Everyone wants the potential value of big data – a mine of essential insights derived in near real time from the data collected from myriad sensors and monitoring systems through any industrial operation. Ironically, however, the problem and challenge of big data is its very bigness. Most enterprises have terabytes of information already stored in databases with more flooding in every day. It’s overwhelming! Where does a company begin to get a handle on and derive value from this vast body of data?
In a fascinating article in Design World, Emerson’s Derek Thomas, takes on the big data problem with truly useful and practical suggestions. He says the temptation is to tackle the issue with mega-scale projects ambitiously gathering all the data from various sources into a data lake. He describes the issues with this approach and says, “During this process, it’s easy for a company to focus on the infrastructure and technologies instead of the problem, which can lead to discouragement due to the complexity, cost, and scale of implementation.”
That’s why Derek says it makes more sense to tackle the big data problem one little data project at a time. This approach greatly reduces the field of view to a specific, defined source and need, reduces the complexity and simplifies the search for a solution. A little data approach yields real tangible improvements and creates positive momentum by allowing users to find, solve, improve, and move on quickly.
One key technology is required to take the little data approach is edge computing, whereby data produced by field devices is analyzed by a field-located controller to generate insight. This information can be supplied to the right personnel, close to the source for appropriate action.
Derek goes on to describe in some more detail how edge computing allows tackling the big data elephant one bite at a time. Read the article here to learn more about manageable ways to glean real value from collected data. And to learn more about how to bring your operations into the world of IIoT one step at a time, visit the advanced automation and control section of the Emerson website.
If you were to tackle your big data with a little data approach, where would you begin? What little data project would you undertake first?