Data is the currency for a digital transformation is a theme that came out loud and clear during last week’s Gartner Data and Analytics Summit. This event for the first time brought together two popular conferences – Analytics and Master Data Management (MDM). The result was a very enjoyable time with tons of great conversations and thoughts being shared on our favorite topic – Connected DATA! Below are my top four take-aways from the event.
The opening keynote on Monday laid the foundation for this thought. In order for data to really take its place as the currency behind the digital transformation it need to become easy and really cheap. Traditional data technologies are real expensive and for anything other than structured data is not easy either. It leads to scarcity. Consider that Business Intelligence (BI) still has not penetrated beyond 20 or 25% of the employees in any organization.
Some 2,000 years ago the average worker had to work 50 hours to earn enough money to buy one hour of synthetic light from an oil lamp. Today half a second of work will suffice. Similarly for data, open source Hadoop with its massive scale and ability to run on commodity hardware is well on its way to achieve the first part of the equation about drastic cost reductions.
The internet has been around a long time, but it was only when we got SEARCH that the internet became easy for all of us. Making Hadoop easy is lagging a little, but managed integrated distributions, cloud Hadoop and perhaps more specifically Data Lake 3.0 are getting us to the tipping point.
Another theme that came up is real-time data streaming – data-in-motion and capturing perishable insights at the edges of our landscape. Increasingly the use cases organizations are pursuing demand support for some real-time automated decision logic pushed down to devices or sensors. Think about real-time promotions for retail. Or sensor data from manufacturing production lines detecting an anomaly. No one wants to find out we just produced 1,000 items that will not pass our quality assurance tests. Today’s connected data architecture need to provide the intersecting of the data-in-motion with our data-at-rest to really unlock actionable insights.
One of the benefits of events like this is talking to many folks 1 on 1. What is interesting is what they did not ask me as a Hadoop provider. That’s right – no questions on “what is Hadoop?” The questions are around business outcomes, what can we do with it, how do we deploy self-service BI with Hadoop. Hadoop has matured beyond the science fair project and are being employed in production to solve business critical problems.
Data itself does not provide insights. Sam Esmail, writer and producer of the TV series Mr Robot suggested that it is when we combine data and analytics with our human emotions, experiences, and even gut feel then we create the insights that alter outcomes. The other inspiration for this point came from Tim Harford speaking of how frustration makes us creative. His point being that when we are most alert is when we are most creative. And we are most alert when we are out of our comfort zones. But he shared his talk via a fantastic story – stories are memorable. If we want our data and insights to change behaviors and inspire we have to tell stories with our data.
If you have embarked on your data journey and want to measure where you are versus your peers, have a look at our Big Data Scorecard and get your own score.