The thing is, beyond the hyperbole (and of course the ridiculous notion that data can be big or small or even mid-sized) incredible things are beginning to happen with data that affect the products and services we use, how we innovate and even how we understand the world around us.
More and more we are using big data services to help us in our personal lives, they recommend our purchases, answer our search queries, even translate our languages and every day, through the beauty and wonder that is machine learning, they get _better_.
Having access to more and more data, combined with technological advances like the cloud which provide seemingly limitless storage and compute power we are able, finally to start to harness the incredible power and potential it offers not just society at a broad level or just to huge organisations like Microsoft, Google and Facebook but we also start to get to a point where that power becomes accessible to every individual and every single business.
As with all such major advancements, we’ll face our fair share of challenges too; some will be technical – we’re still looking for the needle, but now it’s in a billion haystacks, some will be cultural – how do you ensure that data is accessible and of sufficient quality? And some will be just plain hard – like in a world of data and machine learning, what happens when the algorithms take over?
As it turns out, bandwagon or no, big data is crucial to our respective success. Don’t believe me? Well, why not waste 30 minutes of your life listening to me trying to convince you. This is a presentation I gave at this year’s Turing Festival trying to make exactly that point. (You can also download the slides here).
Like it or not, the world of big data is here – it is now up to us to figure out how to make best use of it.