To use data to disrupt, you must be able to see and understand all the signals faster than your competitors, so you can predict faster and disrupt rather than be disrupted.

Edison, the inventor of the incandescent lightbulb, created the right environment for innovation, using a laboratory containing what he perceived as all of the key materials to make change.  Each of his buildings in Menlo Park and Newark, New Jersey, had all the necessary tools, machines, materials, and skilled personnel housed within the complex. This allowed him to have small teams working on several problems at once and streamlining the disruption process.

What you need is a new approach, which is on offer through a concept becoming known as the ‘big data lab’.

Like Edison’s example, this lab becomes the access point to all data including external as well as internal, and transcending silos.  Rather than delivering a system of record, it is a system of innovation.  This is because it enables users to see all the relevant data in one place, understand its potential, enrich the data and make it better. In this way, it becomes possible to unlock insights and share the value, all in a highly visual and intuitive manner.

This ability to provide data to non-technical people has the impact that it accelerates its usefulness, potentially enhancing its value.  Users can start to experiment and test hypotheses quickly in a low-to-no risk environment.

Leave the past in the past
The tools of the past put bias into the data because it had to be structured into the yes/no format of the relational database.  Today’s new technologies don’t have that rigidity of structure and facilitate open ended and ‘what about?’-type questions.  This can be a very scary change for some.

Here’s an example of what a data lab approach can mean to a media and communications company.  Say currently it gets half of its multi-billion-dollar revenue the old-fashioned way – from ads.

To keep that spend up and potentially increase it, the company needs to offer its advertisers the best value. To do that, it has to be able to target right down to the individual set top box.

By using data for customer insight to combine and enrich data from set top boxes with customer data to create better models, the organisation can better understand customer preferences. It can experiment with ways to provide additional value, which can translate to more revenue from network partners, happy subscribers, and innovation by monetising data as a new revenue stream.

No excuse
Contemporary excuses for not harnessing data driven decision-making are fading fast.  Workers are becoming increasingly data literate. And the advent of powerful data visualisation tools is putting insight into the hands of everyone, and fast.

In fact, the economics of cloud for BI are staggering.  If you are just looking at one dimension: the time to provision, it takes approximately six months to setup an enterprise environment for on-premises analytic applications.

With cloud, that can take as little as six hours.

In terms of effort, what you are looking at is as little as a three step process to provision the cloud, compared to 84 in your own environment.

This is enabling us to re-imagine how analytics and data play in the world today, and empowering a completely different approach.

Powering an innovation sprint
This is going to power a time of change.  Why?  Because what we see is that innovation, which is so essential in business today, happens in short sprints, not long marathons.

Gartner refers to this as ‘bimodal IT’ – where you have the traditional, stable and efficiency driven IT, alongside experimental, agile environments that are tightly aligned with business units.  What this enables is two speeds within the business: a sprint and a marathon.

It empowers the non-techie business person to be able to sprint and do something quickly to see if there’s value. Then that learning can be taken and put it into the marathon that moves from experimentation to implementation.

That’s a hard thing to get right, and many companies still don’t realise they need to change their processes and culture, as well as upgrade their skills, as they evaluate what new technology can do for them.

Close coupled
It’s also essential that these discovery projects are tightly connected into the broader organisation before any experimentation goes too far and can’t be commercialised, either because there’s no budget, corporate appetite or the fact that the pilot just can’t be scaled to production effectively.  There are few success stories from organisations that use standalone visualisation tools – with little or no overriding governance, security, integrity, consistency, or ability to scale.

We are the first generation to use these tools, and undoubtedly, we will learn and we will get better at it.  For those at the forefront of experimenting with data, the key things to remember are that innovation happens in short sprints, and therefore what we need to make this happen is more sprinters than marathon runners.

ABOUT RICH CLAYTON//

Rich Clayton is VP at Oracle’s Business Analytics Product Group