Friday 29 Mar 2024
By
main news image

DATA analytics and big data promise to revolutionise marketing. Most companies are sitting on tonnes of data from various sources: financial data, mobile data, transactional data, customer research data, behavioural data, social media data, and so on.

The combination of new analytical techniques, amped-up computer power and instantaneous online resources has resulted in incredibly powerful tools that have changed the game forever. So powerful, in fact, that analytics can go beyond merely lending support to unlocking new opportunities and strategies, as well as opening up possibilities never before imagined.

But the ease of analysing big data also has been overstated. In reality, harnessing big data is still a messy and very labour-intensive business. Take it from two people who do this work for real: some of the hype is doing us a disservice, because it creates a false expectation of how easy this is going to be.  

So that we can start getting real about big data, it’s time to put to rest these commonly heard myths.

Myth #1: It is big

Big data isn’t “big”. It is diverse. “Big” is misleading. What we are talking about is a large volume of data points, updated at high-frequency in real-time, from various sources. It’s very granular. It’s individual transaction data; it’s a certain credit card, paying for a certain amount of gas, at a certain gas station.

Big data is actually lots and lots of very small data. It’s not a landslide of data; it’s a sandstorm. And sandstorms can blind and disorient you. So, to help see in the storm, what other myths do we need to debunk?

Myth #2: You need to apply it right away

Most things in life that are important and worthwhile are difficult, and the analysis of big data is no different. The solution is to take small steps and start with very specific objectives. Think carefully about what you want to do with the information before you start stockpiling data.

Myth #3: The more granular the data, the better

Is real-time and granular data always better? No, it’s not. The first quarter of a football game doesn’t predict how a whole game plays out. Real-time can be too close to the action. Sometimes, you need to pull back for the long shot to reveal what’s really going on.

Big data is encumbered by a huge amount of white noise. The noise as a proportion of the total signal increases with higher resolution, for example, data by minute rather than by week, or data at a town level rather than state. Do not confuse precision with accuracy. Big data, in its raw disaggregate form, can be misleading. There needs to be an appropriate level of aggregation to cancel out all the white noise.

Myth #4: Big data is good data

There is a distinction between a lot of data and a lot of good data. Poor quality data has lots of errors, lots of missing data that can be misleading.

Photographs and videos can be tagged incorrectly, and is unstructured text written by teenagers reflecting a positive or negative sentiment? It takes a smart model to figure that out sometimes. To make sense of data, you need to throw some of it away. To analyse big data, one of the first things you have to figure out is what data to include in your analysis, and what you need to throw away.

Myth #5: Big data means that analysts become all-important

It is often said that big data will see the rise of the analysts, “the new gods of the Information Age”. But the rise of the analytics team is exaggerated. The dramatic increase in data velocity means there’s no time to “brief the analytics team” now. We need fast tools that can cope with the velocity, volume and granularity of the data. Ideally, a small group of master-analysts would leverage technology to empower marketers to do more of their own analytics and scenario-modelling and decision-support. We predict the death of the analytics department, and the rise of self service. The era of the pre-eminence of the data scientist will not last forever — there is just too much data!

Myth #6: Big data gives you concrete answers

Ambiguity is the dominant characteristic of big data. Multiple sources of data (for example, transaction, customer acquisitions and media) can lead you away from what the evidence is telling you. Different data, analysed incorrectly, can yield conflicting evidence. Which data do you believe? Big data requires human judgment to intervene and resolve seemingly conflicting evidence, and that’s where the skilled analyst comes in.

The more data you have, the more likely you are to have contradictions and ambiguities that require resolution. Big data is not all-powerful. Quite the opposite, in fact. More data gives you more witnesses, but doesn’t get you closer to the truth until you leverage experienced human judgment to reconcile conflicting evidence. The future of analytics is all about combining, weighing and judging multiple sources of information and different analyses.

Myth #7: Big data is a Magic 8 Ball

Well, yes, but you need to ask the question in exactly the right way. It’s a bit like when a genie gives you your three wishes. You have to phrase your wishes very carefully. Applying analytics with a lack of precision or detailed hypothesis creation in advance, when dealing with complex data sets such as cell phone or calling network data, can actually lead you astray and give an incorrect answer. You need to ask your questions very carefully of the big data crystal ball.

Myth #8: Big data can create self-learning algorithms

False positives from rogue data (for example, call centre call volume prediction from direct response TV ads) indicate the limits of automated models from a marketing perspective. Rogue data from a Super Bowl weekend could distort an auto-update algorithm.

When set up in the right way, algorithms can be very powerful, but they always require human intervention. Cell phone operators, for example, have demonstrated good use of non-marketing data for marketing. They know who your friends are, they can guess your age, they know the parts of town where you hang out, they know what websites you visit, what apps you use, and when. Insurance companies can use telemetrics for obtaining data for marketing, not just underwriting.

At bottom, debunking these myths is about discarding blind faith that the formulae for business success are set down in the data. Truth is, big data is a tool in itself, like a computer or smartphone — an awesome, game-changing tool, but only when wielded by people who know the right commands and coordinates. — INSEAD Knowledge

Joerg Niessing is an Affiliate Professor of Marketing at INSEAD and James Walker is a partner with Strategy& based in London

This article first appeared in The Edge Malaysia Weekly, on March 16 - 22, 2015.

Save by subscribing to us for your print and/or digital copy.

P/S: The Edge is also available on Apple's AppStore and Androids' Google Play.

      Print
      Text Size
      Share