Projects that utilise big data or advanced analytics are increasingly popular but present a heightened risk of failure, according to Gartner Inc, unless businesses follow best practices.
“Although big data and advanced analytics projects risk many of the same pitfalls as traditional projects, in most cases, these risks are accentuated due to the volume and variety of data, or the sophistication of advanced analytics capabilities,” said Alexander Linden, research director, Gartner. “Most pitfalls will not result in an obvious technical or analytic failure. Rather they will result in a failure to deliver business value.”
Failure to properly understand and mitigate the risks can have a number of unintended and highly impactful consequences. Those can include loss of reputation, limitations in business operations, losing out to competitors, inefficient or wasted use of resources, and even legal sanctions.
Gartner also predicts that, by 2018, 50 per cent of business ethics violations will occur through improper use of big data analytics.
Businesses can prevent these consequences by implementing the following best practices:
1. Linking analytics to business outcomes through benefits mapping
Analytics must enable a business decision maker to take action, and that action should have a measurable effect – whether the effect is directly or indirectly achieved. Linking analytic outputs to traceable outcomes using a formal benefits-management and mapping process can help the analytics team navigate the complexities of the business environment, and keep analytic efforts both relevant and justifiable.
2. Investing in advanced analytics with caution
Many organisations believe that big data automatically requires advanced analytics. However, the data-crunching power required to manage the big data characteristics of volume, velocity and variety does not inherently require any more sophisticated algorithmic processing. It is the complexity of the analytical question to be addressed that drives the need for advanced analytic tools, and in many cases desired outcomes can be achieved without resorting to more sophisticated analysis.
3. Balancing analytic insight with the ability of the organisation to make use of the analysis
Because analytics can only be beneficial in organisations that are willing to embrace change, it makes sense to limit investment in analytics to a level that matches the organisation’s ability to use the resulting insights. Analytics may not be the most suitable approach:
- If pertinent data is absent
- When here are high levels of ambiguity
- Where there are entrenched opposing points of view
- In highly innovative or novel scenarios
In these cases, scenario planning, options-based strategies, and critical thinking should also be incorporated into analytical approaches to better support the organisation’s ability to take action.
4. Prioritising incremental improvements over business transformation
Using big data and advanced analytics to improve existing analyses, or to incrementally update and extend an existing business process, is easier than using them to deliver business transformation, because there are fewer dependencies to overcome to ensure success. Care should be taken to validate the level of overall change required. In some cases, deep reform of the business strategy may still be necessary – for instance, when a new disruptive vendor enters a market, when technology innovation changes the business model, or when an organisation has become dysfunctional.
5. Considering alternative approaches to reaching the same goal
Few objectives can only be achieved in one way. Statistical modelling, data mining and machine learning algorithms all provide means of testing ideas and refining solution propositions. Big data and advanced analytics help validate proposed hypotheses and open an even wider range of potential approaches to addressing corporate priorities. Not all problems even require a fully engineered analytical solution. Investment may be better targeted on human factors, re-education or reframing the problem.
Gartner provides more detailed analysis and guidance in the report, ‘Seven Best Practices for Your Big Data Analytics Projects’.