Successfully predicting which product innovation may become the next big hit is impressive. Entrepreneurs that can see in their Crystal Balls the future succes, become rich and end up on the cover of Time magazine. The underlying assumption is that managers and entrepreneurs who predicted that a new product would be successful, have better intuitive judgment and a superior evaluation of the situation at hand. Is this really the case or does data science tell us otherwise?
Intuition
There is a simple reason why intuition may be wrong. Rather than being an indication of good judgment, accurately forecasting a rare event such as new hit may be an indication of poor judgment. To put it differently: poor forecasters are more likely to make extreme predictions. Because extreme outcomes are scarce, managers who take into account all the available information are less likely to make such extreme predictions. Manager on the other hand who rely on heuristics and intuition are more likely to make extreme predictions.1
To illustrate how this effect works we turn to the Wall Street Journal. Every six months, the Wall Street Journal asks about 50 economists and analysts to forecast a set of macroeconomic statistics for the next six months. Dr. Sung Won Sohn, CEO of Hamni Financial Group, achieved first place by being one of a few who correctly predicted a high inflation rate when the consensus forecast was low. Dr. Sohn credited his unusually high but accurate inflation forecast to an intuition he developed after visiting a California jeans producer. The producer could not keep up with demands for its $250 jeans. According to the Wall Street Journal, “He figured ‘there must be money out there if people are willing to pay that much’ for blue jeans.” Such methods do not always work; in the preceding two surveys, Dr.Sohn was ranked 43 and 49 out of 55.
Implications for innovation
The fallacy of prediction accuracy may have profound implications for innovation. Consider the discussions of the failures of incumbent firms to predict and react to new “disruptive” technologies. Few emerging technologies or business models are disruptive and are not easy to detect.2
Because the base rate, the frequency of disruptive innovations, is low, rational forecasters will rarely bet that new technology is disruptive. Irrational forecasters, who ignore the base rate and evaluate signals differently, are more likely to make such calls.
This line of reasoning suggests that the failure to predict what technologies will become disruptive is not necessarily a sign of poor judgment, flawed mental models, or inertia. Instead, it may be an indication of sound judgment. In such situations, rational individuals will appear as inert and non-responsive, whereas irrational individuals will appear agile and responsive.
A prediction backed by data science
Rather than relying on human intuition, data may provide a means to help make more sound decisions and alleviate over reaction to weak signals. To illustrate how data science may help, let’s try to predict the next big music hit.
We gathered a dataset of 3000 thousand songs. Some of these songs have made it to the Billboard Top 100, some of them did not. Why? We took a closer look at the properties of a song itself and the artists, to see if they might help us in predicting what will be the next hit on the Billboard Top 100. We used the properties of a song as provided by Spotify.
How to predict a hit with data science?
With a couple of models and analysis, we tested which variables are important to predict a hit song. The methods provided us with a robust way of assessing the importance of each variable in our model. The plot below denotes the importance of each variable. Also, we tested whether a variable had a significant and relevant contribution or not.3

It might seem obvious and self-evident but having scored a previous Billboard hit increases the probability of scoring another hit (the artist score). Succes creates succes! Fortunately, previous success is not all there is. For it would limit the chance for any new musician or band to become successful in the future. Instrumentalness, danceability, acousticness and loudness are also great song properties to explain future success. Maybe opposite of what you might think, the key and mode of a song have no significant predictive value.
The properties are not static. Amongst the top four, we saw for example that more instrumentalness decreased significantly the change of scoring a hit. Whereas more danceability made the charts explode;-)

How did we do?
To see if our model performs well, we used the test data to compare our predictions from the model with actual results. Using these statistics, we can calculate how accurate our model is. Our so called F1-score4) is 0.81. Which is much better than random chance ( 50 / 50 ). Obviously a 0.98 score would have been even better. But predicting a hit is never easy, not even for data science. We are still working on it;-)
Our analysis does however provide insights into which factors are important, whereby reducing some of the uncertainty. It even provides guidelines which may be for musicians (or machines) used to compose great hits. Or in management language, better decisions.
Take Away
Innovation has a lot to do with making decisions under uncertainty. While some guru’s and innovators may appear to have an unusual good business sense, it is more likely that over the long run this is not sustainable. Very few people get it right, every time.
Taking a data driven approach can help determine which signals are important and which are not in a systematic way. Forecasters who often make bold predictions on intuition, are likely to be those that overreact to weak signals. Next time, don’t only listen to self-righteous innovation guru’s but apply data science to reduce uncertainty and make bets which are based on data instead of the loudest voice in the room.
References
Denrell, Jerker, and Christina Fang. 2010. “Predicting the Next Big Thing: Success as a Signal of Poor Judgment.” Management Science 56 (10). INFORMS: 1653–67.
Kursa, Miron, and Witold Rudnicki. 2010. “Feature Selection with the Boruta Package.” Journal of Statistical Software, Articles 36 (11): 1–13.
Sood, A, and G J Tellis. 2011. “Demystifying disruption: A new model for understanding and predicting disruptive technologies.” Marketing Science. pubsonline.informs.org.
- Please see (Denrell and Fang 2010) for a complete account of this phenomenon↩
- Please see (Sood and Tellis 2011) on disruptive technologies↩
- We use a method called Random Forest Analysis (RA) to predict a hit song. To understand which variables are important and which are not for the model we use the Boruta method (Kursa and Rudnicki 2010), we tested which variables are important to predict a hit song. The methods provided us with a robust way of assessing the importance of each variable in our model.↩

Bob Rietveld
Head of Growth Analytics
Related Posts
January 7, 2021
Strategies to counter disruption or to become a disrupter yourself
We see the same things happening in the…
November 3, 2020
Why Innovation is Crucial to Your Future Success
You don’t want the competition to take…
October 1, 2020
3 Winning models for Innovation Brainstorms. Part 3: Innovation Ambition Matrix
This post is the final of three that…
September 24, 2020
3 Winning models for Innovation Brainstorms. Part 2: Four Lenses of Innovation
This post is the second of three that…
September 10, 2020
3 Winning models for Innovation Brainstorms. Part 1: Ten Types of Innovation
This post is the first of three that…
August 13, 2020
5 Growth Mindset Examples That You Can Use in Your Job Tomorrow
People who believe their success is…
August 13, 2020
First-Mover Disadvantage: 9 Reasons Why Being First to Market Doesn’t Pay Off
Strongly popularized during the last 25…
August 6, 2020
5 Ways to Become an Innovator in Your Industry
July 23, 2020
Why Lean Startup Doesn’t Always Work in Corporates as it Does in Startups
Over the last few years, Lean Startup…
July 16, 2020
How to define your North Star and why does it matter?
In order to create something new for…
April 22, 2020
Why customer lifetime value analysis is now more important than ever
Over the course of the last weeks we,…
April 16, 2020
Making data driven predictions about the spread of COVID19
How will the COVID19 spread? How many…
April 15, 2020
The three stages of growth: Initiate – Create – Scale
When we took a closer look at the…
April 10, 2020
Leonardo da Vinci – the quintessential growth entrepreneur
Leonardo da Vinci blended intense…
April 1, 2020
Innovation needs its fair share of realism – the flipside of creativity
The adventurer immerses himself in…
April 18, 2019
How to Design Winning Business Models in a Digital World
The five main take-aways to become a…
March 27, 2019
What Is a “Big Hairy Audacious Goal” (And Why Should You Know)?
Spoiler alert: a BHAG will inspire your…
March 13, 2019
7 Cognitive Biases and How to Use them in Marketing & Sales
Consumer behavior is shaped by the same…
March 4, 2019
9 Psychological Tricks to Influence Consumer Behavior (and Grow Your Business)
As marketers and salespeople, you…
March 1, 2019
How To Work As a Lean Startup in a Big(ger) Organization
The Lean Startup approach can give big…
February 27, 2019
4 Reasons Why Startups Are Great Investment Opportunities
The partnership between bigger, mature…
February 22, 2019
What I Learned From Amazon’s Jeff Bezos: How To Stay Customer-centric
Amazon is known as one of the most…
February 20, 2019
What is the North Star Metric and Why Does It Matter?
Sean Ellis defines the North Star…
February 15, 2019
7 Business Revenue Models That Will Inspire You
A smart revenue model is the core of…
February 13, 2019
Atomic Habits: How to Get a Little Better Every Day
There is much that business leaders can…
February 11, 2019
The Top 7 Podcasts That Help You Grow Your Business
There are many examples of podcasts…
February 6, 2019
What Is Reviewification, and Why Is It Changing Consumer Behavior?
Customer reviews are all around us and…
February 4, 2019
How 3 Businesses Thrived by Applying Lean Startup
Lean Startup really works. Meet these…
January 25, 2019
The Readability Rulebook: How to Write More Effective Copy
Your online copy's readability is…
January 23, 2019
If You Want To Boost Organizational Growth—Do This!
If you want your organization to grow,…
December 24, 2018
You Want to Create a Partnership or Joint Venture? Read This Checklist First!
For a big corporation, a partnership…
December 17, 2018
Want to Optimize the Customer Journey? Try These Tools!
The concept of the "customer journey"…
December 12, 2018
So You Want to Buy a Startup? Don’t %$@#! it Up!
When acquiring a startup business,…
December 10, 2018
How I Used a Go-To-Market Plan to Innovate Home Decoration
This is an inspiring example of a…
November 27, 2018
How To Build a Growth Roadmap; a Step-by-step Approach
At RevelX, we believe in the advantages…
November 19, 2018
How Your Business Benefits From a Growth Roadmap
A growth roadmap is a document in which…
November 15, 2018
How To Accelerate Your Performance Management
Performance management can be described…
October 22, 2018
8 Inspiring Examples of a Minimum Viable Product
How Amazon, Google and BDRThermea used…
October 9, 2018
Why Multi-disciplinary Growth Teams are a Necessity for Business
Best-in-class innovators recognize the…
October 8, 2018
Ideation Process Was Awesome, But Don’t Let It Sit on the Shelf
The ideation process feels sometimes as…
October 1, 2018
Why You Need a Go-To-Market Plan (and How to Create It)
Just launching a product can result in…
September 26, 2018
Experimentation Culture: What I Learned from the Beatles
The Beatles knew that creativity is not…
September 25, 2018
What Is the Platform Economy (and Why You Should Care)?
"Digital matchmakers" such as Amazon,…
September 10, 2018
10 Types of Innovation, 3 Horizons of Growth, and How To Use Them
Innovation models can help your…
September 5, 2018
How Value Proposition Design Makes You a Winner
Many teams struggle with defining a…
August 29, 2018
What Is a Growth Mindset (And Why Should You Know About It)?
“Growth mindset” is a concept from the…
August 3, 2018
Jeroen van der Vlugt on Why Sports Innovation Is Important
"Sports innovation never stops, that is…
July 30, 2018
How Augmented Reality Improves the Shopping Experience
Augmented Reality is changing the way…
July 25, 2018
So You Want to Innovate? Here are 8 Drivers for Success!
What makes the difference between…
July 23, 2018
Before You Start Growth Hacking…Fix the Plumbing!
Before you start growth hacking, there…
July 17, 2018
3 Ways External Data Can Help Grow Your Business
We’ve all heard that we should be using…
July 10, 2018
How “Minority Report” Predicted the Internet of Everything
Today, individuals, devices, and…
July 6, 2018
4 Reasons Why Algorithms Are Crucial To Today’s Businesses
Search engines, social media and…
July 2, 2018
Accelerator versus Incubator: 5 Differences that Will Impact Which Model You Should Choose
Accelerator and Incubator programs both…
June 29, 2018
7 Tools that Offer Direct Scheduling to Instagram
For years, scheduling Instagram posts…
June 22, 2018
How to Deal with the Industrial Internet of Things (and Why You Should)
The adoption of IoT in industry is just…
June 20, 2018
3 Industries that Will be Disrupted by Blockchain Technology
Cryptocurrency and blockchain…
June 13, 2018
Vanity Metrics vs. Actionable Metrics: Measure What Matters
Measuring and analyzing data is one of…
June 7, 2018
Inside-out or Outside-in? 4 Reasons Why Your Business Has to Change
In the old days, a business model was…
June 1, 2018
How Amazon, Google, and Belsimpel Perfected the Customer Journey (And How To Apply These Lessons)
Some companies confuse the different…
May 30, 2018
Raphael Nouwen (Triodos Bank): This is Why Investors Say ‘No’!
"Remember, 'no' is not necessarily a…
May 16, 2018
Business Strategy: 4 Steps to Win the Innovation Battle
To innovate successfully, you will need…
May 9, 2018
Fail Hacks: 6 Amazing Tricks to Kill Your Conversion Rates
Read these amazing “fail hacks” that…
May 7, 2018
Digital Growth Hacker Marketing: The Ultimate List of Amazing Case Studies
24 inspiring examples of growth-hacker…
April 30, 2018
Artificial Intelligence Is Not the Answer To All Marketing Challenges (and That’s OK)
The possibilities of artificial…
April 24, 2018
4 Amazing Tips to Optimize Your Landing Page and Generate More Leads
To generate a maximum number of leads,…
April 17, 2018
4 Trends That Shape the World of Digital Marketing (and how to apply them)
To keep ahead of your competition, you…
April 13, 2018
Checklist: 3 things to cover privacy issues when using website conversion pixels
Setting up conversion pixels are useful…
April 11, 2018
Digital Ballgame: Why A/B Testing All Day Long Works!
The more you test, the better you will…
April 9, 2018
5 Reasons Why You Need Content to Enhance the Customer Experience
Excellent content is a must for every…
April 6, 2018
Innovation is the Key to Keep Healthcare Accessible for Everyone
Saturday, World Health Day is…
April 4, 2018
The Internet of Things is Everywhere – When Do You Step In?
Many businesses still don't take…
March 26, 2018
Futurism Is No Longer a Trend; It’s a Necessity
Due to continually changing markets, it…
March 21, 2018
Transportation in 2049: Even More Awesome then in Blade Runner
Did you like the new Blade Runner…
March 20, 2018
3 Examples of Failed Commercial Performance (and What to Learn From Them)
The chain is no stronger than the…
March 19, 2018
Learn from the Best: 5 Habits that Grow Your Business (Part 2)
In the first installment of this…
March 16, 2018
Learn from the Best: 5 Habits that Grow Your Business (Part 1)
Successful individuals and companies…
March 15, 2018
Futurism: 5 Must-read Blogposts on Cryptocurrencies and Blockchain
We have curated the best blogposts…
March 14, 2018
Low-hanging Fruit: 9 Growth Hacks You can use TODAY
For real growth, a long-term strategy…
March 13, 2018
Why Big Corporations Should Partner with Digital Startups
What do the CIA, Microsoft, and…
March 12, 2018
What I Have Learned From YouTube: How to become more customer centric
YouTube is one of the biggest successes…
March 9, 2018
Futurism: 4 Trends that are Disrupting the Manufacturing Industry
The Fourth Industrial Revolution is…
March 8, 2018
Quantum Computing: The Disruption that will Disrupt Other Disruptions
The supercomputer is coming! This…
March 5, 2018
Partner Vision: Eric de Groot on Customer-centricity
“If I have a couple of CEOs in the…
February 19, 2018
3 Reasons Why Consumer Behavior is Changing (and What to Do About It)
This is not the time to wait patiently…
January 18, 2018
How 3 Classic Business Principles are Updated by Big Data
September 11, 2017
Growth and Onboarding: the 3 best tips for successful user onboarding
10 common misconceptions on writing…
February 2, 2017
3 Ways to Innovate Consistently – Without Spending a Fortune on R&D
Each industry has numerous…
January 30, 2017
Steal like Apple: 4 Perspectives on Innovation via Idea Theft
How did Apple manage to continue…
January 6, 2017
How to grow your business without the ‘Big’ in front of ‘Data’
Big Data to improve commercial…
December 12, 2016
10 Perspectives on Building a Culture of Innovation
The business case for stimulating…
December 8, 2016
How NASA is Getting Their Ass Kicked by SpaceX
For years NASA was the backbone of and,…
October 20, 2016
7 Neuromarketing Basics to ‘Hook’ New Customers
In the past, neuromarketing was limited…
September 26, 2016
10 irrational tips for writing winning proposals
10 common misconceptions on writing…