Stacking the Deck: The Next Wave of Opportunity in Big Data
A leading venture capitalist explains why Big Data infrastructure market is mostly mature and where lies the next big area of opportunities related to Big Data.
Guest post by Chip Hazard (Flybridge Capital Partners), May 2014.
At the recent Analytics Week conference in Boston where I was on a Panel discussion moderated by Gregory Piatetsky of KDnuggets, I was asked a question as to where we see investment opportunities in the Big Data landscape.
This post will expand on some of my comments from the conference. Importantly, the lens through which I make these observations is from our role as a seed and early stage venture capital investor, which means we are looking at where market opportunities will develop over the next 3-5 years, not necessarily where the market is today.
Over the past few years, billions of dollars of venture capital funding has flowed into Big Data infrastructure companies that help organizations store, manage and analyze unprecedented levels of data. The recipients of this capital include Hadoop vendors such as Cloudera, HortonWorks and MapR; NoSQL database providers such as MongoDB (a Flybridge portfolio company where I sit on the board), DataStax and Couchbase; BI Tools, SQL on Hadoop and Analytical framework vendors such as Pentaho, Jaspersoft, Datameer and Hadapt.
Further, the large incumbent vendors such as Oracle, IBM, SAP, HP, EMC, TIBCO, and Informatica are plowing significant R&D and M&A resources into Big Data infrastructure. The private companies are attracting capital and the larger companies are dedicating resources to this market given an overall market that is both large, ($18B in spending in 2013 by one estimate) and growing quickly (to $45B by 2016, or a CAGR of 35% by the same estimate) as shown in the chart below:
While significant investment and revenue dollars are flowing into the Big Data infrastructure market today, on a forward looking basis, we believe the winners in these markets have largely been identified and well-capitalized and that opportunities for new companies looking to take advantage of these Big Data trends lie elsewhere, specifically in what we at Flybridge call Full-Stack Analytics companies.
A Full-Stack Analytics company can be defined in the following way:
The two points from the above criteria that are especially worth calling out are the concepts of actionable insights and data network effects.
On the concepts of actionable insights, one of the recurring themes we hear from CIOs and Line of Business Heads at large companies is that they are drowning is data, but suffering from a paucity of insights that change decisions they make. As a result, it is critical to boil the data down into something that can be acted upon in a reasonable time frame to either help companies generate more revenue, serve their customers better or operate more efficiently.
On the data network effects, one of the most important opportunities for Full-Stack Analytics companies is to use machine learning techniques (an area my partner, Jeff Bussgang, has written about) to develop a set of insights that improve over time as more data is analyzed across more customers – in effect, learning the business context with greater data exposure to drive better insights and, therefore, better decisions. This provides both an increasingly more compelling solution and also allows the company to develop competitive barriers that get harder to surmount over time – i.e., creates a network effect where the more data you ingest, the more learning ensues which leads to better decisions and opportunities to ingest yet even more data.
In the Flybridge Capital portfolio, we have supported, among others, Full-Stack Analytics companies such as
Each company demonstrates important criteria for success as a Full-Stack Analytics company:
Chip Hazard is a General Partner at Flybridge Capital Partners, where he focuses on Companies and technologies in the information technology sector including cloud computing, Big Data, and enterprise IT.
Related:
At the recent Analytics Week conference in Boston where I was on a Panel discussion moderated by Gregory Piatetsky of KDnuggets, I was asked a question as to where we see investment opportunities in the Big Data landscape.
This post will expand on some of my comments from the conference. Importantly, the lens through which I make these observations is from our role as a seed and early stage venture capital investor, which means we are looking at where market opportunities will develop over the next 3-5 years, not necessarily where the market is today.
Over the past few years, billions of dollars of venture capital funding has flowed into Big Data infrastructure companies that help organizations store, manage and analyze unprecedented levels of data. The recipients of this capital include Hadoop vendors such as Cloudera, HortonWorks and MapR; NoSQL database providers such as MongoDB (a Flybridge portfolio company where I sit on the board), DataStax and Couchbase; BI Tools, SQL on Hadoop and Analytical framework vendors such as Pentaho, Jaspersoft, Datameer and Hadapt.
Further, the large incumbent vendors such as Oracle, IBM, SAP, HP, EMC, TIBCO, and Informatica are plowing significant R&D and M&A resources into Big Data infrastructure. The private companies are attracting capital and the larger companies are dedicating resources to this market given an overall market that is both large, ($18B in spending in 2013 by one estimate) and growing quickly (to $45B by 2016, or a CAGR of 35% by the same estimate) as shown in the chart below:
While significant investment and revenue dollars are flowing into the Big Data infrastructure market today, on a forward looking basis, we believe the winners in these markets have largely been identified and well-capitalized and that opportunities for new companies looking to take advantage of these Big Data trends lie elsewhere, specifically in what we at Flybridge call Full-Stack Analytics companies.
A Full-Stack Analytics company can be defined in the following way:
- they marry all the advances and innovation developing in the infrastructure layer from the vendors noted above to
- a proprietary analytics, algorithmic and machine learning layer to
- derive unique, and actionable insights from the data to solve real business problems in a way that
- benefits from significant data "network effects" such that the quality of their insights and solutions improve in a non-linear fashion over time as they amass more data and insights.
A Full-Stack Analytics platform is depicted graphically below:
The two points from the above criteria that are especially worth calling out are the concepts of actionable insights and data network effects.
On the concepts of actionable insights, one of the recurring themes we hear from CIOs and Line of Business Heads at large companies is that they are drowning is data, but suffering from a paucity of insights that change decisions they make. As a result, it is critical to boil the data down into something that can be acted upon in a reasonable time frame to either help companies generate more revenue, serve their customers better or operate more efficiently.
On the data network effects, one of the most important opportunities for Full-Stack Analytics companies is to use machine learning techniques (an area my partner, Jeff Bussgang, has written about) to develop a set of insights that improve over time as more data is analyzed across more customers – in effect, learning the business context with greater data exposure to drive better insights and, therefore, better decisions. This provides both an increasingly more compelling solution and also allows the company to develop competitive barriers that get harder to surmount over time – i.e., creates a network effect where the more data you ingest, the more learning ensues which leads to better decisions and opportunities to ingest yet even more data.
In the Flybridge Capital portfolio, we have supported, among others, Full-Stack Analytics companies such as
- DataXu, whose Full-Stack Analytics programmatic advertising platform makes billions of decisions a day to enable large online advertisers to manage their marketing resources more effectively;
- ZestFinance, whose Full-Stack Analytics underwriting platform parses through 1000s of data points to identify the most attractive consumers on a risk-adjusted basis for its consumer lending platform; and
- Predilytics, whose Full-Stack Analytics platform learns from millions of data points to help healthcare organizations attract, retain and provide higher quality care to their existing and prospective members.
Each company demonstrates important criteria for success as a Full-Stack Analytics company:
- identify a large market opportunity with an abundance of data;
- assemble a team with unique domain insights into this market and how data can drive differentiated decisions and have the requisite combination of technical skills to develop and;
- manage a massively scalable learning platform that is self-reinforcing.
If your company can follow this recipe for success, you will find your future as a Full-Stack Analytics provider to be very bright!
Chip Hazard is a General Partner at Flybridge Capital Partners, where he focuses on Companies and technologies in the information technology sector including cloud computing, Big Data, and enterprise IT.
Related:
- Boston AnalyticsWeek Panel Highlights: Next Big Thing in Big Data
- CIOReview Top 100 Most Promising Big Data Companies
- Big Data Landscape, v 3.0, analyzed
- Information Management 10 More Big Data Companies
- April 2014 Analytics, Big Data, Data Mining Acquisitions and Startups Activity
- Sand Hill 50 Swift and Strong in Big Data
- CIO Review 20 Most Promising Big Data Companies
- CIO Review 20 Most Promising Data Analytics Companies