Key technologists behind the Berkeley Data Analytics Stack (BDAS) have launched a company that will build software – centered around Apache Spark and Shark – for analyzing big data. Details of their product and strategy are sparse, as the company is operating in stealth mode. But through conversations with the founders of Databricks, I’ve learned that they’ll be building general purpose analytic tools that can leverage HDFS, YARN, as well as other components of BDAS.
It will be interesting to see how the team transitions to the corporate world. Their Series A funding round of $14M is being led by Andreessen Horowitz. The board will be composed of Ben Horowitz, Scott Shenker, Matei Zaharia, and Ion Stoica.
I’ve written about Spark and the other components of BDAS in numerous posts and have been an avid user of this set of tools for the past year and a half. BDAS appears to benefit from having a company dedicated to building features for enterprise users. With extra resources and a newfound focus, Databricks founders believe their company will accelerate the maturation of Spark, and other components of BDAS.