Earlier this month, more than 2,500 people came together for the O’Reilly Strata Conference in Santa Clara, Calif. Though representing diverse fields, from insurance to media and high-tech to healthcare, attendees buzzed with a new-found common identity: they are data scientists. Entrepreneurial and resourceful, combining programming skills with math, data scientists have emerged as a new profession leading the march toward data-driven business.
This new profession rides on the wave of big data. Our businesses are creating ever more data, and as consumers we are sources of massive streams of information, thanks to social networks and smartphones. In this raw material lies much of value: insight about businesses and markets, and the scope to create new kinds of hyper-personalized products and services.
Five years ago, only big business could afford to profit from big data: Walmart and Google, specialized financial traders. Today, thanks to an open source project called Hadoop, commodity Linux hardware and cloud computing, this power is in reach for everyone. A data revolution is sweeping business, government and science, with consequences as far reaching and long lasting as the web itself.
Where to start?
Every revolution has to start somewhere, and the question for many is “how can data science and big data help my organization?” After years of data processing choices being straightforward, there’s now a diverse landscape to negotiate. What’s more, to become data driven, you must grapple with changes that are cultural as well as technological.
Our aim with Strata is to help you understand what big data is, why it matters, and where to get started. In the wake the recent conference, we’re delighted to announce the publication of our “Planning for Big Data” book. Available as a free download, the book contains the best insights from O’Reilly Radar authors over the past three months, including myself, Alistair Croll, Julie Steele and Mike Loukides.
“Planning for Big Data” is for anybody looking to get a concise overview of the opportunity and technologies associated with big data. If you’re already working with big data, hand this book to your colleagues or executives to help them better appreciate the issues and possibilities.
Related data reports and ebooks