Collecting, Aggregating, and Analyzing Data Exhaust

Next week, O’Reilly’s Research Director Roger Magoulas, will lead an exciting panel discussion on Big Data. The focus will be on the piles of data that companies have been collecting, and are just beginning to analyze:

The internet and social media create a mountain of random, unstructured, and at times ephemeral data by-products, which may appear to be trash. Yet, one person’s trash is another’s treasure. From FaceBook to Netflix, people are spending more time sharing their thoughts, opinions, plans and perspectives as they socialize and conduct business online. With each of these Internet exchanges traces of information,or Data Exhaust, are left behind. When correlated or combined, these snippets can provide insight into political views, professional achievements, purchasing behaviors, and demographic information—pinpointing trend setters and leading indicators. Brilliant innovators now re-purpose this data stream, aggregating and analyzing the data to provide new products or services.

Next Tuesday’s panel discussion and networking event will be held at the Stanford Business School. Further details are available on the VLAB web site.

(†) Recent Radar posts on Big Data: (1) Counting Unique Users in Real-time with Streaming Databases, (2) Pipelining and Real-time Analytics with MapReduce Online

tags: , , , ,