"government" entries

Three kinds of big data

Looking ahead at big data's role in enterprise business intelligence, civil engineering, and customer relationship optimization.

Photo of the columns of Castor and Pollux by OliverN5 on FlickrIn the past couple of years, marketers and pundits have spent a lot of time labeling everything “big data.” The reasoning goes something like this:

  • Everything is on the Internet.
  • The Internet has a lot of data.
  • Therefore, everything is big data.

When you have a hammer, everything looks like a nail. When you have a Hadoop deployment, everything looks like big data. And if you’re trying to cloak your company in the mantle of a burgeoning industry, big data will do just fine. But seeing big data everywhere is a sure way to hasten the inevitable fall from the peak of high expectations to the trough of disillusionment.

We saw this with cloud computing. From early idealists saying everything would live in a magical, limitless, free data center to today’s pragmatism about virtualization and infrastructure, we soon took off our rose-colored glasses and put on welding goggles so we could actually build stuff.

So where will big data go to grow up?

Once we get over ourselves and start rolling up our sleeves, I think big data will fall into three major buckets: Enterprise BI, Civil Engineering, and Customer Relationship Optimization. This is where we’ll see most IT spending, most government oversight, and most early adoption in the next few years. Read more…

Four short links: 29 June 2012

Four short links: 29 June 2012

Personalized Education, Programming Living Data, The Invisible Economy, and State vs Internet

  1. Personalization (Chris Lehmann) — We should be careful about how we use that term, and we should be very skeptical of how well computerized programs can really personalize for kids. Most of what I see – especially from curriculum and assessment vendors – involves personalization of pace while still maintaining standardization of content. This.
  2. Unveiling Quadrigram (Near Future Laboratory) — a Visual Programming Environment to gather, shape and share living data. By living data we mean data that are constantly changing and accumulating. They can come from social network, sensor feeds, human activity, surveys, or any kind of operation that produce digital information.
  3. Tim O’Reilly at MIT Media Lab (Ethan Zuckerman) — a great recap of a Tim talk. There’s an interesting discussion of the unmeasured value created by peer-to-peer activities (such as those made dead simple by the Internet), which is one of the new areas we’re digging into here at O’Reilly.
  4. The State vs the Internet (David Eaves) — we’ve all seen many ways in which the Internet is undermining the power of nation states. A session at Foo asked how it was going to end (which would give way first?), and this is an excellent recap. It could be that the corporation is actually the entity best positioned to adapt to the internet age. Small enough to leverage networks, big enough to generate a community that is actually loyal and engaged.

Top stories: February 20-24, 2012

Data for the public good, the coming health IT revolution, big data in the cloud.

This week on O'Reilly: Alex Howard examined data's civic role, Dr. Farzad Mostashari discussed health IT and patient empowerment, and Edd Dumbill surveyed big data cloud offerings.

Data for the public good

From healthcare to finance to emergency response, data holds immense potential to help citizens and government.

The explosion of big data, open data and social data offers new opportunities to address humanity's biggest challenges. The open question is no longer if data can be used for the public good, but how.

Four short links: 7 November 2011

Four short links: 7 November 2011

City Finances, Low-Power Computers, Future History, and Learner's Mindset

  1. California and Bust (Vanity Fair) — Michael Lewis digs into city and state finances, and the news ain’t good.
  2. Tonido Plug 2 — with only watts a day, you could have your own low-cost compute farm that runs off a car battery and a cheap solar panel.
  3. William Gibson Interview (The Paris Review) — It’s harder to imagine the past that went away than it is to imagine the future. What we were prior to our latest batch of technology is, in a way, unknowable. It would be harder to accurately imagine what New York City was like the day before the advent of broadcast television than to imagine what it will be like after life-size broadcast holography comes online. But actually the New York without the television is more mysterious, because we’ve already been there and nobody paid any attention. That world is gone.
  4. Zen and the Art of Making (Phil Torrone) — thoughts on the difference between beginners and experts, and why the beginner’s mindset is intoxicating and addictive.

Strata Week: IBM puts Hadoop in the cloud

IBM taps the cloud to make Hadoop easier, Factual cleans geo data, Google gets transparent with gov data requests.

IBM targets businesses with a cloud-based Hadoop product, Factual tackles incomplete geo records, and Google embraces transparency by publishing and explaining the data requests it gets from governments.

Why don't they get it?

Tech predictions focusing only on technology miss a key component: people.

If you comment on new technology, you should get to know as many of the quirks and biases of human behavior as you can. That's because you're modeling people first and technology second.

Developer Week in Review: The unglamorous life of video game developers

To live and die making "L.A. Noire," unsensible censors, and the top 25 ways to get PWNED

The folks who make video games sound the alarm bells on working conditions, governments try to break the Internet, and MITRE unveils 2011's most dangerous software errors.

ePayments Week: Where adds context to PayPal

Ebay buys Where, the White House wants identity protection, and researchers find interesting data about themselves on the iPhone.

EBay's purchase of a mobile advertising and check-in service adds another piece to its mobile payment puzzle. Also, the White House calls for an online identity ecosystem and two researchers discover caches of location data left unencrypted on their iPhones.

Search Notes: Google and government scrutiny

Google's dominance draws attention from governments and courts, and it's time to say goodbye to AllTheWeb

In this edition of Search Notes: Google continues to be a top traffic source, governments and courts want to know more about Google's methods, and AllTheWeb takes a final trip to the great Internet in the sky.