Most Hadoop Jobs Are In California

Given the recent buzz surrounding Hadoop and MapReduce, I was curious if employers were beginning to mention either term in their job postings. Fortunately I have access to a massive job data warehouse dating back to mid-2005. In partnership with SimplyHired and Greenplum, we maintain a data warehouse that contains most of the online job postings in the U.S.

While the percentage of job postings that mention either Hadoop or MapReduce remains miniscule, the number of such postings is growing steadily:

pathint

The number of Hadoop/MapReduce job postings (during the Feb/Apr 2009 period) grew 49% compared to 2008. In contrast, the tough economic environment has translated to significantly fewer job postings: the total number of online job postings declined 40% during the same period.

How mainstream is Hadoop? While researching our report on Big Data, we talked to a (database) vendor who jokingly claimed that nobody outside of the West & East coast cared about Hadoop. Analysis of recent job postings seems to support that perspective. During the three most recent months, employers in 18 states posted Hadoop/MapReduce jobs online, but 60% of those were in California. The top 5 states (CA, MD, NY, MA, WA) accounted for 87% of the Hadoop/MapReduce job postings:

pathint

Looking at the same period last year, 72% of the job postings were in California, and the top 5 states (CA, WA, TX, PA, VA) accounted for 79%.

Given the presence of large (Google, Yahoo!, Facebook) and small companies (Cloudera, Greenplum, Aster, …) who are leaders in the use of Hadoop/MapReduce, it’s no surprise that at this early stage, a large share of jobs are in California. While the share of California job postings remains high (60%), it’s down from 72% last year. As mentioned above, the percentage of job postings that mention either Hadoop or MapReduce remains miniscule, so I caution against reading too much into the geographic distributions. Nevertheless, it’s clear that California employers are expressing interest in Hadoop skills ahead of their peers in other states.

tags: , ,

Get the O’Reilly Data Newsletter

Stay informed. Receive weekly insight from industry insiders.

  • http://www.alexandertolley.com Alex Tolley

    Is there any reason to not show actual numbers?

  • http://bbot.org/blog/ bbot

    This “conclusion” is so patently obvious as to beg the question of why you bothered to state it. Nobody outside of the east and west coasts care about hadoop/mapreduce because there are no startup hubs outside of the east and west coasts.

    Duh.

    In other groundbreaking news, water is still wet, the Pope is still a fan of praying.

    I would appreciate if Radar could refrain from clogging up my RSS reader with pointless posts in the future.

  • http://friendfeed.com/ralfrottmann Ralf Rottmann

    We’ve got an excellent hadoop/mapreduce and HBase team here in Germany! ;-)

  • http://www.geeksww.com arun

    what is the salary range like for Hadoop and Mapreduce?

  • http://www.nivertech.com Nivertech

    We’ve got some Hadoop/MapReduce experience here in Israel.

  • http://www.pragsis.com PRAGSIS

    Here in Madrid (Spain) Hadoop/MapReduce is not a problem and growing….