Our Future World: Freedom (and Daemon)

by Brady Forrest | @brady | comments: 1

I just read FreedomTM the second and latest book in the Daniel Suarez's Daemon series. It was a fun, thought-provoking read and I recommend it to any technologist or sci-fi junkie (it would also make a nice Christmas gift for your favorite conspiracy theorist). This review will focus primarily on the technology of FreedomTM, but I recommend that you start with the first book, Daemon.

The Daemon series is an exploration of a could-be-now, constantly connected society. Suarez has taken cutting edge technology and inserted it into everyday life. It's a great exploration of where our society might be headed. In many ways it reminds me Cory Doctorow's excellent Little Brother. Cory's young-adult novel is a great primer for hacker and maker culture. Daemon serves a similar purpose providing a primer for what a networked society that is structured like MMORPG will look like.

The Daemon series is heavy on real world tech (and Suarez has cataloged much of it). After the jump I talk about some of the technology used in the book. Although I will not reveal plot points that aren't on the book cover, these could be viewed as Spoilers. So Reader Be Warned!

(continue reading)

Haiti: OSM and Sat Imagery for Free iPhone App

by Brady Forrest | @brady | comments: 12

Update: The iPhone app referenced in this article has since been released on the App Store.

Crisis Mappers from around the world have been working around the clock to create maps and other tools for relief workers in Haiti. The earthquake caused tremendous damage to the road network and updated maps are necessary to enable food and volunteers to traverse the island.

The volunteer-driven Open Street Map project has become a central data source for the Crisis Mappers. It is regarded by many as the most up-to-date map of the area. It combines UN damage assessment, digitized imagery, Public Domain Topos and other base data. In the wake of the tragedy Google quickly released Haiti data gathered from its MapMaker program. DigitalGlobe has made its satellite imagery of Haiti freely available as well (as did GeoEye).

Soon, there will also be a free iPhone app with maps of Haiti coming to the App Store. Jeffrey Johnson worked with a small company, TrailBehind, Inc., to adapt the company's existing ( offline mapping app, Gaia GPS,) to provide offline maps to relief workers. It combines Digital Globe (.5m resolution), GeoEye (.5m resolution updated on 1/13), and OpenStreetMap (constantly being updated).

This version of Gaia GPS is intended to aid disaster relief for the Haitian earthquake. The app can be used to download maps and satellite imagery of the earthquake area, including up-to-date overlays of disaster sites, hospitals, and other relevant waypoints. The map data is provided by Digital Globe, GeoEye, OpenStreetMap, and the maps are hosted by the New York Public Library.

The app also provides other features that might be relevant to disaster relief efforts:

1) Recording of GPS tracks, waypoints, and geo-tagged photos
2) Import/export GPX tracks and photos
3) Guidance to waypoints and along tracks.

For more information about the app, please visit www.gaiagps.com This version of the app is identical to the commercial version, with the exception of the maps provided.

Fingers crossed that this app gets approved by Apple quickly.

Additionally you can see UAV flights from Haiti. These include new to the web imagery from P3 and GlobalHawk.

Jeffrey Johnson will be speaking about Crisis Mapping Haiti at Where 2.0 in March.

Edited for accuracy, clarity and great news about the iPhone app being released.

(continue reading)

Four short links: 13 November 2009

Open Source Design, Interesting NoSQL Use, Copyright Documentary, Location Intelligence

by Nat Torkington | @gnat | comments: 1

1. Open Source Enters The World of Atoms -- an academic statistical analysis of open design. We indicated that, in open design communities, tangible objects can be developed in very similar fashion to software; one could even say that people treat a design as source code to a physical object and change the object via changing the source.
2. Why I Like Redis (Simon Willison) -- coherent explanation of why Simon likes and uses a particular nosql system. I can run a long running batch job in one Python interpreter (say loading a few million lines of CSV in to a Redis key/value lookup table) and run another interpreter to play with the data that’s already been collected, even as the first process is streaming data in. I can quit and restart my interpreters without losing any data. And because Redis semantics map closely to Python native data types, I don’t have to think for more than a few seconds about how I’m going to represent my data.
3. © kiwiright (Vimeo) -- short documentary about copyright, made to raise awareness of the issues in New Zealand. (just as applicable to the rest of the world)
4. Your Movements Speak For Themselves (Jeff Jonas) -- Mobile devices in America are generating something like 600 billion geo-spatially tagged transactions per day. Every call, text message, email and data transfer handled by your mobile device creates a transaction with your space-time coordinate (to roughly 60 meters accuracy if there are three cell towers in range), whether you have GPS or not. Got a Blackberry? Every few minutes, it sends a heartbeat, creating a transaction whether you are using the phone or not. If the device is GPS-enabled and you’re using a location-based service your location is accurate to somewhere between 10 and 30 meters. Using Wi-Fi? It is accurate below10 meters. A thought-provoking roundup of the information leakage with modern locative systems. (via TomC on Twitter)

Navigating the Future: Take Me to Bob

by Brady Forrest | @brady | comments: 13

Google has just announced a free turn-by-turn navigation app for Android 2.0 in the US (Radar post). Google Maps Navigation relies on Google's own mapping for routing you. As with many navigation devices you can search Business Listings. However, they are also including data not traditionally available to navigators. In the promo video Google demonstrates that you can ask to be taken to "The King Tut exhibit". GMN will determine that it's in Golden Gate Park and route you. This is "because it is connected to the internet it is using all of the latest information on the internet."

This is huge. To be able to request implicit destinations based off of realtime information is something that has never been available before. What new queries will be available to us because of this? Google has a lot of data. How much of it can be assigned a location? Lots. There are millions of KML files out on the internet. Here are some of the useful queries

"Take me to Bob Smith" - If Bob is your friend on Latitude then Google Maps Navigation can take you to him. If Bob moves then GMN could even re-route you. I wonder if they will enable the chase scenario.

"Drop me off in time for the #48 bus" - Google knows the public transit schedule. So not only can it drop you off at the nearest stop, it could drop you off at the stop that will ensure the shortest multi-modal trip.

"Show me homes under 500K in Capitol Hill" - Via Google Base, Google has real estate information (it has had neighborhood data for quite sometime).

"Take me to my next appointment" - If you use Google Calendar and you accurately fill out the location field then this is a snap.

"Take me to the nearest Winter Coat Sale" - Using Adsense for Google Maps, GMN can easily lead you to local sales.

"Take me to the bar my friends go to the most" - Using Social Graph API and the new, experimental Social Search to tap into Foursquare, GMN can determine where you friends go, aggregate their destinations and lead you to their favorite watering hole.

"Take me to the largest event" - Using a combination of Latitude and its new access to the Twitter Firehose (which will soon include location - Radar post), Google can determine where people are.

"Take me on a tour of the top 10 historical sites here" - Using Wikipedia Google can determine what the sites are and where you should be taken. Alternately, Google could take you on user-generated tour.

"Take me to the most picturesque place near here" - Several years ago Google bought Panoramio, a location-based photo site. Google can determine which place nearby has had the most photos of it taken.

"Take me on a tour of the site from Around the World in 80 Days" - Google already geoparses many of the books it scans (just see this map). This routing is quite possible.

"Take me to the EPA's protected sites" - Government data is becoming more available. This is just one possible governmental query. You could also ask to go on a tour of TARP fund recipients or Democratic donors.

Obviously not all of them will be enabled, but I bet that within a year some of them will be. What other scenarios can or should they implement?

A Conversation with Dr. Walter Scott of DigitalGlobe

by Joshua-Michéle Ross | @jmichele | comments: 0

Dr Walter Scott founded Digital Globe - a company you are likely not familiar with though you probably interact with their satellite imagery on a regular basis via Google Maps, Bing and others.


It is only recently that mapping technology and production has been driven by mainly commercial interests especially in the area of satellite imagery. With this commercialization corporations and media have access to information that was once considered closely guarded state property.

The potential for social good - from assessing and responding to natural disasters, to exposing political issues such as prisoner camps, to finding out where Richard Serra is keeping his massive sculptures… is enormous. In this discussion we cover DigitalGlobe's business, the state of commercial satellite imagery and the advantage of commercial vs. government ownership of GIS data.

Dr Scott will be delivering a HighOrder Bit at the upcoming Web 2.0 Summit.

Four short links: 16 October 2009

Audio Geotagging, SF Open Data Stories, Wave Use Cases, Hadooped Genomes

by Nat Torkington | @gnat | comments: 0

1. Wiimote Audio Geotagging -- match audio with the map movement and annotations made with an IR pen and a Wiimote. Very cool! (and from New Zealand)
2. San Francisco: Open For Data -- Two months after it launched, the project is already reaping rewards from San Francisco's huge community of programmers. Applications using the data include Routesy, which offers directions based on real-time city transport feeds; and EcoFinder, which points you to the nearest recycling site for a given item.
3. Google Wave's Best Use Cases (Lifehacker) -- not cases where people are using Wave, but where they want to. Read this as "the Web has not provided all the tools to solve these problems". Something will solve them, and Wave is trying to. (via Jim Stogdill)
4. Analyzing Human Genomes with Hadoop -- case study from the Cloudera blog. Performs alignment and genotyping on the 100GB of data you get when you sequence a human's genome in about three hours for less than $100 using a 40-node, 320-core cluster rented from Amazon’s EC2. (via mndoci on Twitter)

Four short links: 13 October 2009

Open Source, Gov 2.0, Gaming, Education

by Nat Torkington | @gnat | comments: 0

1. Our Open Source School -- blog of Albany Senior High School in New Zealand, which only runs open source software.
2. Behind The Scenes at What Do They Know -- interesting post showing details behind the What Do They Know web site. In the last year there have been only seven significant cases where requests have been hidden from public view on the site due to concerns relating to potential libel and defamation. Three of those cases have involved groups of twenty or so requests made by the same one or two users. While actual number of requests we have had to hide is around 70 (0.4% of the total) even this small fraction overstates the situation due to the repetition of the same potentially libelous accusations comments in different requests. In all cases we have kept as much information up on the site as possible. Our policy with respect to all requests to remove information from the site is that we only take down information in exceptional circumstances; generally only when the law requires us to do so.
3. The Complete History of Lemmings -- a must-read for videogamers from the early 90s. Theres been much debate over the choice of colours as well, but the colours were selected, not because they were the easiest to choose, but because of the PC EGA palette. With the limited choice, it was decided the green hair was nicer than blue, and with that, the final Lemming was born. I was actually the next person to code up a demo on the Commodore 64, but I only got so far as having a single Lemming walking over the landscape before Dave put me onto another project.
4. Google Replaces TeleAtlas -- Tele Atlas confirms that Google has decided to stop using Tele Atlas map data for the U.S. Google will now use its own map data. Our relationship with Google for map coverage continues outside of the U.S. in dozens of geographies.

Where 2.0 CFP Extended

by Brady Forrest | @brady | comments: 0

Every year Where 2.0 is a gathering of mapping companies, and geohackers. This year there will be a lot of discussion about mobile apps (iPhone vs, Android vs. Pre vs. Nokia), user-contributed geodata (like Waze and Google Building Maker), temporal mapping, government geodata (like Data SF), augmented reality (like Wikitude), and the geolocated web. We've extended the CFP entry deadline until October 20th. If you've got something to contribute then submit a talk for the CFP now.

I've included some of the topics that we are looking for after the jump

(continue reading)

Four short links: 2 September 2009

Happy Programmers, Usability Tool, Geo API, Zombie Math

by Nat Torkington | @gnat | comments: 0

1. The Programming Language With The Happiest Users (Dolores Labs) -- you'll be surprised. Age before beauty!
2. Judge It Now -- fast market opinions on design decisions. Compare to Optimal Sort. Usability tools hitting the mainstream web, so the time to learn what works shrinks and progress is faster.
3. BlockChalk API -- These new interfaces enable developers to do nearly everything that you can do at http://blockchalk.com. It’s now possible to build client applications, mash-ups, and other tools based on BlockChalk geolocation data and services. Also see the explanatory blog post. (via joshua on Delicious)
4. The Mathematics of Zombie Attacks (PDF) -- Zombies are a popular figure in pop culture/entertainment and they are usually portrayed as being brought about through an outbreak or epidemic. Consequently, we model a zombie attack, using biological assumptions based on popular zombie movies. We introduce a basic model for zombie infection, determine equilibria and their stability, and illustrate the outcome with numerical solutions. We then refine the model to introduce a latent period of zombification, whereby humans are infected, but not infectious, before becoming undead. We then modify the model to include the effects of possible quarantine or a cure. Finally, we examine the impact of regular, impulsive reductions in the number of zombies and derive conditions under which eradication can occur. We show that only quick, aggressive attacks can stave off the doomsday scenario: the collapse of society as zombies overtake us all. (via Doug McKenna)

Burning Man Gets an API (and a Whole Lot More)

by Brady Forrest | @brady | comments: 17

An API! SMS! Foursquare! An iPhone app! They are all coming to Burning Man this year. Will the festival be the same?

The annual tech-art festival in the Nevada desert, starts on Sunday. Normally the attendees leave their phones and laptop behind, but this year that may not be the case. As I ride from Seattle to Black Rock City, NV I am getting SMS from friends on the playa. In anticipation of wifi and possible data connections Foursquare has rolled out Black Rock City as a city (@sfslim is already the Mayor of The Man). If AT&T's service doesn't work then attendees may be able to take advantage of OpenBTS's local SMS project. Most of the attendees aren't there, but the tech is already making its presence known.

Burning Man is dismissed as a party by many people (attendees and non-attendees alike), but for many it is a unique opportunity to try out new software. Geohackers in particular find it to be a great playground. Black Rock City is a full city complete with a fire department, stores (where you can buy coffee, tea or ice bags), a Main drag and 40,000+ residents. However, since it is only around for a week each year (and is always in a new location) there is not time (or profit) for commercial companies to map it. The process falls to the community and they take advantage of the opportunity (and sites like Flickr use the resulting commercial-grade data).

This year the Burning Man organization is assisting with the launch of an API. With the API you get access to descriptions and locations of the Streets, Art, Camps and Events. When combined with a map this is everything you need for a local city guide. And that is exactly what the iPhone app does (it's not available in the app store; if you want it head to the Burning Man Earth Camp next to Media Mecca -- be nice). It maps all of those entities, will geolocate you and let you mark favorites (see the screenshot from my iPhone). You can learn more about the API project here. Burning Man still has its Virtual Playa project online.

There is also a move to take advantage of Flickr's machine tags. For example if you take a picture of Area 47 (with the online directory entry: http://earth.burningman.com/brc/2009/themecamp/2234/) then use burningman:camp=2234. The photo will appear on that locations page. We will see how many photos end up using these machine tags. I suspect that V2 of the iPhone app will add a camera that can apply those tags automatically and that we'll see more uptake then.

Burning Earth team member, Tom Longson, sent me the following.

Burning Man's theme this year is evolution which is fitting as Burning Man Earth launches an online directory, API, and a beta iPhone App. The group of artists, geo-wankers, and software developers are rapidly deploying systems, both off and on the Black Rock Desert playa to help participants find each other, schedule events, find theme camps, and artwork. It is a digital project aimed at providing better maps, and an online space to describe the community and art.

The open source webapp, named "Earth", builds upon Open Street Map, GeoDjango, and Pinax to create an easy to use, mapping interface for the event. Coupled with Jeffrey Johnson's prior work with aerial photography, and Andrew Johnstone's virtual playa 3D modeling, the platform is rapidly evolving to become an important part of the organization of the event.

Burning Man's API now opens the door for developers and artists alike to remix and reuse data about the event. For example, you could plot all the events in the next hour, build an Arduino belt that vibrated in the direction of the closest piece of artwork, or a web service for rating theme camps.

In addition, Mikel Maron is championing machine-tags to allow the project to couple Earth's database with other websites, such as Flickr. By integrating machine tags, people can say on Flickr what art installation their photo is of, and Earth will automatically pull up that photo. Likewise, Flickr will provide a link to the page describing the artwork itself.

Beyonds enabling mashups, the APIs are the foundation for the new beta iPhone app, which serves as both a directory and enhanced GPS designed for Burning Man. A small number of participants will get to try out the app, which will be in full production next year.

While it may sound like fun and games, the harsh conditions of the Black Rock Desert make the system a perfect testbed for mapping temporary places, people, and things. In this same way, these tools may just be the next best thing for helping disaster hit regions react and respond. Burning Man Earth is more than just an attempt at radical self-expression, self-reliance, and community building. It may just be a tool for tomorrow.

This is Burning Man at its best. Letting people create something just for the festival and its attendees. The question becomes how will the larger Burning Man community, expecting a cellphone free vacation, react to intrusions from the real-world?

BTW, If you are on the playa you may be able to find me at my group art project Steve the Robot H.E.A.i.D.

Where 2.0 2010 CFP is Now Open

by Brady Forrest | @brady | comments: 2

The CFP for the sixth annual Where 2.0 is now open. The three-day conference about location, mapping and geodata will be held from 3/30 to 4/1 in San Jose, CA. This year our focus will be on location-enabled platforms, mobile apps, user-generated geodata, sensors, and augmented reality. Here is more about the conference below,

Mobile: The iPhone, Android, and Symbian mobile OS’s are continually advancing the state of the art. By creating a wide-spread platform that allows for third-party development and geolocation they are bringing along the whole industry. The phone is going to become the primary I/O device for geodata in the near future. What new applications are you building for it? How are the social aapps effecting society and our notions of privacy?
Realtime Mapping: Mobile phones are being used to generate maps and other geodata. Sensors across the world are capturing more data every second. Reality mining systems are being used to release this data to users in realtime. Who is making the most of this deluge? How can they handle these new data sets?
Temporal Information: Realtime data requires the element of time to be added. This is uncharted design territory. How should time come to the Web?
Rich Analysis: Web mapping is moving past just allowing the display of data (aka red-dot fever). There are now many tools online that help people analyze data and could, in time, challenge traditional GIS systems. How is the Web different? Will end-users take up richer tools?
Geolocated Web: Every updated browser can now geolocate it’s user. Websites are now going to start using this information. What should they do with the information? What new services can be created?
Mobile Advertising vs. Services: Will people pay for their mobile apps directly or through ads? Which makes for a better product, a better user experience and a more stable revenue stream?
Augmented Reality: The combination of a camera, a GPS and a compass on a mobile phone is going to let us layer information on top of the world. What do you want to see? How will you edit the layers?
3D: Photosynth-like apps are becoming more commonplace. Google’s 3D Warehouse is filled with models. It’s safe to say that 3D is here. But do we need it? What are its limits?
Open Data: Governments are treasure troves of data. Increasingly they are releasing it online for free. How does open data effect the web? How can this data be widely available and yet maintain its creators? How is this critical information being put to use?
Crisis Mapping: The tools of neogeography are being used to spread the word of humanitarian and natural disasters. What are some of the best (and worst) examples?
Open-Source: The backbone of any independant mapping site is open source software. What are the newest tools that can be used to handle the location-enabled web?
Workshops
Where 2.0 will have a full day of workshops where participants can dig deep into a range of issues and leave the conference armed with new tools and skills. Workshops are one hour and fifteen minutes in length and will be held on Tuesday, March 30, 2010. Topics we’d like to explore include, but are not exclusive to:
Geo Support in Web Application Frameworks: As people design their own mapping applications, there has been a need for built-in geo support. We’re looking for workshops that teach about Mapstraction, Modest Maps, Open Layers, GeoDjango, GeoRuby, MapCruncher, and other tools.
GeoStack: As locations apps are brought in-house, companies need their own geostack. What are the best tools?
Mapping APIs: The location space would not have gotten as far as it has today without all of the innovation in the mapping API space. How can you test the limits of these free resources?
GeoTargeting: Knowing users’ locations has never been more important. Identifying it accurately can be difficult and expensive. What are the best methods?
Privacy Implications: As you are collecting user data, keeping track of your users, or collecting geodata, are you aware of the relevant laws? What would you teach others?
GeoBrowsers: Google Earth and NASA WorldWind are both amazing geobrowsers. How can you get the most out of them?
Data Management: Geo applications work with massive amounts of data. What are the tools, tips, and tricks that can be used to manage it?
Protocols and Formats: GeoRSS, GML, KML, EXIF, Microformats, Geo OpenSearch. Which formats are on the way in and which ones are on the way out? These are just some of the technologies and transformations we’ve noticed and represent just the starting point for the program. While we’d like you to tap into the theme as your inspiration in writing your proposal, feel free to wander. What are you working on that will change the world, or at least the world you’re in? What project is bringing you pleasure, or teasing your brain? Surprise and delight us; shake us out of our assumptions. We’re angling for shorter talks with longer breaks so you’ll have more time for one-on-one interactions.

IN adition to plenary talks and workshops we will also have opportunities for startups to launch, Ignitte talks and opportunities to experiment with RFIDs. The CFP closes 10/13/09. Submit a talk now.

Four short links: 21 August 2009

Moody Twitter, Future Geohistory, News Sucks, Whyless in Wonderland

by Nat Torkington | @gnat | comments: 3

1. TwitterMood -- using Twitter as a giant mood sensor for the world (see also temporal correlations, via kellan on delicious).
2. What Will Remain of Us -- The sea that brought trade to Dunwich was not entirely benevolent. The town was losing ground as early as 1086 when the Domesday Book, a survey of all holdings in England, was published; between 1066 and 1086 more than half of Dunwich’s taxable farmland had washed away. Major storms in 1287, 1328, 1347, and 1740 swallowed up more land. By 1844, only 237 people lived in Dunwich. Today, less than half as many reside there in a handful of ruins on dry land. (via blackbeltjones on Delicious)
3. The Three Key Parts of Stories You Don't Usually Get -- In reality, these longstanding facts provide the true foundation of journalism. But in practice, they play second-fiddle to the news, condensed beyond all meaning into a paragraph halfway down in a news story, tucked away in a remote corner of our news sites. Take a look at that WaPo page again. Currently, a link sits on the far right side of the page, a third of the way down, labeled “What you need to know.” Click on that link, and you’re taken here: a linkless, five-paragraph blog post from May. This basically captures our approach to providing the necessary background to follow the news.
4. Eulogy to _why -- a pseudonymous Ruby character, _why the Lucky Stiff, recently vanished from the net: all his sites and accounts were deleted. It's possible this is because someone tried to identify him, it's possible that his accounts were hacked. Either way, this is a touching tribute to him from John Resig. I for one would like to see more appreciation while the people are still around. Today, tell two good people that you enjoy what they do. You know you can.

Recent Posts

• Seeing the Future of Mapping in Crimespotting | by Brady Forrest on August 21, 2009
• Data Is Journalism: MSNBC.com Acquires Everyblock | by Brady Forrest on August 17, 2009
• Locational Privacy: The EFF Weighs in on Safeguarding Your Location | by Brady Forrest on August 11, 2009
• A Crowd-Sourced National Communications Census | by Carl Malamud on July 19, 2009
• Developers Create Unofficial Find My iPhone API | by Brady Forrest on July 15, 2009
• Recovery Mapping: ARRA Spending Across the US | by Brady Forrest on July 13, 2009
• Four short links: 6 July 2009 | by Nat Torkington on July 6, 2009
• Everyblock's Code is Open-Sourced | by Brady Forrest on July 1, 2009
• Four short links: 24 June 2009 | by Nat Torkington on June 24, 2009
• Before and After Shots of Google's Iran Maps | by Brady Forrest on June 22, 2009
• Want a Map of Tehran? Use Open Street Map or Google | by Brady Forrest on June 17, 2009
• XKCD on the Future Self | by Brady Forrest on June 12, 2009