- Aaron’s Army — powerful words from Carl Malamud. Aaron was part of an army of citizens that believes democracy only works when the citizenry are informed, when we know about our rights—and our obligations. An army that believes we must make justice and knowledge available to all—not just the well born or those that have grabbed the reigns of power—so that we may govern ourselves more wisely.
- Vaurien the Chaos TCP Monkey — a project at Netflix to enhance the infrastructure tolerance. The Chaos Monkey will randomly shut down some servers or block some network connections, and the system is supposed to survive to these events. It’s a way to verify the high availability and tolerance of the system. (via Pete Warden)
- Foto Forensics — tool which uses image processing algorithms to help you identify doctoring in images. The creator’s deconstruction of Victoria’s Secret catalogue model photos is impressive. (via Nelson Minar)
- All Trials Registered — Ben Goldacre steps up his campaign to ensure trial data is reported and used accurately. I’m astonished that there are people who would withhold data, obfuscate results, or opt out of the system entirely, let alone that those people would vigorously assert that they are, in fact, professional scientists.
Informed Citizenry, TCP Chaos Monkey, Photographic Forensics, Medical Trial Data
We need checks and balances to ensure data-driven predictions don't become prejudices.
“Do you know why the French hate traffic cameras?” he asked me. “It’s because it makes it hard for them to cheat on their spouses.”
He contended that while it was possible for a couple to overlook subtle signs of infidelity — a brush of lipstick on a collar, a stray hair, or the smell of a man’s cologne — the hard proof of a speeding ticket given on the way to an afternoon tryst couldn’t be ignored.
Humans live in these grey areas. A 65 mph speed limit is really a suggestion; it’s up to the officers to enforce that limit. That allows for context: a reckless teen might get pulled over for going 70, but a careful driver can go 75 without incident.
But a computer that’s programmed to issue tickets to speeders doesn’t have that ambiguity. And its accusations are hard to ignore because they’re factual, rooted in hard data and numbers.
Did big data kill privacy?
With the rise of a data-driven society, it’s tempting to pronounce privacy dead. Each time we connect to a new service or network, we’re agreeing to leave a digital breadcrumb trail behind us. And increasingly, not connecting makes us social pariahs, leaving others to wonder what we have to hide.
But maybe privacy is a fiction. For millennia — before the rise of city-states — we lived in villages. Gossip, hearsay, and whisperings heard through thin-walled huts were the norm.
Shared moral values and social pressure helped groups to compete better against other groups, helping to evolve the societies and religions that dominate the world today. Humans thrive in part because of our groupish nature — which is why moral psychologist Jonathan Haidt says we’re 90% chimp and 10% bee. We might have evolved as selfish individuals, but we conquered the Earth as selfish teams.
In other words, being private is relatively new, perhaps only transient, and gossip helped us get here. Read more…
News App, Data Wrangler, Responsive Previews, and Accountable Algorithms
- cir.ca — news app for iPhone, which lets you track updates and further news on a given story. (via Andy Baio)
- DataWrangler (Stanford) — an interactive tool for data cleaning and transformation. Spend less time formatting and more time analyzing your data. From the Stanford Visualization Group.
- Responsivator — see how websites look at different screen sizes.
- Accountable Algorithms (Ed Felten) — When we talk about making an algorithmic public process open, we mean two separate things. First, we want transparency: the public knows what the algorithm is. Second, we want the execution of the algorithm to be accountable: the public can check to make sure that the algorithm was executed correctly in a particular case. Transparency is addressed by traditional open government principles; but accountability is different.
Don't Pay Developers, Teaching Programming, Second Android Screens, and Democracy
- Paying for Developers is a Bad Idea (Charlie Kindel) — The companies that make the most profit are those who build virtuous platform cycles. There are no proof points in history of virtuous platform cycles being created when the platform provider incents developers to target the platform by paying them. Paying developers to target your platform is a sign of desperation. Doing so means developers have no skin in the game. A platform where developers do not have skin in the game is artificially propped up and will not succeed in the long run. A thesis illustrated with his experience at Microsoft.
- Learnable Programming (Bret Victor) — deconstructs Khan Academy’s coding learning environment, and explains Victor’s take on learning to program. A good system is designed to encourage particular ways of thinking, with all features carefully and cohesively designed around that purpose. This essay will present many features! The trick is to see through them — to see the underlying design principles that they represent, and understand how these principles enable the programmer to think. (via Layton Duncan)
- Tablet as External Display for Android Smartphones — new app, in beta, letting you remote-control via a tablet. (via Tab Times)
- Clay Shirky: How The Internet Will (One Day) Transform Government (TED Talk) — There’s no democracy worth the name that doesn’t have a transparency move, but transparency is openness in only one direction, and being given a dashboard without a steering wheel has never been the core promise a democracy makes to its citizens.
Programming Patterns, Limits of Observation, Surviving Transparency, 3D Printing Sounds
- Patterns for Research in Machine Learning — every single piece of advice should be tattooed under the eyelids of every beginning programmer, regardless of the field.
- Milton Friedman’s Thermostat — Everybody knows that if you press down on the gas pedal the car goes faster, other things equal, right? And everybody knows that if a car is going uphill the car goes slower, other things equal, right? But suppose you were someone who didn’t know those two things. And you were a passenger in a car watching the driver trying to keep a constant speed on a hilly road. You would see the gas pedal going up and down. You would see the car going downhill and uphill. But if the driver were skilled, and the car powerful enough, you would see the speed stay constant. So, if you were simply looking at this particular “data generating process”, you could easily conclude: “Look! The position of the gas pedal has no effect on the speed!”; and “Look! Whether the car is going uphill or downhill has no effect on the speed!”; and “All you guys who think that gas pedals and hills affect speed are wrong!” (via Dr Data’s Blog)
- Transparency Doesn’t Kill Kittens (O’Reilly Radar) — Atul Gawande says, cystic fibrosis … had data for 40 years on the performance of the centers around the country that take care of kids with cystic fibrosis. They shared the data privately […] They just told you where you stood relative to everybody else and they didn’t make that information public. About four or five years ago, they began making that information public. It’s now available on the Internet. You can see the rating of every center in the country for cystic fibrosis. Several of the centers had said, “We’re going to pull out because this isn’t fair.” Nobody ended up pulling out. They did not lose patients in hoards and go bankrupt unfairly. They were able to see from one another who was doing well and then go visit and learn from one and other.
- 3D Printing: The Coolest Way to Visualize Sound — just what it says. (via Infovore)
Talking About Your Product, Moving On, Visible Turk, and Digital Nativity
- What Twitter’s API Anouncement Could Have Said (Anil Dash) — read this and learn. Anil shows how powerful it is to communicate from the perspective of the reader. People don’t care about your business model or platform changes except as it applies to them. Focus on what you’re doing for the user, because that’s why you make every change–right? Your average “we’ve changed things” message focuses on the platform not the user: “*we* changed things for *our* reasons” and the implicit message is because *we* have all the power”. Anil’s is “you just got this Christmas present, because we are always striving to make things better for you!”. If it’s deceitful bullshit smeared over an offensive money grab, the reader will smell it. But if you’re living life right, you’re telling the truth. And they can smell that, too.
- Goodbye, Everyblock — Adrian Holovaty is moving on and ready, once more, to make something awesome.
- Turkopticon — transparency about crappy microemployers for people who work on Mechanical Turk. (via Beta Knowledge)
- Digital Natives, 10 Years After (PDF) — we need to move away from this fetish of insisting in naming this generation the Digital/Net/Google Generation because those terms don’t describe them, and have the potential of keeping this group of students from realizing personal growth by assuming that they’ve already grown in areas that they so clearly have not.
OpenROV Funded, Teen Surprises, Crowdsourced Net Transparency, and Like Humour
- OpenROV Funded in 1 Day (Kickstarter) — an open source robotic submarine designed to make underwater exploration possible for everyone. (via BoingBoing)
- McAfee Digital Divide Study (PDF) — lots of numbers showing parents are unaware of what their kids do. (via Julie Starr)
- Herdict — crowdsourced transparency to reveal who is censoring what online. (via Twitter)
- You Really Really Like Me (NY Times) — cute collection of visual riffs on “like” and “tweet this” iconography. I like my humour pixellated.
Emily Bell is entrusted with teaching the data journalists of the next century at Columbia University.
In this interview, the director of the Tow Center for Digital Journalism at Columbia University talks about the challenges and opportunities that face those who would practice data journalism in the 21st century. In particular, Emily Bell discusses the skills and mindset that are needed, including how a $2 million research grant will help support developing them.
Animal Imagery, Infectious Ideas, Internet v Books, and Transparency Projects
- Penguins Counted From Space (Reuters) — I love the unintended flow-on effects of technological progress. Nobody funded satellites because they’d help us get an accurate picture of wildlife in the Antarctic, but yet here we are. The street finds a use …
- What Makes a Super-Spreader? — A super-spreader is a person who transmits an infection to a significantly greater number of other people than the average infected person. The occurrence of a super spreader early in an outbreak can be the difference between a local outbreak that fizzles out and a regional epidemic. Cory, Waxy, Gruber, Ms BrainPickings Popova: I’m looking at you. (via BoingBoing)
- The Internet Did Not Kill Reading Books (The Atlantic) — reading probably hasn’t declined to the horrific levels of the 1950s.
- Data Transparency Hacks — projects that came from the WSJ Data Transparency Codeathon.