- dategrep — print lines matching ranges of dates. Genius!
- Business Case Guidance in Agile Projects (gov.uk) — how the UK govt signs off on Agile projects, which normally governments have no clue over how to handle properly.
- Hyper Growth Done Right — “While I was at Oracle, it took a month before a new engineer would get any code in,” Agarwal says. “It sent this implicit message that it’s okay to take a month to write some code.” First time I’d heard this wise point articulated: slow feedback loops send the message that progress can be slow.
- Docker + Github + Jenkins — clever integration of the three tools to get repeatable continuous integration. The modern dev environment has workflow built on git, VMs, and glue.
Agile methodology brings flexibility to the EDW and offers ways to integrate open-source technologies with existing systems.
Data analysis, like other pursuits, is a balancing act. The rise of big data ratchets up the pressure on the traditional enterprise data warehouse (EDW) and associated software tools to handle rapidly evolving sets of new demands posed by the business. Companies want their EDW systems to be more flexible and more user friendly — without sacrificing processing speeds, data integrity, or overall reliability.
“The more data you give the business, the more questions they will ask,” says José Carlos Eiras, who has served as CIO at Kraft Foods, Philip Morris, General Motors, and DHL. “When you have big data, you have a lot of different questions, and suddenly you need an enterprise data warehouse that is very flexible.”
EDWs are remarkably powerful, but it takes considerable expertise and creativity to modify them on the fly. Adding new capabilities to the EDW generally requires significant investments of time and money. You can develop your own tools internally or purchase them from a vendor, but either way, it’s a hard slog. Read more…
More Lessons from the Collapse of healthcare.gov
Last week, I wrote in some detail about some of the specifics of how the Federal healthcare portal seems to have violated basic principles of good software delivery. Now I want to talk a bit about the more general factor that I think led to all those cut corners and shoddy deliverables.
One of the oldest and shortest jokes in the computer industry is “Time. Money. Features. Pick any two.” To some extent, you can swap quality out for features, because poorly delivered functionality is essentially non-existent functionality. In almost all commercial software projects, time and money both end up being the parts that give in the end. In other words, the original feature set almost never gets cut, but the project goes over budget and delivers late.
Tech events you don't want to miss
Each Monday, we round up upcoming event highlights from the programming and technology spaces. Have an event to share? Send us a note.
The Revolution Will Not Be Televised webcast: Jonathan Stark discusses the coming wireless wave and how it will profoundly affect every aspect of society—the iPhone will look like a fax machine compared to what’s coming next. Register for this free webcast.
Date: 10 a.m. PT, June 20 Location: Online webcast
Intro to Raspberry Pi : Ed Snajder explains what a Raspberry Pi is, how it differs from an Arduino and shows attendees some cool things you can do with a Raspberry Pi. Register for this free webcast.
Date: 10 a.m. PT, June 25 Location: Online webcast
Interesting Themes, Distributed Systems Failure Modes, Gesture Sensing Through Wifi, and Bad Taste Agile
- OATV Fund III Pitch Deck (Slideshare) — contains a list of what they were investing in, and what they want to invest in with the new round. Then: Quantified self; Internet subsystems; Smart networks of things; Manipulation and visualization of big data; sustainability; Maker movement. Now: Quantified Self Pro; Maker Pro; Hacking Education; Hidden Economies; Operations as Competitive Advantage; A Router in Every Pocket; The Internet Operating System. The move to “Pro” interests me, too. (via Bryce Roberts)
- The Network is Reliable — Many applications silently degrade when the network fails, and resulting problems may not be understood for some time—if they are understood at all. […] much of what we know about the failure modes of real-world distributed systems is founded on guesswork and rumor. […] In this post, we’d like to bring a few of these stories together. We believe this is a first step towards a more open and honest discussion of real-world partition behavior, and, ultimately, more robust distributed systems design.
- Wisee (PDF) — recognising gestures using disturbances in the (wifi) force. Our results show that WiSee can identify and classify a set of nine gestures with an average accuracy of 94%. (via BoingBoing)
- Why Your Users Hate Agile Development (IT World) — What developers see as iterative and flexible, users see as disorganized and never-ending. Here’s how some experienced developers have changed that perception. (via Slashdot)
Agile FBI, Lucky Meat, Hiring Introverts, and Future of Reading
- FBI Uses Agile (Information Week) — The FBI awarded the original contract for the case management system to Lockheed Martin in 2006, but an impatient Fulgham, who was hired in 2008 to get the project on track, decided to bring it in house in September 2010. Since then, the agency has been using agile development to push the frequently delayed project across the finish line. The FBI’s agile team creates a software build every two weeks, and the pre-launch system is now running Build 33. The agency is working on Build 36, comprised mainly of features that weren’t part of the original RFP. Fulgham says the software is essentially done.
- Lucky Meat (Matt Webb) — the man is a mad genius. If you believe “mad” and “genius” are opposite ends of a single dimension, then I will let you choose where to place this post on that continuum. Then when you choose your tea (or coffee), the liquid is shot as if through the barrel of a gun BANG directly at your face. We use facial recognition computer chips or something for this. It blasts, and splashes, as hard and fierce as possible. And then the tea (or coffee) is runs down the inside slope of the “V” and is channeled in and falls eventually into a cup at the bottom apex where it finally drips in. Then you have your drink. (But you don’t need it, because you’re already awake.)
- Quietly Awesome — how are your hiring processes biased towards extroverts? See also I don’t hire unlucky people.
- How We Will Read (Clive Thompson) — Clive is my hero. I feel like we see all these articles that say, “This is what the e-book is,” and my response is always, “We have no idea what the e-book is like!” All these design things have yet to be solved and even thought about, and we have history of being really really good at figuring this out. If you think about the origins of the codex — first we started reading on scrolls. Scrolls just pile up, though. You can’t really organize them. Codexes made it easier to line them up on a shelf. But it also meant there were pages. It didn’t occur to them for some time to have page numbers, because the whole idea was that you only read a small number of books and you were going to read them over and over and over again. Once there were so many books that you were going to read a book once and maybe never again, it actually became important to consult the book and be able to find something inside it. So page numbers and indices became important. We look at books and we’re like, “They’re so well designed,” but it took centuries for them to become well-designed. So you look at e-books, and yeah, they’re alright, but they’re clearly horrible compared to what they’re going to be. I find it amazing that I can get this much pleasure out of them already. AMEN!
Designing data products, five tough health care lessons, lean startup for publishers.
This week on O'Reilly: We looked at a four-step approach for designing great data products, Andy Oram shared the lessons he's learned about health care, and we learned about a competitive advantage that publishers aren't seizing.
The first in a series looking at the major themes of this year's TOC conference.
Several overriding themes permeated this year's Tools of Change for Publishing conference. The first in a series reviewing five major themes, here we look at agile publishing, in terms of workflow, work environment and practical publishing applications.
"Running Lean" author Ash Maurya on startup adaptation and the gift of obscurity.
Drawing from the Lean Startup and other methods, "Running Lean" helps entrepreneurs transform flawed Plan A ideas into viable companies. "Running Lean" author Ash Maurya explains the basics in this interview.
Bookigee's Kristen McLean says agile techniques from the software world also apply to publishing.
Bookigee founder Kristen McLean explains how lightweight development, flexible teams and other agile methods can help publishers with content development and workflows.