Software // Operating Systems
09:14 PM
Connect Directly
Stop Cyber Attacks with Threat Intelligence
Aug 30, 2016
In this informative webinar on August 30th you will hear security experts discuss practical ways t ...Read More>>

FlightCaster Leverages Big Data

The cloud-based service forecasts up to six hours ahead of time if an airline flight is likely to be delayed, using what's known as Big Data techniques.

Bradford Cross never liked the airport delays, the last minute airline announcements of flight postponements, or the unpredictability of air travel, especially to his home airport of San Francisco, where fog periodically obstructs the runway approaches.

When that happens, planes land one at a time instead of two, and delays cascade through the planned landings and departures. Cross, a former developer of programs for hedge fund trading, found his true calling when he became the head or research and development for FlightCaster.

"I hated the flight delays so bad. I thought it was a great problem to solve," he said during a break in moderating the Big Data track at Cloud Connect 2010 March 18 in Santa Clara, Calif. FlightCaster is a one-year-old Web site, that forecasts, sometimes six hours ahead of the airlines, when flight delays are likely.

Flightcaster is an example of what can be done with the new "cloud-based" systems that manipulate lots of data in the cloud, or on very large server clusters on the Internet. They frequently use NoSQL systems, such as Voldemort, HBase, Apache CouchDb, or Hadoop, and Google's BigTable, which can deal with petabytes of data across hundreds or thousands of servers.

Big Data is something of a misnomer, Cross conceded; FlightCaster deals with data in the terabyte range, like many data warehouses, not petabytes. But it is processing large data sets that are being analyzed in new ways, with Hadoop routines repeatedly sorting, filtering and manipulating the data.

FlightCaster needs to do its analysis work as well as continuously respond to individual inquiries quickly. It also needs to scale up as fast as traffic does when delays start to occur. Relational databases, with their more stringent data handling requirements, would tend to fall behind the task, he said.

FlightCaster is an example of what can be done on a large server cluster to produce useful results propagated freely to thousands of end users. Cross said several companies have negotiated or are negotiating with FlightCaster to make use of its data results.

Users load their airline flight number into FlightCaster, either through an iPhone or Blackberry app or through a browser window, and it analyzes the probability of a delay. The system warns the user if the delay is likely to be less than or more than 60 minutes. If more, that's the type of gap that generates the likelihood a connecting flight will be delayed, and FlightCaster's early notification offers the opportunity to look for alternatives, Cross noted.

1 of 2
Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
Register for InformationWeek Newsletters
White Papers
Current Issue
Top IT Trends to Watch in Financial Services
IT pros at banks, investment houses, insurance companies, and other financial services organizations are focused on a range of issues, from peer-to-peer lending to cybersecurity to performance, agility, and compliance. It all matters.
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
Join us for a roundup of the top stories on for the week of August 14, 2016. We'll be talking with the editors and correspondents who brought you the top stories of the week to get the "story behind the story."
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.