Can Big Data Trump Doping In Sports?

Massive amounts of data, along with Hadoop and visualization tools, helped the U.S. women's cycling team earn silver at the London 2012 Olympic Games.
Christopherson's team used intensive data analysis to improve the cyclists' performance.

"We generated all this data, you know, everything from genetics tests to continuous blood glucose tracking, sleep tracking. We even made this sensor on our own that tracked environmental data for each athlete," recalled Christopherson.

But this deluge of big data created a new set of problems. "In the beginning it was like, 'Wow, we have all this great data,' but it became very hard to manage," he noted. "You know, we were sampling at one second, 24 hours a day, 7 days a week from all these different devices. And it got really overwhelming."

The data eventually became impossible to manage with conventional software applications.

"I remember at one point the spreadsheet was taking longer and longer to open, until one day I got, you know, the spinning wheel of death, and it just completely locked up," said Christopherson.

After quickly researching various data management solutions, Christopherson's team chose Datameer, an analytics software provider with drag-and-drop design tools that allow Hadoop users to quickly create infographics and data visualizations without any coding.

Datameer "had nice ways to integrate and analyze the data, good visualization tools, and that's exactly what we needed, you know, to see how all of this data was interrelated and how it was correlated," said Christopherson.

One insight his team uncovered was related to the athletes' circadian rhythms.

"We saw in the data that early morning sun exposure … not just on the skin for Vitamin D synthesis, but actually in the eyes … was kind of anchoring biorhythms, and that was related to sleep latency and quality, which improved recovery," Christopherson recalled.

"When we got to London, where it was cloudy and overcast, we actually used light box therapy in (the athletes') rooms in the Olympic village to ensure they had the same sleep cycles, along with temperature control and some other things," he added.

The cyclists' silver medal performance was far better than expected, a showing that Christopherson attributes, at least in part, to insights gleaned from the collected data.

"I think the exciting thing about this project is that we went into this five seconds down, not even close to the medals, and we came away with a silver medal. And I think that's more than any of us could have asked for," he said.

To understand how to secure big data, you have to understand what it is -- and what it isn't. In the Security Implications Of Big Data Strategies report, we show you how to alter your security strategy to accommodate big data -- and when not to. (Free registration required.)