Big Data // Big Data Analytics
Commentary
6/18/2014
01:31 PM
Joseph Pigato
Joseph Pigato
Commentary
Connect Directly
Twitter
RSS
E-Mail
100%
0%

Predictive Analytics: 6 Teamwork Tips

One quarter of companies in TDWI's research cite "data ownership and political issues" as the No. 1 challenge with big data analytics.

10 More Powerful Facts About Big Data
10 More Powerful Facts About Big Data
(Click image for larger view and slideshow.)

Predictive analytics is fast becoming a mainstream technology tied to business outcomes, so the playing field is expanding from data science labs into the business and even corner offices.

According to TDWI 's Predictive Analytics for Business Advantages 2014 survey, business analysts will soon overtake statisticians and data scientists as the top users of predictive analytics tools. To prepare for this transformation, where data teams and business managers work closely together, here are six tips to help companies take advantage of predictive analytics:

1. Pinpoint the need
Too often, teams try to aggregate interesting data sources and see where it takes them. Data scientists and business managers need to define their problem as well as what they 're testing for and their desired outcomes. Only then should the data team start building a model.

[Want more on the mainstreaming of predictive analytics? Read Microsoft Brings Predictive Analysis To Azure.]

Companies cite "knowledge of the business" and "critical thinking" as the top two required skills for successful predictive analytics projects, according to TDWI. This underscores the importance of business teams driving the questions that data teams in turn answer. Avoid open-ended questions, which force analysts to develop a system that may not solve the business problem at hand. Targeted, specific questions leave little wiggle room for data scientists to go off course.

2. Don't underestimate office politics
One quarter of companies in TDWI's research cite "data ownership and political issues" as the number-one challenge with big data analytics. That's because companies collect data across all departments, so there's a lack of visibility into what's being collected and who is collecting it. Consequently, trying to acquire this information can be like trying to get a bone from fifteen territorial bulldogs. This task needs to be handled either by a skilled business manager heading the data project or a senior-level champion who can command everyone to "play nice."

Don't discount this threat. Many analytics projects have failed due to political grandstanding and in-fighting among business folks. When some are asked to hand over their data to another manager, they fear helping someone else to get a big win.

3. Keep it simple
Overfitting is a common data-modeling problem. Data scientists often find a sense of challenge and pride in building complex data models. But they cannot afford to lose sight of the fact that data eventually needs to be explained to business managers in a clear, concise way.

Shoot for simplicity and prioritize data volume and data quality over model complexity. Running data through powerful -- but not overwrought -- models guarantees the clearest, most accurate insight. That's not to say there isn't a place for more complex modeling. Just remember that the overarching goal is to provide value to the business. Data professionals can simplify their modeling work and ensure they'll deliver actionable information by working with business managers from the beginning of project, instead of waiting until the end.

4. Ensure that data drives the timeline
TDWI cites data integration as both the top challenge and the most important component of predictive analytics projects. When decision-makers need answers, they need them yesterday. They expect machine-based calculations to happen in seconds, not days or weeks. In reality, the timing of predictive modeling is unpredictable, so data scientists -- not business managers -- need to mandate the timeline, which starts when the data is ready, collected, organized, aggregated, and integrated. By managing expectations, you can avoid the inevitable pitfalls that plague projects where there is last-minute modeling and poor data preparation.

5. Embed data teams
There is often a difference between people who structure the collection of data and those who use it for analysis. Embedding data professionals within business teams ensures interaction between these two parties from the beginning. It also ensures that the data that's collected is useful for analysis and that minimal data-transformation work is required.

6. Increase business involvement
Data teams often figure that their job stops after they present the data, as business managers can then interpret the data and put the findings to use. The latest software helps business managers have more control over predictive analytics projects, but they still lack the quantitative muscle to spot nuances in data. Data teams have to communicate quantitative findings for business managers so they can better understand and present insights to business colleagues and senior managers.

Today's larger playing field for predictive analytics demands better coordination and collaboration between data scientists and technically minded business managers. That's no small task, but the rewards can be enormous.

InformationWeek's June Must Reads is a compendium of our best recent coverage of big data. Find out one CIO's take on what's driving big data, key points on platform considerations, why a recent White House report on the topic has earned praise and skepticism, and much more.

Joseph Pigato is the Managing Director of Sparked, which helps companies retain their customers through sophisticated predictive analytics and engagement tools. You can reach him at joseph@sparked.com and follow him on Twitter @josephpigato. View Full Bio
Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
galapagos1809
50%
50%
galapagos1809,
User Rank: Apprentice
6/24/2014 | 6:28:53 PM
Stellar summary of tips
Joseph:  The tips were all excellent on their merits, but this lead-in line from tip by itself made the article important:

 

"Too often, teams try to aggregate interesting data sources and see where it takes them."

 

You then go on to do a fantastic job of fleshing out what it translates to: really forcing the business side of the house to lead the way, and the data side to mine and massage the data as needed to get where they're being led.  Your 6th tip is a deeper dive of the same notion.  It taks us back to the old science fair project so many were forced to do as a kid: first, truly think about what you're testing for, then come up with the best method to do with the readily available means (read: data and its various sources and surrounding tooling).  You are absolutely on point here.

 

Toben
6 Tools to Protect Big Data
6 Tools to Protect Big Data
Most IT teams have their conventional databases covered in terms of security and business continuity. But as we enter the era of big data, Hadoop, and NoSQL, protection schemes need to evolve. In fact, big data could drive the next big security strategy shift.
Register for InformationWeek Newsletters
White Papers
Current Issue
InformationWeek Tech Digest, Dec. 9, 2014
Apps will make or break the tablet as a work device, but don't shortchange critical factors related to hardware, security, peripherals, and integration.
Video
Slideshows
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
Join us for a roundup of the top stories on InformationWeek.com for the week of December 14, 2014. Be here for the show and for the incredible Friday Afternoon Conversation that runs beside the program.
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.