IoT
IoT
Data Management // Big Data Analytics
News
1/14/2016
09:06 AM
Connect Directly
Twitter
RSS
E-Mail
50%
50%

Big Data Goes Mainstream: What Now?

Now that big data initiatives are going mainstream in Fortune 1000 companies, CIOs and other C-level executives are targeting the next frontier -- how to transform all that information into products and services -- according to a new report.

9 Reasons Why Personalized Marketing Still Isn't Accurate
9 Reasons Why Personalized Marketing Still Isn't Accurate
(Click image for larger view and slideshow.)

As we enter 2016, big data initiatives are becoming more the mainstream than cutting-edge, and many CIOs are now heading up efforts that go well beyond what they dreamed of implementing a decade ago.

Many organizations are still in transition as they look at the data they have, the data they want to add, the products and services they want to create with that data, and what infrastructure and tools they need to accomplish those goals, according to Randy Bean, CEO and managing director at NewVantage Partners, a management consulting firm that works with C-level executives at many financial services firms in the Fortune 1000.

"The past five years have been about big data," he told InformationWeek. "Organizations want to bring in new sources of data. They want to create new information-based products and services."

This week, Bean's firm released the results of its 4th annual Big Data survey of C-level executives at a smattering of Fortune 1000 companies. Of the 44 companies participating in the survey, many of them are financial services firms and healthcare-related companies, which are two vertical market specialties for the consulting firm.

While the survey, titled "An Update on the Adoption of Big Data in the Fortune 1000" focuses on a small sample, and is described by the NewVantage as anecdotal, it does gather insights from some very high-level executives, including CEOs, CIOs, and chief data officers at big, influential companies. Participants included American Express, MasterCard, Capital One, Bank of America, Morgan Stanley, and Charles Schwab.

Bean shared the results of the survey with InformationWeek. He spoke with us about the questions and concerns that he is hearing from executives at these firms today as they seek to implement big data initiatives.

A Quick History Lesson

Most data efforts in the early 2000s began as "CRM-driven" initiatives as organizations sought to leverage the customer data collected, Bean said. That effort gave way to compliance-driven and regulation-driven efforts in the age of Sarbanes-Oxley and other regulations that put pressure on organizations to achieve better data quality.

That environment has shifted again, starting about five years ago, to encompass big data, Bean said.

Today's organizations are working in two types of environments. On one hand, they have an investment in their legacy enterprise data that resides in CRM systems and their data warehouses that are well-suited for compliance requirements. Then they have added new streams -- or raging rivers -- of data, capturing every detail that can be captured about customers and the transactions they make.

Leveraging the 'Big' in Big Data

For consumer financial services companies, capturing the data behind every transaction of every consumer provides a deeply granular view about where individual consumers shop and what they may buy next. That sets up a whole new realm of possibilities.

"You could be in a position to introduce new kinds of offers," Bean said. "We are in an early stage of figuring out how to do that in a way that is most meaningful to the consumer -- matching services to customers based on needs."

[Looking for more perspectives on the current state of big data? Read Big Data Moves From Hype To Reality.]

Organizations today are often pursuing those goals by implementing big data environments that coexist with the data warehouse, according to Bean. Organizations are currently looking at what information is better suited to what environment.

"There are certain things that a data warehouse is suited for, like data compliance" or operational reporting. "Big data is more about discovery environments and looking for patterns … Right now there is a value to both environments."

Another factor that comes into play between the data warehouse environment and the big data initiatives is cost.

"One of the original premises of big data was it was much more cost-effective than traditional data environments," Bean said. "And that will likely be the case." But the ramp-up in big data has included an upfront investment that has made it financially comparable to what companies already have in place. As companies realize value from their big data investments, the cost will drop. But we haven't quite gotten there, according to Bean.

Big Data Survey Results

While Bean frames the survey as anecdotal due to its limited field of participants, it still provides some interesting insights into how big data efforts have shifted among some big firms within the Fortune 1000.

The survey revealed that 62.5% of respondents said they now have at least one instance of big data in production, nearly double the number of those (31.4%) who reported the same in 2013. Some 26.8% of firms surveyed reported that they will invest more than $50 million in big data by 2017. That's up from just 5.4% of them who said they invested more than $50 million in 2014. Also, 69.6% of those surveyed said they now view big data as very important or critical to their business success.

Chief Data Officer

This year's report shows that 54% of companies surveyed have created the role of chief data officer compared to just 12% in 2012. A full 20% of respondents say that the CDO is the executive with primary ownership for big data initiatives and 14.3 say that the CDO is the primary executive sponsor for big data.

Business Factors Are the Key to Big Data Project Success

What's the biggest factor in business adoption of big data? Not surprisingly, 33.9% (the largest percentage) of those surveyed said that it's business and technology cooperation. Strong business sponsorship was cited as the most critical factor by 23.2% of the respondents. Technology leadership was cited by 5.4%, and no one surveyed cited technology selection as a critical factor.

Along similar lines, 37% of those who participated in the survey (the largest percentage) said that the ability to develop greater insights into business and customers was the biggest driver of big data investment. The next biggest driver cited by respondents included advantages gained from speed -- faster time-to-answer, time-to-decision, time-to-market -- as indicated by 27% of the respondents.

Big Data Hits Mainstream

"In 1995 through 1999, people were rushing to take advantage of the Internet. Now people just use the Internet," Bean said. "They don't say 'Hey I'm using the World Wide Web now,' they just do it. We are entering that phase where big data will just become accepted and a normal part of things. It will take a few more years but that's where we are headed."

**Elite 100 2016: DEADLINE EXTENDED TO JAN. 15, 2016** There's still time to be a part of the prestigious InformationWeek Elite 100! Submit your company's application by Jan. 15, 2016. You'll find instructions and a submission form here: InformationWeek's Elite 100 2016.

Jessica Davis has spent a career covering the intersection of business and technology at titles including IDG's Infoworld, Ziff Davis Enterprise's eWeek and Channel Insider, and Penton Technology's MSPmentor. She's passionate about the practical use of business intelligence, ... View Full Bio

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
kstaron
50%
50%
kstaron,
User Rank: Ninja
1/26/2016 | 11:50:20 AM
Now for the Data scientists
It's interesting to see how big data went through this cycle of being the new big thing and now it just is part of doing business. The main issue with big data is and always had been pulling good data out of it. Now you need to make sure you have people that can properly analyze that data to make sure you don't end up with a big pile of garbage in, garbage out.
pfretty494
100%
0%
pfretty494,
User Rank: Moderator
1/15/2016 | 10:18:15 AM
Operationalizing big data
This is where big data has its true opporunity to shine...moving from proof points to meaningful, operational change. The key to success here is going to rest with encouraging the business leaders to embrace the insights, without over promising on the results. No doubt there is huge potential, but we need to solve one problem at a time as we use big data to transform offerings. Peter Fretty, IDG blogger for SAS
6 Tools to Protect Big Data
6 Tools to Protect Big Data
Most IT teams have their conventional databases covered in terms of security and business continuity. But as we enter the era of big data, Hadoop, and NoSQL, protection schemes need to evolve. In fact, big data could drive the next big security strategy shift.
Register for InformationWeek Newsletters
White Papers
Current Issue
Top IT Trends to Watch in Financial Services
IT pros at banks, investment houses, insurance companies, and other financial services organizations are focused on a range of issues, from peer-to-peer lending to cybersecurity to performance, agility, and compliance. It all matters.
Video
Slideshows
Twitter Feed
InformationWeek Radio
Archived InformationWeek Radio
Join us for a roundup of the top stories on InformationWeek.com for the week of August 21, 2016. We'll be talking with the InformationWeek.com editors and correspondents who brought you the top stories of the week to get the "story behind the story."
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.