Can Open Source Solve Big Data For SMBs?
SMBs struggle to identify the right provider for the right need
(Page 2 of 2)
"I would agree that some of the other technologies, particularly on the analytics side, are a bit more complex than perhaps some SMBs are comfortable with," Phillips said in an interview. "I think that's going to change over time, certainly, but some of those technologies have focused more on raw analytical power and raw science rather than customization and simplicity. If those markets are going to grow--and I believe they are on their side--then they're going to have to deal with simplicity issues."
More SMB Insights
- BYOD Best Practices for SMBs
- Effective IT Inventory and Asset Management: From Quagmire to Quick Fix
- Lightweight Application Development Systems Ride the Cloud: IDG Report
- Fulfilling the Lean Software Promise: Building and Running Spring Applications on VMware vFabric tc Server
There are without doubt SMBs, particularly web services companies and other tech startups, that have the requisite in-house expertise to harness that power today. But the open source data maze could send the broader SMB universe running faster than you can say "NoSQL." It requires a certain amount of knowledge simply to identify the right provider for the right need.
Take Cloudera--the company might be on the forefront of Hadoop-based data management, but it's not for every SMB. In the so-called data stack, Cloudera positions itself as a foundational platform, but it would be a poor choice for a small company not dealing with heavy-duty data volume. "If you don't have your hands on at least a couple of terabytes of data, Hadoop is probably not a good fit for you," Cloudera's Zledewski said. He added that Cloudera is investing in ease of use in a several ways, including working with MicroStrategy to allow for its visualization interfaces to be used on top of Hadoop, as well as streamlining tools for installation and ongoing management. "We try to lower the barrier for what it takes to take advantage of this system," Zedlewski said.
For data-intensive SMBs looking to add IT staff to tackle the terabytes, Smith from Revolution Analytics offers a take that might be welcome news: Current and upcoming crops of university graduates will be increasingly well-versed in open source software, which means young (read: cheap) talent is waiting in the wings. "Being able to find technical people that can work with each of the stages and phases of this data analytics stack--as opposed to having to hire an industry veteran that's been trained for over 20 years in one of these monolithic solutions--is really getting [SMBs] much more advanced talent at a much lower cost."
It may be a matter of time before open source truly emerges as a clear-cut option for smaller businesses grappling with growing data, particularly those making their first foray out of largely manual systems into true data management and analysis. Given the chance to mature and invest in ease of use, the open source players could ultimately become a major force for a wide range of SMBs, particularly those priced out by enterprise-focused vendors. But that could require some patience. Commenting on Cloudera, for example, Raden of Hired Brains said: "This is a different kettle of fish. It doesn't support interactive query, requires real programming skill, and is still pretty raw. Expect that to change, but for now, unless you have very large data requirements, it's not a solution."
In the meantime, the data isn't going to stop growing and flowing. The cost advantages of open source are evident, even if it requires an investment in new in-house skills. "There is a level of technical expertise required, but if you're at a size where you have data that needs to be analyzed through either ad-hoc query or structured reports, then you've outgrown Excel," said IDC's McDonough. "You're at a point as a company where you need to start looking at BI tool options."
In the new, all-digital InformationWeek supplement: Our 2011 Strategic Security Survey confronts the five biggest problems faced by midsize companies. Download it now. (Free registration required.)