Big Data Reveals Weather-Related Shopping Patterns - InformationWeek
Data Management // Big Data Analytics
10:02 AM
Connect Directly
Ransomware: Latest Developments & How to Defend Against Them
Nov 01, 2017
Ransomware is one of the fastest growing types of malware, and new breeds that escalate quickly ar ...Read More>>

Big Data Reveals Weather-Related Shopping Patterns

Google BigQuery and Tableau Software's visualization tools show how weather affects shoppers' behavior, help retailers prepare for spikes in demand.

5 Big Wishes For Big Data Deployments
5 Big Wishes For Big Data Deployments
(click image for larger view and for slideshow)

If you're a retailer, how do you plan for the unplanned? A sudden winter snowstorm, for instance, can cause a spike in demand for batteries, canned foods and snow shovels. If you don't have enough of those items in stock, customers may grow irate and shop elsewhere -- and perhaps never come back.

Interactions Marketing, a consumer engagement marketing firm, has conducted a big data test case using point-of-sale transactional data and regional weather information data from multiple sources to gain fast insights into shopper behaviors, the company said.

The test case used Google BigQuery, a Web service for interactive analysis of very large datasets, and visual analytics tools from Tableau Software to quickly examine massive quantities of information. This combination of tools allowed Interactions to slash data-analysis times from about week to just hours or even minutes, says Giovanni DeMeo, VP of global marketing and analytics for Interactions.

"We analyzed the data to find out what patterns existed, and identify what those patterns were," DeMeo told InformationWeek in a phone interview. "We were looking for a query that would demonstrate not just the existence of patterns, but also (how) to monetize ... them for retailers and manufacturers that we work with."

[ Big data has become a top marketing skill, but many marketers aren't ready. See Big Data Skills Scarce Among Marketing Pros. ]

The Interactions study identified repetitive weather events (e.g., snowstorms), classified them by severity, and measured their effects on sales before, during and after the events. It also tracked new sales patterns and shopper activity that potentially could help retailers and makers of consumer product goods (CPGs) plan in-store promotions before these events occur.

By using BigQuery and Tableau's visualization software to analyze "hundreds of millions" of rows of data in a very short time, Interactions found it could quickly share significant findings with its retailing and manufacturing customers.

"What we identify as significant is somewhat arbitrary, but it's based on our history of knowing how we can impact sales," said DeMeo.

Interactions' analysts uncovered which products had the most significant sales increases and decreases during specific weather events, and how shoppers' behaviors changed. They factored in a wide variety of data sources, including geographic location, time of day, day of the week and a retailer's proximity to competitors' locations.

Here's what the data analysis found: A day prior to statistically similar weather events, sales in 28 product categories jumped from 20% to 261% over the same day a year earlier.

"Anything with more than 20% or greater increase in sales, over sale-day [the] previous year, gives us the opportunity to identify those categories, and have enough time to communicate with retailers and manufacturers," DeMeo said.

This allows businesses enough time to create promotional campaigns "to educate shoppers ... even before the shoppers know they're going to need those particular items," he added.

On the flip side, the Interactions study also showed a drop in sales during the event's peak (few of us venture out during a blizzard or hurricane) and for four days after. Interestingly, these behaviors took place not only in regions that experienced the weather event, but also in areas where the event was forecast but didn't occur.

Interactions sees its weather test case as just one example of how marketers can use big data to boost sales.

Other companies are analyzing large amounts of weather-related big data for other purposes. EarthRisk Technologies, for instance, is a San Diego-based startup that makes long-term weather forecasts by taking more than 60 years of historical weather data and crunching it with 82 billion calculations.

Our survey finds that most companies will launch mobile commerce within a year. What's your holdup? Also in the new, all-digital Mobile Commerce Takes Off special issue of InformationWeek: Companies that take PCI responsibilities seriously will find that using a cloud provider and staying compliant can be a major project. (Free registration required.)

Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
How Enterprises Are Attacking the IT Security Enterprise
How Enterprises Are Attacking the IT Security Enterprise
To learn more about what organizations are doing to tackle attacks and threats we surveyed a group of 300 IT and infosec professionals to find out what their biggest IT security challenges are and what they're doing to defend against today's threats. Download the report to see what they're saying.
Register for InformationWeek Newsletters
White Papers
Current Issue
2017 State of IT Report
In today's technology-driven world, "innovation" has become a basic expectation. IT leaders are tasked with making technical magic, improving customer experience, and boosting the bottom line -- yet often without any increase to the IT budget. How are organizations striking the balance between new initiatives and cost control? Download our report to learn about the biggest challenges and how savvy IT executives are overcoming them.
Twitter Feed
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Flash Poll