Amazon Disruption Produces Cloud Outage Spiral - InformationWeek

InformationWeek is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

IoT
IoT
Comments
Amazon Disruption Produces Cloud Outage Spiral
Newest First  |  Oldest First  |  Threaded View
Charlie Babcock
50%
50%
Charlie Babcock,
User Rank: Author
10/2/2015 | 6:14:11 PM
Amazon's public statement on the disruption
Amazon produced a public statement on the outage but I did not receive it in time to include in this story. It was: Between 2:13 AM and 7:10 AM PDT on September 20, 2015, Amazon Web Services (AWS) experienced significant error rates with read and write operations for the Amazon DynamoDB service in the US-East Region, which impacted some other AWS services in that region, and caused some AWS customers to experience elevated error rates.  

 
Charlie Babcock
50%
50%
Charlie Babcock,
User Rank: Author
9/22/2015 | 6:05:54 PM
Cloud processes designed to protect your system may eat it alive
"Many of us are customers of Amazon without knowing it." Good point, Tom. The cloud providers still don't know how to get a circuit breaker into an automated process gone awry. Amazon's Easter weekend shutdown four years ago was triggered by human error, when an operations person unplugged a trunk network, then replugged it into a backup network. That made all the data sets visible on that trunk line disappear, which triggered a "remirroring storm" as the cloud software tried to make up for the lost data by creating new sets. While that was going on, everything else pretty much ground to a halt--for 2-3 days.
Thomas Claburn
50%
50%
Thomas Claburn,
User Rank: Author
9/22/2015 | 4:55:22 PM
Re: Cloud shutdown as an automated process
One company affected by the AWS issues was Scout Alarm. This apparently limited the ability of customers to arm and disarm their alarm systems. As we become more dependent on cloud services, let hope Amazon improves reliability. Many of us are AWS customers without knowing it.
Charlie Babcock
50%
50%
Charlie Babcock,
User Rank: Author
9/22/2015 | 4:34:44 PM
Cloud shutdown as an automated process
On Feb. 29, 2012, an expiration date for security certificates that didn't recognize a a leap year caused one virtual machine after another to fail upon its attempted start. Three failed starts in a row caused a host in Microsoft's Azure cloud to conclude that hardware was failing, when it wasn't, and move the faulty virtual machine to another server, where the error could repeat itself. In this manner does cloud software bring down the cloud as an unexpected automated process.   


The State of IT & Cybersecurity Operations 2020
The State of IT & Cybersecurity Operations 2020
Download this report from InformationWeek, in partnership with Dark Reading, to learn more about how today's IT operations teams work with cybersecurity operations, what technologies they are using, and how they communicate and share responsibility--or create risk by failing to do so. Get it now!
Commentary
The Best Way to Get Started with Data Analytics
John Edwards, Technology Journalist & Author,  7/8/2020
Slideshows
10 Cyberattacks on the Rise During the Pandemic
Cynthia Harvey, Freelance Journalist, InformationWeek,  6/24/2020
News
IT Trade Shows Go Virtual: Your 2020 List of Events
Jessica Davis, Senior Editor, Enterprise Apps,  5/29/2020
Register for InformationWeek Newsletters
Video
Current Issue
Key to Cloud Success: The Right Management
This IT Trend highlights some of the steps IT teams can take to keep their cloud environments running in a safe, efficient manner.
White Papers
Slideshows
Twitter Feed
Sponsored Live Streaming Video
Everything You've Been Told About Mobility Is Wrong
Attend this video symposium with Sean Wisdom, Global Director of Mobility Solutions, and learn about how you can harness powerful new products to mobilize your business potential.
Sponsored Video
Flash Poll