AWS hit by overheating outage in northern Virginia, disrupting Coinbase


A single data centre’s cooling system fell behind. AWS shifted traffic away from the affected zone and warned that fully restoring the remaining services would take longer than expected.


Amazon Web Services said on Thursday that one of its data centres in northern Virginia was running hot enough to disrupt customer workloads, and that engineers were still bringing the site fully back online when most users had gone to bed for the night.

The trigger was prosaic: increased temperatures inside a single data centre, attributed to a cooling-system shortfall, forced AWS to throttle and then partly reroute traffic away from the affected Availability Zone.

By the company’s account, additional cooling capacity began coming online a couple of hours after the first impact reports, and “early signs of recovery” appeared shortly after.

The 💜 of EU tech

The latest rumblings from the EU tech scene, a story from our wise ol’ founder Boris, and some questionable AI art. It’s free, every week, in your inbox. Sign up now!

A later update was less reassuring: bringing in enough extra cooling to safely restart the remaining systems was taking longer than expected, and AWS was unwilling to put a clock on full restoration.

Coinbase confirmed that its trading platform problems were caused by the AWS event. After several hours of degraded markets, the exchange said all markets had been re-enabled, and trading was back to normal.

CME Group, the world’s largest derivatives marketplace, also reported issues with its CME Direct platform during the same window, although it described the cause only as “essential maintenance” and did not say whether the AWS event was a factor. Both companies declined further comment outside business hours.

The northern Virginia cluster, US-East-1 in AWS terminology, is the company’s oldest, busiest, and most concentrated region.

An Availability Zone in that region groups one or more physical data centres that are designed to operate independently, and AWS’s official guidance during recovery was the standard recommendation: customers running in the affected zone should fail over to one of the others. That works well for engineering teams who have built for it. It works less well for those who have not.

The pattern is becoming familiar. AWS suffered a far larger outage last October when a DNS resolution failure in DynamoDB cascaded across more than a hundred services and took offline platforms ranging from Snapchat and Reddit to United Airlines and Coinbase. That event lasted roughly fourteen hours and was the largest internet-wide disruption since the CrowdStrike software malfunction of 2024.

A month later, CME suffered one of its longest trading outages in years, traced back to a cooling failure at a CyrusOne data centre in the Chicago area.

The repetition matters. Cooling failures, configuration errors and DNS misfires are different technical events, but they share an outcome: a single physical or logical site becomes the bottleneck for an outsized share of public-facing traffic. The northern Virginia region carries that load by historical accident more than design.

AWS launched the region in 2006 and US-East-1 has accumulated workloads, regulatory dependencies and customer inertia ever since. The hyperscalers are spending tens of billions to expand other regions, but customer concentration in US-East-1 is unlikely to shift quickly.

Coinbase’s exposure to the cloud sits inside a longer arc. The Cloudflare-driven outage that took down Coinbase and other exchanges in 2019 was a different failure mode, but the same lesson, and it is part of why crypto exchanges have spent the years since architecting for multi-region failover.

Thursday’s incident demonstrates that even with that work, a single warm-room shutdown still ripples into a market that is supposed to be open around the clock.

CME’s situation is more delicate. Derivatives markets sit on top of complex margin and clearing pipelines that do not gracefully degrade easily; an outage at peak Asia hours, as Thursday’s was, hits clearing-cycle deadlines that move money the next morning.

Whether the CME issue was directly tied to the AWS event will determine how the trading-resilience conversation lands with regulators.

AWS has not estimated the affected workload count, and Amazon has not yet said why the cooling system fell behind, whether the issue was equipment, ambient conditions, or a combination.

The northern Virginia region has spent the past year absorbing a wave of new AI-training and inference capacity, which runs hotter and denser than traditional cloud workloads; whether that is incidentally relevant to Thursday’s failure or substantively part of the cause is the question the post-incident report will need to address.

For most customers, the fix is the one AWS recommended in its first update: stop running everything in a single Availability Zone in a single region. That advice has been on AWS’s own architecture-best-practice page for years. Each failure of this kind raises the cost of having ignored it.



Source link

Leave a Reply

Subscribe to Our Newsletter

Get our latest articles delivered straight to your inbox. No spam, we promise.

Recent Reviews


Whoop MG on arm

The Whoop is one of the devices that Google’s rumored screenless health tracker would compete with.

Nina Raemont/ZDNET

Follow ZDNET: Add us as a preferred source on Google.


ZDNET’s key takeaways 

  • Google is poised to unveil a Whoop dupe soon. 
  • Steph Curry teased a screenless health band on his Instagram. 
  • Here’s what I’d like to see from a Google fitness band. 

Could Google’s latest fitness tracker return to its original, screenless Fitbit form? All signs say yes. Google has teased a screenless, Whoop-adjacent health tracker with the help of basketball star Steph Curry. A recent Instagram post from Curry shows him wearing a screenless, fabric band around his wrist, and the accompanying caption promotes “a new relationship with your health.” 

There are scant confirmed details on this next device, but rumors suggest the band will be called “Fitbit Air.” 

Also: I replaced my Whoop with a rival fitness band that has no monthly fees – and it’s nearly as good

Why a screenless fitness band? And why now? Google’s new device could be taking interest away from popular fitness brand Whoop. Whoop’s fitness band is on the more luxurious end of the health wearables spectrum. The company offers three subscription tiers, starting at $199, $239, and $359 annually. Google’s device, on the other hand, is rumored to be more affordable with the option to upgrade to Fitbit Premium. 

Google has the opportunity to make an accessibly priced fitness band with the rumored Fitbit Air and breathe new life into its older Fitbit product lineup, which hasn’t been updated in years. 

What I’m expecting 

Here’s what I expect to see and what I hope Google prioritizes in this new health tracker.

Given Fitbit’s bare-bones approach to fitness tracking, I assume Google will emphasize an affordable, accessible fitness band with the Fitbit Air. Most Fitbit products cost between $130 and $230, so I’m expecting this band to be on the lower end of that price range. I’d also expect Fitbit to give users a free trial of Fitbit Premium. 

Also: T-Mobile is practically giving away the Apple Watch Series 11 – here’s how to get one

A long, long, long battery life 

A smartwatch with a bright screen and integrations with an accompanying smartphone consumes a lot of power. That’s why some of the best smartwatches on the market have a middling battery life of one to two days, tops. 

A fitness band, on the other hand, is screenless. That makes the battery potential on this Fitbit Air double — or even triple — that of Google’s smartwatches.

Also: I use this 30-second routine to fix sluggish Samsung smartwatches – and it works every time

The Fitbit Inspire 3 has around 10 days of battery life — with a watch display. I hope the screenless Fitbit Air has at least 10 days of battery life, plus some change. Two weeks of battery life would be splendid. 

In addition to usage time, I also hope that a screenless fitness tracker addresses some of the issues Fitbit Inspire users have complained about. Many Inspire users report that the device’s screen died after a year of use. They could still access data through the app, but the screen was dysfunctional. Despite being a more affordable Google health tracker, the Fitbit Air should last users for a few years without any hardware issues — or at least I hope it does. 

Fitbit’s classically accurate heart rate measurements 

As Google’s Performance Advisor and the athlete teasing Google’s next device, Steph Curry is sending the message that this new device, one that offers wearers “a new relationship with your health,” will be built for athletes and exercise enthusiasts. I hope this device homes in on accurate heart rate measurements and advanced sensing, as other Fitbit devices do. 

Also: I walked 3,000 steps with my Apple Watch, Google Pixel, and Oura Ring – this tracker was most accurate

Like Whoop, I hope the insights the Fitbit Air provides are performance- and recovery-driven. Whoop grew in popularity for exactly this reason. Not only do Whoop users get their sleep and recovery score, but they also see, through graphs and health data illustrations, how their daily exercise exertion, strain, and sleep interact with and inform each other. 

I’m assuming that Fitbit Premium, with its AI-powered health coach and revamped app design, may do a lot of the heavy lifting for sleep and recovery insights with this new product. 

Also: Are AI health coach subscriptions a scam? My verdict after testing Fitbit’s for a month

But I also hope Google adds a few features on the app’s home screen that specifically target athletic strain and recovery, beyond the steps, sleep, readiness, and weekly exercise percentage already available on the Fitbit app’s main screen. 

Lots of customizable, distinct bands 

I hope the Fitbit Air is cheap — and the accompanying bands are even cheaper. If the rumors of affordability are true, then I’d hope Fitbit sells bands that can be worn with the device that match users’ styles and color preferences at a similarly affordable and accessible price point. Curry wears a gray-orange band in his teaser. I hope the colorways for this device are bold, patterned, and easily distinguishable from rival fitness bands. 





Source link