Estimate: Amazon Cloud Backed by 450,000 Servers
March 14th, 2012 By: Rich Miller
How many servers does it take to power Amazon’s huge cloud computing operation? Like many large Internet companies, Amazon doesn’t disclose details of its infrastructure, including how many servers it uses. But a researcher estimates that Amazon Web Services is using at least 454,400 servers in seven data center hubs around the globe.
Huan Liu, a research manager at Accenture Technology Labs, analyzed Amazon’s EC2 compute service using internal and external IP addresses, which he extrapolated to come up with estimates for the number of racks in each data center location. Liu then applied an assumption of 64 blade servers per rack – four 10U chassis, each holding eight blades – to arrive at the estimate.
That’s one of several assumptions at the heart of Liu’s estimate, which he notes in documenting his methodology, complete with caveats. Photos from a 2011 presentation by AWS Distinguished Engineer James Hamilton show 1U “pizza box” rackmount servers rather than blades, but it’s not known if that was a recent depiction of Amazon’s infrastructure (see Hamilton’s presentation for more). But the server estimate seems feasible given Hamilton’s assumption that an 8 megawatt data center could include 46,000 servers.
One interesting aspect of Liu’s research is that it shows the concentration of Amazon’s IP addresses in its US East region in northern Virginia, where Amazon maintains several data centers. He estimates that Amazon has 5,030 racks in northern Virginia, or about 70 percent of the estimated total of 7,100 racks for AWS. By contrast, the new Amazon US West (Oregon) region has just 41 racks, which are reportedly deployed in containers.
Liu’s estimate is bound to generate some debate. But it provides an additional point of reference for Amazon’s scale, along with earlier analyses from Randy Bias and Guy Rosen. It clearly places the size of Amazon’s structure well above the hosting providers that have publicly disclosed their server counts, but still well below the estimated 900,000 servers in Google’s data center network.
GavoirPosted March 15th, 2012
I somehow think not. They have ~17,000 cores. (http://www.gizmodo.co.uk/2011/11/amazon-powers-silk-with-one-of-the-worlds-fastest-supercomputers/). You can’t have 17,000 cores in 454,000 servers. They have less than 1500 machines to do this, assuming they use the same sort of kit as the rest of us supercomputing sites (22,000 cores in ~1800 machines).
If they need to spread out to the west, we have room out here in western Nebraska. 46 unused fiber strands are waiting to be lit up and with connection to Silicon Mountain(Denver)
Ben InteractivePosted March 15th, 2012
“64 blade servers per rack – four 10U chassis, each holding eight blades”
So 4*8=64? What kind of researcher is this guy?
All that heat… I hope they have attached greenhouses.
Gavoir, you seem to be jumping to the conclusion that those 17,000 make up all of Amazon’s Cloud.
First, it only refers to EC2. I’m sure they also have a lot of servers behind S3 and their other services.
Second, I am fairly certain that they only used a subset of EC2 for their top 500 entry. For one thing, they were servicing other customers at the time. For another thing, Amazon clients have used EC2 to provision even larger clusters. For example, this article about a 30,000 cluster from last fall:
Also, I recall some talk from people who have spun up even larger clusters on EC2, for unnamed clients who would prefer to remain that way.
[...] Amazon AWS powered by nearly half a million servers [...]
[...] is not without reason however, as everyone is trying to build a better, bigger, and more efficient cloud computing solution. A recent study released by Huan Liu at Accenture Technology Labs, predicted that Amazon’s Web [...]
[...] AWS’ biggest facility, in Virginia, which is estimated to hold 70% of their global servers [source], is located on a coal-heavy grid [source]. By the way, I’m focussing on AWS for this talk, but [...]
[...] Amazon, but even that offers some useful insight. As Francine Bennett notes, the vast majority (possibly 70%) of Amazon jobs run in the company’s Virginia data centre. When Virginia’s cool (which [...]