Amazon Cloud Now Stores 339 Billion Objects
June 22nd, 2011 By: Rich Miller
SAN FRANCISCO – What’s the state of the cloud? It’s getting bigger all the time, and sophisticated enterprise applications represent one of the fastest-growing sectors. That’s the bottom line from Werner Vogels, the CTO of Amazon Web Services, who gave his annual “state of the cloud” presentation Wednesday morning at the GigaOm Structure 2011 conference.
First, the numbers: Amazon’s S3 storage service now houses 339 billion objects, more than doubling the volume from the same time last year, when S3 stored 150 billion objects. Vogels sees more breakneck growth ahead. “I think we’re just getting to the hockey stick,” he said.
Enterprise Cloud Apps grow More Sophisticated
Vogels’ main message was that Amazon Web Services is seeing greater adoption by enterprises building advanced applications, some using cloud-certified versions of applications from SAP and Oracle, two software companies that are huge players in the enterprise market.
An example: The U.S. government’s Recovery.gov web site, which is powered by software from Microsoft, SAP and ESRI and runs completely in the Amazon cloud.
Spot Pricing Drives Enterprise Usage
Vogel said Amazon’s introduction of spot pricing for AWS instances has been a huge driver of enterprise usage. Spot pricing allows customers to bid on unused Amazon EC2 capacity and run those instances when they meet defined price points. This dynamic pricing allows companies to save money by running applications only when spot prices fall below a designated price point.
“This has become very, very successful in helping (web) architects feel comfortable about the prices they are paying,” said Vogels. “The things that are being enabled by spot pricing are amazing. Some of our customers have extremely sophisticated batch processing. Their bidding strategies are fascinating. They’re making sure they get the lowest price possible.”
These include checkpoint/restore processes that will run when instances are available at a certain price, halt the process if spot prices rise, and then resume the job when the price falls back within their pricing parameters.
To encourage further adoption of spot pricing, Vogels said that it is now available with Elastic MapReduce, a hosted Hadoop framework that offers AWS users the ability to process huge amounts of data.
GPU Clusters Gaining Traction
Vogels also said that a growing number of customers are shifting workloads to Amazon clusters using graphics processing units (GPUs). These include Animoto, the video production company that runs entirely on the Amazon cloud and has become a poster child for AWS and its capabilities.
Vogels also noted that Amazon eats its own dog food. As of Nov. 10, 2010, all of the web traffic for Amazon.com is being served by Amazon Web Services, he said.
What’s ahead for Amazon’s cloud operation? “Each year we see our customers building more sophisticated applications,” said Vogels. “It’s still day one. there’s more work to be done.”
The future of cloud computing will not totally depend on private cloud system. Meaning, enterprise cloud apps will soon loose its grounds. Cloud computing’s future will be a hybrid – getting the gains of both public and private.
This is what Amazon should focus on – starting now.
I think that it is interesting that the source for the story about “outrageous cloud growth” is the CTO of the biggest cloud service provider. Like all newly embraced technologies; cloud services will grow, but with a slower economy I think that a combination of limited budgets and an “un-battletested” service will keep many on the sideline for some time to come. IMO of course.
[...] Amazon Cloud Now Stores 339 Billion Objects, more than doubling last years volume. [...]
[...] lot of data…CERN: ATLAS produces up to 320M bytes per second, followed by CMS with 220M Bps. Amazon Cloud Now Stores 339 Billion Objects. CERN also has an open source hardware [...]
[...] Amazon Cloud Now Stores 339 Billion Objects. [...]
[...] ones – will be in other people’s large hands: Amazon S3 storage service now stores 339 billion objects – twice last year’s volume. We’ll gain in terms of convenience and efficiency. We [...]