Scaling Flickr, and Other Huge Databases

Microsoft’s James Hamilton has been collecting scaling stories for a while, and has shared a list of resources providing insider accounts of how the Web’s largest sites have managed their scalability challenges. The post focuses on Flickr’s database architecture, but also provides links to similar accounts for Amazon, LinkedIn, Second Life, CraigsList and MySpace. Readers focused on scalability may also be interested in Breakthrough Failures That Help Sites Scale.

As we noted in that story, many of the toughest scaling challenges involve databases. This week Jeff Atwood at Coding Horror wrote about database normalization, sparking a conversation that Todd Hoff at High Scalability has dubbed “the mother of all database normalization debates.”

Get Daily Email News from DCK!
Subscribe now and get our special report, "The World's Most Unique Data Centers."

Enter your email to receive messages about offerings by Penton, its brands, affiliates and/or third-party partners, consistent with Penton's Privacy Policy.

About the Author

Rich Miller is the founder and editor at large of Data Center Knowledge, and has been reporting on the data center sector since 2000. He has tracked the growing impact of high-density computing on the power and cooling of data centers, and the resulting push for improved energy efficiency in these facilities.