Posted By John Rath On February 8, 2010 @ 8:15 am In Storage | No Comments
Back in December we shared some details about the powerhouse data center at Weta Digital , which is responsible for the digital effect featured in the 3D sci-fi epic ”Avatar.” The stunning visual effects produced at Weta have won several awards in past years  and Avatar is nominated for nine Academy Awards, including Art Direction, Cinematography, and Visual Effects.
As the movie continues to generate awards and attention, IT vendors are sharing details of how their systems played a role in creating “Avatar.” Last week NetApp outlined  details of how its storage systems helped reduce Weta’s data management overhead by 95 percent and increased storage price-to-performance ratio by 40 percent.
The data challenges faced by Weta Digital came from Avatar being filmed with revolutionary new motion-capture techniques, which generated more data than any other movie in history (more than the entire Lord of the Rings trilogy combined). To handle the massive storage requirements and provide fast access to that data, Weta worked with NetApp and Fujitsu New Zealand to develop a scalable storage solution.
NetApp SA600 FlexCache  cluster units were selected to maintain high-speed access to texture files being demanded by the 35,000 rendering cores of the renderwall (the computer system used for real-time rendering). The FlexCache units were paired with FAS6000 series storage systems and then linked to the renderwall via two 10 Gigabit Ethernet connections.
HP was another major vendor in the Avatar project, with 4,000 HP BL2x220c blades providing compute power. The HP web page  describing its role in the film’s production talks about selection of the new BladeServers used for rendering and how dramatic power and cooling savings were recognized through working with HP.
“Through water-cooled radiators, closed rack space, and passive rooftop heat exchangers, the data center stayed cool while running full time and often at full capacity, with no air conditioning,” HP says. HP has been involved with Hollywood before, working with DreamWorks on Shrek 2  in 2004, among other digital entertainment projects.
Also mentioned in our original article on Avatar’s data center was BluArc, a provider of high-performance unified network storage. BluArc has provided more details  on Weta’s use of a clustered system of 12 Titan  servers to store and manage over 500 terabytes of data feeding thousands of render nodes.
“The project grew so big that we ended up doubling our BlueArc storage infrastructure in the last six months of production, and the integration and scalability of the new clusters were quick and painless,” said Paul Ryan, chief technology officer at Weta Digital. A BluArc storage solution was also utilized  for the science fiction thriller “District 9,” developed by Canadian visual effects firm Image Engine.
London software firm The Foundry  takes credit for their software being used in the production of visual effects in Avatar. The BBC has a video explaining how they helped creative staff make the power visual effects. Weta Digital purchased  a site license of The Foundry’s Nuke software last summer, but has been using Foundry software since working on The Lord of The Rings Trilogy.
Avatar was one powerful, data-intense, record-breaking movie. Weta Digital has 7 systems  appearing on the TOP500 Supercomputer list, there was more data generated than any other movie in history, Avatar received 11 nominations from the upcoming Visual Effects Society  Awards, and the box office records continue to be recorded.
Digital entertainment and technology have been a long-standing success story:
To complete the data center-centric, geek-filled tour of the world of “Avatar,”I noticed  that the official Avatar movie web site is distributed by Fox Filmed Entertainment via the Level 3 content delivery network.
Article printed from Data Center Knowledge: http://www.datacenterknowledge.com
URL to article: http://www.datacenterknowledge.com/archives/2010/02/08/avatar-hollywood-and-the-data-center/
URLs in this post:
 Image: http://www.datacenterknowledge.com/wp-content/uploads/2009/12/wetadigital-470.jpg
 data center at Weta Digital: http://www.datacenterknowledge.com/archives/2009/12/22/the-data-crunching-powerhouse-behind-avatar/
 past years: http://www.wetafx.co.nz/about/awards/
 outlined: http://www.netapp.com/us/company/news/news-rel-20100203.html
 FlexCache: http://www.netapp.com/us/products/platform-os/flexcache/
 web page: http://h30458.www3.hp.com/us/us/smb/911539.html?JUMPID=EM_TAW_US_JAN10_TSG-ISS_696194_HPGL_US_911586_0&DIMID=1148119494&DICID=null&MRM=1-4BVUP
 DreamWorks on Shrek 2: http://www.hpl.hp.com/news/2004/apr-jun/nab.html?jumpid=reg_R1002_USEN
 more details: http://www.bluearc.com/storage-news/press_releases/pr_100106-avatar.shtml
 Titan: http://www.bluearc.com/data-storage-products/titan-3000-network-storage-system.shtml
 also utilized: http://www.bluearc.com/storage-news/press_releases/pr_090914-district-9.shtml
 The Foundry: http://www.thefoundry.co.uk/
 video explaining: http://news.bbc.co.uk/local/london/hi/people_and_places/arts_and_culture/newsid_8408000/8408314.stm
 purchased: http://www.thefoundry.co.uk/dl_file.aspx?ui=D378FEBB-22A8-42F5-9829-A4A5030C62E9
 7 systems: http://www.top500.org/site/systems/2343
 Visual Effects Society: http://www.visualeffectssociety.com/
 data center: http://www.datacenterknowledge.com/archives/2007/01/26/the-real-death-star-data-center/
 One Data Center To Rule Them All: http://www.datacenterknowledge.com/archives/2008/09/08/one-data-center-to-rule-them-all/
 June 2009 story: http://www.studiodaily.com/filmandvideo/currentissue/ILM-Builds-the-Bots-for-IMAX-Shots-in-Transformers-Sequel_11019.html
 speculates: http://www.greenm3.com/2009/08/what-could-be-in-apples-data-center-future-video-rendering-like-pixars-renderman.html
 $1 billion Apple iData Center: http://www.datacenterknowledge.com/archives/2009/05/26/apple-planning-1-billion-idatacenter/
 I noticed: http://netzome.com/www.avatarmovie.com
 John Rath: http://www.datacenterknowledge.com/archives/author/johnr/
Copyright © 2012 Data Center Knowledge. All rights reserved.