The Immersion Data Center: The New Frontier of High-Density Computing
July 1st, 2013 By: Rich Miller
HOUSTON – As you enter the data center at CGG, the first thing you notice is what’s missing – the noise and the breeze. Instead of rows of air-cooled black cabinets, the room is filled with tanks of liquid coolant, each containing up to 42 servers.
This is the new frontier of immersion cooling, with servers submerged in a liquid similar to mineral oil. It’s also what a growing number of data centers may look like in coming years.
The explosion of data we generate every day is creating a need for industrial strength data crunching. That’s the specialty of CGG, which provides high-end geological and geophysical analysis to its customers, who are primarily from the oil and gas industry. One areas of its expertise involves using powerful computers to sort through mountains of seismic data to produce images of the earth’s geology to help identify the best places to find new sources of energy.
CGG’s Houston data center is one of several hubs in its global network of 43 subsurface imaging centers. The company has shifted an entire data hall to an immersion cooling technology developed by Green Revolution Cooling (GRC). Instead of cool air flowing through a standing cabinet, the GRC system effectively tips the cooling paradigm on its back, with a liquid coolant flowing across servers housed in a tank.
Taking Immersion Cooling to Data Center Scale
Since its launch in 2009, Green Revolution has seen its technology used in facilities from an Austin hosting company, several universities, telecom firms and ultra-scale cloud providers. CGG has been the first company to deploy the GRC system at scale, with dozens of tanks in a single facility, providing its large-scale data processing infrastructure with new levels of energy savings, efficiency and performance.
In this video, the IT team at CGG takes us inside their data center to provide a detailed look at their unique data center and its use of immersion cooling.
Will the appetite for ever-more powerful computing clusters push more users to adopt immersion cooling technologies? Intel recently concluded a year-long test with GRC technology and affirmed that its immersion cooling is highly efficient and safe for servers. The giant chipmaker says it will explore the development of reference designs and custom motherboards optimized for immersion cooling.
Intel’s research lays the groundwork for end users or server OEMs to deploy oil-based cooling technologies on a broader basis. But a key first step is to see the technology working at scale in a live production data center. CGG’s data center provides a window into that experience – and perhaps, the future of high performance computing.
Interesting article, but there is a quiet solution available that allows you to run servers as fast as 5.40 GHz without using submersion. The Chicago Mercantile Exchange and other High Frequency Trading co-locations are populated with “Flash Servers” designed by Liquid Nitrogen Overclocking, Inc. And, no, they don’t use liquid nitrogen, they use something called a Microchannel Heat Pipe which is a pumpless cooling solution.
Interesting, but I don’t see how you could perform replacement of parts, like power supply or HDD, while the server is still running. Also, you have to shut down the server if you ever want to open it. This makes maintenance harder.
eduardoPosted September 11th, 2013
check the vidio they do peform a repair with the servers running
mattPosted December 10th, 2013
I have seen these units. These are operating in an HPC environment. Losing a node is not a big deal as is replacement of components on a failed node is a way of life. While I do not think that this oil immersion is cost effective for regular cpu based clusters it does have to be investigated for use with high heat gpu type of computing, FWI, RTM WAZ processing like cgg does. One thing that CGG does well is adapt and not lock itself into one type of technology. I’ll be following their use of the oil in the future. One real nice feature of the oil is that you do not have to waste raised floor space. You can put these all on slabs and at ~3K lbs per unit you would need to put it on a slab if you wanted to grow your ‘racks’ vertically and add more rows.