IBM’s Hot-Water Supercomputer Goes Live

18 comments

A close-up of the IBM Aquasar server blade shows the piping and processor enclosures supporting the water-cooling system.

A close-up of the IBM Aquasar server blade shows the piping and processor enclosures supporting the water-cooling system.

IBM has delivered a supercomputer cooled by hot water to the Swiss Federal Institute of Technology Zurich (ETH Zurich), which IBM says marks “a new era in energy-aware computing.” The Aquasar cooling system uses water at temperatures of up to 140 degrees, and as a result consumes up to 40 percent less energy than a comparable air-cooled machine. The system also uses waste heat to provide warmth to university buildings, reducing Aquasar’s carbon footprint even further.

The deployment comes a year after ETH and IBM scientists announced plans to collaborate on chip-level water-cooling and energy reuse. The supercomputer, which is now fully operational, consists of special water-cooled IBM BladeCenter Servers designed by IBM scientists in Zurich and Boblingen, Germany. Each of the blades will be equipped with a high-performance liquid cooler on each processor, as well as input and output pipeline networks and connections, which allow each blade to be connected and disconnected easily to the entire system (see photo above). For direct comparison with traditional systems, Aquasar also includes air-cooled BladeCenter servers.

Six Teraflop System
The Aquasar system achieves a performance of six Teraflops and has an energy efficiency of about 450 megaflops per watt. In addition, nine kilowatts of thermal power are fed into the ETH Zurich’s building heating system.

A unique feature of the system is the chip-level cooling with a water temperature of about 60 degrees C (140 degrees F) will keep the chip at operating temperature well below the maximum 85 degrees C (185 degrees). The high input temperature of the coolant results in an even higher-grade output heat of about 65 degrees C. Chiller systems in traditional data centers typically use much lower water temperatures of 45 to 50 degrees F to cool air for use in data center cooling.

The pipelines from the individual blades link to the larger network of the server rack, which in turn are connected to the main water transportation network. The water-cooled supercomputer will require about 10 liters of water for cooling, and a pump ensures a flow rate of roughly 30 liters per minute.

Closed Circuit Cooling System
The entire cooling system is a closed circuit: the cooling water is heated constantly by the chips and consequently cooled to the required temperature as it passes through a passive heat exchanger, thus delivering the removed heat directly to the heating system of the university in this experimental phase. This eliminates the need for energy-hungry chillers.

“With Aquasar, we make an important contribution to the development of sustainable high performance computers and computer system,” said Prof. Dimos Poulikakos, head of the Laboratory of Thermodynamics in New Technologies, ETH Zurich. “In the future it will be important to measure how efficiently a computer is per watt and per gram of equivalent CO2 production.” ETH Zurich will use the supercomputer for multiscale flow simulations for its research in nanotechnology and fluid dynamics.

“With Aquasar we achieved an important milestone on the way to CO2-neutral data centers,” said Dr. Bruno Michel, manager of Advanced Thermal Packaging at IBM Research – Zurich. “The next step in our research is to focus on the performance and characteristics of the cooling system which will be measured with an extensive system of sensors, in order to optimize it further.”

Here’s a video offering a high-level overview of the Aquasar system, which runs about 2 minutes.

This diagram explains how Aquasar will work. Click the image for a larger version.

ibm-aquasar-schematic-470

About the Author

Rich Miller is the founder and editor-in-chief of Data Center Knowledge, and has been reporting on the data center sector since 2000. He has tracked the growing impact of high-density computing on the power and cooling of data centers, and the resulting push for improved energy efficiency in these facilities.

Add Your Comments

  • (will not be published)

18 Comments

  1. Hermitbiker

    .... super amazing concept gone live in use.... I really hope it works as well as they projected.... it will be another "breakthrough" for the computer world.... well at least in the "super-computer" bracket !! :)

  2. Engiblog.com

    I think that this technology be applied in real soon this course.

  3. bob

    The plumbers union will be thrilled.

  4. We have patents that cool microprocessors by direct cool components of electronic devices. We have demonstrated that we can lower the CPU temp to <40°F even in ambient room temps of 95°F. Dew points, humidity and condensation are eliminated in our system using patented condensation measures. If you would like to look at it let me know. drgunderson@hotmail.com So lowering the CPUs to 86F instead of 140F how much energy and cost would you save?

  5. neuroxik

    The blue and red valves make it look like a cardiovascular system works

  6. yetanotherapplicationorjustaninvention

    Better be honest ! This is just an realization of a known solution.. Ok let me clarify on that. many people in the "area" of overclocking already know that water can be used as better cooling solution. Many overclockers have already used water with their projects. so... There is nothing new ! There in IBM they just make a working example with supercomputers. Nothing new ,nothing inovative ,NOTHING revolutionary or such...

  7. Matt

    Green? Efficient? ....What about the energy to heat the water in the first place? What a joke. Lab tech's and developers need to go back to old school instead of staring at computer diagrams and charts that tell them what to do. This reminds me of the corn bio-fuel process of expending more energy than is return. Why not build a perpetual motion machine that runs from human ignorance.

  8. Matthew

    True, your ignorance alone would run the motion on the machine. Heat is a natural byproduct of any electrical design, why not use that heat to, I don't know, heat water? Which could in turn cool down other parts of the circuit through this design? It's nothing new, obviously, but you do realize it's more efficient than that fan you are using on your CPU right? Place yourself outside of the spectrum to criticize what's in it.

  9. Dave Zarbolias

    Water Cooled nothing new I have been using it on my Home System for at least 10 Years. Works well but as stated by yetanotherapplicationorjustaninvention nothing new. Check out web site http://www.koolance.com.

  10. Doesn't sound a innovation. IBM has to do something more than that to get credit for innovation.