Energy Efficiency Guide: Data Center Temperature
March 10th, 2011 By: Colleen Miller
Most data centers operate in a temperature range between 68 and 72 degrees Fahrenheit, and some are as cold as 55 degrees. Raising the baseline temperature inside the data center – known as a set point – can save money by reducing the amount of energy used for air conditioning. It’s been estimated that data center managers can save 4 percent in energy costs for every degree of upward change in the set point. The list of companies singing the praises of savings through higher baseline temperature settings in the data center includes Google, Intel, Sun and HP.
But nudging the thermostat higher may also allow less time to recover from a cooling failure, and is only appropriate for companies with a strong understanding of the cooling conditions in their facility.
Raising the Recommended Temperature Set Point
In 2009, the leading industry group for heating and cooling professionals joined the chorus of voices calling for upward temperatures. The American Society for Heating, Refrigerating and Air-conditioning Engineers (ASHRAE) expanded its recommendations for ambient data center temperatures, raising its recommended upper limit from 77 degrees to 80.6 degrees. Last month ASHRAE indicated that it will soon expand its temperature recommendation again.
Examples of Use Cases
In live settings, companies are seeing that improved monitoring and airflow management can allow data center managers to be more aggressive with higher temperatures. In some cases, raising the temperature can allow companies to operate facilities that make minimal use of chillers – or don’t use them at all.
Chillers, which are used to refrigerate water, are widely used in data center cooling systems but require a large amount of electricity to operate. With the growing focus on power costs, many data centers are reducing their reliance on chillers to improve the energy efficiency of their facilities.
But can servers take the heat? Recent data suggests that servers are far sturdier than previously assumed. In a landmark study, Intel researchers operated a tested data center environment using only air cooling, The survey found that when the temperatures were raised to 80 degrees, hardware failure rates much lower than expected. Many data centers waste energy by over-cooling the data center to compensate for lack of granular control.
That has provided a comfort level for companies to operate servers in warmer environments. Even a data center user in the Middle East and eBay in Phoenix go without chillers. Both Google and Microsoft operate facilities without chillers, using fresh air cooling.
Thought Leadership on Temperature
Guest columnists at Data Center Knowledge have weighed in on the appropriate management of temperature in the data center. Jason Friedler of Telstra writes in The Data Center Temperature Debate that the “cooler is better” attitude is still challenging to overcome, despite mounting financial pressures to reduce costs. And Fred Stack of Liebert Precision Cooling detailed how to manage the expanding temperature envelope, cautioning that raising temperatures in data centers should be carried out in a systematic manner to best determine where hot spots may occur. He adds, “Care should be taken to ensure that data centers are operating efficiently without risking infrastructure shutdown because of high temperatures or contamination.”
Raising the Chiller Water’s Temperature
For facilities using chillers, raising the cooling set point n the data center can allow the manager to also raise the temperature of the water in the chillers, reducing the amount of energy required to cool the water and thus saving energy costs. Facebook retooled the cooling system in one of its existing data centers in Santa Clara, Calif., and trimmed its annual energy bill by $229,000. While many factors were involved, optimizing the cold aisle and server fan speed allowed Facebook to raise the temperature at the CRAH return from 72 degrees F to 81 degrees F. Thus the higher air temperature precipitated a raised temperature of the supply water coming from its chillers, requiring less energy for refrigeration. The temperature of chiller water supply was raised by 8 degrees, from 44 degrees F to 52 degrees F.
In one study, the Chill Off 2 accidentally showcased the potential for Clustered Systems to achieve even greater efficiency. During the testing, a chiller disruption caused the temperature of the chilled water used in the prototype’s cooling distribution unit (CDU) to rise from 44 degrees F to 78 degrees F. During the 46-minute cooling outage, the CPU temperatures rose in the Clustered Systems, but the servers continued to operate. “The observations during the use of 78F (25.5C) chilled water temperature indicate that the Clustered Systems design potentially can be operated with very low-cost cooling water, providing additional energy savings compared to the test results,” said the report on the Clustered Systems technology, prepared by Lawrence Berkeley National Laboratory.
Some are deliberately pushing cooling water temperature even further. IBM deployed a supercomputer cooled by hot water for the Swiss Federal Institute of Technology Zurich (ETH Zurich). The Aquasar cooling system uses water at temperatures of up to 140 degrees, and as a result consumes up to 40 percent less energy than a comparable air-cooled machine. The system also uses waste heat to provide warmth to university buildings, reducing Aquasar’s carbon footprint even further.
[...] Data Center Knowledge [...]
The critical aspect of “set point’ is whether that is applied to the typical return air or if it is applied to the supply air. An 80 degree set point on the return air is still going to result in supply air in the low 60′s. When a relatively complete separation between supply and return air masses is achieved in the data center, then that set point can be moved to the supply stream to great effect. For example, in our lab, we typically run a 75F set point, but our chilled water loop is at 65F and we realize a nearly 40% savings on the chiller at that level. At those temperatures, even here in central Texas, we would have access to a significant portion of “free cooling” hours.
PramodPosted April 11th, 2011
What is the maximum duration the servers can withstand the raising temperatures without any cooling at place..? In our case we have an approximately 120KW of server rack load..and in case of the energy failure, we have to rely only on the UPS battery backup..(Since we dont have generator at place)… so we have planned to increase the battery backup to 45 mins.. need your input on if the servers can withstand the raising temperatures for 45 mins without cooling..
Dell now warranty standard servers to run at 40-45c for extended periods. See the site in my website link.
This blog post summarizes the most recent ASHRAE recommended (and allowable) thermal guidelines: