Amazon Web Services launched T2, a set of cloud compute instances suited for low-impact applications, such as remote desktops, development environments, small databases and low-traffic web sites. The instances can burst up to higher power if needed through CPU credits.
The feature is yet another attempt to “right-size” Amazon cloud servers to give users confidence that they are using and paying for only the capacity they need. Very often customers will provision enough capacity to handle peak demand periods and pay for it throughout, even though most of that capacity remains unused most of the time.
“In many of these cases, long periods of low CPU utilization are punctuated by bursts of full-throttle, pedal-to-the-floor processing that can consume an entire CPU core,” writes Amazon chief evangelist Jeff Barr on the AWS Blog. "Many of these workloads are cost-sensitive as well."
He used a car analogy: “Even though the speedometer in my car maxes out at 150 MPH, I rarely drive at that speed (and the top end may be more optimistic than realistic), but it is certainly nice to have the option to do so when the time and the circumstances are right.”
Like a car that rarely tops out, the new instances are for compute workloads with modest demands for continuous compute power that occasionally need more.
They have a "Baseline Performance", which indicates the percentage of single-core performance of the underlying physical CPU allocated to the instance. Each instance also comes with CPU credits-per-hour, which indicates the rate of credits that the instance receives each hour when the instance doesn’t use its baseline allocation of CPU.
The credits are spent when the instance is active and unused credits are stored for up to 24 hours. The higher the baseline, the more credits the instance accumulates.
A t2.small instance has access to 20 percent of a single core of an Intel Xeon processor running at 2.5 GHz (up to 3.3 GHz in Turbo mode). A t2.medium has access to 40 percent of the performance of a single core, which the operating can use on one or both cores as dictated by demand. The smallest, t2.micro, has 10-percent baseline performance.
Barr noted that the new instances are perfect for business processes that need a burst of CPU power at regular but infrequent intervals and dynamic web sites that received unpredictable bursts of traffic, like some external news drawing a response, getting linked on Reddit (called the "Reddit hug of death") or inclement weather.
Credits will continue to accumulate if they aren't used, until they reach the level which represents an entire day's worth of baseline accumulation. If you’re constantly maxing out on credits, you can switch down to a smaller-size instance.