Cloud Computing Driving Data Center Automation
June 6th, 2013 By: Bill Kleyman
The dynamic nature of cloud computing has pushed data center workload, server, and even hardware automation to whole new levels. Now, any data center provider looking to get into cloud computing must look at some form of automation to help them be as agile as possible in the cloud world.
New technologies are forcing data center providers to adopt new methods to increase efficiency, scalability and redundancy. Let’s face facts; there are numerous big trends which have emphasized the increased use of data center facilities. These trends include:
- More users
- More devices
- More cloud
- More workloads
- A lot more data
As infrastructure improves, more companies have looked towards the data center provider to offload a big part of their IT infrastructure. With better cost structures and even better incentives in moving towards a data center environment, organizations of all sizes are looking at colocation as an option for their IT environment.
With that, data center administrators are teaming with networking, infrastructure and cloud architects to create an even more efficient environment. This means creating intelligent systems from the hardware to the software layer. This growth in data center dependency has resulted in direct growth around automation and orchestration technologies.
Now, organizations can granularly control resources, both internally and in the cloud. This type of automation can be seen at both the software layer as well as the hardware layer. Vendors like BMC, ServiceNow, and Microsoft SCCM/SCOM are working towards unifying massive systems under one management engine to provide a single pain of glass into the data center workload environment.
Furthermore, technologies like the Cisco UCS platform allow administrators to virtualize the hardware layer and create completely automated hardware profiles for new blades and servers. This hardware automation can then be tied into software-based automation tools like SCCM. Already we’re seeing direct integration between software management tools and the hardware layer.
Finally, from a cloud layer, platforms like CloudStack and OpenStack allow organizations to create orchestrated and automated fluid cloud environments capable of very dynamic scalability. Still, when a physical server or hardware component breaks – we still need a person to swap out that blade.
To break it down, it’s important to understand what layers of automation and orchestration are available now – and what might be available in the future.
The automation and orchestration layers
- Server layer. Server and hardware automation have come a long way. As mentioned earlier, there are systems now available which take almost all of the configuration pieces out of deploying a server. Administrators only need to deploy one server profile and allow new servers to pick up those settings. More data centers are trying to get into the cloud business. This means deploying high-density, fast-provisioned, servers and blades. With the on-demand nature of the cloud, being able to quickly deploy fully configured servers is a big plus for staying agile and very proactive.
- Software layer. Entire applications can be automated and provisioned based on usage and resource utilization. Using the latest load-balancing tools, administrators are able to set thresholds for key applications running within the environment. If a load-balancer, a NetScaler for example, sees that a certain type of application is receiving too many connections, it can set off a process that will allow the administrator to provision another instance of the application or a new server which will host the app.
- Virtual layer. The modern data center is now full of virtualization and virtual machines. In using solutions like Citrix’s Provisioning Server or Unidesk’s layering software technologies, administrators are able to take workload provisioning to a whole new level. Imagine being able to set a process that will kick-start the creation of a new virtual server when one starts to get over-utilized. Now, administrators can create truly automated virtual machine environments where each workload is monitored, managed and controlled.
- Cloud layer. This is a new and still emerging field. Still, some very large organizations are already deploying technologies like CloudStack, OpenStack, and even OpenNebula. Furthermore, they’re tying these platforms in with big data management solutions like MapR and Hadoop. What’s happening now is true cloud-layer automation. Organizations can deploy distributed data centers and have the entire cloud layer managed by a cloud-control software platform. Engineers are able to monitor workloads, how data is being distributed, and the health of the cloud infrastructure. The great part about these technologies is that organizations can deploy a true private cloud, with as much control and redundancy as a public cloud instance.
- Data center layer. Although entire data center automation technologies aren’t quite here yet, we are seeing more robotics appear within the data center environment. Robotic arms already control massive tape libraries for Google and robotics automation is a thoroughly discussed concept among other large data center providers. In a recent article, we discussed the concept of a “lights-out” data center in the future. Many experts agree that eventually, data center automation and robotics will likely make its way into the data center of tomorrow. For now, automation at the physical data center layer is only a developing concept.
The need to deploy more advanced cloud solution is only going to grow. More organizations of all verticals and sizes are seeing benefits of moving towards a cloud platform. At the end of the day, all of these resources, workloads and applications have to reside somewhere. That somewhere is always the data center.
In working with modern data center technologies administrators strive to be as efficient and agile as possible. This means deploying new types of automation solutions which span the entire technology stack. Over the upcoming couple of years, automation and orchestration technologies will continue to become popular as the data center becomes an even more core piece for any organization.
This is a very nice view of how Cloud computing is pushing data centers towards automation at different layers.
The software layer is one I think is misplaced. I believe it is between the virtual layer and the cloud layer. Also if you treat the Cloud layer going across data centers then it is the top layer.
The Data center layer seems to be more on the physical placement of the servers and if that is the case then it is the foundation. This is akin to the what IDC is terming DCIM.
- Ranjit Nayak
Interesting post, especially your point, ‘The need to deploy a more advanced cloud solution is only going to grow’, really could not agree more.
I work for Flexiant and we provide Cloud Orchestration software. I would really like to hear your thoughts on one of our posts, ‘Five Reasons for Data Center Automation’ http://www.flexiant.com/2013/05/31/five-reasons-for-data-center-automation/
Look forward to hearing from you.
“With the on-demand nature of the cloud, being able to quickly deploy fully configured servers is a big plus for staying agile and very proactive.” Regarding this point, it’s important to have benchmarks for resource usage – you need to determine if spikes are due to temporary increases in demand, a longer term increase in resource requirements, or a problem in the application. A server and application monitoring solution can provide a long term view of resource that can be used to fine tune the resource allocations for your servers.