Modular data centers: Are benefits overstated?

Power-savings claims could be iffy

Interest in modular data centers is growing, fueled by high-profile endorsements from Microsoft and Google. But the model raises new management concerns, and efficiency claims may be exaggerated.

Modular, containerized data centers being sold by vendors such as IBM, Sun and Rackable Systems fit storage and hundreds -- sometimes thousands -- of servers into one large shipping container with its own cooling system. Microsoft, using Rackable containers, is building a data center outside Chicago with more than 150 containerized data centers, each holding 1,000 to 2,000 servers.

Not to be outdone, Google secured a patent last year for a modular data center that includes "an intermodal shipping container and computing systems mounted within the container."

(See related slide show: IT takes a close look at shipping-container-based data centers.)

To hear some people tell it, containerized data centers are far easier to set up than a traditional data center, are easy to manage and are more power-efficient. It should also be easier to secure permits, depending on local building regulations. Who wouldn't want one?

But that is not the consensus view by any stretch of the imagination. Gartner analyst Rakesh Kumar says it will take a bit of creative marketing for vendors to convince customers that containers are inherently more efficient than regular data centers. Gartner is still analyzing the data, but as of now, Kumar says, "I don't think energy consumption will necessarily be an advantage."

Even IBM, which offers the Portable Modular Data Center and considers the container part of its green strategy, says the same efficiency can be achieved within the four walls of a traditional building.

IBM touts a "modular" approach to data center construction, taking advantage of standardized designs and predefined components, but that doesn't have to involve containers. "We're a huge supporter of modular. We're a limited supporter of container-based data centers," says Steve Sams, vice president of IBM Global Technology Services.

Containers are efficient because they pack lots of servers into a small space and use standardized designs with modular components, he says. But you can deploy storage and servers with the same level of density inside a building, he notes.

Container vendors often tout 40% to 80% savings on cooling costs. But according to Sams, "In almost all cases, they're comparing a highly dense [container] to a low-density [traditional data center]."

Containers also eliminate one scalability advantage related to cooling found in traditional data centers, according to Sams. Just as it's more efficient to cool an apartment complex with 100 living units than it is to cool 100 separate houses, it's more cost-effective to cool a huge data center than many small ones, he says. Air conditioning systems for containerized data centers are locked inside, just like the servers and storage devices are, making true scalability impossible to achieve, he notes.

Finding buyers

That doesn't mean there aren't any advantages, however. A container can be up and running within two or three months, eliminating lengthy building and permitting times required for a traditional data center. But if you need an instant boost in capacity, why not just go to a hosting provider? Gartner's Kumar asks.

"We don't think it's going to become a mainstream solution," he says. "We're struggling to find real benefits."

Kumar sees containers as being more suited to Internet-based, "hyper-scale" companies such as Google, Amazon and Microsoft. Containerized data centers offer scalability in big chunks, if you're willing to buy more containers. But they don't offer scalability inside each container once it has been filled, he says.

Container vendors tout various benefits, of course. Each container is just about a complete ecosystem, says Geoffrey Noer, a vice president at Rackable, which sells the ICE Cube Modular Data Center. Power, networking and chilled water are the only things from the outside world that must be connected to each container, he says. Rackable's containers, which can be fitted with as many as 22,400 processing cores in 2,800 servers, are water-tight and fitted with locks, alarms and LoJack-like tracking units.

For its part, Sun claims that its Modular Data Center can survive an earthquake -- the company made sure of that by testing it on one of the world's largest shake tables at the University of California, San Diego.

A fully equipped Rackable ICE Cube costs several million dollars, mostly for the servers themselves, Noer says. The container pays for itself with lower electricity costs due to an innovative Rackable design that maximizes server density, Noer says.

But it's still too early to tell whether containerized data centers are the wave of the future. "We're just at the cusp of broad adoption," Noer says.

Potential use cases for containers include disaster recovery, remote locations such as military bases, or big IT hosting companies that would prefer not to build brick-and-mortar data centers, Kumar says.

A TV crew that follows sporting events may want a mobile data center, says Robert Bunger, director of business development for American Power Conversion. APC doesn't sell its portable data center, but in 2004 it built one into a tractor-trailer as a proof of concept. It was resilient. "We pulled that trailer all over the country" for demos, Bunger notes.

But APC isn't seeing much demand, except in limited cases. For example, a business that needs an immediate capacity upgrade but is also planning to move its data center in a year might want a container because it would be easier to move than individual servers and storage boxes.

UC San Diego bought two of Sun's Modular Data Centers. One goal is to contain the cost of storing and processing rapidly increasing amounts of data, says Tom DeFanti, principal investigator of the school's GreenLight energy-efficiency research project. But it will take time to see whether the container approach is more efficient. "The whole idea is to create an experiment to see if we can get more work per watts," DeFanti says.

The Modular Data Center is not as convenient to maintain as a regular computer room, because there is so little space to maneuver inside, he says. But "it seems to me to be an extremely well-designed and -thought-out system," DeFanti says. "It gives us a way of dealing with the exploding amount of scientific computing that we need to do."

Beware vendor lock-in

Before purchasing a containerized data center, enterprises should consider several issues related to their manageability and usefulness. Vendors often want you to fill the containers with only their servers, Kumar notes. Besides limiting flexibility at the time of purchase, this raises the question of what happens when those servers reach end of life. Will you need the vendor to rip out the servers and put new ones in, once again limiting your choice of technology?

"At the moment, most vendors will fill their containers only with their servers," Kumar says.

IBM, however, says it uses industry-standard racks in its portable data center, allowing customers to buy whatever technology they like. (Compare server products.) DeFanti says Sun's Modular Data Center allows him the flexibility to buy a heterogeneous mix of servers and storage. Rackable, though, steers customers toward either its own servers or IBM BladeCenter machines through a partnership with IBM.

"I think vendors are learning that people want more flexibility," DeFanti says.

Another consideration is fail-over capabilities, says Lee Kirby, who provides site assessments, data center designs and other services as the general manager of Lee Technologies. If one container goes down, its work must be transferred to another. Server virtualization will help provide this fail-over capability and also make it easier to manage distributed containerized data centers -- an important consideration for customers who want to distribute computing power and have it reside as close to users as possible, Kirby says.

"I think it is key that the combination of virtualization and distributed infrastructure produce a container that can be out of service without impacting the application as a whole," Kirby says.

This story, "Modular data centers: Are benefits overstated?" was originally published by Network World.

Copyright © 2008 IDG Communications, Inc.

7 inconvenient truths about the hybrid work trend
Shop Tech Products at Amazon