Need a supercomputer? This guy builds them himself

Network World - Bruce Allen is perhaps the world's best do-it-yourselfer. When he needed a supercomputer to crunch the results of gravitational-wave research, he built one with his colleagues at the University of Wisconsin-Milwaukee.

That was in 1998, and since then he's built three more supercomputers, all in pursuit of actually observing gravitational waves, which theoretically emanate from black holes orbiting each other and from exploding stars but have never been directly observed.

His most recent supercomputer, a cluster of 1,680 machines with four cores each, is in Hanover, Germany. Essentially, it's a 6,720-core processor that in the months after it was built was ranked No. 58 in the world. "We filled our last row of racks recently, and we're No. 79 on the current Top500 list," says Allen, director of the Max Planck Institute.

He builds his own for several reasons, one of which is that he thinks he gets more for his money when he does the work himself.

"If you go to a company -- Dell or IBM -- and you say, 'I've got a $2 million budget, what can you sell me for that price?' you'll come back with a certain number of CPUs," he says.

"If you then go and look at Pricewatch or some other place where you can find out how much the gear really costs, you find out that if you build something yourself with the same money you'll end up with two or three times the processing power."

The problem is that big-name companies have a lot of overhead made up of layers of management and engineering. "They do sell good products, and you don't need to have any particular expertise to buy them," he says. "It's always been my experience that if I do it myself, I get more bang for my buck."

For instance, his first supercomputer was built from a Linux cluster of bargain 48 DEC Alpha Servers that had been discontinued, each with a single 300-MHz, 64-bit AXP processor. "So I got a very good deal on them. I think the list price was $6,000, and I bought them after they were end-of-lifed for $800," Allen says. "The switch was a 3Com Superstack 100Mbit/sec. Ethernet switch. I think it was a pair of them, each with 24 ports connected by a matrix cable."

The servers were housed in a room slightly larger than a closet, on particle board shelves bought at Home Depot. "It wasn't even racks, because rack-mounted systems would have raised the price significantly," Allen says. The whole thing used about 200 watts of power, and the university's facilities staff had to remove flaps from the air ducts feeding the room so they could dissipate the heat efficiently enough.