IBM, Intel question key Top500 supercomputer metric
IDG News Service - Like Hollywood's Academy Awards, the Top500 list of supercomputers is dutifully watched by high-performance computing (HPC) participants and observers, even as they vocally doubt its fidelity to excellence.
"The Top 500 [uses] an artificial problem -- it doesn't measure about 80% of the workloads" that are usually run on supercomputers, said John Hengeveld, director of technical compute marketing for Intel's Data Center Group, speaking on the sidelines of the Supercomputer 2010 conference this week. "It is not a representative benchmark for the industry."
"The list is unclear exactly what it measures," agreed Dave Turek, who heads up IBM's deep computing division, in an interview last week.
The selection process for the Academy Awards ("The Oscars"), run by the Academy of Motion Picture Arts and Sciences, is shrouded in mystery, and, perhaps not surprisingly, observers grumble over which movies and people receive awards and which remain neglected. With the Top500 though, the discontent centers around the single metric used to measure the supercomputers, called Linpack.
Many question the use of a single metric to rank the performance of something as mind-bogglingly complex as a supercomputer.
During one panel at the SC2010 conference this week in New Orleans, one high-performance-computing vendor executive joked about stringing together 100,000 Android smartphones to get the largest Linpack number, thereby revealing the "stupidity" of Linpack.
The Top500 list is compiled twice a year by researchers at the University of Mannheim, Germany; the U.S. Department of Energy's Lawrence Berkeley National Laboratory; and the University of Tennessee, Knoxville.
In the latest iteration, unveiled Sunday, China's newly built Tianhe-1A system topped the list, reporting a sustained performance of 2.57 petaflops. Placing second was the DOE's Oak Ridge Leadership Computing Facility's Jaguar system, reporting 1.75 petaflops.
While grumbling about Linpack is nothing new, the discontent was pronounced this year as more systems, such as the Tianhe-1A, used GPUs (graphics processing units) to boost Linpack ratings, in effect gaming the Top500 list.
"It is difficult to figure out the real application speed from the benchmark. I don't want to make the Top500 just a contest for the number of GPUs," noted an attendee at the Top500 awards ceremony.
"Linpack has many problems with it, but it has a few positive things. It is important to keep in mind that it is one number and it should be taken in the context of a number of things," argued Jack Dongarra, one of the judges for the ranking, during the awards presentation.
One advantage to Linpack is that, thanks to its simplicity, supercomputer keepers can improve their scores on a relatively periodic basis, which makes for exciting news coverage as different facilities and system builders vie with one another for the next top spot.
- 15 Non-Certified IT Skills Growing in Demand
- How 19 Tech Titans Target Healthcare
- Twitter Suffering From Growing Pains (and Facebook Comparisons)
- Agile Comes to Data Integration
- Slideshow: 7 security mistakes people make with their mobile device
- iOS vs. Android: Which is more secure?
- 11 sure signs you've been hacked
- What Datapipe customers need to know about the new PCI DSS 3.0 compliance standard This handy quick reference outlines what PCI DSS 3.0 is, who needs to be compliant and how Alert Logic solutions address the new...
- Defense Throughout the Vulnerability Life Cycle This whitepaper provides insight into how to leverage threat and log management technologies to protect your IT assets throughout their vulnerability life cycle.
- The Critical Role of Support in Your Enterprise Mobility Management Strategy Most business leaders underestimate the importance of tech support when they choose an EMM solution. Here's what to put on your checklist.
- Separating Work and Personal at the Platform Level: How BlackBerry Balance Works BlackBerry® Balance™ separates work from personal on the same mobile device, right at a platform level. Find out how it can work for...
- Live Webcast Best Practices for the Hyperconverged Enterprise Network To the Age of Constant Connectivity and Information overload
- Getting Ready for BlackBerry Enterprise Service 10.2 Find out how BlackBerry® Enterprise Service 10 helps organizations address the full spectrum of EMM challenges, while balancing the needs of both the...
- Containerization Options: How to Choose the Best DLP Solution for Your Organization This webcast outlines a framework for making the right choice when it comes to containerization approaches, along with the pros and cons of... All Networking White Papers | Webcasts