Subscribe to our e-mail newsletters
For more info on a specific newsletter, click the title. Details will be displayed in a new window.
Hardware
Computerworld Daily News (First Look and Wrap-Up)
Computerworld Blogs Newsletter
The Weekly Top 10
More E-Mail Newsletters 
Computerworld 2007Subscribe to Computerworld
40 years of the most authoritative source of news and information for IT leaders.

IT Struggles with Climate Change

Climatologists tracking global warming need all the computing horsepower they can get
 

Sign up to receive Security Resource Alerts

February 06, 2006 (Computerworld) -- Corporate IT managers who never seem to have enough CPU power, disk space, bandwidth or funding might take comfort from U.S. climate scientists. Computerworld's Gary H. Anthes recently talked with two of them and learned that even having access to the world's most powerful information systems is not enough.
Patrick Heimbach is a research scientist in physical oceanography at MIT, and James Hack heads up climate modeling at the National Center for Atmospheric Research in Boulder, Colo. Both scientists use their own organizations' computer systems, as well as those at supercomputer centers around the U.S.

Patrick Heimbach is a research scientist in physical oceanography at MIT
Patrick Heimbach is a research scientist in physical oceanography at MIT
What are you working on at MIT?
Heimbach: We are trying to see if we can simulate, if we can understand, what the ocean has been doing over the last couple of decades. Are we heading toward a warmer world? Is [warming due to] internal variability of the [oceanic and atmospheric] system, or is there something we are doing to the system?
Do you have the computational power to do that?
Heimbach: What we ultimately would like to run we can't currently fit on any computer. We would need on the order of 20,000 processors, and probably two orders of magnitude faster processors. Each supercomputer center allocates a certain amount of computing time to a specific group. So we have to size down the problem we are addressing for that specific machine.
So it seems you must beg, borrow and steal computer resources for this work.
Heimbach: We have to find the cycles where we can find them. But even for the machines that are available, if we really wanted to go to the actual [spatial] resolutions that we need, we probably would not be able to fit those problems on those machines. Give us any machine, and we can immediately fill it with an interesting problem, and we'll still have the feeling we are limited.
James Hack heads up climate modeling at the National Center for Atmospheric Research
James Hack heads up climate modeling at the National Center for Atmospheric Research
Hack: Climate and weather applications... push high-performance computer technology. A decade ago, global climate applications benefited from the extraordinary memory bandwidth of proprietary high-performance architectures, like the parallel vector architectures from Cray and NEC. As scientific computing migrated toward the commodity platforms, interconnect technology, both in terms of bandwidth and latency, became the limiting factor on application performance and continues to be a performance bottleneck.
Is the Internet adequate for connecting you to the supercomputer centers you use around the U.S.?
Heimbach: Transferring several terabytes of data from NASA Ames [Research Center] to MIT is just overwhelming to do in a reasonable time. As of a year ago, we were limited by the 100Mbit/sec. bandwidth of the network that connects our department to the outside world. The best sustained rates that could be achieved were on the order of 55Mbit/sec. That would bring us to a transfer time of 1.7 days per 1TB of data.

We now have better connection to the high-speed Internet2 Abilene network, with its 10Gbit/sec. cross-country backbone. The bottom line still is we need much higher bandwidth, less network congestion and smart transfer protocols, such as the large-files transfer protocol [bbFTP], that minimize CPU load.
Hack: The so-called sneakernet continues to provide the best bandwidth for moving large data sets between computing centers -- shipping data on tapes or disk via overnight services. We are engaged in some emerging computational projects that will generate hundreds of terabytes per experiment. Moving that data is a significant challenge. Storage and access to that data for analysis purposes is a comparably challenging technical task.
How adequate is supercomputer capacity in the U.S. for scientific research?
Hack: One could argue that there will never be enough supercomputing capacity. In [a] sense, scientific progress is paced by the availability of high- performance computing cycles. And the problem becomes more acute as the need to address nonlinear scientific problems in other disciplines, like material science, computational chemistry and computational biology, continues to grow.
There remains some controversy about global warming. Could better climate models and/or better computer technology help resolve that?
Hack: For many scientists, it's not a question of whether the planet will warm, but more a question of how much the planet will warm and what form the regional distribution of that warming will take. Answering... these questions will require additional levels of sophistication in global climate models, such as improved resolution and extending existing modeling frameworks to include fully interactive chemical and biogeochemical processes. These kinds of extensions are... extremely expensive in computational terms. We will require a minimum of a twenty-five-fold improvement in computational technology to enable the next-generation model [in] three to five years.
Heimbach: You need to run coupled ocean-atmosphere simulations over 10 to 100 years. We think that these models, and the underlying model errors, are still such that we need to do more basic research to understand the errors better. That's what we are trying to address.
Should the federal government be doing more to fund supercomputer research and supercomputer capacity?
Hack: The federal government should treat supercomputer technology in the same way that it treats other strategically important areas, like those related to national defense and national security. It's too important to the nation's scientific and economic competitiveness to be left to chance.



Print this Story Send Us Feedback E-mail this Story Digg! Digg this Story Slashdot this Story
Sidebar: Big Iron, Big Pipes, Big Problems
IT Struggles with Climate Change
"Worried about the explosive growth of Linux on inexpensive, ultra-portable PCs like the Asus Eee PC, Microsoft has launched a..." Read more...
"What can I say? For me, XP SP3 was the cat's meow, the best Windows client operating system ever. But,..." Read more...
Read more Hardware posts or See all Blogs
Powerset unveils test version of Google-killer
iPhone out of stock 'company wide,' say Apple sales reps
Microsoft to limit capabilities of cheap laptops
More top stories...
FBI worried as DoD sold counterfeit networking gear
Update: Microsoft to appeal $1.3B EU fine
XP SP3 cripples some PCs with endless reboots
Mistakes such as putting down co-workers or burning bridges when you resign are surefire ways to darken your career prospects. Here's how to avoid them
Hype and promises abound in the IT world, but these six breakthroughs really will change your life, says author and former IT manager John Brandon.
Baby boomers are retiring and taking their knowledge with them. Why do so few in IT seem to care?
Computerworld editors share stories of their first PCs, including some classics and some real clunkers -- then we ask readers to share their early-PC tales.
Reviews, analyses, how-tos, visual tours, hot issues and predictions about Microsoft's new OS.
Four years from now, the IT field will be a vastly different place. Will you be ready?
All Zones
Application Performance Zone
Enterprise-Class Security Zone
Enterprise Solutions Zone
The File Data Management Zone
Grid Computing on Windows Zone
Security Management Zone
ITIL Best Practices Zone
The SAS Zone
Storage Virtualization Zone
The Data Center Management Zone

Ads by TechWords

See your link here
Computerworld Report: Virtual Reality
Download this Computerworld Report, free for a limited time, compliments of HP.
(Source: Computerworld) The data center is real, but storage is turning virtual at many organizations that need to manage exploding storage needs. Learn how virtualizing your enterprise will save you money in this Computerworld Report, a $49.95 value, available free for a limited time, compliments of HP.
Download this executive briefing download
Virtualization Everywhere
Download this white paper, free, compliments of Citrix.
(Source: Citrix) Adoption of virtualization is concentrated among large enterprises, while adoption by mid-sized companies has been much slower. For these companies, the cost and complexity of server virtualization solutions has been a barrier.

In this paper, we'll discuss how Citrix XenServer" provides simple, economical server virtualization for any size company. Download now!

Download this white paper go
Long Tail Supplier Collaboration - What's In It For You?
Long Tail Supplier Collaboration - What's In It For You?
Download this webcast, free, compliments of Sterling Commerce
Go to the webcast 
White Papers
Read up on the latest ideas and technologies from companies that sell hardware, software and services.
New Fujitsu High-End Itanium Windows- and Linux-Based PRIMEQUEST Servers Offer the Utmost in High Availability
New Fujitsu High-End Itanium-Based PRIMEQUEST Servers Offer Industry-Leading System Management for Linux and Windows
Symantec State of the Data Center Report 2007
View more whitepapers