Computerworld
Quick Menu
Search



Ads by TechWords

See your link here


Subscribe to our e-mail newsletters
For more info on a specific newsletter, click the title. Details will be displayed in a new window.
Data Management
Storage
Computerworld Daily News (First Look and Wrap-Up)
Computerworld Blogs Newsletter
The Weekly Top 10
More E-Mail Newsletters 
Computerworld 2007Subscribe to Computerworld
40 years of the most authoritative source of news and information for IT leaders.

Planet-Scale grid

A particle collider leads data grid developers to unprecedented dimensions.
Patrick Thibodeau   Today’s Top Stories   or  Other Storage Stories  
 

Sign up to receive Storage Resource Alerts

October 10, 2005 (Computerworld) -- In 2007, scientists will begin smashing protons and ions together in a massive, multinational experiment to understand what the universe looked like tiny fractions of a second after the Big Bang. The particle accelerator used in this test will release a vast flood of data on a scale unlike anything seen before, and for that scientists will need a computing grid of equally great capability.


The Large Hadron Collider (LHC), which is being built near Geneva, will be a circular structure 17 miles in circumference. It will produce data in the neighborhood of 1.5GB/sec., or as many as 10 petabytes of data annually, 1,000 times bigger than the Library of Congress' print collection. The data flows will likely begin in earnest in 2008.


As part of this effort, which is costing about 5 billion euros ($6.3 billion U.S.), scientists are building a grid using 100,000 CPUs, mostly PCs and workstations, available at university and research labs in the U.S., Europe, Japan, Taiwan and other locations. Scientists need to harness raw computing power to meet computational demands and to give researchers a single view of this disbursed data.


This latter goal—creating a centralized view of data that may be located in Europe, the U.S. or somewhere else—is the key research problem.


Centralizing the data virtually, or creating what is called a data grid, means extending the capability of existing databases, such as Oracle 10g and MySQL, to scale to these extraordinary data volumes. And it requires new tools for coordinating data requests across the grid in order to synchronize multiple, disparate databases.












Tony Doyle, project leader of Grid Particle Physics (GridPP) project
Tony Doyle, project leader of Grid Particle Physics (GridPP) project

"It's all about pushing the envelope in terms of scale of robustness," says Tony Doyle, project leader of Grid Particle Physics (GridPP) project, a U.K.-based scientific grid initiative that's also part of the international effort to develop the grid middleware tools.


Researchers believe that improving the ability of a grid to handle petabyte-scale data, split up among multiple sites, will benefit not only the scientific community but also mainstream commercial enterprises. They expect that corporations—especially those involved in fields such as life sciences—will one day need a similar ability to harness computing resources globally as their data requirements grow.


"If this works, it will spawn companies that will just set up clusters to provide grid computing to other people," says Steve Lloyd, who chairs the GridPP Collaboration Board, based at the Rutherford Appleton Laboratory in Oxfordshire, England. GridPP is working with the international team to develop the grid the LHC will use.


CERN, the European laboratory for particle physics, is leading the LHC and its grid effort. From CERN's facility near Geneva, the data produced by the particle accelerator will be distributed to nine other major computing centers, including the Brookhaven National Laboratory and the Fermi National Accelerator Laboratory in the U.S., says Fabio Hernandez, grid technical leader at one of the major project sites in France.

Continued...
1 | 2 | NEXT  



Print this Story Send Us Feedback E-mail this Story Digg! Digg this Story Slashdot this Story
"PNY announced this week that it was releasing a USB flash drive with the movie Ghostbusters on it. While it..." Read more...
"The secondary server in this computer room is having problems with its disk drives. Fortunately, there's a simple short-term fix:..." Read more...
Read more Storage posts or See all Blogs
At 10, Google reiterates commitment to CIOs
Microsoft explains Seinfeld-Windows TV ad: just a 'teaser'
Continuing coverage: Google's Chrome browser
More top stories...
iPhone 3G owner sues Apple, AT&T over dropped calls, app crashes
Mozilla: Firefox is faster than Chrome
Upcoming Microsoft patch lineup could be 'massive,' says researcher
Users of Windows XP SP3 who try out IE8 Beta 2 won't be able to uninstall either one under certain circumstances.
Google has gone from innovative upstart to fat-and-happy industry leader in what seems like record time. Preston Gralla explains.
Microsoft's latest beta of IE8 includes better tab management, new services such as Web Slices and Accelerators, and the new 'porn mode.'
These leading-edge graduate schools are moving at the pace of the IT workplace, delivering coursework that's relevant to today's IT professionals.
Reviews, analyses, how-tos, visual tours, hot issues and predictions about Microsoft's new OS.
Four years from now, the IT field will be a vastly different place. Will you be ready?
All Zones
Application Performance Zone
Business Continuity Zone
The File Data Management Zone
Security Management Zone
ITIL Best Practices Zone
The SAS Zone
Business Intelligence and Analytics Zone
Windows Protection Zone
Identity & Security Management Zone

Ads by TechWords

See your link here
Enabling Data Centers that Are Both Automated and Dynamic
Enabling Data Centers that Are Both Automated and Dynamic
View this webcast now!
Go to the webcast 
Virtual Reality
Download this Computerworld briefing, a $49.95 value free, compliments of Riverbed Technologies.
(Source: Computerworld) Is your organization facing the struggles of ineffective capacity utilization, growing data volumes, labor intensive storage management, and a need for better disaster recovery?

The data center is real, but storage is turning virtual at many organizations that need to manage these exploding storage needs. Learn how your organization can benefit from storage virtualization in this new Computerworld Report, available free for a limited time, compliments of Riverbed.

Download this executive briefing download
Brocade and the File Area Network - A Taneja Group Solution Profile
Get this white paper now!
(Source: Brocade) This Taneja Group report examines how Brocade FAN solutions are creating a stateless end-to-end file and block data infrastructure.
Download this white paper go
White Papers
Read up on the latest ideas and technologies from companies that sell hardware, software and services.
Death to PST: Hidden Cost of Email Mismanagement
Extend, Replace, or Convert; which is the best way forward for COBOL Applications?
The Trend from Unix to Linux in SAP Data Centers
View more whitepapers