When the meteor and the 1PB database collide
Craters? No, ginormous amounts of celestial information in need of storage
Computerworld - Our fascination with the prospect of asteroids smashing into the Earth is as deep as the craters that can result from such cosmic fireballs. Think of all the movies Hollywood has made, from little-seen B flicks such as A Fire in the Sky to campy cult classics such as Night of the Comet to scientifically shaky blockbusters such as Meteor and Armageddon.
The 1990s was also awash with news of rocky passersby such as Comet Hale-Bopp and Comet Shoemaker-Levy 9, which unleashed fragments up to two kilometers wide upon Jupiter in 1994.
Once dismissed as the province of fringe cult groups, the fear of what astronomers call "impact events" turns out, thanks to improved satellite and telescopic monitoring, to be not so irrational after all.
Pan-STARRS on patrol
The latest and most ambitious to detect 'near-Earth objects' (NEO) is the Panoramic Survey Telescope and Rapid Response System, or Pan-STARRS.
A joint venture of the University of Hawaii, a number of other schools and the U.S. Air Force, Pan-STARRS is today testing a telescope mounted with the finest digital camera in existence, which boasts a resolution of 1.4 billion pixels.
When Pan-STARRS is fully operational several years from now, it will have four telescopes, each with a 1.4-gigapixel camera.
That will give Pan-STARRS a wider, faster and more-powerful view into space, and will enable it to meet its mandate of tracking virtually all NEOs larger than 300 meters in diameter as well as many smaller NEOs.
It will have plenty to see. About once a year, an asteroid of five to 10 meters in diameter explodes in the Earth's upper atmosphere, releasing as much energy as the atomic bomb used at Hiroshima. And if one slips through, it can cause a lot of damage -- even if it's not a big one.
The asteroid behind 1908's Tunguska Event was only about 50 meters in diameter, but it created an explosion equivalent to 10 to 15 megatons of TNT (about 1,000 times the Hiroshima bomb), knocking over an estimated 80 million trees in Siberia and causing an earthquake that's estimated to have measured a 5.0 on the Richter scale (which had not yet been invented at that time). And we are due for another even like that within 200 years, according to the late astronomer Eugene Shoemaker.
With just a single telescope, Pan-STARRS already generates 1.4 terabytes of raw image data nightly. Compressing, storing and crunching that data in an economical fashion turns out to be a feat of database engineering as impressive as the collection process.
Rather than turning to an expensive supercomputer equipped with hundreds or thousands of processors, Pan-STARRS will use a cluster of 50 PC servers connected to 1.1 petabytes of disk storage via fast Infiniband networking gear, according to Alex Szalay, a physics and astronomy professor at Johns Hopkins University and one of the architects of Pan-STARRS' database.
- Rethinking Backup and Recovery As enterprises continue to transform their data centers, and virtualization plays an increasing role in their IT infrastructures, the way data is backed...
- Archiving benefits more than just email Many organizations assume archiving is mostly related to email and compliance; however, archiving is associated with a wide range of business improvements.
- Server and System Admins Challenged to Keep Up with Storage Explosion Read this whitepaper to learn how administrators are leveraging their existing skills to simplify the management of storage and servers.
- Administrators need an agile platform to usher the new era of enterprise storage Read this whitepaper and learn how administrators are keeping up by guiding their enterprises toward new, software-defined storage platforms that simplify and unify...
- Top 4 Digital Signage Fails Join RMG Networks for a look at four of the most common reasons digital signage fails in corporate businesses. Learn about strategies to...
- Vblock™ Specialized System for SAP HANA® Deploy SAP HANA® fast and with low risk. VCE brings together all of the necessary components for SAP HANA® into a single, standardized... All Data Storage White Papers | Webcasts
Computerworld has launched its annual search for outstanding IT leaders who align technology with business goals. Nominate a top IT executive for the 2015 Premier 100 IT Leaders awards now through July 18.