Berkeley Developing Worldwide Storage System
Computerworld - The University of California at Berkeley is looking to create a data storage network that encompasses the planet.
OceanStore is a research project at the university that would use software to break data into many tiny, encrypted parts and store them across a vast array of Web servers owned by Internet service providers around the world.
A vast redundant storage network such as OceanStore would afford easy access to data from anywhere and unprecedented levels of disaster recovery, according to its inventor, John Kubiatowicz. If more than one computer or server were to crash, OceanStore would be able to rebuild the information using pieces stored in multiple clusters on other servers.
OceanStore would track documents by assigning each one a globally unique identification (GUID) tag before it's split into fragments and sent over the Internet to be stored randomly throughout the network.
"You would maybe spread 64 fragments of a document around, and maybe 16 of those can be used to reconstruct [the original document]," Kubiatowicz said. "We're assuming a system the scale of OceanStore will have pieces of it broken all the time."
For example, to retrieve a chopped-up 1989 tax return, OceanStore would send intelligent agents onto the Internet looking for a GUID tag, he said. As the messenger agents search, they would leave behind trails of digital bread crumbs so that the next time, the agents could find the data more quickly.
More frequently used data would be stored on nearby servers to cut down on latency.
Consumers who want to save their documents on OceanStore would pay a monthly fee to an Internet service provider, which would then arrange to redundantly store the data on another Internet provider's server for a small fee.
Neal Goldman, a research analyst at The Yankee Group in Boston, said there are inherent problems associated with OceanStore. For example, enterprises probably wouldn't store mission-critical data on a Web-based system.
"You don't know what the bandwidth is between you and the piece of data you want, so there are some real issues as far as performance," Goldman said.
The project has received about $500,000 in seed funding from vendors including IBM, Nortel Networks Corp. in Brampton, Ontario, EMC Corp. in Hopkinton, Mass., and federal agencies such as the National Science Foundation and the Defense Advanced Research Projects Agency, both in Arlington, Va., Kubiatowicz said.
Read more about Data Storage in Computerworld's Data Storage Topic Center.
- 15 Non-Certified IT Skills Growing in Demand
- How 19 Tech Titans Target Healthcare
- Twitter Suffering From Growing Pains (and Facebook Comparisons)
- Agile Comes to Data Integration
- Slideshow: 7 security mistakes people make with their mobile device
- iOS vs. Android: Which is more secure?
- 11 sure signs you've been hacked
- Pay-as-you-Grow Data Protection: IBM Tivoli's Full-featured Data Protection Suite for Small to Medium Businesses IBM Tivoli Storage Manager Suite for Unified Recovery gives small and medium businesses the opportunity to start out with only the individual solutions...
- Streamline Data Protection with IBM Tivoli Storage Manager Operations Center IBM Tivoli Storage Manager (TSM) has been an industry-standard data protection solution for two decades. But, where most competitors focus exclusively on Backup...
- Using VM Archiving to Solve VM Sprawl This CommVault whitepaper discusses how archiving virtual machines can mitigate VM sprawl with a comprehensive approach to VM lifecycle management.
- Keep Your Network Available, Efficient and Secure Make the most of your network by working with experts who "get it." CDW and F5 have partnered to keep networks highly optimized....
- Make or Break: New Auto Products Must Go To Market On Time This Webcast quantifies the value of time to market for the auto industry and highlights how Primavera Enterprise Portfolio Management can help organizations.
- IBM Flash Webcast: Optimizing your Datacenter for Efficient Storage & ROI Register for this webcast to learn the benefits of flash storage from IBM Customer, Leonardo Irastorza of Royal Caribbean Cruise Ltd and Storage... All Data Storage White Papers | Webcasts