Start-up costs slow spread of de-duplication
IT is leery even though the technology promises to cut costs and storage needs.
Computerworld - While data de-duplication is a relatively easy way for companies to consolidate storage systems, the technology has yet to attract the widespread attention of IT managers. According to Gartner Inc., only about 30% of corporations have deployed any form of de-duplication technology.
Gartner says the technology can cut storage needs by a ratio of 20:1 to 30:1 on average -- far less than vendor claims of 200:1 to 300:1, but still enough to greatly reduce network bandwidth requirements and stave off storage hardware purchases by making better use of existing equipment. The technology could also eliminate the need for costly tape backup systems.
Gartner analyst Valdis Filks suggested that despite the potential benefits, IT managers remain reluctant buyers of the technology because of high start-up costs.
"De-duplication is becoming very fashionable and lays claim to large cost savings, but quite a few companies I speak to get turned off by the purchase price," Filks said.
Simply put, data de-duplication, or single-instance storage, involves the elimination of redundant data. Hash algorithms mark data blocks with unique numbers, and those numbers are compared so that duplicate pieces of data can be left out of the storage process.
To date, the primary corporate use of the technology has been for e-mail archiving. The benefits of that application are obvious when you realize that a single e-mail can represent thousands of copies of one attachment.
Today's de-duplication tools are mostly point products, such as prepackaged appliances that sit between a primary disk storage system and the backup process, software that runs on commercially available host systems, or virtual tape library (VTL) disk subsystems. The market is starting to expand because companies like Sun Microsystems Inc. and NetApp Inc. have begun shipping tools that provide de-duplication on primary storage systems.
Analysts say that as IT managers consider deploying de-duplication technology, they should keep in mind that it will continue to expand beyond point solutions to primary storage systems. "You should definitely roll it out today but implement something that can adapt and change when de-duplication becomes ubiquitous in other areas of the [data center]," Filks said.
The top makers of de-duplication point products include Data Domain, Sepaton, EMC's Avamar unit, Diligent Technologies, FalconStor Software (whose technology is resold by vendors like IBM, Sun and EMC) and Quantum.
Some users have found that de-duplication can deliver significant benefits in certain specific environments, such as at companies running older tape library systems.
Boston Medical Center was able to reduce 400TB of data stored on its tape libraries and secondary disk storage system to 3.5TB while also eliminating the need for tape backup by using Data Domain Corp.'s DD690 virtual tape library de-duplication system, said Brad Blake, director of IT.
- 15 Non-Certified IT Skills Growing in Demand
- How 19 Tech Titans Target Healthcare
- Twitter Suffering From Growing Pains (and Facebook Comparisons)
- Agile Comes to Data Integration
- Slideshow: 7 security mistakes people make with their mobile device
- iOS vs. Android: Which is more secure?
- 11 sure signs you've been hacked
- Pay-as-you-Grow Data Protection: IBM Tivoli's Full-featured Data Protection Suite for Small to Medium Businesses IBM Tivoli Storage Manager Suite for Unified Recovery gives small and medium businesses the opportunity to start out with only the individual solutions...
- Streamline Data Protection with IBM Tivoli Storage Manager Operations Center IBM Tivoli Storage Manager (TSM) has been an industry-standard data protection solution for two decades. But, where most competitors focus exclusively on Backup...
- Using VM Archiving to Solve VM Sprawl This CommVault whitepaper discusses how archiving virtual machines can mitigate VM sprawl with a comprehensive approach to VM lifecycle management.
- Keep Your Network Available, Efficient and Secure Make the most of your network by working with experts who "get it." CDW and F5 have partnered to keep networks highly optimized....
- Make or Break: New Auto Products Must Go To Market On Time This Webcast quantifies the value of time to market for the auto industry and highlights how Primavera Enterprise Portfolio Management can help organizations.
- IBM Flash Webcast: Optimizing your Datacenter for Efficient Storage & ROI Register for this webcast to learn the benefits of flash storage from IBM Customer, Leonardo Irastorza of Royal Caribbean Cruise Ltd and Storage... All Data Storage White Papers | Webcasts