Permabit extends data dedupe to Linux-based NAS
Dedupe software is targeted at low-end NAS vendors
Albireo Virtual Data Optimizer (VDO), which will be available in the second half of this year, offers inline deduplication and optional data compression as a component of storage systems. Permabit sells a higher-end version of its Albireo deduplication product to NAS vendors such as BluArc, Xiotech and LSI Engenio.
The new VDO application is targeted at smaller NAS vendors that use commodity hardware to create inexpensive and easy-to-use NAS, such as Overland Storage, NetGear, Cisco Systems' Linksys and QNap Systems.
Albireo's index engine works by allowing application servers and NAS systems to quickly identify block- or file-level data already stored on an array of disks. Using the SHA-256 hash function, the software assigns a unique identifier to chunks of data being stored. Those hash identifiers are then stored, along with metadata from the storage systems -- such as the block address -- in an index.
As new data comes in from application servers, it is automatically compared with existing data. If duplicate files or blocks of data are found, the storage system is notified and the data is not stored. When data read requests come into the NAS appliance, the data is delivered in the same way a data snapshot is copied on a backup system, through multiple pointers to the data chunks.
"It means there's no rehydration operation, and we're not in the read path," said Jered Floyd, chief technology officer and co-founder of Permabit. "This functionality is not limited to a handful of terabytes of data. It can deliver this across petabytes of data within the same file system or volume."
Floyd said Albireo is capable of delivering 420MB/sec. of sustained throughput using a single quad-core processor, so as not to cause a bottleneck in the data path.
"We'll never be the bottleneck in the storage network," Floyd said. "We feel if dedupe has a negative impact on a storage system, that's an obstacle to adoption."
Permabit is targeting Linux-based NAS systems with its new VDO product because, after top-tier vendors, it's the fastest-growing market. According to Gartner, the Linux-based NAS appliance market has grown from a 6.5% market share in 2006 to 17.9% in 2009.
Floyd said about 60 vendors offer Linux-based NAS systems, which mainly use the iSCSI transport protocol. The systems typically have from one to 96 drives.
In order for the NAS vendors to use the Albireo VDO software, there is a three-week to three-month engineering effort required to integrate the application with their native storage management software.
"There are dozens of Linux-based NAS vendors that are looking for ways to differentiate themselves from their competitors. If it is available, most of these vendors are frustrated with the subpar capabilities of the deduplication that comes with the OS they integrate into their NAS," said George Crump, founder of market research firm Storage Switzerland, in a statement. "Building the Albireo VDO technology into their devices is an excellent way to differentiate themselves."
Lucas Mearian covers storage, disaster recovery and business continuity, financial services infrastructure and health care IT for Computerworld. Follow Lucas on Twitter at @lucasmearian or subscribe to Lucas's RSS feed . His e-mail address is firstname.lastname@example.org.
Read more about Data Storage in Computerworld's Data Storage Topic Center.
- 15 Non-Certified IT Skills Growing in Demand
- How 19 Tech Titans Target Healthcare
- Twitter Suffering From Growing Pains (and Facebook Comparisons)
- Agile Comes to Data Integration
- Slideshow: 7 security mistakes people make with their mobile device
- iOS vs. Android: Which is more secure?
- 11 sure signs you've been hacked
- Pay-as-you-Grow Data Protection: IBM Tivoli's Full-featured Data Protection Suite for Small to Medium Businesses IBM Tivoli Storage Manager Suite for Unified Recovery gives small and medium businesses the opportunity to start out with only the individual solutions...
- Streamline Data Protection with IBM Tivoli Storage Manager Operations Center IBM Tivoli Storage Manager (TSM) has been an industry-standard data protection solution for two decades. But, where most competitors focus exclusively on Backup...
- Using VM Archiving to Solve VM Sprawl This CommVault whitepaper discusses how archiving virtual machines can mitigate VM sprawl with a comprehensive approach to VM lifecycle management.
- Keep Your Network Available, Efficient and Secure Make the most of your network by working with experts who "get it." CDW and F5 have partnered to keep networks highly optimized....
- Make or Break: New Auto Products Must Go To Market On Time This Webcast quantifies the value of time to market for the auto industry and highlights how Primavera Enterprise Portfolio Management can help organizations.
- IBM Flash Webcast: Optimizing your Datacenter for Efficient Storage & ROI Register for this webcast to learn the benefits of flash storage from IBM Customer, Leonardo Irastorza of Royal Caribbean Cruise Ltd and Storage... All Data Storage White Papers | Webcasts