QuickStudy: Direct Access File System
Computerworld - More storage, now. And make it faster! The explosion of data gathering in today's online business environment means that your storage requirements keep going up, and the amount of data that you need to process and analyze also grows. Unfortunately, the tools we've developed and implemented so far are having a hard time keeping up.
The answer may be the Direct Access File System (DAFS), a protocol that recognizes the speed and reliability of today's Gigabit Ethernet and InfiniBand protocols, provides for remote direct memory access (RDMA) between applications running on separate machines in a cluster or LAN, and is built around files, not blocks.
To understand DAFS better, let's review the differences between a storage-area network (SAN) and network-attached storage (NAS). A SAN is a complete subnetwork dedicated to storage and is connected to one or more servers. Connections to a SAN are made over a high-speed protocol such as Fibre Channel or iSCSI. SAN storage is accessible from all servers, so users can access any storage device on the SAN, regardless of the physical location of the storage or users. SANs were designed to help manage and speed storage by simplifying the data path and taking hard-wired servers out of the loop, but they move data in low-level blocks, thus necessitating a translation to files to use the data.
NAS is simpler than a SAN; basically it's shared, hard-disk storage that's given an integral, dedicated server and its own network address. A NAS appliance attaches to a network without powering it down and requires no changes to the existing file servers. NAS was designed to make it easy and inexpensive to add storage, and data is handled in files, the way the user expects.
Unfortunately, both systems incur considerable processing overhead, which slows data transfers.
DAFS uses the Virtual Interface (VI) architecture, which was designed in 1996 by Microsoft, Compaq and Intel as a data transport mechanism. VI is a high-speed, low latency (i.e., low waiting time) network protocol that lets applications on different machines in a LAN or cluster read and write to memory addresses used by other applications in the network. This memory-to-memory interconnect is called RDMA.
DAFS also reads and writes using a file-based protocol, so it preserves information that would otherwise have to be rebuilt every time it's fetched. File requests to open, update, append, lock or close are exchanged between users' storage clients and storage servers.
Thus DAFS combines the speed of a high-speed SAN and the simplicity of file-based NAS, and does it with lower overhead than either (see diagram below).
DAFS's file-based storage can be managed by several different types of products and also promises to remove some of the internal processing that current block-based databases must perform.
Early work on DAFS was done by Network Appliance Inc. in Sunnyvale, Calif. DAFS is now spearheaded by an 80-plus member industry association called the DAFS Collaborative. The collaborative has completed Version 1.0 of the DAFS specification and turned it over to the Internet Engineering Task Force standards group and to a newly created DAFS Implementors Forum, a subgroup of the Storage Networking Industry Association.
DAFS was first demonstrated in action with an Oracle database in December 2001, but no products have yet reached the market, making it unclear whether DAFS will succeed. Some NAS and subsystem companies don't believe that DAFS is really an open standard, but others believe that it's a genuine step in the evolution of NAS technology that could deliver significant benefits.
Kay is a contributing writer in Worcester, Mass. You can reach him at firstname.lastname@example.org.
See additional Computerworld QuickStudies
- Editor's Note: Cheap & Secure Data Stores
- Storage: The Story So Far
- Five cost-cutting strategies for data storage
- ATA drives: Cheap, but hurt by PC image
- SAN Security: Locking the data store
- Cloning Data for Disaster Recovery
- Tech Check: Backups Get Better
- Direct Access File System
- Storage virtualization: It?s promising but users are holding back
- How your career can thrive in the storage market
- The Next Chapter: Predictions on the future of data storage
- Stalking Storage ROI
- SANs are key to storage ROI, consultant says
- IP storage: More products coming in 2003
- Three Questions for EMC
Read more about Data Storage in Computerworld's Data Storage Topic Center.
- 15 Non-Certified IT Skills Growing in Demand
- How 19 Tech Titans Target Healthcare
- Twitter Suffering From Growing Pains (and Facebook Comparisons)
- Agile Comes to Data Integration
- Slideshow: 7 security mistakes people make with their mobile device
- iOS vs. Android: Which is more secure?
- 11 sure signs you've been hacked
- Pay-as-you-Grow Data Protection: IBM Tivoli's Full-featured Data Protection Suite for Small to Medium Businesses IBM Tivoli Storage Manager Suite for Unified Recovery gives small and medium businesses the opportunity to start out with only the individual solutions...
- Streamline Data Protection with IBM Tivoli Storage Manager Operations Center IBM Tivoli Storage Manager (TSM) has been an industry-standard data protection solution for two decades. But, where most competitors focus exclusively on Backup...
- Using VM Archiving to Solve VM Sprawl This CommVault whitepaper discusses how archiving virtual machines can mitigate VM sprawl with a comprehensive approach to VM lifecycle management.
- Keep Your Network Available, Efficient and Secure Make the most of your network by working with experts who "get it." CDW and F5 have partnered to keep networks highly optimized....
- Make or Break: New Auto Products Must Go To Market On Time This Webcast quantifies the value of time to market for the auto industry and highlights how Primavera Enterprise Portfolio Management can help organizations.
- IBM Flash Webcast: Optimizing your Datacenter for Efficient Storage & ROI Register for this webcast to learn the benefits of flash storage from IBM Customer, Leonardo Irastorza of Royal Caribbean Cruise Ltd and Storage... All Data Storage White Papers | Webcasts