Skip the navigation

The Story So Far: The History of RAID

Redundant Arrays of Inexpensive Disks turned out to be expensive—but dependable.

By Frank Hayes
November 17, 2003 12:00 PM ET

Computerworld - David A. Patterson led the team at the University of California, Berkeley, that developed the idea of RAID storage. In an interview with Frank Hayes, Patterson recalled the beginnings of his RAID project in 1987.
"We had just been working on RISC processors, and we consciously said, 'Processors are going to start getting fast, improving faster than they have in the past. So what are we going to do about I/O?' That was one motivation.
"The other one was that Randy Katz [one of Patterson's colleagues at Berkeley] got a Macintosh, and it had a hard disk in a separate box next to it. And he said, 'That's kind of interesting; here's a much smaller disk than I'm used to. What could we do with that as a building block?'
"So we held a graduate course where we started off with some rough ideas, and then we and the graduate students—Garth Gibson, Pete Chen, Ed Lee, Ann Chevernak, Ethan Miller—met and talked and read papers, and the ideas evolved from there.
"But when we tried to tell people our ideas, they couldn't understand. They'd say, 'Oh yeah, that's the same thing that IBM's been doing forever in terms of mirroring.' Or, 'Oh yeah, Thinking Machines, they've got a product in this area.' And so when we tried to explain things, they assumed what we'd done had already been subsumed by other work.
"That motivated us to write a paper ['The Case for Redundant Arrays of Inexpensive Disks']. It advocated that we should be replacing these big disks by lots of small disks. Basically, a big, relatively thick disk that has to spin fast is much less efficient than lots of small disks, and we get all these benefits in terms of volume and footprint and power. We submitted the paper to the database conference SIGMOD, and Garth Gibson [the lead graduate student on the project] and I went to a short course that was given at Santa Clara University by Al Hoagland, who was kind of the godfather of the disk industry. We came with 20 or 30 copies of our report and handed it out at that meeting, and that was a good thing to do. The paper just clicked. It was a good time, I guess, for that set of arguments.
"We built the RAID I [in 1989] to try the ideas in software. For RAID II [in 1993], we said, 'Let's try to build a high-performance I/O system that connects over a network.' Then at the end of the project, we had a little demo where we pulled the disk out and the thing kept working.
"We were still performance-oriented, thinking RAID was for performance, so we were shocked to see somebody write this up in Byte magazine. The PC community was obviously not so performance-oriented as it was dependability-oriented, and they thought, Hey, less-expensive dependable computing.
"It really just took off after that. EMC decided to build mainframe storage out of PC disks. Compaq had RAID early, and Data General. And of course IBM had its own. We didn't know IBM had its own RAID 5 set of ideas in the AS/400 line. IBM had completely independently done the same RAID part of the ideas but used large disks.
"One of the surprises about RAID was it was so expensive. The I in the name when we coined the term was for inexpensive disks. But the system was so expensive, that was kind of awkward for marketing people. So Randy blessed the change to independent for I. Since the RAID boxes weren't cheap, that was probably a better name.
"The current project I'm working on is ROC, Recovery-Oriented Computing. With the RAID stuff, we were always thinking performance, but obviously, dependability is the reason people are doing it. People get mad if their program crashes, but they just go berserk if they lose data. The ROC philosophy is recovering fast when outages happen. That's a different engineering ethic. Hardware will break, software has bugs, people will make mistakes. And if you believe that, then it makes sense to recover fast, rather than just try to make things that never break."

David A. Patterson led the team at the University of California, Berkeley, that developed the idea of RAID storage.
David A. Patterson led the team at the University of California, Berkeley, that developed the idea of RAID storage.
Credit: Peg Skorpinski
1973: IBM's hermetically sealed Winchester hard disks become the standard design for disk drives.
1973: IBM's hermetically sealed Winchester hard disks become the standard design for disk drives.
Credit: Getty Images
1956: IBM officially announces the RAMAC 305, the first hard disk system, which holds 5MB of data.

1961: Ampex develops helical scanning video recording, which will later be adapted for high-capacity tape backup.

1962: IBM Advanced Disk File uses one head for each disk surface, eliminating the need for compressed air to position heads.

1973: IBM’s hermetically sealed Winchester hard disks become the standard design for disk drives.

1979: Al Shugart and Finis Conner launch Seagate Technology to produce hard disk drives for desktop computers.

1979: Philips demonstrates optical storage drive technology as part of a joint venture with Control Data Corp. Commercial products appear five years later.

1986: SCSI is officially standardized by the American National Standards Institute.

1988: David A. Patterson leads a team that defines RAID standards for improved performance, reliability and scalability.

1995: EMC develops the concept of network-attached storage.

1998: Gigabit Ethernet becomes a formal IEEE standard.

1979: Al Shugart and Finis Conner launch Seagate Technology to produce hard disk drives for desktop computers.
1979: Al Shugart and Finis Conner launch Seagate Technology to produce hard disk drives for desktop computers.


Additional Resources

David Patterson's current work: the Recovery-Oriented Computing (ROC) Project
"Self-Repairing Computers," Scientific American, June 2003
David Patterson, An Oral History



Additional Resources
Forrester Consulting - Optimizing Users and Applications in a Mobile World
WHITE PAPER
Solving application issues over the WAN requires careful consideration. Based on their independent research, Forrester Consulting offers recommendations on how to tackle application performance issues, insufficient bandwidth and the inability to quickly restore users in a disaster.

Read now.

Security KnowledgeVault
WHITE PAPER
Security is not an option. This KnowledgeVault Series offers professional advice how to be proactive in the fight against cybercrimes and multi-layered security threats; how to adopt a holistic approach to protecting and managing data; and how to hire a qualified security assessor. Make security your Number 1 priority.

Read now.

Cut Communications Costs Once and for All
WHITE PAPER
New IP-based communications systems are being deployed by small and midsized businesses at a rapid rate. Learn how these organizations are enabling faster responsiveness, creating better customer experiences, speeding office or mobile interactions, and dramatically reducing existing communications costs.

Read now.

Storage White Papers
Datacenter Consolidation Best Practices Whitepaper
The benefits of storage consolidation are being realized by companies and seen as a way to streamline many storage-driven applications. Learn why the...
Eliminating VMware / Storage Related Performance Challenges
How to proactively monitor the performance in a Fibre Channel SAN / vSphere environment is always a concern. Understand the importance of a...
Cloud Environments Have Familiar Storage Challenges
Cloud environments have many storage challenges that are familiar to data center managers, but due to their density and abstraction, the issues become...
Eight Considerations for Evaluating Disk-Based Backup Solutions
In the past, the movement from tape- to disk-based backup has been less compelling due to the expense of storing backup data on...
ExaGrid Helps U.S. Federal Government Agencies Reduce Backup Windows and Improve Data Protection
The U.S. Government has been the largest user of tape-based backup systems since the 1970s. Most agencies have begun to deploy disk storage...
All Storage White Papers
Storage Webcasts
Understand Your Data: The Future of Backup and Archiving
Archiving and Backup are the foundation of the next generation of information governance. However, commodity data protection tools and basic archives are only...
Optimizing Networks for the Cloud
Join guest speaker, Rohit Mehra, IDC Director of Enterprise Communications Infrastructure, to explore current trends, discuss best practices for optimizing Data Center and...
Apps QuickStart Series Part 2: Designing and Deploying SQL Server on VMware vSphere
Download this webcast to learn about the design considerations for virtualizing SQL workloads, performance and scalability information and high-availability options, as well as...
Apps QuickStart Series Part 1: Designing and Deploying Exchange 2010 on VMware vSphere
Download this webcast to learn the virtual hardware design considerations for Exchange 2010, deployment using the building block approach, options for high-availability and...
Customer Spotlight: How IPC The Hospitalist Company Implemented Oracle on VMware
Have you been looking to hear about customer's experiences with the new VMware vCenter Site Recovery Manager product? View this webcast to learn...
All Storage Webcasts
Newsletter Sign-Up

Receive the latest news test, reviews and trends on your favorite technology topics

Choose a newsletter
  1. View all newsletters | Privacy Policy
IT Jobs