How Netflix streams movies to your TV
The company operates its content delivery network with 1,000 homegrown, high-density storage systems
IDG News Service - At peak times, Netflix accounts for around a third of the consumer Internet traffic in North America. This week, one of its senior engineers described how it gets all those movies to your screen.
The company operates its own content delivery network (CDN), a global network of storage servers that cache content close to where it will be viewed. That local caching reduces bandwidth costs and makes it easier to scale the service over a wide area.
Netflix used to rely on third-party providers like Akamai and Level 3 for the caching work, but two years ago it said it had started building its own CDN, called Open Connect. It now delivers all its content via that network, said David Fullagar, director of content delivery architecture at Netflix, in a talk at the Uptime Institute's data center conference in Silicon Valley.
Netflix also designs its own storage hardware, custom built for streaming video. It uses two types of server, one based on hard disk drives and the other on flash drives, and both are optimized for high-density and low-power use.
Most widely used are the hard drive systems. They cram 36 3.5-inch drives into a server about 6 inches high (four rack units) and 2 feet deep. The servers each store 100TB of data and stream between 10,000 and 20,000 movies simultaneously, Fullagar said. There are about 1,000 of the storage systems total in its network, he said.
Netflix refreshes its hardware design about once a year with the latest drives and low-power Intel processors. It loads the servers with movies and TV shows before it ships them out, because even over high-speed networks it takes time to load 100TB of content remotely.
The servers run mostly open-source software -- the Free BSD operating system, nginx Web server and BIRD routing software -- with a layer of Netflix software on top.
Netflix has a huge library of content -- more than a petabyte -- so during quiet periods between midnight and lunchtime it prepopulates the servers with the content it thinks people will want to watch, reducing bandwidth use in peak hours.
The content still has to get from the CDN to end users, and it's carried by local ISPs (Internet service providers) who connect to the CDN in one of two ways: they peer with it at common Internet exchanges -- basically big data centers where different network providers connect to each other -- or they can install Netflix's storage systems, which it provides them for free, on their own premises.
It currently has servers at 20 different peering locations, and "many tens" of ISPs also have them on site, Fullagar said. For the ISP, having the content on site reduces its inbound bandwidth costs.
- Securing Mobility, From Device to Network At one time, the process of managing and securing mobile devices and applications was fairly straightforward. Most organizations worried about one application (email)...
- Need to Replace MS Threat Management Gateway? Read this article to learn how F5's Secure Web Gateway solution provides a full set of features that can help you successfully migrate...
- The Shortfall of Network Load Balancing Applications running across networks encounter a wide range of performance, security, and availability challenges as IT department strive to deliver fast, secure access...
- Leave No App Behind with Software Defined Application Services F5 Software Defined Application Services (SDAS) is the next-generation model for delivering application services that enables service injection, consumption, automation, and orchestration across...
- Live Webcast IBM FlashSystem V840: Leveraging Software-Defined Flash to Drive Your Business With end-to-end, tightly integrated functionality and super-fast flash technology, products like IBM FlashSystem V840 Enterprise Performance Solution empower businesses to leverage the efficiency...
- DevOps with PureApplication System: Reduce cost and speed delivery with an integrated IBM Cloud solution Join this webcast to hear what ING Netherlands has been able to achieve while deploying DevOps tools from IBM Rational. An ING executive...
- What should I look for in a Next Generation Firewall? SANS Provides Guidance With so many vendors claiming to have a Next Generation Firewall (NGFW), it can be difficult to tell what makes each one different.... All Networking White Papers | Webcasts
Our new bimonthly Internet of Things newsletter helps you keep pace with the rapidly evolving technologies, trends and developments related to the IoT. Subscribe now and stay up to date!