Facebook uses a seasoned Chef to keep servers simmering
Facebook found that the Chef configuration management system was best suited to controlling the company's massive infrastructure
IDG News Service - When it comes to keeping its thousands of servers running smoothly, Facebook relies on the open source Chef configuration manager, modified slightly to handle the size of the social networking giant's huge infrastructure.
"Chef's biggest advantage for us is its flexibility," said Phil Dibowitz, a Facebook systems engineer.
Chef is one of a number of open source configuration management tools that have grown in popularity over the last few years.A As data centers grow ever larger, companies look to automate routine operations around deploying and upgrading servers, switches, OSes, databases and other components.
Facebook's experience in managing its infrastructure may hold lessons for other organizations as well.
Facebook wanted "a new way to manage its systems," Dibowitz said.
Although Facebook does not reveal the total number of servers it runs, industry observers estimate it could be in the tens of thousands, at least. Surprisingly, the company only has a handful of employees -- four on latest count -- on the core infrastructure team, of which Dibowitz is a member. Prior to using Chef, Facebook had been using another open source configuration management package, called CFEngine. The deployment was growing increasingly unwieldy, however.
Using CFEngine version 2, Facebook was experiencing a rapid and unchecked proliferation of system control files.
With CFEngine, users could not edit a configuration management file directly. Instead, each time operations engineers needed to make a change to a system, they would copy a similar system file, make the necessary changes, and then submit the file back to CFEngine.
"In doing so, they added a couple hundred lines of stale configuration," Dibowitz said.
As a result, the infrastructure team did not know all the various configuration permutations it had on hand, or even which of the configuration settings were outdated. "It became really unsupportable," Dibowitz said.
Chef best fit the bill for a number of reasons, Dibowitz explained.
Chef offers great flexibility on how to write configuration changes, thanks in part to how it is based on Ruby, a full-fledged programming language that can be easy to learn for administrators and engineers.
"There's no limiting factor. You don't have to be in the Domain Specific Language [DSL] that CFEngine or Puppet gives you," Dibowitz said. "From there, we had a lot of power to do what we wanted."
Chef offered a number of other advantages as well. It could manage settings at a A much more granular level. It also offered more flexibility in how to manage the configuration files themselves, Dibowitz said.
- Marketers are losing faith in Facebook
- Facebook may lure teen users back with virtual reality promise
- Facebook's Oculus VR buy is about more than gaming
- Facebook spends $2B on virtual reality firm, but analysts are skeptical
- Facebook launches redesign with a bit of the old, a bit of the new
- Facebook eyes solar-powered drone company
- Facebook coughs up $19B for WhatsApp's younger users
- Facebook buying WhatsApp for $16 billion
- Facebook's birthday present: A look back at your social life
- At 10, Facebook strives not to be your granny's social network
- It's Time to Refresh Your Data Center In this Whitepaper, we'll take a close look at how Cisco® Unified Computing System (UCS®) with intelligent Intel® Xeon® processors is revolutionizing the...
- The Strong Business Case for Blades Servers This paper will discuss how several organizations reduced annual IT costs by migrating from a traditional environment to blade server computing.
- Optimize your Virtualization Efforts with a Blade Infrastructure This Brief summarizes the benefits of using a converged and intelligent blade-based infrastructure to support today's highly virtualized environments.
- Maximizing Your Infrastructure through Virtualization With the HP BladeSystem, you can create a virtualized solution that can be tailored to meet your needs today and tomorrow allowing for...
- Cloud Knowledge Vault Learn how your organization can benefit from the scalability, flexibility, and performance that the cloud offers through the short videos and other resources...
- LIVE EVENT: 5/7, The End of Data Protection As We Know It. Introducing a Next Generation Data Protection Architecture. Traditional backup is going away, but where does this leave end-users? All Servers White Papers | Webcasts