How to Use Facebook's Open Sourced Data Center Design to Cut CostsAdded 17th Nov 2012
Facebook's state of the art data center in Oregon uses 38 percent less power and costs 24 percent less to run that its older data centers. These figures are astounding, and they should certainly make any cost-conscious CIO sit up and take notice.
What's the secret behind these savings? The company honored its hacker roots by custom-designing both the data center itself, and the servers (and management tools) inside it, from the ground up. It's akin to what Google has been doing for the past 10 years or so, but the good news is that--unlike Google--Facebook has not kept what it has achieved and how it has achieved it a secret at all.
In fact the reverse is true: following the open-source software model, Facebook turned its server, server management, storage, rack, electrical, cooling and overall data center designs over to the Open Compute Project(OCP) Foundation, a not-for-profit with some heavyweight names on its board including Intel, Rackspace, Goldman Sachs and Arista Networks as well as Facebook. The OCP Foundation has formalized Facebook's designs into OCP specifications, and these specifications are freely available and anyone can contribute improvements to them.
Pick a Vendor, Any Vendor
One of the key ideas behind the development of the OCP specifications has been to avoid the "gratuitous differentiation" between different vendors' products, according to Frank Frankovsky, Facebook's vice president of hardware design and supply chain, and founding board member of the OCP. (The phrase "gratuitous differentiation appears to be a mantra used by everyone involved with the OCP, and Frankovsky is no exception.)
"Buying off-the-shelf servers, for example, is not economical as they include features that most organizations don't need," says Frankovsky. "That leads to extra costs and wasted electricity, and there are issues like it not being possible to manage HP boxes in the same way as Dell boxes: proprietary management wreaks havoc in environments like ours." Instead of being supplied by established hardware vendors like Dell or HP, OCP servers are often supplied directly by manufacturers in theFar Eastwho are willing to supply them at wafer-thin margins.
The overall theme of the OCP then is to slim the server hardware down to what's actually needed to carry out the sort of large-scale computing that Facebook is involved in, and run it off a highly efficient electrical system with a minimum amount of power transformations. Further power and cost savings are achieved by housing it all in a data center with a high efficiency cooling system.
Facebook has proven that its designs work in its purpose-built data center inOregon, but the vast majority of enterprises have far smaller computing environments and are unlikely to embark on a new data center build. So the question you're probably asking is this: can regular small and medium sized businesses, or even large enterprises that don't carry out computing on the same scale as Facebook, benefit from OCP designs? And if so, how?
"We certainly expected initially that our designs would appeal only to companies doing large scale computing like us, or companies like banks that have huge IT operations," says Frankovsky. "But it turns out that there is almost no limit to who can benefit. I would argue that the OCP is applicable to everyone, and who wouldn't want to be more efficient and eliminate gratuitous differentiation?"
The reason that anyone can benefit is that you don't have to build a new data center to achieve some of the cost savings: You can pick and choose which OCP specifications to adopt. That means that even if you are using colocation facilities you could put in OCP servers and power supplies and make significant power and cost saving.
"We achieved a 38 percent reduction in energy usage in a newly built data center, but putting OCP servers in a colocation you could expect energy savings of at least half that," says Frankovsky. The news is even better when it comes to overall cost savings: Frankovsky says he believes that even if you are responsible for a fairly small IT environment, you could still match Facebook's 24 percent cost reduction. That's because while Facebook was already getting heavy discounts on its hardware due to its scale, you probably aren't. That means the cost savings from switching to cheaper OCP gear--minus the gratuitous differentiation--will be all the more significant.
Smaller Enterprise Benefit From OCP
One company that is backing OCP and hopes to bring its benefits to smaller enterprises is Digital Realty Trust, the world's largest operator of data center space. It is planning to equip some of its data center pods with equipment that complies with the OCP Open Rack standard including the OCP integrated power distribution system, enabling customers to pick OCP servers to run in the pods. Since these will be in the company's existing data centers, customers won't get the benefit of OCP cooling system designs.
But Digital Realty Trust CTO Jim Smith says that its existing cooling systems are already very efficient, even if they can't quite match OCP standards. "Smaller customers can pick their own OCP servers, and we can offer them between 75 percent and 85 percent of the benefits that Facebook gets at its data center," he says.
Smith says that typical customers for Digital Reality's OCP environments will be small-to-midsized companies or large, non-technology intensive companies that require between 1 and 3 megawatts of capacity. So far the company is in talks with potential customers, but has yet to sign any up.
One reason for this may be that companies are not yet sure that "open source" hardware design will really work, and prefer to take the safe route of buying from one of the established big name vendors, Frankovsky says. But he expects that will change quickly. "Think of Linux in the early years, and how unsure people were of the risks," he said "But think of the speed of development in the open source software market, and then envision that in hardware."
To help you take advantage of OCP, there is a growing list of "OCP solution providers" such as Avnet, ZT Systems and Hyve Solutions (owned by Synnex, a business process services company), while QCT (owned by Quanta, a Taiwanese original design manufacturer (ODM) which makes many of Dell's servers) and Wiwynn (owned by Wistron, another Taiwanese ODM) have been set up to sell OCP hardware direct to end users.
HP and Dell have also announced new, server designs (codenamed "Coyote" --based on HP's ProLiant platform and Intel's Xeon E5-series processors--and "Zeus," respectively) which will be compatible with OCP's Open Rack specification, and VMware has announced that it will certify its vSphere virtualization platform to run on OCP iron.
OCP solution provider Hyve Solutions takes standard OCP servers, adds cabling, drives and networking gear, and then ships them out as OCP racks. Steve Ichinaga, the company's general manager, says Hyve has seen huge interest and significant sales volumes of OCP servers ever since Facebook announced the savings it had made by specifying them.
"Prior to this people bought what was available--maybe Dell or HP servers. But we have seen a flood in terms of big names coming to us looking for servers that are less expensive and consumed less power, but which can be customized," said Ichinaga.
Storage, Servers and Beyond
So far the OCP Foundation has concentrated on the hardware space, particularly server, storage and data center design, but where will it go from here? Frankovsky says that the Foundation is unlikely to branch out beyond these areas in the foreseeable future. "Linux was successful because there were a lot of developers working on a common core, and we want to study how and why Linux was successful before branching out too far," he said.
But some day will OCP encompass other areas, like networking or perhaps mobile devices? "You never know..." is all that Frankovsky will say at this stage.
Heading an enterprise’s IT means answering thousands of questions every day. From business impacting decisions like how much to charge a customer for a service, to in-house daily process hold ups like whether to deny or approve an insurance claim. CIO Magazine, in association with Airtel, hosted a roundtable to discuss with CIOs and IT heads from various industries to discuss the latest thinking around managed IT services and how do they think it potentially benefits their IT.
Collaboration today has risen to become the next true source of efficacy and innovation in IT for business. CIO Magazine, in association with Airtel, conducted a roundtable to discuss how collaboration has impacted diverse businesses.
As India celebrates the spirit of independence, Indian CIOs crack the code to freedom from the ‘support function’ tag.
This Independence Day Indian CIOs are hoping to find a way to stop LOBs from directly sourcing technology.
Cloud video conferencing is a game changer but traditional methods are still the major competitors, says Gagan Verma, regional director, India and SAARC region, Lifesize.
According to CIO India’s Mid-Year Review 2014 survey, 48 percent of Indian CIOs are currently using, or planning to implement hybrid clouds in their organizations, compared to 35 percent last year.
Somesh Chandra, Director-Customer Service, Operations, Technology and Chief Quality Officer, Max Bupa, puts his customers on a pedestal and is banking on IT to keep them there.
Named Bot-SO, this robot acts as a remote home surveillance system and communicates with users through twitter to alert them about intruders.
Compared to their peers who got a hike, these Indian CIOs are doing the right things but aren’t getting paid for it.
A recent report from the Security for Business Innovation Council (SBIC) states that technology and security teams can work independently and still ensure minimal risks within their organizations.
According to CIO India’s Mid-Year Review 2014, increase in IT spend, focus on strategic and customer impact, and business readiness to clear IT projects, are three factors that Indian CIOs say will enable business growth.
Crowdsourcing is gaining traction in the IT industry and is applauded for its advantages, but it can be secure too with a managed and private crowd.
The solution helps defend against known intrusions, protection from unknown attacks and guard against advanced persistent threats.
According to the CIO Mid-Year Review 2014, Indian CIOs are troubled by the paucity of skills in emerging technologies like cloud computing, mobility, BI and analytics.
An overwhelming 78.1 percent CIOs stated that they would spend more than the previous year on security management and planning in the current year.