Intel® Cloud Builders Guide Intel® Xeon® Processor-based Servers Data Center Energy Management with Dell, Intel, and ZZNode Intel® Cloud Builders Guide to Cloud Design and Deployment on Intel® Platforms Data Center Energy Management with Dell, Intel, and ZZNode Audience and Purpose Intel® Xeon® Processor 5500 Series Intel® Xeon® Processor 5600 Series September 2011 This reference architecture outlines the usage of energy management technologies as part of planning, provisioning and optimizing strategie
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Table of Contents Executive Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Composite: Policy Based Power Management Use Cases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31 Use Case Five: Data Center Energy Reduction through Power-Aware Support for Multiple Service Classes. . . . . . . . . 31 Purpose. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Executive Summary The evolution of cloud computing has resulted in highly efficient and carefully optimized data centers with increased server density and capacity that makes considerations on energy consumption and utilization extremely critical along with several other factors that were not as significant in smaller data centers of the past.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode At the core of cloud computing is the ability of the underlying compute, network, and storage infrastructure to act as an efficient, shared resource pool that is dynamically scalable within one data center or across multiple data centers. With this foundation, critical higher-level capabilities such as energy management, guaranteed quality of service, federation, and data center automation are made possible.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode • Application of standards-based power instrumentation solutions available in all servers to allow management for optimal data center efficiency. Extension of instrumentation to enable load balancing or load migration based on power consumption, and close coupled cooling for the management of pooled power and cooling resources.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Software Architecture The following diagram shows a high level view of EDCM Energy Manager Architecture components. Figure 1: Software Architecture for EDCM Hardware and Software Description EDCM Energy Management Server Virtual Machine hosted on VMware* 4 CPUs, 6 GM RAM, 50GB Hard Disk Software Microsoft* Windows* 2008 R2 64 bit, .NET 4.0 Intel DCM 2.1.0.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Server3 Dell PowerEdge C6100 2-way Intel® Xeon® Processor E5530 @ 2.40GHz with 12GB RAM, 250GB SATA HDD Intel Node Manager enabled BMC Card PMBus Enabled power supply Server4 Software Windows 2008 R2 64 bit, SQL Server 2005 Workload Dell PowerEdge C6100 2-way Intel Xeon Processor E5530 @ 2.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Server Setup and Configuration Servers have to be setup with operating systems installed and BMC configured as described below. The reader is expected to have the basic knowledge of the server configuration and operating system installation. This will not be explained in detail in this paper. Refer to Appendix B for guidance on the BMC configuration. 1.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode 1. 10 Install Intel DCM 2.1.0.1159 or later. Follow the instructions as provided with the software and use default options during the installation. From EDCM, it will be integrated and bundled with EDCM installation; no separate installation will be required.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode 2. Install EDCM package and JDK1.6 version and PGAdmin tool for PostGreSql operation. 3. Install pgAdmin database tool, using this tool to connect DCM database and complete required fields: name: dcm, localhost, port 6443, and password for Intel DCM server. 4. Install JDK1.6, and set the JDK1.6 java version to system environment variable.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode 6. Go to Control Panel > System and Security > System > Advanced system settings > Environment Variables. For the system variables, do the following changes: • Add one system variable. Variable Name: JAVA_HOME and Variable Value: C:\Program Files (x86)\Java\jdk1.6.0_20 • Add one system variable. Variable Name: CLASS PATH and Variable Value: .;%JAVA_HOME%\lib\dt.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode 8. Run command window and run Java version. 9. Run create db.sql, to create the role “aloes” and the database “aloes”, the password for the role aloes is “password” (you can run the sql from pgAdmin UI).
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode 10. Run edcm(complete).sql to create tables and properties for EDCM database. (You can run the sql from pgAdmin tool) 11. Run patch.sql, also can be run from pgAdmin.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode 12. Copy the file rocksaw.dll to the same folder as the java.exe, should be in folder like jdk1.6\bin. This java should be the system variable. 13. Start the EDCM server by running the tomcat5.0.28/bin/startup.bat script. 14. Visit the EDCM system and browse http://localhost:28080/edcm, login id is “Admin”, password is “password”.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode 15. To quit the EDCM system, run the tomcat5.0.28/bin/shutdown.bat script. 16. You can open DCM reference UI http://localhost:8688/DataCenterManager.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode 17. Add Server Group to EDCM. a. Go to ‘Resources Group List’ and click ‘Add’. b. Fill Group Name & PDU Power Limit. Name plate power for equipment in a group. c. Scenario for threshold that cannot be higher than PDU. d. Save Group. e. Go to Resource tab and add servers. f. Fill the OS login credentials for EDCM to pull server details. g. Click ‘Save Changed’. h. Status of the server is shown.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Energy Management Use Cases Use Case One: Real-time Server Power Monitoring, Reporting, and Analysis Real time power monitoring at a server level is a critical capability that helps planning, provisioning and optimizing data center energy and cooling capacity.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Energy Consumption Distributed Report Events Report 19
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Energy Cost and Carbon Emission Settings EDCM allows setting energy cost and carbon emission depending on the location and source of energy for data centers. These values would be used for calculations while generating reports. • On EDCM console, go to Global Settings/Energy Prices. Add locations and the values as shown below for energy prices corresponding to your local utility company.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Device Level Power Demand Report Power demand report can be viewed at device level and aggregated by location or other parameters. • To view at a device levels go to Devices Tree. Recent power usage by the server is displayed. By pointing the mouse at a point, the reading is shown. • To zoom to a particular area, click the mouse on the graph and select the desired area for detailed viewing.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Energy Cost Report EDCM generates energy cost report that can be used to analyze the cost of energy consumed to support different departments and at multiple locations. The power costs configured in the setting is applied for the location. Energy cost is available under the “Consumption Details” report for saved electricity and saved cost.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Rack Level Energy Reporting Monitor your energy data via rack or by customer. • Go to Devices tab. • Select the Grouping you want to view energy on the left side of the device browser. • Click the Overview button. The figure below shows this report, though not from the test bed described in this document.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Use Case Two: Power Guard Rail and Optimize Rack Density/Usage Optimize Rack Density/Usage The collection of real-time power consumption data constitutes an essential capability for power monitoring. Without this data, the best approximation for server power usage comes from the manufacturer’s specifications. To use the nameplate numbers as a guidepost requires the allowance of a hefty safety margin.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Set Power Cap Set the power cap above the maximum value, so that server will not consume power above the capped value, and rack density can be budgeted for this value than name plate power or derated power. • Go to Set Scenario. • Add Set Power Threshold to 750 W.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Verify Power Cap This step shows that the power cap value is set, so that server will not consume power above the capped value. Rack density can be increased if all servers are budgeted at this value rather than name plate power or a static derated power figure. • Green graph shows the power decrease to adjust to business policy. • Power Threshold to 750 W (red line) is achieved and maintained for schedule time.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Optimize Rack Density To perform the above exercise for other servers, we need to determine the total power cap applied to the servers in a rack. The difference between the total power cap assigned to the rack and power quota allocated for the rack provides guidance on how many additional servers having similar power cap settings can be added to the rack without overshooting the power quota allocated.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Use Case Three: Disaster Recovery / Business Continuity Power capping can be used to manage power consumption effectively during unforeseen emergency situations. During Primary AC power outage scenarios for part of all of data center, aggressive power capping can be applied to servers to reduce power consumption.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode The following scenario illustrates the application of power cap at a location in an emergency situation: Use Case Four: Power Optimized Workloads IT organizations (including Intel IT) face significant data center power and cooling challenges. So, companies seek alternative approaches that focus on more efficient use of existing data center power.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Results For workloads that are not constrained by processor performance—such as I/O-intensive and memory-intensive workloads—we may be able to use Intel Node Manager and Intel DCM to throttle back the server processor without an effect on overall performance. As a result, we could reduce server power consumption without risk to service-level agreements (SLAs).
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Composite: Policy-Based Power Management Use Cases The opportunity to reduce energy usage by power capping alone is limited. For significant energy reduction, sustained power cuts are needed over time. If the policy in effect is capping as a guard rail, the policy seldom kicks in, if at all.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode can further trim down power consumption without undue degradation in QoS. Likewise, since servers are turned on in discrete steps, whenever one is activated the system will likely be over-provisioned. An application of power capping will allow the equalization of supply to demand.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode increased rack density, reduced capital, and operational expenses. Intel DCM supports the following security options: Communication: • TLS protected Web service API. • You can enable TLS as part of the installation; TLS enables: ººAPI calling from Enterprise Console. ººCalling between different components. ººEvent integrity verification.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode APPENDIX A: Server Power Management Intel Power Management Technologies Micro-processors are possibly the most energy intensive components in servers and have traditionally been the focus of power management strategies. Emergent technologies such as solid state drives have the potential to significantly reduce power consumption and in the future, management of memory power consumption may be incorporated.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode APPENDIX B: Dell PowerEdge C-Series Server Configuration for Power Management This section describes the configuration required on Dell PowerEdge C-Series servers to enable power management by Intel DCM and EDCM. Configuration steps for the PowerEdge C1100 server are illustrated below.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode 3. Out of the box, the BMC should pick up a DHCP address if it is on a DHCP enabled subnet – the default setup will be Dedicated and DHCP would be Disabled – meaning a dedicated management drop is required for the server and it is required to assign an IP Address when installing the server. In our test scenario we have it setup as Shared-NIC and DHCP is Enabled. 4. Once the IP address is set up, make a note of it.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode 6. Once logged into the BMC, click on the ‘Configuration’ and then ‘Network’ tab where logical name for the server’s management IP address can be set as shown below. 7. Save by clicking ‘Apply Changes’ and this Dell PowerEdge C1100 server is ready to start using EDCM and DCM to monitor and manage power usage.
Intel® Cloud Builders Guide: Data Center Energy Management with Dell, Intel, and ZZNode Disclaimers ∆ Intel processor numbers are not a measure of performance. Processor numbers differentiate features within each processor family, not across different processor families. See www.intel.com/ products/processor_number for details. INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL® PRODUCTS.