White Paper Benchmark the Performance, Reliability, and Scalability of Dell EMC OpenManage Enterprise 3.4 in your data center environment This technical white paper provides information about best practices that you can use as the benchmark for using Dell EMC OpenManage Enterprise 3.4 to optimize the usage of servers and chassis. Performance Test Dell EMC OpenManage Enterprise by using PowerEdge servers & chassis for establishing benchmarkable usage settings.
Revisions Revisions Date Description February 2019 Initial release June 2019 Revision 1 July 2020 Revision 2 Acknowledgements Author: Nagaraj K, Pupul Mayank, Sudhish Singh, Soumyajeet Biswal, and Gabe Stern The information in this publication is provided “as is.” Dell Inc. makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose.
Table of contents Table of contents Revisions.............................................................................................................................................................................2 Acknowledgements .............................................................................................................................................................2 Table of contents .................................................................................................
Table of contents 3.5.2 Test environment and results of the Power Control, CLI, Blink LED Task feature in OpenManage Enterprise 3.4 ..........................................................................................................................................................................23 3.6 Test setup and results of the Profile creation and assignment feature in OpenManage Enterprise 3.4 ..........24 3.6.
Executive summary Executive summary Dell EMC OpenManage Enterprise is a web-based hardware monitoring and management console that provides a comprehensive view of Dell EMC servers, chassis, network switches, other third-party devices, and components on the enterprise network. It is designed for the next generation IT professionals with a focus on simplicity, automation, and unification of data center management.
Impact of hardware on the performance of OpenManage Enterprise 3.
Impact of hardware on the performance of OpenManage Enterprise 3.4 in PowerEdge servers and MX7000 chassis 1. Impact of hardware on the performance of OpenManage Enterprise 3.4 in PowerEdge servers and MX7000 chassis To optimize the setup and task schedule of your appliance, it is first necessary to understand how the hardware may affect performance.
OpenManage Enterprise 3.4 features tested 2. OpenManage Enterprise 3.4 features tested Scalability, performance and longevity tests were performed on OME 3.4 for the following features: • • • • Discovery and Inventory Health Monitoring Firmware and driver Update Configuration and Deployment The methodology used for various tests is defined below: Performance: Performance testing is intended to determine the responsiveness, throughput and reliability of a system under a given load.
OpenManage Enterprise 3.4 features tested 2.1 System Configurations used for Scalability and Performance evaluation of OpenManage Enterprise 3.4 Minimum system configuration required for OpenManage Enterprise in scale environment Configuration 2 Configuration 1 8000 Number of Managed Devices 3000 32 32 RAM used (GB) 200GB 100GB Hard Drive (GB) 8 Processor Cores 8 Note: Anything below “minimum recommended system configuration” is not supported. 2.
OpenManage Enterprise 3.4 features tested 2.3 General recommendations for optimal performance and scalability of OpenManage Enterprise 3.4 Based on the analysis of various tests performed, it is recommended to have the following minimal configurations for optimal performance: • • • • 10 Minimum hardware configuration shown in Table 2 must be used.
OpenManage Enterprise 3.4 features tested 2.4 Test results for deployment of OpenManage Enterprise 3.4 Objective of this test is to verify the time taken to deploy OpenManage Enterprise 3.4 virtual appliance on ESXi. OpenManage Enterprise 3.4 virtual appliance file size (In MB): • • • OVF Size: 1430 VHD Size: 3281.2 KVM Size: 2912.9 ESXi setup details: • • • • ESXi version–6.5.0 U1 Server–PowerEdge R940 Sockets–4 Cores per socket–24 Test results: S.NO.
OpenManage Enterprise 3.4 features tested 2.5 Test results for console upgrade to OpenManage Enterprise 3.4 from various previous versions Console upgrade to OpenManage Enterprise 3.4 was tested in a scalable environment in four different configurations. • • Local Http share was used for the upgrade. All the OME Configs had below configuration: - • RAM – 16GB Virtual Processors – 8 Overall appliance upgrade time taken displayed in the table below is from OME 3.3.1 to 3.4. Config No.
Scalability and performance test results of OpenManage Enterprise 3.4 (tested on multiple PowerEdge servers) 3. Scalability and performance test results of OpenManage Enterprise 3.4 (tested on multiple PowerEdge servers) 3.1 Test setup and results of the Discovery and Inventory feature in OpenManage Enterprise 3.4 3.1.1 Recommendations for setting an environment to test the Discovery and Inventory feature in OpenManage Enterprise 3.4 3.1.
Scalability and performance test results of OpenManage Enterprise 3.
Scalability and performance test results of OpenManage Enterprise 3.4 (tested on multiple PowerEdge servers) 15 Time taken for first discovery, inventory, and onboarding 29m 57s Time taken for re-discovery 26m10 Time taken for re-inventory 9m 38s Time taken for status-poll 29s Time Taken for Complete Chassis Sub-Discovery (1918 sleds) 1h 47m Benchmark the Performance, Reliability, and Scalability of Dell EMC OpenManage Enterprise 3.
Scalability and performance test results of OpenManage Enterprise 3.4 (tested on multiple PowerEdge servers) 3.2 Test setup and results of the Firmware and Driver Upgrade feature in OpenManage Enterprise 3.4 3.2.1 Recommendations for setting an environment to test the Firmware and Driver Upgrade feature in OpenManage Enterprise 3.4 • • • • 3.2.2 Catalog download: Catalog can be downloaded from online/Dell Repository Manager. However, DRM is recommended as it takes less time to download the DUPs.
Scalability and performance test results of OpenManage Enterprise 3.4 (tested on multiple PowerEdge servers) • • • Baseline 7 30s Baseline 8 30s The firmware update was qualified with 200 servers in a single job. Devices more than 200 in a single firmware update job is not supported. To test the scalability of the firmware update task, updates were pushed on 1,000 simulated devices and the job failed gracefully without any unexpected error.
Scalability and performance test results of OpenManage Enterprise 3.4 (tested on multiple PowerEdge servers) 3.2.3 Test environment and results of the Driver Upgrade feature in OpenManage Enterprise 3.
Scalability and performance test results of OpenManage Enterprise 3.4 (tested on multiple PowerEdge servers) 3.3 Test setup and results of the Configuration Compliance feature in OpenManage Enterprise 3.4 3.3.1 Recommendations for setting an environment to test the Configuration Compliance feature in OpenManage Enterprise 3.4 • • • • • • • • 3.3.2 Maximum number of devices used in compliance should not exceed 6,000.
Scalability and performance test results of OpenManage Enterprise 3.
Scalability and performance test results of OpenManage Enterprise 3.4 (tested on multiple PowerEdge servers) 3.4 Test setup and results of the Alert and Task Management feature in OpenManage Enterprise 3.4 3.4.1 Recommendations for setting an environment to test Alert and Task Management feature in OpenManage Enterprise 3.4 • • • • Reception of alerts is supported with 5,000 alerts per minute for 60 minutes without any drop with no alert actions configured.
A Technical support and resources • • • • when 85 alerts/sec were sent to OME for one hour where 5 alert actions were configured, only 60,000 alerts were received. Note: On demand health poll was enabled. Once the alert frequency slows down and all the alert policy execution is complete, the alert reception will return to normal.
A Technical support and resources 3.5 Test setup and results of the Power Control, Remote CLI, Blink LED Task feature in OpenManage Enterprise 3.4 3.5.1 Recommendations for setting an environment to test Power Control, CLI, Blink LED Task feature in OpenManage Enterprise 3.4 Maximum 1200 devices Groups or individual 3.5.2 Devices can be associated by creating groups or by individual selection of devices.
A Technical support and resources 3.6 Test setup and results of the Profile creation and assignment feature in OpenManage Enterprise 3.4 3.6.1 Recommendations for setting an environment to test Profile creation and assignment feature in OpenManage Enterprise 3.4 • • 3.6.2 Maximum number of Profile supported by OpenManage Enterprise 3.4 is 2,000. One profile is associated with one device.
A Technical support and resources • Profile assignments using REST APIs in the OME as follows: a. The API assigns one profile to each device. The API script uses the assignment until the assignment completes for 250 devices. Each assignment has 10 seconds gap. The script waits for the deployment to complete for the 250 devices. b. The same step should be used till the assignment completes for 2,000 profiles.
A Technical support and resources 3.7 Test setup and results of the Deployment feature in OpenManage Enterprise 3.4 3.7.1 Recommendations for setting an environment to test Deployment feature in OpenManage Enterprise 3.4 For deploying a template on multiple servers in a single task, follow the recommendations below to have a higher success percentage: • • • • 3.7.2 Server should have iDRAC Enterprise and OpenManage Enterprise Advanced License in the server.
A Technical support and resources Time taken for configuration deployment 27 2m 30s Benchmark the Performance, Reliability, and Scalability of Dell EMC OpenManage Enterprise 3.
A Technical support and resources 4. Scalability and performance test results of OpenManage Enterprise 3.4 (tested on 20 MX7000 chassis MCM setup) 4.1 Performance results for managing a 20 chassis MCM setup from OpenManage Enterprise 3.4 • Test setup: MCM setup with 1 Lead and 1 backup Lead.
A Technical support and resources Memory mapping for Discovery,Inventory and Statusing of 20 MX7000 chassis MCM setup 4.2 Test setup and results of the Firmware Upgrade feature in OpenManage Enterprise 3.4 (tested on 10 MX7000 chassis) Note: OME supports monitoring of 20 Chassis MCM but the firmware update is only supported for 10 Chassis MCM when the number of SLEDs does not exceed 43. Also, OME 3.4 does not support firmware upgrade on IOMs.
A Technical support and resources • • “Reset iDRAC” is not supported when updating SLEDs in an MCM setup (Only clear job queue is supported). Online catalog was used for firmware update of Chassis and Sleds. Target Time taken for firmware update of MX7000 chassis and multiple sleds Time taken Comments 9 member chassis 1h 21 m Firmware version- 1.10 to 1.20 43 sleds 1h 44m Each sled had 8 DUPs to update. Components: iDRAC, BIOS, iSM, NIC, SEP, OS collector, OS driver pack, BackPane 4.
A Technical support and resources 5. Longevity Test results for OpenManage Enterprise 3.4 5.1 Longevity test configuration for OpenManage Enterprise 3.4 For Longevity testing the appliance was loaded with below Data on Day 1: • • • • • • • • • • • • • • 8,000 devices were discovered and inventoried. Devices discovered were a mix of chassis and rack servers (5,000 rack and remaining chassis and sleds.
A 5.2 Technical support and resources Longevity test results for OpenManage Enterprise 3.4 • Task The time taken for performing scheduled discovery, inventory, and status poll remained approximately constant for a period of 15 days for the supported number of devices.
A Technical support and resources • The time taken to open the GUI and access different pages increases slowly but becomes stable after a few days. No drastic increase in Page Load time was observed. The test data below was captured after each day. To reduce the time taken to open the GUI, users can restart services after a few months if needed. Test results of the Page load time of various Pages per day in Longevity testing in OpenManage Enterprise 3.
A 5.3 Technical support and resources Test results of REST API in a Longevity setup in OpenManage Enterprise 3.4 Test setup: • • • 8,000 Devices were discovered in Open Manage Enterprise 3.4. 50,000 Alerts were present in the Database. OpenManage Power Manager plugin was installed with 6,000 devices added to working set. There is no major difference in results with Power Management plugin installed.
A Technical support and resources 6. Scalability and performance test results of OpenManage Enterprise 3.4 (tested on a Single PowerEdge servers) 6.1 Test setup and results of the Discovery, Inventory, and Status Poll feature in OpenManage Enterprise 3.4 (tested on a single server) Test setup of Discovery, Inventory, and Status poll feature in OpenManage Enterprise 3.4 for single server Load Parameter YX4X Server YX3X Server Model PowerEdge R 940 PowerEdge M830 Processor 4 2 iDRAC version 4.10.
A 6.2 Technical support and resources Test setup and results of the Firmware Upgrade feature in OpenManage Enterprise 3.4 (tested on a single server) Test setup of Firmware Upgrade feature in OpenManage Enterprise 3.4 for single server Load Parameter YX4X Server YX3X Server 36 Model PowerEdge R 740xd2 PowerEdge R830 Processor 2 2 iDRAC version 4.10.10.10 2.63.60.
A 6.3 Technical support and resources Test setup and results of the Configuration Deployment feature in OpenManage Enterprise 3.4 (tested on a single server) Test setup: Test setup for testing Configuration deployment on single server Load Parameter YX4X Server YX3X Server Model PowerEdge R 740xd2 PowerEdge R730xd Processor 2 2 iDRAC version 4.10.10.10 2.70.70.
A A Technical support and resources Technical support and resources • • Dell.com/support is focused on meeting customer needs with proven services and support. To watch quick and short videos about handling the PowerEdge server components, visit the QRL video website. A.1 Related resources A.1.1 Contacting Dell EMC Dell provides several online and telephone-based support and service options. Availability varies by country and product, and some services may not be available in your area.
A Technical support and resources • • • • • Manage device firmware versions and perform system updates and remote tasks. Create and deploy device configuration templates. View and manage system alerts and alert policies. View hardware inventory and compliance reports. Monitor and report about warranty and licenses. Note—For information about supported browsers, see the Dell EMC OpenManage Enterprise Support Matrix available on the support site.
