NeXtScale nx360 M4 Lenovo Press Product Guide NeXtScale System is a new dense HPC offering, based on our experience with iDataPlex® and BladeCenter® along with a tight focus on emerging and future client requirements. The NeXtScale n1200 enclosure and NeXtScale nx360 M4 server are designed to optimize density and performance within typical data center infrastructure limits. The 6U NeXtScale n1200 enclosure fits in a standard 19-inch rack and up to twelve nx360 M4 servers can be installed into the enclosure.
Key features Introducing NeXtScale System, which is a new generation Intelligent Cluster™ platform that follows on from the highly successful iDataPlex offering. Designed with industry-standard, off-the-shelf components, NeXtScale System is a general-purpose platform that is designed to give customers a flexible IT infrastructure.
Intel Hyper-Threading Technology boosts performance for multi-threaded applications by enabling simultaneous multi-threading within each processor core, up to two threads per core. Intel Virtualization Technology integrates hardware-level virtualization hooks that allow operating system vendors to better use the hardware for virtualization workloads. Intel Advanced Vector Extensions (AVX) improve floating-point performance for compute-intensive technical and scientific applications.
The nx360 M4 is Energy Star 2.0 compliant. Energy Star is the trusted, US government-backed symbol for energy efficiency, with the goal of helping customers save money and protect the environment through energy efficient products and practices. For the Power and Performance Data Sheet, see http://ibm.com/systems/x/hardware/energy-star Shared 80 Plus Platinum power supplies ensure energy efficiency. Large 80 mm fans maximize air flow efficiencies.
Locations of key components and connectors The following figure shows the front of the nx360 M4 server. Figure 2. Front view of NeXtScale nx360 M4 The following figure shows the locations of key components inside the server. Figure 3.
The compute nodes are installed in the NeXtScale n1200 enclosure, as shown in the following figure. Figure 4. Front view of the NeXtScale n1200 enclosure The rear of the enclosure contains the power supplies, fans, and the Fan and Power Controller, as shown in the following figure. Figure 5.
Standard specifications The following table lists the standard specifications of the NeXtScale nx360 M4 compute node and NeXtScale n1200 enclosure. Table 1. Standard specifications (part 1) Components Specification Form factor Standard server: Half-wide, 1U compute node. With optional Native Expansion Tray: Half-wide 2U compute node. Supported chassis NeXtScale n1200 enclosure, 6U high; up to 12 compute nodes per chassis.
Table 1. Standard specifications (part 2) Components Specification Ports Front of the server: KVM connector; with the addition of a console breakout cable (1 cable standard with the chassis) supplies one RS232 serial port, one VGA port, and two USB ports for local console connectivity. Three 1 Gbps Ethernet ports with RJ45 connectors: one dedicated for systems management (wired to the IMM), one dedicated for use by the operating system, and one shared by the IMM and the operating system.
Standard models The following table lists the standard models. Table 2. Standard models Model Intel Xeon Processor† (2 maximum) Memory and speed RAID controller Drive bays Disks Network Optical 5455-22x 2x E5-2620 v2 6C 2.1GHz 15MB 1600MHz 80W 2x 4 GB 1600 MHz 6 Gbps SATA (No RAID) 1x 3.5-inch SS bay Open 2x GbE None 5455-42x 2x E5-2660 v2 10C 2.2GHz 25MB 1866MHz 95W 2x 8 GB 1866 MHz 6 Gbps SATA (No RAID) 1x 3.5-inch SS bay Open 2x GbE None 5455-62x 2x E5-2670 v2 10C 2.
The tables are as follows: Table 3 - 1300 W power supplies, 200-240V AC input, no GPU Trays Table 4 - 1300 W power supplies, 200-240V AC input, GPU Trays with 130 W GPUs Table 5 - 1300 W power supplies, 200-240V AC input, GPU Trays with 225 W GPUs Table 6 - 1300 W power supplies, 200-240V AC input, GPU Trays with 235 W GPUs Table 7 - 1300 W power supplies, 200-240V AC input, GPU Trays with 300 W GPUs Table 8 - 900 W power supplies, 200-240V AC input, no GPU Trays Table 9 - 900 W power s
Table 4. Number of compute nodes supported each with two 130 W GPUs installed (200-240 V AC Input, with 6 x 1300 W PSUs) CPU TDP Number of CPUs Non-redundant or N+1 with OVS N+1 N+N N+N with OVS 50 W 1 6 6 6 6 2 6 6 6 6 1 6 6 6 6 2 6 6 6 6 1 6 6 6 6 2 6 6 6 6 1 6 6 6 6 2 6 6 6 6 1 6 6 6 6 2 6 6 5+1 6 1 6 6 6 6 2 6 6 5 6 1 6 6 5+1 6 2 6 6 4+1 5+1 60 W 70 W 80 W 95 W 115 W 130 W Table 5.
Table 6. Number of compute nodes supported each with two 235 W GPUs installed (200-240 V AC Input, with 6 x 1300 W PSUs) CPU TDP Number of CPUs Non-redundant or N+1 with OVS N+1 N+N N+N with OVS 50 W 1 6 6 5+1 6 2 6 6 4+1 6 1 6 6 5 6 2 6 6 4+1 5+1 1 6 6 5 6 2 6 6 4+1 5+1 1 6 6 5 6 2 6 6 4+1 5+1 1 6 6 4+2 5+1 2 6 6 4 5 1 6 6 4+1 5+1 2 6 6 3+1 4+1 1 6 6 4 5 2 6 6 3+1 4 60 W 70 W 80 W 95 W 115 W 130 W Table 7.
Table 8. Number of compute nodes supported (200-240 V AC Input, with 6 x 900 W PSUs) CPU TDP Number of CPUs Non-redundant or N+1 with OVS N+1 N+N N+N with OVS 50 W 1 12 12 12 12 2 12 12 11 12 1 12 12 12 12 2 12 12 10 12 1 12 12 12 12 2 12 12 8 11 1 12 12 11 12 2 12 12 8 9 1 12 12 10 12 2 12 12 6 10 1 12 12 8 10 2 12 10 5 8 1 12 12 7 9 2 10 8 4 7 60 W 70 W 80 W 95 W 115 W 130 W Table 9.
NeXtScale n1200 Enclosure models The standard n1200 Enclosure models are listed in the following table. Table 10.
Processor options The nx360 M4 supports the processor options that are listed in the following table. Table 11. Processor options Part number Feature code* Intel Xeon processors** Where used 00FL128 A55N / A55W Intel Xeon Processor E5-2603 v2 4C 1.8GHz 10MB 1333MHz 80W - 00FL129 A55P / A55X Intel Xeon Processor E5-2609 v2 4C 2.5GHz 10MB 1333MHz 80W - 00Y8687 A4MF / A4MK Intel Xeon Processor E5-2618L v2 6C 2.0GHz 15MB 1333MHz 50W - 46W2712 A425 / A42F Intel Xeon Processor E5-2620 v2 6C 2.
Memory options Lenovo DDR3 memory is compatibility tested and tuned for optimal System x® performance and throughput. Lenovo memory specifications are integrated into the light path diagnostics for immediate system performance feedback and optimum system uptime. From a service and support standpoint, Lenovo memory automatically assumes the system warranty, and Lenovo provides service and support worldwide. The NeXtScale nx360 M4 supports DDR3 memory.
In the nx360 M4, the maximum memory speed of a configuration is the lower of the following two values: The memory speed of the processor (See Table 4 above) The memory speed of the DIMM (See Table 5 below) The server supports both 1.5 V and 1.35 V DIMMs. Mixing 1.5 V and 1.35 V DIMMs in the same server is supported. In such a case, all DIMMs operate at 1.5 V.
NeXtScale Storage Native Expansion Tray The NeXtScale Storage Native Expansion Tray is a half-wide 1U expansion tray that attaches to the nx360 M4 to provide seven extra 3.5-inch simple-swap SATA drives. The tray allows the configuration of storage-rich nx360 M4 compute nodes. Note: The Storage Native Expansion Tray and the PCIe Native Expansion Tray cannot be connected to the same compute node. The following figure shows the storage tray attached to an nx360 M4 Figure 6.
The following figure shows the NeXtScale Storage Native Expansion Tray with the cover removed showing seven 3.5-inch drives installed. Figure 7.
Internal storage The NeXtScale nx360 M4 server supports one of the following drives internally in the server: One 3.5-inch simple-swap SATA drive Two 2.5-inch simple-swap HDDs or SSDs Four 1.8-inch simple-swap SSDs In addition, the nx360 M4 supports seven additional 3.5-inch drive bays if the NeXtScale Storage Native Expansion Tray is attached.
The following figure shows the three variations (the two 3.5-inch cages look similar). Figure 8. Drive bay options There are two 3.5-inch drive cages - the last two rows of the above table. If the Storage Native Expansion Tray is attached to the nx360 M4, then the use of the RAID cage (feature A4GE, option 00Y8615) allows you to configure a RAID array that spans all 8 drives - the 7 in the storage tray and the 1 drive internal to the nx360 M4.
The following table lists the adapters that are supported for each drive configuration. Table 17. Drive type and RAID adapter support Software RAID or no RAID Drive type Quantity of drives supported On board SATA ServeRAID C100 Hardware RAID N2115 HBA ServeRAID H1110 ServeRAID M1115 Without Storage Native Expansion Tray attached (one controller) 1.8-inch SS SATA SSD 4 No Yes Yes Yes Yes 2.5-inch SS SATA HDD 2 No Yes Yes Yes Yes 2.5-inch SS SAS HDD 2 No No Yes Yes Yes 3.
If you do not use the 3.5-inch RAID cage or you are using 2.5-inch or 1.8-inch drives in the nx360 M4, then the internal drives will be connected to a separate controller than the drives in the storage tray and you will not be able to form a RAID array spanning both internal drives and drives in the storage tray. The internal drives are connected to the ServeRAID C100 controller as indicated in the above table.
The ServeRAID C100 is an integrated SATA controller with software RAID capabilities. It is a cost-effective way to provide reliability, performance, and fault-tolerant disk subsystem management to help safeguard your valuable data and enhance availability.
Internal drive options The following table lists hard disk drive options for the internal disk storage of the nx360 M4 server. Rules for mixing drive types: Mixing HDDs: Simple-swap SATA HDDs and simple-swap SAS HDDs can be intermixed in the system, but cannot be intermixed in the same RAID array. Mixing HDDs and SSDs: Both simple-swap SATA HDDs and simple-swap SAS HDDs can be intermixed with SSDs in the system. SAS or SATA HDDs cannot be configured with SSDs within the same RAID array. Table 18.
Table 18. Disk drive options for internal disk storage (Part 2) Part number Feature code Description Maximum supported 2.5-inch simple-swap SATA HDDs 00AD030 A48A 250GB 7.2K 6Gbps SATA 2.5" HDD for NeXtScale System 2 00AD035 A48B 500GB 7.2K 6Gbps SATA 2.5" HDD for NeXtScale System 2 00AD040 A48C 1TB 7.2K 6Gbps SATA 2.5" HDD for NeXtScale System 2 2.5-inch simple swap SAS-SSD Hybrid 00AJ315 A58T 600GB 10K 6Gbps SAS 2.5" Hybrid for NeXtScale System 2 2.
NeXtScale PCIe Native Expansion Tray The NeXtScale PCIe Native Expansion Tray is a half-wide 1U expansion tray that attaches to the nx360 M4 to provide two full-height full-length double-width PCIe 3.0 x16 slots. The tray is designed to support two GPU adapters or coprocessors. Note: The PCIe Native Expansion Tray and the Storage Native Expansion Tray cannot be connected to the same compute node.
Only GPUs and coprocessors are supported in the PCIe Native Expansion Tray and only those listed in the following section. The PCIe Native Expansion Tray also includes the auxiliary power connectors and cables for each adapter slot necessary for each supported GPU and coprocessor.
Network adapters The nx360 M4 offers two Gigabit Ethernet ports with the following features: Intel I350 Gb Ethernet controller IEEE 802.3 Ethernet interface for 1000BASE-T, 100BASE-TX, and 10BASE-T applications (802.3, 802.3u, and 802.
The following table lists additional supported network adapters in the standard full-height half-length PCIe slot. Table 22.
Storage host bus adapters The following table lists the storage HBAs that are supported by the nx360 M4 server. Table 23.
Power supplies The NeXtScale n1200 enclosure supports up to six redundant hot-plug power supplies, providing N+N or N+1 redundancy Power policies with no redundancy is also supported. These High Efficiency (HE) Platinum AC power supplies are 80 PLUS Platinum certified to allow for the best efficiency values of your data center. The following table lists the supported power supply option. Table 24.
Local server management The nx360 M4 provides local console access through the KVM connector on the front of the server. A console breakout cable is used with this connector which provides a VGA port, two USB ports and a DB9 serial port. The cable is shown in the following figure. Figure 10. Console breakout cable One console breakout cable is shipped with the NeXtScale n1200 enclosure. Additional cables can be ordered per the following table. Table 26.
To aid with problem determination, the server includes light path diagnostics, which is a set of LEDs on the front of the server and inside the server that show you which component is failing. The LEDs are shown in the following figure. Figure 11. Power button and system LEDs When an error occurs, the system error LED lights up. Review the logs through the web interface of the IMMv2 (see the "Remote server management" section). If needed, power off the server and remove it from the enclosure.
IMM2 Standard (as enabled using the Feature on Demand software license key using part number 90Y3900) has the following features in addition to the IMM2 Basic features: Remote access through a secure web console Access to server vital product data (VPD) Automatic notification and alerts Continuous health monitoring and control Email alerts Syslog logging support Enhanced user authority levels Event logs that are time stamped, saved on the IMM, and that can be attached to email alert
Remote enclosure management The NeXtScale n1200 Enclosure offers a remote management capability through the Fan and Power Controller, which is at the back of the enclosure. Figure 12. Fan and Power Controller The Fan and Power Controller has one external RJ45 port which provides a 10/100 Mbps Ethernet connection for browser-based remote control.
Supported operating systems The server supports the following operating systems: Microsoft Windows Server 2008 HPC Edition Microsoft Windows Server 2008 R2 Microsoft Windows Server 2012 Microsoft Windows Server 2012 R2 Red Hat Enterprise Linux 5 Server x64 Edition Red Hat Enterprise Linux 6 Server x64 Edition Red Hat Enterprise Linux 7 SUSE Enterprise Linux Server (SLES) 12 SUSE LINUX Enterprise Server 11 for AMD64/EM64T SUSE Linux Enterprise Server 12 with XEN VMware vSphere 5.
Physical and electrical specifications NeXtScale nx360 M4 dimensions: Width: 216 mm (8.5 in.) Height: 41 mm (1.6 in.) Depth: 659 mm (25.9 in.) Maximum weight: 6.05 kg (13.31 lb) NeXtScale n1200 enclosure dimensions: Width: 447 mm (17.6 in.) Height: 263 mm (10.4 in.) Depth: 915 mm (36 in.) Fully configured (stand-alone): 112 kg (247 lb), empty chassis 28 kg (62 lb) Supported environment The NeXtScale nx360 M4 compute node complies with ASHRAE class A3 specifications.
BTU output Minimum configuration: 341 Btu/hr (100 watts) Maximum configuration: 20,471 Btu/hr (6,000 watts) Noise level 7.0 bels (idle) Regulatory compliance The server conforms to the following international standards: Energy Star 2.0 FCC - Verified to comply with Part 15 of the FCC Rules, Class A Canada ICES-003, issue 5, Class A UL/IEC 60950-1 CSA C22.2 No.
Warranty options The NeXtScale nx360 M4 and NeXtScale n1200 enclosure have a 3-year onsite warranty with 9x5/next business day terms. Lenovo offers the warranty service upgrades through ServicePac offerings. The ServicePac is a series of prepackaged warranty maintenance upgrades and post-warranty maintenance agreements with a well-defined scope of services, including service hours, response time, term of service, and service agreement terms and conditions. ServicePac offerings are country-specific.
Rack cabinets The NeXtScale n1200 enclosure is supported in the following racks: 42U 1100 mm Enterprise V2 Deep Dynamic Rack 42U 1100 mm Dynamic Enterprise V2 Expansion Rack For more information, see the list of Lenovo Press Product Guides in the Rack cabinets and options category: http://www.redbooks.ibm.com/portals/systemx?Open&page=pg&cat=rack Rack options The server supports the rack console switches and monitor kits that are listed in the following table. Table 30.
External disk storage expansion The server supports attachment to external storage expansion enclosures, such as the EXP2500 series, by using either the ServeRAID M5120 (6 Gbps) or M5225 (12 Gbps) SAS/SATA Controller. Table 31.
The controllers supports connectivity to the external expansion enclosures that are listed in the following table. Up to nine expansion enclosures can be daisy-chained per one adapter port. For better performance, distribute expansion enclosures evenly across both adapter ports. Table 32.
The following table lists the hard disk drives that are supported by EXP2524 external expansion enclosures. Table 35. Drive options for EXP2524 external expansion enclosures Part number Description Maximum quantity supported per one enclosure 2.5" NL SAS HS HDDs 00NC571 1TB 7,200 rpm 6Gb SAS NL 2.5" HDD 24 2.5" SAS HS HDDs 00NC561 146GB 15,000 rpm 6Gb SAS 2.5" HDD 24 00NC563 300GB 15,000 rpm 6Gb SAS 2.5" HDD 24 00NC565 600GB 10,000 rpm 6Gb SAS 2.5" HDD 24 00NC567 900GB 10,000 rpm 6Gb SAS 2.
External disk storage systems The following table lists the external storage systems that are supported by the x3630 M4 server and can be ordered through the System x sales channel. The server may support other disk systems that are not listed in this table. For further information, refer to the IBM System Storage Interoperation Center at: http://www.ibm.com/systems/support/storage/ssic Table 36.
External backup units The server supports the external backup attachment options listed in the following table. Table 37.
Top-of-rack Ethernet switches The server supports the top-of-rack Ethernet switches from Lenovo listed in the following table. Table 38.
Additional edge switches are offered as part of the Intelligent Cluster program, as listed in the following table. Table 39.
Uninterruptible power supply units The server supports attachments to the uninterruptible power supply (UPS) units that are listed in the following table. Table 40. Uninterruptible power supply units Part number Description Rack-mounted or tower UPS units 55941AX RT1.5kVA 2U Rack or Tower UPS (100-125VAC) 55941KX RT1.5kVA 2U Rack or Tower UPS (200-240VAC) 55942AX RT2.2kVA 2U Rack or Tower UPS (100-125VAC) 55942KX RT2.
Power distribution units The server supports attachments to the power distribution units (PDUs) that are listed in the following table. Table 41.
Table 41.
Lenovo Financial Services Lenovo Financial Services reinforces Lenovo’s commitment to deliver pioneering products and services that are recognized for their quality, excellence, and trustworthiness. Lenovo Financial Services offers financing solutions and services that complement your technology solution anywhere in the world.
Related publications and links For more information, see these resources: U.S. Announcement Letter for NeXtScale PCIe Native Expansion Tray http://ibm.com/common/ssi/cgi-bin/ssialias?infotype=dd&subtype=ca&&htmlfid=897/ENUS114-063 U.S. Announcement Letter for NeXtScale Storage Native Expansion Tray http://ibm.com/common/ssi/cgi-bin/ssialias?infotype=dd&subtype=ca&&htmlfid=897/ENUS113-219 U.S. Announcement Letter for NeXtScale System http://ibm.
Notices Lenovo may not offer the products, services, or features discussed in this document in all countries. Consult your local Lenovo representative for information on the products and services currently available in your area. Any reference to a Lenovo product, program, or service is not intended to state or imply that only that Lenovo product, program, or service may be used.
This document was created or updated on February 17, 2015. Send us your comments in one of the following ways: Use the online Contact us review form found at: ibm.com/redbooks Send your comments in an e-mail to: redbooks@us.ibm.com This document is available online at http://www.ibm.com/redbooks/abstracts/tips1051.html . Trademarks Lenovo, For Those Who Do and the Lenovo logo are trademarks or registered trademarks of Lenovo in the United States, other countries, or both.