IBM System z10 Enterprise Class (z10 EC) Reference Guide April 2009
Table of Contents IBM System z10 EnterpriseClass (z10 EC) Overview page 3 z/Architecture page 6 z10 EC page 11 z10 EC Design and Technology page 14 z10 EC Model page 15 z10 EC Performance page 17 z10 EC I/O Subsystem page 18 z10 EC Channels and I/O Connectivity page 19 HiperSockets page 32 Security page 34 Cryptography page 34 On Demand Capabilities page 39 Reliability, Availability, and Serviceability (RAS) page 43 Availability Functions page 44 Environmental Enhancements page
IBM System z10 Enterprise Class (z10 EC) Overview The IBM System z10™ Enterprise Class (z10™ EC) server is The System z10 was introduced with a new connectivity designed to meet the challenges of today’s business world option for LANs – Open Systems Adapter-Express3 (OSA- and to be the cornerstone of an evolutionary new model for Express3). The OSA-Express3 features provide improved ® efficient IT delivery called the Dynamic Infrastructure .
Just-in-time deployment of IT resources With the z10 EC, it is now possible to add permanent Infrastructures must be more flexible to changing capacity capacity while a temporary capacity is currently activated, requirements and provide users with just-in-time deploy- without having to return first to the original configuration. ment of resources.
In order of introduction: The System z10 Integrated Information Processor (zIIP) is The Internal Coupling Facility (ICF) processor was intro- designed to support select data and transaction process- duced to help cut the cost of Coupling Facility functions ing and network workloads and thereby make the consoli- by reducing the need for an external Coupling Facility. dation of these workloads on to the System z platform more IBM System z Parallel Sysplex® technology allows for cost effective.
z/Architecture point operations. This is expected to be particularly useful The z10 EC continues the line of upward compatible main- for the calculations involved in many financial transactions. frame processors and retains application compatibility since 1964. The z10 EC supports all z/Architecture-compli- Decimal calculations are often used in financial applica- ant Operating Systems.
• Improved total cost of ownership. zIIP-Assisted The z10 EC is also able to exploit numerous operating systems concurrently on a single server, these include z/OS, HiperSockets for Large Messages, IBM Scalable z/VM, z/VSE, z/TPF, TPF and Linux for System z.
Commitment to system integrity With z/OS 1.9, IBM introduces: First issued in 1973, IBM’s MVS™ System Integrity State- • A revised and expanded Statement of z/OS System ment and subsequent statements for OS/390® and z/OS Integrity stand as a symbol of IBM’s confidence and commitment to • Large Page Support (1 MB) the z/OS operating system. Today, IBM reaffirms its com- • Capacity Provisioning mitment to z/OS system integrity.
z/VM SSL server now operates in a CMS environment, instead of z/VM V5.4 is designed to extend its System z virtualization requiring a Linux distribution, thus allowing encryption ser- technology leadership by exploiting more capabilities of vices to be deployed more quickly and helping to simplify System z servers including: installation, service, and release-to-release migration.
z/VSE z/TPF z/VSE 4.1, the latest advance in the ongoing evolution of z/TPF is a 64-bit operating system that allows you to move VSE, is designed to help address needs of VSE clients legacy applications into an open development environ- with growing core VSE workloads and/or those who wish ment, leveraging large scale memory spaces for increased to exploit Linux on System z for new, Web-based business speed, diagnostics and functionality.
z10 EC Operating System ESA/390 (31-bit) z/Architecture (64-bit) No Yes z/OS V1R7 with BM Lifecycle Extension for z/OS V1.
of your business. With the potential for increased perfor- For LAN connectivity, z10 EC provides a OSA-Express3 mance and capacity, you have an opportunity to continue 2-port 10 Gigabit Ethernet (GbE) Long Reach feature along to consolidate diverse applications on a single platform. with the OSA-Express3 Gigabit Ethernet SX and LX with The z10 EC is designed to provide up 1.7 times the total four ports per features.
z10 EC preplanning improvements are designed to avoid The z10 EC processor introduces IBM System z10 planned outages and include: Enterprise Class with Quad Core technology, advanced pipeline design and enhanced performance on CPU inten- • Flexible Customer Initiated Upgrades sive workloads. The z10 EC is specifically designed and • Enhanced Driver Maintenance optimized for full z/Architecture compatibility.
z10 EC Design and Technology The System z10 EC is designed to provide balanced The design of the MCM technology on the z10 EC pro- system performance. From processor storage to the vides the flexibility to configure the PUs for different uses; system’s I/O and network channels, end-to-end bandwidth there are two spares and up to 11 System Assist Proces- is provided and designed to deliver data where and when sors (SAPs) standard per system. The remaining inactive it is needed.
z10 EC Model The z10 EC has been designed to offer high performance The z10 EC has five models offering between 1 to 64 pro- and efficient I/O structure. All z10 EC models ship with two cessor units (PUs), which can be configured to provide frames: an A-Frame and a Z-Frame, which together sup- a highly scalable solution designed to meet the needs port the installation of up to three I/O cages.
z10 EC Base and Sub-capacity Offerings number will be reported by the Store System Information (STSI) instruction for software billing purposes only. There is no affinity between the hardware model and the number of CPs. For example, it is possible to have a Model E26 which has 13 PUs characterized as CPs, so for software billing purposes, the STSI instruction would report 713. z10 EC model upgrades There are full upgrades within the z10 EC models and upgrades from any z9 EC or z990 to any z10 EC.
z10 EC Performance The performance design of the z/Architecture can enable may experience will vary depending upon considerations the server to support a new standard of performance for such as the amount of multiprogramming in the user’s job applications through expanding upon a balanced system stream, the I/O configuration, and the workload processed. approach.
z10 EC I/O Subsystem The z10 EC contains an I/O subsystem infrastructure system hardware administrator access to the information which uses an I/O cage that provides 28 I/O slots and from these many sources in one place. This will make it the ability to have one to three I/O cages delivering a much easier to manage I/O configurations, particularly total of 84 I/O slots. ESCON, FICON Express4, FICON across multiple CPCs. The SIOA is a “view-only” tool.
z10 EC Channels and I/O Connectivity ESCON Channels FICON Express4 Channels The z10 EC supports up to 1,024 ESCON channels. The The z10 EC supports up to 336 FICON Express4 channels, high density ESCON feature has 16 ports, 15 of which can each one operating at 1, 2 or 4 Gb/sec auto-negotiated. be activated for customer use.
– any combination of FICON Express4, FICON Express2 Continued Support of Spanned Channels and Logical Partitions and FICON Express LX and SX features. The FICON Express4 and FICON Express2, FICON and The System z10 EC Model E12 is limited to 64 features FCP (CHPID types FC and FCP) channel types, can be The FICON Express4, FICON Express2 and FICON defined as a spanned channel and can be shared among Express feature conforms to the Fibre Connection (FICON) logical partitions within and across LCSSs.
FICON Support for Cascaded Directors usage including install and IPL. Support for FCP devices Native FICON (FC) channels support cascaded directors. means that z10 EC servers are capable of attaching to This support is for a single hop configuration only. Two- select FCP-attached SCSI devices and may access these director cascading requires a single vendor high integrity devices from Linux on z10 EC and z/VSE. This expanded fabric.
SCSI IPL now a base function The maximum number of I/Os is designed to be improved The SCSI Initial Program Load (IPL) enablement feature, up to 100% for small data transfers that can exploit zHPF. first introduced on z990 in October of 2003, is no longer Realistic production workloads with a mix of data transfer required. The function is now delivered as a part of the sizes can see up to 30 to 70% of FICON I/Os utilizing zHPF server Licensed Internal Code.
It will register: The tool needs to know the FCP-specific I/O device defini- • Platform’s: tions in the form of a .csv file. This file can either be cre- – Worldwide node name (node name for the platform same for all channels) ated manually, or exported from Hardware Configuration – Platform type (host computer) The tool will then create the WWPN assignments, which – Platform name (includes vendor ID, product ID, and vendor specific data from the node descriptor) are required to set up your SAN.
The requirements for channel extension equipment are utilization due to fewer hardware requirements, and can simplified with the increased number of commands in reduce the complexity of physical FCP I/O connectivity. flight. This may benefit z/OS Global Mirror (Extended Remote Copy – XRC) applications as the channel exten- Program Directed re-IPL sion kit is no longer required to simulate specific channel Program Directed re-IPL is designed to enable an operat- commands.
Choose the OSA-Express3 features that best meet your The above statements are based on OSA-Express3 perfor- business requirements. mance measurements performed in a laboratory environment on a System z10 and do not represent actual field To meet the demands of your applications, provide granu- measurements. Results may vary. larity, facilitate redundant paths, and satisfy your infrastructure requirements, there are five features from which to choose.
Medium Access Control (MAC) address. onto System z10. With reduced latency, improved through- – QDIO Layer 3 (Network or IP layer) – for IP workloads. Packet forwarding decisions are based upon the IP address. All guests share OSA’s MAC address. put, and up to 96 ports of LAN connectivity, (when all are 4-port features, 24 features per server), you can “do more with less.
There are two PCIe adapters per feature. OSA-Express3 ports attachment to a one Gigabit per second (Gbps) Eth- 10 GbE LR is designed to support attachment to a 10 ernet Local Area Network (LAN). OSA-Express3 GbE SX Gigabits per second (Gbps) Ethernet Local Area Network supports CHPID types OSD and OSN. It can be defined (LAN) or Ethernet switch capable of 10 Gbps. OSA- as a spanned channel and can be shared among LPARs Express3 10 GbE LR supports CHPID type OSD exclu- within and across LCSSs.
When configured at 1 Gbps, the 1000BASE-T Ethernet fea- Virtual Switch OSA-Express QDIO connection is to be non- ture operates in full duplex mode only and supports jumbo isolated (default) or isolated. frames when in QDIO mode (CHPID type OSD). QDIO data connection isolation applies to the device statement defined at the operating system level.
• Ability to dynamically add/remove OSA ports for “on For latency sensitive applications, the blocking algo- demand” bandwidth rithm is modified to be “latency sensitive.” For streaming (throughput sensitive) applications, the blocking algorithm • Full-duplex mode (send and receive) is adjusted to maximize throughput.
Layer 2 transport mode is supported by z/VM and Linux on Hardware data router System z. With OSA-Express3, much of what was previously done in firmware (packet construction, inspection, and routing) is OSA Layer 3 Virtual MAC for z/OS now performed in hardware. This allows packets to flow To simplify the infrastructure and to facilitate load balanc- directly from host memory to the LAN without firmware ing when an LPAR is sharing the same OSA Media Access intervention.
OSA-Express for NCP, supporting the channel data link With the OSA-Express3 and OSA-Express2 1000BASE-T control (CDLC) protocol, provides connectivity between Ethernet features, the OSA-ICC is configured on a port by System z operating systems and IBM Communication Con- port basis, using the Channel Path Identifier (CHPID) type troller for Linux (CCL). CCL allows you to keep your busi- OSC.
HiperSockets The HiperSockets function, also known as internal Queued with Layer 2 and Layer 3 with Layer 3). A Layer 2 device Direct Input/Output (iDQIO) or internal QDIO, is an inte- cannot communicate directly with a Layer 3 device in grated function of the z10 EC server that provides users another LPAR.
A solution is HiperSockets Multiple Write Facility. HiperSockets Enhancement for zIIP Exploitation HiperSockets performance has been enhanced to allow In z/OS V1.10, specifically, the z/OS Communications for the streaming of bulk data over a HiperSockets link Server allows the HiperSockets Multiple Write Facility between logical partitions (LPARs).
Security Cryptography Today’s world mandates that your systems are secure and The z10 EC includes both standard cryptographic hard- available 24/7. The z10 EC employs some of the most ware and optional cryptographic features for flexibility and advanced security technologies in the industry—helping growth capability.
Enhancements to CP Assist for Cryptographic Function (CPACF): Crypto Express2 Accelerator – for Secure Sockets Layer CPACF has been enhanced to include support of the fol- (SSL) acceleration: lowing on CPs and IFLs: • Is designed to support clear-key RSA operations • Advanced Encryption Standard (AES) for 192-bit keys • Offloads compute-intensive RSA public-key and private- and 256-bit keys key cryptographic operations employed in the SSL pro- • SHA-384 and SHA-512 bit for message digest tocol Cr
Support for ISO 16609 Secure Key AES Support for ISO 16609 CBC Mode T-DES Message The Advanced Encryption Standard (AES) is a National Authentication (MAC) requirements ISO 16609 CBC Mode Institute of Standards and Technology specification for the T-DES MAC is accessible through ICSF function calls encryption of electronic data.
TKE 5.3 workstation and continued support for Smart Card TKE 5.3 LIC has added the capability to store key parts Reader on DVD-RAMs and continues to support the ability to store The Trusted Key Entry (TKE) workstation and the TKE key parts on paper, or optionally on a smart card. TKE 5.3 5.3 level of Licensed Internal Code are optional features LIC has limited the use of floppy diskettes to read-only. on the System z10 EC. The TKE 5.3 Licensed Internal The TKE 5.
Typically, a new ATM has none of the financial institution’s Improved Key Exchange With Non-CCA Cryptographic Systems keys installed. Remote Key Loading refers to the pro- IBM Common Cryptographic Architecture (CCA) employs cess of loading Data Encryption Standard (DES) keys to Control Vectors to control usage of cryptographic keys.
On Demand Capabilities It may sound revolutionary, but it’s really quite simple. In ing contracts for Capacity Back Up (CBU) and Customer the highly unpredictable world of On Demand business, Initiated Upgrade (CIU) – On/Off Capacity on Demand you should get what you need, when you need it. And you (On/Off CoD) may carry those contracts forward to z10 EC should pay for only what you use. Radical? Not to IBM.
Capacity Back Up (CBU): Temporary access to dormant While all new CBU contract documents contain the new processing units (PUs), intended to replace capacity lost CBU Test terms, existing CBU customers will need to exe- within the enterprise due to a disaster.
• The quantity of temporary IFLs ordered is limited by how many tokens go into each pool. Once On/Off CoD quantity of purchased IFLs (permanently active plus resources are activated, tokens will be decremented from unassigned). their pools every 24 hours. The amount decremented is • Temporary use of unassigned CP capacity or unas- based on the highest activation level for that engine type signed IFLs will not incur a hardware charge. during the previous 24 hours.
z/OS Capacity provisioning allows you to set up rules Capacity on Demand – Permanent Capacity defining the circumstances under which additional capac- Customer Initiated Upgrade (CIU) facility: When your ity should be provisioned in order to fulfill a specific busi- business needs additional capacity quickly, Customer ness need. The rules are based on criteria, such as: a Initiated Upgrade (CIU) is designed to deliver it.
Reliability, Availability, and Serviceability (RAS) In today’s on demand environment, downtime is not only RAS Design Focus unwelcome—it’s costly. If your applications aren’t consis- High Availability (HA) – The attribute of a system tently available, your business suffers.
Availability Functions With the z10 EC, significant steps have been taken in the Enhanced Book Availability area of server availability with a focus on reducing pre- With proper planning, z10 EC is designed to allow a planning requirements. Pre-planning requirements are min- single book, in a multi-book server, to be non-disrup- imized by delivering and reserving 16 GB for HSA so the tively removed from the server and re-installed during an maximum configuration capabilities can be exploited.
Concurrent Physical Memory Upgrade ment of an HCA2-C fanout card or book, the z10 EC is Allows one or more physical memory cards on a single designed to provide access to your I/O devices through book to be added, or an existing card to be upgraded another InfiniBand Multiplexer (IFB-MP) to the affected I/O increasing the amount of physical memory in the system. domains. This is exclusive to System z10 EC and z9 EC.
and provide the clock signal to the system transparently, Auto-Switchover for Support Element (SE): The z10 with no system outage. Previously, in the event of a failure EC has two Support Elements. In the event of failure on of the active oscillator, a system outage would occur, the the Primary SE, the switchover to the backup is handled subsequent system Power On Reset (POR) would select automatically. There is no need for any intervention by the the backup, and the system would resume operation.
Environmental Enhancements memory activation feature. One pre-planned memory acti- Power and cooling discussions have entered the budget vation feature is required for each preplanned memory fea- planning of every IT environment. As energy prices have ture. You now have the flexibility to activate memory to any risen and utilities have restricted the amount of power logical size offered between the starting and target size.
Parallel Sysplex Cluster Technology IBM Systems Director Active Energy Manager Parallel Sysplex clustering is designed to bring the power ™ IBM Systems Director Active Energy Manager (AEM) is a of parallel processing to business-critical System z10, building block which enables customers to manage actual System z9, z990 or z890 applications.
be dynamically routed to the z/OS image most capable of List notification improvements: Prior to CFCC Level 16, handling the work. This dynamic workload balancing, along when a shared queue (subsidiary list) changed state from with the capability to have read/write access data from any- empty to non-empty, the CF would notify ALL active con- where in the Parallel Sysplex cluster, provides scalability nectors. The first one to respond would process the new and availability.
Coupling Facility Configuration Alternatives ing enhancements described previously in the section titled IBM offers multiple options for configuring a functioning “Coupling Facility Control Code (CFCC) Level 16”. Coupling Facility: • Standalone Coupling Facility: The standalone CF provides the most “robust” CF capability, as the CPC is wholly dedicated to running the CFCC microcode — all of the processors, links and memory are for CF use only.
Introducing long reach InfiniBand coupling links The IBM System z10 EC will support up to 32 PSIFB links Now, InfiniBand can be used for Parallel Sysplex coupling as compared to 16 PSIFB links on System z9 servers. For and STP communication at unrepeated distances up to either z10 EC or z9, there must be less than or equal to a 10 km (6.2 miles) and greater distances when attached to total of 32 PSIFBs and ICB-4 links. qualified optical networking solutions.
z10 Coupling Link Options System z now supports 12x InfiniBand single data rate (12x IB-SDR) coupling link attachment between System Type Description Use z10 and System z9 general purpose (no longer limited to Link data rate Distance standalone coupling facility) 5. InterSystem Channel-3 (ISC-3) supports communica- PSIFB 1x IB-DDR LR z10 to z10 5 Gbps tion at unrepeated distances up to 10 km (6.2 miles) z10 BC z10 EC Max z10 Max 10 km unrepeated 12*/32* (6.
Time synchronization and time accuracy on z10 EC Server Time Protocol (STP) If you require time synchronization across multiple servers STP is a message-based protocol in which timekeeping (for example you have a Parallel Sysplex environment) or information is transmitted between servers over externally you require time accuracy either for one or more System defined coupling links.
The following STP enhancements are available on System In comparison, the IBM Sysplex Timer is designed to z10 and System z9 servers. maintain an accuracy of 100 microseconds when attached to an ETS with a PPS output. If STP is configured to use The STP feature and the latest Machine Change Levels are a dial-out time service or an NTP server without PPS, it is required. designed to provide a time accuracy of 100 milliseconds to the ETS device.
always accepted by some environments. The STP design z server, STP now has the capability of receiving notifica- provides continuous availability of ETS while maintaining tion that customer power has failed and that the IBF is the special roles of PTS and BTS assigned by the enter- engaged. When STP receives this notification from a server prise.
Prior to this enhancement, the PTS, BTS, and Arbiter roles Message Time Ordering (Sysplex Timer Connectivity to Coupling had to be reassigned manually using the System (Sysplex) Facilities) Time task on the HMC. For additional details on the API, As processor and Coupling Facility link technologies have please refer to System z Application Programming Inter- improved, the requirement for time synchronization toler- faces, SB10-7030-11.
HMC System Support The new functions available on the Hardware Management HMC/SE support is addressing the following requirements: Console (HMC) version 2.10.1 apply exclusively to System • The availability of addresses in the IPv4 address space z10. However, the HMC version 2.10.1 will continue to sup- is becoming increasingly scarce port System z9, zSeries, and S/390® G5/G6 servers. • The demand for IPv6 support is high in Asia/Pacific countries since many companies are deploying IPv6 The 2.10.
local and remote users permitting interactive plain-text HMC DVD drive. This new function does not require an communication between two users and also allowing a external network connection between z/VM and the HMC, user to broadcast a plain-text message to all users. This but instead uses the existing communication path between feature is a limited messenger application and does not the HMC and the SE. interact with other messengers.
Implementation Services for Parallel Sysplex IBM Implementation Services for Parallel Sysplex CICS and This DB2 data sharing service is designed for clients who WAS Enablement want to: IBM Implementation Services for Parallel Sysplex Middle- 1) Enhance the availability of data ware – CICS enablement consists of five fixed-price and 2) Enable applications to take full utilization of all servers’ fixed-scope selectable modules: resources 3) Share application system resources to meet business 1) CICS
Fiber Quick Connect for FICON LX Environments System z servers. Now Geographically Dispersed Open Fiber Quick Connect (FQC), an optional feature on z10 EC, Clusters (GDOC) is designed to address this need for is now being offered for all FICON LX (single mode fiber) open systems. GDPS 3.5 will support GDOC for coordi- channels, in addition to the current support for ESCON.
z10 EC Physical Characteristics z10 EC Configuration Detail z10 EC Environmentals Features Model 1 I/O Cage 2 I/O Cage 3 I/O Cage E12 9.70 kW 13.26 kW 13.50 kW E26 13.77 kW 17.51 kW 21.17 kW E40 16.92 kW 20.66 kW 24.40 kW E56 19.55 kW 23.29 kW 27.00 kW E64 19.55 kW 23.29 kW 27.50 kW Model 1 I/O Cage 2 I/O Cage 3 I/O Cage E12 33.1 kBTU/hr 46.0 kBTU/hr 46.0 kBTU/hr E26 47.7 kBTU/hr 61.0 kBTU/hr 73.7 kBTU/hr E40 58.8 kBTU/hr 72.0 kBTU/hr 84.9 kBTU/hr E56 67.
Coupling Links Processor Unit Features Model Books Links CPs IFLs zAAPs ICFs Standard Standard uIFLs zIIPs SAP Spares E12 1/17 0-12 0-12 0-11 0-6 0-6 0-12 3 2 E26 2/34 0-26 0-26 0-25 0-13 0-13 0-16 6 2 E40 3/51 0-40 0-40 0-39 0-20 0-20 0-16 9 2 E56 4/68 0-56 0-56 0-55 0-28 0-28 0-16 10 2 E64 4/77 0-64 0-64 0-63 0-32 0-32 0-16 11 2 PSIFB 0-32* 0-16* Except E64 ISC-3 IC Max Links 0-48 0-32 Total External + Internal Links = 64 * Maximum of 32 IFB + ICB-4 link
z10 EC Frame and I/O Configuration Content: Planning for I/O The following diagrams show the capability and flexibility built into the I/O subsystem. All machines are shipped with two frames, the A-Frame and the Z-Frame, and can have between one and three I/O cages. Each I/O cage has 28 I/O slots.
Coupling Facility – CF Level of Support CF Level Function z10 EC z10 BC z9 EC z9 BC z990 z890 16 CF Duplexing Enhancements List Notification Improvements Structure Size increment increase from 512 MB –> 1 MB X 15 Increasing the allowable tasks in the CF from 48 to 112 14 CFCC Dispatcher Enhancements X X 13 DB2 Castout Performance X X 12 z990 Compatibility 64-bit CFCC Addressability Message Time Ordering DB2 Performance SM Duplexing Support for zSeries X X X X X X 11 z990 Compatibilit
Statement of Direction IBM intends to support optional water cooling on future one, in which the following Statement of Direction was high end System z servers. This cooling technology will made: IBM intends to remove the Dynamic ICF expansion tap into building chilled water that already exists within the function from future System z servers. datacenter for computer room air conditioning systems. External chillers or special water conditioning will not be required.
Publications The following Redbook publications are available now: Physical Layer SA23-0395 z10 EC Technical Overview ESCON and FICON CTC Reference SB10-7034 SG24-7515 ESCON I/O Interface Physical Layer SA23-0394 z10 EC Technical Guide SG24-7516 FICON I/O Interface Physical Layer z10 EC Capacity on Demand SG24-7504 SA24-7172 Getting Started with InfiniBand on z10 EC and System z9 SG24-7539 Hardware Management Console Operations Guide (V2.10.
© Copyright IBM Corporation 2009 IBM Systems and Technology Group Route 100 Somers, NY 10589 U.S.A Produced in the United States of America, 04-09 All Rights Reserved References in this publication to IBM products or services do not imply that IBM intends to make them available in every country in which IBM operates. Consult your local IBM business contact for information on the products, features, and services available in your area.
