iSeries. mySeries. Common Europe Luxembourg Introducing IBM eServer i5 & i5/OS LPAR i5 “Up-to-Date” : Logical Partitions on the IBM Power5 by Eddy PASTEGER iSeries. mySeries.
iSeries. mySeries. Logical Partitions on the IBM Power5 Introduction iSeries. mySeries. 3 Introduction Objectives Understand the LPAR functionality as implemented on the IBM Power5 servers Understand planning considerations and system requirements Warning This presentation is built on functionalities available on i5 models 5xx running i5/OS V5R3 iSeries. mySeries.
Logical Partitioning on the IBM Power5 Agenda Chapter Chapter Chapter Chapter Chapter Chapter 1. 2. 3. 4. 5. 6. Architecture Resources Management Concepts LPAR-Capable i5 Models Planning Hardware Management Console Virtual Partition Manager iSeries. mySeries. 5 iSeries. mySeries. Logical Partitions on the IBM Power5 Architecture iSeries. mySeries.
Architecture HMC Service Processor Processor Complex Main Storage I/O Subsystem NVRAM Permanent Temporary The Service Processor Standard built-in, independent component of every eServer i5 or p5 Own processor, memory and boot code NVRAM stores the “firmware” and the LPAR configuration iSeries. mySeries. 7 Architecture HMC Service Processor Processor Complex Main Storage I/O Subsystem NVRAM Permanent Temporary The Service Processor (aka SP) Once main power is connected ...
Architecture P1 P2 P3 P4 Power Hypervisor HMC Service Processor Processor Complex Main Storage I/O Subsystem The Service Processor (aka SP) Once you power on the system ...
Architecture The Power Hypervisor Functions Virtual processor support Allocation of physical processor time to partition thru “virtual processors” Virtual memory management Virtual hardware support Allocation of physical memory to partition thru “virtual memory” Processors OptiConnect SCSI Ethernet Serial Security an isolation between partition Partition allowed to access only to their allocated resources Enforced by the Power Hypervisor Reinitializes proc
Architecture i5/OS TIMI Linux AIX Open Firmware Open Firmware RTAS RTAS P2 P3 SLIC P1 P4 Power Hypervisor HMC Hardware Starting a LINUX or AIX partition Hypervisor will operates ... Open Firmware contains boot-time drivers and the boot manager RTAS is a service that passes platform-dependent system calls to the Hypervisor Other is characteristic to the guest operating system E.g. Linux has a “monolithic” kernel, while AIX has a “microkernel-hybrid” structure iSeries.
iSeries. mySeries. Logical Partitions on the IBM Power5 Resources Management Concepts iSeries. mySeries. 15 Resources Management Concepts What is “logical partitioning” ? The ability to make a single server run as if it were many independent systems Each logical system is called a “Partition” Each partition operates as an independent system Each partition will receive a portion of the system resources : Processor Memory I/O slots Virtual I/O slots iSeries. mySeries.
iSeries. mySeries. Logical Partitions on the IBM Power5 Resources Management Concepts Processor iSeries. mySeries. 17 Resources Management Concepts Processor Concepts Dedicated vs. Shared Processors Virtual Processors Capped vs. Uncapped Processors Considerations about LPAR and SMT iSeries. mySeries.
Processor Concepts Processor Concepts P1 P2 Dedicated P3 Shared Inactive Physical Processors iSeries. mySeries.
Processor Concepts Shared Processors A “shared processor” allows to assign partial processors to a partition Physical processors lives in a “shared processor pool” By default, any unassigned processor is a member of the shared processor pool iSeries. mySeries. 21 Processor Concepts Shared Processors 10 milliseconds 20 milliseconds of processor time P1 P2 P3 iSeries. mySeries.
Processor Concepts Shared Processors 10 milliseconds 20 milliseconds of processor time P1 P2 P3 iSeries. mySeries. 23 Processor Concepts Shared Processors Rules & requirements : A processing unit (PU) represents the cycles of a single processor At least 0.10 PU (1 millisecond) Granularity of movements : 0.01 PU Processor moves are dynamic, without any IPL within the configured ranges Unallocated PU are not used iSeries. mySeries.
Processor Concepts Potential Shared Processors Penalty Increase the possibility that job’s won’t complete, and : Have to be re-dispatched, and potentially have to reload cache Increase the chance of a cache miss Reduce the chance for processor/memory affinity Increase the Power Hypervisor work : Tracking each partition use of its allocated milliseconds iSeries. mySeries.
Processor Concepts Virtual Processors 10 milliseconds 20 milliseconds of processor time P1 P2 P3 iSeries. mySeries. 27 Processor Concepts Virtual Processors 10 milliseconds 20 milliseconds of processor time P1 P2 P3 iSeries. mySeries.
Processor Concepts Virtual Processors Rules & requirements : It is possible to allocate more virtual processors than there are in the shared processor pool The actual number of processor in the shared processor pool is a “floating” number A single physical processor can report in the system as a n-ways You cannot allocate less than 0.10 PU per virtual processor Changes are dynamic, without any IPL within the configured ranges Example : requesting 0.20 PU to run on 4 VCPU means 0.
Processor Concepts Dedicated, Shared, Capped or Uncapped ? How to decide on using : Dedicated or shared processors ? If using shared processors, it is to be capped or uncapped ? And ... how many virtual processors do I allocate ? The best performance may be achieved by using dedicated processors ...
Processor Concepts About Simultaneous Multi-Threading (SMT) SMT is a technology that allows a single CPU to be seen logically as 2 logical CPU Physical processor Logical processors SMT allows 2 threads to run simultaneously on the same processor SMT optimizes the usage of the 7 execution units of a PowerPC processor Hypervisor only deals with physical processors Using different execution units, or “pipes” Each operating system can use the physical processor as its needs SMT
Main Storage Concepts Memory Allocation Facts Power4 Hypervisor allowed memory manipulation at the single megabyte (1MB) level Memory in the Power5 machines cannot be manipulated that finely : Memory must be assigned or moved in blocks Theses blocks are called “Logical Memory Blocks (LMB)” or “Memory Regions” About those “Memory Regions” : LMB are sized in multiples of 16 MB Future implementations will allow use of 16, 32, 64, 128 or 256 MB blocks LMB size is a system-wide param
Main Storage Concepts Memory Allocation Facts A “Hardware Page Table (HPT)” is needed to manage memory Power4 Hypervisor reserved HPT within partition memory Power5 Hypervisor allocates HPT separately from partition memory Size of the HPT depends of the maximum memory amount the partition can receive Basic calculation : maximum memory divided by 64, rounded up to next power of 2 A partition can allocates a maximum of 12 GB (12288 MB) HPT size will be 12288 / 64 = 192 ...
Main Storage Concepts Memory Allocation Facts Power4 Hypervisor allocated memory equally from all nodes This leads to more “remote” memory access Power5 hypervisor tries to do better ... Processors are assigned on the fewest nodes possible Configured memory will be assigned keeping as much memory as possible on the same node The HPT for the partition will be assigned on the same node How becomes memory affinity with dynamic processor/memory moves ? The system will “do its best” .
I/O Concepts I/O Facts I/O allocations are done at slot level A single slot can be allocated I/O structure must be understood for proper configuration ! iSeries. mySeries. 41 I/O Concepts Hierarchy of Microprocessors Main Storage Power5 5 84 /s B G G 44 B/ s System Main Storage Bus G 2 B/ s I/O Hub HSL Loop iSeries. mySeries.
I/O Concepts Hierarchy of Microprocessors G 2 B/ s HSL Loop 3 13 Hz M I/O Bridge PCI-X Bus IOP IOA IOA IOA iSeries. mySeries.
I/O Concepts IOP-Less IOAs CPU IOP CPU IOA IOA iSeries. mySeries.
iSeries. mySeries. Logical Partitions on the IBM Power5 Resources Management Concepts Virtual I/O iSeries. mySeries.
Virtual I/O Concepts Partition Virtual Bus Virtual Slot Virtual Slot Virtual Slot Virtual Slot Virtual IOP Virtual IOA Virtual IOA Virtual IOA Virtual Serial Virtual Ethernet Virtual SCSI Power Hypervisor iSeries. mySeries.
Virtual I/O Concepts Virtual Serial Virtual serial adapter provides point-to-point connection between The partition and the HMC The partition and another partition Purpose Virtual console Virtual terminal Parameters Slot number Adapter type : server or client Connection information : who can connect ... The HMC Any remote partition Selected remote partition iSeries. mySeries.
Virtual I/O Concepts Virtual Ethernet P1 P2 P3 Power Hypervisor Virtual LAN #X Virtual LAN #Y iSeries. mySeries. 53 Virtual I/O Concepts Virtual SCSI Virtual SCSI adapter provides SCSI storage services connection between partitions Purpose Storage virtualization Parameters Slot number Adapter type : server or client Connection information for the server : who can connect ...
Virtual I/O Concepts Virtual SCSI P1 P2 S SCSI Server C Power Hypervisor SCSI Client iSeries. mySeries.
iSeries. mySeries. Logical Partitions on the IBM Power5 Dynamic LPAR ! iSeries. mySeries. 57 Dynamic LPAR What is called “Dynamic Logical Partitioning” The ability to add, move or remove resources without system disruption iSeries. mySeries.
Dynamic LPAR What can be changed dynamically ! Processors Within established minimum and maximum Configuration maintained in the partition profile Changes to minimum or maximum requires partition deactivation an reactivation Granularity of moves Dedicated processors : 1 processor Shared processors : 0.
Dynamic LPAR What can be changed dynamically ! I/O Slots Only “desired” slots can be moved ! Remember i5/OS still needs IOPs An IOP without IOA is functional but not very useful An IOA without IOP is nothing BUS/IOP/IOA requirements must be kept ! Remember “IOP-less” IOAs Ethernet adapters Cryptographic processors ... more in the future : the direction is to get away from the IOP ! iSeries. mySeries.
Dynamic LPAR What can be changed dynamically ! Virtual I/O Slots Can only be filled or emptied Only “desired” slots can be moved ! Cannot be moved from one partition to another Configuration maintained in the partition profile Changes to the desired/required status of a slot requires partition deactivation an reactivation Changes to the number of virtual slots requires partition deactivation and reactivation Granularity of moves One slot iSeries. mySeries. 63 iSeries.
IBM eServer i5/520 Model i5/520 - 1000 CPW Processor : 1-Way Power5, 1.50GHz, L1+L2 Cache Processing units available : 0.43 Maximum partitions : 4 Model i5/520 - 2400 CPW Processor : 1-Way Power5, 1.50GHz, L1+L2 Cache Processing units available : 1.00 Maximum partitions : 10 Model i5/520 - 3300 CPW Processor : 1-Way Power5, 1.65GHz, L1+L2+L3 Cache Processing units available : 1.00 Maximum partitions : 10 Model i5/520 - 6000 CPW Processor : 2-Ways Power5, 1.
IBM eServer i5/570 Model i5/570 - CoD from 3300 to 44700 CPW Minimal Configuration Processor : 1-Ways Power5, 1.65GHz, L1+L2+L3 Cache Processing units available : 1.0 Maximum partitions : 10 Maximal Configuration Processor : 16-Ways Power5, 1.65GHz, L1+L2+L3 Cache Processing units available : 16.0 Maximum partitions : 160 iSeries. mySeries. 67 IBM eServer i5/595 Model i5/595 - CoD from 24500 to 165000 CPW Minimal Configuration Processor : 8-Ways Power5, 1.
iSeries. mySeries. Logical Partitions on the IBM Power5 Planning iSeries. mySeries. 69 Planning Think ... Understand eServer i5 capabilities Review previous chapters ... System Builder ! Understand Operating System requirements i5/OS Linux AIX iSeries. mySeries.
Planning Requirements for i5/OS Are mandatory : At least 0.10 processing unit At least 256 MB of main storage One direct-attach (internal) disk unit (LSU) One console One alternate-IPL device One backup device Commonly represents +/- 330 CPW Just enough to load and start SLIC & i5/OS ... plan a few bit more to open a session ! Minimum size : 8.58 GB Can be a HMC thru virtual serial port DVD or tape unit ... can be switchable or dedicated A tape unit ...
Planning About Linux and AIX ... CPW Commercial Processing Workload Representative for a commercial workload environment Workload composed by CPU and I/O operations rPerf Relative Performance Derived from multiple “standard” benchmarks TPC : Technical Publication Center SPEC : System Performance Evaluation Center Other IBM internal workloads Does not simulate I/O operations iSeries. mySeries. 73 Planning About Linux and AIX ...
Planning Requirements for Linux/AIX 5L v5.3 Are mandatory : At least 0.10 processing unit Some memory ... depending on the applications you’ll have to run ! One disk unit ... One console One alternate boot device One backup device Physical or ... virtual ! Can be a HMC thru virtual serial port CD or DVD ... physical or virtual ! A tape unit ...
Planning Requirements for AIX 5L v5.2 REMEMBER : this version of AIX does NOT SUPPORT “virtual things” ! Virtual processors cannot be used ... Memory cannot be dynamically assigned ... No virtual networks, nor virtual storage can be used Virtual console can be used ! Are mandatory : At least 1 dedicated processor Some memory ...
Planning Know restrictions At this time, Linux/AIX partitions does not handle any IOA with an IOP placed in an upstream position on the same bus ! This means that you cannot share a bus between a Linux/AIX partition and an i5/OS partition This means that you cannot switch a device between a Linux/AIX partition and an i5/OS partition You can switch a device between i5/OS partitions You can switch a device between AIX/Linux partitions iSeries. mySeries.
Planning ... Think ... Make a capacity planning Determine your needs Inventory existing system Build a new system Validate the new system Determine which component may/will be reused Use LPAR Validater Tool Call IBM or a Business Partner Consider to upgrade existing system to supported OS version/release Consider EVERY partition ! Upgrades to i5/OS V5R3 ...
Planning ... Then act ! Backup existing system Twice ! Perform physical installation Install every hardware piece at its planned position Install and configure HMC Power on the new system to “Hypervisor Stand-by” mode Create LPAR definitions Setup wizard ! Start or reload If disk were moved ... just start ! Else ... just reload ! Validate your new system ... and ... enjoy it ! iSeries. mySeries. 83 iSeries. mySeries.
Hardware Management Console What is it ? Hardware dedicated to console functions Used to create and maintain a multiple-partitioned environment Startup & shutdown partitions Performing resource movements Displaying a virtual console Displaying a virtual operator panel Detecting, reporting and sorting change in hardware conditions Gathering and reporting system error events Activating CoD resources Supports i5/OS, Linux and AIX Is it mandatory ? YES, for LPARed systems YES,
iSeries. mySeries. Logical Partitions on the IBM Power5 Hardware Management Console Connecting HMC iSeries. mySeries. 87 Hardware Management Console Service & Support HMC1 HMC2 LAN1 LAN2 HMC ETH0 ETH1 Ethernet Ports Private LAN Open LAN Auto-MDIX ports Medium Dependent Interface Crossover iSeries. mySeries.
Hardware Management Console Service & Support HMC1 HMC2 LAN1 LAN2 HMC ETH0 ETH1 Simple HMC connection iSeries. mySeries. 89 Hardware Management Console HMC Service & Support ETH0 ETH1 HMC1 HMC2 LAN1 LAN2 HMC ETH0 ETH1 Cloning HMC configuration System profiles and partition profiles are stored in SP’s NVRAM When SP detects that a redundant HMC is connected : SP copies NVRAM configuration to the new HMC iSeries. mySeries.
Hardware Management Console Redundant HMC configuration considerations Both HMCs can be used concurrently Both are fully active and accessible at all times Both enabling you to perform management tasks at any time SP provides a lock-mechanism to allow operations in a parallel environment When one HMC issues an order, the other HMC is temporarily “locked-out” There is no “primary” or “backup” designation But ...
Hardware Management Console Private indirect networking HMC Service & Support ETH0 ETH1 HMC1 HMC2 LAN1 LAN2 HMC ETH0 ETH1 HMC1 HMC2 LAN1 LAN2 Private LAN iSeries. mySeries. 93 Hardware Management Console Private and open networking HMC Service & Support ETH0 ETH1 HMC1 HMC2 LAN1 LAN2 HMC ETH0 ETH1 HMC1 HMC2 LAN1 LAN2 Private LAN Open LAN iSeries. mySeries.
Hardware Management Console Working with HMC in open networks C HMC C HMC C S Internet iSeries. mySeries. 95 iSeries. mySeries. Logical Partitions on the IBM Power5 Hardware Management Console HMC Functionalities iSeries. mySeries.
Hardware Management Console Server Management Physical systems Logical partitions System profiles Partition profiles iSeries. mySeries. 97 Hardware Management Console HMC Code Update Gets and install HMC version, releases and hot fixes Via removable media, local FTP server or internet (IBM service FTP server) Backups Critical console data vs. upgrade data iSeries. mySeries.
Licensed Internal Code Updates Manages managed systems’ firmware Installed (Temporary), activated and Accepted (Permanent) iSeries. mySeries. 99 Hardware Management Console HMC Users Define users Define roles iSeries. mySeries.
Hardware Management Console HMC Configuration All HMC parameters Date, time, network, ... iSeries. mySeries. 101 Hardware Management Console Service Agent Configuration Notify problems Kind of problems : “all” or “home-call” To the user : via SMTP To the service : via PSTN, VPN or another HMC iSeries. mySeries.
Hardware Management Console Remote Support Connectivity : outbound and inbound Via SMTP or VPN iSeries. mySeries. 103 Hardware Management Console Service Focal Point Manage reported events and errors Concurrent maintenance Service utilities Access to control panel service functions (e.g. Function 21 - Request DST) iSeries. mySeries.
One more thing ... iSeries. mySeries. 105 iSeries. mySeries. Logical Partitions on the IBM Power5 Virtual Partition Manager iSeries. mySeries.
Virtual Partition Manager What is it ? VPM introduces a way to create and manage Linux partitions without the use of a HMC VPM allows small and medium configuration to add simple Linux workloads Available on May 27th, 2005 (tomorrow) ! iSeries. mySeries. 107 Virtual Partition Manager Planning for VPM ...
Virtual Partition Manager Planning for VPM ...
Questions & Answers iSeries. mySeries. 111 iSeries. mySeries. Logical Partitions on the IBML Power5 Bibliography iSeries. mySeries.
Bibliography Front cover Logical Partitions on the he IBM PowerPC A Guide to Working with LPAR on Power5 i5 Servers Understand the new logical partitions for IBM Power5 architecture Learn how to install, configure, and manage LPAR with the latest HMC Discover how to implement OS/400 logical partitions Dale Barrick Ivan Berrios Ron Carter Ron Frantish Ed Gerwill Marco Guadagno Shashank Jamgavkar Steve Mann Andrei Matetic Alain Plu Ian Smith Nick Harris ibm.com/redbooks iSeries. mySeries.
Bibliography Front cover Virtual Partition Manager ger A Guide to Planning lanning and Implementation Learn about the Virtual Partition Manager (VPM) Review planning guidance for an eServer i5 server with VPM Create partitions and allocate virtual resources with VPM Amit Dave Erwin Earley Nick Harris Fant Steele ibm.com/redbooks Redpaper iSeries. mySeries.
Thank You ! iSeries. mySeries. 117 Contact Information REAL Solutions S.A. Rue d’Eich, 33 L-1461 Luxembourg Eddy Pasteger System Engineer Manager iSeries Certified Solutions Expert Voice : (+352) 43 65 22 1 Fax : (+352) 42 26 38 E-mail : eddy.pasteger@real.lu iSeries. mySeries.
