Front cover Draft Document for Review January 29, 2013 12:52 pmSG24-8068-00 IBM Flex System V7000 Storage Node Introduction and Implementation Guide Introduction to IBM Flex System Family IBM Flex System V7000 Storage Node Hardware Introduction Host Configuration Guide Sangam Racherla Eva Ho Carsten Larsen Kim Serup John Sexton Mansoor Syed Alexander Watson ibm.
Draft Document for Review January 29, 2013 12:52 pm 8068edno.
8068edno.fm Draft Document for Review January 29, 2013 12:52 pm Note: Before using this information and the product it supports, read the information in “Notices” on page ix. First Edition (June 2012) This edition applies to IBM Flex System V7000 Storage Node Version 6.4. This document was created or updated on January 29, 2013. Note: This book is based on a pre-GA version of a product and some of the features discussed in this book may change when the product becomes generally available.
Draft Document for Review January 29, 2013 12:52 pm 8068TOC.fm Contents Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix Trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .x Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
8068TOC.fm IBM Confidential Draft Document for Review January 29, 2013 12:52 pm 2.4.2 Expansion canister . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.4.3 Supported disk drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.4.4 IBM Storwize V7000 expansion enclosure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.4.5 SAS cabling requirements . . . . . . . . . . . . . . . . . . . . . . . . . .
Draft Document for Review January 29, 2013 12:52 pm 8068TOC.fm 3.3.7 Managing storage using IBM Flex System Manager . . . . . . . . . . . . . . . . . . . . . 139 Chapter 4. IBM Flex System V7000 Storage Node Initial Configuration . . . . . . . . . . 4.1 Planning Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.1.1 Hardware Planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4.1.
068TOC.fm vi IBM Confidential Draft Document for Review January 29, 2013 12:52 pm 5.7.4 Remote Copy and the Partnerships . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5.8 Access menu. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5.8.1 Users menu. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5.8.2 Audit Log menu . . . . . . . . . . . . . . . . . . . . . . . .
Draft Document for Review January 29, 2013 12:52 pm 8068TOC.fm 9.2.5 Managing FlashCopy mapping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.3 Remote Copy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.3.1 Remote Copy concepts. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9.3.2 Global Mirror with Change Volumes . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
8068TOC.fm viii IBM Confidential Draft Document for Review January 29, 2013 12:52 pm 12.5.4 Installing the 2145 host attachment support package. . . . . . . . . . . . . . . . . . . . 12.5.5 Subsystem Device Driver Path Control Module . . . . . . . . . . . . . . . . . . . . . . . . 12.6 Linux host attachment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12.6.1 Linux Fibre Channel attachment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Draft Document for Review January 29, 2013 12:52 pm 8068spec.fm Notices This information was developed for products and services offered in the U.S.A. IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area.
8068spec.fm Draft Document for Review January 29, 2013 12:52 pm Trademarks IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. These and other IBM trademarked terms are marked on their first occurrence in this information with the appropriate symbol (® or ™), indicating US registered or common law trademarks owned by IBM at the time this information was published.
Draft Document for Review January 29, 2013 12:52 pm 8068pref.fm Preface IBM® Flex System™ products are ideally suited for data center environments that require flexible, cost-effective, secure, and energy-efficient hardware.The IBM Flex System V7000 Storage Node is the latest addition to the IBM Flex Systems product family and is a modular storage system designed to fit into the IBM Flex System Enterprise chassis.
8068pref.fm Draft Document for Review January 29, 2013 12:52 pm certification: Master Certified Systems Engineer (MASE). While working for IBM, Carsten has obtained Brocade BCFP and BCSD certifications as well as NetApp NCDA and NCIE certifications. Carsten is the author of a number of IBM Redbooks related to these product certifications. Kim Serup is an IT Specialist at STG Lab Services, Copenhagen Denmark and has been with IBM since 1998.
Draft Document for Review January 29, 2013 12:52 pm 8068pref.fm John Fasano Karen Brown Bill Wiegand Andrew Martin Dan Braden IBM Now you can become a published author, too! Here’s an opportunity to spotlight your skills, grow your career, and become a published author—all at the same time! Join an ITSO residency project and help write a book in your area of expertise, while honing your experience using leading-edge technologies.
8068pref.fm Draft Document for Review January 29, 2013 12:52 pm Explore new Redbooks publications, residencies, and workshops with the IBM Redbooks weekly newsletter: https://www.redbooks.ibm.com/Redbooks.nsf/subscribe?OpenForm Stay current on recent Redbooks publications with RSS Feeds: http://www.redbooks.ibm.com/rss.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm 1 Chapter 1. Introduction to IBM Flex Systems and IBM PureSystems offerings This chapter provides an overview of the IBM PureSystems offerings and how the IBM Flex System V7000 Storage Node adds to a cloud ready solution within a single IBM Flex System Enterprise Chassis. Such a solution consists of Compute Nodes, Storage Systems and LANand SAN-infrastructure that connects it all together.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm 1.1 IBM PureSystems overview During the last 100 years, information technology has moved from a specialized tool to a pervasive influence on nearly every aspect of life. From tabulating machines that simply counted with mechanical switches or vacuum tubes to the first programmable computers, IBM has been a part of this growth, while always helping customers to solve problems.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm 1.1.1 Product names The primary product names for the IBM PureSystems components are as follows: IBM PureSystems – The overall name for IBMs new family of expert integrated systems.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm – IBM Storwize V7000 Unified is like the IBM Storwize V7000 a disk system that provides internal storage and external virtualization. However the IBM Storwize V7000 Unified also has file modules that provides NAS functionality like the CIFS and NFS protocols.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm customers interested in a system that delivers the simplicity of an integrated solution but that also want control over tuning middleware and the run-time environment. IBM PureFlex System recommends workload placement based on virtual machine compatibility and resource availability.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm The components of the PureFlex System are summarized in Table 1-1.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm Note: IBM Flex System V7000 Storage Node is currently not offered in IBM PureApplication Systems. Currently the only available storage for IBM PureApplication Systems is IBM Storwize V7000. With the IBM PureApplication System, you can provision your own patterns of software, middleware and virtual system resources.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm Table 1-2 IBM PureApplication System configurations IBM PureApplication System W1500-96 IBM PureApplication System W1500-192 IBM PureApplication System W1500-384 IBM PureApplication System W1500-608 Cores 96 192 384 608 RAM 1.5 TB 3.1 TB 6.1 TB 9.7 TB SSD Storage 6.4 TB HDD Storage 48.0 TB Application Services Entitlement Included For more details about IBM PureApplication System, see http://ibm.com/expert 1.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm Figure 1-3 IBM PureFlex System Building Bocks Storage components The storage capabilities of IBM Flex System allows you to gain advanced functionality with storage nodes in your system while taking advantage of your existing storage infrastructure through advanced virtualization. For early versions of the IBM Flex System the only integrated storage was the IBM Storwize V7000 that was external to the IBM Flex System Enterprise Chassis.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm We now review the various components of the IBM Flex System in order to understand how the IBM Flex System V7000 Storage Node integrates with the PureFlex Systems solution. All of the components are used in the three pre-integrated offerings to support compute, storage, and networking requirements. You can select from these offerings, which are designed for key client initiatives and help simplify ordering and configuration.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm Four physical I/O modules. An I/O architectural design capable of providing: – Up to 8 lanes of I/O to an I/O adapter card; each lane capable of up to 16 Gbps – A maximum of 16 lanes of I/O to a half wide-node with two adapters – A wide variety of networking solutions including Ethernet, Fibre Channel, FCoE, and InfiniBand Up to two IBM Flex System Manager (FSM) management appliances for redundancy.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm Up to six 2500W power supply modules. Up to six fan modules consisting of four 80 mm fan modules and two 40 mm fan modules. Additional fan modules may be installed to a total of ten modules. Up to four I/O modules. 1.3.1 Chassis Power supplies A maximum of six power supplies may be installed within the Enterprise Chassis, the PSUs and empty PSU bays can be seen in Figure 1-5 on page 12.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm An IBM Flex System Enterprise Chassis would typically be connected to at least two power distribution units (PDU) in a computer room with the PSUs connected evenly across the PDUs. With ‘N+N’ redundancy the IBM Flex System Enterprise Chassis in this configuration is also protected against PDU failure within the computer room. 1.3.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm Configurator tool may be made to establish specific power requirements for a given configuration. Power configurator can be found at: http://www.ibm.com/systems/x/hardware/configtools.html 1.4 Compute Nodes The IBM Flex System portfolio of compute nodes include those with Intel Xeon processors or with IBM POWER7® processors.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm Figure 1-6 IBM Flex System x440 Compute Node Refer to IBM Flex System x440 Compute Node, TIPS0886 for more information. 1.4.2 IBM Flex System x240 Compute Node The IBM Flex System x240 Compute Node, available as machine type 8737 is a half-wide, two-socket server running the latest Intel Xeon processor E5-2600 family processors.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm run at up to 8 GT/s, one integrated memory controller, and four memory channels supporting up to three DIMMs each. The x240 includes 8 GB of memory (2x 4 GB DIMMs) running at either 1600 MHz or 1333 MHz depending on model. Some models include an Embedded 10Gb Virtual Fabric Ethernet LAN-on-motherboard (LOM) controller as standard, this embedded controller precludes the use of an I/O adapter in I/O connector 1.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm Figure 1-9 shows the rear of the x240 compute node and the locations of the I/O connectors. I/O Connector 1 I/O Connector 2 Figure 1-9 Rear of the x240 compute node showing the locations of the I/O connectors 1.4.3 IBM Flex System x220 Compute Node The IBM Flex System x220 Compute Node, machine type 7906, is the next generation cost-optimized compute node designed for less demanding workloads and low-density virtualization.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm Figure 1-10 IBM Flex System x220 Compute Node The IBM Flex System x220 Compute Node features the Intel Xeon E5-2400 series processors. The Xeon E5-2400 series processor has models with either four, six or eight cores per processor with up to 16 threads per socket. The processors have up to 20 MB of shared L3 cache, Hyper-Threading, Turbo Boost Technology 2.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm 1.4.4 IBM Flex System p260 and p24L Compute Nodes The IBM Flex System p260 Compute Node and IBM Flex System p24L Compute Node are based on IBM POWER architecture technologies. These compute nodes run in IBM Flex System Enterprise Chassis units to provide a high-density, high-performance compute node environment, using advanced processing technology.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm There is no onboard video capability in the Power Systems compute nodes. The machines have been designed to be accessed using Serial Over LAN (SOL) or the IBM Flex System Manager (FSM). The IBM POWER7 processor represents a leap forward in technology and associated computing capability.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm The I/O is controlled by two P7-IOC I/O controller hub chips. This provides additional flexibility when assigning resources within Virtual I/O Server (VIOS) to specific Virtual Machine/LPARs. 1.4.5 IBM Flex System p460 Compute Node The IBM Flex System p460 Compute Node is also based on IBM POWER architecture technologies.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm Although the processor is an important component in servers, many elements and facilities have to be balanced across a server to deliver maximum throughput. As with previous generations of systems based on POWER processors, the design philosophy for POWER7 processor-based systems is one of system-wide balance in which the POWER7 processor plays an important role. Each POWER7 processor has two integrated memory controllers in the chip.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm 1 3 2 4 Figure 1-13 IBM Flex System Enterprise Chassis with I/O module bays numbered If a node has a two port integrated LAN on motherboard (LOM) as standard, Module 1 and 2 are connected to this. If an I/O adapter is installed in the nodes I/O expansion bay 1, then Module 1 and 2 would be connected to this. Module 3 and 4 connect to the I/O adapter that is installed within I/O expansion bay 2 on the node.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm LOM connector (remove when I/O expansion adapter is installed) 4 lanes (KX-4) or 4 10 Gbps lanes (KR) I/O module 1 Node LOM bay 1 with LOM I/O module 3 I/O module 2 Node LOM bay 2 with I/O expansion adapter Node bay 14 I/O module 4 14 internal groups (of 4 lanes each), one to each node.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm The 10 Gb Ethernet switch supports single compute node port capability (14 ports). Dual compute node port capability (28 ports) and triple compute node port capability (42 ports) are available with optional licenses. The base model of this scalable switch provides: 14 internal 10 Gb Ethernet/FCoE ports 2 external 1Gb/10Gb Ethernet/FCoE ports 6 external flexible ports, usable for either 10 Gb Ethernet/FCoE or 4/8 Gb Fibre Channel.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm For more information about the IBM Flex System Fabric EN4093 and EN4093R 10Gb Scalable Switches, refer to IBM Flex System Fabric EN4093 and EN4093R 10Gb Scalable Switches, TIPS0864. 1.5.3 IBM Flex System EN4091 10Gb Ethernet Pass-thru The EN4091 10Gb Ethernet Pass-thru module offers a 1 for 1 connection between a single node bay and an I/O module uplink.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm With DPOD, ports are licensed as they come online. With the FC5022 16Gb SAN Scalable Switch, the first 12 ports reporting (on a first-come, first-served basis) on boot-up are assigned licenses. These 12 ports may be any combination of external or internal Fibre Channel (FC) ports. After all licenses have been assigned, you can manually move those licenses from one port to another.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm The FC3171 8Gb SAN Pass-thru can be configured using either command line or QuickTools. Command Line: Access the module via the console port through the IBM Flex System Chassis Management Module or through the Ethernet Port. This method requires a basic understanding of the CLI commands. QuickTools: Requires a current version of the JRE on your workstation before pointing a web browser to the modules IP address.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm Figure 1-15 IBM Flex System V7000 Storage Node The IBM Storwize V7000 product is described in detail in the Implementing the IBM Storwize V7000 V6.3, SG24-7938. For more information about the IBM Flex System V7000 Storage Node see Chapter 2, “Introduction to IBM Flex System V7000 Storage Node” on page 39. 1.6.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm provisioning and to help organizations achieve greater responsiveness to business needs while reducing costs. For more information on IBM Real-time Compression in relation to IBM SAN Volume Controller and IBM Storwize V7000, refer to Real-time Compression in SAN Volume Controller and Storwize V7000, REDP-4859.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm user interface (GUI). Together, these technologies are designed to enable IBM Storwize V7000 and IBM Flex System V7000 Storage Node to deliver extraordinary levels of storage efficiency. Newest of these technologies is IBM Real-time Compression, which is designed to improve efficiency by compressing data as much as 80 percent, enabling you to store up to five times as much data in the same physical disk space.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm effectiveness even further. Automated tiering technologies such as Easy Tier, Active Cloud Engine™ and Tivoli software help make the best use of the storage resources available.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm 1.6.2 Benefits and value proposition With IBM Storwize V7000 and IBM Flex System V7000 Storage Node you get the following Benefits: Simplified management and intuitive Graphical User Interface (GUI) - Aid rapid implementation and deployment. Virtualization of existing storage infrastructure improves administrator productivity.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm 1.
8068ch01-Intro.fm Draft Document for Review January 29, 2013 12:52 pm 1.7.1 IBM Storwize V7000 IBM Storwize V7000 is an innovative storage offering that delivers essential storage efficiency technologies and exceptional ease of use and performance – all integrated into a compact, modular design. IBM Flex System V7000 Storage Node architecture is the same as that of the IBM Storwize V7000 and is managed from the IBM Flex System Chassis Management Module or IBM Flex System Manager node.
Draft Document for Review January 29, 2013 12:52 pm 8068ch01-Intro.fm IBM Flex System V7000 Storage Node Support home: http://www.ibm.com/support/entry/portal/overview/hardware/puresystems/pureflex_ system/storage_node/flex_system_v7000 IBM Storwize V7000 Information Center: http://publib.boulder.ibm.com/infocenter/storwize/ic/index.jsp The IBM Storwize V7000 Support page is at the following website: http://www.ibm.
8068ch01-Intro.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm 2 Chapter 2. Introduction to IBM Flex System V7000 Storage Node In this chapter we introduce the IBM Flex System V7000 Storage Node and the enclosures and capabilities on which it is based. We will discuss in detail the controller and the expansion enclosures that make up the hardware of IBM Flex System V7000 Storage Node and point out the differences between them.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm 2.1 IBM Flex System V7000 Storage Node overview When virtualizing external storage arrays, an IBM Flex System V7000 Storage Node can provide up to 32 PB of usable capacity. An IBM Flex System V7000 Storage Node supports a range of external disk systems similar to what the IBM Storwize V7000 system supports today. A control enclosure contains two control canisters; an expansion enclosure contains two expansion canisters.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm Figure 2-1 shows a representation of the IBM virtual storage environment. Figure 2-1 IBM virtual storage environment 2.2 IBM Flex System V7000 Storage Node terminology The IBM Flex System V7000 Storage Node introduces some new terminology, which is defined below in Table 2-1.
8068ch02-HW Intro.fm 42 Draft Document for Review January 29, 2013 12:52 pm IBM Flex System V7000 Storage Node term Definition Event An occurrence that is significant to a task or system. Events can include completion or failure of an operation, a user action, or the change in the state of a process.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm IBM Flex System V7000 Storage Node term Definition Volume As used with the IBM Flex System V7000 Storage Node environment, this is the virtually defined device created for use by the host or the IBM Flex System V7000 Storage Node cluster to store IO data. 2.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm An IBM Flex System V7000 Storage Node is mainly intended to be a scalable, internal storage system, to support the internal compute nodes of the IBM Flex System. When needed, it can be expanded in its capacity by attaching external IBM Storwize V7000 expansion enclosures to its SAS2 chain. Both the 2076-212 and the 2076-224 model of the Storwize V7000 expansions are supported.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm This function is used to create copies of copies and supports full, incremental, or nocopy operations. – Reverse FlashCopy This function allows data from an earlier point-in-time copy to be restored with minimal disruption to the host. – FlashCopy nocopy with thin provisioning This function provides a combination of using thin-provisioned volumes and FlashCopy together to help reduce disk space requirements when making copies.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm Data Migration (no charge for temporary usage) IBM Flex System V7000 Storage Node provides a data migration function that can be used to import external storage systems into the IBM Flex System V7000 Storage Node system.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm Table 2-2 Licenses that might be required License type Unit License name License required? Enclosure Base+expansion Physical Enclosure Number IBM Flex System V7000 Base Software Yes, software license per enclosure. External Virtualization Physical Enclosure Number Of External Storage IBM Flex System V7000 External Virtualization Software Optional addon feature Yes, software license per external storage enclosure.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm The Flex System V7000 Storage Node has two available slots in each control canister for populating with host network adapters.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm Attention: The first network adapter (slot1) location can only be populated by a 2 port 10Gbps ethernet CNA network adapter; the second location can be populated by either a 2 port 10Gbps ethernet CNA network adapter or a 4 port 8Gbps fiber channel network adapter.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm Figure 2-5 Control enclosure with connection ports and indicators In Table 2-3, the LED indicators are defined for the control enclosure; some of these are also used on the expansion enclosure as well. Table 2-3 Control enclosure LED description LED Group LED Name Meaning Enclosure Indicator Check Log Is a software fault telling you to check the errorlog for details. Identify Used for identifying the selected enclosure.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm LED Group LED Name Meaning Controller Indicators Power Status Controller FRU Control canister hardware fault Battery Indicators Slow Blink - Power available but Processor shutdown. Fast blink - doing POST. On solid - Powered up.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm A Figure 2-6 Components and board layout of the expansion canister As shown in Figure 2-6, the expansion canister does not contain a battery backup unit like the control canister does. It does have an additional SAS2 connection (A) on it to allow for the continuation of the chain to additional expansions. Figure 2-7 shows the SAS connection ports and the indicators on the front of the expansion enclosures.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm Figure 2-8 Logical block diagram for control canister 2.4.3 Supported disk drives Both the IBM Flex System V7000 Control Enclosure and the IBM Flex System V7000 Expansion Enclosure support up to 24 2.5 inch disk drives in their enclosures. Table 2-4 shows all the possible drive types that can be used in the internal enclosure drive slots at the time of writing.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm 2.4.4 IBM Storwize V7000 expansion enclosure The IBM Storwize V7000 expansion enclosure can be optionally attached to the IBM Flex System V7000 Storage Node for added capacity beyond that of the internal enclosures. These expansion enclosures contain two IBM Storwize V7000 expansion canisters, disk drives, and two power supplies. There are two models of the expansion enclosures with the 2076-212 providing 12 disk slots of the 3.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm Figure 2-11 shows the front view of the 2076-224, enclosure. Figure 2-11 IBM Storwize V7000 front view for 2076-224, enclosure The drives are positioned in one row of 24 vertically mounted row in the drive assemblies. The drive slots are numbered 1 - 24, starting from the left. (There is a vertical center drive bay molding between slots 12 and 13). Though the IBM Storwize V7000 2076-224 enclosure is a 2.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm Figure 2-12 IBM Flex System V7000 Storage Node cabling internal SAS and external It should be noted that the IBM Flex System V7000 Storage Node cable directly from top to bottom down through its expansions including any additional external expansions. 2.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm Note: Even though there is no external switches required there is a requirement for the appropriate internal switch IO modules to be available for the desired host interfacing to work. The IBM Flex System V7000 Storage Node consists of a set of drive enclosures. Control enclosures contain disk drives and two control canisters and form an I/O group for its management of additional internal and external storage.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm When a host server performs I/O to one of its volumes, all the I/Os for a specific volume are directed to the owning I/O group. Also, under normal conditions, the I/Os for that specific volume are always processed by the same canister within the I/O group.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm chooses a new canister as the configuration node and the new canister takes over the system IP addresses. The system can be configured using either the IBM Flex System V7000 Storage Node management software the command-line interface (CLI), 2.5.5 RAID The IBM Flex System V7000 Storage Node setup contains a number of internal disk drive objects known as candidate drives, but these drives cannot be directly added to storage pools.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm 2.5.6 Managed disks A managed disk (MDisk) refers to the unit of storage that IBM Flex System V7000 Storage Node virtualizes. This unit could be a logical volume from an external storage array presented to the IBM Flex System V7000 Storage Node or a RAID array created on internal drives, or an external Storwize V7000 expansion that is managed by the IBM Flex System V7000 Storage Node.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm Figure 2-13 Preferred quorum drive layout The clustered system automatically forms the quorum disk by taking a small amount of space from a managed disk (MDisk). It allocates space from up to three different MDisks for redundancy, although only one quorum disk is active.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm be added to the storage pool. When an MDisk is added to the storage pool, the mode changes from unmanaged to managed and vice versa when you remove it. Each MDisk in the storage pool is divided into a number of extents. The size of the extent is selected by the administrator at creation time of the storage pool and cannot be changed later. The size of the extent ranges from 16 MB up to 8 GB.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm Use the same extent size for all storage pools in a storage system, when they are supporting volume migration between two storage pools. If the storage pool extent sizes are not the same, use volume mirroring to copy volumes between storage pools, as described in Chapter 10, “Volume Mirroring and Migration” on page 423.
68ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm Figure 2-14 IBM Flex System V7000 Storage Node with single and multi-tier pools 2.5.9 Volumes A volume is a virtual logical disk that is presented to a host system by the clustered system. In our virtualized environment, the host system has a volume mapped to it by IBM Flex System V7000 Storage Node. The IBM Flex System V7000 Storage Node translates this volume into a number of extents, which are allocated across MDisks.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm Figure 2-15 Striped and Sequential volumes Image mode Image mode volumes are special volumes that have a direct relationship with one MDisk. They are used to migrate existing data into and out of the IBM Flex System V7000 Storage Node. When the image mode volume is created, a direct mapping is made between extents that are on the MDisk and the extents that are on the volume.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm Figure 2-16 Image mode volume Some virtualization functions are not available for image mode volumes, so it is often useful to migrate the volume into a new storage pool. After it is migrated, the MDisk becomes a managed MDisk. If you add an MDisk containing data to a storage pool, any data on the MDisk is lost. Ensure that you create image mode volumes from MDisks that contain data before adding MDisks to the storage pools. 2.5.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm The contingency capacity is initially set to the real capacity that is assigned when the volume is created. If the user modifies the real capacity, the contingency capacity is reset to be the difference between the used capacity and real capacity. A volume that is created with a zero contingency capacity goes offline as soon as it needs to expand. A volume with a non-zero contingency capacity stays online until it has been used up.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm 2.5.12 Easy Tier Easy Tier is a performance function that automatically migrates or moves extents off a volume to, or from, SSD storage to HDD storage. Easy Tier monitors the host I/O activity and latency on the extent of all volumes with the Easy Tier function turned on in a multitiered storage pool over a 24-hour period.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm 2.5.13 Real-time Compression (RTC) With the IBM Flex System V7000 Storage Node there is a capability to create a volume as a compressed volume type. With this type of volume storage capacity needs can be lowered by as much as half. IBM Flex System V7000 Storage Node RTC function is based off of the same proven Random-Access Compression Engine (RACE) as the IBM RTC Appliances.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm Commands, which are sent by the client and processed by the server, are put into the Command Descriptor Block (CDB). The server runs a command, and completion is indicated by a special signal alert. The major functions of iSCSI include encapsulation and the reliable delivery of CDB transactions between initiators and targets through the Internet Protocol network, especially over a potentially unreliable IP network.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm Changing names: Before changing system or node names for an IBM Flex System V7000 Storage Node clustered system that has servers connected to it using SCSI, be aware that because the system and node name are part of the IQN for the IBM Flex System V7000 Storage Node you can lose access to your data by changing these names. The IBM Flex System V7000 Storage Node GUI shows a specific warning, but the CLI does not.
8068ch02-HW Intro.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm Most clients aim to integrate the FlashCopy feature for point in time copies and quick recovery of their applications and databases. IBM Support is provided by Tivoli Storage FlashCopy Manager, which is described at the following website: http://www-01.ibm.com/software/tivoli/products/storage-flashcopy-mgr/ You can read a detailed description about the FlashCopy copy services in 9.2, “FlashCopy” on page 342. 2.6.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm Customers who wish to use the global mirror capability with Flex System V7000 on a low bandwidth link between sites can do so with the use of the low bandwidth remote mirroring. This capability provides options to help administrators balance network bandwidth requirements and RPO times for applications, helping reduce operation costs for disaster recovery solutions.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm Synchronous Remote Copy ensures that updates are committed at both the primary and the secondary before the application considers the updates complete; therefore, the secondary is fully up to date if it is needed in a failover. However, the application is fully exposed to the latency and bandwidth limitations of the communication link to the secondary.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm Table 2-8 Copy Services configuration limits Properties Maximum number Note Remote Copy (Metro Mirror and Global Mirror) relationships per clustered system 4096 This configuration can be any mix of Metro Mirror and Global Mirror relationships.
Draft Document for Review January 29, 2013 12:52 pm 8068ch02-HW Intro.fm 2.7.1 IBM Assist On-site and remote service The IBM Assist On-site tool is a remote desktop-sharing solution that is offered through the IBM website. With it, the IBM service representative can remotely view your system to troubleshoot a problem.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm Flex System V7000 Storage Node can transmit syslog messages in either expanded or concise format. You can use a syslog manager to view the syslog messages that IBM Flex System V7000 Storage Node sends. IBM Flex System V7000 Storage Node uses the User Datagram Protocol (UDP) to transmit the syslog message.
8068ch02-HW Intro.fm Draft Document for Review January 29, 2013 12:52 pm http://publib.boulder.ibm.com/infocenter/flexsys/information/topic/com.ibm.acc. 4939.doc/site_bkmap_trblshoot.pdf IBM Flex System V7000 Storage Node Support home: http://www.ibm.com/support/entry/portal/overview/hardware/puresystems/pureflex_ system/storage_node/flex_system_v7000 The IBM Storwize V7000 Storage Support page is at the following website http://www.ibm.
8068ch02-HW Intro.fm 80 Draft Document for Review January 29, 2013 12:52 pm Description of the video Link WEB IBM Storwize V7000 Rapid Application Storage Solution - Tivoli Storage FlashCopy Manager http://www.youtube.com/watch?v=1zgEljRVDSc VMware data protection with Storwize V7000 http://www.youtube.com/watch?v=vecOap-qwbA IBM SAN Volume Controller and Storwize V7000 Performance Panel Sped-up! (HD) http://www.youtube.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm 3 Chapter 3. Systems Management This chapter provides an overview of storage management for IBM Flex System V7000 Storage Node from the IBM Flex System Chassis Management Module and the IBM Flex System Manager Node, and shows how to use the navigation tools. While there are several ways to manage the various components of the IBM Flex Systems, a discussion about all these options is beyond the scope of this publication.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm 3.1 System Management Overview The IBM PureFlex System is designed to improve efficiency in system management. The advanced automation of configuration and management, enhanced and user-friendly interface, cross-resource integration, easier monitoring and problem management, policy-based expert patterns, and all other functions and features are designed towards providing a simplified yet dynamic management experience to the user.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Chassis Management Module, command line interface (CLI), web interface, IBM System Network Element Manager (SNEM), or any third-party SNMP-based management tool. Compute Node Management Processors There are two types of compute nodes in an IBM Flex System: For IBM x86 (intel-based) compute nodes, the management interface is IMMv2, which is a powerful management interface providing control at node-level.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm virtualization and efficiency capabilities of IBM Storwize V7000 by simplifying and speeding deployment, and providing greater integration of server and storage management to automate and streamline provisioning for greater responsiveness to business needs and lower overall cost.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Starting Level - IBM Flex System Manager Chassis Map The IBM Flex System Manager offers a Chassis Map, which is the single point of management and starting point for IBM Flex System. It allows for physical navigation through the entire system, as shown in Figure 3-1.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-2 IBM IBM Flex System Manager Storage control Detailed Level - IBM Flex System V7000 Storage Node User Interface This interface is inherent in every IBM Flex System V7000 Storage Node. It allows for detailed disk setup (RAID arrays, LUNs). All the advanced disk features like Easy Tier, Mirroring, Clustering, and Virtualization can be configured using the IBM Flex System V7000 Storage Node User Interface.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Figure 3-3 IBM Flex System V7000 GUI - System Details For further details on management of an IBM Flex System V7000 Storage Node, refer to Chapter 5, “IBM Flex System V7000 Storage Node Graphical user interface overview” on page 175. Chapter 3.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm 3.2 IBM Flex System Chassis Management Module (CMM) The IBM Flex System Chassis Management Module (CMM) is a hot-swap module that configures and manages all installed chassis components. The chassis comes with one IBM Flex System Chassis Management Module in the CMM bays. The IBM Flex System Chassis Management Module auto-detects and manages the hardware of the entire IBM Flex System Enterprise Chassis.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Management Interfaces The IBM Flex System Chassis Management Module allows two user interfaces to perform management functions: IBM Flex System Chassis Management Module web-based graphical user interface (GUI), that provides a way to perform CMM functions within a supported web browser. This user interface is a program that is part of the firmware on IBM Flex System Chassis Management Module.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm 3.2.2 Accessing the CMM After initial connection, you must configure the IBM Flex System Enterprise Chassis and its components for your operating environment. When the chassis is started, all installed components will be discovered and the vital product data (VPD) of each component is stored in the IBM Flex System Chassis Management Module.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Figure 3-5 IBM Chassis Management Module Login screen An Initial Setup wizard starts automatically the first time you access the web interface of a new CMM or a CMM that has been reset to its default settings, for more information regarding Initial setup of the CMM, refer to Implementing Systems Management of IBM PureFlex System, SG24-8060. 3.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm 3.2.3 Viewing and Configuring IP Addresses of Chassis Components Due to the increasing demand for Remote Access to IT equipment over networks, being able to easily view and configure IP addresses of devices in a solution is of a great advantage to IT Administrators and Users.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Figure 3-8 Component IP Configuration view To configure the IP address of a certain chassis component, click on the component (under Device Name), as shown in Figure 3-9. Figure 3-9 IP Address Configuration You can also view and configure IP addresses using IBM Flex System Manager as well as the node-specific management controllers. Chapter 3.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm There are numerous functions and features offered by IBM Flex System Chassis Management Module that are beyond the scope of this publication, however, we will cover the I/O module access features in the next section, due to its relevance with Storage management. For detailed information regarding IBM Flex System Chassis Management Module configuration capabilities, visit http://publib.boulder.ibm.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Figure 3-12 Properties of IO Module device The Properties window has multiple tabs, showing detailed information regarding the module. Click on the IO Connectivity tab to view the connectivity details between the IO module and the compute nodes in the IBM Flex System. This is shown in Figure 3-13.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-14 Launching IOM Console via CMM The drop-down menu gives the option to select HTTP or HTTPS protocol. In case of most IO Modules, HTTPS may need to be selected. This will result in execution of Switch Modules platform-level management interface. 3.2.5 Managing Storage using IBM Flex System Chassis Management Module After completing initial setup, a subsequent login into CMM opens the System Status page.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Scrolling mouse on the selected component opens a pop-up windows that lists its name, location and FRU number, as shown in Figure 3-16. Figure 3-16 CMM chassis view - component pop-up When you click on a component, details about it emerge in the lower part of interface. Depending on the component, one or more tabs show information regarding hardware, firmware, events, and other information. An example is shown in Figure 3-17.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-18 CMM - System Information Quick View Selecting a component also opens up an Actions frame, which lists the actions that can be performed on that particular IBM Flex component, as shown in Figure 3-19. Figure 3-19 CMM - Actions for Chassis Component In the Figure 3-19, an IBM Flex System V7000 Storage Node canister is seen as selected (blue rectangle around component).
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm of Actions for the particular Canister, which includes options to power on/off, restart the service processor, launch the detailed IBM Flex System V7000 Management application, as well as manage the identity LEDs on the component. The area of GUI under the graphical representation of the chassis shows details regarding the selected component. This includes very detailed information laid out in convenient tabular format.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-22 Canister properties - Voltages An important view for storage canister is the IO Connectivity tab, which shows the fabric information related to the IO modules in the chassis, as shown in Figure 3-23. Figure 3-23 IO Connectivity Figure 3-24 on page 101 shows the DC Power consumption for the component.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-24 Power consumption of selected chassis component The IBM Flex System Chassis Management Module web interface has a menu structure at the top of each page that gives easy access to most management functions. One of the most frequently used menu item is Chassis Management, which shows properties, setting and various views and reports regarding the nodes, modules and other components in the Chassis.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm The Chassis Hardware Topology view provides very detailed information regarding all the hardware in the chassis. It goes deep to the point where you can select individual drives, batteries and even expansion cards within a storage or compute node, as shown in Figure 3-26.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm The Storage Nodes view shows all the storage enclosures in the chassis, and gives options to perform various actions on these, including power and restart options, as shown in Figure 3-28. Figure 3-28 CMM - Storage Nodes - view of all enclosures In the Storage Node view, you can select the column headers depending on how much detail is desired, as shown in Figure 3-29.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-30 Manage Identify LED The IBM Flex System V7000 Storage Node User Interface is used for detailed-level management and configuration of the IBM Flex System V7000 Storage Node. Click on Actions Launch Storage Node Controller Console, which will take you to the IBM Flex System V7000 Storage User Interface, as shown in Figure 3-31.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-32 IIBM Flex System V7000 Storage Node Login window After logging in, you can use the IBM Flex System V7000 Storage User Interface directly to perform the management tasks, as shown in Figure 3-33.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm 3.2.6 Data collection using CMM IBM Flex System Chassis Management Module offers various powerful options to pull service information from the components in chassis.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Figure 3-36 Initiate and Collect System will prompt you for verification, indicate that operation is in progress, and then its completion, as shown in Figure 3-37. Figure 3-37 Status dialog boxes Chapter 3.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm To view or delete files in the CMM local storage file system, select Mgt. Module Management File Management, as shown in Figure 3-38. Figure 3-38 File Management File Management page shows the status of CMM’s local Storage file system and the CMM File management menu as shown in Figure 3-39.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Figure 3-40 Viewing service data in /service/ folder The file containing dump of service data is also copied in /tftproot/service/ for ease of transfer, as shown in Figure 3-41. Figure 3-41 Viewing service data in /tftp/service/ path For more details regarding the IBM IBM Flex System Chassis Management Module, visit http://publib.boulder.ibm.com/infocenter/flexsys/information/topic/com.ibm.acc.cmm .doc/cmm_product_page.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm 3.3 Flex System Manager (FSM) The IBM Flex System Manager Node (FSM) is an advanced chassis management appliance which provides the ability to manage up to four chassis. Also referred to as the Management Node, FSM is based on an Intel-based x86 compute node that comes with preloaded management software.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm management software system password is specified when the management software is set up initially, during the Management Server Setup wizard. For more information regarding FSM initial setup, refer to Implementing Systems Management of IBM PureFlex System, SG24-8060. IBM Flex System Manager will auto-discover new and existing components, as well as automatically initiate and perform set-up tasks.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Service & Support Management with Call-Home – Automatically detect and log HW Problems – Notify IBM directly of HW Outages Required update of the default passwords after the initial setup Only secure communication protocols, such as SSH and SSL. Unencrypted protocols, such as HTTP, Telnet, and SNMPv1, are disabled.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm The interoperability is illustrated in Figure 3-43. Figure 3-43 Storage Interoperability IBM Flex System Manager is the common management interface used in an IBM Flex System for multi-chassis management. It offers features for simplified administration of storage along with server and network management. The integrated storage management with Flex System Manager offers simplified storage virtualization capabilities.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm You can virtualize and manage the complete solution infrastructure using the IBM Flex System Manager. Figure 3-44 shows FSM virtualization overview. Figure 3-44 Managing diverse IT infrastructure with storage For further details regarding managing storage using FSM, review the section 3.3.7, “Managing storage using IBM Flex System Manager” on page 139.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm IBM Flex System Manager advanced feature set IBM Flex System Manager advanced feature set offers all capabilities of the base feature set plus: Image management (VMControl Standard) Pool management (VMControl Enterprise) Important: The advanced upgrade license requires the IBM Flex System Manager base license.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm http://publib.boulder.ibm.com/infocenter/flexsys/information/topic/com.ibm.acc.iof m.doc/dw1li_creating_a_configuration_file_automatically.html For information regarding how to install, configure, and use IBM Fabric Manager (IFM), visit http://publib.boulder.ibm.com/infocenter/flexsys/information/topic/com.ibm.acc.iof m.doc/dw1li_advanced.html 3.3.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Figure 3-46 FSM - Startup Page 3.3.4 Overview of IBM Flex System Manager and IBM FSM Explorer The new GUI on IBM Flex System Manager provides 2 interfaces, which will be discussed in the following sections. IBM Flex System Manager Following section will give a short overview on how to navigate around in the IBM Flex System Manager.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Chassis manager page has multiple functions as shown in Figure 3-47. Figure 3-47 FSM chassis manager tab Figure 3-47 shows FSM chassis manager. In this window, Clicking on the chassis name, will open IBM FSM Explorer, which will be discussed later in this section.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm As seen in Figure 3-48 on page 118, there are numerous enhanced features and functions that can be easily preformed in the user-friendly FSM user-interface. For detailed information regarding IBM Flex System Manager’s web interface and management options, refer to the IBM Flex System Manager Systems Management Guide, at http://publib.boulder.ibm.com/infocenter/flexsys/information/topic/com.ibm.directo r.main.helps.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm IBM FSM Explorer - Important information: If you choose a task from the chassis hardware map, or any other menu than the horizontal menu, you will not be informed if it is opened in IBM FSM Explorer or in IBM Flex System Manager. Horizontal menu The horizontal menu is divided in 5 pull down menus, which we will cover in this section. Home menu is divided in to 3 groups: Dashboard takes you back to the main page.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Monitoring gives you shortcuts to Monitors page and Threshold page, which allows you to create thresholds, and select which systems these thresholds should be used for monitoring. Compliance gives you shortcuts to Update manager (Monitored systems) and Compliance policy page. Automation gives you shortcuts to the event automation plans page, Event actions page, Event filters page and Command automation page.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-55 shows the Utilities menu. Figure 3-55 IBM FSM Explorer - Utilities menu Vertical menu The vertical menu has 5 images, which opens different pages, these pages will be covered in the following section. Figure 3-56 Shows the vertical menu. Figure 3-56 IBM FSM Explorer - Vertical menu Chassis page gives you an overview of what is installed in one or more chassis as shown in Figure 3-57 on page 123.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Figure 3-57 IBM FSM Explorer To get to the chassis map, click on chassis in the vertical menu on Figure 3-56 on page 122, then click on the chassis under the chassis list as shown in Figure 3-58. Figure 3-58 IBM FSM Explorer home tab - chassis map The chassis view shows a map of the front and back with graphical representation of the components, as shown in Figure 3-59 on page 124. Chapter 3.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-59 IBM FSM Explorer chassis map To get detailed information about the chassis and chassis components, click on View Details in the summery field of Figure 3-59.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm As shown in Figure 3-60, Common Actions for chassis are shown below the Hardware map at the left side and the detailed information regarding the chassis are shown below the Hardware map at the right. Figure 3-60 IBM FSM Explorer chassis details A drop-down menu shows the actions that can be performed at the Chassis level, as shown in Figure 3-61. Figure 3-61 IBM FSM Explorer - Component Actions Chapter 3.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Network page gives an overview of VLANs, Subnets and network switches, as shown in Figure 3-62. Figure 3-62 IBM FSM Explorer - Network page Storage page gives you an overview of all storage systems, Fabrics and Storage pools as shown in Figure 3-63.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-64 IBM FSM Explorer - Storage page - Firmware update From the menu shown in Figure 3-64, you can also launch the IBM Storwize V7000 Element manager as seen in Figure 3-65.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-66 IBM Flex System Storage Management - Login page In the Fabrics section, clicking on one of the numbers (Last 12 numbers is the MAC address of the switch) will show you all the switches as shown in Figure 3-67. Figure 3-67 IBM FSM Explorer - Storage page - Switch overview Double clicking on one of the switches leads you to detailed information about the switch, as shown in Figure 3-68 on page 129.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-68 IBM FSM Explorer - Storage page - Switch details From the switch overview page, right click on one of the switches select Remote access Launch Web Browser. This will open the switch web GUI login prompt, from where the switch can be configured. Figure shows how to open the switch web GUI. Figure 3-69 IBM FSM Explorer - Storage page - Switch GUI Figure 3-70 Shows the FC switch login page.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm 3.3.5 Accessing I/O Modules using FSM In an IBM Flex system, node to node communication happens within the Chassis. Network Control Network Control is a plug-in that enables utilization of integrated network management capabilities of an FSM. It has the following key features: Logical network management – allows management of port profiles, VLANs, ACLs and QoS in virtualized, live-migration environments Leverages 802.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Click to manage ethernet switches in the Chassis Figure 3-72 Network Control Plug-in Selecting Ethernet Switches in Network Control interface opens a view of all available Ethernet Switches along with information regarding state, access, IP and type, as shown in Figure 3-73 on page 132. Chapter 3.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-73 Viewing Ethernet Switches in FSM Select a switch by clicking on its given name to go to the detailed management and configuration options for it, as shown in Figure 3-74 on page 133.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Figure 3-74 Details regarding selected ethernet switch Several tabs in this view illustrate enhanced monitoring and logging capabilities of the FSM. Click on the Inventory tab to view and gather Inventory for the selected switch module, as shown in Figure 3-75 on page 134. Chapter 3.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-75 Gathering Inventory information For further details regarding the management and configuration of I/O Modules using IBM Flex System Manager, visit http://publib.boulder.ibm.com/infocenter/flexsys/information/topic/com.ibm.acc.873 1.doc/managing_network_resources.html 3.3.6 Data Collection using FSM You can use IBM Flex System Manager to collect and submit support files for a managed resource.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm advantage of SSM is transmission of hardware and software inventory data to IBM using ESA, which assists in troubleshooting the problem as well as monitor the dependencies. Note: If you do not setup the Electronic Service Agent (ESA) then problems will be collected in the FSM management appliance but will not be reported to IBM, however, you can always use the FSM itself to monitor and track your serviceable problems.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-77 SSM default view To collect logs from IBM Flex System V7000 Storage Node using IBM Flex System Manager, click on Manage support files as shown in Figure 3-77. Manage support files page comes up and by choosing Collect support files, a new window appears, where you can see logs already collected. Figure 3-78 on page 137 shows logs already collected.
8068ch03-Sys Manage.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-80 IBM FSM - Collect support file - choose device To select the type of support file you which to collect, click the Support Files tab, then select the file and click collect as shown in Figure 3-81. Figure 3-81 IBM FSM - Collect support file - choose file type When the file has been collected, you can choose to download it, send it to IBM or copy it to a media.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm 3.3.7 Managing storage using IBM Flex System Manager Storage management with IBM Flex System Manager involves two software components: Storage Manager and Storage Control. Both components are included with the management software. Storage Manager is a standard management software capability that provides basic storage life cycle management (Discovery, Inventory, Health and Alerts).
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Depending on the firmware levels of these devices, Storage Control supports native interfaces to the device, which simplifies configuration setup and improves device management reliability. After being discovered, these devices will be listed as being managed by Storage Manager in Flex System Manager. To open Storage Management choose Home Storage Control in the horizontal menu in IBM FSM Explorer as shown in Figure 3-82.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Figure 3-84 FSM - Manage System Storage To get more information about the storage systems controlled by IBM Flex System Manager and see which actions there can be performed, click on Network Storage in the storage control window, as shown in Figure 3-85 on page 142. Chapter 3.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Network Storage Figure 3-85 FSM - Storage Control - Network storage This will open a new page showing Network attached storage, as shown in Figure 3-86. Figure 3-86 FSM - Storage Control - Storage systems Clicking on the storage system name opens the selected storage systems properties page as shown in Figure 3-87 on page 143.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Figure 3-87 FSM - Storage Control - Storage systems From this window, you are able to see General information, Eventlog and Inventory of the storage system, by clicking on the different tabs. Choosing the Actions pull down button, will allow you to collect inventory, update storage system firmware and open the IBM Flex System V7000 Storage Node management application, as shown in Figure 3-88 on page 144. Chapter 3.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-88 FSM - Storage Control - Storage system action menu Managing External Storage Systems To manage external storage subsystems in IBM Flex System Manager, perform the following steps: From the left slide-out tab, select Resource Explorer, as shown in Figure 3-89.
Draft Document for Review January 29, 2013 12:52 pm 8068ch03-Sys Manage.fm Figure 3-90 Resource Explorer Navigate to manage discovered storage, as shown in Figure 3-91. Figure 3-91 Navigate to all storage subsystems Select target storage (e.g. IBM Storwize V7000), as shown in Figure 3-92 on page 146. Chapter 3.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-92 Selecting target storage Select the tab Inventory to collect the inventory, as shown in Figure 3-93. Figure 3-93 Inventory of Storage A Task Launch Dialog box is opened to verify the name of the inventory, and time for running it, as shown in Figure 3-94 on page 147.
8068ch03-Sys Manage.fm Draft Document for Review January 29, 2013 12:52 pm Figure 3-94 Task Launch Dialog You can use Storage Control to monitor the health of storage subsystems, storage pools, storage volumes, and fabric switches. Run the inventory against the Storage Control farm to see updated health status. Follow these steps to retrieve the health and alert status for the devices managed by Storage Control. 1. Select Resource Explorer All Systems.
8068ch03-Sys Manage.
Draft Document for Review January 29, 2013 12:52 pm 8068ch04-Initial Config.fm 4 Chapter 4. IBM Flex System V7000 Storage Node Initial Configuration In this chapter we discuss the initial configuration steps of the IBM Flex System V7000 Storage Node. Before the actual installation and the initial configuration, proper planning is important. In this chapter, we also present an overview of the planning tasks and refer you to the appropriate documentation as needed to enable you to complete these tasks.
8068ch04-Initial Config.fm Draft Document for Review January 29, 2013 12:52 pm 4.1 Planning Overview We start with a overview of the planning tasks required for the proper installation of IBM Flex System V7000 Storage Node. 4.1.1 Hardware Planning Proper planning before the actual physical installation of the hardware is required.
Draft Document for Review January 29, 2013 12:52 pm 8068ch04-Initial Config.fm You should have a minimum of three IP addresses for initial system configuration. These IP addresses can be of either the IPv4 or IPv6 standards. One for management and two for service access to each of the control canisters. A minimum of one and up to four IP addresses are needed if iSCSI attached hosts access volumes from the IBM Flex System V7000 Storage Node.
8068ch04-Initial Config.fm Draft Document for Review January 29, 2013 12:52 pm also used to access remote services like authentication servers, NTP, SNMP, SMTP, and Syslog systems, if configured. Management IP address is configured during first-time setup of your IBM Flex System V7000 Storage Node. See 4.3, “IBM Flex System V7000 Storage Node Setup Wizard” on page 161.
Draft Document for Review January 29, 2013 12:52 pm 8068ch04-Initial Config.fm 4.1.
8068ch04-Initial Config.fm Draft Document for Review January 29, 2013 12:52 pm There are two methods that can be used for the initial setup of the IBM Flex System V7000 Storage Node. The method used depends upon the configuration of the IBM Flex System. If the IBM Flex System has an installed and configured IBM Flex System Manager, then it should be used to set up the IBM Flex System V7000 Storage Node.
Draft Document for Review January 29, 2013 12:52 pm 8068ch04-Initial Config.fm 1. Open a web browser and point it to the IP address of the FSM and login. The following menu screen (Figure 4-1) appears giving you a number of selections. Figure 4-1 Select and launch the chassis in the Chassis Manage Select Launch IBM FSM Explorer from above menu list. Notice a new browser tab is opened, which allows you to select the applicable enclosure from the Chassis Map as shown in Figure 4-2.
8068ch04-Initial Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 4-3 IBM Flex System Manager - Hardware Map 3. From the Chassis Manager page in the management software web interface, click the chassis name that contains your applicable storage node as shown in Figure 4-4 on page 157 (A) and continue to Step 4 on page 157.
Draft Document for Review January 29, 2013 12:52 pm 8068ch04-Initial Config.fm A B Figure 4-4 Add a chassis in to Chassis Manager 4. Navigate to General Actions and click Launch IBM Flex System V7000 Storage Node Manage (V7000) as shown in Figure 4-5 to start the Initial Setup wizard. If you do not see this option, examine the Service IP setting for the storage node. See to 4.5.1, “Change Service IP address” on page 170, for details. Figure 4-5 Launch Storage Manager (V7000) 5.
8068ch04-Initial Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 4-6 IBM Flex System V7000 Storage Node first time setup welcome window 6. If you choose to create a new system, it will ask for network information, as shown in Figure 4-7. Select whether you are using an IPv4 or IPv6 management IP address and type in the address (you can use either DHCP or static address that was assigned). The subnet mask and gateway will already have defaults listed, which you can edit.
Draft Document for Review January 29, 2013 12:52 pm 8068ch04-Initial Config.fm Before you begin Attention: If the control enclosure you have installed in the chassis is being added to an existing clustered system, do not use this procedure. Go to Adding another control enclosure into an existing system. You need to be sure your IBM Flex System V7000 Storage Node has access to the DHCP server and there are at least two DHCP addresses available on your subnet.
8068ch04-Initial Config.fm Draft Document for Review January 29, 2013 12:52 pm 3. A browser window displays the IBM Flex System V7000 Storage Node system startup screen. The Service IP address displayed will be one that has been allocated by your DHCP server as shown in Figure 4-9. Figure 4-9 CMM - Launch Node Console – If a default Service IP address in the range between 192.168.70.131 and 192.168.70.144 is displayed, the canister has not obtained a DHCP address.
Draft Document for Review January 29, 2013 12:52 pm 8068ch04-Initial Config.fm Figure 4-11 Create new Storage Cluster 5. Click Finish Figure 4-11 to set the management IP address for the system. System initialization begins and might take several minutes to complete. When system initialization is complete, System Set Up is launched automatically. The setup wizard will take you through the steps to configure basic system settings such as time and date, system name, and hardware detection and verification.
8068ch04-Initial Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 4-12 IBM Flex System V7000 Storage Node Welcome window Note: During the initial setup of the Flex System V7000, the installation wizard asks for various information that you should have available during the installation process. If you do not have this information or choose not to configure some of the items at this time, you can configure them later through the GUI. 2.
Draft Document for Review January 29, 2013 12:52 pm 8068ch04-Initial Config.fm Figure 4-14 Setup wizard - Set system name and superuser password 4. Set up the system date and time and click Next as shown in Figure 4-15. Figure 4-15 Setup wizard - Set date and time 5. Optionally, you can type in System licenses and click Next as shown in Figure 4-16. The System Licenses include External Virtualization Limit, Remote-Copy Limit, and Real-time Compression Limit.
8068ch04-Initial Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 4-17 Configure support notifications 7. Define company contact info as shown in Figure 4-18. Figure 4-18 Define company contact 8. Verify that all hardware has been detected by the system correctly as shown in Figure 4-19. Figure 4-19 Verify hardware 9. Select ‘Yes’ to automatically configure internal storage now if preferred (Figure 4-20 on page 165).
Draft Document for Review January 29, 2013 12:52 pm 8068ch04-Initial Config.fm Figure 4-20 Select ‘Yes’ to automatically configure internal storage now 10.Click Finish to complete Setup wizard task and log in to IBM Flex System V7000 Storage Node as shown in Figure 4-21. You login as superuser with your newly defined password. If you have note changed the password the default is “passw0rd”. Figure 4-21 Setup wizard task complete 11.
8068ch04-Initial Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 4-22 IBM Flex System V7000 Storage Node Home Overview window 12.IBM Flex System V7000 Storage Node initial configuration is complete and the cluster is up and running (Figure 4-23). Figure 4-23 System details view in management GUI 13.You may continue to configure additional functions and features for your environment in order to meet your implementation requirements.
Draft Document for Review January 29, 2013 12:52 pm 8068ch04-Initial Config.fm 4.4 System Management System management allows for troubleshooting and management tasks using the management graphical user interface (GUI), this includes checking the status of the storage server components, updating the firmware, monitoring events, and managing the storage server. It offers advanced functions, such as FlashCopy, Volume Mirroring, and Remote Mirroring.
8068ch04-Initial Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 4-24 IBM Flex System V7000 Storage Node GUI logon screen Figure 4-25 shows a overview of IBM Flex System V7000 Storage Node GUI. Figure 4-25 IBM Flex System V7000 Storage Node management GUI Welcome page For more details on how to use IBM Flex System V7000 Storage Node management GUI, see Chapter 5, “IBM Flex System V7000 Storage Node Graphical user interface overview” on page 175. 4.4.
Draft Document for Review January 29, 2013 12:52 pm 8068ch04-Initial Config.fm launched and accessed via CMM after the management IP been assigned to your new Flex System V7000 storage node. To start, log in to the CMM GUI and navigate to the chassis map. Right Click on the canister you wish to launch and select Launch Storage Node Controller Console to access storage node management GUI.
8068ch04-Initial Config.fm Draft Document for Review January 29, 2013 12:52 pm The storage system management GUI operates only when there is an online system. Use the Service Assistant if you are unable to create a system or if all node canisters in a system are in service state.
8068ch04-Initial Config.fm Draft Document for Review January 29, 2013 12:52 pm 1 2 3 4 Figure 4-28 Change Service IP via management GUI procedure Change Service IP via CMM If CMM in the chassis is operating and reachable, you can use the CMM to change the Service IP address of a node canister, as shown in Figure 4-29 on page 172. Note: If, for example, the canister has failed to obtain a DHCP address and a default Service IP address in the range between 192.168.70.131 and 192.168.70.
8068ch04-Initial Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 4-29 Change Service IP via CMM procedure Change service IP via CLI These addresses are not set during the installation of a Flex System V7000 Storage Node system, but you can set these IP addresses later by using the chserviceip CLI command. 4.
8068ch04-Initial Config.fm Draft Document for Review January 29, 2013 12:52 pm entering a password, use an SSH public key. Then store the SSH public key for each SSH client on the Flex System V7000 Storage Node. Note: After the first SSH public key is stored, you can add additional SSH public keys using either the management GUI or the CLI. You can connect to the Flex System V7000 Storage Node CLI using PuTTY (Figure 4-30).
8068ch04-Initial Config.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm 5 Chapter 5. IBM Flex System V7000 Storage Node Graphical user interface overview This chapter provides an overview of the graphical user interface of the IBM Flex System V7000 Storage Node and shows how to use the navigation tools. © Copyright IBM Corp. 2012. All rights reserved.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm 5.1 Overview of IBM Flex System V7000 Storage Node management software The IBM Flex System V7000 Storage Node can be managed from either the IBM Flex System Manager Node (FSM) or from the built in Graphical User Interface (GUI) which is a web browser based management tool. The web based Graphical User Interface is designed to simplify storage management and provide a fast and more efficient management tool.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm After you have logged in successfully, the Home window opens showing the Overview screen (Figure 5-2). Figure 5-2 Home menu showing the Overview window 5.1.2 Graphical User Interface layout This Graphical User Interface (GUI) has three main sections for navigating through the management tool. On the far left of the window are eight function icons.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm Figure 5-3 shows the main areas of the GUI Home Overview. Menu Icons Extended Help Status Indicators Figure 5-3 Main areas 5.1.3 Navigation Navigating around the management tool is simple. You can hover the cursor over one of the eight function icons on the left side of the window, which highlights the function icon and shows a list of options. You can then move the cursor to the wanted option and click it (Figure 5-4 on page 179).
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm Figure 5-4 Navigation using the menu options Figure 5-5 shows a list of the IBM Flex System V7000 Storage Node Software function icons and the associated menu options. Figure 5-5 IBM Flex System V7000 Storage Node Software - Menu options Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm If you for example click the Volumes menu, you can change the window’s view (Figure 5-6). This action also applies to any other menu options. Figure 5-6 Navigation using the change view 5.1.4 Multiple selections The new management tool also lets you select multiple items by using a combination of the Shift or Ctrl keys.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm Figure 5-7 Multiple selections using the Shift key Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm If you want to select multiple items that are not in sequential order, click the first item, press and hold the Ctrl key, and click the other items you require (Figure 5-8). Figure 5-8 Multiple selections using the Ctrl key 5.1.5 Status Indicators menus Other useful tools are the Status Indicators that appear at the bottom of the window.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm Figure 5-10 Status Indicators Figure 5-11 shows additional information about Recently Completed tasks when it opens from the Running Tasks menu. Figure 5-11 Status Indicators - Recently Completed tasks Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm 5.2 Home menu The IBM Flex System V7000 Storage Node management software provides an efficient and quick mechanism for navigating between the various different functions. Clicking one of the eight function icons on the left side of the window causes a menu option to open that allows you to navigate directly to the selected option (Figure 5-12). Figure 5-12 Navigate to the Home menu 5.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm Figure 5-13 Monitoring System Details menu After clicking on the System Details, window shown in Figure 5-14 on page 186 is displayed. This shows the upper level of the Details section of the IBM Flex System V7000 Storage Node. From here the firmware level, host name as well as capacity usage can be reviewed and changed. Pressing the Actions button here gives a number of options e.g.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm Figure 5-14 System Details The IBM Flex System V7000 Storage Node Control Enclosure contains Array controllers called Canisters as well as up to 24 disk drives. Figure 5-15 on page 187 shows properties for the Control Enclosure including the system Serial number and Machine Type and Model number.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm Figure 5-15 System Details - Enclosure Figure 5-16 on page 188 shows the top section of the properties for the left Canister including Node name, SAS-port status and the iSCSI Initiator name (IQN Name). Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm Figure 5-16 System Details - Canisters In the Figure 5-16, the SAS Port 1 is Offline as the control enclosure is not currently connected to any disk enclosures. Figure 5-17 on page 189 shows the bottom section of the properties for the left Canister where World Wide Names (WWN) can be reviewed. The WWNs are used when the IBM Flex System V7000 Storage Node connects to an external Fibre Channel attached storage system through SAN switches.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm Figure 5-17 System Details - Canisters IO modules and WWNs Another detail of this window is the Adapters section. This contains information of which Host Interface Cards (HICs) are installed in the system. For more information of Host Interface Cards and in which slots they can be installed refer to Chapter 2, “Introduction to IBM Flex System V7000 Storage Node” on page 39. 5.3.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm Figure 5-18 Navigate to the Monitoring Events menu Recommended actions In the Events window, messages and errors are displayed. In case any unresolved issues exist the Next Recommended Actions section displays the recommended actions and it is possible to run a Fix Procedure. By doing that the IBM Flex System V7000 Storage Node will check if the problem still exists and it will fix the issue if possible.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm Filter events Figure 5-19 Recommended Actions menu In Figure 5-19, you can also use the option to filter the events and display only the events you need to see. Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm Another way to fix an event is to right-click the particular event and click Run Fix Procedure as shown in Figure 5-20. Figure 5-20 Event Fix procedure using right click To view the details of a specific event, click Properties (as shown in Figure 5-20). The Properties window opens as shown in Figure 5-21 on page 193 and shows the details of the error.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm Figure 5-21 Properties of the event Performing the Fix Procedure In Figure 5-22 on page 194, we demonstrate how an error is fixed. Before starting the fix procedure we filter events to Recommended Actions so that only errors are displayed that require attention. Click Run This Fix Procedure. Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm Figure 5-22 Error code 1625 Fix Procedure before fix Figure 5-23 shows the first step of the fix procedure for the error with Event Code1625 Incorrect Controller Configuration.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm Figure 5-24 shows the next step of the fix procedure. The fix procedure is informing about the error and what may have caused it. Figure 5-24 Error code 1625 Fix Procedure Step 2 Figure 5-25 on page 196 shows the third step of the fix procedure where we mark the error as fixed where after the IBM Flex System V7000 Storage Node starts a rescan of the system to see if the error persist. Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm Figure 5-25 Error code 1625 Fix Procedure Step 3 Figure 5-26 shows that the rescan has begun. Figure 5-26 Error code 1625 Fix Procedure Step 4 Figure 5-27 on page 197 shows that the rescan has finished.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm Figure 5-27 Error code 1625 Fix Procedure Step 5 Figure 5-28 shows that the rescan has finished and that the error condition has been resolved. Figure 5-28 Error code 1625 Fix Procedure Step 6 Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm The error 1625 in the above example was caused because of one of our Control Enclosure controllers had been temporarily removed from the system. Figure 5-29 shows that few more errors remain as unresolved. These should be fixed as the one we just resolved in the example above. Figure 5-29 Error code 1625 Fix Procedure - Problem fixed 5.3.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm – Writes in MegaByte per second (MBps) – Red latency in milli seconds (ms) – Write latency in milli seconds (ms) Figure 5-30 shows the Performance screen of IBM Flex System V7000 Storage Node.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm Figure 5-31 Navigate to the Pools menu Volumes by Pool Menu is discussed in 5.4.1, “Volumes by Pool menu” on page 201.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm 5.4.1 Volumes by Pool menu Figure 5-32 shows the Volumes by Pool window, from where you can create or delete storage pools as well as perform actions on volumes like mapping to host or unmapping from host. Also migration actions can be performed from the Volumes by Pool menu Click to rename Figure 5-32 Volumes by Pools menu As with the storage controllers, you may rename the MDisk pools to reflect where the disks are located.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm 5.4.2 Internal Storage menu The IBM Flex System V7000 Storage Node has internal disk drives in the enclosures. The Internal Storage menu option displays and manages these drives. Clicking the Internal Storage option opens the window shown in Figure 5-33. From this window, you can place internal disk drives into storage pools. This window also provides the option to display the internal drives based on their capacity and speed.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm 5.4.3 External Storage menu The IBM Flex System V7000 Storage Node can also manage external storage subsystems using the SAN or FCoE connections. If any are attached, they are managed in this option. Clicking the External Storage option opens the window shown in Figure 5-34. This window shows any virtual external disk systems in that IBM Flex System V7000 Storage Node.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm 5.4.5 MDisks by Pools menu Figure 5-35 shows the MDisks that are available to the IBM Flex System V7000 Storage Node system. The MDisks show whether they are managed, in which case the storage pool is displayed, or whether they are unmanaged, in which case the storage pools can be added to a new pool.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm By right-clicking the display bar (Figure 5-36), you can choose to change the fields that are displayed. Select the items you want to be displayed. Figure 5-36 Display additional fields Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm From this window, you can choose to either use the options of the Actions button or you can choose to highlight the particular MDisks that you require, right-click, and access the same options (Figure 5-37).
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm 5.5 Volumes menu The volumes are built from extents in the pools, and are presented to hosts as external disks. In this section, we describe the Volumes menu and its options. When you hover the cursor over the Volumes function icon, the menu shown in Figure 5-38 opens. Figure 5-38 Navigate to the Volumes menu Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm 5.5.1 The Volumes menu Clicking the Volumes menu opens the window shown in Figure 5-39. From here you can perform tasks on the volumes, such as shrink or enlarge them, map them to a host, or migrate a volume.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm From this menu, you can perform various operations on the volumes. You can use the Actions button to access these operations, or you can right-click the Volume name, which opens list of operations that can be performed against the volume (Figure 5-40). Figure 5-40 Volume operations Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm 5.5.2 Volumes by Pool menu Clicking the Volumes by Pool menu opens the window shown in Figure 5-41.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm Similar to the previous window, you can either use the Actions button to access the menu operations or you can right-click the pool to display a list of valid commands (Figure 5-42). Figure 5-42 Commands for a single volume from the Volume by Pools menu 5.5.3 Volumes by Host menu Clicking the Volumes by Host option opens the window shown in Figure 5-43 on page 212. This window shows the volumes that have been mapped to a given host.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm Figure 5-43 Volumes by Host window You can use the Actions button or you can right-click the pool to show a list of valid commands (Figure 5-44 on page 213).
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm Figure 5-44 Commands for a single volume from the Volume by Host menu By using the Migrate to Another Pool option the Volume can be migrated from one pool to another while still maintaining full service to the host that connects to the Volume. Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm 5.6 Hosts menu In this section, we describe the Hosts menu and its options. When you hover the cursor over the Host function icon, a menu opens (Figure 5-45).
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm 5.6.1 The Hosts menu Clicking Hosts opens the window shown in Figure 5-46. From here you can modify host mappings, unmap hosts, rename hosts, and create new hosts. Figure 5-46 The Hosts window that shows all hosts Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm As with a number of other windows, you can use the command buttons or you can select a host and right-click it to access the commands (Figure 5-47). Figure 5-47 Actions for a single host from the Hosts menu Figure 5-48 shows an example of Modify Mappings. The selected Windows server has no mappings and we select a Volume for to be mapped to the server. From this menu we can also map more volumes or we can unmap volumes already mapped.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm 5.6.2 Ports by Host menu Clicking Ports by Hosts opens the window shown in Figure 5-49. This window shows the Fibre Channel and iSCSI ports that are assigned to a particular host. Figure 5-49 Ports by Host window Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm Clicking the Actions button allows you to modify the mappings, unmap volumes, rename hosts, and delete ports (Figure 5-50).
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm 5.6.3 Host Mappings menu Clicking Host Mappings opens the window shown in Figure 5-51. This window shows the Host name, SCSI identifier, Volume name and the Volume identifier for all the mapped volumes. Figure 5-51 Host Mapping window Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm You can use the Actions buttons shown in Figure 5-52 or you can select a host and right-click it to access the commands. Figure 5-52 Actions for a single host from the Host Mapping window By unmapping the volume as the example shown above, the volume will be made unavailable to the host. 5.6.4 Volumes by Host The Volumes by Host menu is used to filter the view to show which hosts has which volumes mapped.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm 5.7 Copy Services menu IBM Flex System V7000 Storage Node provide a number of different methods of coping and replicating data. FlashCopy is provided for instant copy of block volumes within the cluster. Remote copy is used to copy block volumes to another location on another cluster and this can be done synchronously (Metro Mirror) or asynschronously (Global Mirror). In this section, we describe the Copy Services menu and its options.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm 5.7.1 FlashCopy menu Clicking FlashCopy opens the window shown in Figure 5-54. This window shows the volumes that are available. If you right-click a volume, a list of operations opens. From here you can perform tasks such as initiate a new snapshot, clone or back up of a volume.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm By either double clicking the volume name or Right click Properties opens the Volume Details window shown in Figure 5-55. From here, you can click the tabs at the top of the window to display additional information, such as the hosts that the volume or FlashCopy volume is mapped to and its dependant MDisks. Figure 5-55 FlashCopy volume details with Show Details checked Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm 5.7.2 FlashCopy Consistency Group menu FlashCopy Consistency Groups are used to group multiple copy operations together that have a need to be controlled at the same time. In this way the group can be controlled by starting, stopping, and so on, with a single operation.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm 5.7.3 FlashCopy Mapping menu The FlashCopy Mapping menu allows you to create and view the relationship (mapping) between the FlashCopy source and target volumes. Clicking FlashCopy Mapping opens the window shown in Figure 5-57. From this window, you can Start, Stop, Delete, and Rename the FlashCopy mappings. There is also an option to move the relationship into a consistency group. Figure 5-57 FlashCopy Mapping window 5.7.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm 5.8 Access menu There are a number of levels of user access to the IBM Flex System V7000 Storage Node cluster, which are managed through the access menu. The access levels are divided into groups each having a different level of access and authority. If desired, multiple users can be defined and their access assigned to suit the tasks they perform. In this section, we describe the Access menu and its options.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm 5.8.1 Users menu Figure 5-59 shows the Users window. This window enables you to create and delete new users, change and remove passwords, and add and remove SSH keys. Figure 5-59 Users menu Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm Clicking New User opens the window shown in Figure 5-60. From here you can enter the name of the user and the password, and load the SSH key (if the SSH key has been generated). Starting with SAN Volume Controller and IBM Storwize V7000 V6.3 SSH keys are not required for CLI access, and you can choose either to use SSH or password for CLI authentication.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm 5.8.2 Audit Log menu All commands issued on the cluster are logged in the Audit log. Note that even if initiated from the GUI, most actions cause a CLI command to be run, so this will also be logged. Clicking Audit Log opens the window shown in Figure 5-61. The cluster maintains an audit log of successfully executed commands, indicating which users performed particular actions at certain times.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm 5.9 Settings menu In the following section, we describe the Settings menu and its options. If you hover the cursor over the Settings function icon, the Settings menus opens (Figure 5-62).
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm 5.9.1 Event Notification menu This option is used to configure the alerting and logging. Here we define the e-mail and SNMP servers and the levels of alerting as desired. Clicking Event Notification opens the window shown in Figure 5-63. From this window, you can configure email alerts (which is included in the Call Home function) and SNMP monitoring, and define syslog servers and the message types.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm needs access to the management GUI, a password is needed for the user. If the user requires access to the command-line interface (CLI) through SSH, either a password or a valid SSH key file is necessary. Local users must be part of a user group that is defined on the system. User groups define roles that authorize the users within that group to a specific set of operations on the system.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm 5.9.3 Network menu The network setup for all the interfaces in the cluster is configured here. Clicking Network opens the window shown in Figure 5-64. From here you can update the network configuration, set up iSCSI definitions, and view information about the Fibre Channel connections.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm Fibre Channel Fibre Channel is used to display the FC-paths and their status. This is the Fibre Channel paths over the SAN and only relates to the storage nodes. When you click Fibre Channel (Figure 5-65), some useful information is displayed about Fibre Channel connectivity. In this example, we review connectivity for all nodes, storage systems and hosts.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm Figure 5-66 Support menu Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm You can download any of the various log files or delete them by selecting a single item (Figure 5-67) and click either the Download or Delete options under the Actions button. Figure 5-67 Download / Delete options of the Actions button Delete option: When the Delete option is not available, the file cannot be deleted because it is a file being used by the system.
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm At the upper right of the window, there is a Node option that can be used to show node canister 1 or 2 log files (Figure 5-68). Figure 5-68 Change the log listing of the Nodes canister Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm Clicking Download Support Package opens the window shown in Figure 5-69. This window provides a number of different options that can be used to collect logs and save state information from the cluster. Figure 5-69 Download a support package Clicking Download generates the support package shown in Figure 5-70. Figure 5-70 Generate a Support Package Click Save File and then Save to save a copy of the package (Figure 5-71 on page 239).
Draft Document for Review January 29, 2013 12:52 pm 8068ch05-GUI.fm Figure 5-71 Save the Support Package The downloaded support package is now ready for analysis which is part of how IBM Support deals with troubleshooting on the IBM Flex System V7000 Storage Node and similar IBM storage virtualization products. Chapter 5.
8068ch05-GUI.fm Draft Document for Review January 29, 2013 12:52 pm 5.9.5 General menu In this option we can set the time and date for the cluster, enter licensing details if needed and perform software upgrades for the cluster. Clicking the General option opens the window shown in Figure 5-72. This window provides options to set the date and time, update the software licensing levels, upgrade the firmware, and set GUI preferences.
Draft Document for Review January 29, 2013 12:52 pm 8068ch06-Volumes.fm 6 Chapter 6. Basic Volume and Host Configuration This chapter describes how to use the IBM Flex System V7000 Storage Node to create a volume and map a volume to a host. A volume is a logical disk on the IBM Flex System V7000 Storage Node that is provisioned out of a storage pool and is recognized by a host with an identifier UID field and a parameter list.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm 6.1 Storage provisioning from IBM Flex System V7000 Storage Node This section follows the setup process and shows how to create volumes and make them accessible from the host. The following steps are required to complete the basic setup of your environment: 1. Create new volumes - starting at 6.1.1, “Creating a generic volume” on page 244 2. Create New Host - 6.2, “Creating a new host” on page 256 3. Map volumes to the host 6.
Draft Document for Review January 29, 2013 12:52 pm 8068ch06-Volumes.fm The All Volumes window opens (Figure 6-2). If this the first time volumes are configured on a newly initialized system, a pop up message appears that no volumes are defined yet. Figure 6-2 All Volumes window We have some volumes already and are creating additional volumes in the following sections. By default, all volumes that you create are striped across all available MDisks in one storage pool.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm 6.1.1 Creating a generic volume The most commonly used type of volume is the generic volume type. This type of volume is fully provisioned, with the entire size of the volume dedicated to the volume. The host and the IBM Flex System V7000 Storage Node see the fully allocated space without a mirror. 1. Click New Volume and select Generic as shown in Figure 6-3. Figure 6-3 New Volume window - select pool 2.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm Figure 6-5 Volume created 4. After the task is completed, click Close You can choose to map the new volumes immediately as part of the volume create wizard by clicking Create and Map to Host. This will guide you through the Map to Host wizard described in section 6.3, “Mapping a volume to the host” on page 261. 6.1.2 Creating a thin-provisioned volume Volumes can be configured to be thin provisioned.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm To create a thin-provisioned volume, complete the following steps: 1. From the New Volume window, select Thin Provision (Figure 6-6). Figure 6-6 Create a thin-provisioned volume - select pool 2. Select the pool in which the thin-provisioned volume should be created by clicking it and entering the volume name and size (Figure 6-7). Figure 6-7 Enter the volume name and size 3.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm Figure 6-8 Advanced Settings 4. On the Thin Provisioning tab (Figure 6-8), there are several advanced options available: – Real: Specify the size of the real capacity space used during creation. – Automatically Extend: This option enables the automatic expansion of real capacity, if new capacity must be allocated. – Warning Threshold: Enter a threshold for receiving capacity alerts.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm You can choose to map the new volumes immediately as part of the volume create wizard by clicking Create and Map to Host. This will guide you through the Map to Host wizard described in section 6.3, “Mapping a volume to the host” on page 261. 6.1.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm To create a mirrored volume, complete the following steps: 1. From the New Volume window, select Mirror (Figure 6-10). Figure 6-10 Create a mirrored volume - Select the primary pool 2. Select the primary pool by clicking it and the view changes to the second pool (Figure 6-11). Figure 6-11 Create a mirrored volume - Select the secondary pool 3.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm Figure 6-12 Create a mirrored volume - Select pools, name, and size 4. The summary shows you capacity information about the pool. If you want to select advanced settings, click Advanced and click the Mirroring tab (Figure 6-13). Figure 6-13 Advanced mirroring features 5. In the advanced mirroring settings, you are able to specify a synchronization rate. Enter a Mirror Sync Rate between 1 - 100%.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm 6. Click Create and Map to Host and the mirrored volume is created (Figure 6-14). Figure 6-14 Create a mirrored volume - CLI command displays 7. After the task is completed, click Close You can choose to map the new volumes immediately as part of the volume create wizard by clicking Create and Map to Host. This will guide you through the Map to Host wizard described in section 6.3, “Mapping a volume to the host” on page 261. 6.1.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm To create a thin-mirror volume, complete the following steps: 1. From the New Volume window, select Thin Mirror (Figure 6-15). Figure 6-15 Thin Mirror - select the primary pool 2. Select the primary pool by clicking it and the view changes to the second pool (Figure 6-16). Figure 6-16 Thin Mirror - select the secondary pool 3.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm Figure 6-17 Thin Mirror - Enter volume name and size 4. The summary shows you the capacity information and the allocated space. You can click Advanced and customize the thin-provision settings (Figure 6-8 on page 247) or the mirror synchronization rate (Figure 6-13 on page 250). If you have opened the advanced settings, click OK to return to Figure 6-17. 5. Click Create and the mirrored volume is created (Figure 6-18).
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm 6.1.5 IBM Real-time Compression IBM Flex System V7000 version 6.4 (or higher) has the capability of compressing volumes and this is called IBM Real-time Compression. This reduces disk capacity required to store data by up to 80%, helping improve efficiency and control storage costs.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm this is a very busy system. One option is to create the compressed volume at the end of the day, so that fewer users are affected by a performance decrease during creation of the compressed volume. 2. Select a pool where you want the new Compressed volume as shown in Figure 6-20. Type a name for the new Compressed volume, and the size and click Create. Figure 6-20 Compressed Volume - Enter name and size 3.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm Figure 6-22 Compressed Volume- CLI command displays 5. After the task is completed, click Close You can choose to map the new volumes immediately as part of the volume create wizard by clicking Create and Map to Host. This will guide you through the Map to Host wizard described in section 6.3, “Mapping a volume to the host” on page 261.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm Figure 6-23 The Hosts menu - create new host 2. Click Fibre Channel Host - the Wizard automatically moves to the next screen. Figure 6-24 shows that the first choice we have to make is whether we are creating a Fibre Channel attached host or an iSCSI host. Figure 6-24 New Host creation - select iSCSI or FC host 3. Give the host a name after your choice of the host type. 4.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm Figure 6-25 New Host creation - select between available World Wide Names 5. Click Create Host after you finished adding WWNs Figure 6-26 shows that we have added our HBA ports and are now ready to create our new host. Figure 6-26 New Host creation - two World Wide Names Selected The CLI commands window appear and after the task is completed, click Close.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm Figure 6-27 The newly created host appears 6.2.2 Create an iSCSI attached host The process of creating a iSCSI attached host is almost similar to creating a FC-attached host as shown in 6.2.1, “Create a Fibre Channel attached host” on page 256. The only difference is that instead of configuring the new host with WWN’s from our host we instead configure an iSCSI initiator name.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm Figure 6-28 New Host creation - add iSCSI port name obtained from host 5. Click Create Host. Figure 6-29 shows the final step of creating the iSCSI host. Figure 6-29 New Host creation - iSCSI port defined Figure 6-30 on page 261 shows that we now have two configured hosts in our IBM Flex System V7000 Storage Node GUI.
Draft Document for Review January 29, 2013 12:52 pm 8068ch06-Volumes.fm Figure 6-30 The Hosts menu - two additional hosts created We have now finished creating the Fibre Channel attached host as well as the iSCSI attached host. The newly created iSCSI host may show Status with the color red and Offline. This indicates that no traffic has yet travelled over the connection.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm If you clicked Create the next logical step is to map the newly created volume to a host. If you clicked Create and Map to Host the volume create wizard takes you to the host mapping wizard as shown below. To map the volumes, complete the following steps: 1. From the volumes menu select a volume and click either Actions and Map to Host or right-click and select Map to host as shown in Figure 6-31.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm Figure 6-33 Map to host - select volumes 4. After the task completes, click Close (Figure 6-34), and the wizard returns to the All volumes window. Figure 6-34 Map to host - CLI command displays The newly created volume is displayed and we see that it is now has host mappings as shown in Figure 6-35 on page 264. Chapter 6.
8068ch06-Volumes.fm Draft Document for Review January 29, 2013 12:52 pm Figure 6-35 Map to host - Volume now has host mappings The host is now able to access the volumes and store data on it. Go to Chapter 12, “Host Configuration” on page 473 to discover the volumes on the host and make some additional host settings if required. You can also create multiple volumes in preparation for discovering them later. Mappings can be customized as well.
Draft Document for Review January 29, 2013 12:52 pm 8068ch07-Migration.fm 7 Chapter 7. Migration wizard In this chapter, we describe how to migrate existing data on external storage systems to the IBM Flex System V7000 Storage Node. Migrating data from external storage systems to the IBM Flex System V7000 Storage Node allows applications to benefit from the new features, such as Easy Tier, an intuitive management GUI, and advanced storage replication functions that better support applications.
8068ch07-Migration.fm Draft Document for Review January 29, 2013 12:52 pm 7.1 Preparing for data migration In this section, we show you how to prepare external storage systems and IBM Flex System V7000 Storage Node for data migration. Data migration is always an important step when setting up new storage systems in an existing storage infrastructure.
Draft Document for Review January 29, 2013 12:52 pm 8068ch07-Migration.fm 7.2.1 Checking the Windows 2008 host before upgrade Before any migration begins at the IBM Flex System V7000 Storage Node Migration Wizard we check the host that currently has its disks located on a IBM DS4300 disk array. Figure 7-1 shows that the server has a disk two disks (Disk 1 and Disk 2) which are currently located on a IBM DS4300 disk array. Figure 7-1 Windows server with disks from DS4300 mapped 7.2.
8068ch07-Migration.fm Draft Document for Review January 29, 2013 12:52 pm Figure 7-2 DS4300 Storage Manager - Disk maps to Windows server Figure 7-3 shows how we make the mapping changes in DS Storage Manager. The disk is unmapped from the Windows server and is mapped to the IBM Flex System V7000 Storage Node instead.
Draft Document for Review January 29, 2013 12:52 pm 8068ch07-Migration.fm Figure 7-4 DS4300 Storage Manager - Disk now maps to IBM Flex System V7000 Storage Node At this point we go back to our Microsoft Windows 2008 server and check that the disk has disappeared from the Server Manager Disk Administrator. Figure 7-5 on page 270 shows that the disk has disappeared from the Server Manager Disk Administrator. We also use the Rescan Disks option to confirm this. Chapter 7.
8068ch07-Migration.fm Draft Document for Review January 29, 2013 12:52 pm Figure 7-5 Windows server with disk from DS4300 unmapped - rescan disks Now we are ready to start the Import of the disk to the IBM Flex System V7000 Storage Node. 7.2.3 Migration Wizard on the IBM Flex System V7000 Storage Node Before starting the Migration, we want to make sure the remapped disks are available and visible on the IBM Flex System V7000 Storage Node GUI.
Draft Document for Review January 29, 2013 12:52 pm 8068ch07-Migration.fm Figure 7-6 Remapped disks are visible in the External Storage section There are two ways to access the menu options for starting a migration: Either Click Home Overview, and then click Migrate Storage from the Suggested Tasks drop-down menu as shown in (Figure 7-7 on page 272). Chapter 7.
8068ch07-Migration.
Draft Document for Review January 29, 2013 12:52 pm 8068ch07-Migration.fm Or Click the Pools icon and click System Migration as shown in Figure 7-8. Figure 7-8 Migrate Storage from Pools menu System Migration option Whichever method is chosen, the storage migration window opens (Figure 7-9 on page 274). Click Start New Migration to start the storage migration wizard. Chapter 7.
8068ch07-Migration.fm Draft Document for Review January 29, 2013 12:52 pm Figure 7-9 Storage Migration Wizard - Start New Migration Using the IBM Flex System V7000 Storage Node storage migration wizard, you can easily migrate your existing data. Complete the following steps: 1. The Step 1 of the Storage Migration Wizard is to check the restrictions and prerequisites, and click Next as shown in Figure 7-10 on page 275.
Draft Document for Review January 29, 2013 12:52 pm 8068ch07-Migration.fm Figure 7-10 Storage Migration Wizard step 1- Before You Begin window Avoiding data loss: To avoid any potential data loss, back up all the data stored on your external storage before using the wizard. Figure 7-10 shows there are some restrictions and prerequisites to using the storage migration wizard: – Restrictions: • • Do not use the storage migration wizard to migrate cluster hosts, including clusters of VMware hosts and VIOS.
8068ch07-Migration.fm Draft Document for Review January 29, 2013 12:52 pm The VMware ESX Storage vMotion feature might be an alternative to migrating VMware clusters. For more information about this topic, see the following address: http://www.vmware.com/products/vmotion/overview.html – Prerequisites: • • Make sure that the IBM Flex System V7000 Storage Node Fibre Channel ports have been connected to the SAN fabrics to which the external disk controller and hosts you want to migrate from are connected.
Draft Document for Review January 29, 2013 12:52 pm 8068ch07-Migration.fm Figure 7-12 Storage Migration Wizard step 3 - Map Storage After you click Next, the IBM Flex System V7000 Storage Node starts to discover external devices (if you have correctly zoned the external storage systems with the IBM Flex System V7000 Storage Node and mapped the LUNs). When the discovery completes, IBM Flex System V7000 Storage Node shows the MDisks found. 4.
8068ch07-Migration.fm Draft Document for Review January 29, 2013 12:52 pm If the MDisks that need migrating are in the list, select them and click Next. The IBM Flex System V7000 Storage Node starts to import the MDisks that you have chosen. If the MDisks that need migrating are not in the list, you might need to check your zone configuration and LUN mapping, and click Detect MDisks to run the IBM Flex System V7000 Storage Node discovery procedure again.
Draft Document for Review January 29, 2013 12:52 pm 8068ch07-Migration.fm 5. Configure the host that needs to access the data after the migration, or create new hosts as needed in Step 5, and click Next (Figure 7-14). Figure 7-14 Storage Migration Wizard step 5 - Configure Hosts Before you configure any hosts, make sure that the appropriate drivers have been installed on the host and that the host zones have been zoned correctly.
8068ch07-Migration.fm Draft Document for Review January 29, 2013 12:52 pm Figure 7-15 Storage Migration Wizard step 6 - Map to host 7. Select the host you want to use for mapping the volume. Click Next to continue with the migration wizard as shown in Figure 7-16. Figure 7-16 Storage Migration Wizard - Map disk to Windows 2008 host 8. Map the newly migrated volume to the host, and when the mapping is complete, click Apply or Map Volumes as shown in Figure 7-17 on page 281.
Draft Document for Review January 29, 2013 12:52 pm 8068ch07-Migration.fm Figure 7-17 Storage Migration Wizard s- Apply Mapping to Windows 2008 host In Step 4 on page 277 of the migration wizard, the volumes from the imported MDisks that need to be migrated have been listed. The names of the volumes have been assigned automatically by the IBM Flex System V7000 Storage Node storage system.
8068ch07-Migration.fm Draft Document for Review January 29, 2013 12:52 pm Figure 7-18 Storage Migration Wizard - Completion of the host mappings 9. Select the destination storage pool for data migration in Step 7 and click Next (Figure 7-19). Figure 7-19 Storage Migration Wizard step 7 - select Storage Pool The destination storage pool of the data migration could be an external storage pool or an internal storage pool. Make sure that there is enough space in the storage pools.
8068ch07-Migration.fm Draft Document for Review January 29, 2013 12:52 pm Figure 7-20 Storage Migration Wizard step 8 - Migration has begun When returning to the Pools System Migration window the migration progress is showing. Also at the status indicators Running Tasks show that volume synchronization is in progress as shown in Figure 7-21 Figure 7-21 Migration is in progress 7.2.
8068ch07-Migration.fm Draft Document for Review January 29, 2013 12:52 pm Figure 7-22 shows that the Microsoft Windows 2008 Server now again has access to the migrated disks. Data is still being copied from the IBM DS4300 disk system to the IBM Flex System V7000 Storage Node as a background process.
Draft Document for Review January 29, 2013 12:52 pm 8068ch07-Migration.fm Figure 7-23 After Migration - Disk is now in a Migration pool The end of the storage migration wizard is not the end of the data migration. The data migration has begun, and after clicking Finish in step 10 on page 282, you can find the migration progress in the migration window. You can also find the target storage pool to which your volumes are being migrated, along with the status of the volumes.
8068ch07-Migration.fm Draft Document for Review January 29, 2013 12:52 pm Figure 7-24 Migration progress in the migration window 7.2.5 Finalizing the migration When the migration progress reaches 100%, select one or both volumes and click Finalize in the Actions drop-down menu in the migration window (Figure 7-25 on page 287).
Draft Document for Review January 29, 2013 12:52 pm 8068ch07-Migration.fm Figure 7-25 Storage Migration Wizard - Finalize migration step 1 After you select Finalize in the Action menu, the IBM Flex System V7000 Storage Node needs you to confirm the migration of the volumes. Verify the volume name and the number of migrations and click OK. Figure 7-26 shows the Finalize Volume Migration window.
8068ch07-Migration.fm Draft Document for Review January 29, 2013 12:52 pm Figure 7-27 Disks are returned as unmanaged MDisks You can now un-zone and remove the older storage system from the IBM Flex System V7000 Storage Node. For more information about the IBM Flex System V7000 Storage Node migration function, refer to Chapter 10, “Volume Mirroring and Migration” on page 423. After the migration is Finalized, the Migration Pool used for the migration remain as a Storage Pool on the system and is empty.
Draft Document for Review January 29, 2013 12:52 pm 8068ch07-Migration.fm Figure 7-28 After Migration start - Map to host Figure 7-29 on page 290 shows the next step of the mapping process. The wizard shows all the hosts currently configures on the IBM Flex System V7000 Storage Node and lets us select which host we want to map the volume. Chapter 7.
8068ch07-Migration.fm Draft Document for Review January 29, 2013 12:52 pm Figure 7-29 Modify Host Mappings - Choose a host When the host is selected you can click either Map Volumes or Apply whichever will continue to the next step of the Map to Host Wizard. Figure 7-30 shows all unmapped volumes that can be mapped to the host. The volume we right-clicked in the first step now appears in the right-side of the window and is ready to be mapped.
Draft Document for Review January 29, 2013 12:52 pm 8068ch07-Migration.fm You can change the SCSI ID of the new mappings through the Edit SCSI ID button or by double clicking the SCSI ID Field. Clicking either Map Volumes or Apply maps the volume to the host. Click Close on the CLI commands window to complete the mapping. 7.2.
8068ch07-Migration.fm Draft Document for Review January 29, 2013 12:52 pm Figure 7-32 After Migration - Rename volume step 1 Figure 7-33 show how we give the volume a name that makes sense according to which function the volume has. Figure 7-33 After Migration - Rename Volume step 2 Figure 7-34 on page 293 shows that the volume has been renamed.
Draft Document for Review January 29, 2013 12:52 pm 8068ch07-Migration.fm Figure 7-34 After Migration - Volume Name after rename Chapter 7.
8068ch07-Migration.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm 8 Chapter 8. Storage pools This chapter explains how IBM Flex System V7000 Storage Node manages physical storage resources. All storage resources under IBM Flex System V7000 Storage Node control are managed using Storage pools. Storage pools and the volumes you build on them make it easy to dynamically allocate resources, manipulating these and hence maximize productivity and reduce costs. © Copyright IBM Corp. 2012.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm 8.1 Working with internal drives This section describes how to configure the internal storage disk drives using different RAID levels and different optimization strategies. In this section, we start with the environment shown in Figure 8-1. All the internal drives are unconfigured. Currently, the existing MDisks come from external storage, and example storage pools, volumes, and hosts have been created for use.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm An alternative way to access the Internal Storage window is by clicking the Pools icon on the left side of the window (Figure 8-2). Figure 8-2 Access the Internal Storage window using the Pools icon Chapter 8.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm The Internal Storage window (Figure 8-3) gives an overview of the internal drives installed in the IBM Flex System V7000 Storage Node storage system. Selecting All Internal in the Drive Class Filter shows all the drives installed in the managed system, including attached expansion enclosures. Alternatively, you can filter the drives by their type or class, for example, you can choose to show only SAS, NL SAS, or SSD drives.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm More details, for example, the drive’s RPM speed or its MDisk member ID, can be shown by right-clicking the blue header bar of the table (Figure 8-4). Also, if you click the table headers, the table content can be ascending or descending sorted by the value represented in that column.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm 8.1.1 Actions on internal drives There are a few actions that can be taken on internal drives when you select the drive and right-click it, or click the Actions drop-down menu (Figure 8-5). Figure 8-5 Take actions on internal drives The Fix Error action starts the Directed Maintenance Procedure (DMP) for a defective drive.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm Internal drives: Choosing the option to take internal drives offline could lead to potential data loss. The internal drives in the IBM Flex System V7000 Storage Node storage system can be assigned to several usage roles, which either can be unused, candidate, spare, or failed. The meanings of these roles are: – Unused: The drive is not member of an MDisk (array). – Candidate: The drive is available for use in an array.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm Figure 8-8 shows the information that is displayed when you click the Identify action. Figure 8-8 Drive identification LED feature Click Turn LED Off when you are done. Clicking Show Dependent Volumes shows you the volumes that are dependent on the drives. Clicking Properties in the Actions drop-down menu, or double-clicking the drive, provides more information about the drives (Figure 8-9).
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm Figure 8-10 Properties tab with details 8.1.2 Configuring internal storage To configure internal storage for use with hosts, click Pools Internal Storage and click the Configure Storage button (Figure 8-4 on page 299). A configuration wizard opens and guides you through the process of configuring internal storage (Figure 8-11).
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm Selecting Use the recommended configuration guides you through the wizard described in “Using the recommended configuration” on page 305. Selecting Select a different configuration uses the wizard described in “Selecting a different configuration” on page 308. Before going through the storage configuration wizard, we first describe IBM Flex System V7000 Storage Node RAID configuration presets.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm Table 8-2 HDD RAID presets Preset Purpose RAID level Drives per array goal Spare goal Chain balance Basic RAID 5 Protects against a single drive failure. Data and one stripe of parity are striped across all array members. 5 8 1 All drives in the array are from the same chain wherever possible. Basic RAID 6 Protects against two drive failures. Data and two stripes of parity are striped across all array members.
8068ch08-Storage Pools.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm After creating an array, the array MDisk members are being synchronized with each other through a background initialization process. The progress of the initialization process can be monitored by clicking the icon at the left of the Running Tasks status bar and then clicking the task displayed (Figure 8-13). Figure 8-13 Running Tasks status bar The progress window opens (Figure 8-14).
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm The capacity allocation indicator shows that the allocation capacity has reached 90% after the configuration is set (Figure 8-15).
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm Figure 8-16 Select a drive class 2. Click Next and select an appropriate RAID preset (Figure 8-17) and click Next. Figure 8-17 Select a RAID preset 3. Select the Number of drives to provision in the configuration. By default, all drives with the Candidate status are included, and drives with the Unused status are made available for use in the array as well.
8068ch08-Storage Pools.fm • Draft Document for Review January 29, 2013 12:52 pm SSD Easy Tier uses two disk drives. Hence, creating an Optimized for Performance configuration is only possible if sufficient number of drives available to match your needs. As a consequence, all arrays with similar physical disks feature the same performance characteristics. Due to the defined presets, this setup might leave drives unused. The remaining unconfigured drives can be used then in another array.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm Figure 8-19 Assign capacity to an existing storage pool Alternatively, create a new storage pool and type in a name for the new storage pool (Figure 8-20). Figure 8-20 Create storage pool Click Finish to finalize the wizard. After the wizard completes, the configuration changes are reflected at the upper right of the Internal Storage window (Figure 8-21 on page 312). Chapter 8.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm Figure 8-21 Configuration complete with performance optimized setup With the performance optimized setup the IBM Flex System V7000 Storage Node creates MDisks, each containing eight drives. Additional drives remain unconfigured, as they did not meet the goal of eight drives for a Basic RAID 5 array to create another performance optimized MDisk.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm In the Capacity Optimized setup, all available Candidate disk drives are used, no “unconfigured drives” remain, unlike in the Performance Optimized setup. Figure 8-22 shows an example of the capacity optimized setup. Figure 8-22 Capacity optimized setup Provisioned drives: You can choose the number of drives to be provisioned. The wizard proposes that you create arrays from all available candidate drives.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm Figure 8-23 Access the Pools management window from the Overview window Another way to access the MDisks window is by using the Physical Storage function icon on the left (Figure 8-24).
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm The MDisks by Pools window (Figure 8-25) lets you manage all MDisks made of both internal and external storage.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm external storage systems to IBM Flex System V7000 Storage Node are discovered as unmanaged MDisks. Managed: The MDisk is assigned to a storage pool and provides extents to be used by volumes. Image: The MDisk is assigned directly to a volume with a one-to-one mapping of extents between the MDisk and the volume. 8.2.1 Adding MDisks to storage pools By adding unmanaged MDisks to a pool, their status changes to managed MDisks.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm To add an unmanaged MDisks to an existing pool select the MDisk, click Actions Add to Pool (Figure 8-28). Figure 8-28 Add an unmanaged MDisk to a storage pool Existing data: If there is existing data on the unmanaged MDisks that you need to preserve, do not select Add to Pool on this LUN, as this action deletes the data. Use Import instead, which is described in 8.2.2, “Importing MDisks” on page 320.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm After the IBM Flex System V7000 Storage Node system completes this action, the MDisk shows up in the pool that it was added to (Figure 8-30). Figure 8-30 MDisk added to pool In some cases, you may want to remove MDisks from storage pools to reorganize your storage allocation. You can remove MDisks from storage pools by selecting the MDisks and clicking Remove from Pool from the Actions drop-down menu (Figure 8-31 on page 319).
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm Figure 8-31 Remove an MDisk from the storage pool You need to confirm the number of MDisks you need to remove (Figure 8-32). If you have data on the MDisks, and you still need to remove the MDisks from the pool, select the Remove the MDisk from the storage pool even if it has data on it. The system migrates the data to other MDisks in the pool check box.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm After you click Delete, data migration from the MDisks to be removed starts. You can find the migration progress in the Running Tasks status indicator (Figure 8-33). Figure 8-33 Data migration progress when removing MDisks from the pool 8.2.2 Importing MDisks LUNs hosted on external storage systems can be migrated into IBM Flex System V7000 Storage Node storage.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm In Figure 8-34, we show an example of how to import an unmanaged MDisk. Select the unmanaged MDisk and click Import from the Actions drop-down menu or right-click the MDisk and select Import. Figure 8-34 Import MDisk As shown in Figure 8-35, the import wizard is activated and guides you through the import process.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm If you want to migrate the data from the external volume (that is being imported) to existing IBM Flex System V7000 Storage Node MDisks, choose an existing destination storage pool. Only pools with sufficient free capacity are listed in Step 2 (Figure 8-36). The actual data migration begins after the MDisk was imported successfully.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm All data has been migrated off the source MDisk to MDisks in the destination storage pool. The source MDisk has changed its status to managed and is associated with an automatically created migration pool. It can be used as a regular MDisk to host volumes (Figure 8-38).
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm Figure 8-40 MDisk mode changed to Image when no destination pool was selected during Import If needed, the image mode volume can be migrated manually into a different pool by selecting either Migration to Another Pool or Volume Copy Actions. Alternatively, the migration into another pool can be done by clicking Pools System Migration. Migration is described in greater detail in Chapter 7, “Migration wizard” on page 265.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm Any imported MDisk that has not been migrated into a pool yet is listed under Pools System Migration (Figure 8-41). Figure 8-41 Imported MDisk in the System Migration window This feature is normally used as a method to migrate data from existing external LUNs into storage pools, either located internally or externally, on the IBM Flex System V7000 Storage Node.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm Figure 8-42 Start Migration of Image mode disk Choose the wanted target storage pool to migrate the data into and click Add to Pool (Figure 8-43). Only regular pools, and no migration pools, are offered as a destination. Figure 8-43 Migrate Image Mode Volume into a regular storage pool The migration itself internally uses the volume copy function, which creates a second copy of the existing volume in the chosen target pool.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm Figure 8-44 Stop Migration When the migration progress reaches 100%, click Finalize to complete the migration process (Figure 8-45). Figure 8-45 Finalize volume migration Chapter 8.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm The original volume copy on the image mode MDisk is deleted and the newly created copy is kept. The source image mode MDisk is removed from the Migration Pool and changes its mode back to unmanaged. Figure 8-46 shows that we confirm that the link between the original source volume and the destination volume is finally broken where after the migration finalizes.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm Figure 8-47 RAID actions on Array MDisks You can choose the following RAID actions: Set Spare Goal: You can set the wanted number of spare drives that is required to protect the array from drive failures. If the number of drives assigned as Spare does not meet the configured spare goal, an error is logged in the event log that reads “Array MDisk is not protected by sufficient spares”.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm Figure 8-48 Select a drive to swap out of the MDisk In Figure 8-49, select an available Candidate or Spare drive to swap into the Array MDisk and click Finish. Figure 8-49 Select a drive to swap into the MDisk The exchange of the drives starts and runs in the background, and the volumes on the affected MDisk remain accessible. Delete: An Array MDisk can be deleted by clicking RAID Actions Delete.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm Figure 8-50 Delete Array MDisks window Available capacity: Make sure that you have enough available capacity left in the storage pool for the data on the MDisks to be removed. Data on MDisks is migrated to other MDisks in the pool, assuming enough space is available on the remaining MDisks in the pool. After deleting an MDisk from a pool, its member drives return to candidate mode. 8.2.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm Internal drives have their tier assigned automatically by the IBM Flex System V7000 Storage Node. MDisks on external storage systems are assigned the generic HDD tier by default. This setting can be changed manually by the user. To assign a specific tier to an MDisk, click Pools MDisks by Pool and click Select Tier from the Actions drop-down menu (Figure 8-51).
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm After the action has been completed successfully, the MDisk can be found in the SSD tier (Figure 8-53). Figure 8-53 The desired tier has been assigned to the MDisk The action we are performing above instructs the system to use mdisk7 as a faster disk. The IBM Flex System V7000 Storage Node will then move highly utilized storage extents to this MDisk. 8.2.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm configuration changes. Use the Detect MDisk button to rescan the Fibre Channel network and update the list of unmanaged MDisks. MDisks detection: The Detect MDisks action is asynchronous. Although the task appears to be finished, it still might be running in the background. Include Excluded MDisks: An MDisk could be excluded from the IBM Flex System V7000 Storage Node because of multiple I/O failures.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm Properties for Mdisks The Properties action for an MDisk shows the information that you need to identify it. In the MDisks by Pools window, select the MDisk and click Properties from the Actions drop-down menu. A window opens as shown in Figure 8-56. Figure 8-56 MDisk overview with general information There are three tabs in this information window. The Overview tab contains information about the MDisk itself.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm The Member Drives tab is only used with array MDisks. In the Member Drives tab, you find all the member drives of this MDisk (Figure 8-58). Also, all actions described in 8.1.1, “Actions on internal drives” on page 300 can be performed on the drives listed here. Figure 8-58 Member Drives tab The Dependent Volumes tab lists all volumes using extents on this MDisk as shown in Figure 8-59.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm 8.3 Working with storage pools Storage pools act as a container for MDisks and provision the capacity to volumes. They are comparable to MDisk Groups in IBM SAN Volume Controller or an array or a group of disks managed by a storage controller. IBM Flex System V7000 Storage Node organizes storage in storage pools to ease storage management and make it more efficient. Storage pools and MDisks are managed in MDisks by Pools window.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm Figure 8-61 Filter the pools view A few actions can be performed on storage pools using the Actions menu. A pool can be renamed, its icon can be changed, and it can be deleted from here as well. When you expand a pool’s entry by clicking the plus sign (+) to the left of the pool’s icon, you get access to the MDisks associated with this pool. You can perform all actions on them, as described in 8.
Draft Document for Review January 29, 2013 12:52 pm 8068ch08-Storage Pools.fm Figure 8-62 Delete Pool window A confirmation window opens (Figure 8-63). If there are volumes with their only copy on MDisks in the pool to be deleted, they are listed in the confirmation window. If it is safe to delete the volumes and MDisks in this pool, even though they still might be mapped to a host, select the Delete all volumes, host mappings and MDisks that are associated with this pool check box and click Delete.
8068ch08-Storage Pools.fm Draft Document for Review January 29, 2013 12:52 pm Important: After you delete the pool, all the data in the pool is lost except for the image mode MDisks; their volume definition is deleted, yet the data on the imported MDisk remains untouched. After you delete a pool, all associated volumes and their host mappings are removed. Figure 8-64 shows that the MDisks in the Migration Pool is returned to the Not in a Pool MDisk group.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm 9 Chapter 9. IBM Flex System V7000 Storage Node Copy Services In this chapter, we describe the Copy Service features provided by the IBM Flex System V7000 Storage Node. All the copy services features of the IBM Flex System V7000 Storage Node are provided by the shared code of the IBM SAN Virtual Controller (SVC) and the IBM Storwize V7000, and all function in the same manner.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm 9.1 Services provided The IBM Flex System V7000 Storage Node features the following copy services capabilities: Flashcopy Synchronous remote copy Asynchronous remote copy These functions are useful for making data copies for backup, application test, disaster recovery, and so on. To decide on the functions to be used to meet a need, it is best to plan for the desired results.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm business perspective, and then determine if FlashCopy fulfills the technical needs of those business requirements.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm volume. Additionally, the source and target volumes must belong to the same IBM Flex System V7000 Storage Node, but they do not have to reside in the same storage pool.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Read I/O request to target: Reads are performed from the target if the grains have already been copied; otherwise, the read is performed from the source. Write I/O request to target: Writes to the target cause the grain to be copied from the source to the target unless the entire grain is being written, and then the write completes to the target.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm mapping source volume after the copy is complete. When the background copy is disabled, the target volume only remains a valid copy of the source data while the FlashCopy mapping remains in place. Copying only the changed data saves your storage capacity (assuming it is thin provisioned and -rsize has been correctly setup.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm FlashCopy mapping states At any point in time, a mapping is in one of the following states: Idle or Copied The source and target volumes act as independent volumes even if a mapping exists between the two. Read and write caching is enabled for both the source and the target volumes. If the mapping is incremental and the background copy is complete, the mapping only records the differences between the source and target volumes.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Any data that has not been flushed and has been written to the source or target volume before the suspension is in cache until the mapping leaves the suspended state. FlashCopy consistency groups Consistency groups address the requirement to preserve point-in-time data consistency across multiple volumes for applications having related data that spans them.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm The database ensures the correct ordering of these writes by waiting for each step to complete before starting the next step. However, if the database log (updates 1 and 3) and the database itself (update 2) are on separate volumes, when creating FlashCopy images it is possible for the FlashCopy of the database volume to occur before the FlashCopy of the database log.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm The consistency group is ready to start. While in this state, the target volumes of all FlashCopy mappings in this consistency group are not accessible. Copying At least one FlashCopy mapping in the consistency group is in the Copying state and no FlashCopy mappings are in the Suspended state.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm 2. Create a FlashCopy mapping for the backup to be restored with the target volume being the source volume and the original source production as the target volume, if this mapping does not already exist. 3. Start the FlashCopy map (Target Data -> Customer Data) with the -restore option to copy the backup data onto the production disk.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm FlashCopy property Maximum FlashCopy mappings per consistency group 512 FlashCopy presets The IBM Storwize V7000 storage system provides three FlashCopy presets, named Snapshot, Clone, and Backup, to simplify the more common FlashCopy operations (Table 9-3). Table 9-3 FlashCopy presets Preset Purpose Snapshot Creates a point-in-time view of the production data.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Figure 9-4 shows the Copy Services function icon. Figure 9-4 Copy Services function icon Most of the actions to manage the FlashCopy mapping could be done both in the FlashCopy window or the FlashCopy Mappings windows, although the quick path to create FlashCopy presets can only be found in the FlashCopy window. Chapter 9.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Click FlashCopy in the Copy Services function icon menu, and the FlashCopy window opens (Figure 9-5). In the FlashCopy window, the FlashCopy mappings are organized by volumes. Figure 9-5 FlashCopy window Click FlashCopy Mappings in the Copy Services function icon menu, and the FlashCopy Mappings window opens (Figure 9-6). In the FlashCopy Mappings window, the FlashCopy mappings are listed one by one.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm The Consistency Groups window could be used to manage the consistency groups for FlashCopy mappings. Click Consistency Groups in the Copy Services function icon menu, and the Consistency Groups window opens (Figure 9-7). Figure 9-7 Consistency Groups window Quick path to create FlashCopy presets It is easy to create FlashCopy using the presets in the FlashCopy window.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm You now have a snapshot volume for the volume you choose. Creating a clone In the FlashCopy window, choose a volume and click New Clone from the Actions drop-down menu (Figure 9-9). Figure 9-9 Create a clone from the preset You now have a clone volume for the volume you choose.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Creating a backup In the FlashCopy window, choose a volume and click New Backup from the Actions drop-down menu (Figure 9-10). Figure 9-10 Create a backup from the preset You now have a backup volume for the volume you choose. Chapter 9.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Now, in the FlashCopy window, you find three FlashCopy target volumes under the source volume (Figure 9-11). The progress bars behind the target volumes indicate the copy progress in percentage. The copy progress remains 0% for snapshot; there is no change happening at the moment because only the changed data is being copied. At the same time, the copy progresses for clone and backup keep increasing.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm The copy progress can be also found under the Running Tasks status indicator (Figure 9-12). This view is slightly different than the Remote Copy Running Tasks status indicator. Figure 9-12 The FlashCopy progress After the copy progresses complete, you find the FlashCopy with the clone preset has been deleted automatically (Figure 9-13). Figure 9-13 FlashCopy progresses complete 9.2.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Creating FlashCopy mappings You can create FlashCopy mappings through the FlashCopy window. Select the volume you want to be the source volume for the FlashCopy mapping and click Advanced FlashCopy... from the Actions drop-down menu (Figure 9-14). Figure 9-14 Create advanced FlashCopy You have two options: Click Create new target volumes, if you have not created the target volume yet. a.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm It is the same with backup preset, and the default settings of backup preset are found when you click Advanced Settings, after you select the backup preset (Figure 9-18), which includes: • • • • Background Copy: 50 Incremental: Yes Auto Delete after completion: No Cleaning Rate: 50 Figure 9-18 Default settings for the backup preset Change the settings of the FlashCopy mapping according to your requirements and click Next. b.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Figure 9-20 Choose use the same storage pool with the source volume d. You can also specify some other storage pool for your new volume (Figure 9-21). Click Next to continue. Figure 9-21 Choose another storage pool to create the volume e. You are prompted to select how you want to manage volume capacity. Create a generic volume is your default choice.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Figure 9-23 The default choice when creating a FlashCopy mapping f. Click Finish when you make your decision, and the FlashCopy mapping is created on your volume with a new target (Figure 9-24). The status of the newly created FlashCopy mapping is Idle; it could be started, as described in “Starting a FlashCopy mapping” on page 367.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm In the Advanced FlashCopy menu, if you already have candidate target volumes, select Use existing target volumes (Figure 9-25). Figure 9-25 Create FlashCopy mapping using existing target volume a. You need to choose the target volume for the source volume you selected. Select the target volume in the drop-down menu in the right pane of the window and click Add (Figure 9-26). Figure 9-26 Select the target volume Chapter 9.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm b. After you click Add, the FlashCopy mapping is listed (Figure 9-27). Click the red X if the FlashCopy mapping is not the one you want to create. If the FlashCopy mapping is what you want, click Next to continue. Figure 9-27 Add FlashCopy mapping c. Select the preset and adjust the settings (Figure 9-28). Make sure that the settings meet your requirements, and click Next.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm You can also create the FlashCopy mappings in the FlashCopy Mapping window by clicking New FlashCopy Mapping at the upper left, as shown in Figure 9-30. Figure 9-30 Create a FlashCopy mapping in the FlashCopy Mappings window A wizard opens to guide you through the creation of a FlashCopy mapping, and the steps are the same as creating an advanced FlashCopy mapping using existing target volumes in the FlashCopy window.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Figure 9-31 Start FlashCopy mapping Stopping a FlashCopy mapping The FlashCopy mapping can be stopped by selecting the FlashCopy target volume in the FlashCopy window and clicking the Stop option from the Actions drop-down menu (Figure 9-32). After the stopping process completes, the status of the FlashCopy mapping is changed to Stopped.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Renaming the target volume If the FlashCopy target volumes were created automatically by IBM Flex System V7000 Storage Node system, the name of the target volumes is the source volume name plus a suffix containing numbers. The name of the target volumes could be changed to be more meaningful in your environment.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm To change the name of a FlashCopy mapping, select the FlashCopy mapping in the FlashCopy Mappings window and click the Rename Mapping option from the Actions drop-down menu (Figure 9-35). Figure 9-35 Rename a FlashCopy mapping You need to enter your new name for the FlashCopy mapping (Figure 9-36). Click Rename to finish.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Deleting a FlashCopy mapping The FlashCopy mapping can be deleted by selecting the FlashCopy target volume in the FlashCopy window and clicking the Delete Mapping option from the Actions drop-down menu (Figure 9-37). Figure 9-37 Select Delete Mapping FlashCopy Mapping state: If the FlashCopy mapping is in the Copying state, it must be stopped before being deleted.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Deleting FlashCopy mapping: Deleting the FlashCopy mapping does not delete the target volume. If you need to reclaim the storage space occupied by the target volume, you need to delete the target volume manually.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Editing properties The background copy rate and cleaning rate can be changed after the FlashCopy mapping has been created by selecting the FlashCopy target volume in the FlashCopy window and clicking the Edit Properties option from the Actions drop-down menu (Figure 9-41).
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Figure 9-43 Access to the Consistency Groups window The Consistency Groups window (Figure 9-44) is where you can manage both consistency groups and FlashCopy mappings. Figure 9-44 Consistency Groups window In the left pane of the Consistency Groups window, you can list the consistency groups you need. Click Not in a Group, and then expand your selection by clicking the plus icon next to Not in a Group.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm consistency groups and FlashCopy mappings within the Consistency Groups window, as allowed by their state. All the actions allowed for the FlashCopy mapping are described in 9.2.5, “Managing FlashCopy mapping” on page 359. Creating a FlashCopy consistency group To create a FlashCopy consistency group, click New Consistency Group at the top of the Consistency Groups window (Figure 9-44 on page 374).
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Selections of a range are performed by highlighting a mapping, pressing and holding the Shift key, and clicking the last item in the range. Multiple selections can be made by pressing and holding the Ctrl key and clicking each mapping individually. Figure 9-47 Select the FlashCopy mappings to add to a consistency group You are prompted to specify which consistency group you want to move the FlashCopy mapping into (Figure 9-48).
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Starting a consistency group To start a consistency group, click Start from the Actions drop-down menu (Figure 9-49). Figure 9-49 Start a consistency group After you start the consistency group, all the FlashCopy mappings in the consistency group are started at the same time. The state of the FlashCopy changes to Copying (Figure 9-50).
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Figure 9-51 Stop a consistency group After the stop process completes, the FlashCopy mappings in the consistency group are in the Stopped state, and a red “X” icon appears on the function icon of this consistency group to indicate an alert (Figure 9-52).
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Removing FlashCopy mappings from a consistency group The FlashCopy mappings can be removed from a consistency group by selecting the FlashCopy mappings and clicking Remove from Consistency Group from the Actions drop-down menu of the FlashCopy mapping (Figure 9-53). Figure 9-53 Remove from consistency group The FlashCopy mappings are returned to the Not in a Group list after being removed from the consistency group.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm 9.3 Remote Copy In this section, we describe how the Remote Copy function works in IBM Flex System V7000 Storage Node. We also provide the implementation steps, using the GUI, for Remote Copy configuration and management. Remote Copy consists of three methods for copying: Metro Mirror, Global Mirror, and Global Mirror with Change Volumes. Metro Mirror is designed for metropolitan distances with a synchronous copy requirement.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Introduction to layers Version 6.4.1 uses a concept called layers for the IBM Flex System V7000 Storage Node. The setting for the layers determine how the IBM Flex System V7000 Storage Node interacts with the other IBM Flex System V7000 Storage Node, IBM Storwize V7000 or IBM SAN Volume Controller. Currently there are two layers: replication and storage.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Limitations on the SAN Volume Controller and Storwize V7000 partnership With Version 6.4.1, the IBM Flex System V7000 Storage Node, SAN Volume Controller, and IBM Storwize V7000 systems can be partners in a Remote Copy partnership. There are however, a few limitations: The layer for both the IBM Flex System V7000 Storage Node and the IBM Storwize V7000 must be set to replication for remote copy to work with the SVC in the mix.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Figure 9-58 Star topology for IBM Flex System V7000 Storage Node Full-meshed topology (Figure 9-59) Figure 9-59 Full-meshed IBM Flex System V7000 Storage Node Partnerships: These partnerships are also valid for mixed configurations with SAN Volume Controllers as long as the replication layer is set.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Indicates that the partnership is defined on the local and remote clusters and is started. Remote Not Present Indicates that the remote cluster is not present for the partnership. Partially Configured (Local Stopped) Indicates that the local cluster is only defined to the remote cluster and the local cluster is stopped.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm The two volumes in a relationship must be the same size. The Remote Copy relationship can be established on the volumes within one IBM Flex System V7000 Storage Node system, which is called an intra-cluster relationship.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Global Mirror Global Mirror provides an asynchronous copy, which means that the secondary volume is not an exact match of the primary volume at every point in time. The Global Mirror function provides the same function as Metro Mirror Remote Copy without requiring the hosts to wait for the full round-trip delay of the long-distance link; however, some delay can be seen on the hosts in congested or overloaded environments.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Figure 9-61 Global Mirror write sequence The Global Mirror algorithms maintain a consistent image on the auxiliary volume at all times. They achieve this consistent image by identifying sets of I/Os that are active concurrently at the master, assigning an order to those sets, and applying those sets of I/Os in the assigned order at the secondary.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm To address these issues, Change Volumes were added as an option for Global Mirror relationships. Change Volumes use the FlashCopy functionality, but cannot be manipulated as FlashCopy volumes, as they are special purpose only. Change volumes are used at both the primary and secondary end of the replication link.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm This situation provides an always consistent image at the target site and protects your data from being inconsistent during re synchronization. Take a closer look at how Change Volumes might reduce replication traffic. Figure 9-64 shows a number of I/Os on the source volume and the same number on the target volume, and in the same order.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Important: When using Global Mirror volumes with Change Volumes, make sure that you remember to select the Change Volume on the auxiliary (target) site. Failure to do so leaves you exposed during a resynchronization operation. Important: The GUI for Version 6.4.1 automatically creates Change Volumes for you. However, it is a limitation of this initial release that they are fully provisioned volumes.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm added to the consistency group. After the consistency group is assigned a copy type, only relationships of that copy type can be added to the consistency group. Remote Copy and consistency group states Stand-alone Remote Copy relationships and consistency groups share a common configuration and state model. All of the relationships in a non-empty consistency group have the same state as the consistency group.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm ConsistentDisconnected The volumes in this half of the consistency group are all operating in the secondary role and can accept read I/O operations but not write I/O operations. Empty The consistency group does not contain any relationships. 9.3.3 Remote Copy planning Before you use Remote Copy, you need to plan for its usage.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm as Global Mirror with Change Volumes and should have Change Volumes defined for both the source and target volumes when used. This capability provides options to help administrators balance network bandwidth requirements and RPO times for applications, helping reduce operation costs for disaster recovery solutions.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Parameter Value Total Remote Copy volume capacity per I/O Group 1024 TB (This limit is the total capacity for all master and auxiliary volumes in the I/O group.) SAN planning for Remote Copy Here are guidelines for planning for a SAN for Remote Copy. Zoning recommendation Node canister ports on each IBM Storwize V7000 must be able to communicate with each other in order for the partnership creation to be performed.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Remote Copy link requirements The link requirements are valid for Metro Mirror and Global Mirror. Basically, there are two link requirements: Round-trip latency The total round-trip latency must be less than 80 ms, and less than 40 ms in each direction.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Table 9-5 FlashCopy and Remote Copy interaction Component Remote Copy primary site Remote Copy secondary site FlashCopy source Supported Supported. When the FlashCopy relationship is in the Preparing and Prepared states, the cache at the Remote Copy secondary site operates in write-through mode. This process adds additional latency to the already latent Remote Copy relationship.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Primary 2145 cluster or SAN fabric configuration (10%) Secondary 2145 cluster or SAN fabric problem (15%) Secondary 2145 cluster or SAN fabric configuration (25%) Inter-cluster link problem (15%) Inter-cluster link configuration (25%) In practice, the error that is most often overlooked is latency. Global Mirror has a round-trip-time tolerance limit of 80 ms.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Figure 9-68 The effect of packet size (in bytes) versus the link size Before you proceed, take a quick look at the second largest component of your round-trip-time, that is, serialization delay. Serialization delay is the amount of time required to move a packet of data of a specific size across a network link of a given bandwidth.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm for each node per I/O group. One port for each node per I/O group associated with the host is the recommended zoning configuration for fabrics. For those fabrics with 64 or more host ports, this recommendation becomes a rule. You must follow this zoning rule or the configuration is technically unsupported. Improper zoning leads to SAN congestion, which can inhibit remote link communication intermittently.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Figure 9-69 Partnership window Creating a partnership No partnership is defined in our example (Figure 9-70), so you must create a partnership between the IBM Flex System V7000 Storage Node system and the other mirroring member. Click New Partnership in the Partnership window. Figure 9-70 Create a cluster partnership If there is no partnership candidate, an error window opens (Figure 9-71 on page 401).
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Figure 9-71 No candidates are available to create a partnership Check the zoning and the system status and make sure that the clusters can “see” each other. Then you can create your partnership by selecting the appropriate remote storage system (Figure 9-72), and defining the available bandwidth between both systems.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Complete the same steps on the second storage system that becomes a fully configured partner. The Remote Copy partnership is now implemented between two IBM Flex System V7000 Storage Node systems and both systems are ready for further configuration of Remote Copy relationships (Figure 9-74).
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Figure 9-76 Stop the partnership Chapter 9.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm After you have stopped the partnership, your partnership is listed as Fully Configured: Stopped (Figure 9-77). Figure 9-77 Fully configured partnership in stopped state You can restart a stopped partnership by clicking Start Partnership from the Actions drop-down menu (Figure 9-78). Figure 9-78 Start partnership The partnership returns to the fully configured status when it has been restarted.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm 9.5.2 Deleting a partnership You can delete a partnership by selecting Delete Partnership from the Actions drop-down menu (Figure 9-79). Figure 9-79 Delete a partnership Managing stand-alone Remote Copy relationships A Remote Copy relationship can be defined between two volumes, where one is the master (source) and the other one is the auxiliary (target) volume.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm The Remote Copy window (Figure 9-81) is where you can manage Remote Copy relationships and Remote Copy consistency groups. Figure 9-81 Remote Copy window In the left pane of the Remote Copy window, there is a consistency group filter to list Remote Copy consistency groups that meet your requirements.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Note: The use of creating a mirror relationship on the local system is frequently used to develop an understanding of the remote copy procedures and usage, as well as for testing purposes. In our example (Figure 9-83), choose another system to build an inter-cluster relationship. Click Next to continue. Figure 9-83 Select Remote Copy partner The Remote Copy master and auxiliary volume need to be specified.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm A window opens and asks if the volumes in the relationship are already synchronized. In most situations, the data on the master volume and on the auxiliary volume are not identical, so click No and click Next to enable an initial copy (Figure 9-86). Figure 9-86 Activate initial data copy If you select Yes, the volumes are already synchronized in this step, a warning message opens (Figure 9-87).
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm After the Remote Copy relationships creation completes, two independent Remote Copy relationships are defined and displayed in the Not in a Group list (Figure 9-89). Figure 9-89 Remote Copy relationship create completes Optionally, you can monitor the ongoing initial synchronization in the Running Tasks status indicator (Figure 9-90).
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Figure 9-91 Stop Remote Copy relationship Allow secondary read/write access, if required, and click Stop Relationship (Figure 9-92). Figure 9-92 Option to allow secondary read/write access After the stop completes, the state of the Remote Copy relationship is changed from Consistent Synchronized to Idling (Figure 9-93). Read / write access to both volumes is now allowed.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Starting a stand-alone Remote Copy relationship The Remote Copy relationship can be started by selecting the relationship and clicking Stop from the Actions drop-down menu (Figure 9-94). Figure 9-94 Start a Remote Copy relationship When starting a Remote Copy relationship, the most important item is selecting the copy direction. Both master and auxiliary volumes could be the primary.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Switching the direction of a stand-alone Remote Copy relationship The copy direction of the Remote Copy relationship could be switched by selecting the relationship and clicking Switch from the Actions drop-down menu (Figure 9-96). Figure 9-96 Switch Remote Copy relationship A warning message opens and shows you the consequences of this action (Figure 9-97).
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Figure 9-98 Note the switch icon on the state of the relationship Renaming a stand-alone Remote Copy relationship The Remote Copy relationship can be renamed by selecting the relationship and clicking Rename from the Actions drop-down menu (Figure 9-99). Figure 9-99 Rename the Remote Copy relationship Chapter 9.
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Enter the new name for the Remote Copy relationship and click Rename (Figure 9-100). Figure 9-100 Enter a new name for the Remote Copy relationship Deleting a stand-alone Remote Copy relationship The Remote Copy relationship can be deleted by selecting the relationship and clicking Delete Relationship from the Actions drop-down menu (Figure 9-101).
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm 9.5.3 Managing a Remote Copy consistency group A Remote Copy consistency group can be managed from the Remote Copy window as well. Creating a Remote Copy consistency group To create a Remote Copy consistency group, click New Consistency Group (Figure 9-103). Figure 9-103 Create a consistency group You need to enter a name for your new consistency group (Figure 9-104).
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Figure 9-106 New Remote Copy consistency group You can find the name and the status of the consistency group beside the Relationship function icon. It is easy to change the name of consistency group by clicking the name and entering a new one. At the upper right of the Remote Copy window, you can take actions on the Remote Copy consistency group.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Figure 9-108 Choose the consistency group to add the remote copies to Your Remote Copy relationships are now in the consistency group you selected. Starting a consistency group The Remote Copy relationship could be started by clicking Start from the Actions drop-down menu (Figure 9-109). Figure 9-109 Start the consistency group You can select the copy direction of the consistency group (as required) (Figure 9-110).
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Stopping a consistency group The Remote Copy relationship can be stopped by clicking Stop in the Actions drop-down menu (Figure 9-111). Figure 9-111 Stop the consistency group You can allow read / write access to secondary volumes by selecting the check box (Figure 9-112) and clicking Stop Consistency Group.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Switching a consistency group As with the switch action on the Remote Copy relationship, you can switch the copy direction of the consistency group as well. To switch the copy direction of the consistency group, click Switch from the Actions drop-down menu (Figure 9-113). Figure 9-113 Switch the copy direction of a consistency group A warning message opens (Figure 9-114).
8068ch09-Copy Servies.fm Draft Document for Review January 29, 2013 12:52 pm Figure 9-115 Remove Remote Copy relationships from a consistency group You are prompted to confirm the Remote Copy relationships you want to delete from the consistency group (Figure 9-116). Make sure the Remote Copy relationships shown in the box are the ones you need to remove from the consistency group, and click Remove to proceed.
Draft Document for Review January 29, 2013 12:52 pm 8068ch09-Copy Servies.fm Figure 9-117 Delete a consistency group You must confirm the deletion of the consistency group (Figure 9-118). Click OK if you are sure that this consistency group should be deleted. Figure 9-118 Warning to confirm deletion of the consistency group The consistency group is deleted. Chapter 9.
8068ch09-Copy Servies.
Draft Document for Review January 29, 2013 12:52 pm 8068ch10-Volume Mirror and Migration.fm 10 Chapter 10. Volume Mirroring and Migration This chapter discusses a number of the details and capabilities of the volume mirroring function. This feature was originally developed as a part of the IBM SAN Volume Controller (SVC) and is shared with the IBM Flex System V7000 Storage Node.
8068ch10-Volume Mirror and Migration.fm Draft Document for Review January 29, 2013 12:52 pm 10.1 Volume mirroring and migration options Volume mirroring is a function that is designed to allow a volume to remain online even when the primary storage pool backing it becomes inaccessible. This function is designed to protect the volume from storage infrastructure failures by providing seamless mirroring between different storage pools.
Draft Document for Review January 29, 2013 12:52 pm 8068ch10-Volume Mirror and Migration.fm volume storage pool creating a copy without putting any metadata on the original device (Image mode mdisk); therefore, leaving the source data intact. After they are migrated in they are fully accessible as volumes for use by host and any of the other features of the IBM Flex System V7000 Storage Node.
8068ch10-Volume Mirror and Migration.fm Draft Document for Review January 29, 2013 12:52 pm Figure 10-2 Add Volume Mirrored Copy After you complete this action, you can specify the type of volume mirror, that is, generic or thin provisioned, and select the storage pool to use for the copy (Figure 10-3). Make sure that you select a storage pool with sufficient space and similar performance characteristics, and then click Add Copy.
Draft Document for Review January 29, 2013 12:52 pm 8068ch10-Volume Mirror and Migration.fm After you create your mirror, you can view the distribution of extents on the assigned mdisks for each copy or for the entire volume (Figure 10-4). You can also view the mirroring progress percentage by high lighting the volume and selecting the Volume Synchronization tab in the Running Tasks radial (Figure 10-5).
8068ch10-Volume Mirror and Migration.fm Draft Document for Review January 29, 2013 12:52 pm Figure 10-6 Selection of Split into New Volume After you click Split into New Volume on either Copy0 or Copy1, you can specify a new volume name and confirm the split (Figure 10-7). Figure 10-7 Confirmation of volume mirror split After providing a new volume name (optional) and confirming the split, you can see the results as shown in Figure 10-8.
Draft Document for Review January 29, 2013 12:52 pm 8068ch10-Volume Mirror and Migration.fm Splitting volume copies: When you split a volume copy, the view returns to the pool in which it was created, not to where the primary copy exist. If you want to migrate your volumes to another storage pool in one step instead of two, you can use the Migrate to Another Pool option (Figure 10-9).
8068ch10-Volume Mirror and Migration.fm Draft Document for Review January 29, 2013 12:52 pm If the volume has only one copy, a storage pool selection window opens. If it has two, the same window with a variation that allows you to choose the copy to migrate opens as shown in Figure 10-10.
Draft Document for Review January 29, 2013 12:52 pm 8068ch11-SAN Config.fm 11 Chapter 11. SAN Connections and Configuration This chapter discusses the types of connectivity of IBM Flex System V7000 Storage Node to the compute nodes in the IBM Flex System Enterprise Chassis for storage provisioning. It includes the three types of storage area network - fibre channel (FC), iSCSI, and FC over Ethernet (FCoE).
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm 11.1 Storage Area Network Overview Storage Area Network (SAN) has long been regarded as consisting of dedicated equipment which connects host servers to share remote storage. This has enabled storage of varying size and performance to be used and allocated more efficiently and help eliminating islands of storage.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm nodes. As stated in 2.4.1, “Control canister” on page 48, each canister on the IBM Flex System V7000 Storage Node has host attachments on one control canister which match the configuration of the second canister and must use the same slots.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 11-1 Logical layout of Storage Node to I/O module switch interconnects I/O Module connection summary The storage node canister can communicate with all 4 of the I/O switch modules in the IBM Flex System Enterprise Chassis via both of the canister Network Adapters.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 11-2 SAN Connectivity within the IBM Flex System Enterprise Chassis 11.3 iSCSI Connectivity The Internet Small Computer System Interface (iSCSI) protocol is the encapsulation of the industry standard SCSI protocol within TCP/IP packets. The iSCSI protocol provides a block-level storage capability similar to Fibre Channel (FC) storage area network (SAN) technology.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Otherwise, it issues an unsuccessful login. iSCSI can support multiple connections per session (MCS) to increase aggregate bandwidth or, for several links, to improve reliability. PDU structure A protocol data unit is the basic message packet that travels between a client and target. It consists of a basic header segment (BHS) and additional headers segments (AHS).
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 11-3 compares the iSCSI initiator technologies.
8068ch11-SAN Config.
Draft Document for Review January 29, 2013 12:52 pm 8068ch11-SAN Config.fm If the Microsoft Windows clustered system is rebuilt or restored from a backup, hosts must log off and then log back on to any previously connected iSCSI targets that are supplied from the system. If the host application uses SCSI 3 Persistent Reservation, you must run only a single iSCSI session.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 11-6 iSCSI redundancy using both Ethernet switches 11.3.5 Configuring Multiple iSCSI Host Links This section will show how to configure the IBM Flex System V7000 Storage Node canisters for multiple connections to a x240 compute node running MS Windows. The example will create the configuration as shown in Figure 11-6, the x240 compute node has two Ethernet adapter ports which are already configured with IP addresses.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Table 11-1 IP port configuration on IBM Flex System V7000 Storage Node canisters Canister Ethernet Port IP Address left Port 2 192.168.1.10 left Port 3 192.168.2.10 right Port 2 192.168.1.20 right Port 3 192.168.2.20 The host is detailed in section 6.2.2, “Create an iSCSI attached host” on page 259 where the IQN of the x240 compute node is defined.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm 11.4 FCoE Connectivity Fibre Channel over Ethernet (FCoE) is a method of sending Fibre Channel frames directly over an Ethernet network. It relies on a new Ethernet transport with extensions that provide lossless transmission of storage data.
Draft Document for Review January 29, 2013 12:52 pm 8068ch11-SAN Config.fm Figure 11-8 FCoE protocol mapping Figure 11-9 on page 444 shows another perspective on FCoE layering compared to other storage networking technologies. The FC and FCoE layers are shown with the other storage networking protocols along with iSCSI. In general, an FCoE network contains servers, lossless Ethernet (DCB-capable) switches, Fibre Channel Forwarders (FCFs) that provide FC fabric services, and storage devices.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 11-9 Storage Network Protocol Layering 11.4.1 Converged Network Adapters In a traditional FC storage area network (SAN) and LAN environment, the server has an Ethernet adapter for data traffic and a Fibre Channel host bus adapter (HBA) for storage traffic. With converged networks which may include FCoE, these two adapters are replaced by a converged network adapter (CNA) that services both protocol stacks.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 11-10 Compute node with CNA and FCF I/O module switch Fibre Channel Forwarders The IBM Flex System Fabric CN4093 10Gb Converged Scalable Switch has an optional Fibre Channel Forwarder. The FCF function is the FC switching element in an FCoE SAN. It provides functions that are analogous to the functions provided by the FC switch in a traditional FC SAN.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 11-11 Port type between Compute nodes and IBM Flex System Enterprise Chassis switches FCoE Initialization Protocol and snooping bridges In a traditional FC network, with point-to-point links between an end device and an FC switch, the end device logs in to the fabric. The device exchanges information with the switch by using well-known addresses over its direct link to the switch.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm undesirable FCoE or FIP traffic. The CN4093 provides FIP snooping function allows the compute node to log in establishing the VN_Port to VF_Port virtual link. For more information about FIP, see the FC-BB-5 standard at: http://fcoe.com/09-056v5.pdf MAC addresses used by end devices End devices such as the compute nodes (ENodes in the FC-BB-5 standard) use virtual MAC addresses for their VN_Ports.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Table 11-2 IBM Flex System CN4054 10Gb Virtual Fabric Adapter Ports) Port Type Port Name / Range Description Ethernet Ports (Internal) INTA1-INTA14 (ports 1-14), INTB1-INTB14 (15-28), INTC1-INTC14 (29-42) These standard 10Gb SFP+ Ethernet ports connect internally to compute nodes and storage in the system chassis.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 11-12 Internal and External port inclusion for FCoE VLAN With this VLAN created, FCoE zones can be configured to map Compute Node 11 to IBM Flex System V7000 Storage Node via internal ports INTA3+4, and/or to external storage via port EXT12.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm It is necessary to complete the above steps in the correct order for the configuration to be successful. In Example 11-1 the ISCLI commands display shows the Omni ports EXT11-12 are changed from their ethernet default to Fibre Channel after the Converged Enhanced Ethernet (CEE) and FCoE Initialization Protocol (FIP) snooping is enabled.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Router(config-vlan)# The next step is to enable Fibre Channel Forwarding (FCF) where Example 11-4 shows the ISCLI command fcf enable run where on completion FCoE connections are established.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 11-13 Active 10Gb Ethernet on Canister 1 Figure 11-14 shows the active Ethernet port for Canister 2 of the IBM Flex System V7000 Storage Node. By comparing the canister PWWNs with Example 11-5 on page 451 you can see that Canister 1 uses port INTA3 and Canister 2 uses INTA4.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Create Zone Create Zoneset Activate Zoneset This process is very much the same as is used on FC zoning. Example 11-6 shows from the ISCLI creating a zones and populating it with PWWNs from Compute Node 11 and each canister of the IBM Flex System V7000 Storage Node.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm System Enterprise Chassis where a second host port can be added to the host name. This will eliminate one of the switches as being a point of failure. The same VLAN number must be used, in the above example we used VLAN 1002.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm 11.5 Fibre Channel Connectivity Fibre Channel (FC) is an open, technical standard for networking which incorporates the “channel transport” characteristics of an I/O bus, with the flexible connectivity and distance characteristics of a traditional network. Due to its channel-like qualities, hosts and applications see storage devices attached to the SAN as though they are locally attached storage.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm System Enterprise Chassis the compute nodes are the initiators with IBM Flex System V7000 Storage Node being the target. Fibre Channel architecture is extremely flexible in its potential application. Fibre Channel transport layers are protocol independent, enabling the transmission of multiple protocols.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm layer is used to integrate the data with the clock information required by serial transmission technologies. Framing and signaling protocol: FC-2 – Reliable communications result from Fibre Channel’s FC-2 framing and signaling protocol. FC-2 specifies a data transport mechanism that is independent of upper layer protocols. Upper layers The Upper layer includes two layers: FC-3 and FC-4.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm 11.5.1 Fibre Channel Topologies Fibre Channel provides three distinct and one hybrid interconnection topologies. By having more than one interconnection option available, a particular application can choose the topology that is best suited to its requirements. The three Fibre Channel topologies are: – Point-to-point, the point-to-point topology consists of a single connection between two nodes.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm IBM Flex System Enterprise Chassis External SAN Figure 11-19 FC point to point topology within the IBM Flex System Enterprise Chassis 11.5.2 FC addressing and port types In a Fibre Channel environment the unique identity of participants are maintained through a hierarchy of fixed names and assigned addresses identifiers. In Fibre Channel terminology, a communicating device is a node.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm – Fabric ports (F_Port), these ports are found in Fibre Channel switched fabrics. They are not the source or destination of IU’s, but instead function only as a “middle-man” to relay the IUs from the sender to the receiver. F_Ports can only be attached to N_Ports. – Expansion ports (E_Port), these ports are found in Fibre Channel switched fabrics and are used to interconnect the individual switch or routing elements.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 11-20 Login prompt for FC switch access Figure 11-21shows the first screen when logged in initially, the bay ports and adapters are displayed with ports which have logged into the switch. The IBM Flex System V7000 Storage Node occupies node bays 1-4. The positions can be verified with the CMM chassis display.
8068ch11-SAN Config.fm 1. 2. 3. 4. 5. 6. Draft Document for Review January 29, 2013 12:52 pm creating a zoneset creating aliases creating a zone adding aliases to a zone adding a zone to zoneset activating the zoneset Figure 11-22 shows from the main menu how to access and configure zoning by clicking on ‘Zoning’ and select ‘Edit Zoning ...’ option. Figure 11-22 Access the zoning configuration window Creating a Zoneset From this option the screen in Figure 11-23 on page 463 is displayed where: 1.
Draft Document for Review January 29, 2013 12:52 pm 8068ch11-SAN Config.fm Figure 11-23 Creating a zoneset Creating an Alias The next task is to create aliases for the WWN (shown in the right hand display in Figure 11-23), to do this from the main zoning screen, click the ‘Alias’ box and enter the alias name in the ‘Create Alias’ window as shown in Figure 11-24 on page 464 and click the ‘OK’ box when completed.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 11-24 Creating an alias name A WWN has to be added to the alias just created. In Figure 11-25 on page 465 with the mouse, highlight the alias you wish to use and the WWN that you want to add. In this example we have created the alias ‘RH_Can’ and now wish to add the WWN as seen from the right hand column. The WWN in Bay 4 is from the right hand canister so have selected this to add.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 11-25 Add WWN to alias When this is completed, you can check that the WWN has been added to the alias as shown in Figure 11-26 Figure 11-26 Check that WWN has been added to alias Create Zone We now want to create a zone and add to it aliases that are already created. Figure 11-27 on page 466 shows the main zoning window, highlight the zoneset you wish the zone to belong to and click the ‘Zone’ square.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 11-27 Create and name a zone Adding an alias to a zone Figure 11-28 shows the highlighted alias where it is dragged using the mouse onto the required zone. This is repeated for all aliases required in that zone.
Draft Document for Review January 29, 2013 12:52 pm 8068ch11-SAN Config.fm Notice that the zone is associated with the required zoneset as specified when the zone was created and named in Figure 11-27 on page 466. Activate the Zoneset The aliases and zones have been created and placed in the zoneset, all that is required now is to activate the zoneset.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 11-30 Re confirm zoneset activation When you have completed all zoning, click the ‘Close’ box to the right of the ‘Apply’ box to return to the main switch menu. This process needs to be repeated for the second FC3171 8Gb SAN Switch in the chassis so as to allow for redundancy by using both fabrics in the chassis. 11.5.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm configuration and management is undertaken. This negates the zoning requirement described previously to be carried out on the FC3171 8Gb SAN Switch. Figure 11-31 shows how to enable ‘Transparent Mode’. From the main Switch view select ‘Switch’ option in top left of the window then click on ‘Advanced Switch Properties’ with the mouse.
8068ch11-SAN Config.fm Draft Document for Review January 29, 2013 12:52 pm N_Port ID Virtualization In Transparent Mode the FC3171 8Gb SAN Switch becomes a gateway device on FC SAN. A gateway device that uses NPIV technology might be referred to by various names, including NPort concentrator, NPort Aggregator, or NPIV Gateway. Vendors also use many terms to refer to such gateways.
Draft Document for Review January 29, 2013 12:52 pm 8068ch11-SAN Config.fm Flex System environment storage performance will be critical so expectations of the selected storage protocol will be very high. Within the IBM Flex System Enterprise Chassis either option would be suitable between storage and compute nodes. Each of the iSCSI, FCoE or FC have their attributes and advantages over another.
8068ch11-SAN Config.
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm 12 Chapter 12. Host Configuration This chapter describes how to configure hosts to access the volumes that are created on a IBM Flex System V7000 Storage Node. © Copyright IBM Corp. 2012. All rights reserved.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm 12.1 Host configuration overview In this section we provide an overview of connectivity between servers (hosts) and storage with the primary focus on how to configure the hosts. A host system, as defined here, is an open-systems computer that is connected to storage through LAN or SAN switches, using either Fibre Channel (FC), iSCSI or FCoE protocols. In a IBM Flex System a host is also called a compute node.
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm 12.2 Discovering the volumes from the host and Multipath settings This section shows how to discover host mapped volumes from the host We assume that you have completed all previous steps so that the hosts and the IBM Flex System V7000 Storage Node are prepared: Prepare your operating systems for attachment by installing the appropriate multipath driver if needed.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm The view that opens gives you an overview of the currently configured and mapped hosts (Figure 12-2). Figure 12-2 All Hosts view 12.3 Windows host attachment In this section we cover Windows host attachment for Fibre channel (FC), iSCSI and FCoE. 12.3.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm Navigate to the Mapped Volumes tab (Figure 12-4). Figure 12-4 Mapped Volumes to a host The host details show you which volumes are currently mapped to the host, and you also see the volume UID and the SCSI ID. In our example, one volume with SCSI ID 0 is mapped to the host. 2. Log on to your Microsoft host and click Start All Programs Subsystem Device Driver DSM Subsystem Device Driver DSM. A command-line interface opens.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm 3. The output provides information about the connected volumes. In our example, there is one disk connected, Disk 14 for the Windows host, and four paths to the disk are available (State = Open). Open the Windows Disk Management window (Figure 12-5) by clicking Start Run, type diskmgmt.msc, and click OK or simply open it from Server Manager.
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm 6. Right-click the right pane and click New Simple Volume (Figure 12-8). Figure 12-8 New Simple Volume 7. Follow the wizard and the volume is ready to use from your Windows host (Figure 12-9).
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm 12.3.2 Windows 2008 R2 iSCSI volume attachment The equipment we have for demonstrating volume attachment for an iSCSI capable server is an IBM Flex System x240 Compute Node running Microsoft Windows 2008 R2 Enterprise, two IBM Flex System Fabric CN4093 10Gb Converged Scalable Switches and one IBM Flex System V7000 Storage Node. All is installed in a single IBM Flex System Enterprise Chassis.
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm Figure 12-11 Mapped Volumes to an iSCSI host The host details show you which volumes are currently mapped to the host, and you also see the volume UID and the SCSI ID. In our example, one volume with SCSI ID 0 is mapped to the host. 2. Log on to your Windows 2008 host and click Start Administrative Tools iSCSI Initiator to open the iSCSI Configuration tab (Figure 12-12 on page 482). Chapter 12.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 12-12 Windows iSCSI Configuration tab 3. Enter the IP address of one of the IBM Flex System V7000 Storage Node iSCSI ports and click Quick Connect (Figure 12-13). iSCSI IP addresses: The iSCSI IP addresses are different for the cluster and canister IP addresses. The iSCSI addresses are configured directly on each of the canisters.
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm The IBM Flex System V7000 Storage Node initiator is discovered and connected. (Figure 12-14). Figure 12-14 iSCSI Initiator target is connected Now you have completed the steps to connect the storage disk to your iSCSI host, but you are only using a single path at the moment. To enable multipathing for iSCSI targets, more actions are required. Complete the following steps: 1.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm 2. Click Start Administrative Tools MPIO, click the Discover Multi-Paths tab, and select the Add support for iSCSI devices check box (Figure 12-15). Figure 12-15 Enable iSCSI MPIO 3. Click Add and confirm the prompt to reboot your host. 4. After the reboot, log on again, click Start Administrative Tools iSCSI Initiator to open the iSCSI Configuration tab, and navigate to the Discovery tab (Figure 12-16 on page 485).
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm Figure 12-16 iSCSI Properties Discovery tab 5. Click Discover Portal..., enter the IP address of another IBM Flex System V7000 Storage Node iSCSI port (Figure 12-17), and click OK. Figure 12-17 Discover Target Portal window Chapter 12.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm 6. Return to the Targets tab (Figure 12-18) and you find the new connection there is listed as Inactive. Figure 12-18 Inactive target ports 7. Highlight the inactive port and click Connect. The Connect to Target window opens (Figure 12-19).
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm 8. Select the Enable Multipath check box and click OK. The second port now appears as Connected (Figure 12-20). Figure 12-20 Second target port connected Repeat this step for each IBM Flex System V7000 Storage Node port you want to use for iSCSI traffic. It is possible to have up to four port paths to the system. 9. Open the Windows Disk Management window (Figure 12-21 on page 488) by clicking Start Run, typing diskmgmt.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 12-21 Windows Disk Management 10.Set the disk online, initialize it, create a file system on it, and then it is ready to use. The detailed steps of this process are the same as described in 12.3.1, “Windows 2008 R2 Fibre Channel volume attachment” on page 476. Now the disk is ready for use (Figure 12-22).
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm Verifying Microsoft iSCSI SW initiator setup From the Windows server iSCSI Initiator Applet menu Figure 12-23 shows the IBM Flex System V7000 Storage Node canister IQNs defined. Figure 12-23 Canister IQN define in iSCSI initiator From this window click on the ‘Properties’ box with the mouse for node1 highlighted as shown in Figure 12-23. Figure 12-24 will show both canister IP addresses for node1 from the ‘Portal Groups’ tab.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 12-25 iSCSI target IP addresses and adapter portal IPs The ‘Favorite Targets’ tab shows two entries for each canister as shown in Figure 12-26 where details of one target is shown, these correspond with the target and portal IP addresses as shown in Figure 12-25. Figure 12-26 Favorite Target details We then added a single device and then had a look at the properties of that device for each iSCSI target.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 12-27 Two ‘Disk 1’s identified on first target From this there are two disks of the same name with identified as ‘Target 0’ and ‘Target 1’, these represent two paths, one from each x240 host adapter to the node canister on separate networks.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm LUN was mapped the ‘Auto Configure’ box was clicked from the ‘Volumes and Devices’ tab as shown in Figure 12-29 Figure 12-29 Single device identified in tab. This completes the verification of the iSCSI setup. iSCSI authentication Authentication of the host server from the IBM Flex System V7000 Storage Node system is optional and is disabled by default.
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm 12.3.3 Windows 2008 R2 FCoE volume attachment The equipment we have for demonstrating volume attachment for an FCoE capable server is an IBM Flex System x240 Compute Node running Microsoft Windows 2008 R2 Enterprise, two IBM Flex System Fabric CN4093 10Gb Converged Scalable Switches and one IBM Flex System V7000 Storage Node. All is installed in a single IBM Flex System Enterprise Chassis.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 12-31 FCoE port definitions 4. On the Windows 2008 server make sure appropriate drivers are installed for FCoE attachment. This can be done through the IBM UpdateXpress System Update Installer which can be downloaded from: http://www-947.ibm.com/support/entry/portal/docdisplay?lndocid=SERV-XPRESS Figure 12-32 on page 495 shows how FCoE drivers are installed using the IBM UpdateXpress System Update Installer.
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm Figure 12-32 FCoE drivers are installed 5. On the Windows 2008 R2 server install appropriate multipathing software. Multipathing software for FCoE is the same as for Fibre Channel (FC) attached hosts and is called Subsystem Device Driver Device Specific Module (SDDDSM). SDDDSM software can be downloaded from: https://www.ibm.com/storage/support 6.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 12-33 Emulex OneCommand Manager 7. On the Windows 2008 R2 server click Start All Programs Subsystem Device Driver DSM Subsystem Device Driver DSM. A command-line interface opens. Enter datapath query device and press Enter to see if there are IBM Flex System V7000 Storage Node disks connected to this host.
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm In the output above note that the UID of the mapped IBM Flex System V7000 Storage Node volume reflects the SERIAL number in the output from datapath query device. 8. Open the Windows Disk Management window by clicking Start Run, typing diskmgmt.msc or simply open it from the Server Manager. You may have to click More Actions Rescan Disks before the FCoE attached disk displays.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm Figure 12-35 Disk Management - FCoE attached disk formatted and online The setup is now complete and the IBM Flex System V7000 Storage Node is mapping a FCoE attached volume to the server. The Windows 2008 R2 server is prepared to access the volumes over four paths and is able to store data on the storage subsystem. For more information about FCoE refer to Chapter 11, “SAN Connections and Configuration” on page 431. 12.
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm Figure 12-36 Example ESX FC host Navigate to the Mapped Volumes tab (Figure 12-37). Figure 12-37 Mapped Volumes to ESX FC host Chapter 12.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm 2. In the Host Details window, you see that there is one volume connected to the ESX FC host using SCSI ID 1. The UID of the volume is also displayed. Connect to your VMware ESX Server using the vSphere client, navigate to the Configuration tab, and select Storage Adapters (Figure 12-38). Figure 12-38 vSphere Client: Storage adapters 3. Click Rescan All... and click OK (Figure 12-39) to scan for new storage devices.
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm 4. Select Storage and click Add Storage (Figure 12-40). Figure 12-40 vSphere Client: Storage 5. The Add Storage wizard opens. Click Select Disk/LUN and click Next. The IBM Flex System V7000 Storage Node disk appears (Figure 12-41). Highlight it and click Next. Figure 12-41 Select Disk/LUN menu Chapter 12.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm 6. Follow the wizard to complete the attachment of the disk. After you click Finish, the wizard closes and you return to the storage view. In Figure 12-42, you see that the new volume has been added to the configuration. Figure 12-42 Add Storage task complete 7. Highlight the new data store and click Properties to see the details of it (Figure 12-43).
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm 8. Click Manage Paths to customize the multipath settings. Select Round Robin (Figure 12-44) and click Change. Figure 12-44 Select a data store multipath setting The storage disk is available and ready to use for your VMware ESX server using Fibre Channel attachment. Chapter 12.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm 12.4.2 VMware ESX iSCSI attachment To perform a VMware ESX iSCSI attachment, complete the following steps: 1. Right-click your VMware ESX Fibre iSCSI host in the All Hosts view (Figure 12-45) and select Properties.
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm Navigate to the Mapped Volumes tab (Figure 12-46). Figure 12-46 iSCSI ESX host properties 2. In the Host Details window, you see that there is one volume connected to the ESX iSCSI host using SCSI ID 0. The UID of the volume is also displayed. Chapter 12.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm Connect to your VMware ESX Server using the vSphere Client, navigate to the Configuration tab, and select Storage Adapters (Figure 12-47).
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm 3. Highlight the iSCSI Software Initiator and click Properties. The iSCSI initiator properties window opens. Select the Dynamic Discovery tab (Figure 12-48) and click Add. Figure 12-48 iSCSI Initiator properties 4. To add a target, enter the target IP address (Figure 12-49). The target IP address is the IP address of a node in the I/O group from which you are mapping the iSCSI volume.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm 5. After you have added all the ports required, close the iSCSI Initiator properties by clicking Close (Figure 12-48 on page 507). You are prompted to rescan for new storage devices. Confirm the scan by clicking Yes (Figure 12-50). Figure 12-50 Confirm the rescan 6. Go to the storage view shown in Figure 12-51 and click Add Storage.
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm 7. The Add Storage wizard opens (Figure 12-52). Select Disk/LUN and click Next. Figure 12-52 Select Disk/LUN menu 8. The new iSCSI LUN displays. Highlight it and click Next (Figure 12-53). Figure 12-53 Select iSCSI LUN menu Chapter 12.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm 9. Review the disk layout and click Next (Figure 12-54). Figure 12-54 Current Disk Layout 10.Enter a name for the data store and click Next (Figure 12-55).
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm 11.Select the maximum file size and click Next (Figure 12-56). Figure 12-56 Maximum file size 12.Review your selections and click Finish (Figure 12-57). Figure 12-57 Finish the wizard Chapter 12.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm The new iSCSI LUN is now in the process of being added; this task can take a few minutes. After the tasks complete, the new data store appears in the storage view (Figure 12-58). Figure 12-58 New data store available 13.Highlight the new data store and click Properties to open and review the data store settings (Figure 12-59).
Draft Document for Review January 29, 2013 12:52 pm 8068ch12-Host Config.fm 14.Click Manage Paths, select Round Robin as the multipath policy (Figure 12-60), and click Change. Figure 12-60 Change the multipath policy 15.Click Close twice to return to the storage view, and now the storage disk is available and ready to use for your VMware ESX server using an iSCSI attachment. 12.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm 4. Check the FC switch zoning. 5. Install the 2145 host attachment support package, 6. Install and configure the Subsystem Device Driver Path Control Module (SDDPCM). 7. Run cfgmgr or reboot the compute node to discover and configure the IBM Flex System V7000 Storage Node volumes. Checking HBAs in the Compute Node You can display the availability of installed host adapters by using the command lsdev -Cc adapter.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm http://ibm.com/servers/eserver/serverproven/compat/us/ For the latest information, and device driver support, always refer to the following website: http://ibm.com/systems/storage/software/virtualization/svc/interop.html 12.5.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm Check Zoning On the IBM Flex System FC3171 8Gb SAN Switch. the zoning is checked as shown in Figure 12-62. Here, the WWN is defined in zone with IBM Flex System V7000 Storage Node canisters. Figure 12-62 Check WWN is defined in zone Again, this check should be repeated on the second IBM Flex System FC3171 8Gb SAN Switch for the second HBA fcs1.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm as “Other SCSI Disk Drives” and will not be recognized by SDDPCM. To correct the device type, hdisks will need to be deleted using rmdev -dl hdiskX and then cfgmgr will need to be rerun after the fileset is installed. Perform the following steps to install the host attachment support package: 1. Access the following website: http://www.ibm.com/servers/storage/support/software/sdd/downloading.html 2.
8068ch12-Host Config.fm # ls -al total 8648 drwxr-xr-x drwxr-xr-x -rw-r--r--rw------pio.rte -rw-r--r-3.2.bff -rw-r--r--rw-r--r-- Draft Document for Review January 29, 2013 12:52 pm 2 4 1 1 root root root root system system system system 256 4096 2455 95232 Nov Nov Nov Nov 1 1 1 1 21:14 21:04 21:12 21:08 . .. .toc devices.fcp.disk.ibm.m 1 root system 1188864 Nov 1 21:07 devices.sddpcm.71.2.6. 1 root 1 root system system 3123200 Nov 1852 Nov 1 21:07 devices.sddpcm.71.rte 1 21:14 preview.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm hdisk1 Available 05-00-01 MPIO FC 2145 hdisk2 Available 05-00-01 MPIO FC 2145 The lsdev command confirms that the new drives hdisk1 and hdisk2 are FC 2145 (IBM Flex System V7000 Storage Node volumes) hdisks. The mkvg command can now be used to create a Volume Group with the two newly configured hdisks. We then use the new hdisks to create filesystems and make them available for users as shown in Example 12-9.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm Using SDDPCM The SDDPCM is administered using the pcmpath command. This commands is used to perform all administrative functions such as displaying and changing the path state. The pcmpath query adapter command displays the current state of the adapters. In Example 12-11, we can see the adapter status and that both adapters are showing as optimal with State=NORMAL and Mode=ACTIVE.
8068ch12-Host Config.fm Draft Document for Review January 29, 2013 12:52 pm 12.6 Linux host attachment This section briefly guide you in preparing and configuring a Linux host for FC attachment. 12.6.1 Linux Fibre Channel attachment Follow these steps to configure the Linux host: Use the latest firmware levels on your host system. Install the HBA or HBAs on the Linux server. Install the supported HBA driver/firmware and upgrade the kernel, if required.
8068ch12-Host Config.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm 13 Chapter 13. Maintenance and Troubleshooting There are many ways to monitor and troubleshoot the IBM Flex System V7000 Storage Node.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm 13.1 Reliability, availability, and serviceability (RAS) Reliability, availability, and serviceability (RAS) are important concepts in the design of the IBM Flex System V7000 Storage Node. Hardware features, software features, design considerations, and operational guidelines all contribute to make the IBM Flex System V7000 Storage Node reliable.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Note: Be aware of the differences between the 4939 canisters and the enclosures, you must be able to distinguish between them when you service the system.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm appropriate actions to take to resolve the issues. See Figure 13-2 for a description of the various LED states that you might observe. 2 8 1 3 4 5 6 9 10 7 11 12 13 Figure 13-2 Node canister LED layout 1. Start by considering the state of the power LED 8, as shown in Figure 13-2 and Table 13-2. Continue to troubleshoot the canister until the power LED is ON.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Table 13-3 Node canister status LED statues LED layout LED Name Color States Green 9 Canister status OFF – The IBM Flex System V7000 system code is not running. If the Power LED is ON, the operating system has not started the IBM Flex System V7000 system code yet. This state is normal just after the canister is powered on.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm Table 13-5 Node canister battery LED states LED layout LED Name Color States Green 5 Battery Status Amber 6 Battery fault Green 7 Battery in use OFF – Indicates the battery is not in a state where it can support a save of cache and system state data. This is an error condition.
Draft Document for Review January 29, 2013 12:52 pm LED layout LED Name Color States Green 2 SASport activity 10 8068ch13-Maintenance and Troubleshooting.fm OFF – Power is not present or there is no SAS link connectivity established. Check that the SAS cable is correctly connected at each end, and that the canisters it connects to are both powered on. The cable may need replacing.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm The procedure shows the status for the expansion canisters. It does not show the status for the drives. IBM Flex System V7000 expansion enclosure includes two expansion canisters that are located in the rear of the expansion enclosure. The expansion canister has no controls and does not include battery unit.
Draft Document for Review January 29, 2013 12:52 pm LED layout LED name 8068ch13-Maintenance and Troubleshooting.fm Color Color 8 Canister or expansion enclosure identify Blue 9 Expansion enclosure fault Amber Table 13-8 defines the various LED states for the canisters in the IBM Flex System V7000 expansion canister.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm Table 13-9 Expansion canister Power LED states LED layout LED Name 7 Color States Green Power OFF – There is no power to the expansion canister. Make sure that the CMM has powered on the expansion canister. The CMM event log might indicate why the expansion canister has no power. Try reseating it.
Draft Document for Review January 29, 2013 12:52 pm LED layout LED Name 1 3 Color States Amber SAS port status green 2 4 SAS port activity 8068ch13-Maintenance and Troubleshooting.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm Attention: Do not operate the system when the drive assemblies are missing. Drive assemblies that are missing disrupt the airflow; the drives do not receive sufficient cooling. You must insert blank carriers into any unused drive bays. Powering on a control enclosure procedure 1. Powering on a control enclosure 2. When the power on LEDs reach the blink state, the control enclosure is powered on automatically.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Figure 13-4 FSM - tasks management and navigation IBM Flex System Manager automatically retrieves and displays the status of systems that have been discovered. You can display this information using one of the System Status and Health tasks, by navigating to a specific resource in IBM Flex System Manager, or by using the command-line interface.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm The System Status and Health tasks simplify your work as a system administrator by providing consolidated views of the health and status of your entire environment. Specifically, the Health Summary task displays information about the resources that IBM Flex System Manager has discovered.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm The Problems task lists only those elevated status set entries that are problem status set entries that have been reported to IBM Flex System Manager. The data listed here is a subset of what is listed on the Active Status page. From the Problems page, you can navigate to, display, and manage these status set entries.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm 13.4.1 Using FSM Chassis Manager page to manage storage node The Chassis Manager page and Chassis Map view provide hardware and table views of all discovered resources in a managed chassis. Use the Chassis Manager view in the management software web interface to view Flex System V7000 details and perform management tasks.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Figure 13-7 FSM - access a Flex System V7000 from the Chassis Manager page Note: You can launch the Flex System V7000 management GUI from the Chassis Map view. After you select the storage node in the Chassis Map view, click Launch IBM Flex System V7000 13.4.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm Figure 13-8 FSM - Storage Management The following links are available under Storage Tasks: Discover Storage Storage to Server Mapping View Server to Storage Mapping View View Current Configuration View and Apply Storage Templates For implementation details, refer to 3.3, “Flex System Manager (FSM)” on page 110. 13.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm To generate a configuration backup using the CLI, go to: http://publib.boulder.ibm.com/infocenter/flexsys/information/topic/com.ibm.acc.493 9.doc/svc_clustconfbackuptsk_1e4k69.html Table 13-11 describes the three files that are created by the backup process. Table 13-11 File names created by the backup process File name Description svc.config.backup.xml This file contains your cluster configuration data.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm in the system are successfully restarted with the new code level, the new level is automatically committed. During an automatic code upgrade, each node of a working pair is upgraded sequentially. The node that is being upgraded is temporarily unavailable and all I/O operations to that node fails.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Note: Immediately prior to a manual upgrade, the cluster must be prepared by issuing the svctask applysoftware -prepare -file svc_software_package command in the CLI. Refer to the below link for more information. http://publib.boulder.ibm.com/infocenter/flexsys/information/topic/com.ibm.acc. 4939.doc/svc_userpacedsftwrupgrade_419938.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm Figure 13-11 Check for software updates 4. Click Launch Upgrade Wizard as shown in Figure 13-11 to download the upgrade test utility. This utility checks for known issues which might prevent the upgrade from completing successfully. Click Download link to download the test utility directly from the web server.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Figure 13-14 Step 2 of 5 - Run upgrade test utility Note: The test may take several minutes to complete. If the upgrade test utility used didn’t match with the upgrade version you want to upgrade to, you will receive a message similar to the following message This version of svcupgradetest cannot test the currently running version of cluster code. This cluster has software version 6.4.1.3 installed.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm Figure 13-16 Step 5 of 5 Start the upgrade h 11.Click Finish to complete your software upgrade. You receive message that inform you that first node, then the other, has been upgraded. When both nodes have been rebooted, you have completed your IBM Flex System V7000 Storage Node software upgrade, as shown in Figure 13-17.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Figure 13-18 Software upgrade complete 13.7 Drive Firmware upgrade You can upgrade a drive by downloading and applying firmware updates by using the command-line interface (CLI). The time required to perform drive upgrade varies depending on the number of drives to be upgraded and the capacity of these drives. You need to plan your drive firmware upgrade task accordingly.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm 4. Run the applydrivesoftware command. You must specify the firmware upgrade file, the firmware type, and the drive ID. Command: applydrivesoftware -file name -type firmware -drive drive_id To apply the upgrade even if it causes one or more volumes to go offline, specify the -force option.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Figure 13-19 CMM chassis map - color status 3. Hover the mouse over a component to view information about it, as shown in Figure 13-20 and Figure 13-21 Figure 13-20 CMM chassis map - node canister status information Figure 13-21 CMM chassis map - drive status information Chapter 13.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm 4. Click a component to view detailed information, which appears in tabs in the Details panel, as shown in Figure 13-22 and Figure 13-23. Figure 13-22 CMM chassis map - node canister detail tabs Figure 13-23 CMM chassis map - drive detail tabs 5. Right-click a component to access an action pop-up window, as shown in Figure 13-24 on page 551.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Figure 13-24 CMM chassis map - action pop-up window Attention: The use of the actions below are described on other pages. Do not use them without referring to those pages. 13.8.2 Using management GUI for troubleshooting tasks Always use the recommended actions on the Events panel of the management GUI of the Flex System V7000 Storage Node as the starting point to diagnose and resolve a problem.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm problem. In all these cases the management GUI recommended action is the correct starting point. For problem that you might experience, that is not resolved by using the management GUI. In those situations, review the symptoms and follow the actions that are provided here. You may be directed to the IBM Flex System V7000 Service Assistant GUI or to Flex System chassis management devices.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm 3. If enabled, event notifications can be forwarded from a sender to a receiver through Call Home email. 4. If Call Home is enabled, critical faults generate a problem management record (PMR) that is sent directly to the appropriate IBM Support Center. In general, events are classified as either alerts or messages: An alert is logged when the event requires some action.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm Figure 13-26 Event filters Figure 13-27 Event log collected and displayed for network storage resource 13.8.6 Error event IDs and error codes Each event ID that requires service has an associated error code. See the IBM Flex System V7000 Storage Node Troubleshooting, Recovery, and Maintenance Guide PDF on the CD or IBM Flex System Information Center website.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Figure 13-28 shows the navigation window that is used to start the Monitoring wizard for the Viewing System, Viewing System Details, Viewing Events, and See Real Time Performance Graphs. Figure 13-28 Recommended actions The Recommended Actions tab shows the highest priority maintenance procedure that needs to be run.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm In this example, Number of device logins reduced appears. The next step in this example is to review the physical FC cabling to determine the issue and then click Run Fix Procedure to fix the error (Figure 13-30).
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm 13.9 Audit log navigation Figure 13-31 shows the Audit Log tab menu item. Click Audit Log to view which configuration CLI commands have been run so far on the IBM Flex System V7000 system (information and service commands are not included). Figure 13-31 Audit Log from Access window 13.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm Figure 13-32 Collect support package Figure 13-33 shows all log files. Search for the file you want, Select it, right-click it, and select Download to download it to your workstation.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Figure 13-34 Download support package To upload the resulting snap file to the IBM Support portal after you open a call with IBM support, go to the following address: http://www.ecurep.ibm.com/app/upload You are ready to call the IBM Support Line or use the IBM Support Portal to open a call. If you use the latter option, go to the following address: http://www.ibm.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm support files, to manually collect additional support files, and to submit collected files to the IBM service provider for analysis, as show in Figure 13-35. Figure 13-35 FSM collects support files The following view displays all support files on this system that have been collected by Service and Support Manager.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Figure 13-36 FSM Support files collection Support files associated with a problem cannot be submitted unless the problem itself has been submitted to IBM support and is currently in a submitted state. These Support files can only be collected on systems in the monitored group.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm V7000 can send syslog messages that notify personnel about an event. IBM Flex System V7000 can transmit syslog messages in either expanded or concise format. You can use a syslog manager to view the syslog messages that IBM Flex System V7000 sends. IBM Flex System V7000 uses the User Datagram Protocol (UDP) to transmit the syslog message.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm besides sending a test email to check that all connections and infrastructure are set up correctly, no further Call Home configuration is required. Figure 13-37 Configure email event notification during initial setup 2.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm Figure 13-39 Define company contact information 13.12.2 Configuring Call Home if FSM is included Note: All the topics mentioned in the procedure below are available for reference on the IBM Flex System Information Center at the below link: http://publib.boulder.ibm.com/infocenter/flexsys/information/index.jsp You configure Call Home on FSM. FSM automatically takes control of Call Home.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Follow the below procedure to configure call home if the FSM is included. 1. You can set up and enable Electronic Service Agent from the Additional Setup tab of the IBM Flex System Manager home page Getting started with Electronic Service Agent welcome screen, as shown in Figure 13-40 on page 565. Figure 13-40 Getting Started with Electronic Service Agent welcome screen 2.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm selecting a system, and clicking Location under the Additional Properties heading, as shown in Figure 13-42 on page 566. Figure 13-42 System location 4. Click OK, An Internet connection is required to use this function. Specify how the Internet should be accessed. Click Test Internet Connection to verify your internet access is working properly, as shown in Figure 6 on page 568.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Figure 13-43 Select internet access 5. Click Next. Provide an IBM ID to be associated with information sent by Electronic Service Agent, as shown in Figure 6 on page 568. Chapter 13.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm Figure 13-44 Provide IBM ID access 6. Click Next, Review the Summary page and click Finish if all information displayed is correct, as shown in Figure 13-45 on page 569.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm Figure 13-45 Summary screen for review 13.13 IBM Flex System V7000 Storage Node Power On and Off You may shut down only one node canister using CMM or the entire cluster using IBM Flex System V7000 management GUI.
8068ch13-Maintenance and Troubleshooting.fm Draft Document for Review January 29, 2013 12:52 pm 13.13.2 Powering off the system Follow the below procedure to power off the system. 1. Stop any hosts using the Flex System V7000 Storage Node. 2. Use the Flex System V7000 Storage Node management GUI to shut down the system, as shown in Figure 13-46.
Draft Document for Review January 29, 2013 12:52 pm 8068ch13-Maintenance and Troubleshooting.fm a Flex System V7000 Storage Node canister using the Flex System V7000 Storage Node service GUI. 1. Open the CMM and navigate to the chassis map. The chassis map displayed by the CMM provides a graphical view of the IBM Flex System Enterprise Chassis components. Using the mouse, locate the node that you want to power off, as shown in Figure 13-48.
8068ch13-Maintenance and Troubleshooting.
Draft Document for Review January 29, 2013 12:52 pm 8068AppA-CLI.fm A Appendix A. CLI Setup and Configuration This section describes the setup of the CLI and how to setup the host for an Secure Shell connection. To demonstrate this capability we used PuTTY, a freeware tool that is available at the following url: © Copyright IBM Corp. 2012. All rights reserved.
8068AppA-CLI.fm Draft Document for Review January 29, 2013 12:52 pm Command-line interface The IBM Flex System V7000 Storage Node also has a powerful CLI, which offers even more functions than those provided by the GUI. This section is not intended to be a detailed guide to the CLI, as that topic is beyond the scope of this book. The basic configuration of the IBM Flex System V7000 Storage Node CLI and some example commands are covered.
8068AppA-CLI.fm Draft Document for Review January 29, 2013 12:52 pm http://www.chiark.greenend.org.uk Download the following tools: PuTTY SSH client: putty.exe PuTTY key generator: puttygen.exe Generating a public and private key pair To generate a public and private key pair, complete the following steps: 1. Start the PuTTY key generator to generate the public and private key pair (Figure A-1).
8068AppA-CLI.fm Draft Document for Review January 29, 2013 12:52 pm 2. Click Generate and move the cursor over the blank area to generate the keys (Figure A-2). Figure A-2 Generate keys To generate keys: The blank area indicated by the message is the large blank rectangle on the GUI inside the section of the GUI labeled Key. Continue to move the mouse pointer over the blank area until the progress bar reaches the far right. This action generates random characters to create a unique key pair. 3.
Draft Document for Review January 29, 2013 12:52 pm 8068AppA-CLI.fm 4. You are prompted for a name (for example, pubkey) and a location for the public key (for example, C:\Support Utils\PuTTY). Click Save. Ensure that you record the name and location, because the name and location of this SSH public key must be specified later. Public key extension: By default, the PuTTY key generator saves the public key with no extension.
8068AppA-CLI.fm Draft Document for Review January 29, 2013 12:52 pm Uploading SSH public key to the IBM Flex System V7000 Storage Node After you have created your SSH key pair, you need to upload your SSH public key onto the IBM Flex System V7000 Storage Node. Complete the following steps: 1. Open the user section (Figure 13-49). Figure 13-49 Open Users section 2. Right-click the user for which you want to upload the key and click Properties (Figure A-6).
8068AppA-CLI.fm Draft Document for Review January 29, 2013 12:52 pm 3. To upload the public key, click Browse, select your public key, and click OK (Figure A-7). Figure A-7 Select public key 4. Click OK and the key is uploaded (Figure A-8). Figure A-8 Public key upload complete 5. Click Close to return to the GUI. Configuring the SSH client Before the CLI can be used, the SSH client must be configured. To accomplish this task, complete the following steps: 1. Start PuTTY (Figure A-9 on page 580).
8068AppA-CLI.fm Draft Document for Review January 29, 2013 12:52 pm Figure A-9 PuTTY Configuration In the right pane under the “Specify the destination you want to connect to” section, select SSH. Under the “Close window on exit” section, select Only on clean exit, which ensures that if there are any connection errors, they are displayed on the user’s window. 2.
Draft Document for Review January 29, 2013 12:52 pm 8068AppA-CLI.fm Figure A-11 SSH authentication 5. From the Category pane on the left side of the PuTTY Configuration window, click Session to return to the Session view (Figure A-9 on page 580). Appendix A.
8068AppA-CLI.fm Draft Document for Review January 29, 2013 12:52 pm 6. In the right pane, enter the host name or system IP address of the IBM Flex System V7000 Storage Node cluster in the Host Name field, and enter a session name in the Saved Sessions field (Figure A-12). Figure A-12 Enter session information 7. Click Save to save the new session (Figure A-13).
8068AppA-CLI.fm Draft Document for Review January 29, 2013 12:52 pm 8. Highlight the new session and click Open to connect to the IBM Flex System V7000 Storage Node. A PuTTY Security Alert opens; confirm it by clicking Yes (Figure A-14). Figure A-14 Confirm Security Alert 9. PuTTY now connects to the system and prompts you for a user name. Enter admin as the user name and press Enter (Example A-1).
8068AppA-CLI.fm 4 ESXi-Demo 0 io_grp0 600507680185853FF000000000000013 0 Draft Document for Review January 29, 2013 12:52 pm online many many 2 not_empty 0 1000.00GB many no Enter lshost to get a list of all configured hosts on the system (Example A-3).
8068AppA-CLI.fm Draft Document for Review January 29, 2013 12:52 pm Example: A-7 Throttling based on I/O IBM_4939:FlexSystem_V7000:admin>chvdisk -rate 4000 ESXi-Redbooks IBM_4939:FlexSystem_V7000:admin>lsvdisk ESXi-Redbooks id 2 name ESXi-Redbooks . . vdisk_UID 600507680185853FF000000000000011 throttling 4000 preferred_node_id 2 . . IBM_4939:FlexSystem_V7000:admin> To disable I/O throttling, set the I/O rate to 0 (Example A-8).
8068AppA-CLI.
Draft Document for Review January 29, 2013 12:52 pm 8068AppA-CLI.fm id_alias 0000020061614FFC gm_link_tolerance 300 gm_inter_cluster_delay_simulation 0 gm_intra_cluster_delay_simulation 0 gm_max_host_delay 5 . tier generic_hdd tier_capacity 5.45TB tier_free_capacity 2.10TB has_nas_key no layer storage rc_buffer_size 48 IBM_4939:FlexSystem_V7000:admin>lssystem id 0000020061614FFC name FlexSystem_V7000 gm_inter_cluster_delay_simulation 0 gm_intra_cluster_delay_simulation 20 gm_max_host_delay 5 .
8068AppA-CLI.
Draft Document for Review January 29, 2013 12:52 pm 8068bibl.fm Related publications The publications listed in this section are considered particularly suitable for a more detailed discussion of the topics covered in this book. IBM Redbooks The following IBM Redbooks publications provide additional information about the topic in this document. Note that some publications referenced in this list might be available in softcopy only. Implementing the IBM System Storage SAN Volume Controller V6.
8068bibl.fm Draft Document for Review January 29, 2013 12:52 pm http://publib.boulder.ibm.com/infocenter/flexsys/information/topic/com.ibm.acc. 4939.doc/site_bkmap_trblshoot.pdf Online resources These websites are also relevant as further information sources: The IBM Storwize V7000 Support page is at the following website: http://www.ibm.com/storage/support/storwize/v7000 The IBM Storwize V7000 home page is at the following website: http://www-03.ibm.
(0.5” spine) 0.475”<->0.873” 250 <-> 459 pages (1.0” spine) 0.875”<->1.498” 460 <-> 788 pages (1.5” spine) 1.5”<-> 1.998” 789 <->1051 pages 8068spine.fm 591 To determine the spine width of a book, you divide the paper PPI into the number of pages in the book. An example is a 250 page book using Plainfield opaque 50# smooth which has a PPI of 526. Divided 250 by 526 which equals a spine width of .4752". In this case, you would use the .5” spine.
Conditional Text Settings (ONLY!) to the book files. 592 (2.5” spine) 2.5”<->nnn.n” 1315<-> nnnn pages 8068spine.fm To determine the spine width of a book, you divide the paper PPI into the number of pages in the book. An example is a 250 page book using Plainfield opaque 50# smooth which has a PPI of 526. Divided 250 by 526 which equals a spine width of .4752". In this case, you would use the .5” spine.
Draft Document for Review January 29, 2013 12:52 pm Back cover ® IBM Flex System V7000 Storage Node Introduction and Implementation Guide Introduction to IBM Flex System Family IBM Flex System V7000 Storage Node Hardware Introduction Host Configuration Guide IBM® Flex System™ products are ideally suited for data center environments that require flexible, cost-effective, secure, and energy-efficient hardware.
