NEC Storage Software NEC Storage PathManager User’s Manual (Windows version) IS201-5E
© NEC Corporation 2003, 2004 No part of the contents of this book may be reproduced or transmitted in any form without permission of NEC Corporation. The contents of this book may be modified without notice in the future.
Preface This document illustrates how to use NEC Storage PathManager. NEC Storage PathManager multiplexes paths between a server and a storage unit in a system with Express5800 and the NEC Storage Disk Array SubSystem. 1st edition: February, 2003 5th edition: July, 2004 Notes: (1) Functions described in this document are supported by the following software: NEC Storage PathManager 3.1 Enterprise for Windows NEC Storage PathManager 3.
Contents PART I OVERVIEW -------------------------------------------------------------------------------------------------------------------- I-1 Chapter 1 Overview of NEC Storage PathManager --------------------------------------------------------------------------I-2 1.1 About NEC Storage PathManager ------------------------------------------------------------------------------------------- I-2 1.
art I P Part ew vervi O viiew Overv
Chapter 1 Overview of NEC Storage PathManager Chapter 1 Overview of NEC Storage PathManager NEC Storage PathManager software multiplexes paths between a server and a storage unit in a system with Express5800 and the NEC Storage series Disk Array SubSystem. This software automatically switches paths to be used in case of failures in paths currently in use. Also, this software uses multiple paths simultaneously to distribute loads to the paths.
Chapter 1 Overview of NEC Storage PathManager during the course of switching the paths. Applications can continue their processing without being aware of the path failure. 11..1 .2 .11.2 Lo ad bbalancing alancing ffunction u n ct i o n Lo oad NEC Storage PathManager has a load balancing function that uses multiplexed paths to distribute loads. Static load balancing and dynamic load balancing methods are used so that it is possible to take advantage of the features of NEC Storage.
Chapter 1 Overview of NEC Storage PathManager This service offers a log extract function that writes log information related to NEC Storage PathManager in the event log. From internal information of NEC Storage PathManager, it writes important information in the event log.
Chapter 1 Overview of NEC Storage PathManager Express5800 Storage PathManager NEC Storage Figure 1-2 Single-server configuration 11..3 .2 .33.2 Mu ltiple-server cconfiguration o n f i g u ra t i o n Mu ultiple-server In this system, multiple servers are directly connected to NEC Storage. This system configuration is used when multiple servers having different tasks share a relatively large NEC Storage.
Chapter 1 Overview of NEC Storage PathManager 11..3 .3 .33.3 Cl uster cconfiguration o n f i g u ra t i o n Clluster Below is an example of a cluster system configuration. There are FC switches between the server and NEC Storage so that multiple servers will make the same logical unit visible.
art IIII P Part nstallation IInstallation
Chapter 2 Installing NEC Storage PathManager Chapter 2 22.1 .
Chapter 2 Installing NEC Storage PathManager After installing NEC Storage PathManager and before starting its operation, make sure to read "Chapter 4 Operating NEC Storage PathManager" and check operation status and make settings. 22..2 .1 .22.1 Be fore ssetup e t up Beefore Read the following notes before starting the setup of NEC Storage PathManager. /1/ Make sure to use HotFix (Q323289_W2K_SP4_X86_EN.exe) on the Setup CD when working in a Windows 2000 Service Pack 3 environment.
Chapter 2 Installing NEC Storage PathManager Make sure to use HotFix (Q323289_W2K_SP4_X86_EN.exe) contained in the Setup CD when installing NEC Storage PathManager in a Windows 2000 Service Pack 3 environment. HotFix solves the Windows 2000 memory leak problem that would affect NEC Storage PathManager. HotFix is for use only in a Windows 2000 Service Pack 3 environment. Never use HotFix in any other environments. This HotFix is included in Windows 2000 Service Pack 4.
Chapter 2 Installing NEC Storage PathManager When turning on the server after uninstalling NEC Storage PathManager, make sure that the connection between the server and NEC Storage is not redundant. You can also set the cross call of NEC Storage to "Off." Turning on the server while the connection is redundant may result in unexpected damage to the file systems. For cross call settings, refer to the NEC Storage manual. 22..2 .4 .22.
II art IIII P Part unc t i ons F Functions
Chapter 3 Functions of NEC Storage PathManager Chapter 3 Functions of NEC Storage PathManager This chapter describes functions that NEC Storage PathManager offers. Basic functions of NEC Storage PathManager can be roughly categorized as follows: /1/ Path state display This function displays information regarding state of paths. /2/ Path control This function sets the state of paths. /3/ Load balancing This function distributes I/O loads to multiple paths.
Chapter 3 33..1 .1 .11.1 Functions of NEC Storage PathManager P h sstate t at e Paatth There are roughly four types of path state: /1/ In use This is the path that is currently in use. For each logical unit, there can only be one path in use. /2/ Active This is a path that is ready for use, and the priority given to this path is in effect. /3/ Standby This is a path that is ready for use, and the priority given to this path is not in effect.
Chapter 3 Functions of NEC Storage PathManager C:\>spscmd -getlun /1/ *** LogicalUnit #0 *** > 0: Priority=2, PathNumber=4:0:0:0 1: Priority=1, PathNumber=5:0:1:0 /2/ /3/ /4/ *** LogicalUnit #1 *** X 0: Priority=1, PathNumber=4:0:0:1 > 1: Priority=2, PathNumber=5:0:1:1 +++ LogicalUnit #2 +++ [round robin] > 0: Priority=2, PathNumber=5:0:1:2 @ 1: Priority=1, PathNumber=4:0:0:2 C:\> A list of recognized paths is displayed for each logical unit.
Chapter 3 Functions of NEC Storage PathManager When devices become completely invisible due to disconnection of the FC cable for example, the corresponding path information disappears instead of the path state being displayed as "Failed." C:\>spscmd -getlun *** LogicalUnit #0 *** > 0: Priority=2, PathNumber=4:0:0:0 1: Priority=1, PathNumber=5:0:1:0 C:\> Disconnection occurs in the path 4:0:0:0.
Chapter 3 Functions of NEC Storage PathManager C:\>spscmd -getlun -v *** LogicalUnit #0 *** State=0x0 Config=0x0 LBMode=0x0 LogialDiskNumber='00000' ProductId='iStorage 2000 ' SerialNumber='1234123412341234' > 0: Priority=2, PortNumber=4, PathId=0, TargetId=0, Lun=0 BusNumber=0, SlotNumber=9 Wwpn=34129078:56341221 > 1: Priority=1, PortNumber=5, PathId=0, TargetId=1, Lun=0 BusNumber=1, SlotNumber=1 Wwpn=34129078:56341223 *** LogicalUnit #1 *** State=0x0 Config=0x0 @ 1: Priority=1, PortNumber=4, PathId=0
Chapter 3 of their number. Functions of NEC Storage PathManager For other logical units, the paths will be displayed in the order of priority. If not specifically set, this display order will be applied. - s1: Paths will be displayed in the order of their number. - s2: Paths will be displayed in the order of priority. The following image shows a display example when the -s1 option is used.
Chapter 3 Functions of NEC Storage PathManager order of priority, from the highest to the lowest for each I/O. After the path with the lowest priority is used, the order returns to the path with the highest priority. When path priority or path state has been changed by the spscmd described below, the result will immediately be in effect for the currently used path. 33..2 .2 .22.
Chapter 3 Functions of NEC Storage PathManager A path with disabled priority will be excluded from the decision process of the order of path use by priority and dynamic load balancing process. Note that this does not mean that this path will be absolutely unavailable. Instead, this path is treated as a path having an even lower priority than the path with the lowest priority. Therefore, a path with disabled priority will be used in case of failures in all the other paths.
Chapter 3 Functions of NEC Storage PathManager The following image shows an example when the -avail option is used. C:\>spscmd -getlun *** LogicalUnit #0 *** @ 0: Priority=2, PathNumber=4:0:0:0 > 1: Priority=1, PathNumber=5:0:1:0 C:\>spscmd -avail 4:0:0:0 C:\>spscmd -getlun *** LogicalUnit #0 *** > 0: Priority=2, PathNumber=4:0:0:0 1: Priority=1, PathNumber=5:0:1:0 C:\> 33..2 .3 .22.3 Ch anging ppaths aths ffor or uuse se Ch hanging Use the -path option of the spscmd to change the path to be used.
Chapter 3 Functions of NEC Storage PathManager When using the -path option to specify a path, a path number (PathNumber) displayed in the -getlun option is inputted as an argument. Here, part of the path number input can be omitted. If multiple paths in the same logical unit match the result of partially omitted path number input, the first matched path will be specified. The following image shows an example.
Chapter 3 Functions of NEC Storage PathManager specified integer. C:\>spscmd -getlun *** LogicalUnit #0 *** > 0: Priority=2, PathNumber=4:0:0:0 1: Priority=1, PathNumber=5:0:1:0 C:\>spscmd -priority 5:0:1:0 3 C:\>spscmd -getlun *** LogicalUnit #0 *** 0: Priority=2, PathNumber=4:0:0:0 > 1: Priority=3, PathNumber=5:0:1:0 C:\> Priority specified in the -priority option must be an integer between 1 and 254, and each path must have a unique priority in a logical unit.
Chapter 3 Functions of NEC Storage PathManager Path 0 Path 1 LUN0 LUN1 Figure 3-5 Static load balancing Use the -path option or the -swap option of the spscmd to make settings for static load balancing. The following image shows an example.
Chapter 3 Functions of NEC Storage PathManager It is possible to confirm that static load balancing is in effect once the -path option is applied to the logical unit 1. 33..3 .2 .33.2 Dy namic lload oad bbalancing a la nc ing Dyynamic In this method, loads are distributed by dynamically changing the paths to be used among multiple paths. Path 0 Path 1 LUN0 LUN1 Figure 3-6 Dynamic load balancing Use the -lbmode option of the spscmd to make settings for dynamic load balancing.
Chapter 3 Functions of NEC Storage PathManager for dynamic load balancing must be set for each unit. Second argument 0: do not execute dynamic load balancing (specified when load balancing will not be executed or when static load balancing will be executed) Second argument 1: execute dynamic load balancing (in the round robin method) Note also that the settings for dynamic load balancing cannot be made if the program is working with MSCS. 33.4 .
Chapter 3 Functions of NEC Storage PathManager C:\>spscmd -getmscsmode MSCS : Disable C:\>spscmd -setmscsmode E C:\>spscmd -getmscsmode MSCS : Enable C:\> The -getmode option of the spscmd can also be used to check the settings for MSCS liaison. C:\>spscmd -getmode Class : Enterprise Failback : Active MSCS : Disable C:\> Note also that the settings for dynamic load balancing cannot be made if the program is working with MSCS. 33.5 .
Chapter 3 Functions of NEC Storage PathManager for use. If the I/O results in an error or if it is not complete before time-out, the paths are regarded as being unavailable for use. 33..5 .1 .55.1 He alth ccheck heck Heealth This function detects failed paths and makes them fail over by periodically issuing monitoring I/O to available paths that have not been used for a certain period of time.
Chapter 3 Functions of NEC Storage PathManager 33..5 .3 .55.3 S tings ffor or ppath ath ppatr atro ro Seetttings oll Use the -setwatcher option of the spscmd to make settings for path patrol. Use the -getwatcher option to check the settings. [For Windows 2000] C:\>spscmd -setwatcher 3:120:30:180 /1//2//3/ /4/ C:\>spscmd -getwatcher Health check Recovery check Request interval Threshold Timeout duration : : : : : Enable Enable 120 sec 30 sec 180 sec .../1/ .../1/ .../2/ .../3/ ...
Chapter 3 Functions of NEC Storage PathManager (Recovery check is not for Windows Server 2003.) /2/ Request interval The path patrol service issues monitoring requests for each path to the NEC Storage PathManager driver at this interval (default: 60, unit: seconds). /3/ Threshold This refers to a period of time in which paths have not been used. Threshold is used to determine if monitoring I/O should be issued to the designated paths when the NEC Storage PathManager driver receives monitoring requests.
Chapter 3 Functions of NEC Storage PathManager [For Windows Server 2003] C:\>spscmd -getwatcher Health check : Enable Request interval : 30 sec C:\>spscmd -setwatcher :60:: C:\>spscmd -getwatcher Set only Request interval at 60 seconds Health check : Enable Request interval : 60 sec C:\> 33.6 .
Chapter 3 Path 0 Functions of NEC Storage PathManager Path 1 Path 0 Failures ? Path1 Recovery ? LUN0 LUN0 LUN1 LUN1 Figure 3-9 Failover (left) and failback (right) Active Available In use Standby Unavailavle Failures Figure 3-10 Failover as a result of failure avoidance Active Available In use Standby Unavailable Failures Figure 3-11 Failback as a result of failure recovery III-21
Chapter 3 Functions of NEC Storage PathManager 33..6 .2 .66.2 S ecting aa m ethod ooff ffailback a i l b ac k Seellecting method In NEC Storage PathManager, two types of failback methods are available: active failback and standby failback. /1/ Active failback Failback is executed and the state of the path becomes active. The priority of a path that failed back becomes enabled. There may be a case where paths are switched at the time of failback, and the state of the path becomes "In use.
Chapter 3 33..6 .3 .66.3 Functions of NEC Storage PathManager M ual ffailback a i l b a ck Maannual When the abovementioned recovery check function is disabled, failback will not be executed even though failed paths have recovered from the failures. In such a case, use the -failback option or the -failbackall option of the spscmd to execute forced failback. (This function is not for Windows Server 2003.
Chapter 3 Functions of NEC Storage PathManager 33.7 .7 L og eextraction x tr a c t i o n Log This function outputs log information related to NEC Storage PathManager to an event log. NEC Storage PathManager internally holds log information (SPS logs). From the log information, the log service outputs important information to the event log (system). NEC Storage PathManager driver Log service (iSpmLogger) SPS logs Event log Figure 3-6 Log extraction 33..7 .1 .77.
Chapter 3 Functions of NEC Storage PathManager Log storage folder spsevent.log.old spsevent.log spsevent.log The file name is changed, and... a new one is created. Figure 3-8 Storing SPS logs (2) When the new "spsevent.log" becomes full, the previous log file "spsevent.log.old" will be deleted. Then "spsevent.log" becomes "spsevent.log.old." A new "spsevent.log" is created, and logs will be stored in this file. Log storage folder spsevent.log.old spsevent.log spsevent.log.
Chapter 3 Functions of NEC Storage PathManager 33..7 .2 .77.2 E nt llogs ogs Evveent Among the pieces of information stored in the SPS logs, important information such as information related to failover and failback will be outputted to the event log (system) by the log service. Refer to the following table for the outputted event log information.
Chapter 3 33.8 .8 Functions of NEC Storage PathManager M essage(ESMPRO lliaison) i a i s on) Message(ESMPRO The message function of ESMPRO reports the most important events among those outputted to the event log by NEC Storage PathManager. No particular settings are required in NEC Storage PathManager to use this function. Refer to the following table for event log information to be reported.
Chapter 3 Functions of NEC Storage PathManager If you would like to use the Alert Manager feature of ESMPRO Manager, you have to set up the registries shown below on the server which ESMPRO Manager is installed. /1/ Set the registries shown below. [HKEY_LOCAL_MACHINE\SOFTWARE\NEC\NVBASE\AlertViewer\AlertType\StoragePath] WavDefault : REG_SZ : Default.wav AniDefault : REG_SZ : Default.bmp Image : REG_SZ : Default.bmp SmallImage : REG_SZ : Default.bmp /2/ Set the permissions shown below.
V art IIV P Part per at i on O Operation
Chapter 4 Operating NEC Storage PathManager Chapter 4 44.1 .1 44..1 .1 .11.1 Operating NEC Storage PathManager O peration iin nn ormal sstate t at e Operation normal St arting ooperation p er at i o n Sttarting After installation of NEC Storage PathManager is complete and connection is established between the server and NEC Storage, NEC Storage PathManager automatically recognizes disk subsystems and paths. Then operation starts.
Chapter 4 Operating NEC Storage PathManager During redundant operation, multiple paths are displayed under each "LogicalUnit." The example above shows that there are two logical units and two paths in NEC Storage. Refer to "Chapter 3 Functions of NEC Storage PathManager" for detailed information about the display. It may take some time (up to a minute) for the spscmd to return its result if the spscmd is used right after the server starts up.
Chapter 4 Operating NEC Storage PathManager /3/ For an already recognized path to an already recognized logical unit, the state of priority will be maintained even after the system is rebooted. /4/ When a path is already recognized as a path to an already recognized logical unit, and is recovered from path failures, the path will have a priority level that it had prior to the failures. Whether the priority is disabled or enabled will depend on the failback mode.
Chapter 4 Operating NEC Storage PathManager C:\>spscmd -avail ::: C:\>spscmd -getlun *** LogicalUnit #0 0: Priority=1, 1: Priority=2, 2: Priority=3, > 3: Priority=4, *** PathNumber=4:0:0:0 PathNumber=5:0:1:0 PathNumber=6:0:2:0 PathNumber=7:0:3:0 *** LogicalUnit #1 0: Priority=1, 1: Priority=2, 2: Priority=3, > 3: Priority=4, *** PathNumber=4:0:0:1 PathNumber=5:0:1:1 PathNumber=6:0:2:1 PathNumber=7:0:3:1 C:\> If the HBA driver is reinstalled, priority setting information may be lost.
Chapter 4 Operating NEC Storage PathManager [For Windows 2000] C:\>spscmd -getwatcher Health check Recovery check Request interval Threshold Timeout duration : : : : : Enable Enable 60 sec 60 sec 120 sec C:\> [For Windows Server 2003] C:\>spscmd -getwatcher Health check : Enable Request interval : 60 sec C:\> 44..1 .4 .11.
Chapter 4 Operating NEC Storage PathManager take up to a minute longer for NEC Storage PathManager to recognize path failures due to execution of failover. To avoid such situations, it is recommended that paths having priorities in numerical sequence do not have common resources. Express5800 StoragePathSavior Storage PathManager ???????? Priority: ? 4 ? 3 ? 2 ? 1 NEC Storage Figure 4-1 Setting priority (1) In the next figure, path priorities are set to 4, 2, 3, and 1 from left to right.
Chapter 4 Operating NEC Storage PathManager Express5800 Storage StoragePathSavior PathManager ???????? Priority: ? 4 ? 2 ? 3 ? NEC Storage Figure 4-2 Setting priority (2) IV-8 1
Chapter 4 44.2 .2 Operating NEC Storage PathManager H andling aabnormalities b n o r m a l i ti e s Handling 44..2 .1 .22.1 FA Qs aand nd ttroubleshooting r o u b l es h o o t i n g FA AQs If only one path is displayed in the -getlun option of NEC Storage PathManager, causes may be found in the table below. Refer to the descriptions in the table before making inquiries.
Chapter 4 Operating NEC Storage PathManager /2/ Select [System Information] from the tree. /3/ Select [Action] -> [Save as System Information File...] from the menu bar. /4/ Specify [File Name]. /5/ Click on [Save]. System information will be collected in a file with the specified file name. (2) Disk drive information Use "Device Manager" of Windows to collect disk drive information (bitmap image). /1/ Open [Start] -> [Settings] -> [Control Panel] -> [Administrative tools] -> [Computer Management].
Chapter 4 Operating NEC Storage PathManager Then starting from step /2/ above, select [Application] instead of [System] to collect application logs using the same procedures. (5) SPS logs Collect the SPS log file "spsevent.log." If the default installation destination of NEC Storage PathManager (C:\Program Files\NEC\SPS) is used, spsevent.log will exist at: C:\Program Files\NEC\SPS\Log\spsevent.log (6) Path information Execute the spscmd to collect path information.
e n di x pp A pp pendix Ap
Appendix A spscmd Appendix A spscmd [Name] spscmd - Settings for NEC Storage PathManager and display of its status.
Appendix A spscmd spscmd –failbackall It executes failback targeting all paths that are unavailable for use. spscmd –getfbmode It displays the failback method currently set. Active: active failback Standby: standby failback spscmd –getlun [-v] [-s0 | -s1 | -s2] It displays a path list. It displays a detailed list if the -v option is specified. The -s0, -s1, and -s2 options allow specification of the order of path display.
Appendix A spscmd It displays settings for path control. Health check: Settings for health check (Enable/Disable) Recovery check: Settings for recovery check (Enable/Disable) Request interval: Interval for issuing monitoring requests (in seconds) Threshold: Duration of time that a path has not been used (in seconds). This information is necessary for issuance of monitoring I/O. Timeout duration: Duration before timeout for monitoring I/O (in seconds).
Appendix A spscmd state = Enable or E: MSCS liaison is enabled state = Disable or D: MSCS liaison is disabled spscmd –setwatcher param It sets the state of path control to the state specified by "param.
Index Information gathering necessary in case of failures .. IV-9 Initial settings ............................................................ IV-3 Installation ...........................................................II-2, II-4 internal information ...................................................... I-4 iSpmLogger .................................................................. I-4 iSpmWatcher ................................................................
Priority size relationship ............................................III-9 ProductId ....................................................................III-6 spsevent.log ............................................................. III-24 Standby ....................................................III-3, III-4, III-8 standby failback...................................III-17, III-22, IV-5 Starting operation ...................................................... IV-2 State ...............................
