NEC Storage Software
NEC Storage PathManager
User’s Manual
(Windows version)
IS201-5E
© NEC Corporation 2003, 2004
No part of the contents of this book may be reproduced or
transmitted in any form without permission of NEC Corporation.
The contents of this book may be modified without notice in the future.
Preface
This document illustrates how to use NEC Storage PathManager.
NEC Storage PathManager multiplexes paths between a server and a storage unit in a system with Express5800 and the
NEC Storage Disk Array SubSystem.
st
1
edition: February, 2003
th
5
edition: July, 2004
Notes: (1) Functions described in this document are supported by the following software:
NEC Storage PathManager 3.1 Enterprise for Windows
NEC Storage PathManager 3.1 Standard for Windows
(2) Microsoft(R), Windows(R), and Windows NT(R) are registered trademarks or trademarks of Microsoft
Corporation in the United States and other countries.
(3) If you have any comments or requests regarding this manual or if the content of this manual requires further
clarification, fill in the "Comment form" provided at the end of this document and submit it to our sales
representatives or SEs.
iii
Contents
PART I OVERVIEW -------------------------------------------------------------------------------------------------------------------- I-1
Chapter 1 Overview of NEC Storage PathManager --------------------------------------------------------------------------I-2
1.1 About NEC Storage PathManager------------------------------------------------------------------------------------------- I-2
1.2 Configuration of NEC Storage PathManager ------------------------------------------------------------------------------I-3
1.3 System configuration ---------------------------------------------------------------------------------------------------------- I-4
PART II INSTALLATION ---------------------------------------------------------------------------------------------------------- II-1
Chapter 2 Installing NEC Storage PathManager ----------------------------------------------------------------------------II-2
2.1 Operating environment ------------------------------------------------------------------------------------------------------- II-2
2.2 Setup ---------------------------------------------------------------------------------------------------------------------------- II-2
PART III FUNCTIONS-------------------------------------------------------------------------------------------------------------- III-1
Chapter 3 Functions of NEC Storage PathManager----------------------------------------------------------------------- III-2
3.1 Path state display ------------------------------------------------------------------------------------------------------------- III-2
3.2 Path control -------------------------------------------------------------------------------------------------------------------III-7
3.3 Load balancing ------------------------------------------------------------------------------------------------------------- III-12
3.4 Cluster liaison--------------------------------------------------------------------------------------------------------------- III-15
3.5 Path patrol ------------------------------------------------------------------------------------------------------------------- III-16
3.6 Failure avoidance and failure recovery --------------------------------------------------------------------------------- III-20
3.7 Log extraction -------------------------------------------------------------------------------------------------------------- III-24
3.8 Message(ESMPRO liaison)----------------------------------------------------------------------------------------------- III-27
PART IV OPERATION ------------------------------------------------------------------------------------------------------------- IV-1
Chapter 4 Operating NEC Storage PathManager --------------------------------------------------------------------------IV-2
4.1 Operation in normal state --------------------------------------------------------------------------------------------------- IV-2
4.2 Handling abnormalities------------------------------------------------------------------------------------------------------IV-9
APPENDIX--------------------------------------------------------------------------------------------------------------------------------------1
Appendix A spscmd ------------------------------------------------------------------------------------------------------------------------- 2
Index---------------------------------------------------------------------------------------------------------------------------------------------- 6
i
P
P
P
a
a
a
r
r
r
I
t
I
t
I
t
O
O
O
v
v
e
e
r
r
v
v
i
e
i
w
w
e
w
e
i
v
r
e
v
Chapter 1 Overview of NEC Storage PathManager
Chapter 1 Overview of NEC Storage
PathManager
NEC Storage PathManager software multiplexes paths between a server and a storage unit in a system with Express5800
and the NEC Storage series Disk Array SubSystem. This software automatically switches paths to be used in case of
failures in paths currently in use. Also, this software uses multiple paths simultaneously to distribute loads to the paths.
This document will provide basic information such as an overview, hardware configuration, and software configuration
of NEC Storage PathManager. This document will also illustrate features of the software.
In this document, "NEC Storage series Disk Array SubSystem" will be referred to as "NEC
Storage" hereinafter.
1
.
1
A
b
o
u
t
N
E
C
S
t
o
r
a
g
e
P
a
t
h
M
a
n
a
g
e
r
1
.
1
A
b
o
u
t
N
E
C
S
t
o
r
a
g
e
P
a
t
h
M
a
n
a
1
.
1
A
b
o
u
t
N
E
C
S
t
o
r
a
g
e
P
a
t
h
M
a
Availability is one of the important points when constructing a SAN system and needless to say this
availability largely relies on the storage subsystem. This is because a storage subsystem is one of the most
common places in a system to experience failures.
A variety of methods have been found and used so far in order to reduce failure occurrence in storage units
and smoothly recover from failures. Examples include RAIDs, hot spares, and replications. These functions
are also provided in NEC Storage to achieve high availability.
Unfortunately, these solutions are only effective for media errors. If failures occur in host bus adapters,
controllers, or physical paths (such as fibre channel cables and switches) between a server and a storage unit,
spindle redundancy alone will not be sufficient to continue operating the system. This is because there will
be no means for accessing data in the storage unit even though the data themselves are intact. Even a heavily
protected storage unit will lose all its power once a path failure occurs. This also applies to NEC Storage.
1
.
1
.
1
1
1
.
1
.
1
.
1
.
1
H
a
n
d
l
i
n
g
p
a
t
h
f
a
i
l
u
r
e
s
H
a
n
d
l
i
n
g
p
a
t
h
f
a
i
l
H
a
n
d
l
i
n
g
p
a
t
h
u
f
a
i
l
u
r
e
s
r
e
s
n
a
g
g
e
e
r
r
NEC Storage PathManager provides an infrastructure to multiplex paths and eliminate the abovementioned
vulnerability present between a server and a storage unit in a system.
When a failure occurs in a path and a storage unit can no longer be accessed during system operation, NEC
Storage PathManager will detect the event. NEC Storage PathManager then switches the path to be used
from the failed path to a normal path so that access to the storage unit can continue. No I/O will be lost
I-2
Chapter 1 Overview of NEC Storage PathManager
during the course of switching the paths. Applications can continue their processing without being aware of
the path failure.
1
.
1
.
2
1
1
Static load balancing and dynamic load balancing methods are used so that it is possible to take advantage of
the features of NEC Storage. Using this function will improve the access efficiency of NEC Storage.
1
1
1
(Microsoft Cluster System) Environments. As a result, cluster systems and multiplexed paths are combined,
and systems that are more solid than before can be constructed. Using NEC Storage PathManager eliminates
.
1
.
2
.
1
.
2
NEC Storage PathManager has a load balancing function that uses multiplexed paths to distribute loads.
.
1
.
3
.
1
.
3
.
1
.
3
NEC Storage PathManager works together with NEC Storage to support CLUSTERPRO and MSCS
L
o
a
d
b
a
l
a
n
c
i
n
g
f
u
n
c
t
i
o
n
y
i
o
n
i
o
n
s
t
e
m
s
m
m
s
s
s
s
t
e
t
e
L
o
a
d
b
a
l
a
n
c
i
n
g
f
u
n
c
e
e
r
n
r
r
t
c
t
s
y
s
y
s
L
S
S
S
o
u
u
u
a
p
p
p
d
p
p
p
o
o
o
b
a
l
a
n
c
i
n
g
f
u
r
t
f
o
r
c
l
u
s
t
r
t
f
o
r
c
r
t
f
o
l
r
c
l
u
u
s
s
e
t
t
the necessity to use the failover function for nodes in cluster systems in order to avoid path failures.
1
.
2
C
o
n
f
i
g
u
r
a
t
i
o
n
o
f
N
E
C
S
t
o
r
a
g
e
1
.
2
C
o
n
f
i
g
u
r
a
t
i
o
n
o
f
N
E
C
S
t
o
r
1
.
2
C
o
n
f
i
g
u
r
a
t
i
o
n
o
f
N
E
C
S
P
a
t
h
M
a
n
a
g
e
r
P
a
t
h
M
a
n
a
P
a
t
h
M
a
NEC Storage PathManager operates on servers such as Express5800 and monitors the paths connected by
FC cables between the HBA (host bus adapter) at the server and the HP (host port) of NEC Storage.
NEC Storage PathManager consists of the following modules:
/1/ NEC Storage PathManager driver
This is a group of drivers that form the core of NEC Storage PathManager. It controls basic functions
of NEC Storage PathManager such as multiplexed paths and load balancing.
/2/ Operation command (spscmd)
This is a command used to check status or make settings for actions or paths of NEC Storage
PathManager. Use the command prompt to use this command. This operation command is used in
n
a
g
g
e
e
r
r
a
t
o
r
a
g
g
e
e
most of the NEC Storage PathManager related operations.
/3/ Path patrol service (iSpmWatcher)
This service offers a path patrol function that automatically monitors status of the paths. It issues
requests for path monitoring to the NEC Storage PathManager driver every specified period of time.
/4/ Log service (iSpmLogger)
I-3
Chapter 1 Overview of NEC Storage PathManager
This service offers a log extract function that writes log information related to NEC Storage
PathManager in the event log. From internal information of NEC Storage PathManager, it writes
important information in the event log.
Server
Application
I/O request
NEC Storage
PathManager
Operation
command
(spscmd)
HBA HBA HBA
HP HP HP
Figure 1-1 Configuration of NEC Storage PathManager
File system
NEC Storage
PathManager
driver
Port/miniPort
driver
…
…
…
…
iStorage
Path patrol service
(iSpmWatcher)
Log service
(iSpmLogger)
Event log
1
.
3
S
y
s
t
e
m
c
o
n
f
i
g
u
r
a
t
i
o
n
1
.
3
S
y
s
t
e
m
c
o
n
f
i
g
u
r
a
1
.
3
S
y
s
t
e
m
c
o
n
f
i
g
A basic configuration example of a system to which NEC Storage PathManager is installed will be
illustrated below.
1
.
3
.
1
1
1
the configuration is the most common.
.
3
.
1
.
3
.
1
In this configuration, a server and NEC Storage are directly connected. The system is relatively small, and
S
i
n
g
l
e
-
s
e
r
v
e
r
S
i
n
g
l
e
-
s
e
S
i
n
g
l
e
r
-
s
e
r
v
v
e
e
I-4
r
r
u
c
c
c
r
o
o
o
a
n
n
n
t
t
f
f
f
i
o
n
i
o
n
i
g
u
r
a
t
i
o
n
i
g
u
r
a
u
t
r
a
t
i
g
i
o
n
i
o
n
Chapter 1 Overview of NEC Storage PathManager
Express5800
Storage PathManager
NEC Stora
Figure 1-2 Single-server configuration
e
1
.
3
.
2
1
1
when multiple servers having different tasks share a relatively large NEC Storage. Exclusive control such as
access control is necessary among logical units used by respective servers.
.
3
.
2
.
3
.
2
In this system, multiple servers are directly connected to NEC Storage. This system configuration is used
M
u
l
t
i
p
l
e
-
s
e
r
v
e
r
c
o
n
f
i
g
u
r
a
t
i
o
n
M
u
l
t
i
p
l
e
-
s
e
r
v
e
r
c
o
n
f
i
g
u
r
a
M
u
l
t
Express5800
i
p
l
e
-
s
e
r
v
e
r
c
o
n
f
i
g
Express5800
StoragePathSavior
Storage PathManager Storage PathManager
u
t
r
a
t
i
o
n
i
o
n
NEC Storage
Figure 1-3 Multiple-server configuration
I-5
Chapter 1 Overview of NEC Storage PathManager
1
.
3
.
3
1
1
NEC Storage so that multiple servers will make the same logical unit visible.
.
3
.
3
.
3
.
3
Below is an example of a cluster system configuration. There are FC switches between the server and
C
l
u
s
t
e
r
c
o
n
f
i
g
u
r
a
t
C
l
u
s
t
e
r
c
o
n
f
i
g
C
l
u
s
Express5800
t
e
r
c
o
n
StoragePathSavior
Storage PathManager
u
f
i
g
u
i
r
a
t
i
r
a
t
o
n
o
n
i
o
n
Express5800
StoragePathSavior
Storage PathManager
NEC Storage
Figure 1-4 Cluster configuration
I-6
P
P
P
a
a
a
r
r
r
t
t
t
I
I
I
I
I
I
I
s
n
I
s
n
I
l
a
t
l
a
t
i
t
a
l
i
t
a
l
o
o
n
n
n
o
i
t
a
l
l
a
t
s
n
Chapter 2 Installing NEC Storage PathManager
Chapter 2 Installing NEC Storage
PathManager
2
.
1
O
p
e
r
a
t
i
n
g
e
n
v
i
r
o
2
.
1
O
p
e
r
a
t
i
n
g
e
n
2
.
1
O
p
e
r
a
t
i
n
g
Operating environment for NEC Storage PathManager is shown below:
Table 2-1 Operating environment
OS
Server Express5800/100 series, 1000 series, ft series
Memory Necessary memory for OS + 10 MB, or more
Disk
HBA Host bus adapter specified by NEC Storage
NEC Storage
(*1) Storage PathManager on IA64 servers does not support NEC Storage S100 series.
v
e
n
v
Enterprise Standard
Windows 2000 Advanced Server (Service Pack 3 or later)
Windows Server 2003, Enterprise Edition (both 32-bit and 64-bit(*1))
Windows 2000 Server (Service Pack 3 or later)
Necessary disk size for program operation: more than 23 MB
- 4000 series
- 3000 series
- 2800 series
- 2000 series
- 1000 series
- 100 series
n
i
r
o
i
r
o
Windows Server 2003, Standard Edition
m
e
n
n
m
n
m
Program size: 13 MB
e
e
n
n
t
t
t
- 2800 series
- 2000 series
- 1000 series
- 100 series
2
.
2
S
e
t
u
p
2
.
2
S
2
.
2
The Setup CD is used to install/uninstall NEC Storage PathManager. The Setup CD allows the following
actions:
/1/ Installation
It installs the program to the server and registers the HBA in NEC Storage PathManager.
/2/ Uninstallation
It completely removes NEC Storage PathManager from the server.
/3/ Version upgrade
Users who are using previous versions of this software can use this mode and easily prepare for
installation of this version.
Procedures for each action will be illustrated in the following sections. For further details, refer to the
"Storage PathManager Installation Guide."
S
e
e
t
u
p
t
u
p
II-2
Chapter 2 Installing NEC Storage PathManager
After installing NEC Storage PathManager and before starting its operation, make sure to read
"Chapter 4 Operating NEC Storage PathManager" and check operation status and make settings.
2
.
2
.
1
2
2
.
2
.
1
.
2
.
1
Read the following notes before starting the setup of NEC Storage PathManager.
/1/ Make sure to use HotFix (Q323289_W2K_SP4_X86_EN.exe) on the Setup CD when working
B
e
f
o
r
e
s
e
t
u
p
B
e
f
o
r
e
s
in a Windows 2000 Service Pack 3 environment. HotFix solves the Windows 2000 memory
leak problem that would affect NEC Storage PathManager. HotFix is for use only in a
Service Pack 3 environment. Never use HotFix in any other environments. This HotFix is
B
e
f
o
r
e
e
s
e
t
u
p
t
u
p
included in Service Pack 4.
/2/ Do not connect the server and NEC Storage via multiple paths until setup of NEC Storage
PathManager is complete. Turning on the server while multiple paths connect the server and NEC
Storage may result in fatal damage to file systems.
/3/ Follow the HBA setup procedure manual to set up the FibreChannel driver.
/4/ Set the cross call of NEC Storage to "On." For settings of the cross call, refer to the NEC Storage
manual.
/5/ If "Alert Manager Main Service" is active, temporarily stop the service and then set up NEC
Storage PathManager in order to ensure successful registration of liaison functions.
/6/ When using E
PathManager first and then E
/7/ When upgrading NEC Storage PathManager in an environment using EXPRESSCLUSTER
(CLUSTERPRO) or MSCS, the upgrade must be conducted at one node at a time. If a group is in
operation at the node where upgrading will be conducted, move the group beforehand to any other
node. Move the group back to the original node after completing the upgrade. Refer to manuals
XPRESSCLUSTER (CLUSTERPRO) or MSCS, make sure to set up NEC Storage
XPRESSCLUSTER (CLUSTERPRO) or MSCS.
of respective products for how to move groups.
2
.
2
.
2
2
2
.
2
.
2
.
2
.
2
Use the Setup CD and follow the procedures below to install NEC Storage PathManager.
I
n
s
t
a
l
l
a
t
i
o
n
I
n
s
t
a
l
l
a
I
n
s
t
a
t
l
l
a
t
i
o
n
i
o
n
II-3
Chapter 2 Installing NEC Storage PathManager
Make sure to use HotFix (Q323289_W2K_SP4_X86_EN.exe) contained in the Setup CD
when installing NEC Storage PathManager in a Windows 2000 Service Pack 3 environment. HotFix
solves the Windows 2000 memory leak problem that would affect NEC Storage PathManager. HotFix is
for use only in a Windows 2000 Service Pack 3 environment. Never use HotFix in any other
environments. This HotFix is included in Windows 2000 Service Pack 4.
/1/ Completely disconnect the server and NEC Storage while the server is turned off.
/2/ Turn the server on and log in as an administrative user.
/3/ Insert the Setup CD into the CD drive unit.
/4/ Follow the instructions of the installer to install NEC Storage PathManager.
/5/ Once the installation is complete, connect NEC Storage and the server used in installation (if you are
requested to reboot the system, first reboot the system and then make the above connection).
For further information regarding installation procedures, refer to the "Storage PathManager Installation
Guide."
2
.
2
.
3
2
2
Guide."
.
2
.
3
.
2
.
3
Use the Setup CD and follow the procedures below to uninstall NEC Storage PathManager.
/1/ Completely disconnect the server and NEC Storage while the server is turned off.
/2/ Turn the server on and log in as an administrative user.
/3/ Insert the Setup CD into the CD drive unit.
/4/ The dialogue box [Storage PathManager Maintenance] will be displayed. Click on the [Uninstall]
button.
/5/ Follow the instructions of the installer to uninstall NEC Storage PathManager.
For further information regarding uninstallation procedures, refer to the "Storage PathManager Installation
U
n
i
n
s
t
a
l
l
a
t
i
o
n
U
n
i
n
s
t
a
l
l
a
U
n
i
n
s
t
a
t
l
l
a
t
i
o
n
i
o
n
II-4
Chapter 2 Installing NEC Storage PathManager
When turning on the server after uninstalling NEC Storage PathManager, make sure that the
connection between the server and NEC Storage is not redundant. You can also set the cross call of
NEC Storage to "Off." Turning on the server while the connection is redundant may result in
unexpected damage to the file systems. For cross call settings, refer to the NEC Storage manual.
2
.
2
.
4
2
2
.
2
.
4
.
2
.
4
Use the Setup CD and follow the procedures below to upgrade NEC Storage PathManager.
/1/ Completely disconnect the server and NEC Storage while the server is turned off.
/2/ Turn the server on and log in as an administrative user.
V
e
r
s
i
o
n
u
p
g
r
a
d
e
V
e
r
s
i
o
n
u
p
g
V
e
r
s
i
o
n
u
p
g
r
r
a
a
d
d
e
e
/3/ Insert the Setup CD into the CD drive unit.
/4/ Follow the instructions of the installer to upgrade NEC Storage PathManager.
If the previous version of NEC Storage PathManager and EXPRESSCLUSTER (CLUSTERPRO)
were used in combination, the X-CALL DISK setting information of EXPRESSCLUSTER
(CLUSTERPRO) will be lost during the course of the version upgrade. Refer to the "Storage
PathManager Installation Guide" and use the CLUSTERPRO Disk Administrator to remake the X-CALL
DISK settings.
For further information regarding procedures for version upgrade refer to the "Storage PathManager
Installation Guide."
II-5
P
P
P
a
a
a
r
r
r
t
t
t
I
I
I
I
I
I
F
F
u
u
n
n
c
c
o
i
t
o
i
t
n
n
s
s
s
n
o
i
t
c
n
u
F
I
I
I
Chapter 3 Functions of NEC Storage PathManager
Chapter 3 Functions of NEC Storage
PathManager
This chapter describes functions that NEC Storage PathManager offers. Basic functions of NEC Storage PathManager
can be roughly categorized as follows:
/1/ Path state display
This function displays information regarding state of paths.
/2/ Path control
This function sets the state of paths.
/3/ Load balancing
This function distributes I/O loads to multiple paths.
/4/ Cluster liaison
This function enables the program to operate in a cluster environment (such as CLUSTERPRO and
MSCS).
/5/ Path patrol
This function monitors the state of paths. It also detects failures and recovery from failures as they occur.
/6/ Failure avoidance and failure recovery
This function shuts down failed paths when failures occur, uses the failover function to use alternative
paths, and uses the failback function at the time of failure recovery.
/7/ Log extraction
This function outputs operation information and failure information to system log files and dedicated log
files as operation histories.
/8/ Message (ESMPRO liaison)
This function issues notifications to operators as performance or failure information is outputted.
3
.
1
P
a
t
h
s
3
3
.
1
P
a
.
1
P
a
t
t
h
h
t
s
t
s
t
a
a
a
t
e
d
i
s
p
l
a
y
t
e
d
i
s
d
p
i
s
p
t
e
l
a
y
l
a
y
The path state display function is the most basic function of NEC Storage PathManager. For each logical
unit, this function lists the state of the paths that are managed by NEC Storage PathManager.
An spscmd will activate the path state display function. The state of the paths managed by NEC Storage
PathManager will first be described below. Then corresponding spscmd options such as the -getlun option
used in path state display will be described.
III-2