Fujitsu ETERNUS Multipath Driver V2 User Manual

Download

FUJITSU Storage ETERNUS Multipath Driver V2 User's Guide

for Linux

P2U3-0031-15ENZ0

This page is intentionally left blank.

This FUJITSU Storage ETERNUS Multipath Driver User's Guide describes the features, functions, and operation of the "ETERNUS Multipath Driver" (hereinafter referred to as "Multipath Driver") software on a Linux server. This manual describes how to use the Multipath Driver to manage the path control, connection status, and other features of FUJITSU Storage "ETERNUS Disk storage system, ETERNUS All Flash Array, GR series" (hereinafter referred to as "storage system" unless stated otherwise). The latest information is provided in the "FUJITSU Storage ETERNUS Multipath Driver V2 (for Linux) Installation Information" found under "Downloads" at the following URL:

http://www.fujitsu.com/global/products/computing/storage/software/eternus-mpd/

Intended Audience

This guide is intended for system administrators who are connecting the storage system to a Linux server.

Preface

Fifteenth Edition

October 2014

Organization and Contents

This guide is composed of the following 11 chapters and an appendix.

● Chapter 1 What is Multipath Driver?

This chapter explains the features, functions, and connection patterns of the Multipath Driver.

● Chapter 2 Multipath Driver System Setup

This chapter explains how to install and uninstall the Multipath Driver. Instructions are provided for setting up the system environment, including setup of logical units, partitions, and file systems, and mounting the storage system.

● Chapter 3 Multipath Driver Functions and Operation

This chapter explains how to use the main commands to operate various functions of the Multipath Driver.

● Chapter 4 Changing the Multipath Configuration (FC/FCoE Connection for RHEL-AS4, RHEL-ES4, RHEL5,

SLES9, or SLES10)

This chapter explains how to change a multipath configuration for a FC/FCoE connection with RHEL-AS4, RHEL-ES4, RHEL5, SLES9, or SLES10.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Preface

● Chapter 5 Changing the Multipath Configuration (SAS Connection for RHEL-AS4, RHEL-ES4, RHEL5, or

SLES10)

This chapter explains how to change a multipath configuration for a SAS connection with RHEL-AS4, RHELES4, RHEL5, or SLES10.

● Chapter 6 Changing the Multipath Configuration (iSCSI Connection for RHEL5, SLES9, or SLES10)

This chapter explains how to change a multipath configuration for an iSCSI connection with RHEL5, SLES9, or SLES10.

● Chapter 7 Changing the Multipath Configuration (FC/FCoE Connection for RHEL6, RHEL7, or SLES11)

This chapter explains how to change a multipath configuration for a FC/FCoE connection with RHEL6, RHEL7, or SLES11.

● Chapter 8 Changing the Multipath Configuration (SAS Connection for RHEL6, RHEL7, or SLES11)

This chapter explains how to change a multipath configuration for a SAS connection with RHEL6, RHEL7, or SLES11.

● Chapter 9 Changing the Multipath Configuration (iSCSI Connection for RHEL6, RHEL7, or SLES11)

This chapter explains how to change a multipath configuration for an iSCSI connection with RHEL6, RHEL7, or SLES11.

● Chapter 10 Notes when Using the Multipath Driver

This chapter contains important notes for using the Multipath Driver.

● Chapter 11 Command Reference

This chapter contains important notes for using the Multipath Driver.

A list of "Syslog Messages" is provided in the appendix.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Preface

Trademarks, Product Names, and Abbreviations Used in this Guide

• "HBA" represents a Host Bus Adapter, which is a Linux server-installed Fibre Channel card, Serial Attached

SCSI (SAS) card, or Converged Network Adapter (CNA) that connects to a storage system.

• "NIC" is a Network Interface Card.

• "CA" is a storage system Channel Adapter.

• "CM" is a storage system Controller Module.

• The following software bundle is described as "ETERNUS Web GUI".

- Web-based GUI management tool that is provided with the storage system as standard

- ETERNUSmgr that is installed in some storage systems

• Red Hat Enterprise Linux series products are as described below.

Product names Abbreviation

Red Hat Enterprise Linux 7 RHEL7

Red Hat Enterprise Linux 6 RHEL6

Red Hat Enterprise Linux 5 RHEL5

Red Hat Enterprise Linux AS v.4 RHEL-AS4

Red Hat Enterprise Linux ES v.4 RHEL-ES4

• SUSE Linux Enterprise Server series products are as described below.

Product names Abbreviation

SUSE Linux Enterprise Server 11 SLES11

SUSE Linux Enterprise Server 10 SLES10

SUSE Linux Enterprise Server 9 SLES9

Related Manuals

Refer to the following related manuals for more information:

• The storage system manual

• The manual provided with ETERNUS Web GUI/GRmgr/ETERNUSmgr

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Preface

Typographical Conventions

The following conventions are used in this guide.

A product-usage caution that must be followed. Not doing so may result in loss of data.

A note that provides additional information.

High Safety

This Product is designed, developed and manufactured as contemplated for general use, including without limitation, general office use, personal use, household use, and ordinary industrial use, but is not designed, developed and manufactured for use in situations with accompanying fatal risks or dangers that, unless extremely high safety is secured, could lead directly to death, personal injury, severe physical damage or other loss (hereinafter "High Safety Required Use"), including without limitation, nuclear reaction control in nuclear facility, aircraft flight control, air traffic control, mass transport control, medical life support system, and missile launch control in weapon systems. Do not use this Product for High Safety Required Use without securing the sufficient safety level required. If you wish to use this Product for High Safety Required Use, please consult with our sales representative before such use.

Linux is a registered trademark of Linus Torvalds. Red Hat is a registered trademark of Red Hat, Inc. in the U.S. and other countries. SUSE is a registered trademark of Novell, Inc. in the United States and other countries. Intel, the Intel logo, Itanium, and the Itanium logo are trademarks of Intel Corporation in the U.S. and other countries. The company names, product names and service names mentioned in this document are registered trademarks or trademarks of their respective companies.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Multipath Driver Modification History

This section provides a history of modifications for the Multipath Driver.

■ V2.0L03 modifications

● Modification outline

Previously, when a response from the device was "Illegal Request", it was changed to "DID_SOFT_ERROR". For V2.0L03, the "Illegal Request" response does not change to "DID_SOFT_ERROR".

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L02 or earlier The "Illegal Request" response from the device changes to "DID_SOFT_ERROR".

V2.0L03 The "Illegal Request" response from the device does not change to "DID_SOFT_ERROR".

Release Information

- Modification effect

Previously, some I/Os for which the cause of the error was "Illegal Request" returned "DID_SOFT_ERROR". After this modification, "Illegal Request" is returned for I/Os for which the error factor is "Illegal Request".

● Modification outline

The error levels of some messages that were NOTICE or lower error levels have been changed to WARNING or higher. In addition, the error levels of some messages that were WARNING or higher have been changed to NOTICE or lower.

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L02 or earlier Some error messages that require device monitoring have "NOTICE" error level. Some

error messages that do not require device monitoring have "WARNING" error level.

V2.0L03 For error messages that require device monitoring, "WARNING" or higher error level are

displayed. For error messages that do not require device monitoring, "NOTICE" or a lower error level are displayed.

- Modification effect

This change affects when error levels are used for message monitoring.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

■ V2.0L10 modification

● Modification outline

■ V2.0L11 modification

● Modification outline

The "by-path" name for the udev function is not created after V2.0L10 is applied. Use the "by-id" name.

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L03 or earlier Creates a "by-path" name.

V2.0L10 Does not create a "by-path" name.

- Modification effect

The "by-path" name for the udev function cannot be used. Use the "by-id" name.

Removed the function that inquires whether the udev function is used or not when using the "mpdconfig s" command.

- Modification target

"mpdconfig" command

- Modification details

Version Modification details

V2.0L10 or earlier Inquires whether the udev function is used or not when using the "mpdconfig -s"

command.

V2.0L11 Does not inquire whether the udev function is used or not when using the "mpdconfig -s"

command.

- Modification effect

Does not affect any other operation.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

■ V2.0L12 modifications

● Modification outline

The default Max Throttle value of the ETERNUS2000 is changed from "256" to "40".

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L11 or earlier The default Max Throttle value of the ETERNUS2000 is "256".

V2.0L12 The default Max Throttle value of the ETERNUS2000 is "40".

- Modification effect

After a connected ETERNUS2000 is initially recognized, the Max Throttle value is changed from "256" to "40".

The default Max Throttle setting of the ETERNUS8000, the ETERNUS6000, and the ETERNUS4000 model 300 and 500 is automated.

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L11 or earlier The default Max Throttle value of the ETERNUS8000, the ETERNUS6000, and the

ETERNUS4000 model 300 and 500 has to be manually specified.

V2.0L12 The default Max Throttle value of the ETERNUS8000, the ETERNUS6000, and the

ETERNUS4000 model 300 and 500 is automatically specified.

- Modification effect

When connecting to the ETERNUS8000, the ETERNUS6000, and the ETERNUS4000 model 300 and 500, Max Throttle does not have to be set with the "mpdconfig -m" command.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

MPDH%d: NOTICE: %s: Device configuration is without CFL redundancy. All paths connect to (ZZ%x, ZZ%x).

■ V2.0L13 modifications

● Modification outline

The maximum number of devices for the specifying recognition order is changed from "20" to "32".

- Modification target

Multipath Driver, "mpdconfig" command

- Modification details

Version Modification details

V2.0L12 or earlier Up to 20 devices can be specified for the recognition order.

V2.0L13 Up to 32 devices can be specified for the recognition order.

- Modification effect

Up to 32 storage systems can be specified for the recognition order. If 33 or more storage systems are specified for the recognition order and the "mpdconfig -s" command is executed, the following error message is displayed:

Cannot setup because the number of devices is greater than 32.

● Modification outline

Added a message for loading concurrent firmware in storage systems.

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L12 or earlier Even when performing concurrent firmware loading closes all the paths for the

connected storage system, a message is not output in "/var/log/messages".

V2.0L13 When performing concurrent firmware loading closes all the paths for the connected

storage system, the following message is output in "/var/log/messages":

- Modification effect

When performing message monitoring, the newly added message may not be monitored as intended. Note that this change does not affect the message monitoring function with Fujitsu middleware.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

MPDH%d: NOTICE: SCSI%u (%u, %u, %u) : I/O LUN degrade. number of online paths left of this LUN =%d

MPDH%d: WARNING: I/O LUN degraded, no more online path of this LUN.

SCSI%u (%u, %u ,%u): ERROR=0x05: abort

SCSI%u (%u, %u ,%u): ERROR=0x06: parity error

SCSI%u (%u, %u ,%u): ERROR=0x07: internal error

SCSI%u (%u, %u ,%u): ERROR=0x08: reset

SCSI%u (%u, %u ,%u): ERROR=0x0b: soft error

● Modification outline

Some error messages for I/O are added or changed.

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L12 or earlier When an I/O error occurs, the following message is output in "/var/log/ messages":

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

MPDH%d: NOTICE: SCSI%u (%u, %u, %u) : I/O LUN degrade. MPDH%d: NOTICE: SCSI%u (%u, %u, %u) : I/O LUN failed. number of online paths left for this LUN =%d

MPDH%d: NOTICE: SCSI%u (%u, %u, %u) : I/O rejection. number of online paths left for this LUN =%d.

MPDH%d: WARNING: I/O LUN failed, no more online path for this LUN.

MPDH%d: WARNING: I/O rejection, no more online path for this LUN.

SCSI%u (%u, %u ,%u): ERROR=0x05: HBA abort

SCSI%u (%u, %u ,%u): ERROR=0x06: HBA parity error

SCSI%u (%u, %u ,%u): ERROR=0x07: HBA internal error

SCSI%u (%u, %u ,%u): ERROR=0x08: HBA reset

SCSI%u (%u, %u ,%u): ERROR=0x0b: HBA soft error

MPDH%d: WARNING: SCSI%u (%u, %u, --) : I/O timeout was detected by the scsi timer.

SCSI%u (%u, %u ,%u): ERROR=0x02: HBA bus busy

SCSI%u (%u, %u ,%u): ERROR=0x04: HBA bad target

SCSI%u (%u, %u ,%u): STATUS ERROR=%d

Version Modification details

V2.0L13 When an I/O error occurs, the following message is output in "/var/log/ messages":

• Changed message

• Added message

- Modification effect

When performing message monitoring, the newly added message may not be monitored as intended. Note that this change does not affect the message monitoring function with Fujitsu middleware.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

LUN degraded,

bus busy,

parity,

abort,

internal error,

reset,

soft error

LUN trouble

I/O rejection,

HBA bus busy,

HBA parity error,

HBA abort,

HBA internal error,

HBA reset,

HBA soft error,

HBA bad target,

● Modification outline

Some of the path details in the output of the "iompadm info" command are added or changed.

- Modification target

"iompadm" command

- Modification details

Version Modification details

V2.0L12 or earlier The path details in the "iompadm info" command output when executing the "iompadm

info" command after an I/O error occurs are shown below.

V2.0L13 The path details in the "iompadm info" command output when executing the "iompadm

info" command after an I/O error occurs are shown below.

- Modification effect

When analyzing the result of the "iompadm info" command, the newly added message may not be analyzed as intended. Note that this change does not affect the Fujitsu middleware that analyzes the "iompadm info" command result.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

SCSI%u (%u, %u ,%u): incomplete scsi cdb=0x%x - giving up

SCSI%u (%u, %u ,%u): incomplete scsi cdb=0x%x

● Modification outline

Changed the message that is displayed when the I/O by diagnosis function fails.

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L12 or earlier The following message is displayed when the I/O by diagnosis function fails:

V2.0L13 The following message is displayed when the I/O by diagnosis function fails:

- Modification effect

When performing message monitoring, the newly added message may not be monitored as intended. Note that this change does not affect the message monitoring function with Fujitsu middleware.

■ V2.0L14 modification

● Modification outline

The initial RAM disk and boot loader settings for an Multipath Driver that is not used any more are automatically deleted.

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L13 or earlier Does not delete the initial RAM disk and boot loader settings for an Multipath Driver that

V2.0L14 Deletes the initial RAM disk and boot loader settings for an Multipath Driver that will not

- Modification effect

Initial RAM disk settings that are not needed are deleted. The boot loader setting to boot up with this Initial RAM disk is also deleted.

will not be used.

be used.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

SCSI%u (%u, %u ,%u): SK=0x04 SC=0xf2 SSC=0x%x FRU=0x%x: FRU broken SCSI%u (%u, %u ,%u): SK=0x%x SC=0x%x SSC=0x%x FRU=0x%x SCSI%u (%u, %u ,%u): ERROR=0xf: HBA transport fail fast

■ V2.0L20 modifications

● Modification outline

Added an output message when an I/O error is occurred.

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L14 or earlier In the following conditions, no messages are output even when an I/O error occurs:

• When the storage system responds the sense information below:

Sense key= 0x04, ASC=0xf2, ASCQ=0x00 – 0xff Sense key= 0x06, ASC=0xfb, ASCQ=0x81 – 0x8f

• When the HBA responds "DID_TRANSPORT_FAILFAST".

V2.0L20 In the following conditions, messages are output when an I/O error occurs:

• When the storage system responds the sense information below:

Sense key= 0x04, ASC=0xf2, ASCQ=0x00 – 0xff Sense key= 0x06, ASC=0xfb, ASCQ=0x81 – 0x8f

• When the HBA responds "DID_TRANSPORT_FAILFAST".

The following shows the example of the output message when an I/O error occurs:

- Modification effect

When performing message monitoring, the newly added message may not be monitored as intended. Note that this change does not affect the message monitoring function with Fujitsu middleware.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

MPDH%d: NOTICE: %s: Device configuration succeeded.

MPDH%d: WARNING: %s: Device configuration is without redundancy.

MPDH%d: NOTICE: %s: Device configuration is without CFL redundancy. All paths connect to (RT%x, RT%x).

MPDH%d: NOTICE: %s: Device configuration is without CFL redundancy. All paths connect to (CM%x, CM%x).

MPDH%d: NOTICE: %s: Device configuration succeeded.

MPDH%d: WARNING: %s: Device configuration is without redundancy.

MPDH%d: NOTICE: %s: Device configuration is without CFL redundancy. All paths connect to (RT%x, RT%x).

MPDH%d: NOTICE: %s: Device configuration is without CFL redundancy. All paths connect to (CM%x, CM%x).

MPDH%d: WARNING: %s: This path was unrecognizable.

MPDH%d: NOTICE: %s: Device configuration succeeded.

■ V2.0L23 modifications

● Modification outline

Added syslog messages and changed the output timing of syslog messages that are output when starting up a Red Hat Enterprise Linux 5 or SUSE Linux Enterprise Server 10 system.

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L22 or earlier The following syslog messages are sequentially output during system startup:

Note that the following syslog message is output when path redundancy is maintained regardless of whether the path is recognized or not.

V2.0L23 The following syslog messages are sequentially output during system startup:

Note that the following syslog message is output when path redundancy is maintained

- Modification effect

When performing message monitoring, the newly added message may not be monitored as intended. Note that this change does not affect the message monitoring function with Fujitsu middleware.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

and all the paths are recognized.

Release Information

!!! WARNING !!! ETERNUS Multipath Driver is not loaded.

● Modification outline

Added console messages that are output when starting up the system.

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L22 or earlier No messages are output on the console if the Multipath Driver is not loaded when

starting up the system.

V2.0L23 The following message is output on the console if the Multipath Driver is not loaded

when starting up the system:

- Modification effect

When performing message monitoring, the newly added message may not be monitored as intended. Note that this change does not affect the message monitoring function with Fujitsu middleware.

■ V2.0L24 modifications

● Modification outline

Changed the command so that a backup file is created for the initial RAM disk when the "mpdsetup" command is executed.

- Modification target

"mpdsetup" command

- Modification details

Version Modification details

V2.0L23 or earlier If there are no problems with the load order when the "mpdsetup" command is executed:

V2.0L24 If there are no problems with the load order when the "mpdsetup" command is executed:

- Modification effect

A backup file for the initial RAM disk is added under the /boot directory.

the existing initial RAM disk name is used as the file name of ".mpdbak".

If there are problems with the load order when the "mpdsetup" command is executed:

a backup file is not created.

the existing initial RAM disk name is used as the file name of ".mpdbak".

If there are problems with the load order when the "mpdsetup" command is executed:

the existing initial RAM disk name is used as the file name of ".mpdsetup".

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

● Modification outline

Added conditions that trigger the recreation of the initial RAM disk and restarting of the system when Red Hat Enterprise Linux 9 system, SUSE Linux Enterprise Server 10 system, or SUSE Linux Enterprise Server 11 system starts up.

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L23 or earlier There are problems with the load order of the Multipath Driver modules.

V2.0L24

• There are problems with the load order of the Multipath Driver modules.

• The Multipath Driver modules are not loaded, and the Multipath Driver modules that

correspond to the initial RAM disk that is used at system startup do not exist.

- Modification effect

When the system starts without loading the Multipath Driver modules, recreation of the initial RAM disk and restarting of the system may occur.

Added a service (mpdprerc) to the Multipath Driver.

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L23 or earlier The Multipath Driver has the following two services.

• mpdrc

• mpdstrrc

V2.0L24 The Multipath Driver has the following two services.

• mpdrc

• mpdstrrc

In the following conditions, mpdprerc is added as a service:

• When a server with Red Hat Enterprise Linux 5 is connected to the storage system via

an iSCSI interface

• When Red Hat Enterprise Linux 6 is used

• When a server with SUSE Linux Enterprise Server 10 is connected to the storage

system via an iSCSI interface

• When SUSE Linux Enterprise Server 11 is used and the open-iscsi service is enabled

- Modification effect

A service (mpdprerc) for the Multipath Driver is added to the services that are executed at system startup. Apart from the adding of the services listed above, there is no other affect on servers.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

MPDH%d: NOTICE: SCSI%u (%u, %u, %u) : I/O rejection. number of online paths left for this LUN =%d.

■ V2.0L25 modifications

● Modification outline

Changed the command so that the offline status is checked for a device when the "iompadm info" command is executed.

- Modification target

"iompadm" command

- Modification details

Version Modification details

V2.0L24 or earlier The offline status is not checked for a device when the "iompadm info" command is

executed.

V2.0L25 The offline status is checked for a device when the "iompadm info" command is

executed. The following syslog message may be output if offline status is detected:

- Modification effect

When performing message monitoring, the newly added message may not be monitored as intended. Note that this change does not affect the message monitoring function with Fujitsu middleware.

● Modification outline

The default Max Throttle setting of the ETERNUS DX60/DX60 S2, DX80/DX80 S2, DX90/DX90 S2 is automated.

- Modification target

Multipath Driver

- Modification details

Version Modification details

V2.0L24 or earlier The default Max Throttle value of the ETERNUS DX60/DX60 S2, DX80/DX80 S2, DX90/

DX90 S2 has to be manually specified.

V2.0L25 The default Max Throttle value of the ETERNUS DX60/DX60 S2, DX80/DX80 S2, DX90/

DX90 S2 is automatically specified.

- Modification effect

When connecting to the ETERNUS DX60/DX60 S2, DX80/DX80 S2, DX90/DX90 S2, Max Throttle does not have to be set with the "mpdconfig -m" command.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

Multipath Driver Updates

The following table shows the updates for each Multipath Driver version:

Fibre Channel connections are available for all the supported OSs.

The latest information is provided in the "FUJITSU Storage ETERNUS Multipath Driver V2 (for Linux) Installation Information" found under "Downloads" at the following URL:

http://www.fujitsu.com/global/products/computing/storage/software/eternus-mpd/

(1/5)

Version Modifications

V2.0L01 (May 2005)

V2.0L02 (October 2005)

V2.0L03 (June 2006)

V2.0L10 (February 2007)

The first version.

• The following OSs are supported:

- Red Hat Enterprise Linux AS (v.4 for x86) Update 1

- Red Hat Enterprise Linux ES (v.4 for x86) Update 1

- Red Hat Enterprise Linux AS (v.4 for EM64T) Update 1

- Red Hat Enterprise Linux ES (v.4 for EM64T) Update 1

• The following OSs are supported:

- Red Hat Enterprise Linux AS (v.4 for x86) Update 2

- Red Hat Enterprise Linux ES (v.4 for x86) Update 2

- Red Hat Enterprise Linux AS (v.4 for EM64T) Update 2

- Red Hat Enterprise Linux ES (v.4 for EM64T) Update 2

- Red Hat Enterprise Linux AS (v.4 for Itanium) Update 2

- Red Hat Enterprise Linux AS (v.4 for x86) Update 3

- Red Hat Enterprise Linux ES (v.4 for x86) Update 3

- Red Hat Enterprise Linux AS (v.4 for EM64T) Update 3

- Red Hat Enterprise Linux ES (v.4 for EM64T) Update 3

- SUSE Linux Enterprise Server 9 for x86 Service Pack 3

- SUSE Linux Enterprise Server 9 for EM64T Service Pack 3

- SUSE Linux Enterprise Server 9 for Itanium Processor Family Service Pack 3

• The following storage systems are supported:

- ETERNUS4000 models 80, 100, 300, and 500

- ETERNUS8000 models 700, 900, 1100, and 2100

• The following OSs are supported:

- Red Hat Enterprise Linux AS (v.4 for x86) Update 4

- Red Hat Enterprise Linux ES (v.4 for x86) Update 4

- Red Hat Enterprise Linux AS (v.4 for EM64T) Update 4

- Red Hat Enterprise Linux ES (v.4 for EM64T) Update 4

- Red Hat Enterprise Linux AS (v.4 for Itanium) Update 4

- SUSE Linux Enterprise Server 9 for x86 Service Pack 2

- SUSE Linux Enterprise Server 9 for EM64T Service Pack 2

- SUSE Linux Enterprise Server 9 for Itanium Processor Family Service Pack 2

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

(2/5)

V2.0L11 (May 2007)

V2.0L12 (January 2008)

Version Modifications

• The following OSs are supported:

- Red Hat Enterprise Linux AS (4.5 for x86)

- Red Hat Enterprise Linux ES (4.5 for x86)

- Red Hat Enterprise Linux AS (4.5 for EM64T)

- Red Hat Enterprise Linux ES (4.5 for EM64T)

- Red Hat Enterprise Linux AS (4.5 for Itanium)

- Red Hat Enterprise Linux 5 (for x86)

- Red Hat Enterprise Linux 5 (for Intel64)

- Red Hat Enterprise Linux 5 (for Intel Itanium)

• The following OSs are supported:

- Red Hat Enterprise Linux AS (4.6 for x86)

- Red Hat Enterprise Linux ES (4.6 for x86)

- Red Hat Enterprise Linux AS (4.6 for EM64T)

- Red Hat Enterprise Linux ES (4.6 for EM64T)

- Red Hat Enterprise Linux AS (4.6 for Itanium)

- Red Hat Enterprise Linux 5.1 (for x86)

- Red Hat Enterprise Linux 5.1 (for Intel64)

- Red Hat Enterprise Linux 5.1 (for Intel Itanium)

- SUSE Linux Enterprise Server 9 for x86 Service Pack 4

- SUSE Linux Enterprise Server 9 for EM64T Service Pack 4

- SUSE Linux Enterprise Server 9 for Itanium Processor Family Service Pack 4

- SUSE Linux Enterprise Server 10 Service Pack 1 for x86

- SUSE Linux Enterprise Server 10 Service Pack 1 for EM64T

- SUSE Linux Enterprise Server 10 Service Pack 1 for Itanium Processor Family

• Driver Update Program for Red Hat Enterprise Linux 5 is supported.

• The following storage system is supported:

- ETERNUS2000

• LifeKeeper clustering software with Red Hat Enterprise Linux AS (v.4 for x86) Update

4 and Red Hat Enterprise Linux ES (v.4 for x86) Update 4 is supported.

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

(3/5)

V2.0L13 (June 2009)

V2.0L14 (November 2009)

Version Modifications

• The following OSs are supported:

- Red Hat Enterprise Linux AS (4.7 for x86)

- Red Hat Enterprise Linux ES (4.7 for x86)

- Red Hat Enterprise Linux AS (4.7 for EM64T)

- Red Hat Enterprise Linux ES (4.7 for EM64T)

- Red Hat Enterprise Linux AS (4.7 for Itanium)

- Red Hat Enterprise Linux AS (4.8 for x86)

- Red Hat Enterprise Linux ES (4.8 for x86)

- Red Hat Enterprise Linux AS (4.8 for EM64T)

- Red Hat Enterprise Linux ES (4.8 for EM64T)

- Red Hat Enterprise Linux AS (4.8 for Itanium)

- Red Hat Enterprise Linux 5.2 (for x86)

- Red Hat Enterprise Linux 5.2 (for Intel64)

- Red Hat Enterprise Linux 5.2 (for Intel Itanium)

- Red Hat Enterprise Linux 5.3 (for x86)

- Red Hat Enterprise Linux 5.3 (for Intel64)

- Red Hat Enterprise Linux 5.3 (for Intel Itanium)

- SUSE Linux Enterprise Server 10 Service Pack 2 for x86

- SUSE Linux Enterprise Server 10 Service Pack 2 for EM64T

- SUSE Linux Enterprise Server 10 Service Pack 2 for Itanium Processor Family

• SAS connection of the following OSs is supported:

- Red Hat Enterprise Linux AS (4.7 or later)

- Red Hat Enterprise Linux ES (4.7 or later)

- Red Hat Enterprise Linux 5 (Update 3 or later)

• iSCSI connection of the following OSs is supported:

- SUSE Linux Enterprise Server 9 (Service Pack 3 or later)

• The following storage systems are supported:

- ETERNUS DX60 FC model

- ETERNUS DX80 FC model

- ETERNUS4000 models 400 and 600

- ETERNUS8000 models 800, 1200, and 2200

• The following OSs are supported:

- Red Hat Enterprise Linux 5.4 (for x86)

- Red Hat Enterprise Linux 5.4 (for Intel64)

- Red Hat Enterprise Linux 5.4 (for Intel Itanium)

• The following storage systems are supported:

- ETERNUS DX60 SAS model

- ETERNUS DX80 SAS model

- ETERNUS DX90

- ETERNUS DX400 series

- ETERNUS DX8000 series

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

(4/5)

V2.0L20 (April 2010)

V2.0L21 (February 2011)

V2.0L22 (June 2011)

V2.0L23 (June 2012)

V2.0L24 (February 2013)

Version Modifications

• The following OSs are supported:

- Red Hat Enterprise Linux 5.5 (for x86)

- Red Hat Enterprise Linux 5.5 (for Intel64)

- Red Hat Enterprise Linux 5.5 (for Intel Itanium)

- SUSE Linux Enterprise Server 10 Service Pack 3 for x86

- SUSE Linux Enterprise Server 10 Service Pack 3 for EM64T

- SUSE Linux Enterprise Server 10 Service Pack 3 for Itanium Processor Family

• iSCSI connection of the following OSs is supported:

- Red Hat Enterprise Linux 5 (Update 4 or later)

- SUSE Linux Enterprise Server 10 (Service Pack 2 or later)

• The following storage systems are supported:

- ETERNUS DX60 iSCSI model

- ETERNUS DX80 iSCSI model

• The following OSs are supported:

- Red Hat Enterprise Linux 6 (for x86)

- Red Hat Enterprise Linux 6 (for Intel64)

- SUSE Linux Enterprise Server 11 Service Pack 1 for x86

- SUSE Linux Enterprise Server 11 Service Pack 1 for EM64T

• SAS connection of the following OS is supported:

- SUSE Linux Enterprise Server 10 (Service Pack 3 or later)

• The following OSs are supported:

- Red Hat Enterprise Linux 6.1 (for x86)

- Red Hat Enterprise Linux 6.1 (for Intel64)

• 6G SAS connection of the following OSs is supported:

- Red Hat Enterprise Linux 5 (Update 3 or later)

- Red Hat Enterprise Linux 6

- SUSE Linux Enterprise Server 10 (Service Pack 3 or later)

- SUSE Linux Enterprise Server 11 (Service Pack 1 or later)

• The following OSs are supported:

- SUSE Linux Enterprise Server 11 Service Pack 2 for x86

- SUSE Linux Enterprise Server 11 Service Pack 2 for EM64T

• EFI boot of the following OSs is supported:

- SUSE Linux Enterprise Server 11 (Service Pack 1 or later)

• LifeKeeper is supported for the following OSs:

- Red Hat Enterprise Linux 5 (Update 8 or later)

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Release Information

(5/5)

V2.0L25 (October 2013)

V2.0L26 (October 2014)

Version Modifications

• The following OSs are supported:

- SUSE Linux Enterprise Server 11 Service Pack 3 for x86

- SUSE Linux Enterprise Server 11 Service Pack 3 for EM64T

• The TPG Referrals function is supported by the following OSs:

- Red Hat Enterprise Linux 5

- Red Hat Enterprise Linux 6

- SUSE Linux Enterprise Server 10 (Service Pack 1 or later)

- SUSE Linux Enterprise Server 11 (Service Pack 1 or later)

For details, refer to "ETERNUS Web GUI User's Guide ETERNUS DX80 S2/DX90 S2, ETERNUS DX410 S2/DX440 S2, ETERNUS DX8100 S2/DX8700 S2" (tenth edition or later).

• The following OSs are supported:

- Red Hat Enterprise Linux 7 (for Intel64)

• The Storage Cluster function is supported by the following OSs:

- Red Hat Enterprise Linux 5

- Red Hat Enterprise Linux 6

- Red Hat Enterprise Linux 7

- SUSE Linux Enterprise Server 10 (Service Pack 1 or later)

- SUSE Linux Enterprise Server 11 (Service Pack 1 or later)

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Chapter 1 What is Multipath Driver? 32

1.1 Features ............................................................................................................................ 32

1.2 Connections ...................................................................................................................... 33

Chapter 2 Multipath Driver System Setup 34

2.1 Accessing the Storage System Disks .................................................................................. 34

2.1.1 Using the udev Function ................................................................................................................................34

2.1.2 When Using FUJITSU Software PRIMECLUSTER Global Disk Services

(Storage System Recognition Order Setting) .................................................................................................. 35

2.2 Multipath Driver Related Log ............................................................................................37

Chapter 3 Multipath Driver Functions and Operation 38

3.1 Path Management ............................................................................................................ 39

3.1.1 Path Status ....................................................................................................................................................39

3.1.2 Checks and Path Status Transitions ................................................................................................................ 42

3.2 Load Balancing/Failover .................................................................................................... 44

3.2.1 Load Balancing .............................................................................................................................................. 44

3.2.2 Failover .......................................................................................................................................................... 46

3.3 Identifying Disks and Paths .............................................................................................. 49

3.3.1 Device Identification ...................................................................................................................................... 49

3.3.2 Path Identification .........................................................................................................................................49

3.4 Multipath Status Display ................................................................................................... 50

3.4.1 "iompadm info" Command ............................................................................................................................. 50

3.5 Disconnecting/Reconnecting Paths when Replacing Hardware ......................................... 51

3.5.1 "iompadm change" Command ....................................................................................................................... 51

3.5.2 "iompadm restart" Command ........................................................................................................................52

3.6 Multipath Recovery ........................................................................................................... 52

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Table of Contents

Chapter 4 Changing the Multipath Configuration

(FC/FCoE Connection for RHEL-AS4, RHEL-ES4, RHEL5, SLES9, or SLES10) 53

4.1 Storage System and LU Addition ....................................................................................... 54

4.1.1 Addition without Server Rebooting ................................................................................................................54

4.1.2 Addition with Server Rebooting ..................................................................................................................... 56

4.2 Storage System and LU Reduction .................................................................................... 57

4.2.1 Reduction without Server Rebooting .............................................................................................................57

4.2.2 Reduction with Server Rebooting ................................................................................................................... 58

4.3 Path Addition (Cable Addition) ......................................................................................... 60

4.3.1 Addition without Server Rebooting ................................................................................................................60

4.3.2 Addition with Server Rebooting ..................................................................................................................... 61

4.4 Path Reduction (Cable Reduction) .................................................................................... 62

4.4.1 Reduction without Server Rebooting .............................................................................................................62

4.4.2 Reduction with Server Rebooting ................................................................................................................... 63

4.5 Path Addition and Reduction (HBA Addition and Reduction) ............................................ 64

Chapter 5 Changing the Multipath Configuration

(SAS Connection for RHEL-AS4, RHEL-ES4, RHEL5, or SLES10) 65

5.1 Storage System Addition ................................................................................................... 66

5.1.1 Addition without Server Rebooting ................................................................................................................66

5.1.2 Addition with Server Rebooting ..................................................................................................................... 66

5.2 Storage System Reduction ................................................................................................ 67

5.2.1 Reduction without Server Rebooting .............................................................................................................67

5.2.2 Reduction with Server Rebooting ................................................................................................................... 67

5.3 LU Addition ....................................................................................................................... 68

5.4 LU Reduction ..................................................................................................................... 68

5.5 Path Addition (Cable Addition) ......................................................................................... 68

5.5.1 Addition without Server Rebooting ................................................................................................................68

5.5.2 Addition with Server Rebooting ..................................................................................................................... 69

5.6 Path Reduction (Cable Reduction) .................................................................................... 69

5.6.1 Reduction without Server Rebooting .............................................................................................................69

5.6.2 Reduction with Server Rebooting ................................................................................................................... 69

5.7 Path Addition and Reduction (HBA Addition and Reduction) ............................................ 70

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Table of Contents

Chapter 6 Changing the Multipath Configuration

(iSCSI Connection for RHEL5, SLES9, or SLES10) 71

6.1 Storage System Addition ................................................................................................... 72

6.1.1 For Red Hat Enterprise Linux 5 or SUSE Linux Enterprise Server 10 ................................................................ 72

6.1.2 For SUSE Linux Enterprise Server 9 ................................................................................................................ 73

6.2 Storage System Reduction ................................................................................................ 74

6.2.1 Reduction without Server Rebooting .............................................................................................................74

6.2.2 Reduction with Server Rebooting ................................................................................................................... 75

6.3 LU Addition ....................................................................................................................... 76

6.4 LU Reduction ..................................................................................................................... 76

6.5 Path Addition (Cable Addition) ......................................................................................... 77

6.5.1 For Red Hat Enterprise Linux 5 or SUSE Linux Enterprise Server 10 ................................................................ 77

6.5.2 For SUSE Linux Enterprise Server 9 ................................................................................................................ 78

6.6 Path Reduction (Cable Reduction) .................................................................................... 79

6.6.1 Reduction without Server Rebooting .............................................................................................................79

6.6.2 Reduction with Server Rebooting ................................................................................................................... 80

6.7 Path Addition and Reduction (NIC Addition and Reduction) ............................................. 81

Chapter 7 Changing the Multipath Configuration

(FC/FCoE Connection for RHEL6, RHEL7, or SLES11) 82

7.1 Storage System Addition ................................................................................................... 83

7.1.1 Addition without Server Rebooting ................................................................................................................83

7.1.2 Addition with Server Rebooting ..................................................................................................................... 83

7.2 Storage System Reduction ................................................................................................ 84

7.2.1 Reduction without Server Rebooting .............................................................................................................84

7.2.2 Reduction with Server Rebooting ................................................................................................................... 85

7.3 LU Addition ....................................................................................................................... 86

7.3.1 Addition without Server Rebooting ................................................................................................................86

7.3.2 Addition with Server Rebooting ..................................................................................................................... 87

7.4 LU Reduction ..................................................................................................................... 88

7.4.1 Reduction without Server Rebooting .............................................................................................................88

7.4.2 Reduction with Server Rebooting ................................................................................................................... 89

7.5 Path Addition (Cable Addition) ......................................................................................... 90

7.5.1 Addition without Server Rebooting ................................................................................................................90

7.5.2 Addition with Server Rebooting ..................................................................................................................... 90

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Table of Contents

7.6 Path Reduction (Cable Reduction) .................................................................................... 91

7.6.1 Reduction without Server Rebooting .............................................................................................................91

7.6.2 Reduction with Server Rebooting ................................................................................................................... 92

7.7 Path Addition and Reduction (HBA Addition and Reduction) ............................................ 93

Chapter 8 Changing the Multipath Configuration

(SAS Connection for RHEL6, RHEL7, or SLES11) 94

8.1 Storage System Addition ................................................................................................... 94

8.2 Storage System Reduction ................................................................................................ 95

8.2.1 Reduction without Server Rebooting .............................................................................................................95

8.2.2 Reduction with Server Rebooting ................................................................................................................... 95

8.3 LU Addition ....................................................................................................................... 96

8.4 LU Reduction ..................................................................................................................... 96

8.5 Path Addition (Cable Addition) ......................................................................................... 96

8.6 Path Reduction (Cable Reduction) .................................................................................... 96

8.6.1 Reduction without Server Rebooting .............................................................................................................96

8.6.2 Reduction with Server Rebooting ................................................................................................................... 97

8.7 Path Addition and Reduction (HBA Addition and Reduction) ............................................ 97

Chapter 9 Changing the Multipath Configuration

(iSCSI Connection for RHEL6, RHEL7, or SLES11) 98

9.1 Storage System Addition ................................................................................................... 99

9.2 Storage System Reduction .............................................................................................. 100

9.2.1 Reduction without Server Rebooting ...........................................................................................................100

9.2.2 Reduction with Server Rebooting ................................................................................................................. 101

9.3 LU Addition ..................................................................................................................... 101

9.4 LU Reduction ................................................................................................................... 101

9.5 Path Addition (Cable Addition) ....................................................................................... 102

9.6 Path Reduction (Cable Reduction) .................................................................................. 103

9.6.1 Reduction without Server Rebooting ...........................................................................................................103

9.6.2 Reduction with Server Rebooting ................................................................................................................. 104

9.7 Path Addition and Reduction (NIC Addition and Reduction) ........................................... 104

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

Table of Contents

Chapter 10 Notes when Using the Multipath Driver 105

10.1 Configuring a Storage System ......................................................................................... 105

10.2 Considerations for Linux Servers ..................................................................................... 108

10.3 Notes when Installing the Multipath Driver .................................................................... 111

10.4 Troubleshooting .............................................................................................................. 113

10.5 Frequently Asked Questions ............................................................................................ 114

Chapter 11 Command Reference 115

11.1 "iompadm" Commands ...................................................................................................115

11.2 "mpdconfig" Command ...................................................................................................120

11.3 "mpd_snap" Command .................................................................................................... 124

Appendix A Syslog Messages 125

Index 137

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

List of Figures

Figure 1.1 Sample multipath connection ..................................................................................................................... 33

Figure 3.1 Path status transitions ................................................................................................................................ 40

Figure 3.2 2-path load balancing on a storage system with CM assigned .................................................................... 44

Figure 3.3 4-path load balancing on a storage system with CM assigned .................................................................... 45

Figure 3.4 Multipath load balancing on a storage system with CM not assigned ......................................................... 45

Figure 3.5 2-path failover on a storage system with CM assigned................................................................................ 46

Figure 3.6 4-path failover, active to active ................................................................................................................... 47

Figure 3.7 4-path failover, active to standby................................................................................................................ 47

Figure 3.8 Multipath failover, a storage system with CM not assigned......................................................................... 48

Figure 10.1 Use identical LUNs..................................................................................................................................... 106

Figure 10.2 Start from LUN0......................................................................................................................................... 107

FUJITSU Storage ETERNUS Multipath Driver V2 User’s Guide for Linux

+ 110 hidden pages

Fujitsu ETERNUS Multipath Driver V2 User Manual

Specifications and Main Features

Frequently Asked Questions

User Manual

Preface

Release Information

Table of Contents

List of Figures