HP Hitachi Dynamic Link Manager Software Licenses User Manual

Hitachi Command Suite

Dynamic Link Manager

(for Solaris) User Guide

Document Organization

Product Version

Getting Help

Contents

MK-92DLM114-28

No part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording, or stored in a database or retrieval system for any purpose without the express written permission of Hitachi, Ltd.

Hitachi, Ltd., reserves the right to make changes to this document at any time without notice and assumes no responsibility for its use. This document contains the most current information available at the time of publication. When new or revised information becomes available, this entire document will be updated and distributed to all registered users.

Some of the features described in this document might not be currently available. Refer to the most recent product announcement for information about feature and product availability, or contact Hitachi Data Systems Corporation at

Notice: Hitachi, Ltd., products and services can be ordered only under the terms and conditions of the applicable Hitachi Data Systems Corporation agreements. The use of Hitachi, Ltd., products is governed by the terms of your agreements with Hitachi Data Systems Corporation.

Hitachi is a registered trademark of Hitachi, Ltd., in the United States and other countries. Hitachi Data Systems is a registered trademark and service mark of Hitachi, Ltd., in the United States and other countries.

Archivas, Essential NAS Platform, HiCommand, Hi-Track, ShadowImage, Tagmaserve, Tagmasoft, Tagmasolve, Tagmastore, TrueCopy, Universal Star Network, and Universal Storage Platform are registered trademarks of Hitachi Data Systems.

AIX, AS/400, DB2, Domino, DS6000, DS8000, Enterprise Storage Server, ESCON, FICON, FlashCopy, IBM, Lotus, MVS, OS/390, RS/6000, S/390, System z9, System z10, Tivoli, VM/ESA, z/OS, z9, z10, zSeries, z/VM, and z/VSE are registered trademarks or trademarks of International Business Machines Corporation.

https://portal.hds.com.

All other trademarks, service marks, and company names in this document or web site are properties of their respective owners.

Microsoft product screen shots are reprinted with permission from Microsoft Corporation.

Notice on Export Controls. The technical data and technology inherent in this Document may be subject to U.S. export control laws, including the U.S. Export Administration Act and its associated regulations, and may be subject to export or import regulations in other countries. Reader agrees to comply strictly with all such regulations and acknowledges that Reader has the responsibility to obtain licenses to export, re-export, or import the Document and any Compliant Products.

Hitachi Dynamic Link Manager (for Solaris) User Guide

Preface.................................................................................................xiii

Intended audience...................................................................................................xiv

Product version....................................................................................................... xiv

Release notes..........................................................................................................xiv

Document revision level........................................................................................... xiv

Document organization.............................................................................................xv

Related documents...................................................................................................xv

Document conventions.............................................................................................xvi

Conventions for storage capacity values.................................................................... xvi

Accessing product documentation............................................................................ xvii

Getting help........................................................................................................... xvii

Comments.............................................................................................................xviii

1 Overview of HDLM................................................................................1-1

What is HDLM?.......................................................................................................1-2

HDLM Features.......................................................................................................1-2

2 HDLM Functions................................................................................... 2-1

Devices Managed by HDLM......................................................................................2-3

System Configuration.............................................................................................. 2-3

LU Configuration.....................................................................................................2-5

Program Configuration............................................................................................ 2-6

Position of the HDLM Driver and HDLM Device..........................................................2-8

Logical Device Files for HDLM Devices...................................................................... 2-9

Distributing a Load Using Load Balancing................................................................2-10

Paths to Which Load Balancing Is Applied.........................................................2-12

When Using the Thunder 9500V Series, or Hitachi AMS/WMS series..........2-12

When Using Other Than the Thunder 9500V Series and Hitachi AMS/WMS

Series................................................................................................... 2-13

Load Balancing Algorithms...............................................................................2-14

Performing Failovers and Failbacks Using Path Switching......................................... 2-15

Automatic Path Switching................................................................................ 2-16

Automatic Failovers............................................................................... 2-16

Automatic Failbacks...............................................................................2-18

Manual Path Switching.................................................................................... 2-18

Hitachi Dynamic Link Manager (for Solaris) User Guide

iii

Path Status Transition..................................................................................... 2-19

The Online Path Status.......................................................................... 2-19

The Offline Path Status.......................................................................... 2-20

Status Transitions of a Path....................................................................2-20

Intermittent Error Monitoring (Functionality When Automatic Failback Is Used)......... 2-23

Checking Intermittent Errors............................................................................2-23

Setting Up Intermittent Error Monitoring...........................................................2-23

Intermittent Error Monitoring Actions............................................................... 2-24

When an Intermittent Error Occurs......................................................... 2-24

When an Intermittent Error Does Not Occur............................................ 2-25

When the Conditions for an Intermittent Error Are Changed During Error

Monitoring............................................................................................ 2-26

When a User Changes the Intermittent Error Information.................................. 2-27

Detecting Errors by Using Path Health Checking...................................................... 2-28

Distributing a Load by Using the Dynamic I/O Path Control Function.........................2-29

What is the Dynamic Load Balance Control Function..........................................2-29

Dynamic I/O Path Control Function.................................................................. 2-29

Error Management................................................................................................ 2-30

Types of Collected Logs...................................................................................2-31

Filtering of Error Information........................................................................... 2-32

Collecting Error Information Using the Utility for Collecting HDLM Error Information

(DLMgetras)................................................................................................... 2-33

Collecting Audit Log Data.......................................................................................2-33

Categories and Audit Events that HDLM Can Output to the Audit Log................. 2-35

Requirements for Outputting Audit Log Data.....................................................2-38

Destination and Filtering of Audit Log Data....................................................... 2-39

Audit Log Data Formats...................................................................................2-40

Integrated HDLM management using Global Link Manager.......................................2-41

Cluster Support.....................................................................................................2-42

3 Creating an HDLM Environment............................................................. 3-1

HDLM System Requirements....................................................................................3-3

Hosts and OSs Supported by HDLM................................................................... 3-3

Storage Systems Supported by HDLM................................................................ 3-4

Storage Systems..................................................................................... 3-4

HBAs......................................................................................................3-5

When Handling Intermediate Volumes Managed by Hitachi RapidXchange...3-5

Cluster Software Supported by HDLM.................................................................3-6

Volume Manager Supported by HDLM................................................................ 3-6

Combinations of Cluster Software and Volume Managers Supported by HDLM.......3-7

For the Solaris Cluster or VCS Environment............................................... 3-7

When Creating an Oracle9i RAC Environment.......................................... 3-11

When Creating an Oracle RAC 10g Environment...................................... 3-11

When Creating an Oracle RAC 11g Environment...................................... 3-25

Virtualization Environments Supported by HDLM............................................... 3-35

Memory and Disk Capacity Requirements......................................................... 3-36

Memory Requirements...........................................................................3-36

Disk Capacity Requirements................................................................... 3-36

Number of LUs and Paths Supported in HDLM...................................................3-37

Flow for Creating an HDLM Environment.................................................................3-37

HDLM Installation Types........................................................................................3-38

Notes on Creating an HDLM Environment............................................................... 3-39

Hitachi Dynamic Link Manager (for Solaris) User Guide

Notes on Hardware Settings............................................................................ 3-39

Notes on Installation.......................................................................................3-40

Notes on Related Software.............................................................................. 3-44

Notes on Command Execution......................................................................... 3-45

Notes on the Disk Label...................................................................................3-45

Installing HDLM.................................................................................................... 3-45

Preparations for a New Installation of HDLM.....................................................3-45

Performing Operations on Devices to Be Managed by HDLM..................... 3-45

Apply Solaris Patches.............................................................................3-47

Set Up the Hardware............................................................................. 3-47

Set Up the /kernel/drv/sd.conf File......................................................... 3-48

Switch the Kernel Mode ........................................................................ 3-48

Set Up the /etc/system File.................................................................... 3-49

Set Up the /etc/syslog.conf or /etc/rsyslog.conf File.................................3-49

Set Up VxVM.........................................................................................3-50

Set Up SDS and SVM............................................................................. 3-50

Set Up Solaris Cluster............................................................................ 3-51

Setting up a Solaris 11 environment........................................................3-52

Preparation for Performing an Unattended Installation of HDLM......................... 3-54

Performing a New Installation of HDLM (When Solaris Cluster Is Not Being Used)3-55

Performing a New Installation of HDLM (When Solaris Cluster Is Being Used)..... 3-62

Using the HDLM Device Unconfiguration Function When Performing a New

Installation of HDLM....................................................................................... 3-72

Preparations for an Upgrade Installation or Re-installation of HDLM................... 3-73

Performing an Upgrade Installation or Re-installation of HDLM...........................3-73

Installing HDLM in an LDoms Environment....................................................... 3-78

Configuring a Boot Disk Environment......................................................................3-82

Overview of Configuring a Boot Disk Environment............................................. 3-83

Procedure for Configuring a Boot Disk Environment...........................................3-83

Migration from an Existing HDLM Environment........................................ 3-84

Migration by Installing HDLM in the Existing Local Boot Disk Environment. 3-85

Migration by Installing HDLM in the Existing Boot Disk Environment..........3-87

Migration by Building a New Pre-Migration Environment........................... 3-89

Setting Up the Post-Migration Environment............................................. 3-91

Configuring a Boot Disk Environment for a ZFS File System......................................3-96

Boot Disk Environment that uses a ZFS File System...........................................3-96

Creating a ZFS Boot Disk Environment (for Solaris 10).......................................3-98

Copying the local boot disk environment to the LUs (SCSI device) in the

storage system......................................................................................3-99

Replacing the ZFS boot disk environment on the SCSI device with the ZFS

boot disk environment on the HDLM device........................................... 3-101

Creating a ZFS Boot Disk Environment (for Solaris 11).....................................3-102

Moving a local boot disk environment to an LU (HDLM device) in a storage

system................................................................................................3-102

Configuring a ZFS Boot Disk Environment after the Migration..................3-104

Replacing an LU with Another LU in the Boot Disk Environment.............. 3-106

Performing a Check after Restart.......................................................... 3-108

Migrating from a ZFS Boot Disk Environment to the Local Boot Disk Environment (for

Solaris 10)....................................................................................................3-109

Migrating from a ZFS Boot Disk Environment to the Local Boot Disk Environment (for

Solaris 11)....................................................................................................3-110

Replacing an LU with Another LU in the Boot Disk Environment.............. 3-110

Hitachi Dynamic Link Manager (for Solaris) User Guide

Creating a New Boot Environment........................................................ 3-112

Configuring the Post-Migration ZFS Boot Disk Environment.....................3-113

Migrating to the ZFS Boot Disk Environment.......................................... 3-114

Performing a Check after Restart.......................................................... 3-115

Migrating from a Boot Disk Environment to the Local Boot Disk Environment...........3-116

Configuring a Mirrored Boot Disk Environment Incorporating SVM.......................... 3-121

Precautions.................................................................................................. 3-121

Configuring a Boot Disk Environment in Which HDLM Manages the Boot Disk and

Mirroring the Environment by Using SVM........................................................ 3-122

Configuring a Boot Disk Environment in Which HDLM Manages the Boot Disk,

from the Local Boot Disk Environment...................................................3-122

Mirroring a Boot Disk Environment in Which HDLM Manages the Boot Disk by

Using SVM.......................................................................................... 3-123

Placing the Boot Disks Under HDLM Management by Installing HDLM to a Mirrored

Boot Disk Environment Incorporating SVM...................................................... 3-126

Installing HDLM and then Configuring the Environment.......................... 3-127

Placing the Boot Disks Under HDLM Management.................................. 3-127

Removing HDLM........................................................................................... 3-133

Excluding the Prepared LUs from HDLM Management............................ 3-133

Configuring an Environment and then Removing HDLM.......................... 3-133

Checking the Path Configuration...........................................................................3-139

Setting Up HDLM Functions..................................................................................3-140

Checking the Current Settings........................................................................3-140

Setting Up the HDLM Functions......................................................................3-140

Setting Up Load Balancing....................................................................3-141

Setting Up Path Health Checking...........................................................3-142

Setting Up the Automatic Failback Function........................................... 3-142

Setting Up Intermittent Error Monitoring............................................... 3-143

Setting Up Dynamic I/O Path Control.................................................... 3-144

Setting the Error Log Collection Level....................................................3-144

Setting the Trace Level........................................................................ 3-145

Setting the Error Log File Size...............................................................3-145

Setting the Number of Error Log Files................................................... 3-146

Setting the Trace File Size.................................................................... 3-146

Setting the Number of Trace Files.........................................................3-147

Setting Up Audit Log Data Collection.....................................................3-147

Setting the Audit Log Facility................................................................ 3-148

Checking the Updated Settings...................................................................... 3-149

Setting up Integrated Traces................................................................................3-149

Notes on Using the Hitachi Network Objectplaza Trace Library......................... 3-150

Displaying the Hitachi Network Objectplaza Trace Library setup Menu.............. 3-151

Changing the Size of Integrated Trace Files.................................................... 3-151

Changing the Number of Integrated Trace Files.............................................. 3-152

Changing the Buffer Size Per Monitoring Interval Duration............................... 3-152

Adjusting the Number of Messages to Be Output Per Monitoring Interval.......... 3-153

Finishing the Hitachi Network Objectplaza Trace Library Settings......................3-155

Applying the Hitachi Network Objectplaza Trace Library Settings...................... 3-155

Creating File Systems for HDLM (When Volume Management Software Is Not Used)3-156

Setting Up VxVM................................................................................................. 3-157

Creating a Disk Group................................................................................... 3-157

Creating VxVM Volumes.................................................................................3-160

Removing Devices from VxVM........................................................................3-160

Hitachi Dynamic Link Manager (for Solaris) User Guide

Devices to Be Removed from VxVM.......................................................3-161

Removing Devices from VxVM on a Controller Basis............................... 3-162

Removing Devices From VxVM on a Path Basis...................................... 3-166

Actions To Be Taken if an sd or ssd Device Has Not Been Suppressed from

VxVM..................................................................................................3-170

Introducing VxVM while Using HDLM.............................................................. 3-174

Linking VxVM and Solaris Cluster....................................................................3-174

Setting Up SDS................................................................................................... 3-176

Notes...........................................................................................................3-176

Registering HDLM Devices............................................................................. 3-177

To Use a Local Metadevice................................................................... 3-177

To Use a Shared Diskset...................................................................... 3-178

Setting Up SVM...................................................................................................3-180

Notes...........................................................................................................3-180

Registering HDLM Devices............................................................................. 3-181

To Use a Local Volume.........................................................................3-181

To Use a Shared Diskset...................................................................... 3-181

Setting Up VCS................................................................................................... 3-183

Removing HDLM................................................................................................. 3-184

Overview of HDLM Removal...........................................................................3-184

Preparations for HDLM Removal.....................................................................3-185

Performing Operations on HDLM-Managed Devices................................ 3-185

Remove Solaris Cluster Settings............................................................3-186

Remove VCS Settings...........................................................................3-188

Remove VxVM Settings........................................................................ 3-189

Remove SDS Settings...........................................................................3-189

Remove SVM Settings.......................................................................... 3-190

Removing HDLM........................................................................................... 3-191

Removing HDLM from the Local Boot Disk Environment..........................3-191

Removing HDLM from the Boot Disk Environment.................................. 3-193

Removing HDLM from an LDoms Environment....................................... 3-193

Settings Needed After HDLM Removal............................................................ 3-198

VxVM Settings..................................................................................... 3-198

SDS Settings....................................................................................... 3-198

SVM Settings.......................................................................................3-198

Solaris Cluster Settings.........................................................................3-198

File System Settings.............................................................................3-200

Application Program Settings................................................................3-200

Removing Hitachi Network Objectplaza Trace Library (HNTRLib2).....................3-200

Removing Hitachi Network Objectplaza Trace Library (HNTRLib)...................... 3-201

4 HDLM Operation................................................................................... 4-1

Notes on Using HDLM............................................................................................. 4-2

Displaying Path Information.............................................................................. 4-2

When a Path Error is Detected...........................................................................4-2

iostat Command............................................................................................... 4-2

Storage System................................................................................................ 4-3

Command Execution......................................................................................... 4-3

Using a Sun HBA.............................................................................................. 4-3

Starting Solaris in Single-User Mode...................................................................4-3

Upgrading Solaris............................................................................................. 4-4

Operation in Single-User Mode.......................................................................... 4-4

vii

Hitachi Dynamic Link Manager (for Solaris) User Guide

Initializing HDLM When the Host Is Started in Single-User Mode.................4-4

Tasks that Can Be Performed in Single-User Mode.....................................4-5

Maintenance Tasks on Devices Connected by Paths in the Boot Disk Environment

.......................................................................................................................4-6

HDLM Operations Using Commands......................................................................... 4-6

Notes on Using Commands................................................................................4-6

Viewing Path Information..................................................................................4-6

Changing the Status of Paths.............................................................................4-7

Changing the Status of Paths to Online.....................................................4-7

Changing the Status of Paths to Offline(C)................................................ 4-8

Viewing LU Information.....................................................................................4-9

Displaying Corresponding Information About an HDLM Device, sd or ssd Device, and

LDEV............................................................................................................... 4-9

Initializing Statistical Information for Paths....................................................... 4-10

Viewing and Setting Up the Operating Environment...........................................4-11

Viewing the Operating Environment........................................................4-11

Setting Up the Operating Environment.................................................... 4-11

Viewing License Information............................................................................4-12

Updating the License.......................................................................................4-13

Viewing HDLM Version Information.................................................................. 4-13

Viewing HDLM Component Information............................................................ 4-14

Starting and Stopping the HDLM Manager...............................................................4-15

Starting the HDLM Manager.............................................................................4-15

Stopping the HDLM Manager........................................................................... 4-15

HDLM Resident Processes......................................................................................4-16

Changing the Configuration of the HDLM Operating Environment............................. 4-16

Precautions Regarding Changes to the Configuration of an HDLM Operating

Environment...................................................................................................4-17

Changing the Configuration of a System that Uses HDLM......................... 4-17

When the Path Configuration Is Changed................................................ 4-17

Switching the Kernel Mode.....................................................................4-19

When the Path Configuration Is Changed in a Boot Disk Environment....... 4-19

Dynamic Reconfiguration (DR) for Solaris................................................4-20

Overview of Reconfiguring the HDLM Device.....................................................4-20

Reconfiguring the HDLM Device..............................................................4-20

Notes on Reconfiguring the HDLM Device................................................4-21

Adding a New Logical Unit...............................................................................4-22

Notes................................................................................................... 4-22

Adding a New LU (When Not Using Solaris Cluster)..................................4-23

Adding a New LU By Restarting the Nodes (When Using Solaris Cluster)....4-25

Adding a New LU Via Dynamic Reconfiguration (When Using Solaris Cluster)

............................................................................................................4-31

Configuration Changes Such as Deleting a Logical Unit...................................... 4-36

Changing the Configuration by Restarting the Host.................................. 4-37

Deleting an LU via Dynamic Reconfiguration............................................4-42

Adding a Path to an Existing LU by Dynamic Reconfiguration............................. 4-44

Deleting a Path to an Existing LU by Dynamic Reconfiguration........................... 4-47

Specifying Whether a Logical Unit Is To Be Managed by HDLM (When Not Using

Solaris Cluster)............................................................................................... 4-48

Changing an HDLM-managed Device to a Non-HDLM-Managed Device......4-49

Changing a Non-HDLM-Managed Device to an HDLM-Managed Device...... 4-49

viii

Hitachi Dynamic Link Manager (for Solaris) User Guide

Specifying Whether a Logical Unit Is To Be Managed by HDLM (When Using Solaris

Cluster)..........................................................................................................4-52

Changing an HDLM-Managed Device to a Non-HDLM-Managed Device...... 4-52

Changing a Non-HDLM-Managed Device to an HDLM-Managed Device (When

the Node Must Be Restarted)................................................................. 4-57

Changing a Non-HDLM-Managed Device to an HDLM-Managed Device (For

Dynamic Reconfiguration)...................................................................... 4-63

Inheriting logical device names during storage system migration........................4-68

5 Troubleshooting....................................................................................5-1

Information collected by using the DLMgetras utility for collecting HDLM error

information.............................................................................................................5-2

Checking Error Information in Messages...................................................................5-2

What To Do for a Path Error.................................................................................... 5-3

Examining the Messages................................................................................... 5-5

Obtain Path Information....................................................................................5-5

Identifying the Error Path..................................................................................5-5

Narrowing Down the Hardware That Might Have Caused the Error....................... 5-5

Identifying the Error Location and Correcting any Hardware Errors.......................5-5

Placing the Path Online..................................................................................... 5-5

Actions to Take for a Path Error in a Boot Disk Environment...................................... 5-6

Path Errors During Boot Processing....................................................................5-6

When a Path Error Occurs at the Initial Stage of Boot Processing................5-6

When a Path Error Occurs After the HDLM Driver Starts Path Processing.....5-6

Path Errors After Boot Processing Completes...................................................... 5-7

What To Do for a Program Error.............................................................................. 5-7

Examining the Messages................................................................................... 5-8

Obtaining Program Information......................................................................... 5-8

What To Do for the Program Error..................................................................... 5-8

Contacting Your HDLM Vendor or Maintenance Company.................................... 5-9

What To Do for Other Errors....................................................................................5-9

6 Command Reference.............................................................................6-1

Overview of the HDLM Command dlnkmgr................................................................6-2

clear (Returns the Path Statistics to the Initial Value)................................................ 6-3

Format.............................................................................................................6-3

To set the path statistics to 0...................................................................6-3

To display the format of the clear operation.............................................. 6-3

Parameters...................................................................................................... 6-3

To set the path statistics to 0...................................................................6-3

To display the format of the clear operation.............................................. 6-4

help (Displays the Operation Format)....................................................................... 6-4

Format.............................................................................................................6-4

Parameter........................................................................................................6-4

offline (Places Paths Offline)....................................................................................6-6

Format.............................................................................................................6-6

To place paths offline.............................................................................. 6-6

To display the format of the offline operation............................................6-7

Parameters...................................................................................................... 6-7

To place paths offline.............................................................................. 6-7

To display the format of the offline operation.......................................... 6-10

Hitachi Dynamic Link Manager (for Solaris) User Guide

online (Places Paths Online)...................................................................................6-12

Format...........................................................................................................6-12

To place paths online.............................................................................6-12

To display the format of the online operation.......................................... 6-12

Parameters.....................................................................................................6-12

To place paths online.............................................................................6-12

To display the format of the online operation.......................................... 6-16

set (Sets Up the Operating Environment)................................................................6-17

Format...........................................................................................................6-17

To set up the HDLM operating environment............................................ 6-17

To display the format of the set operation...............................................6-18

Parameters.....................................................................................................6-18

To set up the HDLM operating environment............................................ 6-18

To display the format of the set operation...............................................6-32

view (Displays Information)................................................................................... 6-34

Format...........................................................................................................6-34

To display program information..............................................................6-34

To display path information....................................................................6-34

To display LU information...................................................................... 6-35

To display HBA port information............................................................. 6-35

To display CHA port information............................................................. 6-35

To display corresponding information about an HDLM device, sd or ssd device,

and LDEV..............................................................................................6-35

To display the format of the view operation.............................................6-36

Parameters.....................................................................................................6-36

To display program information..............................................................6-36

To display path information....................................................................6-43

To display LU information...................................................................... 6-57

To display HBA port information............................................................. 6-70

To display CHA port information............................................................. 6-71

To display corresponding information about an HDLM device, sd or ssd device,

and LDEV..............................................................................................6-72

To display view operation format............................................................6-73

monitor (Displays I/O Information at a Specified Interval)........................................6-74

Format...........................................................................................................6-75

To display I/O information for each HBA port.......................................... 6-75

To display I/O information for each CHA port.......................................... 6-75

To display the monitor operation format................................................. 6-75

Parameters.....................................................................................................6-75

To display I/O information for each HBA port.......................................... 6-76

To display I/O information for each CHA port.......................................... 6-77

To display monitor operation format....................................................... 6-78

add (Adds a Path Dynamically)...............................................................................6-79

Format...........................................................................................................6-79

To Add a Path Dynamically.....................................................................6-79

To Display the Format of the add Operation............................................ 6-79

Parameters.....................................................................................................6-79

To Add a Path Dynamically.....................................................................6-79

To Display the Format of the add Operation............................................ 6-80

delete (Deletes a Path Dynamically)....................................................................... 6-80

Format...........................................................................................................6-81

To Delete a Path Dynamically.................................................................6-81

Hitachi Dynamic Link Manager (for Solaris) User Guide

To Display the Format of the delete Operation.........................................6-81

Parameters.....................................................................................................6-81

To Delete a Path Dynamically.................................................................6-81

To Display the Format of the delete Operation.........................................6-82

7 Utility Reference................................................................................... 7-1

Overview of the Utilities.......................................................................................... 7-2

The DLMgetras Utility for Collecting HDLM Error Information......................................7-3

Format.............................................................................................................7-4

Parameters...................................................................................................... 7-4

List of Collected Error Information..................................................................... 7-6

The dlmcfgmgr Utility for Managing the HDLM Configuration....................................7-17

Format...........................................................................................................7-17

Parameters.....................................................................................................7-18

The dlminstcomp HDLM Component Installation Utility............................................ 7-20

Format...........................................................................................................7-20

Parameter...................................................................................................... 7-20

The dlmlisthdev Utility for Assisting HDLM Transitions..............................................7-20

Format...........................................................................................................7-21

Parameters.....................................................................................................7-21

The dlmsetboot Utility for Assisting Configuration of an HDLM Boot Disk Environment7-23

Format...........................................................................................................7-23

Parameters.....................................................................................................7-23

The dlmsetconf Utility for Creating the HDLM Driver Configuration Definition File.......7-23

Format...........................................................................................................7-24

Parameters.....................................................................................................7-25

Items in the storage-system-migration definition file......................................... 7-29

The dlmstart Utility for Configuring HDLM Devices...................................................7-30

Format...........................................................................................................7-30

Parameters.....................................................................................................7-30

Note.............................................................................................................. 7-31

The dlmvxexclude Utility for Assisting Creation of the VxVM Configuration File...........7-31

Format...........................................................................................................7-32

Parameters.....................................................................................................7-32

The installhdlm Utility for Installing HDLM...............................................................7-33

Format...........................................................................................................7-34

Parameters.....................................................................................................7-34

Contents of the Installation-Information Settings File........................................ 7-34

About the Log File...........................................................................................7-42

Note.............................................................................................................. 7-43

installux.sh Utility for HDLM Common Installer........................................................ 7-44

Format...........................................................................................................7-44

Parameters.....................................................................................................7-44

Log file...........................................................................................................7-45

Note.............................................................................................................. 7-45

The removehdlm Utility for Removing HDLM........................................................... 7-46

Format...........................................................................................................7-46

Parameters.....................................................................................................7-46

8 Messages............................................................................................. 8-1

Before Viewing the List of Messages.........................................................................8-3

Hitachi Dynamic Link Manager (for Solaris) User Guide

Format and Meaning of Message IDs................................................................. 8-3

Terms Used in Messages and Message Explanations............................................8-3

Components That Output Messages to Syslog.....................................................8-3

KAPL01001 to KAPL02000....................................................................................... 8-4

KAPL03001 to KAPL04000......................................................................................8-31

KAPL04001 to KAPL05000......................................................................................8-33

KAPL05001 to KAPL06000......................................................................................8-41

KAPL06001 to KAPL07000......................................................................................8-49

KAPL07001 to KAPL08000......................................................................................8-52

KAPL08001 to KAPL09000......................................................................................8-53

KAPL09001 to KAPL10000......................................................................................8-57

KAPL10001 to KAPL11000......................................................................................8-84

KAPL11001 to KAPL12000....................................................................................8-128

KAPL13001 to KAPL14000....................................................................................8-131

KAPL15001 to KAPL16000....................................................................................8-133

Return Codes for Hitachi Command Suite Common Agent Component.....................8-136

A Sun Cluster 3.2 Commands................................................................... A-1

Sun Cluster 3.2 Commands..................................................................................... A-2

B Functional Differences Between Versions of HDLM.................................. B-1

Functional Differences Between Version 6.1 or Later and Versions Earlier Than 6.1..... B-2

Functional Differences Between Version 6.0 or Later and Versions Earlier Than 6.0..... B-2

Precautions on Differences in Functionality Between HDLM 5.6.1 or Earlier and HDLM

5.6.2 or Later......................................................................................................... B-2

Acronyms and abbreviations

Glossary

Index

xii

Hitachi Dynamic Link Manager (for Solaris) User Guide

Preface

This document describes how to use the Hitachi Dynamic Link Manager.

Intended audience

□

Product version

□

Release notes

□

Document revision level

□

Document organization

□

Intended audience

This document is intended for storage administrators who use Hitachi Dynamic Link Manager (HDLM) to operate and manage storage systems, and assumes that readers have:

• Knowledge of Solaris and its management functionality

• Knowledge of Storage system management functionality

• Knowledge of Cluster software functionality

• Knowledge of Volume management software functionality

Product version

This document revision applies to HDLM for Solaris version 8.0.0 or later.

Release notes

Read the release notes before installing and using this product. They may contain requirements or restrictions that are not fully described in this document or updates or corrections to this document.

Document revision level

Revision Date Description

MK-92DLM114-21 November 2011 Initial Release

MK-92DLM114-22 July 2012 Revision 1, supersedes and replaces

MK-92DLM114-23 August 2012 Revision 2, supersedes and replaces

MK-92DLM114-24 November 2012 Revision 3, supersedes and replaces

MK-92DLM114-25 February 2013 Revision 4, supersedes and replaces

MK-92DLM114-26 May 2013 Revision 5, supersedes and replaces

MK-92DLM114-27 October 2013 Revision 6, supersedes and replaces

MK-92DLM114-28 April 2014 Revision 7, supersedes and replaces

MK-92DLM114-21

MK-92DLM114-22

MK-92DLM114-23

MK-92DLM114-24

MK-92DLM114-25

MK-92DLM114-26

MK-92DLM114-27

xiv

Preface

Hitachi Dynamic Link Manager (for Solaris) User Guide

Document organization

The following table provides an overview of the contents and organization of this document. Click the chapter title in the left column to go to that chapter. The first page of each chapter provides links to the sections in that chapter.

Chapter/Appendix Description

Chapter 1, Overview of HDLM on page 1-1

Chapter 2, HDLM Functions on page 2-1

Chapter 3, Creating an HDLM Environment on page 3-1

Chapter 4, HDLM Operation on page 4-1

Chapter 5, Troubleshooting on page 5-1

Chapter 6, Command Reference on page 6-1

Chapter 7, Utility Reference on page 7-1

Gives an overview of HDLM, and describes its features.

Describes management targets and the system configuration of HDLM, and the basic terms and functions for HDLM.

Describes the procedures for setting up an HDLM environment and the procedure for canceling those settings.

Describes how to use HDLM by using both the HDLM GUI and commands, and how to manually start and stop the HDLM manager. This chapter also describes how to configure an environment to properly operate HDLM, such as changing the HDLM managementtarget devices that connect paths or replacing the hardware that makes up a path. describes how to check path information by using the Windows management tool.

Explains how to troubleshoot a path error, HDLM failure, or any other problems that you might encounter.

Describes all the HDLM commands.

Describes the HDLM utilities.

Chapter 8, Messages on page 8-1

Appendix A, Sun Cluster 3.2 Commands on page A-1

Appendix B, Functional Differences Between Versions of HDLM on page B-1

Document conventions

This document uses the following typographic conventions:

Convention Description

Bold Indicates text on a window, other than the window title, including

menus, menu options, buttons, fields, and labels. Example: Click OK.

Italic Indicates a variable, which is a placeholder for actual text provided by

the user or system. Example: copy source-file target-file

Note: Angled brackets (< >) are also used to indicate variables.

Monospace

< > angled brackets

[ ] square brackets

{ } braces Indicates required or expected values. Example: { a | b } indicates

| vertical bar Indicates that you have a choice between two or more options or

underline

Indicates text that is displayed on screen or entered by the user. Example: # pairdisplay -g oradb

Indicates a variable, which is a placeholder for actual text provided by the user or system. Example: # pairdisplay -g <group>

Note: Italic font is also used to indicate variables.

Indicates optional values. Example: [ a | b ] indicates that you can choose a, b, or nothing.

that you must choose either a or b.

arguments. Examples: [ a | b ] indicates that you can choose a, b, or nothing. { a | b } indicates that you must choose either a or b.

Indicates the default value.

Example:

[ a | b ]

Conventions for storage capacity values

Physical storage capacity values (for example, disk drive capacity) are calculated based on the following values:

xvi

Preface

Hitachi Dynamic Link Manager (for Solaris) User Guide

Physical capacity unit Value

1 kilobyte (KB)

1 megabyte (MB)

1 gigabyte (GB)

1 terabyte (TB)

1 petabyte (PB)

1 exabyte (EB)

1,000 (103) bytes

1,000 KB or 1,0002 bytes

1,000 MB or 1,0003 bytes

1,000 GB or 1,0004 bytes

1,000 TB or 1,0005 bytes

1,000 PB or 1,0006 bytes

Logical storage capacity values (for example, logical device capacity) are calculated based on the following values:

Logical capacity unit Value

1 block 512 bytes

1 KB

1 MB

1 GB

1 TB

1 PB

1,024 (210) bytes

1,024 KB or 1,0242 bytes

1,024 MB or 1,0243 bytes

1,024 GB or 1,0244 bytes

1,024 TB or 1,0245 bytes

1 EB

Accessing product documentation

The HDLM user documentation is available on the Hitachi Data Systems Portal: https://portal.hds.com. Check this site for the most current documentation, including important updates that may have been made after the release of the product.

Getting help

Hitachi Data Systems Support Portal is the destination for technical support of your current or previously-sold storage systems, midrange and enterprise servers, and combined solution offerings. The Hitachi Data Systems customer support staff is available 24 hours a day, seven days a week. If you need technical support, log on to the Hitachi Data Systems Support Portal for contact information:

Hitachi Data Systems Community is a new global online community for HDS customers, partners, independent software vendors, employees, and prospects. It is an open discussion among these groups about the HDS portfolio of products and services. It is the destination to get answers, discover insights, and make connections. The HDS Community complements

https://portal.hds.com.

1,024 PB or 1,0246 bytes

Preface

Hitachi Dynamic Link Manager (for Solaris) User Guide

xvii

our existing Support Portal and support services by providing an area where you can get answers to non-critical issues and questions. Join the conversation today! Go to community.hds.com, register, and complete your profile.

Comments

Please send us your comments on this document: doc.comments@hds.com. Include the document title and number, including the revision level (for example, -07), and refer to specific sections and paragraphs whenever possible. All comments become the property of Hitachi Data Systems Corporation.

Thank you!

xviii

Preface

Hitachi Dynamic Link Manager (for Solaris) User Guide

Overview of HDLM

HDLM is a software package that manages paths between a host and a storage system. HDLM is designed to distribute loads across multiple paths and will switch a given load to another path if there is a failure in the path that is currently being used, thus improving system reliability.

This chapter gives an overview of HDLM and describes its features.

What is HDLM?

□

HDLM Features

□

Overview of HDLM

Hitachi Dynamic Link Manager (for Solaris) User Guide

1-1

What is HDLM?

With the widespread use of data warehousing and increasing use of multimedia data, the need for high-speed processing of large volumes of data on networks has rapidly grown. To satisfy this need, networks dedicated to the transfer of data, such as SANs, are now being used to provide access to storage systems.

HDLM manages the access paths to these storage systems. HDLM provides the ability to distribute loads across multiple paths and switch to another path if there is a failure in the path that is currently being used, thus improving system availability and reliability.

The figure below shows the connections between hosts and storage systems. A server on which HDLM is installed is called a host.

For details about the storage systems supported by HDLM, see Storage

Systems Supported by HDLM on page 3-4.

HDLM Features

HDLM features include the following:

The ability to distribute a load across multiple paths. This is also known as

load balancing.

When a host is connected to a storage system via multiple paths, HDLM can distribute the load across all the paths. This prevents one, loaded down path from affecting the processing speed of the entire system.

For details on load balancing, see

Balancing on page 2-10.

1-2

Figure 1-1 Connections between hosts and storage systems

Distributing a Load Using Load

Overview of HDLM

Hitachi Dynamic Link Manager (for Solaris) User Guide

The ability to continue running operations between a host and storage system, even if there is a failure. This is also known as performing a failover.

When a host is connected to a storage system via multiple paths, HDLM can automatically switch to another path if there is some sort of failure in the path that is currently being used. This allows operations to continue between a host and a storage system.

For details on performing failovers, see

Using Path Switching on page 2-15.

The ability to bring a path that has recovered from an error back online. This is also known as performing a failback.

If a path is recovered from an error, HDLM can bring that path back online. This enables the maximum possible number of paths to always be available and online, which in turn enables HDLM to better distribute the load across multiple paths.

Failbacks can be performed manually or automatically. In automatic failback, HDLM automatically restores the route to the active state after the user has corrected hardware problems in the route.

For details on performing failbacks, see

Failbacks Using Path Switching on page 2-15.

The ability to automatically check the status of any given path at regular intervals. This is also known as path health checking.

HDLM can easily detect errors by checking the statuses of paths at userdefined time intervals. This allows you to check for any existing path errors and to resolve them promptly and efficiently.

For details on setting up and performing path health checking, see

Detecting Errors by Using Path Health Checking on page 2-28.

Performing Failovers and Failbacks

Performing Failovers and

Overview of HDLM

Hitachi Dynamic Link Manager (for Solaris) User Guide

1-3

1-4

Overview of HDLM

Hitachi Dynamic Link Manager (for Solaris) User Guide

HDLM Functions

This chapter describes the various functions that are built into HDLM. Before the function specifications are explained though, this chapter will go into detail about the HDLM management targets, system configuration, and basic terms that are necessary to know to effectively operate HDLM. After that, the rest of the chapter focus on describing all the HDLM functions, including the main ones: load distribution across paths and path switching.

Devices Managed by HDLM

□

System Configuration

□

LU Configuration

□

Program Configuration

□

Position of the HDLM Driver and HDLM Device

□

Logical Device Files for HDLM Devices

□

Distributing a Load Using Load Balancing

□

Performing Failovers and Failbacks Using Path Switching

□

Intermittent Error Monitoring (Functionality When Automatic Failback Is

□

Used)

Detecting Errors by Using Path Health Checking

□

Distributing a Load by Using the Dynamic I/O Path Control Function

□

Error Management

□

HDLM Functions

Hitachi Dynamic Link Manager (for Solaris) User Guide

2-1

Collecting Audit Log Data

□

Integrated HDLM management using Global Link Manager

□

Cluster Support

□

2-2

HDLM Functions

Hitachi Dynamic Link Manager (for Solaris) User Guide

Devices Managed by HDLM

Below is a list of devices that can or cannot be managed by HDLM. The devices that can be managed by HDLM are called HDLM management-target devices.

HDLM management-target devices:

The following devices are from the storage systems listed in Section What

is HDLM? on page 1-2:

SCSI devices (sd or ssd devices)

Boot disks

Swap devices

Dump devices

If you want to use these disks as HDLM management-target devices, assign VTOC labels to them. EFI labels are not supported.

Non-HDLM management-target devices:

SCSI devices (sd or ssd devices) other than those of the storage systems listed in Section What is HDLM? on page 1-2

Built-in disks in a host

Devices other than disks (tape devices, etc.)

Command devices of the storage systems listed in Section

HDLM? on page 1-2 (For example, Hitachi RAID Manager command

devices.)

What is

System Configuration

HDLM manages routes between a host and a storage system by using the SCSI driver (sd or ssd driver). The host and storage systems are connected using SAN with fiber cables or SCSI cables. The cable port on the host is a host bus adapter (HBA). The cable port on the storage system is a port (P) on a channel adapter (CHA).

A logical unit (LU) contained in a storage system is the target of input to, or output from, the host. You can divide an LU into multiple areas. Each area after the division is called a Dev. The Dev is equivalent to a slice or partition. A route that connects a host and an LU is called a physical path, and a route that connects a host and a Dev is called a path. When an LU has been divided into multiple Devs, the number of paths set to the LU is equal to the number that is found by multiplying the number of physical paths by the number of Devs in the LU.

HDLM assigns an ID to each physical path and manages paths on a physicalpath basis. Because you do not need to be aware of the difference between physical paths and paths to operate HDLM, the following descriptions might simply refer to paths, without distinguishing between physical paths and

HDLM Functions

Hitachi Dynamic Link Manager (for Solaris) User Guide

2-3

paths. The ID that HDLM assigns to each path (physical path) is called a AutoPATH_ID. A path is also sometimes called a managed object.

The following figure shows the HDLM system configuration.

Figure 2-1 HDLM System Configuration

The following table lists and describes the HDLM system components.

Table 2-1 HDLM System Components

Components Description

HBA A host bus adapter. This serves as a cable port on the host.

SAN A dedicated network that is used for data transfer between the

host and storage systems

CHA A channel adapter

P A port on a CHA. This serves as a cable port on a storage

system.

LU A logical unit (a logical volume defined on the storage system).

This serves as the target of input or output operations from the host.

Dev An area (slice or partition) that is created when an LU is divided

Physical path A route that connects a host and an LU

Path A route that connects a host and a Dev

2-4

HDLM Functions

Hitachi Dynamic Link Manager (for Solaris) User Guide

LU Configuration

After you have properly installed HDLM, the LU configuration will change as follows:

Before the installation of HDLM:

The host recognizes that an sd or ssd device is connected to each physical path.

Thus, a single LU in the storage system is recognized as the same number of LUs as that of physical paths.

After the installation of HDLM:

An HDLM device that corresponds one-to-one with the Dev in an LU in the storage system is created above an sd or ssd device.

Thus, from the host, LUs in the storage system are also recognized as one LU regardless the number of physical paths.

After the installation of HDLM, an LU recognized by a host is called a host LU (HLU). The areas in a host LU that correspond to the Devs (slice or partition) in a storage system LU are called host devices (HDev).

On a system using HDLM, the logical device file for the HDLM device is used to access the target LU instead of the logical device file for the sd or ssd device.

The logical device files for sd or ssd are deleted by HDLM.

The following figure shows the LU configuration recognized by the host, after the installation of HDLM.

HDLM Functions

Hitachi Dynamic Link Manager (for Solaris) User Guide

2-5

Figure 2-2 LU Configuration Recognized by the Host After the Installation

The following table lists and describes the components recognized by the host.

Table 2-2 Components Recognized by the Host

Components Description

HLU An LU that the host recognizes via the HDLM driver. It is

HDev A Dev (a slice or partition) in an LU that the host

Program Configuration

HDLM is actually a combination of several programs. Because each program corresponds to a specific HDLM operation, it is important to understand the name and purpose of each program, along with how they are all interrelated.

of HDLM

called a host LU. No matter how many physical paths exist, one host LU is recognized for one LU in the storage system.

recognizes via the HDLM driver. It is called a host device. No matter how many physical paths exist, one host device is recognized for one Dev in the storage system.

2-6

The following figure shows the configuration of the HDLM programs.

HDLM Functions

Hitachi Dynamic Link Manager (for Solaris) User Guide

Figure 2-3 Configuration of the HDLM Programs

The following table lists and describes the functions of these programs.

Table 2-3 Function of HDLM Programs

Program name Functions

HDLM command Provides the dlnkmgr command, which enables you to:

• Manage paths

• Display error information

• Set up the HDLM operating environment

HDLM utility Provides the HDLM utility, which enables you to:

• Collect error information

• Add a new LU and delete an existing LU (reconfiguring an HDLM device dynamically)

• Create an HDLM driver configuration definition file (/ kernel/drv/dlmfdrv.conf)

• Create a correspondence table of logical device files when migrating to HDLM 6.5.1

• Support the creation of a VxVM configuration file

• The unattended installation of HDLM

• Install Hitachi Command Suite Common Agent Component

HDLM manager Provides the HDLM manager, which enables you to:

• Configure the HDLM operating environment

HDLM Functions

Hitachi Dynamic Link Manager (for Solaris) User Guide

2-7

Program name Functions

• Request path health checks and automatic failbacks to be performed

• Collect error log data

HDLM alert driver Reports the log information collected by the HDLM driver

to the HDLM manager. The driver name is dlmadrv.

HDLM driver Controls all the HDLM functions, manages paths, and

detects errors. The HDLM driver consists of the following:

• Core logic component

Controls the basic functionality of HDLM.

• Filter component

Sends and receives I/O data. The driver name is dlmfdrv.

• HDLM nexus driver

Performs operations such as reserving controller numbers for logical device files of the HDLM device, and managing HDLM driver instances for each HBA port. The driver name is dlmndrv.

Position of the HDLM Driver and HDLM Device

The HDLM driver is positioned above the SCSI driver. Each application on the host uses the HDLM device (logical device file) created by HDLM, to access LUs in the storage system. The following figure shows the positions of the HDLM driver and HDLM devices.

2-8

HDLM Functions

Hitachi Dynamic Link Manager (for Solaris) User Guide

+ 616 hidden pages