HP Hitachi Dynamic Link Manager Software Licenses User Manual
Hitachi Command Suite
Dynamic Link Manager
(for Solaris) User Guide
Document Organization
Product Version
Getting Help
Contents
MK-92DLM114-28
© 2014 Hitachi, Ltd. All rights reserved.
No part of this publication may be reproduced or transmitted in any form or by any means,
electronic or mechanical, including photocopying and recording, or stored in a database or retrieval
system for any purpose without the express written permission of Hitachi, Ltd.
Hitachi, Ltd., reserves the right to make changes to this document at any time without notice and
assumes no responsibility for its use. This document contains the most current information available
at the time of publication. When new or revised information becomes available, this entire
document will be updated and distributed to all registered users.
Some of the features described in this document might not be currently available. Refer to the most
recent product announcement for information about feature and product availability, or contact
Hitachi Data Systems Corporation at
Notice: Hitachi, Ltd., products and services can be ordered only under the terms and conditions of
the applicable Hitachi Data Systems Corporation agreements. The use of Hitachi, Ltd., products is
governed by the terms of your agreements with Hitachi Data Systems Corporation.
Hitachi is a registered trademark of Hitachi, Ltd., in the United States and other countries. Hitachi
Data Systems is a registered trademark and service mark of Hitachi, Ltd., in the United States and
other countries.
Archivas, Essential NAS Platform, HiCommand, Hi-Track, ShadowImage, Tagmaserve, Tagmasoft,
Tagmasolve, Tagmastore, TrueCopy, Universal Star Network, and Universal Storage Platform are
registered trademarks of Hitachi Data Systems.
AIX, AS/400, DB2, Domino, DS6000, DS8000, Enterprise Storage Server, ESCON, FICON,
FlashCopy, IBM, Lotus, MVS, OS/390, RS/6000, S/390, System z9, System z10, Tivoli, VM/ESA,
z/OS, z9, z10, zSeries, z/VM, and z/VSE are registered trademarks or trademarks of International
Business Machines Corporation.
https://portal.hds.com.
All other trademarks, service marks, and company names in this document or web site are
properties of their respective owners.
Microsoft product screen shots are reprinted with permission from Microsoft Corporation.
Notice on Export Controls. The technical data and technology inherent in this Document may be
subject to U.S. export control laws, including the U.S. Export Administration Act and its associated
regulations, and may be subject to export or import regulations in other countries. Reader agrees to
comply strictly with all such regulations and acknowledges that Reader has the responsibility to
obtain licenses to export, re-export, or import the Document and any Compliant Products.
ii
Hitachi Dynamic Link Manager (for Solaris) User Guide
Contents
Preface.................................................................................................xiii
Intended audience...................................................................................................xiv
Product version....................................................................................................... xiv
Release notes..........................................................................................................xiv
Document revision level........................................................................................... xiv
Document organization.............................................................................................xv
Related documents...................................................................................................xv
Document conventions.............................................................................................xvi
Conventions for storage capacity values.................................................................... xvi
Accessing product documentation............................................................................ xvii
Getting help........................................................................................................... xvii
Comments.............................................................................................................xviii
1 Overview of HDLM................................................................................1-1
What is HDLM?.......................................................................................................1-2
HDLM Features.......................................................................................................1-2
2 HDLM Functions................................................................................... 2-1
Devices Managed by HDLM......................................................................................2-3
System Configuration.............................................................................................. 2-3
LU Configuration.....................................................................................................2-5
Program Configuration............................................................................................ 2-6
Position of the HDLM Driver and HDLM Device..........................................................2-8
Logical Device Files for HDLM Devices...................................................................... 2-9
Distributing a Load Using Load Balancing................................................................2-10
Paths to Which Load Balancing Is Applied.........................................................2-12
When Using the Thunder 9500V Series, or Hitachi AMS/WMS series..........2-12
When Using Other Than the Thunder 9500V Series and Hitachi AMS/WMS
Series................................................................................................... 2-13
Load Balancing Algorithms...............................................................................2-14
Performing Failovers and Failbacks Using Path Switching......................................... 2-15
Automatic Path Switching................................................................................ 2-16
Automatic Failovers............................................................................... 2-16
Automatic Failbacks...............................................................................2-18
Manual Path Switching.................................................................................... 2-18
Hitachi Dynamic Link Manager (for Solaris) User Guide
iii
Path Status Transition..................................................................................... 2-19
The Online Path Status.......................................................................... 2-19
The Offline Path Status.......................................................................... 2-20
Status Transitions of a Path....................................................................2-20
Intermittent Error Monitoring (Functionality When Automatic Failback Is Used)......... 2-23
Checking Intermittent Errors............................................................................2-23
Setting Up Intermittent Error Monitoring...........................................................2-23
Intermittent Error Monitoring Actions............................................................... 2-24
When an Intermittent Error Occurs......................................................... 2-24
When an Intermittent Error Does Not Occur............................................ 2-25
When the Conditions for an Intermittent Error Are Changed During Error
Monitoring............................................................................................ 2-26
When a User Changes the Intermittent Error Information.................................. 2-27
Detecting Errors by Using Path Health Checking...................................................... 2-28
Distributing a Load by Using the Dynamic I/O Path Control Function.........................2-29
What is the Dynamic Load Balance Control Function..........................................2-29
Dynamic I/O Path Control Function.................................................................. 2-29
Error Management................................................................................................ 2-30
Types of Collected Logs...................................................................................2-31
Filtering of Error Information........................................................................... 2-32
Collecting Error Information Using the Utility for Collecting HDLM Error Information
(DLMgetras)................................................................................................... 2-33
Collecting Audit Log Data.......................................................................................2-33
Categories and Audit Events that HDLM Can Output to the Audit Log................. 2-35
Requirements for Outputting Audit Log Data.....................................................2-38
Destination and Filtering of Audit Log Data....................................................... 2-39
Audit Log Data Formats...................................................................................2-40
Integrated HDLM management using Global Link Manager.......................................2-41
Cluster Support.....................................................................................................2-42
3 Creating an HDLM Environment............................................................. 3-1
HDLM System Requirements....................................................................................3-3
Hosts and OSs Supported by HDLM................................................................... 3-3
Storage Systems Supported by HDLM................................................................ 3-4
Storage Systems..................................................................................... 3-4
HBAs......................................................................................................3-5
When Handling Intermediate Volumes Managed by Hitachi RapidXchange...3-5
Cluster Software Supported by HDLM.................................................................3-6
Volume Manager Supported by HDLM................................................................ 3-6
Combinations of Cluster Software and Volume Managers Supported by HDLM.......3-7
For the Solaris Cluster or VCS Environment............................................... 3-7
When Creating an Oracle9i RAC Environment.......................................... 3-11
When Creating an Oracle RAC 10g Environment...................................... 3-11
When Creating an Oracle RAC 11g Environment...................................... 3-25
Virtualization Environments Supported by HDLM............................................... 3-35
Memory and Disk Capacity Requirements......................................................... 3-36
Memory Requirements...........................................................................3-36
Disk Capacity Requirements................................................................... 3-36
Number of LUs and Paths Supported in HDLM...................................................3-37
Flow for Creating an HDLM Environment.................................................................3-37
HDLM Installation Types........................................................................................3-38
Notes on Creating an HDLM Environment............................................................... 3-39
iv
Hitachi Dynamic Link Manager (for Solaris) User Guide
Notes on Hardware Settings............................................................................ 3-39
Notes on Installation.......................................................................................3-40
Notes on Related Software.............................................................................. 3-44
Notes on Command Execution......................................................................... 3-45
Notes on the Disk Label...................................................................................3-45
Installing HDLM.................................................................................................... 3-45
Preparations for a New Installation of HDLM.....................................................3-45
Performing Operations on Devices to Be Managed by HDLM..................... 3-45
Apply Solaris Patches.............................................................................3-47
Set Up the Hardware............................................................................. 3-47
Set Up the /kernel/drv/sd.conf File......................................................... 3-48
Switch the Kernel Mode ........................................................................ 3-48
Set Up the /etc/system File.................................................................... 3-49
Set Up the /etc/syslog.conf or /etc/rsyslog.conf File.................................3-49
Set Up VxVM.........................................................................................3-50
Set Up SDS and SVM............................................................................. 3-50
Set Up Solaris Cluster............................................................................ 3-51
Setting up a Solaris 11 environment........................................................3-52
Preparation for Performing an Unattended Installation of HDLM......................... 3-54
Performing a New Installation of HDLM (When Solaris Cluster Is Not Being Used)3-55
Performing a New Installation of HDLM (When Solaris Cluster Is Being Used)..... 3-62
Using the HDLM Device Unconfiguration Function When Performing a New
Installation of HDLM....................................................................................... 3-72
Preparations for an Upgrade Installation or Re-installation of HDLM................... 3-73
Performing an Upgrade Installation or Re-installation of HDLM...........................3-73
Installing HDLM in an LDoms Environment....................................................... 3-78
Configuring a Boot Disk Environment......................................................................3-82
Overview of Configuring a Boot Disk Environment............................................. 3-83
Procedure for Configuring a Boot Disk Environment...........................................3-83
Migration from an Existing HDLM Environment........................................ 3-84
Migration by Installing HDLM in the Existing Local Boot Disk Environment. 3-85
Migration by Installing HDLM in the Existing Boot Disk Environment..........3-87
Migration by Building a New Pre-Migration Environment........................... 3-89
Setting Up the Post-Migration Environment............................................. 3-91
Configuring a Boot Disk Environment for a ZFS File System......................................3-96
Boot Disk Environment that uses a ZFS File System...........................................3-96
Creating a ZFS Boot Disk Environment (for Solaris 10).......................................3-98
Copying the local boot disk environment to the LUs (SCSI device) in the
storage system......................................................................................3-99
Replacing the ZFS boot disk environment on the SCSI device with the ZFS
boot disk environment on the HDLM device........................................... 3-101
Creating a ZFS Boot Disk Environment (for Solaris 11).....................................3-102
Moving a local boot disk environment to an LU (HDLM device) in a storage
system................................................................................................3-102
Configuring a ZFS Boot Disk Environment after the Migration..................3-104
Replacing an LU with Another LU in the Boot Disk Environment.............. 3-106
Performing a Check after Restart.......................................................... 3-108
Migrating from a ZFS Boot Disk Environment to the Local Boot Disk Environment (for
Solaris 10)....................................................................................................3-109
Migrating from a ZFS Boot Disk Environment to the Local Boot Disk Environment (for
Solaris 11)....................................................................................................3-110
Replacing an LU with Another LU in the Boot Disk Environment.............. 3-110
Hitachi Dynamic Link Manager (for Solaris) User Guide
v
Creating a New Boot Environment........................................................ 3-112
Configuring the Post-Migration ZFS Boot Disk Environment.....................3-113
Migrating to the ZFS Boot Disk Environment.......................................... 3-114
Performing a Check after Restart.......................................................... 3-115
Migrating from a Boot Disk Environment to the Local Boot Disk Environment...........3-116
Configuring a Mirrored Boot Disk Environment Incorporating SVM.......................... 3-121
Precautions.................................................................................................. 3-121
Configuring a Boot Disk Environment in Which HDLM Manages the Boot Disk and
Mirroring the Environment by Using SVM........................................................ 3-122
Configuring a Boot Disk Environment in Which HDLM Manages the Boot Disk,
from the Local Boot Disk Environment...................................................3-122
Mirroring a Boot Disk Environment in Which HDLM Manages the Boot Disk by
Using SVM.......................................................................................... 3-123
Placing the Boot Disks Under HDLM Management by Installing HDLM to a Mirrored
Boot Disk Environment Incorporating SVM...................................................... 3-126
Installing HDLM and then Configuring the Environment.......................... 3-127
Placing the Boot Disks Under HDLM Management.................................. 3-127
Removing HDLM........................................................................................... 3-133
Excluding the Prepared LUs from HDLM Management............................ 3-133
Configuring an Environment and then Removing HDLM.......................... 3-133
Checking the Path Configuration...........................................................................3-139
Setting Up HDLM Functions..................................................................................3-140
Checking the Current Settings........................................................................3-140
Setting Up the HDLM Functions......................................................................3-140
Setting Up Load Balancing....................................................................3-141
Setting Up Path Health Checking...........................................................3-142
Setting Up the Automatic Failback Function........................................... 3-142
Setting Up Intermittent Error Monitoring............................................... 3-143
Setting Up Dynamic I/O Path Control.................................................... 3-144
Setting the Error Log Collection Level....................................................3-144
Setting the Trace Level........................................................................ 3-145
Setting the Error Log File Size...............................................................3-145
Setting the Number of Error Log Files................................................... 3-146
Setting the Trace File Size.................................................................... 3-146
Setting the Number of Trace Files.........................................................3-147
Setting Up Audit Log Data Collection.....................................................3-147
Setting the Audit Log Facility................................................................ 3-148
Checking the Updated Settings...................................................................... 3-149
Setting up Integrated Traces................................................................................3-149
Notes on Using the Hitachi Network Objectplaza Trace Library......................... 3-150
Displaying the Hitachi Network Objectplaza Trace Library setup Menu.............. 3-151
Changing the Size of Integrated Trace Files.................................................... 3-151
Changing the Number of Integrated Trace Files.............................................. 3-152
Changing the Buffer Size Per Monitoring Interval Duration............................... 3-152
Adjusting the Number of Messages to Be Output Per Monitoring Interval.......... 3-153
Finishing the Hitachi Network Objectplaza Trace Library Settings......................3-155
Applying the Hitachi Network Objectplaza Trace Library Settings...................... 3-155
Creating File Systems for HDLM (When Volume Management Software Is Not Used)3-156
Setting Up VxVM................................................................................................. 3-157
Creating a Disk Group................................................................................... 3-157
Creating VxVM Volumes.................................................................................3-160
Removing Devices from VxVM........................................................................3-160
vi
Hitachi Dynamic Link Manager (for Solaris) User Guide
Devices to Be Removed from VxVM.......................................................3-161
Removing Devices from VxVM on a Controller Basis............................... 3-162
Removing Devices From VxVM on a Path Basis...................................... 3-166
Actions To Be Taken if an sd or ssd Device Has Not Been Suppressed from
VxVM..................................................................................................3-170
Introducing VxVM while Using HDLM.............................................................. 3-174
Linking VxVM and Solaris Cluster....................................................................3-174
Setting Up SDS................................................................................................... 3-176
Notes...........................................................................................................3-176
Registering HDLM Devices............................................................................. 3-177
To Use a Local Metadevice................................................................... 3-177
To Use a Shared Diskset...................................................................... 3-178
Setting Up SVM...................................................................................................3-180
Notes...........................................................................................................3-180
Registering HDLM Devices............................................................................. 3-181
To Use a Local Volume.........................................................................3-181
To Use a Shared Diskset...................................................................... 3-181
Setting Up VCS................................................................................................... 3-183
Removing HDLM................................................................................................. 3-184
Overview of HDLM Removal...........................................................................3-184
Preparations for HDLM Removal.....................................................................3-185
Performing Operations on HDLM-Managed Devices................................ 3-185
Remove Solaris Cluster Settings............................................................3-186
Remove VCS Settings...........................................................................3-188
Remove VxVM Settings........................................................................ 3-189
Remove SDS Settings...........................................................................3-189
Remove SVM Settings.......................................................................... 3-190
Removing HDLM........................................................................................... 3-191
Removing HDLM from the Local Boot Disk Environment..........................3-191
Removing HDLM from the Boot Disk Environment.................................. 3-193
Removing HDLM from an LDoms Environment....................................... 3-193
Settings Needed After HDLM Removal............................................................ 3-198
VxVM Settings..................................................................................... 3-198
SDS Settings....................................................................................... 3-198
SVM Settings.......................................................................................3-198
Solaris Cluster Settings.........................................................................3-198
File System Settings.............................................................................3-200
Application Program Settings................................................................3-200
Removing Hitachi Network Objectplaza Trace Library (HNTRLib2).....................3-200
Removing Hitachi Network Objectplaza Trace Library (HNTRLib)...................... 3-201
4 HDLM Operation................................................................................... 4-1
Notes on Using HDLM............................................................................................. 4-2
Displaying Path Information.............................................................................. 4-2
When a Path Error is Detected...........................................................................4-2
iostat Command............................................................................................... 4-2
Storage System................................................................................................ 4-3
Command Execution......................................................................................... 4-3
Using a Sun HBA.............................................................................................. 4-3
Starting Solaris in Single-User Mode...................................................................4-3
Upgrading Solaris............................................................................................. 4-4
Operation in Single-User Mode.......................................................................... 4-4
vii
Hitachi Dynamic Link Manager (for Solaris) User Guide
Initializing HDLM When the Host Is Started in Single-User Mode.................4-4
Tasks that Can Be Performed in Single-User Mode.....................................4-5
Maintenance Tasks on Devices Connected by Paths in the Boot Disk Environment
.......................................................................................................................4-6
HDLM Operations Using Commands......................................................................... 4-6
Notes on Using Commands................................................................................4-6
Viewing Path Information..................................................................................4-6
Changing the Status of Paths.............................................................................4-7
Changing the Status of Paths to Online.....................................................4-7
Changing the Status of Paths to Offline(C)................................................ 4-8
Viewing LU Information.....................................................................................4-9
Displaying Corresponding Information About an HDLM Device, sd or ssd Device, and
LDEV............................................................................................................... 4-9
Initializing Statistical Information for Paths....................................................... 4-10
Viewing and Setting Up the Operating Environment...........................................4-11
Viewing the Operating Environment........................................................4-11
Setting Up the Operating Environment.................................................... 4-11
Viewing License Information............................................................................4-12
Updating the License.......................................................................................4-13
Viewing HDLM Version Information.................................................................. 4-13
Viewing HDLM Component Information............................................................ 4-14
Starting and Stopping the HDLM Manager...............................................................4-15
Starting the HDLM Manager.............................................................................4-15
Stopping the HDLM Manager........................................................................... 4-15
HDLM Resident Processes......................................................................................4-16
Changing the Configuration of the HDLM Operating Environment............................. 4-16
Precautions Regarding Changes to the Configuration of an HDLM Operating
Environment...................................................................................................4-17
Changing the Configuration of a System that Uses HDLM......................... 4-17
When the Path Configuration Is Changed................................................ 4-17
Switching the Kernel Mode.....................................................................4-19
When the Path Configuration Is Changed in a Boot Disk Environment....... 4-19
Dynamic Reconfiguration (DR) for Solaris................................................4-20
Overview of Reconfiguring the HDLM Device.....................................................4-20
Reconfiguring the HDLM Device..............................................................4-20
Notes on Reconfiguring the HDLM Device................................................4-21
Adding a New Logical Unit...............................................................................4-22
Notes................................................................................................... 4-22
Adding a New LU (When Not Using Solaris Cluster)..................................4-23
Adding a New LU By Restarting the Nodes (When Using Solaris Cluster)....4-25
Adding a New LU Via Dynamic Reconfiguration (When Using Solaris Cluster)
............................................................................................................4-31
Configuration Changes Such as Deleting a Logical Unit...................................... 4-36
Changing the Configuration by Restarting the Host.................................. 4-37
Deleting an LU via Dynamic Reconfiguration............................................4-42
Adding a Path to an Existing LU by Dynamic Reconfiguration............................. 4-44
Deleting a Path to an Existing LU by Dynamic Reconfiguration........................... 4-47
Specifying Whether a Logical Unit Is To Be Managed by HDLM (When Not Using
Solaris Cluster)............................................................................................... 4-48
Changing an HDLM-managed Device to a Non-HDLM-Managed Device......4-49
Changing a Non-HDLM-Managed Device to an HDLM-Managed Device...... 4-49
viii
Hitachi Dynamic Link Manager (for Solaris) User Guide
Specifying Whether a Logical Unit Is To Be Managed by HDLM (When Using Solaris
Cluster)..........................................................................................................4-52
Changing an HDLM-Managed Device to a Non-HDLM-Managed Device...... 4-52
Changing a Non-HDLM-Managed Device to an HDLM-Managed Device (When
the Node Must Be Restarted)................................................................. 4-57
Changing a Non-HDLM-Managed Device to an HDLM-Managed Device (For
Dynamic Reconfiguration)...................................................................... 4-63
Inheriting logical device names during storage system migration........................4-68
5 Troubleshooting....................................................................................5-1
Information collected by using the DLMgetras utility for collecting HDLM error
information.............................................................................................................5-2
Checking Error Information in Messages...................................................................5-2
What To Do for a Path Error.................................................................................... 5-3
Examining the Messages................................................................................... 5-5
Obtain Path Information....................................................................................5-5
Identifying the Error Path..................................................................................5-5
Narrowing Down the Hardware That Might Have Caused the Error....................... 5-5
Identifying the Error Location and Correcting any Hardware Errors.......................5-5
Placing the Path Online..................................................................................... 5-5
Actions to Take for a Path Error in a Boot Disk Environment...................................... 5-6
Path Errors During Boot Processing....................................................................5-6
When a Path Error Occurs at the Initial Stage of Boot Processing................5-6
When a Path Error Occurs After the HDLM Driver Starts Path Processing.....5-6
Path Errors After Boot Processing Completes...................................................... 5-7
What To Do for a Program Error.............................................................................. 5-7
Examining the Messages................................................................................... 5-8
Obtaining Program Information......................................................................... 5-8
What To Do for the Program Error..................................................................... 5-8
Contacting Your HDLM Vendor or Maintenance Company.................................... 5-9
What To Do for Other Errors....................................................................................5-9
6 Command Reference.............................................................................6-1
Overview of the HDLM Command dlnkmgr................................................................6-2
clear (Returns the Path Statistics to the Initial Value)................................................ 6-3
Format.............................................................................................................6-3
To set the path statistics to 0...................................................................6-3
To display the format of the clear operation.............................................. 6-3
Parameters...................................................................................................... 6-3
To set the path statistics to 0...................................................................6-3
To display the format of the clear operation.............................................. 6-4
help (Displays the Operation Format)....................................................................... 6-4
Format.............................................................................................................6-4
Parameter........................................................................................................6-4
offline (Places Paths Offline)....................................................................................6-6
Format.............................................................................................................6-6
To place paths offline.............................................................................. 6-6
To display the format of the offline operation............................................6-7
Parameters...................................................................................................... 6-7
To place paths offline.............................................................................. 6-7
To display the format of the offline operation.......................................... 6-10
ix
Hitachi Dynamic Link Manager (for Solaris) User Guide
online (Places Paths Online)...................................................................................6-12
Format...........................................................................................................6-12
To place paths online.............................................................................6-12
To display the format of the online operation.......................................... 6-12
Parameters.....................................................................................................6-12
To place paths online.............................................................................6-12
To display the format of the online operation.......................................... 6-16
set (Sets Up the Operating Environment)................................................................6-17
Format...........................................................................................................6-17
To set up the HDLM operating environment............................................ 6-17
To display the format of the set operation...............................................6-18
Parameters.....................................................................................................6-18
To set up the HDLM operating environment............................................ 6-18
To display the format of the set operation...............................................6-32
view (Displays Information)................................................................................... 6-34
Format...........................................................................................................6-34
To display program information..............................................................6-34
To display path information....................................................................6-34
To display LU information...................................................................... 6-35
To display HBA port information............................................................. 6-35
To display CHA port information............................................................. 6-35
To display corresponding information about an HDLM device, sd or ssd device,
and LDEV..............................................................................................6-35
To display the format of the view operation.............................................6-36
Parameters.....................................................................................................6-36
To display program information..............................................................6-36
To display path information....................................................................6-43
To display LU information...................................................................... 6-57
To display HBA port information............................................................. 6-70
To display CHA port information............................................................. 6-71
To display corresponding information about an HDLM device, sd or ssd device,
and LDEV..............................................................................................6-72
To display view operation format............................................................6-73
monitor (Displays I/O Information at a Specified Interval)........................................6-74
Format...........................................................................................................6-75
To display I/O information for each HBA port.......................................... 6-75
To display I/O information for each CHA port.......................................... 6-75
To display the monitor operation format................................................. 6-75
Parameters.....................................................................................................6-75
To display I/O information for each HBA port.......................................... 6-76
To display I/O information for each CHA port.......................................... 6-77
To display monitor operation format....................................................... 6-78
add (Adds a Path Dynamically)...............................................................................6-79
Format...........................................................................................................6-79
To Add a Path Dynamically.....................................................................6-79
To Display the Format of the add Operation............................................ 6-79
Parameters.....................................................................................................6-79
To Add a Path Dynamically.....................................................................6-79
To Display the Format of the add Operation............................................ 6-80
delete (Deletes a Path Dynamically)....................................................................... 6-80
Format...........................................................................................................6-81
To Delete a Path Dynamically.................................................................6-81
x
Hitachi Dynamic Link Manager (for Solaris) User Guide
To Display the Format of the delete Operation.........................................6-81
Parameters.....................................................................................................6-81
To Delete a Path Dynamically.................................................................6-81
To Display the Format of the delete Operation.........................................6-82
7 Utility Reference................................................................................... 7-1
Overview of the Utilities.......................................................................................... 7-2
The DLMgetras Utility for Collecting HDLM Error Information......................................7-3
Format.............................................................................................................7-4
Parameters...................................................................................................... 7-4
List of Collected Error Information..................................................................... 7-6
The dlmcfgmgr Utility for Managing the HDLM Configuration....................................7-17
Format...........................................................................................................7-17
Parameters.....................................................................................................7-18
The dlminstcomp HDLM Component Installation Utility............................................ 7-20
Format...........................................................................................................7-20
Parameter...................................................................................................... 7-20
The dlmlisthdev Utility for Assisting HDLM Transitions..............................................7-20
Format...........................................................................................................7-21
Parameters.....................................................................................................7-21
The dlmsetboot Utility for Assisting Configuration of an HDLM Boot Disk Environment7-23
Format...........................................................................................................7-23
Parameters.....................................................................................................7-23
The dlmsetconf Utility for Creating the HDLM Driver Configuration Definition File.......7-23
Format...........................................................................................................7-24
Parameters.....................................................................................................7-25
Items in the storage-system-migration definition file......................................... 7-29
The dlmstart Utility for Configuring HDLM Devices...................................................7-30
Format...........................................................................................................7-30
Parameters.....................................................................................................7-30
Note.............................................................................................................. 7-31
The dlmvxexclude Utility for Assisting Creation of the VxVM Configuration File...........7-31
Format...........................................................................................................7-32
Parameters.....................................................................................................7-32
The installhdlm Utility for Installing HDLM...............................................................7-33
Format...........................................................................................................7-34
Parameters.....................................................................................................7-34
Contents of the Installation-Information Settings File........................................ 7-34
About the Log File...........................................................................................7-42
Note.............................................................................................................. 7-43
installux.sh Utility for HDLM Common Installer........................................................ 7-44
Format...........................................................................................................7-44
Parameters.....................................................................................................7-44
Log file...........................................................................................................7-45
Note.............................................................................................................. 7-45
The removehdlm Utility for Removing HDLM........................................................... 7-46
Format...........................................................................................................7-46
Parameters.....................................................................................................7-46
8 Messages............................................................................................. 8-1
Before Viewing the List of Messages.........................................................................8-3
xi
Hitachi Dynamic Link Manager (for Solaris) User Guide
Format and Meaning of Message IDs................................................................. 8-3
Terms Used in Messages and Message Explanations............................................8-3
Components That Output Messages to Syslog.....................................................8-3
KAPL01001 to KAPL02000....................................................................................... 8-4
KAPL03001 to KAPL04000......................................................................................8-31
KAPL04001 to KAPL05000......................................................................................8-33
KAPL05001 to KAPL06000......................................................................................8-41
KAPL06001 to KAPL07000......................................................................................8-49
KAPL07001 to KAPL08000......................................................................................8-52
KAPL08001 to KAPL09000......................................................................................8-53
KAPL09001 to KAPL10000......................................................................................8-57
KAPL10001 to KAPL11000......................................................................................8-84
KAPL11001 to KAPL12000....................................................................................8-128
KAPL13001 to KAPL14000....................................................................................8-131
KAPL15001 to KAPL16000....................................................................................8-133
Return Codes for Hitachi Command Suite Common Agent Component.....................8-136
A Sun Cluster 3.2 Commands................................................................... A-1
Sun Cluster 3.2 Commands..................................................................................... A-2
B Functional Differences Between Versions of HDLM.................................. B-1
Functional Differences Between Version 6.1 or Later and Versions Earlier Than 6.1..... B-2
Functional Differences Between Version 6.0 or Later and Versions Earlier Than 6.0..... B-2
Precautions on Differences in Functionality Between HDLM 5.6.1 or Earlier and HDLM
5.6.2 or Later......................................................................................................... B-2
Acronyms and abbreviations
Glossary
Index
xii
Hitachi Dynamic Link Manager (for Solaris) User Guide
Preface
This document describes how to use the Hitachi Dynamic Link Manager.
Intended audience
□
Product version
□
Release notes
□
Document revision level
□
Document organization
□
Related documents
□
Document conventions
□
Conventions for storage capacity values
□
Accessing product documentation
□
Getting help
□
Comments
□
Hitachi Dynamic Link Manager (for Solaris) User Guide
Preface
xiii
Intended audience
This document is intended for storage administrators who use Hitachi
Dynamic Link Manager (HDLM) to operate and manage storage systems, and
assumes that readers have:
• Knowledge of Solaris and its management functionality
• Knowledge of Storage system management functionality
• Knowledge of Cluster software functionality
• Knowledge of Volume management software functionality
Product version
This document revision applies to HDLM for Solaris version 8.0.0 or later.
Release notes
Read the release notes before installing and using this product. They may
contain requirements or restrictions that are not fully described in this
document or updates or corrections to this document.
Document revision level
Revision Date Description
MK-92DLM114-21 November 2011 Initial Release
MK-92DLM114-22 July 2012 Revision 1, supersedes and replaces
MK-92DLM114-23 August 2012 Revision 2, supersedes and replaces
MK-92DLM114-24 November 2012 Revision 3, supersedes and replaces
MK-92DLM114-25 February 2013 Revision 4, supersedes and replaces
MK-92DLM114-26 May 2013 Revision 5, supersedes and replaces
MK-92DLM114-27 October 2013 Revision 6, supersedes and replaces
MK-92DLM114-28 April 2014 Revision 7, supersedes and replaces
MK-92DLM114-21
MK-92DLM114-22
MK-92DLM114-23
MK-92DLM114-24
MK-92DLM114-25
MK-92DLM114-26
MK-92DLM114-27
xiv
Preface
Hitachi Dynamic Link Manager (for Solaris) User Guide
Document organization
The following table provides an overview of the contents and organization of
this document. Click the chapter title in the left column to go to that chapter.
The first page of each chapter provides links to the sections in that chapter.
Chapter/Appendix Description
Chapter 1, Overview of HDLM on
page 1-1
Chapter 2, HDLM Functions on
page 2-1
Chapter 3, Creating an HDLM
Environment on page 3-1
Chapter 4, HDLM Operation on
page 4-1
Chapter 5, Troubleshooting on
page 5-1
Chapter 6, Command Reference
on page 6-1
Chapter 7, Utility Reference on
page 7-1
Gives an overview of HDLM, and describes its
features.
Describes management targets and the system
configuration of HDLM, and the basic terms and
functions for HDLM.
Describes the procedures for setting up an HDLM
environment and the procedure for canceling those
settings.
Describes how to use HDLM by using both the HDLM
GUI and commands, and how to manually start and
stop the HDLM manager. This chapter also describes
how to configure an environment to properly operate
HDLM, such as changing the HDLM managementtarget devices that connect paths or replacing the
hardware that makes up a path. describes how to
check path information by using the Windows
management tool.
Explains how to troubleshoot a path error, HDLM
failure, or any other problems that you might
encounter.
Describes all the HDLM commands.
Describes the HDLM utilities.
Chapter 8, Messages on page
8-1
Appendix A, Sun Cluster 3.2
Commands on page A-1
Appendix B, Functional
Differences Between Versions of
HDLM on page B-1
Related documents
The following related Hitachi Command Suite documents are available on the
documentation CD:
• Hitachi Command Suite Global Link Manager Installation and
Configuration Guide, MK-95HC107
• Hitachi Command Suite Global Link Manager Messages, MK-95HC108
Hitachi Dynamic Link Manager (for Solaris) User Guide
Provides information about viewing messages output
by HDLM. It also lists and explains the HDLM
messages and shows the actions to be taken in
response to each message.
Describes the Sun Cluster 3.2 commands.
Gives precautions on differences in functionality
between HDLM versions.
Preface
xv
• Hitachi Adaptable Modular Storage Series User's Guide
• Hitachi Simple Modular Storage Series User's Guide
• Hitachi Unified Storage Series User's Guide
• Hitachi USP Series User's Guide
• Hitachi Workgroup Modular Storage Series User's Guide
• Thunder9580V Series Disk Array Subsystem User's Guide
• Hitachi Universal Storage Platform V Hitachi Universal Storage Platform
VM User and Reference Guide
• Hitachi Virtual Storage Platform Series User's Guide
• Reference Manual / File Conversion Utility & File Access Library
Document conventions
This document uses the following typographic conventions:
Convention Description
Bold Indicates text on a window, other than the window title, including
menus, menu options, buttons, fields, and labels. Example: Click OK.
Italic Indicates a variable, which is a placeholder for actual text provided by
the user or system. Example: copy source-file target-file
Note: Angled brackets (< >) are also used to indicate variables.
Monospace
< > angled
brackets
[ ] square
brackets
{ } braces Indicates required or expected values. Example: { a | b } indicates
| vertical bar Indicates that you have a choice between two or more options or
underline
Indicates text that is displayed on screen or entered by the user.
Example: # pairdisplay -g oradb
Indicates a variable, which is a placeholder for actual text provided by
the user or system. Example: # pairdisplay -g <group>
Note: Italic font is also used to indicate variables.
Indicates optional values. Example: [ a | b ] indicates that you can
choose a, b, or nothing.
that you must choose either a or b.
arguments. Examples: [ a | b ] indicates that you can choose a, b, or
nothing. { a | b } indicates that you must choose either a or b.
Indicates the default value.
Example:
[ a | b ]
Conventions for storage capacity values
Physical storage capacity values (for example, disk drive capacity) are
calculated based on the following values:
xvi
Preface
Hitachi Dynamic Link Manager (for Solaris) User Guide
Physical capacity unit Value
1 kilobyte (KB)
1 megabyte (MB)
1 gigabyte (GB)
1 terabyte (TB)
1 petabyte (PB)
1 exabyte (EB)
1,000 (103) bytes
1,000 KB or 1,0002 bytes
1,000 MB or 1,0003 bytes
1,000 GB or 1,0004 bytes
1,000 TB or 1,0005 bytes
1,000 PB or 1,0006 bytes
Logical storage capacity values (for example, logical device capacity) are
calculated based on the following values:
Logical capacity unit Value
1 block 512 bytes
1 KB
1 MB
1 GB
1 TB
1 PB
1,024 (210) bytes
1,024 KB or 1,0242 bytes
1,024 MB or 1,0243 bytes
1,024 GB or 1,0244 bytes
1,024 TB or 1,0245 bytes
1 EB
Accessing product documentation
The HDLM user documentation is available on the Hitachi Data Systems
Portal: https://portal.hds.com. Check this site for the most current
documentation, including important updates that may have been made after
the release of the product.
Getting help
Hitachi Data Systems Support Portal is the destination for technical support of
your current or previously-sold storage systems, midrange and enterprise
servers, and combined solution offerings. The Hitachi Data Systems customer
support staff is available 24 hours a day, seven days a week. If you need
technical support, log on to the Hitachi Data Systems Support Portal for
contact information:
Hitachi Data Systems Community is a new global online community for HDS
customers, partners, independent software vendors, employees, and
prospects. It is an open discussion among these groups about the HDS
portfolio of products and services. It is the destination to get answers,
discover insights, and make connections. The HDS Community complements
https://portal.hds.com.
1,024 PB or 1,0246 bytes
Preface
Hitachi Dynamic Link Manager (for Solaris) User Guide
xvii
our existing Support Portal and support services by providing an area where
you can get answers to non-critical issues and questions. Join the
conversation today! Go to community.hds.com, register, and complete
your profile.
Comments
Please send us your comments on this document: doc.comments@hds.com.
Include the document title and number, including the revision level (for
example, -07), and refer to specific sections and paragraphs whenever
possible. All comments become the property of Hitachi Data Systems
Corporation.
Thank you!
xviii
Preface
Hitachi Dynamic Link Manager (for Solaris) User Guide
1
Overview of HDLM
HDLM is a software package that manages paths between a host and a
storage system. HDLM is designed to distribute loads across multiple paths
and will switch a given load to another path if there is a failure in the path
that is currently being used, thus improving system reliability.
This chapter gives an overview of HDLM and describes its features.
What is HDLM?
□
HDLM Features
□
Overview of HDLM
Hitachi Dynamic Link Manager (for Solaris) User Guide
1-1
What is HDLM?
With the widespread use of data warehousing and increasing use of
multimedia data, the need for high-speed processing of large volumes of data
on networks has rapidly grown. To satisfy this need, networks dedicated to
the transfer of data, such as SANs, are now being used to provide access to
storage systems.
HDLM manages the access paths to these storage systems. HDLM provides
the ability to distribute loads across multiple paths and switch to another path
if there is a failure in the path that is currently being used, thus improving
system availability and reliability.
The figure below shows the connections between hosts and storage systems.
A server on which HDLM is installed is called a host.
For details about the storage systems supported by HDLM, see Storage
Systems Supported by HDLM on page 3-4.
HDLM Features
HDLM features include the following:
The ability to distribute a load across multiple paths. This is also known as
load balancing.
When a host is connected to a storage system via multiple paths, HDLM
can distribute the load across all the paths. This prevents one, loaded
down path from affecting the processing speed of the entire system.
For details on load balancing, see
Balancing on page 2-10.
1-2
Figure 1-1 Connections between hosts and storage systems
Distributing a Load Using Load
Overview of HDLM
Hitachi Dynamic Link Manager (for Solaris) User Guide
The ability to continue running operations between a host and storage
system, even if there is a failure. This is also known as performing a failover.
When a host is connected to a storage system via multiple paths, HDLM
can automatically switch to another path if there is some sort of failure in
the path that is currently being used. This allows operations to continue
between a host and a storage system.
For details on performing failovers, see
Using Path Switching on page 2-15.
The ability to bring a path that has recovered from an error back online. This
is also known as performing a failback.
If a path is recovered from an error, HDLM can bring that path back
online. This enables the maximum possible number of paths to always be
available and online, which in turn enables HDLM to better distribute the
load across multiple paths.
Failbacks can be performed manually or automatically. In automatic
failback, HDLM automatically restores the route to the active state after
the user has corrected hardware problems in the route.
For details on performing failbacks, see
Failbacks Using Path Switching on page 2-15.
The ability to automatically check the status of any given path at regular
intervals. This is also known as path health checking.
HDLM can easily detect errors by checking the statuses of paths at userdefined time intervals. This allows you to check for any existing path
errors and to resolve them promptly and efficiently.
For details on setting up and performing path health checking, see
Detecting Errors by Using Path Health Checking on page 2-28.
Performing Failovers and Failbacks
Performing Failovers and
Overview of HDLM
Hitachi Dynamic Link Manager (for Solaris) User Guide
1-3
1-4
Overview of HDLM
Hitachi Dynamic Link Manager (for Solaris) User Guide
2
HDLM Functions
This chapter describes the various functions that are built into HDLM. Before
the function specifications are explained though, this chapter will go into
detail about the HDLM management targets, system configuration, and basic
terms that are necessary to know to effectively operate HDLM. After that, the
rest of the chapter focus on describing all the HDLM functions, including the
main ones: load distribution across paths and path switching.
Devices Managed by HDLM
□
System Configuration
□
LU Configuration
□
Program Configuration
□
Position of the HDLM Driver and HDLM Device
□
Logical Device Files for HDLM Devices
□
Distributing a Load Using Load Balancing
□
Performing Failovers and Failbacks Using Path Switching
□
Intermittent Error Monitoring (Functionality When Automatic Failback Is
□
Used)
Detecting Errors by Using Path Health Checking
□
Distributing a Load by Using the Dynamic I/O Path Control Function
□
Error Management
□
HDLM Functions
Hitachi Dynamic Link Manager (for Solaris) User Guide
2-1
Collecting Audit Log Data
□
Integrated HDLM management using Global Link Manager
□
Cluster Support
□
2-2
HDLM Functions
Hitachi Dynamic Link Manager (for Solaris) User Guide
Devices Managed by HDLM
Below is a list of devices that can or cannot be managed by HDLM. The
devices that can be managed by HDLM are called HDLM management-target
devices.
HDLM management-target devices:
The following devices are from the storage systems listed in Section What
is HDLM? on page 1-2:
¢
SCSI devices (sd or ssd devices)
¢
Boot disks
¢
Swap devices
¢
Dump devices
#:
If you want to use these disks as HDLM management-target devices,
assign VTOC labels to them. EFI labels are not supported.
Non-HDLM management-target devices:
¢
SCSI devices (sd or ssd devices) other than those of the storage
systems listed in Section What is HDLM? on page 1-2
¢
Built-in disks in a host
¢
Devices other than disks (tape devices, etc.)
¢
Command devices of the storage systems listed in Section
HDLM? on page 1-2 (For example, Hitachi RAID Manager command
devices.)
#
#
#
What is
System Configuration
HDLM manages routes between a host and a storage system by using the
SCSI driver (sd or ssd driver). The host and storage systems are connected
using SAN with fiber cables or SCSI cables. The cable port on the host is a
host bus adapter (HBA). The cable port on the storage system is a port (P) on
a channel adapter (CHA).
A logical unit (LU) contained in a storage system is the target of input to, or
output from, the host. You can divide an LU into multiple areas. Each area
after the division is called a Dev. The Dev is equivalent to a slice or partition.
A route that connects a host and an LU is called a physical path, and a route
that connects a host and a Dev is called a path. When an LU has been divided
into multiple Devs, the number of paths set to the LU is equal to the number
that is found by multiplying the number of physical paths by the number of
Devs in the LU.
HDLM assigns an ID to each physical path and manages paths on a physicalpath basis. Because you do not need to be aware of the difference between
physical paths and paths to operate HDLM, the following descriptions might
simply refer to paths, without distinguishing between physical paths and
HDLM Functions
Hitachi Dynamic Link Manager (for Solaris) User Guide
2-3
paths. The ID that HDLM assigns to each path (physical path) is called a
AutoPATH_ID. A path is also sometimes called a managed object.
The following figure shows the HDLM system configuration.
Figure 2-1 HDLM System Configuration
The following table lists and describes the HDLM system components.
Table 2-1 HDLM System Components
Components Description
HBA A host bus adapter. This serves as a cable port on the host.
SAN A dedicated network that is used for data transfer between the
host and storage systems
CHA A channel adapter
P A port on a CHA. This serves as a cable port on a storage
system.
LU A logical unit (a logical volume defined on the storage system).
This serves as the target of input or output operations from the
host.
Dev An area (slice or partition) that is created when an LU is divided
Physical path A route that connects a host and an LU
Path A route that connects a host and a Dev
2-4
HDLM Functions
Hitachi Dynamic Link Manager (for Solaris) User Guide
LU Configuration
After you have properly installed HDLM, the LU configuration will change as
follows:
Before the installation of HDLM:
The host recognizes that an sd or ssd device is connected to each physical
path.
Thus, a single LU in the storage system is recognized as the same
number of LUs as that of physical paths.
After the installation of HDLM:
An HDLM device that corresponds one-to-one with the Dev in an LU in the
storage system is created above an sd or ssd device.
Thus, from the host, LUs in the storage system are also recognized as one
LU regardless the number of physical paths.
After the installation of HDLM, an LU recognized by a host is called a host LU
(HLU). The areas in a host LU that correspond to the Devs (slice or partition)
in a storage system LU are called host devices (HDev).
On a system using HDLM, the logical device file for the HDLM device is used
to access the target LU instead of the logical device file for the sd or ssd
device.
The logical device files for sd or ssd are deleted by HDLM.
The following figure shows the LU configuration recognized by the host, after
the installation of HDLM.
HDLM Functions
Hitachi Dynamic Link Manager (for Solaris) User Guide
2-5
Figure 2-2 LU Configuration Recognized by the Host After the Installation
The following table lists and describes the components recognized by the
host.
Table 2-2 Components Recognized by the Host
Components Description
HLU An LU that the host recognizes via the HDLM driver. It is
HDev A Dev (a slice or partition) in an LU that the host
Program Configuration
HDLM is actually a combination of several programs. Because each program
corresponds to a specific HDLM operation, it is important to understand the
name and purpose of each program, along with how they are all interrelated.
of HDLM
called a host LU. No matter how many physical paths
exist, one host LU is recognized for one LU in the storage
system.
recognizes via the HDLM driver. It is called a host device.
No matter how many physical paths exist, one host
device is recognized for one Dev in the storage system.
2-6
The following figure shows the configuration of the HDLM programs.
HDLM Functions
Hitachi Dynamic Link Manager (for Solaris) User Guide
Figure 2-3 Configuration of the HDLM Programs
The following table lists and describes the functions of these programs.
Table 2-3 Function of HDLM Programs
Program name Functions
HDLM command Provides the dlnkmgr command, which enables you to:
• Manage paths
• Display error information
• Set up the HDLM operating environment
HDLM utility Provides the HDLM utility, which enables you to:
• Collect error information
• Add a new LU and delete an existing LU
(reconfiguring an HDLM device dynamically)
• Create an HDLM driver configuration definition file (/
kernel/drv/dlmfdrv.conf)
• Create a correspondence table of logical device files
when migrating to HDLM 6.5.1
• Support the creation of a VxVM configuration file
• The unattended installation of HDLM
• Install Hitachi Command Suite Common Agent
Component
HDLM manager Provides the HDLM manager, which enables you to:
• Configure the HDLM operating environment
HDLM Functions
Hitachi Dynamic Link Manager (for Solaris) User Guide
2-7
Program name Functions
• Request path health checks and automatic failbacks
to be performed
• Collect error log data
HDLM alert driver Reports the log information collected by the HDLM driver
to the HDLM manager. The driver name is dlmadrv.
HDLM driver Controls all the HDLM functions, manages paths, and
detects errors. The HDLM driver consists of the following:
• Core logic component
Controls the basic functionality of HDLM.
• Filter component
Sends and receives I/O data. The driver name is
dlmfdrv.
• HDLM nexus driver
Performs operations such as reserving controller
numbers for logical device files of the HDLM device,
and managing HDLM driver instances for each HBA
port. The driver name is dlmndrv.
Position of the HDLM Driver and HDLM Device
The HDLM driver is positioned above the SCSI driver. Each application on the
host uses the HDLM device (logical device file) created by HDLM, to access
LUs in the storage system. The following figure shows the positions of the
HDLM driver and HDLM devices.
2-8
HDLM Functions
Hitachi Dynamic Link Manager (for Solaris) User Guide
Loading...