EMC believes the information in this publication is accurate as of its publication date. The information is
subject to change without notice.
THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS IS.” EMC CORPORATION MAKES NO
REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS
PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR
FITNESS FOR A PARTICULAR PURPOSE.
Use, copying, and distribution of any EMC software described in this publication requires an applicable
software license.
For the most up-to-date listing of EMC product names, see EMC Corporation Trademarks on EMC.com. For
the most up-to-date regulatory document for your product line, go to the EMC Powerlink website.
All other trademarks used herein are the property of their respective owners.
2
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
2Slot requirements of EMC-supported QLogic adapters ............................32
3QLogic BIOS settings for Fibre Channel HBAs ..........................................40
4Supported FC and FCoE in kernel driver versions ....................................49
5Supported FC and FCoE out of kernel driver versions .............................59
6QLogic v7.x series driver parameters ...........................................................79
7Supported iSCSI in kernel driver versions ..................................................89
8Supported iSCSI out of kernel driver versions ...........................................95
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
9
Tab les
10
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
Preface
As part of an effort to improve and enhance the performance and capabilities
of its product line, EMC from time to time releases revisions of its hardware
and software. Therefore, some functions described in this document may not
be supported by all revisions of the software or hardware currently in use.
For the most up-to-date information on product features, refer to your
product release notes.
If a product does not function properly or does not function as described in
this document, please contact your EMC representative.
This guide describes the features and setup procedures for Linux
hosts with QLogic host bus adapters (HBAs) and converged network
adapters (CNAs) to EMC Symmetrix, EMC VNX series, and EMC
CLARiiON storage systems.
AudienceThis guide is intended for use by storage administrators, system
programmers, or operators who are involved in acquiring, managing,
or operating Symmetrix, VNX series, or CLARiiON, and host devices.
Readers of this guide are expected to be familiar with the following
topics:
◆Symmetrix, VNX series, and CLARiiON system operation
◆Linux operating environment
◆QLogic adapters and drivers
EMC Support MatrixFor the most up-to-date information, always consult the EMC Support
Matrix(ESM), available through E-Lab Interoperability Navigator
(ELN) at: http://elabnavigator.EMC.com, under the PDFs and Guides tab.
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
11
Preface
IMPORTANT
!
CAUTION
!
Related
documentation
Conventions used in
this document
The following related documents are available on Powerlink:
◆EMC Host Connectivity Guide for Linux
◆EMC Linux iSCSI Attach Release Notes
◆The EMC Networked Storage Topology Guide has been divided into
several TechBooks and reference manuals. These are available
through the E-Lab Interoperability Navigator, Topology Resource Center tab, at http://elabnavigator.EMC.com.
◆For information on Unisphsere and Navisphere, refer to the
documentation on EMC Powerlink at
http://Powerlink.EMC.com.
EMC uses the following conventions for special notices.
Note: A note presents information that is important, but not hazard-related.
An important notice contains information essential to operation of
the software.
A caution contains information essential to avoid data loss or
damage to the system or equipment.
Typographical conventions
EMC uses the following type style conventions in this document:
NormalUsed in running (nonprocedural) text for:
•Names of interface elements (such as names of windows,
dialog boxes, buttons, fields, and menus)
•Names of commands, daemons, options, programs,
processes, services, applications, utilities, kernels,
notifications, system call, man pages
12
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
Italic:
Courier
Courier bold
Courier italic
< >
[ ]
|
{ }
...
Preface
Used in procedures for:
•Names of interface elements (such as names of windows,
dialog boxes, buttons, fields, and menus)
•What user specifically selects, clicks, presses, or types
Used in all text (including procedures) for:
•Full titles of publications referenced in text
•Emphasis (for example a new term)
•Variables
Used for:
•System output, such as an error message or script
•URLs, complete paths, filenames, prompts, and syntax when
shown outside of running text
Used for:
•Specific user input (such as commands)
Used in procedures for:
•Variables on command line
•User input variables
Angle brackets enclose parameter or variable values supplied by
the user
Square brackets enclose optional values
Vertical bar indicates alternate selections - the bar means “or”
Braces indicate content that you must specify (that is, x or y or z)
Ellipses indicate nonessential information omitted from the
example
Where to get helpEMC support, product, and licensing information can be obtained as
follows.
Product information — For documentation, release notes, software
updates, or for information about EMC products, licensing, and
service, go to the EMC Powerlink website (registration required) at:
http://Powerlink.EMC.com
Technical support — For technical support, go to EMC Customer
Service on Powerlink. To open a service request through Powerlink,
you must have a valid support agreement. Please contact your EMC
sales representative for details about obtaining a valid support
agreement or to answer any questions about your account.
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
13
Preface
Your commentsYour suggestions will help us continue to improve the accuracy,
organization, and overall quality of the user publications. Please send
your opinion of this document to:
techpub_comments@EMC.com
14
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
Invisible Body Tag
1
Introduction
This document describes the procedures for installing an
EMC-approved QLogic host bus adapter (HBA) or converged
network adapter (CNA) into a Linux host environment and
configuring the host for connection to an EMC storage array over
Fibre Channel, Fibre Channel over Ethernet (FCoE), or iSCSI.
◆ Purpose of this document................................................................. 16
This document is meant to assist in the installation and configuration
of QLogic Fibre Channel host bus adapters (HBAs) and Fibre
Channel Over Ethernet (FCoE) converged network adapters (CNAs),
and iSCSI HBAs in Linux environments. The focus of this document
is to enable the integrated QLogic driver in the Linux distributions
for EMC
®
-supported QLogic adapters or Fibre Channel adapters or
to set up Linux hosts using the EMC-supported driver for QLogic
adapters, available from the EMC-approved section of the QLogic
website.
Review the EMC Support Matrixor contact your EMC representative
for the latest information on qualified adapters, drivers, and Linux
distributions.
Note: EMC does not support mixing different types of Fibre Channel adapter
(including different types from the same vendor) in a server.
Fibre Channel
Fibre Channel over Ethernet
16
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
The Fibre Channel adapter driver functions as a device driver layer
below the standard Linux SCSI adapter driver. The Fibre Channel
interface therefore is transparent to the Linux disk administration
system.
EMC supports the QLogic Fibre Channel over Ethernet (FCoE)
Converged Network Adapter (CNA). FCoE adapters provide a
method to converge both Fibre Channel and Ethernet traffic over a
single physical link to a switch infrastructure which manages both
storage (SAN) and network (IP) connectivity within a single unit.
The benefits of FCoE technology become apparent in large data
centers:
◆Where dense, rack-mounted and blade server chassis exist.
◆Where physical cable topology simplification is a priority.
iSCSI
Introduction
◆In virtualization environments, where several physical storage
and network links are commonly required.
The installation of the QLogic FCoE CNA provides the host with an
Intel-based 10 gigabit Ethernet interface (using the existing in-box
drivers), and an QLogic Fibre Channel adapter interface, which
requires the installation of the supported driver revision.
Following installation of the proper driver for the FCoE CNA, the
Fibre Channel interface will function identically to that of a standard
QLogic Fibre Channel HBA, as the FCoE simply encapsulates Fibre
Channel traffic within ethernet frames. As such, FC-based content
within this document also applies directly to the QLogic FCoE CNAs.
In-depth information about FCoE and its supported features and
topologies can be found in the Fibre Channel over Ethernet (FCoE) TechBook available through the E-Lab Interoperability Navigator,
Topology Resource Center tab, at http://elabnavigator.EMC.com.
The iSCSI HBA provides PCI connectivity to SCSI using the iSCSI
protocol. iSCSI enables the use of IP-based SANs, which are similar to
Fibre Channel SANs. The QLA40xx-Series HBA implements the
TCP/IP and iSCSI protocols on the HBA and offloads the host of any
I/O protocol processing. This type of adapter is also referred to by
QLogic as an iSCSI Offload Engine (iSOE). Offloading the host frees
the system to perform other tasks and optimizes system performance.
The QLogic iSCSI HBA driver functions as a device driver layer
below the standard Linux SCSI adapter driver. The iSCSI interface,
therefore, is transparent to the Linux disk administration system.
Host connectivity
17
Introduction
Boot device support
Linux hosts using QLogic adapters have been qualified for booting
from EMC storage array devices interfaced through Fibre Channel
and iSCSI as specified in the EMC Support Matrix.
The EMC Symmetrix
®
, EMC VNX™ series, or EMC CLARiiON®
device that is to contain the Master Boot Record (MBR) for the host
must have a lower logical unit number (LUN) than any other device
visible to the host. This device should be mapped as /dev/sda by the
Linux operating system for the boot to succeed from the device.
Refer to Chapter 7, ”Configuring a Boot Device on an EMC Storage
Array,” for further information on booting from the SAN.troduction
18
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
Zoning
FC and FCoE
Introduction
This section contains general configuration guidelines when
connecting a Linux server via Fibre Channel or iSCSI to an EMC
storage array.
Note: Multi-initiator zones are not recommended in a Linux fabric
environment.
When using Linux hosts in a fabric environment, the zoning must be
set up as single initiator and single target zoning. A single
initiator/single target zone is composed of one adapter and one EMC
storage array port. Storage array ports can be shared among adapters;
however, each adapter must be in its own zone.
Note: Multi-initiator zones are not recommended in a Linux fabric
environment.
iSCSI
Follow the guidelines outlined by EMC. Be aware that using
improper settings may cause erratic behavior. In particular, note the
following:
◆Each QLogic iSCSI HBA in a Linux server must be on a separate
subnet.
◆A single host can not mix HBAs and NICs to connect to the same
array or different arrays.
◆A single host may not attach to an EMC Fibre Channel Array and
an EMC iSCSI Array simultaneously.
◆QLogic SANsurfer or iscli are required to be installed in order to
configure iSCSI HBAs to connect to iSCSI targets
Zoning
19
Introduction
k
SPA 0 SPA 1 SPB 0 SPB 1
y
k
Figure 1 provides a zoning example.
Linux Server
HBA or NIC
sub-networ
HBA or NIC
sub-networ
Arra
Figure 1Zoning example
EMC storage array-specific settings
Refer to the EMC Host Connectivity Guide for Linux, available at
http://Powerlink.EMC.com, for EMC storage array-specific settings.
20
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
Invisible Body Tag
2
Installation Steps
This chapter outlines the prerequisisites for first-time installation,
offers a summary of the installation steps with links to the
appropriate sections, and provides information on installing the
adapter.
Review the EMC Support Matrix for the latest information on
approved adapters and drivers.
◆ Prerequisites for first-time installation ........................................... 22
◆ Summary of installation steps.......................................................... 24
◆ Installing the adapter......................................................................... 27
Installation Steps
21
Installation Steps
IMPORTANT
!
Prerequisites for first-time installation
In order to complete a first-time installation of the QLogic adpater in
your server, you will need the following:
◆“Operating system” on page 22
◆“QLogic SANSurfer and SANSurfer CLI” on page 22
◆“BIOS and firmware” on page 22
◆“Linux driver” on page 23
Operating systemBefore the adapter is installed, the Linux operating system must be
installed and properly configured. Install the Linux kernel from the
distribution installation CD by following the procedure provided in
the distribution installation guide. Partition the boot drive, and select
the packages and services necessary for the host.
Include the kernel source/development package and the gcc
compiler tools during the installation. If these tools are not
installed, then the out-of-kernel driver installation may fail and the
driver will not be installed.
QLogic SANSurfer and
SANSurfer CLI
QLogic's SANsurfer program is a GUI-based utility and the
SANsurfer CLI is a text-based utility. Both applications may be
installed on any Linux system and used to manage, configure, and
update the EMC-approved QLogic adapters.
Complete documentation and the EMC-qualified versions of
SANsurfer and the SANsurfer CLI are available for download from
the EMC-approved section of the QLogic website at
http://www.qlogic.com.
Follow the Downloads > EMC links to your adapter for the
appropriate version.
BIOS and firmwareThe version of BIOS and firmware (adapter firmware for your iSCSI
HBA, and CEE/Menlo firmware for your CNA) per the EMC Support
Matrix for your supported configuration.
These are available for download from the EMC-approved section of
the QLogic website
22
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
at http://www.qlogic.com.
Installation Steps
Follow the Downloads > EMC links to your adapter for the
appropriate version.
Linux driverThe Linux driver for your HBA or CNA per theEMC Support Matrix
for your supported configuration.
EMC supports both in-kernel and out-of-kernel drivers.
Note: The installation of the in-kernel driver occurs when you install your
Linux distribution of choice.
Refer to the latest EMC Support Matrix for your specific Linux
distribution, kernel version, and driver to determine whether or not
you need to proceed with the following out-of-kernel instructions.
If your installation requires an out of kernel driver, download it from
the EMC-approved section of the QLogic website
at
http://www.qlogic.com.
Follow the Downloads > EMC links to your adapter for the
appropriate version.
Prerequisites for first-time installation
23
Installation Steps
Summary of installation steps
Ta bl e 1describes the procedures for installing an EMC-approved
QLogic adapters into a Linux host and configuring the host for
connection to an EMC Storage Array over Fibre Channel (FC) or Fibre
Channel over Ethernet (FCoE).
Tab le 1Installation steps (page 1 of 3)
StepInstructionsFor Fibre Channel, refer toFor Fibre Channel over
1Install the
adapter .
2Verify the
BIOS version
3Install the BIOS.
There are three states:
•If no
version is
installed
•If wrong
version is
installed
•If correct
version is
installed
“Installing the adapter” on
page 27
“Verifying the correct BIOS
version” on page 36
“Upgrading the adapter BIOS”
on page 37
“Upgrading the adapter BIOS”
on page 37
Proceed to step 4.Proceed to step 4.Proceed to step 4.
Ethernet (FCoE), refer to
“Installing the adapter” on
page 27
“Verifying the correct BIOS
version” on page 36
“Upgrading the adapter BIOS”
on page 37
“Upgrading the adapter BIOS”
on page 37
For iSCSI, refer to
“Installing the adapter” on
page 27
“Verifying the correct BIOS
version” on page 36
“Upgrading the adapter BIOS” on
page 37
“Upgrading the adapter BIOS” on
page 37
24
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
Tab le 1Installation steps (page 2 of 3)
Installation Steps
StepInstructionsFor Fibre Channel, refer toFor Fibre Channel over
Ethernet (FCoE), refer to
4Install the driver.
There are two states:
•In kernelFor drivers listed in the
Support Matrix
drivers, there is no need to install
a driver since the process of
installing the operating system
has already included the driver.
Table 4 on page 49 lists
supported QLogic driver
versions .
If in kernel, proceed to Step 5.
•Out of
kernel
“Installation instructions for the
out of kernel QLogic driver” on
page 61
EMC
as in kernel
For drivers listed in the
Support Matrix
as in kernel
drivers, there is no need to install
a driver since the process of
installing the operating system
has already included the driver.
Table 4 on page 49 lists
supported QLogic driver
versions .
If in kernel, proceed to Step 5.
“Method 2: Installing the QLogic
v7.xx.xx/v8.xx.xx driver via the
QLogic installation script” on
page 65.
EMC
For iSCSI, refer to
For drivers listed in the EMC
Support Matrix as in kernel
drivers, there is no need to install
a driver since the process of
installing the operating system
has already included the
driver.
Table 7 on page 89 lists
supported QLogic driver
versions.
If in kernel, perform the steps
outlined in “Installation
instructions for the in kernel
QLogic driver in Linux 2.6.x
kernels” on page 91 to disable
the qla3xxx driver then proceed
to Step 5.
Proceed to either “Installation
instructions for the out of kernel
QLogic driver” on page 96
Summary of installation steps
25
Installation Steps
Tab le 1Installation steps (page 3 of 3)
StepInstructionsFor Fibre Channel, refer toFor Fibre Channel over
Ethernet (FCoE), refer to
5Install the firmware.
There are two states:
•Wrong
firmware
The adapter firmware is part of
the Linux driver and cannot be
altered..
Proceed to Step 6.
The adapter firmware is part of
the Linux driver and cannot be
altered.
“Updating the QLogic CEE
/Menlo firmware for FCoE
adapters” on page 130
Once corrected, proceed to Step
6.
•Correct
Proceed to Step 6.Proceed to Step 6.Once corrected, proceed to Step
firmware
6Connect to the
storage.
7Reconfigure
the device.
“Zoning and connection planning
in a Fibre Channel or Fibre
Channel over Ethernet
environment” on page 134
“Device reconfiguration
procedures for FC and FCoE” on
page 195
“Zoning and connection planning
in a Fibre Channel or Fibre
Channel over Ethernet
environment” on page 134
“Device reconfiguration
procedures for FC and FCoE” on
page 195
For iSCSI, refer to
“Updating the QLogic firmware
for iSCSI adapters” on page 131
Once corrected, proceed to Step
6.
6.
“Zoning and connection planning
in an iSCSI environment” on
page 135
Proceed to either “Device
reconfiguration procedures for
the iSCSI 3.x driver” on page 196
or “Device reconfiguration
procedures for the iSCSI 5.x
driver” on page 198
26
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
Installing the adapter
2
1
3
2
1
3
Follow the instructions included with your adapter. The adapter
installs into a single slot.
To connect the cable to the adapter:
1. (Optical cable only) Remove the protective covers on each
2. Plug one end of the cable into the connector on the adapter as
Installation Steps
fiber-optic cable.
shown in the appropriate figure in this step. (The hardware might
be rotated 90 degrees clockwise from the orientation shown.)
• Fibre Channel adapter connectivity options include copper
cable with DB9 connector, SC optical, and LC optical cable, as
shown next.
– Copper cable with DB9 connector:
– SC optical cable:
– LC optical cable:
Installing the adapter
27
Installation Steps
2
1
3
• Fibre Channel over Ethernet converged network adapter
(CNA) connectivity options include LC optical and Cisco
SFP+, shown next.
– LC optical cable:
– Cisco SFP+ (Twinax cable)
3. Plug the other end of the cable into a connector on the storage
system or a hub/switch port.
4. Label each cable to identify the adapter and the
storage/switch/hub port to which it connects.
5. After connecting all adapters in the server, power up the server.
Matching the adapter with the correct PCI slot
When choosing an adapter for your server, it is important to know
which adapter is compatible with your server's PCI/PCI-X/PCI
Express slots. Certain adapter models have specific voltage
requirements or physical limitations that allow them to work only in
28
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
specific slots.
Installation Steps
Servers have several different bus slot types for accepting adapters:
◆PCI
◆PCI-X
◆PCI-X 2.0
◆PCI-Express
PCI slots can be 32-bit and 64-bit (denoted by their 124-pin or 188-pin
connectors.) These slots have plastic "keys" that prevent certain
adapters from fitting into them. These keys work with the cutout
notches in the adapter edge connector so that only compatible
adapters will fit into them. This is done because of the voltage
characteristics of the adapter. Inserting a 3.3v adapter into a 5v slot
would cause severe damage to both the adapter and the server.
Therefore, the slot keys denote the type of voltage provided by the
slot and effectively prevent a voltage incompatible adapter from
being inserted.
Figure 2 shows how PCI slots will appear with their keys and what
type of voltage is provided for each slot type.
Figure 2PCI slot types and voltage key locations
Installing the adapter
29
Installation Steps
Figure 3 shows the adapter edge connectors compatible with the PCI
slots shown in Figure 2 on page 29. Note adapter 5, which shows a
universal adapter edge connector. Universal adapters are compatible
with both 3.3 V and 5 V PCI slots.
Figure 3Adapter edge connectors
30
PCI-X(or PCI Extended) slots increase the speed with which data
travels over the bus. PCI-X slots appear identical to a 64-bit PCI slot
keyed for 3.3 V. (Refer to number 3 in Figure 2 on page 29 and
Figure 3.) PCI-X slots are backwards compatible with 3.3 V PCI
adapters and universal adapters. Inserting standard PCI adapters
into PCI-X slots will lower the bus speed as they cannot take
advantage of the improved performance.
PCI-X 2.0 is the next generation of PCI-X buses. PCI-X 2.0 increases
the bus speed again, providing more performance for adapters.
PCI-X 2.0 slots also appear identical to a 64-bit PCI slot keyed for 3.3
V. (Refer to number 3 in Figure 2 and Figure 3.) PCI-X 2.0 is also fully
backward compatible with 3.3 V PCI and PCI-X.
PCI Express (sometimes noted as PCIe) is a new bus type that uses
the existing PCI model, but implements it in a faster, serial protocol.
Because of the serial way it transmits data, the PCI Express bus slot
can be different sizes depending on the throughput it supports. PCI
Express slot speeds are expressed in "lanes" and are normally shown
as x1, x4, x8, and x16. Each type of slot is a different length (as shown
in Figure 4 on page 31) and adapter edge connectors will also be of
varying lengths depending on how many lanes they require for
EMC Host Connectivity with QLogic FC and iSCSI HBAs and FCoE CNAs for the Linux Environment
Loading...
+ 186 hidden pages
You need points to download manuals.
1 point = 1 manual.
You can buy points or you can get point for every manual you upload.