Qlogic FastLinQ 3400 Series, FastLinQ 8400 Series User Manual

User’s Guide
Converged Network Adapters and Intelligent
Ethernet Adapters
QLogic FastLinQ 3400, 8400 Series
83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
Document Revision History
Revision A, October 20, 2014 Revision B, November 14, 2014 Revision C, April 3, 2015 Revision D, September 16, 2015 Revision E, May 10, 2016
Changes Sections Affected
Updated to replace the QLogic Control Suite GUI
Throughout
with the QConvergeConsole GUI. In the Note, removed Separate licenses are
“Functional Description” on page 1
required for all offloading technologies. Added a QConvergeConsole Plug-ins fo r vSphere
“Features” on page 2
to the list of manageability features. Added the Adapter Management section. “Adapter Management” on page 6 In step 1, removed the reference to the table of
“Connecting the Network Cables” on page 11
10GbE optics. Added the Manually Extracting the Device Drivers
section. In the KMP Packages bullet, added a reference to
“Manually Extracting the Device Drivers” on page 20
“Packaging” on page 26
the QLogic Control Suite CLI User’s Guide. Removed the chapters Installing Management
Applications, Using QLogic Control Suite, and Manageability.
Updated the first sentence to read, The optional
“enable_vxlan_offld” on p age 54
parameter enable_vxlan_ofld can be used to enable or disable . . .
In the Note in step 5, added the option of configur­ing iSCSI boot parameters with UEFI HII BIOS pages.
Added a procedure to inject adapter drivers into the Windows image files.
In the fourth question, replaced configurations with IP addresses.
“MBA Boot Protocol Configuration” on page 71
“Injecting (Slipstreaming) Adapter Drivers into Win­dows Image Files” on page 91
“Event Log Messages” on page 105
ii 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters
QLogic FastLinQ 3400, 8400 Series
Removed NX2 from the heading. “Bind iSCSI Target to QLogic iSCSI Transport
Name” on page 111
At the end of the first paragraph, added and the
other PFs on that port can support SR-IOV VF connections..
Updated all instances of Advanced Server Pro­gram and ASP to QLogic Advanced Server Pro­gram and QLASP, respectively.
Added a paragraph at the end of the section describing two traffic classes that can be used by the Windows QoS service.
Removed the table describing the QLogic Teaming Software Component.
In Table 15-4, updated the subheads to read Generic (Static) Trunking and Dynamic LACP.
In the first bullet, added with Auto-Fallback Enabled (SLB).
In the second paragraph, last sentence, updated bnx2 to read bnx2/bnx2x.
Removed sections Running a Cable Length Test and Testing Network Connectivity.
“SR-IOV and Storage” on page 161
Throughout
“Data Center Bridging in Windows Server 2012” on page 172
“Software Components” on page 183
“Teaming Mechanisms” on page 188
“QLASP Overview” on page 233 “Types of Teams” on page 234
“Linux” on page 251
Chapter 18, Troubleshooting
iii 83840-546-00 E
User’s Guide Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
iv 83840-546-00 E

Table of Contents

Preface
Intended Audience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxi
What Is in This Guide. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxi
Related Materials . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxii
Documentation Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxiii
License Agreements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxiv
Technical Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxv
Downloading Updates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxv
Training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxvi
Contact Information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxvi
Knowledge Database . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxvi
Legal Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxvii
Warranty . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxvii
Laser Safety . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxvii
FDA Notice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxvii
Agency Certification. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxvii
EMI and EMC Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . xxvii
Product Safety Compliance . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxviii
1 Product Overview
Functional Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
iSCSI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
FCoE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Power Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Adaptive Interrupt Frequency . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
ASIC with Embedded RISC Processor . . . . . . . . . . . . . . . . . . . . . . . . 5
Adapter Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
QLogic Control Suite CLI. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
QLogic QConvergeConsole Graphical User Interface. . . . . . . . . . . . . 6
QLogic QConvergeConsole vCenter Plug-In. . . . . . . . . . . . . . . . . . . . 6
QLogic FastLinQ ESXCLI VMware Plug-In. . . . . . . . . . . . . . . . . . . . . 6
Supported Operating Environments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
v 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
Adapter Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Physical Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Standards Specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2 Installing the Hardware
System Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Hardware Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Operating System Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Safety Precautions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Preinstallation Checklist. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Installation of the Network Adapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
Connecting the Network Cables. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
3 Multi-boot Agent (MBA) Driver Software
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
Setting Up MBA in a Client Environment . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
Enabling the MBA Driver. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
Configuring the MBA Driver. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
Setting Up the BIOS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Setting Up MBA in a Server Environment . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Red Hat Linux PXE Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
MS-DOS UNDI/Intel APITEST. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
4 Windows Driver Software
Installing the Driver Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
Using the Installer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
Using Silent Installation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
Manually Extracting the Device Drivers . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
Removing the Device Drivers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
Installing QLogic Management Applications . . . . . . . . . . . . . . . . . . . . . . . . 21
Viewing or Changing the Adapter Properties. . . . . . . . . . . . . . . . . . . . . . . . 21
Setting Power Management Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
5 Linux Driver Software
Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
bnx2x Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
bnx2i Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
bnx2fc Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
Packaging. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
Installing Linux Driver Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
vi 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
Installing the Source RPM Package . . . . . . . . . . . . . . . . . . . . . . . . . . 28
Installing the KMP Package. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Building the Driver from the Source TAR File . . . . . . . . . . . . . . . . . . . 31
Load and Run Necessary iSCSI Software Components . . . . . . . . . . . . . . . 32
Unloading/Removing the Linux Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Unloading/Removing the Driver from an RPM Installation . . . . . . . . . 33
Removing the Driver from a TAR Installation . . . . . . . . . . . . . . . . . . . 33
Uninstalling the QCC GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Patching PCI Files (Optional). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Network Installations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Setting Values for Optional Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
bnx2x Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
disable_tpa . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
int_mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
dropless_fc. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
disable_iscsi_ooo . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
multi_mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
num_queues. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
pri_map. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
qs_per_cos. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
cos_min_rate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
bnx2i Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
error_mask1 and error_mask2. . . . . . . . . . . . . . . . . . . . . . . . . . 38
en_tcp_dack. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
time_stamps . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
sq_size . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
rq_size . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
event_coal_div . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
last_active_tcp_port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
ooo_enable. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
bnx2fc Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
debug_logging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
Driver Defaults . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
bnx2 Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
bnx2x Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Driver Messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
vii 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
bnx2x Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Driver Sign On . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
CNIC Driver Sign On (bnx2 only) . . . . . . . . . . . . . . . . . . . . . . . . 42
NIC Detected . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Link Up and Speed Indication. . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Link Down Indication . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
MSI-X Enabled Successfully . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
bnx2i Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
BNX2I Driver Signon . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Network Port to iSCSI Transport Name Binding. . . . . . . . . . . . . 43
Driver Completes handshake with iSCSI Offload-enabled
CNIC Device. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Driver Detects iSCSI Offload Is Not Enabled on the CNIC Device 43 Exceeds Maximum Allowed iSCSI Connection Offload Limit. . . 43 Network Route to Target Node and Transport Name Binding
Are Two Different Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Target Cannot Be Reached on Any of the CNIC Devices. . . . . . 43
Network Route Is Assigned to Network Interface, Which Is Down 43
SCSI-ML Initiated Host Reset (Session Recovery) . . . . . . . . . . 43
CNIC Detects iSCSI Protocol Violation - Fatal Errors. . . . . . . . . 44
CNIC Detects iSCSI Protocol Violation - Non-FATAL, Warning . 45
Driver Puts a Session Through Recovery. . . . . . . . . . . . . . . . . . 45
Reject iSCSI PDU Received from the Target . . . . . . . . . . . . . . . 45
Open-iSCSI Daemon Handing Over Session to Driver . . . . . . . 45
bnx2fc Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
BNX2FC Driver Signon: . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
Driver Compiles Handshake with FCoE Offload Enabled
CNIC Device. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
Driver Fails Handshake with FCoE Offload Enabled CNIC Device 45
No Valid License to Start FCoE . . . . . . . . . . . . . . . . . . . . . . . . . 46
Session Failures Due to Exceeding Maximum Allowed FCoE
Offload Connection Limit or Memory Limits . . . . . . . . . . . . . . . 46
Session Offload Failures. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
Session Upload Failures. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
Unable to Issue ABTS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
Unable to Recover the IO Using ABTS (Due to ABTS Timeout) 46
Unable to Issue IO Request Due to Session Not Ready . . . . . . 46
Drop Incorrect L2 Receive Frames. . . . . . . . . . . . . . . . . . . . . . . 46
HBA/lport Allocation Failures . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
NPIV Port Creation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
viii 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
Teaming with Channel Bonding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
Statistics. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
6 VMware Driver Software
Packaging. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
Download, Install, and Update Drivers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
Networking Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Driver Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
int_mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
disable_tpa . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
num_rx_queues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
num_tx_queues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
pri_map. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
qs_per_cos. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
cos_min_rate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
dropless_fc. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
RSS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
max_vfs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
enable_vxlan_offld . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
Driver Defaults. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
Unloading and Removing Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Driver Messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Driver Sign On . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
NIC Detected . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
MSI-X Enabled Successfully . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Link Up and Speed Indication. . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Link Down Indication . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Memory Limitation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
MultiQueue/NetQueue . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
FCoE Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Enabling FCoE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Installation Check . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
Drivers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
Supported Distributions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
7 Firmware Upgrade
Upgrading Firmware for Windows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
Upgrading Firmware for Linux . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
ix 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
8 iSCSI Protocol
iSCSI Boot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Supported Operating Systems for iSCSI Boot. . . . . . . . . . . . . . . . . . . 68
iSCSI Boot Setup. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
Configuring the iSCSI Target . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
Configuring iSCSI Boot Parameters. . . . . . . . . . . . . . . . . . . . . . 69
MBA Boot Protocol Configuration. . . . . . . . . . . . . . . . . . . . . . . . 71
iSCSI Boot Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
Enabling CHAP Authentication. . . . . . . . . . . . . . . . . . . . . . . . . . 79
Configuring the DHCP Server to Support iSCSI Boot . . . . . . . . 79
DHCP iSCSI Boot Configurations for IPv4. . . . . . . . . . . . . . . . . 79
DHCP iSCSI Boot Configuration for IPv6. . . . . . . . . . . . . . . . . . 81
Configuring the DHCP Server . . . . . . . . . . . . . . . . . . . . . . . . . . 82
Preparing the iSCSI Boot Image. . . . . . . . . . . . . . . . . . . . . . . . . 83
Booting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92
Configuring VLANs for iSCSI Boot . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
Other iSCSI Boot Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
Changing the Speed and Duplex Settings in
Windows Environments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
Virtual LANs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95
The 'dd' Method of Creating an iSCSI Boot Image. . . . . . . . . . . 95
Troubleshooting iSCSI Boot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96
iSCSI Crash Dump. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
iSCSI Offload in Windows Server. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
iSCSI Offload Limitations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
Configuring iSCSI Offload . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98
Installing QLogic Drivers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99
Installing the Microsoft iSCSI Initiator. . . . . . . . . . . . . . . . . . . . . 99
Configure Microsoft Initiator to Use QLogic’s iSCSI Offload. . . . 99
iSCSI Offload FAQs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105
Event Log Messages. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105
iSCSI Offload in Linux Server. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110
Open iSCSI User Applications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110
User Application - qlgc_iscsiuio. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111
Bind iSCSI Target to QLogic iSCSI Transport Name. . . . . . . . . . . . . . 111
VLAN Configuration for iSCSI Offload (Linux). . . . . . . . . . . . . . . . . . . 112
Modifying the iSCSI iface File. . . . . . . . . . . . . . . . . . . . . . . . . . . 112
Setting the VLAN ID on the Ethernet Interface. . . . . . . . . . . . . . 112
x 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
Making Connections to iSCSI Targets. . . . . . . . . . . . . . . . . . . . . . . . . 113
Add Static Entry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
iSCSI Target Discovery Using 'SendTargets' . . . . . . . . . . . . . . . 113
Login to Target Using 'iscsiadm' Command . . . . . . . . . . . . . . . . 113
List All Sessions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114
List All Drives Active in the System . . . . . . . . . . . . . . . . . . . . . . 114
Maximum Offload iSCSI Connections. . . . . . . . . . . . . . . . . . . . . . . . . 114
Linux iSCSI Offload FAQ. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114
iSCSI Offload on VMware Server. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114
9 Fibre Channel Over Ethernet
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117
FCoE Boot from SAN. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118
Preparing System BIOS for FCoE Build and Boot. . . . . . . . . . . . . . . . 118
Modify System Boot Order . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118
Specify BIOS Boot Protocol (if required) . . . . . . . . . . . . . . . . . . 118
Prepare QLogic Multiple Boot Agent for FCoE Boot. . . . . . . . . . . . . . 119
UEFI Boot LUN Scanning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123
Provisioning Storage Access in the SAN. . . . . . . . . . . . . . . . . . . . . . . 125
Pre-Provisioning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125
CTRL+R Method. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 125
One-Time Disabled . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 126
Windows Server 2008 R2 and Windows Server 2008 SP2
FCoE Boot Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128
Windows Server 2012/2102 R2 FCoE Boot Installation . . . . . . . . . . . 130
Linux FCoE Boot Installation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131
SLES11 SP2 Installation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131
RHEL6 Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137
Linux: Adding Additional Boot Paths . . . . . . . . . . . . . . . . . . . . . 142
VMware ESXi FCoE Boot Installation . . . . . . . . . . . . . . . . . . . . . . . . . 144
Configuring FCoE Boot from SAN on VMware. . . . . . . . . . . . . . 148
Booting from SAN After Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149
Driver Upgrade on Linux Boot from SAN Systems . . . . . . . . . . . . . . . 149
Errors During Windows FCoE Boot from SAN Installation . . . . . . . . . 150
Configuring FCoE. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151
10 NIC Partitioning and Bandwidth Management
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 152
Supported Operating Systems for NIC Partitioning. . . . . . . . . . . . . . . 152
Configuring for NIC Partitioning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
xi 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
Configuration Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
Number of Partitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
Network MAC Address . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
iSCSI MAC Address . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
Flow Control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 154
Physical Link Speed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 154
Relative Bandwidth Weight (%). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 154
Maximum Bandwidth (%). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 154
11 Virtual LANs in Windows
VLAN Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 156
Adding VLANs to Teams . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 158
12 SR-IOV
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159
Enabling SR-IOV . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159
SR-IOV and Storage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 161
SR-IOV and Jumbo Packets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 161
13 Microsoft Virtualization with Hyper-V
Supported Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163
Single Network Adapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 164
Windows Server 2008 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 164
Windows Server 2008 R2 and 2012 . . . . . . . . . . . . . . . . . . . . . . . . . . 164
Teamed Network Adapters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 165
Windows Server 2008 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 166
Windows Server 2008 R2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 167
Configuring VMQ with SLB Teaming. . . . . . . . . . . . . . . . . . . . . . . . . . 167
Upgrading Windows Operating Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . 168
14 Data Center Bridging (DCB)
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169
DCB Capabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 170
Enhanced Transmission Selection (ETS) . . . . . . . . . . . . . . . . . . . . . . 170
Priority Flow Control (PFC) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 170
Data Center Bridging eXchange (DCBX) . . . . . . . . . . . . . . . . . . . . . . 170
Configuring DCB . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171
DCB Conditions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 171
Data Center Bridging in Windows Server 2012 . . . . . . . . . . . . . . . . . . . . . . 172
xii 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
15 QLogic Teaming Services
Executive Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 174
Glossary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 175
Teaming Concepts. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 176
Network Addressing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 177
Teaming and Network Addresses. . . . . . . . . . . . . . . . . . . . . . . . 177
Description of Teaming Types . . . . . . . . . . . . . . . . . . . . . . . . . . 178
Software Components. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 183
Hardware Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 183
Repeater Hub. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 184
Switching Hub. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 184
Router. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 184
Teaming Support by Processor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 184
Configuring Teaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 185
Supported Features by Team Type. . . . . . . . . . . . . . . . . . . . . . . . . . . 185
Selecting a Team Type . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 187
Teaming Mechanisms. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188
Architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 189
Outbound Traffic Flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 190
Inbound Traffic Flow (SLB Only). . . . . . . . . . . . . . . . . . . . . . . . . 190
Protocol Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 191
Performance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 192
Types of Teams. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 192
Switch-Independent . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 192
Switch-Dependent . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193
LiveLink . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 196
Attributes of the Features Associated with Each Type of Team . . . . . 196
Speeds Supported for Each Type of Team . . . . . . . . . . . . . . . . . . . . . 199
Teaming and Other Advanced Networking Properties . . . . . . . . . . . . . . . . 199
Checksum Offload. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 200
IEEE 802.1p QoS Tagging. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 200
Large Send Offload. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201
Jumbo Frames. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201
IEEE 802.1Q VLANs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201
Preboot Execution Environment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202
General Network Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202
Teaming with Microsoft Virtual Server 2005 . . . . . . . . . . . . . . . . . . . . 202
Teaming Across Switches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 203
Switch-Link Fault Tolerance . . . . . . . . . . . . . . . . . . . . . . . . . . . . 203
xiii 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
Spanning Tree Algorithm. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 207
Topology Change Notice (TCN) . . . . . . . . . . . . . . . . . . . . . . . . . 208
Port Fast/Edge Port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 208
Layer 3 Routing/Switching. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 208
Teaming with Hubs (for troubleshooting purposes only) . . . . . . . . . . . 209
Hub Usage in Teaming Network Configurations. . . . . . . . . . . . . 209
SLB Teams . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 209
SLB Team Connected to a Single Hub. . . . . . . . . . . . . . . . . . . . 210
Generic and Dynamic Trunking (FEC/GEC/IEEE 802.3ad) . . . . 210
Teaming with Microsoft NLB . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211
Application Considerations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211
Teaming and Clustering. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211
Microsoft Cluster Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211
High-Performance Computing Cluster . . . . . . . . . . . . . . . . . . . . 213
Oracle. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 214
Teaming and Network Backup. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 215
Load Balancing and Failover . . . . . . . . . . . . . . . . . . . . . . . . . . . 216
Fault Tolerance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 217
Troubleshooting Teaming Problems. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 219
Teaming Configuration Tips. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 219
Troubleshooting Guidelines. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 220
Frequently Asked Questions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 221
Event Log Messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224
Windows System Event Log Messages . . . . . . . . . . . . . . . . . . . . . . . 224
Base Driver (Physical Adapter/Miniport) . . . . . . . . . . . . . . . . . . . . . . . 224
Intermediate Driver (Virtual Adapter/Team). . . . . . . . . . . . . . . . . . . . . 228
Virtual Bus Driver. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 230
16 Configuring Teaming in Windows Server
QLASP Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233
Load Balancing and Fault Tolerance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 234
Types of Teams. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 234
Smart Load Balancing and Failover . . . . . . . . . . . . . . . . . . . . . . . . . . 235
Link Aggregation (802.3ad). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 235
Generic Trunking (FEC/GEC)/802.3ad-Draft Static. . . . . . . . . . . . . . . 236
SLB (Auto-Fallback Disable) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 236
Limitations of Smart Load Balancing and Failover/SLB
(Auto-Fallback Disable) Types of Teams. . . . . . . . . . . . . . . . . . . . . . 237
Teaming and Large Send Offload/Checksum Offload Support . . . . . . 238
xiv 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
17 User Diagnostics in DOS
Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 239
System Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 239
Performing Diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 240
Diagnostic Test Descriptions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242
18 Troubleshooting
Hardware Diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 248
QCC GUI Diagnostic Tests Failures . . . . . . . . . . . . . . . . . . . . . . . . . . 248
QCC Network Test Failures. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 249
Checking Port LEDs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 249
Troubleshooting Checklist . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 250
Checking if Current Drivers are Loaded. . . . . . . . . . . . . . . . . . . . . . . . . . . . 250
Windows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 250
Linux . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 251
Possible Problems and Solutions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 252
Multi-boot Agent . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 252
QLASP. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 252
Linux . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 253
NPAR. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 255
Miscellaneous . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 255
A Adapter LEDS
xv 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
xvi 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters
QLogic FastLinQ 3400, 8400 Series

List of Figures

Figure Page
3-1 MBA Configuration Menu. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
4-1 Power Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
6-1 Selecting an Adapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
6-2 QLE3442 Driver Versions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
6-3 PCI Identifiers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
6-4 List of Driver Packages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
6-5 Download Driver Package . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
8-1 QLogic 577xx/578xx Ethernet Boot Agent. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
8-2 CCM Device List . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
8-3 Selecting MBA Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
8-4 Selecting the iSCSI Boot Protocol . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
8-5 Selecting iSCSI Boot Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
8-6 Selecting General Parameters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
8-7 Saving the iSCSI Boot Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76
8-8 Comprehensive Configuration Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
8-9 Configuring VLANs—CCM Device List . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
8-10 Configuring VLANs—Multiboot Agent Configuration . . . . . . . . . . . . . . . . . . . . . . . . 93
8-11 Configuring iSCSI Boot VLAN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
8-12 Saving the iSCSI Boot VLAN Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 94
8-13 iSCSI Initiator Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99
8-14 iSCSI Initiator Node Name Change . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100
8-15 iSCSI Initiator—Add a Target Portal. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100
8-16 Target Portal IP Address . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101
8-17 Selecting the Local Adapter. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101
8-18 Selecting the Initiator IP Address. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102
8-19 Adding the Target Portal. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103
8-20 Logging on to the iSCSI Target . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
8-21 Log On to Target Dialog Box . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
8-22 Assigning a VLAN Number . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115
8-23 Configuring the VLAN on VMKernel. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116
9-1 FCoE Boot<Variable>—CCM Device List . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119
9-2 FCoE Boot<Variable>—Enable DCB/DCBX . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120
9-3 FCoE Boot<Variable>—Select FCoE Boot Protocol . . . . . . . . . . . . . . . . . . . . . . . . 120
9-4 FCoE Boot<Variable>—Target Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121
9-5 FCoE Boot<Variable>—Specify Target WWPN and Boot LUN . . . . . . . . . . . . . . . . 122
9-6 FCoE Boot Target Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122
9-7 FCoE Boot Configuration Menu. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123
9-8 FCoE Target Parameters Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124
9-9 Selecting an FCoE WWPN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124
9-10 One-time Disabled . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127
9-11 Load EVBD Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128
9-12 Load bxfcoe Driver. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129
9-13 Selecting the FCoE Boot LUN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129
xvii 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
9-14 SLES Boot Options Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131
9-15 Choosing Driver Update Medium. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 132
9-16 FCoE Reboot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149
11-1 Example of Servers Supporting Multiple VLANs with Tagging. . . . . . . . . . . . . . . . . 156
15-1 Process for Selecting a Team Type . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 187
15-2 Intermediate Driver. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 189
15-3 Teaming Across Switches Without an Interswitch Link . . . . . . . . . . . . . . . . . . . . . . 204
15-4 Teaming Across Switches With Interconnect. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205
15-5 Failover Event . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 206
15-6 Team Connected to a Single Hub . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210
15-7 Clustering With Teaming Across One Switch. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 212
15-8 Clustering With Teaming Across Two Switches. . . . . . . . . . . . . . . . . . . . . . . . . . . . 214
15-9 Network Backup without Teaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 215
15-10 Network Backup With SLB Teaming Across Two Switches . . . . . . . . . . . . . . . . . . . 218
xviii 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters
QLogic FastLinQ 3400, 8400 Series

List of Tables

Table Page
2-1 100/1000BASE-T and 10GBASE-T Cable Specifications . . . . . . . . . . . . . . . . . . . . 11
4-1 Windows Operating Systems and iSCSI Crash Dump. . . . . . . . . . . . . . . . . . . . . . . 19
5-1 QLogic 8400/3400 Series Linux Drivers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
6-1 VMware Driver Packaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
6-2 QLogic 8400/3400 Series FCoE Drivers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
8-1 Configuration Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
8-2 DHCP Option 17 Parameter Definition. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
8-3 DHCP Option 43 Suboption Definition. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81
8-4 DHCP Option 17 Suboption Definition. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82
8-5 Offload iSCSI (OIS) Driver Event Log Messages. . . . . . . . . . . . . . . . . . . . . . . . . . . 105
11-1 Example VLAN Network Topology. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 157
13-1 Configurable Network Adapter Hyper-V Features . . . . . . . . . . . . . . . . . . . . . . . . . . 163
13-2 Configurable Teamed Network Adapter Hyper-V Features . . . . . . . . . . . . . . . . . . . 165
15-1 Glossary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 175
15-2 Available Teaming Types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 178
15-3 Comparison of Team Types. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 185
15-4 Attributes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 196
15-5 Link Speeds in Teaming. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 199
15-6 Advanced Adapter Properties and Teaming Support. . . . . . . . . . . . . . . . . . . . . . . . 199
15-7 Base Driver Event Log Messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224
15-8 Intermediate Driver Event Log Messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 228
15-9 VBD Event Log Messages. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 230
16-1 Smart Load Balancing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 237
17-1 uediag Command Options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 240
17-2 Diagnostic Tests. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242
A-1 Network Link and Activity Indicated by the RJ-45 Port LEDs. . . . . . . . . . . . . . . . . . 257
A-2 Network Link and Activity Indicated by the Port LED. . . . . . . . . . . . . . . . . . . . . . . . 257
xix 83840-546-00 E
User’s Guide—Converged Network Adapters and Intelligent Ethernet Adapters QLogic FastLinQ 3400, 8400 Series
xx 83840-546-00 E

Preface

NOTE
QLogic now supports QConvergeConsole® (QCC) GUI as the only GUI management tool across all QLogic adapters. The QLogic Control Suite (QCS) GUI is no longer supported for the 8400/3400 Series Adapters and adapters based on 57xx/57xxx controllers, and has been replaced by the QCC GUI management tool. The QCC GUI provides single-pane-of-glass GUI management for all QLogic adapters.
In Windows environments, when you run the QCS CLI and the Management Agents Installer, it will uninstall the QCS GUI (if installed on the system) and any related components from your system. To obtain the new GUI, download QCC GUI for your adapter from the QLogic Downloads Web page:
driverdownloads.qlogic.com

Intended Audience

This guide is intended for personnel responsible for installing and maintaining computer networking equipment.

What Is in This Guide

This guide describes the features, installation, and configuration of the QLogic® FastLinQ™ 8400/3400 Series Converged Network Adapters and Intelligent Ethernet Adapters. The guide is organized as follows:
Chapter 1, Product Overview provides a product functional description, a list
of features, a list of supported operating systems, and the adapter specifications.
Chapter 2, Installing the Hardware describes how to install the adapter
including the list of system requirements and a preinstallation checklist.
Chapter 3, Multi-boot Agent (MBA) Driver Software describes the software
module that allows your network computer to boot with the images provided by remote servers across the network.
Chapter 4, Windows Driver Software describes Windows
and removal, QLogic management application installation, adapter properties management, and power management options.
®
driver installation
xxi 83840-546-00 E
Preface Related Materials
Chapter 5, Linux Driver Software describes the Linux® drivers.
®
Chapter 6, VMware Driver Software describes the VMware
drivers.
Chapter 7, Firmware Upgrade describes the installation and use of the
firmware upgrade utility.
Chapter 8, iSCSI Protocol describes iSCSI boot, iSCSI crash dump, and
iSCSI offload for Windows, Linux, and VMware.
Chapter 9, Fibre Channel Over Ethernet describes FCoE boot from SAN
and booting from SAN after installation.
Chapter 10, NIC Partitioning and Bandwidth Management describes the
NPAR operating system requirements and the NPAR configuration parameters.
Chapter 11, Virtual LANs in Windows describes the use of VLANs to divide
the physical LAN into functional segments.
Chapter 12, SR-IOV describes the use of Single-Root I/O Virtualization
(SR-IOV) to virtualize network controllers and how to enable SR-IOV.
Chapter 13, Microsoft Virtualization with Hyper-V describes the use of
Microsoft
®
Hyper-V® for Windows Server 2008 and 2012.
Chapter 14, Data Center Bridging (DCB) describes the DCB capabilities
configuration, and requirements.
Chapter 15, QLogic T eaming Services describes the use of teaming to group
multiple physical devices to provide fault tolerance and load balancing.
Chapter 16, Configuring T eamin g in Windows Server describ es the teaming
configuration for Windows Server
Chapter 17, User Diagnostics in DOS describes the MS-DOS based
application that runs diagnostic tests, updates device firmware, and manages adapter properties.
Chapter 18, Troubleshootingdescribes a variety of troubleshooting methods
and resources.
Appendix A, Adapter LEDS describes the adapter LEDs and their
significance.

Related Materials

For information about downloading documentation from the QLogic Web site, see
“Downloading Updates” on page xxv.
®
operating systems.
xxii 83840-546-00 E
Preface
NOTE
CAUTION
CAUTION
!
!
WARNING

Documentation Conventions

Documentation Conventions
This guide uses the following documentation conventions:
provides additional information.
without an alert symbol indicates the presence of a hazard
that could cause damage to equipment or loss of data.
with an alert symbol indicates the presence of a hazard that
could cause minor or moderate injury.
indicates the presence of a hazard that could cause serious
injury or death.
Text in blue font indicates a hyperlink (jump) to a figure, table, or section in
this guide, and links to Web sites are shown in underlined blue example:
. For
Table 9-2 lists problems related to the user interface and remote agent. See “Installation Checklist” on page 6. For more information, visit www.qlogic.com
Text in bold font indicates user interface elements such as a menu items,
buttons, check boxes, or column headings. For example: Click the Start button, point to Programs, point to Accessories, and
then click Command Prompt.
Under Notification Options, select the Warning Alarms check box.
Text in Courier font indicates a file name, directory path, or command line
text. For example: To return to the root directory from anywhere in the file structure:
Type
cd /root and press ENTER.
Enter the following command: sh ./install.bin
Key names and key strokes are indicated with UPPERCASE:
Press CTRL+P. Press the UP ARROW key.
.
xxiii 83840-546-00 E
Preface License Agreements
Text in italics indicates terms, emphasis, variables, or document titles. For
example:
For a complete listing of license agreements, refer to the QLogic
Software End User License Agreement.
What are shortcut keys? To enter the date type mm/dd/yyyy (where mm is the month, dd is the
day, and yyyy is the year).
Topic titles between quotation marks identify related topics either within this
manual or in the online help, which is also referred to as the help system throughout this document.

License Agreements

Refer to the QLogic Software End User License Agreement for a complete listing of all license agreements affecting this product.
xxiv 83840-546-00 E
Preface Technical Support

Technical Support

Customers should contact their authorized maintenance provider for technical support of their QLogic products. QLogic-direct customers may contact QLogic Technical Support; others will be redirected to their authorized maintenance provider. Visit the QLogic support Web site listed in Cont act Information for the latest firmware and software updates.
For details about available service plans, or for information about renewing and extending your service, visit the Service Program Web page at
http://www.qlogic.com/Support/Pages/ServicePrograms.aspx

Downloading Updates

The QLogic Web site provides periodic updates to product firmware, software, and documentation.
To download firmware, software, and documentation:
1. Go to the QLogic Downloads and Documentation page:
driverdownloads.qlogic.com
.
.
2. Type the QLogic model name in the search box.
3. In the search results list, locate and select the firmware, software, or documentation for your product.
4. View the product details Web page to ensure that you have the correct firmware, software, or documentation. For additional information, click Read Me and Release Notes under Support Files.
5. Click Download Now.
6. Save the file to your computer.
7. If you have downloaded firmware, software, drivers, or boot code, follow the installation instructions in the Readme file.
Instead of typing a model name in the search box, you can perform a guided search as follows:
1. Click the product type tab: Adapters, Switches, Routers, or ASICs.
2. Click the corresponding button to search by model or operating system.
3. Click an item in each selection column to define the search, and then click Go.
4. Locate the firmware, software, or document you need, and then click the item’s name or icon to download or open the item.
xxv 83840-546-00 E
Preface Technical Support

Training

QLogic Global Training maintains a Web site at www.qlogictraining.com offering online and instructor-led training for all QLogic products. In addition, sales and technical professionals may obtain Associate and Specialist-level certifications to qualify for additional benefits from QLogic.

Contact Information

QLogic Technical Support for products under warranty is available during local standard working hours excluding QLogic Observed Holidays. For customers with extended service, consult your plan for available hours. For Support phone numbers, see the Contact Support link at support.qlogic.com
.
Support Headquarters
QLogic Web Site Technical Support Web Site Technical Support E-mail Technical Training E-mail

Knowledge Database

The QLogic knowledge database is an extensive collection of QLogic product information that you can search for specific solutions. QLogic is constantly adding to the collection of information in the database to provide answers to your most urgent questions. Access the database from the QLogic Support Center:
support.qlogic.com.
QLogic Corporation 12701 Whitewater Drive Minnetonka, MN 55343 USA
www.qlogic.com support.qlogic.com support@qlogic.com training@qlogic.com
xxvi 83840-546-00 E
Preface
CLASS I LASER

Legal Notices

Legal Notices

Warranty

For warranty details, please check the QLogic Web site:
http://www.qlogic.com/Support/Pages/Warranty.aspx

Laser Safety

FDA Notice
This product complies with DHHS Rules 21CFR Chapter I, Subchapter J. This product has been designed and manufactured according to IEC60825-1 on the safety label of laser product.
Class 1 Laser Product Appareil laser de classe 1 Produkt der Laser Klasse 1 Luokan 1 Laserlaite

Agency Certification

The following sections contain a summary of EMC and EMI test specifications performed on the QLogic adapters to comply with emission and product safety standards.
EMI and EMC Requirements
FCC Rules,CFR Title 47, Part 15, Subpart B:2013 Class A
This device complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: (1) this device may not cause harmful interference, and (2) this device must accept any interference received, including interference that may cause undesired operation.
Caution—Class 1 laser radiation when open. Do not view directly with optical instruments
Attention—Radiation laser de classe 1. Ne pas regarder directement avec des instruments optiques.
Vorsicht—Laserstrahlung der Klasse 1 bei geöffneter Abdeckung. Direktes Ansehen mit optischen Instrumenten vermeiden.
Varoitus—Luokan 1 lasersäteilyä, kun laite on auki. Älä katso suoraan laitteeseen käyttämällä optisia instrumenttej.
Industry Canada, ICES-003:2012 Class A
This Class A digital apparatus complies with Canadian ICES-003.Cet appareil numériqué de la classe A est conformé à la norme NMB-003 du Canada.
xxvii 83840-546-00 E
Preface Legal Notices
CE Mark 2004/108/EC EMC Directive Compliance
EN55022:2010 Class A1:2007/CISPR22:2009+A1:2010 Class A EN55024:2010
EN61000-3-2:2006 A1 +A2:2009: Harmonic Current Emission EN61000-3-3:2008: Voltage Fluctuation and Flicker
VCCI
VCCI:2012-04; Class A
AS/NZS CISPR22
AS/NZS; CISPR 22:2009+A1:2010 Class A
KCC
KC-RRA KN22 KN24(2013) Class A
Product Safety Compliance
UL, cUL product safety:
UL60950-1 (2nd Edition), 2007 UL CSA C22.2 60950-1-07 (2nd Edition) 2007
Use only with listed ITE or equivalent. Complies with 21 CFR 1040.10 and 1040.11. 2006/95/EC low voltage directive: TUV EN60950-1:2006+A11+A1+A12 2nd edition
TUV IEC60950-1:2006 2nd Edition Am 1:2009 CB
xxviii 83840-546-00 E

1 Product Overview

NOTE
Functional De scriptio n Features Supported Operating Environments Adapter Management Adapter Specifications

Functional Description

The QLogic 8400/3400 Series adapters are based on a new class of Gigabit Ethernet (GbE) and 10GbE converged network interface controller (C-NIC) that can simultaneously perform accelerated data networking and storage networking on a standard Ethernet network. The C-NIC offers acceleration for popular protocols used in the data center, such as:
Internet Small Computer Systems Interface (iSCSI) offload for accelerating
network storage access featuring centralized boot (iSCSI boot)
Fibre Channel over Ethernet (FCoE) offload and acceleration for Fibre
Channel block storage
Not all adapters support each listed protocol. For information about supported protocols, refer to the product data sheet at www.qlogic.com under Resources.
Enterprise networks that use multiple protocols and multiple network fabrics benefit from the network adapter’s ability to combine data communications, storage, and clustering over a single Ethernet fabric by boosting server CPU processing performance and memory use while alleviating I/O bottlenecks.
The QLogic 8400/3400 Series adapters include a 100/1000Mbps or 10Gbps Ethernet MAC with both half-duplex and full-duplex capability and a 100/1000Mbps or 10Gbps PHY. The transceiver is fully compatible with the IEEE
802.3 standard for auto-negotiation of speed.
1 83840-546-00 E
1–Product Overview Features
Using the QLogic teaming software, you can split your network into virtual LANs (VLANs) and group multiple network adapters together into teams to provide network load balancing and fault tolerance. See Chapter 15, QLogic Teaming
Services and Chapter 16, Configuring Teaming in Windows Server for detailed
information about teaming. See Chapter 11, Virtual LANs in Windows for a description of VLANs. See “Configuring Teaming” on page 185 for instructions on configuring teaming and creating VLANs on Windows operating systems.

Features

The following is a list of the QLogic 8400/3400 Series adapters features. Some features may not be available on all adapters.
iSCSI offload FCoE offload NIC partitioning (NPAR) Data center bridging (DCB)
Enhanced transmission selection (ETS; IEEE 802.1Qaz) Priority-based flow control (PFC; IEEE 802.1Qbb) Data center bridging capability exchange protocol (DCBX; CEE
version 1.01)
Single-chip solution (excluding QLE3442-RJ) 10/100/1000G triple-speed MAC (QLE3442-RJ) 1G/10G triple-speed MAC SerDes interface for optical transceiver connection
PCIe
®
Gen3 x8 (10GE)
Zero copy capable hardware Other offload performance features
TCP, IP, user datagram protocol (UDP) checksum TCP segmentation Adaptive interrupts Receive side scaling (RSS)
2 83840-546-00 E
Loading...
+ 257 hidden pages