User’s Guide
Converged Network Adapter
8200 and 3200 Series
SN0054671-00 A
User’s Guide—Converged Network Adapter
8200 and 3200 Series
Information furnished in this manual is believed to be accurate and reliable. However, QLogic Corporation assumes no
responsibility for its use, nor for any infringements of patents or other rights of third parties which may result from its
use. QLogic Corporation reserves the right to change product specifications at any time without notice. Applications
described in this document for any of these products are for illustrative purposes only. QLogic Corporation makes no
representation nor warranty that such applications are suitable for the specified use without further testing or
modification. QLogic Corporation assumes no responsibility for any errors that may appear in this document.
Document Revision History
Revision A, March 31, 2011
Changes Sections Affected
Initial release All
ii SN0054671-00 A
Table of Contents
Preface
What’s in This Guide . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
Intended Audience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii
Related Materials . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii
Documentation Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii
License Agreements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Technical Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Training . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiv
Contact Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiv
Knowledge Database . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiv
Legal Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv
Warranty . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv
Laser Safety . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv
FDA Notice . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv
Agency Certification. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv
EMI and EMC Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . xv
CNS 13438: Class A (QLE8xxx). . . . . . . . . . . . . . . . . . . . . . . . . xvi
MIC: Class A. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xvi
Product Safety Compliance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xvii
Quick Start
Installation Instructions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xix
Step 1. Verify the Package Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xix
Step 2. Install the Adapter Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xx
Step 3. Install the Adapter Drivers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxi
Step 4. Install QConvergeConsole™ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxii
Additional Resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xxii
1 Product Overview
What is a Converged Network Adapter? . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-1
What is an Intelligent Ethernet Adapter? . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-1
SN0054671-00 A iii
User’s Guide—Converged Network Adapter
8200 and 3200 Series Adapters
Functionality and Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-1
Functional Description. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-1
Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-1
Supported Operating Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-3
Adapter Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-3
Physical Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-3
Standards Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-3
Environmental Specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-4
Converged Network Adapter SuperInstaller Installation. . . . . . . . . . . . . . . . 1-5
QLogic Windows SuperInstaller . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-5
QLogic Linux SuperInstaller . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-5
Multi-boot Image for 10Gb CNA—CNA Function Configuration Utility. . . . . 1-5
Operating System Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-5
Multi-boot Package Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-5
Converged Network Adapter Function Configuration Package Contents 1-6
Using QLflash . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-6
Updating the Multi-boot Code. . . . . . . . . . . . . . . . . . . . . . . . . . . 1-6
QLflash Command Line Options . . . . . . . . . . . . . . . . . . . . . . . . 1-7
Adapter Configuration (CNA/IEA Function Configuration Utility). . . . . 1-8
Function . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-9
Type . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-11
MinBW%. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-11
Protocol . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-11
Restore to Non-NIC Partition Settings . . . . . . . . . . . . . . . . . . . . 1-11
Exit the CNA Function Configuration Utility . . . . . . . . . . . . . . . . 1-12
Installing the QLogic Adapter vCenter Plug-in for ESX/ESXi. . . . . . . . . . . . 1-12
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-13
Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-14
ESX/ESXi Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-14
vCenter Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-15
Tomcat Web Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-15
Installing the QLogic Adapter CIM Provider . . . . . . . . . . . . . . . . . . . . 1-15
Initial Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-15
Subsequent Update Installation . . . . . . . . . . . . . . . . . . . . . . . . . 1-16
Starting the QLogic Adapter CIM Provider . . . . . . . . . . . . . . . . . . . . . 1-16
Removing the QLogic Adapter CIM Provider . . . . . . . . . . . . . . . . . . . 1-17
Starting the QLogic Adapter vCenter Plug-in. . . . . . . . . . . . . . . . . . . . 1-18
Removing the QLogic Adapter vCenter Plug-in. . . . . . . . . . . . . . . . . . 1-18
Installing the Flash Utility. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-19
iv SN0054671-00 A
Updating the Flash . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-19
Using the vCenter Plug-in on a Tomcat Server . . . . . . . . . . . . . . . . . . 1-20
Installing Tomcat on Linux . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-21
Starting and Stopping Tomcat on Linux . . . . . . . . . . . . . . . . . . . 1-21
Installing Tomcat on Windows . . . . . . . . . . . . . . . . . . . . . . . . . . 1-21
Starting and Stopping Tomcat on Windows . . . . . . . . . . . . . . . . 1-22
Installing the vCenter Plug-in on Tomcat . . . . . . . . . . . . . . . . . . 1-22
Plug-in Unregistration from a Manual Installation . . . . . . . . . . . . . . . . 1-22
Launching the Plug-in from vSphere Client . . . . . . . . . . . . . . . . . . . . . 1-23
2 Configuring NIC
Installing NIC in Linux. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-1
Packaging Content . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-1
Linux OS Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-1
Supported Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-1
Using the Driver. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-1
Installing NIC in ESX . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-1
Packaging Content . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-2
ESX OS Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-2
Using the Driver. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-2
Installing NIC in Windows. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-2
Packaging Content . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-2
Windows OS Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-2
Using the Driver. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-2
Configuring PXE Boot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-3
Configuring Driver Software Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-6
Linux NIC Driver Management Applications . . . . . . . . . . . . . . . . . . . . 2-6
qaucli Utility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-7
ethtool Utility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-7
phantomcore Utility. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-9
Windows Property Pages. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-9
Configuring NIC Driver Parameters with QCC GUI. . . . . . . . . . . . . . . 2-14
Configuring NIC Driver Parameters with QCC Interactive CLI . . . . . . 2-14
Configuring NIC Driver Parameters with QCC Non-Interactive CLI . . 2-14
VLAN Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-14
VLAN Configuration with QCC GUI. . . . . . . . . . . . . . . . . . . . . . . . . . . 2-14
VLAN Configuration with the QCC Interactive CLI . . . . . . . . . . . . . . . 2-14
VLAN Configuration with the QCC Non-Interactive CLI . . . . . . . . . . . 2-14
User’s Guide—Converged Network Adapter
8200 and 3200 Series Adapters
SN0054671-00 A v
User’s Guide—Converged Network Adapter
8200 and 3200 Series Adapters
Teaming/Bonding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-14
Windows Teaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-14
Team MAC Address . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-15
Teaming Modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-15
Using the CLI for Teaming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-19
Using the Team Management GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-19
Teaming Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-20
Creating a Team . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-21
Modifying a Team . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-27
Deleting a Team . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-33
Saving and Restoring Teaming Configuration . . . . . . . . . . . . . . 2-34
Viewing Teaming Statistics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-34
Linux Bonding/Failover/Aggregation . . . . . . . . . . . . . . . . . . . . . . . . . . 2-34
NIC Partition (NPAR) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-35
Configuration and Operation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-35
Using NPAR under ESX . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-36
Configuring NPAR in the BIOS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-37
Configuring NPAR in QCC GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-37
Configuring NPAR in QCC Interactive CLI . . . . . . . . . . . . . . . . . . . . . 2-37
Configuring NPAR in QCC Non-Interactive CLI. . . . . . . . . . . . . . . . . . 2-37
Configuring NPAR in the QLogic Adapter vCenter Plug-in . . . . . . . . . 2-37
NPAR Personality Changes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-41
Enabling NPAR. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-42
Quality of Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-42
eSwitch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-43
NIC TroubleShooting/Diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-44
NIC Linux Diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-44
Linux Diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-44
Windows Property Page Diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . 2-46
Running Windows User Diagnostics. . . . . . . . . . . . . . . . . . . . . . 2-46
Windows Diagnostic Test Descriptions . . . . . . . . . . . . . . . . . . . . 2-52
Windows Diagnostic Test Messages . . . . . . . . . . . . . . . . . . . . . 2-53
NIC Troubleshooting Guidelines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-57
3 Configuring iSCSI
iSCSI Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1
Installing iSCSI in Linux . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1
Packaging Content . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1
Linux OS Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1
Supported Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1
vi SN0054671-00 A
User’s Guide—Converged Network Adapter
8200 and 3200 Series Adapters
Deploying the Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1
Driver System Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-1
Installing iSCSI in ESX. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2
Packaging Content . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2
ESX OS Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2
Using the Driver. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2
Installing the Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2
Installing iSCSI in Windows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2
Packaging Content . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2
Windows OS Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2
Using the Driver. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2
iSCSI Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-3
iSCSI Configuration with QCC GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-3
iSCSI Configuration with Interactive QCC CLI . . . . . . . . . . . . . . . . . . 3-3
iSCSI Configuration with Non-Interactive CLI . . . . . . . . . . . . . . . . . . . 3-3
iSCSI Initiator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-3
Configuring an iSCSI Initiator in Linux. . . . . . . . . . . . . . . . . . . . . . . . . 3-3
Configuring an iSCSI Initiator in Windows. . . . . . . . . . . . . . . . . . . . . . 3-4
Configuring an iSCSI Initiator in VMware . . . . . . . . . . . . . . . . . . . . . . 3-6
iSCSI Name Server iSNS. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-6
iSCSI Boot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-6
iSCSI Boot Setup Using Fast!UTIL . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-6
Accessing Fast!UTIL . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-7
Configuring iSCSI Boot Settings. . . . . . . . . . . . . . . . . . . . . . . . . 3-7
DHCP Boot Setup for iSCSI Boot . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-7
iBFT Boot Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-8
iSCSi Boot Setup Using QCC CLI. . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-8
Configuring iSCSI Boot using the QCC CLI . . . . . . . . . . . . . . . . 3-8
Configuring iSCSI DHCP Boot Options using QCC CLI. . . . . . . 3-8
Configuring iSCSI DHCP Boot Options using Interactive QCC CLI 3-8
Configuring iSCSI DHCP Boot Options using Non-interactive
QCC CLI. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-8
iSCSI Boot Setup Using QCC GUI . . . . . . . . . . . . . . . . . . . . . . . 3-8
iSCSI TroubleShooting. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-9
iSCSI Diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-9
iSCSI Diagnostics using QCC GUI. . . . . . . . . . . . . . . . . . . . . . . 3-9
iSCSI Diagnostics using Interactive QCC CLI . . . . . . . . . . . . . . 3-9
iSCSI Troubleshooting Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-10
SN0054671-00 A vii
User’s Guide—Converged Network Adapter
8200 and 3200 Series Adapters
4 Configuring FCoE
Installing FCoE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-1
Installing FCoE in Linux. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-1
Packaging Content . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-1
Linux OS Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-1
Supported Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-1
Deploying the Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-1
Driver System Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-1
Boot From SAN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-1
Firmware Installation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2
Installing FCoE in ESX . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2
Packaging Content . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2
ESX OS Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2
Using the Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2
Installing FCoE in Windows. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2
Packaging Content . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2
Windows OS Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2
Using the Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2
Driver Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2
HBA Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-3
Setting HBA Parameters with the QCC GUI . . . . . . . . . . . . . . . . . . . . 4-3
Setting HBA Parameters with the Interactive QCC CLI. . . . . . . . . . . . 4-3
Setting HBA Parameters with the Non-Interactive QCC CLI. . . . . . . . 4-3
Target Persistent Binding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-3
Configuring Persistent Binding with the QCC GUI . . . . . . . . . . . . . . . 4-3
Configuring Persistent Binding with the Interactive QCC CLI . . . . . . . 4-3
Configuring Persistent Binding with the Non-Interactive QCC CLI . . . 4-3
Boot Devices Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-3
Configuring Boot Devices with the QCC GUI . . . . . . . . . . . . . . . . . . . 4-3
Configuring Boot Devices with the Interactive QCC CLI . . . . . . . . . . . 4-3
Configuring Boot Devices with the Non-Interactive QCC CLI . . . . . . . 4-3
Configuring Boot Devices with the BIOS. . . . . . . . . . . . . . . . . . . . . . . 4-4
Virtual Ports (NPIV) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-4
Configuring NPIV with the QCC GUI. . . . . . . . . . . . . . . . . . . . . . . . . . 4-4
Configuring NPIV with the Interactive QCC CLI . . . . . . . . . . . . . . . . . 4-4
Configuring NPIV with the Non-Interactive QCC CLI . . . . . . . . . . . . . 4-4
Driver Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-4
Configuring FCoE Driver Parameters with the QCC GUI . . . . . . . . . . 4-4
Configuring FCoE Driver Parameters with the Interactive QCC CLI . . 4-4
viii SN0054671-00 A
User’s Guide—Converged Network Adapter
8200 and 3200 Series Adapters
Configuring FCoE Driver Parameters with the Non-Interactive QCC CLI 4-4
Configuring FCoE Driver Parameters with the vCenter Plugin . . . . . . 4-4
Selective LUNS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-4
Configuring Selective LUNS with the QCC GUI . . . . . . . . . . . . . . . . . 4-4
Configuring Selective LUNS with the Interactive QCC CLI . . . . . . . . . 4-5
Configuring Selective LUNS with the Non-Interactive QCC CLI . . . . . 4-5
Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-5
FCoE Diagnostics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-5
FCoE Diagnostics using QCC GUI. . . . . . . . . . . . . . . . . . . . . . . 4-5
FCoE Diagnostics using Interactive QCC CLI . . . . . . . . . . . . . . 4-5
FCoE Troubleshooting Diagram . . . . . . . . . . . . . . . . . . . . . . . . . 4-6
A Adapter LEDs
Glossary
List of Figures
Figure Page
i Illustration of Server Motherboard and Slots . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xx
1-1 vSphere Client Showing QLogic Adapter Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-13
1-2 vCenter Plug-in Requirements. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-14
2-1 Dell BIOS: Integrated Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-3
2-2 QLogic 8200 CNA Function Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-4
2-3 BIOS: Boot Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-5
2-4 Embedded NIC 1 QLogic PXE. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-6
2-5 Team Management Property Page . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-20
2-6 Creating a Team. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-21
2-7 Creating a Failsafe Team . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-23
2-8 Creating a Switch-Independent Load Balancing Team . . . . . . . . . . . . . . . . . . . . . . 2-24
2-9 Creating an 802.3ad Static Team . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-25
2-10 Creating an 802.3ad Dynamic Team . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-26
2-11 Confirming New Team Creation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-27
2-12 Adding a Team . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-28
2-13 Modifying Advanced Team Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-29
2-14 Modifying Team Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-31
2-15 Modifying Failsafe Team Properties. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-32
2-16 Modifying the Team Type . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-33
2-17 vCenter Plug-in QLogic Adapter Tab Default View . . . . . . . . . . . . . . . . . . . . . . . . . 2-38
2-18 8200 Series Configuration Range Without NPAR . . . . . . . . . . . . . . . . . . . . . . . . . . 2-38
2-19 8200 Series Configuration Range With NPAR. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-39
2-20 3200 Series Configuration Range With NPAR. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-39
2-21 Enabling a Physical Function . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-40
2-22 Port One Configured with NPAR Enabled . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-41
SN0054671-00 A ix
User’s Guide—Converged Network Adapter
8200 and 3200 Series Adapters
2-23 QLogic Adapter vCenter Plug-in with QoS Interface, Function eSwitch
Configuration, and eSwitch Statistics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-43
2-24 Diagnostics Tests on Windows. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-47
2-25 NIC Troubleshooting Diagram 1. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-57
2-26 NIC Troubleshooting Diagram 2. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-58
3-1 iSCSI Troubleshooting Diagram. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-10
4-1 FCoE Troubleshooting Diagram. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-6
List of Tables
Table Page
1-1 Environmental Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-4
2-1 Windows Driver Configurable Parameters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-10
2-2 Windows Teaming Modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-15
2-3 Windows QConvergeConsole CLI—Selecting a Protocol in Menu Mode . . . . . . . . 2-48
2-4 Windows QConvergeConsole CLI—Selecting a Protocol in Legacy Mode . . . . . . . 2-48
2-5 Windows QConvergeConsole CLI—Getting Help . . . . . . . . . . . . . . . . . . . . . . . . . . 2-49
2-6 Windows QConvergeConsole CLI—Miscellaneous Commands . . . . . . . . . . . . . . . 2-49
2-7 Windows QConvergeConsole CLI—Diagnostic Test Commands . . . . . . . . . . . . . . 2-49
2-8 Running Windows Diagnostic Tests in the CLI. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-51
2-9 Windows Diagnostic Test Messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-53
A-1 QLE824x and QLE324x LED Scheme. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-1
x SN0054671-00 A
Preface
This guide provides detailed instructions on the installation, configuration, and
troubleshooting of 8200 and 3200 Series Adapters for Windows
VMware
enhance the value of server virtualization using VMware ESX/ESXi 4.0. Such
features include virtual adapter configuration using N_Port ID virtualization (NPIV)
and boot-from-SAN configuration.
®
. It also provides details on the use of QLogic adapter features to
What’s in This Guide
This guide is organized into the following sections and appendices:
This Preface describes the intended audience, related materials, document
conventions used, license agreements, technical support, and legal notices.
The Quick Start section provides high-level hardware and software
installation instructions for advanced users.
The Product Overview provides a product introduction and specifications;
information about the multi-boot image (CNA Function Configuration Utility);
and detailed installation instructions for the SuperInstaller and vCenter
Plug-in for ESX/ESXi.
The Configuring NIC section describes installing the NIC driver and agent
across operating systems (OSs); configuring the PXE boot; how to use
driver parameters, VLANs, and teaming/bonding; and troubleshooting NIC
issues.
®
, Linux®, and
The Configuring iSCSI section describes installing the iSCSI driver and
agent across OSs; configuring iSCSI; how to use the iSCSI initiator, ISNS,
and iSCSI boot; and troubleshooting iSCSI issues.
The Configuring FCoE section describes installing the Fibre Channel over
Ethernet (FCoE) driver and agent across OSs; setting HBA parameters;
configuring the boot device, NPIV, driver parameters, and selective LUNs;
and troubleshooting FCoE issues.
The Glossary describes many of the terms used in this guide.
SN0054671-00 A xi
Preface
Intended Audience
Intended Audience
This guide is intended for those responsible for deploying QLogic Fibre Channel
and Converged Network Adapters on Windows, Linux, and VMware: users
ranging from end users, such as data center managers and system
administrators, to the test and development community.
Related Materials
For additional information, refer to the 8200 and 3200 Series Adapters Read Me
and Release Notes files, the QConvergeConsole User’s Guide, and the
QConvergeConsole CLI User’s Guide, available on the QLogic Web site,
Downloads page: http:\\driverdownloads.qlogic.com
Documentation Conventions
This guide uses the following documentation conventions:
.
NOTE: provides additional information.
CAUTION!
causing damage to data or equipment.
WARNING!!
causing personal injury.
Tex t in blue font indicates a hyperlink (jump) to a figure, table, or section in
this guide, and links to Web sites are shown in underlined blue
example:
Table 9-2 lists problems related to the user interface and remote agent.
See “Installation Checklist” on page 3-6.
For more information, visit www.qlogic.com
Tex t in bold font indicates user interface elements such as a menu items,
buttons, check boxes, or column headings. For example:
Click Start, point to Programs, point to Accessories, and then click
Under Notification Options, select the Warning Alarms check box.
Tex t in Courier font indicates a file name, directory path, or command line
text. For example:
indicates the presence of a hazard that has the potential of
indicates the presence of a hazard that has the potential of
. For
.
Command Prompt.
To return to the root directory from anywhere in the file structure:
Type
cd /root and press <ENTER.
Enter the following command: sh ./install.bin
xii SN0054671-00 A
Preface
License Agreements
Key names and key strokes are indicated with UPPERCASE:
Press the CTRL+P keys.
Press the UP ARROW key.
Tex t in italics indicates terms, emphasis, variables, or document titles. For
example:
For a complete listing of license agreements, refer to the QLogic
Software End User License Agreement.
What are shortcut keys?
To enter the date type mm/dd/yyyy (where mm is the month, dd is the
day, and yyyy is the year).
Topic titles between quotation marks identify related topics either within this
manual or in the online help, which is also referred to as the help system
throughout this document.
License Agreements
Refer to the QLogic Software End User License Agreement for a complete listing
of all license agreements affecting this product.
Technical Support
Customers should contact their authorized maintenance provider for technical
support of their QLogic products. QLogic-direct customers may contact QLogic
Technical Support; others will be redirected to their authorized maintenance
provider.
Visit the QLogic support Web site listed in Contact Information for the latest
firmware and software updates.
QLogic Technical Support for products under warranty is available during local
standard working hours excluding QLogic Observed Holidays. For customers with
extended service, consult your plan for available hours.
For details about available service plans, or for information about renewing and
extending your service, visit the Service Program web page at
http://www.qlogic.com/services
.
SN0054671-00 A xiii
Preface
Technical Support
Training
QLogic offers training for technical professionals for all iSCSI, Converged
Network, InfiniBand, and Fibre Channel products. From the main QLogic web
page at www.qlogic.com
Certification on the left. The QLogic Global Training Portal offers online courses,
certification exams, and scheduling of in-person training.
Technical Certification courses include installation, maintenance and
troubleshooting QLogic products. Upon demonstrating knowledge using live
equipment, QLogic awards a certificate identifying the student as a certified
professional. You can reach the training professionals at QLogic by e-mail at
training@qlogic.com
Contact Information
, click the Support tab at the top, then click Training and
.
Support Headquarters
QLogic Web Site
Technical Support Web Site
Technical Support E-mail
Technical Training E-mail
For Support phone numbers, see the Contact Support link at support.qlogic.com.
Knowledge Database
The QLogic knowledge database is an extensive collection of QLogic product
information that you can search for specific solutions. We are constantly adding to
the collection of information in our database to provide answers to your most
urgent questions. Access the database from the QLogic Support Center:
http://support.qlogic.com
QLogic Corporation
4601 Dean Lakes Blvd.
Shakopee, MN 55379 USA
www.qlogic.com
http://support.qlogic.com
support@qlogic.com
training@qlogic.com
.
xiv SN0054671-00 A
Legal Notices
CLASS I LASER
Warranty
For warranty details, please check the QLogic Web site at
http://www.qlogic.com/Support/Pages/Warranty.aspx
Laser Safety
FDA Notice
This product complies with DHHS Rules 21CFR Chapter I, Subchapter J. This
product has been designed and manufactured according to IEC60825-1 on the
safety label of laser product.
Class 1 Laser Product Caution—Class 1 laser radiation when open
Appareil laser de classe 1 Do not view directly with optical instruments
Produkt der Laser Klasse 1
Luokan 1 Laserlaite Attention—Radiation laser de classe 1
Preface
Legal Notices
.
Ne pas regarder directement avec des instruments
optiques Vorsicht—Laserstrahlung der Klasse 1
bei geöffneter Abdeckung
Direktes Ansehen mit optischen Instrumenten
vermeiden
Agency Certification
The following sections contain a summary of EMC/EMI test specifications
performed on the QLogic adapters to comply with radiated emission, radiated
immunity, and product safety standards.
EMI and EMC Requirements
FCC Part 15 compliance: Class A (QLE8xxx)
information statement: This device complies with Part 15 of the FCC Rules.
Operation is subject to the following two conditions: (1) this device may not cause
harmful interference, and (2) this device must accept any interference received,
including interference that may cause undesired operation.
ICES-003 compliance: Class A (QLE8xxx) This Class A digital apparatus
complies with Canadian ICES-003.Cet appareil numériqué de la classe A est
conformé à la norme NMB-003 du Canada.
Varoitus—Luokan 1 lasersäteilyä, kun laite on auki
Älä katso suoraan laitteeseen käyttämällä optisia
instrumenttej
FCC compliance
SN0054671-00 A xv
Preface
Legal Notices
CE Mark 2004/108/EC EMC Directive compliance:
EN55022:2006+A1:2007/CISPR22:2006: Class A (QLE8xxx)
EN55024:1998
EN61000-3-2: Harmonic Current Emission
EN61000-3-3: Voltage Fluctuation and Flicker
Immunity Standards
EN61000-4-2: ESD
EN61000-4-3: RF Electro Magnetic Field
EN61000-4-4: Fast Transient/Burst
EN61000-4-5: Fast Surge Common/ Differential
EN61000-4-6: RF Conducted Susceptibility
EN61000-4-8: Power Frequency Magnetic Field
EN61000-4-11: Voltage Dips and Interrupt
VCCI: 2009-04 Class A (QLE8xxx)
AS/NZS CISPR22: Class A (QLE8xxx)
CNS 13438: Class A (QLE8xxx)
This is a Class A product. In a domestic environment, this product may cause radio
interference, in which case, the user may be required to take adequate measures.
MIC: Class A
Korea RRA Class A Certified
A class equipment
(Business purpose info/telecommunica-
tions equipment)
Product Name/Model Fibre Channel Adapter
Certification holder—QLogic Corporation
Manufactured date—Refer to date code listed
on product
Manufacturer/Country of origin QLogic
Corporation/USA
As this equipment has undergone EMC registration for
business purpose, the seller and/or the buyer is asked
to beware of this point and in case a wrongful sale or
purchase has been made, it is asked that a change to
household use be made.
xvi SN0054671-00 A
Korean Language Format— Class A
Product Safety Compliance
UL, cUL product safety: 8200 and 3200 Series Adapters
UL60950-1 (2
UL CSA C22.2 60950-1-07 (2nd Edition)
Use only with listed ITE or equivalent.
Complies with 21 CFR 1040.10 and 1040.11.
2006/95/EC low voltage directive: 8200 and 3200 Series Adapters
TUV:
EN60950-1:2006+A11 2nd Edition
EN60825-1:1994+A1+A2
EN60825-2:2004+A1
IEC60950-1 2nd Edition (2005) CB
nd
Edition), 2007-03-3-27
Preface
Legal Notices
CB Certified to IEC 60950-1 2nd Edition
SN0054671-00 A xvii
Preface
Legal Notices
xviii SN0054671-00 A
Quick Start
Installation Instructions
This Quick Start section describes how to install and configure your new QLogic
converged network adapter in four simple steps:
Step 1. Verify the Package Contents
Step 2. Install the Adapter Hardware
Step 3. Install the Adapter Drivers
Step 4. Install QConvergeConsole™
CAUTION!
Keep the adapter in the antistatic bag until installation. The adapter contains
parts that can be damaged by electrostatic discharge (ESD). Before
handling the adapter, use standard methods to discharge static electricity.
Place the adapter on the bag when examining it. Retain the bag for future
use.
Step 1. Verify the Package Contents
The QLogic adapter is shipped with the following items:
Low-profile bracket
For more information on the 8200 Series Adapter package contents, go to the
following link, select Show+ under the QLogic 8200 Series, and then select
Ordering Information.
http://www.qlogic.com/Products/adapters/Pages/ConvergedNetworkAdapters.aspx
For more information on the 3200 Series Adapter package contents, go to the
following link, select Show+ under the QLogic 3200 Series, and then select
Ordering Information.
http://www.qlogic.com/Products/adapters/Pages/IntelligentEthernetAdapters.aspx
SN0054671-00 A PRELIMINARY xix
Quick Start
ADAPTER
RETAINING
BRACKET
LEVER
SLOT COVERS
SYSTEM
CHASSIS
PCI EXPRESS
x8 (OR
LARGER) SLOT
REQUIRED
FOR QLOGIC
ADAPTERS.
SCREW
ADAPTER
Step 2. Install the Adapter Hardware
Step 2. Install the Adapter Hardware
To install the adapter hardware, you need to open the computer and locate the
appropriate bus slot. If necessary, consult your computer system manual for
instructions on how to remove the computer cover.
Follow these steps to install the adapter hardware:
1. Power off the computer and all attached devices such as monitors, printers,
and external components.
2. Disconnect the power cable.
3. Remove the computer cover and find an empty PCIe
4. Pull out the slot cover (if any) by removing the screw or releasing the lever.
5. Install the low-profile bracket (if required).
6. Grasp the adapter by the top edge and seat it firmly into the appropriate slot
(see Figure i).
®
x8 (or larger) bus slot.
xx PRELIMINARY SN0054671-00 A
Figure i Illustration of Server Motherboard and Slots
7. Refasten the adapter’s retaining bracket using the existing screw or lever.
8. Close the computer cover.
9. Plug the appropriate Ethernet cable (either copper or optical) into the
adapter.
Optical models ship with optical transceivers already installed. The
8200 and 3200 Series Adapters will only operate with optical
transceivers sold by QLogic.
For copper connectivity, see the list of approved SFP+ direct-attach
copper cables on QLogic's Web site:
http://www.qlogic.com/Resources/Documents/LineCards/Copper_Cabl
es_Support_Matrix_Line_Card.pdf
10. Plug in the power cable and turn on the computer.
Step 3. Install the Adapter Drivers
To install the adapter drivers:
1. Go to the QLogic Driver Downloads/Documentation page at
http://driverdownloads.qlogic.com
.
Quick Start
Step 3. Install the Adapter Drivers
2. Locate the appropriate driver package for the adapter product, as follows:
8200 Series Adapters: Click QLogic Products. Select Converged
Network Adapters, the appropriate adapter model, and your
operating system. Click Go. The product download page opens.
3200 Series Adapters: Click QLogic Products. Select Intelligent
Ethernet Adapters, the appropriate adapter model, and your
operating system. Click Go. The product download page opens.
3. On the download page under Drivers, select the appropriate driver and
download it to your system.
4. Follow the installation instructions included in the Readme file for the
downloaded driver.
SN0054671-00 A PRELIMINARY xxi
Quick Start
Step 4. Install QConvergeConsole
™
Step 4. Install QConvergeConsole
To install QConvergeConsole:
1. Go to the QLogic Driver Downloads/Documentation page at
http://driverdownloads.qlogic.com
2. Locate the QConvergeConsole package for the adapter product, as follows:
8200 Series Adapters: Click QLogic Products. Select Converged
Network Adapters, the appropriate adapter model, and your
operating system. Click Go. The product download page opens.
3200 Series Adapters: Click QLogic Products. Select Intelligent
Ethernet Adapters, the appropriate adapter model, and your
operating system. Click Go. The product download page opens.
3. On the download page under Tools, select the appropriate
QConvergeConsole package (GUI or CLI) and download it to your system.
4. Follow the instructions in the QConvergeConsole readme file for installing
the downloaded software.
.
Additional Resources
To obtain the most current drivers, management tools, user instructions, and
documentation, please visit the QLogic Web site at
http://driverdownloads.qlogic.com
and download the latest versions.
™
See What’s in This Guide for descriptions of user instructions provided in
this document.
For important product information, including warranty, laser safety, and
agency certification, and see the Legal Notices section.
For descriptions and procedures related to QConvergeConsole, use the
built-in help system.
xxii PRELIMINARY SN0054671-00 A
1 Product Overview
What is a Converged Network Adapter?
A Converged Network Adapter is a multifunction adapter that combines the
capabilities of a Fibre Channel adapter and an Ethernet NIC. A Converged
Network Adapter provides simultaneous Fibre Channel and Ethernet traffic over a
shared 10Gb Ethernet link.
What is an Intelligent Ethernet Adapter?
The Intelligent Ethernet Adapter is a multifunction adapter that supports one
Ethernet functions per port (default) and can be expanded to four Ethernet
functions per port.
Functionality and Features
This section provides the following information:
Functional Description
Features
Supported Operating Systems
Functional Description
The 8200 Series Adapters are Converged Network Adapters, and the 3200 Series
Adapters are Intelligent Ethernet Adapters (IEA). The 8200 Series Adapters
support 210GbE Enhanced Ethernet, FCoE, and iSCSI. The 3200 Series
Adapters support 210GbE Enhanced Ethernet ports.
Features
The 8200 and 3200 Series Adapters provide the following features:
NIC partitioning
Message signaled interrupts (MSI-X)
Device management for LAN and SAN
SN0054671-00 A 1-1
1–Product Overview
Functionality and Features
Multi-boot capability including:
Preboot-eXecution environment (PXE)
iSCSI (8200 Series Adapters only)
Fibre Channel (8200 Series Adapters only)
Unified extensible firmware interface (UEFI)
PCIe 2.0 8
User diagnostics that can be run from the CLI and the GUI
Ethernet functions include:
210 GbE
Priority and virtual LAN (VLAN) tagging
Jumbo frames up to 9618 bytes
Advanced teaming
VLAN configuration and management
Preservation of teaming and VLAN configuration information during
driver upgrade
Enhanced Ethernet functions include:
Priority-based flow control (802.1Qbb)
Enhanced transmission selection (802.1Qaz)
Data center bridging exchange protocol (802.1Qaz)
Advanced stateless offload features include:
IP, TCP, and UDP checksums
Large send offload (LSO)
Large receive offload (LRO)
Stateful offload features (8200 Series Adapters only) include:
iSCSI
FCoE
Several advanced management features for iSCSI and Fibre Channel
adapters, including QConvergeConsole (QCC) (GUI and CLI) and NIC
partitioning (NPAR)
Interrupt management and scalability features including:
Receive side scaling (RSS)
Interrupt moderation
1-2 SN0054671-00 A
Flow control
Locally Administered Address (LAA)
Enhanced optimization with MSI, MSI-X, and NetQueue
Supported Operating Systems
1–Product Overview
Adapter Specifications
The 8200 and 3200 Series adapters support commonly used operating systems:
Windows, Linux, Solaris
For a detailed list of the currently supported operating systems, refer to the
adapter’s Readme and Release Notes on the QLogic Web site:
http://driverdownloads.qlogic.com
®
and ESX®.
Adapter Specifications
Physical Characteristics
The 8200 and 3200 Series Adapters are implemented as low-profile PCIe cards.
The adapters ship with a full-height bracket for use in a standard PCIe slot or an
optional spare low-profile bracket for use in a low-profile PCIe slot. Low-profile
slots are typically found in compact servers.
Standards Specifications
The 8200 and 3200 Series adapters support the following standards
specifications:
IEEE: 802.3ae (10 Gb Ethernet)
IEEE: 8021q (VLAN)
IEEE: 802.3ad (Link Aggregation)
IEEE: 802.1p (Priority Encoding)
IEEE: 802.3x (Flow Control)
IEEE: 802.1Qbb (Priority Based Flow Control)
IEEE: 802.1Qaz (Enhanced Transmission Selection)
IPv4 Specification (RFC791)
IPv6 Specification (RFC2460)
TCP/UDP Specification (RFC793/768)
ARP Specification (RFC826)
SCSI-3 Fibre Channel Protocol (SCSI-FCP)
Fibre Channel Tape (FC-TAPE) Profile
SCSI Fibre Channel Protocol-2 (FCP-2)
Second Generation FC Generic Services (FC-GS-2)
Third Generation FC Generic Services (FC-GS-3)
iSCSI (RFC3720)
SN0054671-00 A 1-3
1–Product Overview
Adapter Specifications
Environmental Specifications
Table 1-1. Environmental Specifications
Condition Operating Non-Operating
Temperature Ranges
(for Altitude=900 m or 2952.75 ft)
Temperature Ranges
(for Altitude >900 m or 2952.75 ft)
Temperature Gradient Maximum
10°C to 55°C
(50°F to 131°F)
10°C to n°C
(50°F to n°F
10°C 20°C
a
–40°C to 65°C
(–40°C to 149°F)
b
c
)
–40°C to 65°C
(–40°F to 149°F)
per 60 Min.
Humidity Percent Ranges—Noncondensing
Humidity Gradient Maximum
20% to 80%
(Max Wet bulb temper-
ature= 29°C)
d
10% 10%
5% to 95%
(Max Wet bulb tempera-
ture= 38°C)
d
per 60 Min.
Altitude Ranges—Low Limits –15.2m (–50 ft) –15.2m (–50 ft)
Altitude Ranges—High Limits 3,048m (10,000 ft) 10,668m (35,000 ft)
Airborne Contaminants—ISA-71
G1
d
G1
d
Level
a
200LFM is required to operate at this temperature.
b
Use the following formulas to calculate the maximum operating temperature (in °C) for a specific
altitude. Use the first formula if the altitude is stated in meters and the second formula if the altitude
is stated in feet.
c
Use the following formulas to calculate the maximum operating temperature (in °F) for a specific
altitude. Use the first formula if the altitude is stated in meters and the second formula if the altitude
is stated in feet.
d
Maximum corrosive contaminant levels measured at =50% relative humidity; see Table 3 in
ISA-71.04-1985.
1-4 SN0054671-00 A
1–Product Overview
Converged Network Adapter SuperInstaller Installation
Converged Network Adapter SuperInstaller
Installation
QLogic Windows SuperInstaller
Refer to the QLogic Windows SuperInstaller Readme file for information.
QLogic Linux SuperInstaller
Refer to the QLogic Linux SuperInstaller Readme file for information.
Multi-boot Image for 10Gb CNA—CNA Function
Configuration Utility
This section contains the following information:
Operating System Support
Multi-boot Package Contents
Converged Network Adapter Function Configuration Package Contents
Using QLflash
Updating the Multi-boot Code
QLflash Command Line Options
Adapter Configuration (CNA/IEA Function Configuration Utility)
For an alternate method of iSCSI boot from SAN (3200 Series Adapters only), use
the fields in the iSCSI Boot Firmware Table (iBFT). iBFT is a component of the
advanced configuration and power interface specification (ACPI) 3.0b standard
that provides operating systems a standard way to boot from software-initiated
iSCSI protocol. To view the iBFT specification, see the following Web page:
http://www.microsoft.com/whdc/system/platform/firmware/ibft.mspx
Operating System Support
This multi-boot code supports DOS, Windows Server® 2008; Solaris x86; and
Linux on IA32, AMD64, and Intel
for operating system (OS) information.
Multi-boot Package Contents
The multi-boot package for 10Gb adapters is a compressed file that contains the
82xx/32xx BIOS, UEFI, PXE, and firmware. This package also includes the
QLflash application.
®
x64-based systems. Refer to the Readme file
SN0054671-00 A 1-5
1–Product Overview
Multi-boot Image for 10Gb CNA—CNA Function Configuration Utility
Converged Network Adapter Function Configuration Package
Contents
The following files are included for updating the adapter multi-boot code:
update.bat—DOS batch file that calls the executable files to update the
adapter multi-boot.
QLflash.exe—Utility to update multi-boot code and firmware.
DOS4GW.exe—This file is required to use the QLflash.exe.
p3pyyyyy.bin—Combined binary file, which includes the binaries for the
BIOS, UEFI, PXE, and firmware.
Using QLflash
QLflash is a native DOS utility. Refer to the Readme file for more information. To
run this utility, boot to a DOS hard drive or USB removable drive.
Utility Version:
/VER = Display version of the QLflash utility
Help Options:
/? = Help menu
Updating the Multi-boot Code
To write the multi-boot code to Flash memory:
1. Insert the 10Gb adapter in the system.
2. Boot to DOS.
3. Run the update script at the command prompt:
C:\>update.bat
This script program updates the multi-boot image on the adapter.
4. Reboot the system.
NOTE:
You can also use QCC GUI/CLI to flash the multi-boot image. After the
multi-boot code is updated, power cycle the server for the new changes to
take effect.
1-6 SN0054671-00 A
Multi-boot Image for 10Gb CNA—CNA Function Configuration Utility
QLflash Command Line Options
The executable file QLflash.exe is used by the UPDATE.BAT file to update your
adapter multiboot-code. The application QLflash.exe may be used to read,
write, or verify either the multi-boot image or the NVRAM on the adapter.
The following paragraphs describe the command line options available with this
utility. Use of QLflash will modify the way your adapter operates, and it must be
used with extreme caution.
Certain features (that is, the NVRAM options) may require additional data.
Files and passwords are not provided in this file.
QLflash Options
QLflash.exe <1...N | ALL> [options]
/SLT
SLT: Sets the application to silent mode
Use application return code for success or failure
1–Product Overview
/SIL=filename.ext
SIL: Load multiflash image from file
/PRV | /VPP | /PRN
PRV: Print firmware versions
VPP: Print VPD contents
PRN: Print MAC addresses and WWPN
/CFU=filename.ext | /CFS=filename.ext | /CFC=filename.ext
CFU: Flash board configuration from file
CFS: Save board configuration file (need template file BRDCFG.DAT)
CFC: Compare board configuration to a binary file
/NVU=filename.ext | /NVS=filename.ext | /NVC=filename.ext
NVU: Flash NVRAM from file
NVS: Save NVRAM to file (need template file NVRAM.DAT)
NVC: Compare Flash to NVRAM file
/UIL=filename.ext | /UIS=filename.ext | /UIC=filename.ext
UIL: Flash user info data from file
UIS: Save user info data to file
UIC: Compare user info data to a binary file
SN0054671-00 A 1-7
1–Product Overview
Multi-boot Image for 10Gb CNA—CNA Function Configuration Utility
NOTE:
If you used an FC RAID target in a cluster environment, you should
enable the Enable Target Reset = Enabled (Advanced
Adapter Settings).
Use the /I option if the update utility, QLflash, does not detect your
adapter.
QLogic recommends disabling the internal disk before installing the OS
or booting to the FCoE disk.
Adapter Configuration (CNA/IEA Function Configuration
Utility)
NOTE:
The CNA Function Configuration utility does not run on SUN™ SPARC
systems.
®
This section provides detailed configuration information for advanced users who
want to customize the configuration of the 10Gb adapter and the connected
devices. You can configure the adapter using the CNA Function Configuration
utility.
To access the CNA Function Configuration utility, press ALT+ Q during the
adapter initialization (it may take a few seconds for the menu to appear). If you
have more than one adapter, the utility will ask you to select the adapter you want
to configure. After changing the settings, the utility reboots your system to load the
new parameters.
CAUTION!
If the configuration settings are incorrect, your adapter may not function
properly.
Upon entering the CNA Function Configuration utility, the following selections are
available from the Setup Menu/Function Configuration menu:
Function
Type
MinBW%
Protocol
Restore to Non-NIC Partition Settings
Exit the CNA Function Configuration Utility
1-8 SN0054671-00 A
Function
1–Product Overview
Multi-boot Image for 10Gb CNA—CNA Function Configuration Utility
The Function parameter applies only to only function 0 and function 1. Press the
ENTER key to configure either PXE or iBFT settings. (The Function option is
predicated on the Protocol that is selected.)
Adapter Settings
Press the ENTER key on the Function number to access Adapter Settings, and to
configure PXE Boot or iBFT.
PXE. The following are available when Protocol is set to PXE:
Setup Menu Wait Time (0–15: the default is 5 seconds)
Specifies the time in seconds the menu will wait.
Enable PXE Boot (Enabled/Disabled: Default—Disabled)
Enter to toggle between Enabled and Disabled. Use the Enable PXE
Boot option to attempt a PXE boot on the selected function.
NOTE:
For an embedded LAN on motherboard (LOM), the Enable PXE Boot
parameter is controlled by the system BIOS and is non-configurable in
the CNA Function Configuration utility.
iBFT. The following parameters are available when Protocol is set to iBFT:
Enable ROM (Enabled/Disabled: Default—Enabled)
Enter to toggle between Enabled and Disabled. Use the Enable ROM
option to attempt iBFT boot on the selected function.
NOTE:
For an embedded LOM, the Enable PXE Boot parameter is controlled
by the system BIOS and is non-configurable in the CNA Function
Configuration utility.
IP Format (IPv4/IPv6: Default —IPv4)
Enter to specify IPv4 or IPv6 address format.
VLAN Mode (Enabled/Disabled: Default—Disabled)
This setting enables VLAN.
VLAN ID (2 – 4095: Default—2)
Enter to specify the VLAN ID.
SN0054671-00 A 1-9
1–Product Overview
Multi-boot Image for 10Gb CNA—CNA Function Configuration Utility
Initiator Settings
Enable DHCP (Enabled/Disabled: Default—Enabled)
When Enable DHCP is set to Enabled, the adapter utilizes DHCP to obtain
its IP address, subnet mask, and gateway IP address.
Target Param From DHCP (Enabled/Disabled: Default—Enabled)
When Target Param From DHCP is set to Enabled, the adapter uses
DHCP to obtain the target IP address, subnet mask, and gateway IP
address.
Initiator Name (Programmed during manufacturing)
Enter to modify the iSCSI name of the initiator.
Initiator IP Address
When Enable DHCP is set to Disabled, this field must contain a valid IP
address.
Initiator Subnet Mask
When Enable DHCP is set to Disabled, this field must contain a valid
subnet mask.
Gateway
When Enable DHCP is set to Disabled, this field must contain a valid
gateway address.
Reverse CHAP Name
Enter to configure bidirectional CHAP name.
Reverse CHAP Secret
Enter to configure Bidirectional CHAP secret.
Primary/Secondary Target Settings
When Target Param From DHCP is set to Disabled, enter to manually
configure the target parameters.
Target Name
Enter to specify the iSCSI name of the intended boot target. (Depending on
your configuration, it may not be necessary to configure this option).
Target IP Address
This field must contain a valid IP address of the intended iSCSI boot target.
Target Port
Enter to specify the port used by the target. (By default, iSCSI uses
port 3260—do not modify this unless it is necessary.)
1-10 SN0054671-00 A
Type
1–Product Overview
Multi-boot Image for 10Gb CNA—CNA Function Configuration Utility
Boot LUN
Enter to specify the LUN of the boot device. (Depending on your
configuration, it may not be necessary to change this option.)
CHAP Type
None—CHAP is not used.
One-Way—Unidirectional CHAP is used.
Mutual—Bidirectional CHAP is used.
Target CHAP Name
Enter to specify the target CHAP name.
Target CHAP Secret
Enter to specify the target CHAP secret.
Enter to set a function to a particular type.
NIC—NIC protocols will be supported.
None—The function will be disabled.
iSCSI—The function will support iSCSI protocol.
FCoE—The function will support FCoE protocol.
NOTE:
Functions 0 through 3 support only NIC or None. Functions 4 and 5 support
NIC, iSCSI, or None. Functions 6 and 7 support NIC, FCoE, or None.
MinBW%
Enter to specify the percentage of bandwidth allocated to the function. The
combined MinBW% values for a port’s functions cannot exceed 100 percent.
Protocol
The Protocol parameter applies only to only function 0 and function 1.
PXE—PXE will be supported on the NIC.
iBFT—iBFT will be supported on the NIC.
NOTE:
For an embedded LOM, the Protocol parameter is controlled by the system
BIOS and is non-configurable in the CNA Function Configuration utility.
Restore to Non-NIC Partition Settings
Press the ENTER key to restore the NIC partition settings.
SN0054671-00 A 1-11
1–Product Overview
Installing the QLogic Adapter vCenter Plug-in for ESX/ESXi
Exit the CNA Function Configuration Utility
Press the ENTER key to select from the following:
Reboot System
Return to Fast!UTIL
Installing the QLogic Adapter vCenter Plug-in for
ESX/ESXi
This section on installing the QLogic Adapter vCenter Plug-in contains the
following:
Introduction
Requirements
Installing the QLogic Adapter CIM Provider
Starting the QLogic Adapter CIM Provider
Removing the QLogic Adapter CIM Provider
Starting the QLogic Adapter vCenter Plug-in
Removing the QLogic Adapter vCenter Plug-in
Installing the Flash Utility
Updating the Flash
Using the vCenter Plug-in on a Tomcat Server
Plug-in Unregistration from a Manual Installation
Launching the Plug-in from vSphere Client
1-12 SN0054671-00 A
Introduction
The QLogic Adapter vCenter Plug-in is a user-interface extension to the
vSphere™ Client that allows you to manage and configure QLogic adapters,
including the NIC partitioning feature, on ESX and ESXi servers. When the you
select an ESX or ESXi host that has QLogic adapters installed, the extension
appears in the client as an additional tab named QLogic Adapter, as shown in
Figure 1-1.
1–Product Overview
Installing the QLogic Adapter vCenter Plug-in for ESX/ESXi
Figure 1-1. vSphere Client Showing QLogic Adapter Tab
SN0054671-00 A 1-13
1–Product Overview
Installing the QLogic Adapter vCenter Plug-in for ESX/ESXi
Requirements
The QLogic Adapter vCenter Plug-in requires the components in Figure 1-2 to be
installed and running.
Figure 1-2. vCenter Plug-in Requirements
QLogic provides the following components that must be installed on the ESX or
ESXi Server, vCenter Server, and Tomcat Web Server.
ESX/ESXi Server
QLogic adapters with firmware and driver.
QLogic Adapter CIM Provider
NOTE:
For the latest versions of QLogic firmware, drivers, and QLogic CIM
Provider, please refer to the Release Notes on the QLogic Web site:
http:\\driverdownloads.qlogic.com
1-14 SN0054671-00 A
Installing the QLogic Adapter vCenter Plug-in for ESX/ESXi
vCenter Server
QLogic XML configuration file to register the plug-in to the vCenter Server
Tomcat Web Server
QLogic Web-based extension to the vSphere Client
Installing the QLogic Adapter CIM Provider
The QLogic Adapter CIM Provider for VMware ESX was generated as a vSphere
Installation Bundle (VIB) file. A VIB contains the complete set of files and binaries
required to install the provider on VMware ESX/ESXi. The
offline-bundle.zip file contains the VIB and the necessary metadata to
install the provider on VMware ESX/ESXi.
This section provides the following installation procedures for the CIM Provider:
Initial Installation
Subsequent Update Installation
Initial Installation
To install the QLogic Adapter CIM Provider using the esxupdate command (ESX
systems only):
1–Product Overview
1. Copy the offline-bundle.zip file into the root directory (/) of the ESX
system.
2. Issue the esxupdate command as follows:
# cd /
# esxupdate --bundle offline-bundle.zip --nodeps –nosigcheck
--maintenancemode update
To install the QLogic Adapter CIM Provider from a remote host using the vSphere
CLI vihostupdate command (ESXi systems only):
NOTE:
To update the provider from a remote host using the vihostupdate
command, make sure that the ESXi system is in Maintenance Mode. To put
the ESXi host in Maintenance Mode using vSphere Client, select Inventory,
select Host, and then select Enter Maintenance Mode.
1. Copy the offline-bundle.zip file to any location on the host where
either the vSphere CLI package is installed or vSphere Management
Assistant (vMA) is hosted.
2. Navigate to the location of the offline-bundle.zip file.
SN0054671-00 A 1-15
1–Product Overview
Installing the QLogic Adapter vCenter Plug-in for ESX/ESXi
3. Issue the vihostupdate command to install the offline bundle as follows:
# vihostupdate.pl <conn_options> --install --bundle
offline-bundle.zip --nosigcheck
For available options, refer to the vihostupdate page.
4. Follow the on-screen instructions to complete the installation. You may need
to reboot the ESXi system.
NOTE:
For more details on vihostupdate, refer to the documents on the VMware
vSphere Command-Line Interface Documentation page, located here:
h
ttp://www.vmware.com/support/developer/vcli/
Subsequent Update Installation
To update the QLogic Adapter CIM Provider after a prior VIB installation:
1. Follow the instructions in the Removing the QLogic Adapter CIM Provider
section to remove the existing VIB.
2. Follow the instructions in the Initial Installation section to install the new VIB.
Starting the QLogic Adapter CIM Provider
After a system startup, the Small Footprint CIM Broker (SFCB) CIM object
manager (CIMOM) in the ESX system should start automatically and load the
QLogic Adapter CIM Provider when necessary.
For ESX systems, you can also manually stop, start, or restart the SFCB CIMOM
by issuing the following commands.
To stop the SFCB CIMOM and the QLogic Adapter CIM Provider:
# /etc/init.d/sfcbd-watchdog stop
To start the SFCB CIMOM and the QLogic Adapter CIM Provider:
# /etc/init.d/sfcbd-watchdog start
To restart the SFCB CIMOM and the QLogic Adapter CIM Provider:
# /etc/init.d/sfcbd-watchdog restart
After starting the SFCB CIMOM, use a CIM client utility to query the QLogic
Adapter CIM Provider for information.
1-16 SN0054671-00 A
Installing the QLogic Adapter vCenter Plug-in for ESX/ESXi
Removing the QLogic Adapter CIM Provider
To remove the QLogic Adapter CIM Provider, use either the esxupdate or
vihostupdate command.
To uninstall the QLogic Adapter CIM Provider using the esxupdate command:
1. Query and find the existing VIB you are updating as follows:
# esxupdate query --vib-view | grep qlogic
For example, the VIB ID may have a format similar to the following:
ESX/ESXi 4.0: cross_qlogic-nic-provider_400.x.x.x-000000
ESX/ESXi 4.1: cross_qlogic-nic-provider_410.x.x.x-000000
where x.x.x is the version number of the existing provider.
2. Remove the existing VIB as follows:
# esxupdate remove -b <vibID>
1–Product Overview
To uninstall from a remote host using the vihostupdate command:
NOTE:
To uninstall the provider from a remote host using the vihostupdate
command, make sure that the ESX/ESXi system is in Maintenance Mode.
To put the ESX/ESXi host in Maintenance Mode using vSphere Client, select
Inventory, select Host, and then select Enter Maintenance Mode.
1. From a console on the host where the vSphere CLI package is installed or
vMA is hosted, query to find the Bulletin ID of the existing provider:
# vihostupdate.pl <conn_options> --query\
For example, the Bulletin ID may have a format similar to the following:
ESX/ESXi 4.0: QLGC_NIC_PROVIDER-ESX-4.0.0-qlogic-nic-provider-x.x.x
ESX/ESXi 4.1: QLGC_NIC_PROVIDER-ESX-4.1.0-qlogic-nic-provider-x.x.x
where x.x.x is the version number of the existing provider.
2. Remove the existing VIB as follows:
# vihostupdate.pl <conn_options> --remove --bulletin
<bulletinID>
SN0054671-00 A 1-17
1–Product Overview
Installing the QLogic Adapter vCenter Plug-in for ESX/ESXi
NOTE:
For more details on vihostupdate, refer to the documents on the
VMware vSphere Command-Line Interface Documentation page,
located here:
http://www.vmware.com/support/developer/vcli/
Starting the QLogic Adapter vCenter Plug-in
To start the QLogic Adapter vCenter Plug-in:
1. Start the VMware vSphere Client and connect to the vCenter Server by
entering the IP address or name, user name, and password.
2. Click Login.
3. If the Security Warning dialog box appears, click Ignore to use the current
SSL certificate.
If you start and connect the vSphere Client directly to an ESX/ESXi
server, the vCenter plug-in does not open.
If you have not already done so, create a data center and add the ESX
server.
4. In the left pane, select the IP address of the VMware server.
5. In the right pane, click the QLogic Adapter tab to view the Web page.
The vCenter plug-in retrieves the adapter information from the server.
NOTE:
If the server does not have the QLogic Adapter CIM Provider and
adapters installed, or if the vCenter Plug-in installation and registration
was not successful, the QLogic Adapter tab is not shown.
Removing the QLogic Adapter vCenter Plug-in
To remove the QLogic Adapter vCenter Plug-in:
1. In the Windows Control Panel, select Add or Remove Programs.
2. In the Add or Remove Programs dialog box, select the QLogic Adapter
vCenter Plug-in, and then click Change/Remove.
3. Follow the instructions in the QLogic Adapter vCenter Plug-in installer to
remove the plug-in.
1-18 SN0054671-00 A
Installing the Flash Utility
For ESX, before you perform a Flash update on QLogic Adapters using the
QLogic Adapter vCenter Plug-in, ensure that the QLflash utility is also installed on
the ESX system.
To install the QLflash utility on ESX:
1. Unzip the esx_qlflash.zip file, which contains the qlflash
userworld executable.
2. Copy the QLflash binary file to the /usr/lib/vmware/bin/ directory.
3. Add executable permission for QLflash by issuing the following command:
# chmod +x qlflash
4. If it does not already exist, edit and append the
/usr/lib/vmware/bin/qlflash entry in the
/etc/vmware/UserWorldBinaries.txt file.
For ESXi, the QLflash utility is not required, so no additional steps are necessary.
1–Product Overview
Installing the QLogic Adapter vCenter Plug-in for ESX/ESXi
Updating the Flash
NOTE:
For ESX systems, before you perform a Flash update on QLogic Adapters
using the QLogic Adapter vCenter Plug-in, ensure that the QLflash utility is
also installed. Follow the instructions in the Installing the Flash Utility
section.
To update the Flash from the QLogic Adapter vCenter Plug-in:
1. Follow the instructions in the Starting the QLogic Adapter vCenter Plug-in
section to start the vCenter plug-in.
2. In the left pane of the QLogic Adapter page, select the adapter, and then
click the Update Adapter Flash Image link.
3. In the Select Flash File for Update dialog box, click Browse.
4. In the Choose File to Upload dialog box, select the .bin Flash file from the
extracted Flash kit package that is compatible with your adapter, and then
click Open.
5. In the Select Flash File for Update dialog box, click Send.
6. Verify the current Flash version and file version, and then click OK to
continue the update.
SN0054671-00 A 1-19
1–Product Overview
Installing the QLogic Adapter vCenter Plug-in for ESX/ESXi
7. When asked “Do you want to reset the adapter to activate the firmware
immediately after successful update?,” click OK if you want the new
firmware to take effect immediately. Or, click Cancel to have the new
firmware take effect after the next system reboot.
8. Wait for the Flash update process to complete. Processing time depends on
the network connection and the system configuration. Do not interrupt the
update process.
CAUTION!
The Flash update may take up to ten minutes to complete. Do not
cancel the task or reboot the server during this time. Doing so may
corrupt the firmware on the adapter.
9. In the Flash update successful completion message box, click OK.
10. If you clicked OK in Step 7, you can click Refresh to verify the new firmware
version. Otherwise, you must reboot the system for the new firmware to take
effect.
Using the vCenter Plug-in on a Tomcat Server
VMware requires that all vCenter plug-ins are web-based applications hosted on a
Tomcat Server, which can be downloaded and installed on Linux and Windows
systems. Here is a link to Tomcat:
http://tomcat.apache.org/
The QLogic vCenter Plug-in supports Tomcat 5, 6, and 7. The installer
dynamically detects the Tomcat version and installs accordingly.
This section provides the following procedures for using the vCenter Plug-in on a
Tomcat Server:
Installing Tomcat on Linux
Starting and Stopping Tomcat on Linux
Installing Tomcat on Windows
Starting and Stopping Tomcat on Windows
1-20 SN0054671-00 A
Installing Tomcat on Linux
To install Tomcat on a Linux OS:
1. Go to the following URL:
http://tomcat.apache.org/download-55.cgi
2. Locate the following directory and file:
Binary Distribution > Core > tar.gz
(apache-tomcat-5.5.28.tar.gz)
3. Unzip the tar.gz file by issuing the following command:
root # tar zxf file.tar.gz
4. Create a symbolic link to a Tomcat directory by issuing the following
command:
# ln -s apache-tomcat-5.5.28 tomcat
1–Product Overview
Installing the QLogic Adapter vCenter Plug-in for ESX/ESXi
Where setting variables include the following:
export JAVA_HOME=/root/gwt/jdk1.6.0_17/
export CATALINA_HOME=/root/gwt/tomcat/
Starting and Stopping Tomcat on Linux
To start Tomcat, issue the following command:
# $CATALINA_HOME/bin/startup.sh
To stop Tomcat, issue the following command:
# $CATALINA_HOME/bin/shutdown.sh
Installing Tomcat on Windows
To install Tomcat on a Windows OS:
1. Go to either of the following URLs:
http://tomcat.apache.org/download-60.cgi
http://tomcat.apache.org/download-70.cgi
2. Locate the following directory and file:
Binary Distribution > Core > 32-bit/64-bit Windows Service
Installer
3. To install the Tomcat service, get the 32-bit/64-bit Windows Service Installer,
save it, and run it.
SN0054671-00 A 1-21
1–Product Overview
Installing the QLogic Adapter vCenter Plug-in for ESX/ESXi
Starting and Stopping Tomcat on Windows
To start and stop Tomcat on a Windows OS:
1. Go to Computer Management > Services and Application > Services >
Apache Tomcat <version number>.
2. Right-click, and then select Start /Stop to initiate Tomcat service, or select
Stop to halt the Tomcat service.
Installing the vCenter Plug-in on Tomcat
1. Download the QLogic Adapter vCenter Plug-in installer EXE; for example,
QLogic Adapter VI Plugin 1.0.4.exe.
2. Run the installer by double-clicking the EXE file or by typing the name of the
EXE on a command prompt.
The InstallAnywhere installer prepares to install the QLogic Adapter vCenter
Plug-in.
3. On the Introduction window, click Next.
4. On the Please Wait window, wait while the QLogic Adapter vCenter Plug-in
is configured for your system.
5. On the Choose Install Folder window, either accept the default installation
directory, or click Choose to specify a different folder.
6. Click Install to install files to the installation directory specified in the
previous step.
A progress window shows the status of the installation.
7. On the User Input window, type your vCenter Server IP address, username,
and password, as well as the IP address of your local Tomcat Server. Then
click Next to continue.
8. On the Please Wait window, wait while the QLogic Adapter vCenter Plug-in
is configured for your system and registers the plug-in with the vCenter
Server.
9. On the Registration Result window, click Finish to complete the plug-in
installation.
Plug-in Unregistration from a Manual Installation
If you have performed a manual installation of the vCenter plug-in, you must
perform a manual uninstall before running the vCenter installation wizard.
VMware provides two type of scripts for vCenter plug-in registration:
For Windows PowerShell
®
scripting:
http://communities.vmware.com/docs/DOC-4521
1-22 SN0054671-00 A
1–Product Overview
Installing the QLogic Adapter vCenter Plug-in for ESX/ESXi
For Perl:
http://communities.vmware.com/docs/DOC-4530
1. Before you can use the script, download the appropriate VI SDK from
VMware.
For PowerShell, download vSphere PowerCLI:
http://communities.vmware.com/community/vmtn/vsphere/automationtools/
powercli
For Perl VI SDK, download vSphere SDK for Perl:
http://www.vmware.com/support/developer/viperltoolkit/
2. After you download and install the SDK and the registration script, follow
VMware instructions to register the vCenter Plug-in.
For example, the Perl unregister command is:
perl registerPlugin.pl --server="127.0.0.1"
-username="administrator" --password="password"
--key="com.qlogic.QLogicAdapterVIPlugIn" --action="remove"
3. Replace the username and password with the correct information to log into
the vCenter Server.
Launching the Plug-in from vSphere Client
To launch the plug-in from vSphere client:
1. Start the vSphere Client and connect to the vCenter Server. (If you start and
connect the vSphere Client directly to an ESX or ESXi server, the vCenter
plug-in does not appear.)
2. If you have not already done so, create a data center and add the ESX
server.
3. In the left pane, select the server.
A row of tabs appear in the right pane. If the server has QLogic Adapter CIM
Provider and adapters installed, and if the vCenter plug-in installation and
registration were successful, the QLogic Adapter tab appears in the tab
row.
4. Click the QLogic Adapter tab to view a web page.
SN0054671-00 A 1-23
1–Product Overview
Installing the QLogic Adapter vCenter Plug-in for ESX/ESXi
1-24 SN0054671-00 A
2 Configuring NIC
This section describes the driver and QConvergeConsole (QCC) agent
installation, configuration, operation, and troubleshooting of the NIC function of
the 8200 and 3200 Series Adapters. Refer to the QCC User’s Guide for
information on QCC Agents.
Installing NIC in Linux
Refer to the Intelligent Ethernet Adapter and Converged Network Adapter
Networking Inbox Driver Update for Linux Readme file for information.
Packaging Content
Refer to the Intelligent Ethernet Adapter and Converged Network Adapter
Networking Inbox Driver Update for Linux Readme file for information.
Linux OS Support
Refer to the Intelligent Ethernet Adapter and Converged Network Adapter
Networking Inbox Driver Update for Linux Readme file for information.
Supported Features
Refer to the Intelligent Ethernet Adapter and Converged Network Adapter
Networking Inbox Driver Update for Linux Readme file for information.
Using the Driver
Refer to the Intelligent Ethernet Adapter and Converged Network Adapter
Networking Inbox Driver Update for Linux Readme file for information on installing
the driver, removing the driver, and driver system parameters.
Installing NIC in ESX
Refer to the Intelligent Ethernet Adapter and Converged Network Adapter
Networking Inbox Driver Update for ESX Readme file for information.
SN0054671-00 A 2-1
2–Configuring NIC
Installing NIC in Windows
Packaging Content
Refer to the Intelligent Ethernet Adapter and Converged Network Adapter
Networking Inbox Driver Update for ESX Readme file for information.
ESX OS Support
Refer to the Intelligent Ethernet Adapter and Converged Network Adapter
Networking Inbox Driver Update for ESX Readme file for information.
Using the Driver
Refer to the Intelligent Ethernet Adapter and Converged Network Adapter
Networking Inbox Driver Update for ESX Readme file for information on installing
and removing the driver.
Installing NIC in Windows
Refer to the Intelligent Ethernet Adapter and Converged Network Adapter NDIS
Miniport Driver for Windows Readme file for information.
Packaging Content
Refer to the Intelligent Ethernet Adapter and Converged Network Adapter NDIS
Miniport Driver for Windows Readme file for information.
Windows OS Support
Refer to the Intelligent Ethernet Adapter and Converged Network Adapter NDIS
Miniport Driver for Windows Readme file for information.
Using the Driver
Refer to the Intelligent Ethernet Adapter and Converged Network Adapter NDIS
Miniport Driver for Windows Readme file for information on installing and
removing the driver.
2-2 SN0054671-00 A
Configuring PXE Boot
This section provides procedures for configuring the 8200 and 3200 Series
Adapters to perform PXE boot. The example uses function 1 and NIC 1.
To configure PXE boot:
1. Enter the system BIOS by pressing the F2 key.
2. On the BIOS window (Figure 2-1), select Integrated Devices, and then
press the ENTER key.
2–Configuring NIC
Configuring PXE Boot
Figure 2-1. Dell BIOS: Integrated Devices
3. Set the Embedded NIC1 and NIC2 option to Enabled.
4. Set the Embedded NIC1 option to Enabled with PXE.
5. Press the ESCAPE key twice, and then select Save changes and exit.
The system reboots.
6. (Optional) During POST, press the CTRL+Q keys to enter the QLogic 8200
Series / 3200 Series CNA Function Configuration window.
SN0054671-00 A 2-3
2–Configuring NIC
Configuring PXE Boot
7. On the CNA Function Configuration main window, ensure that Protocol is
set to PXE (Figure 2-2).
Figure 2-2. QLogic 8200 CNA Function Configuration
8. Press the ESC key to exit.
9. Select Save changes to save your edits, exit, and reboot the system.
10. During POST, press the F2 key to enter the BIOS system.
2-4 SN0054671-00 A
2–Configuring NIC
Configuring PXE Boot
11. Select Boot Settings, and then press the ENTER key (Figure 2-3).
Figure 2-3. BIOS: Boot Settings
12. Select the Boot Sequence option, and then press the ENTER key.
SN0054671-00 A 2-5
2–Configuring NIC
Configuring Driver Software Parameters
13. Select the Embedded NIC 1 QLogic PXE... entry, and then press the UP
ARROW key to move this entry to the first position (Figure 2-4).
Figure 2-4. Embedded NIC 1 QLogic PXE
14. Press the ESCAPE key, and then select Save changes and exit.
The system reboots.
15. After the system reboot, follow the screen prompt for PXE boot server for the
installation of OS of your choice.
Configuring Driver Software Parameters
Linux NIC Driver Management Applications
Overview
The following sections describe how to configure and manage the driver and
adapter using Linux management utilities.
Viewing and Changing Adapter Properties on Linux
Use the following Linux utilities to view and change adapter properties:
qaucli Utility
ethtool Utility
phantomcore Utility
2-6 SN0054671-00 A
qaucli Utility
2–Configuring NIC
Configuring Driver Software Parameters
Install QConvergeConsole CLI (qaucli) from the following packages supplied by
QLogic:
QConvergeConsoleCLI-<version>_linux_<arch>.install.tar.gz—
Package file
QConvergeConsoleCLI-<version>_<arch>.rpm—RPM installer
package file
Example RPM package installation:
To determine if QCC is installed and to find the full name of the installed QCC
RPM package, issue the following command using the partial name
QConvergeConsoleCLI as an argument to grep:
rpm –qa | grep QConvergeConsoleCLI
1. To check for an older version of the RPM package, issue the following
command:
ethtool Utility
rpm –qa QConvergeConsoleCLI
2. If an older version is found, erase that version by issuing the following
command:
rpm –e QConvergeConsoleCLI
3. To install the new version, issue the following command:
rpm –ihv QConvergeConsoleCLI-1.0.00-04.i386.rpm
The utility is installed in the
/opt/QLogic_Corporation/QConvergeConsoleCLI directory.
Use the ethtool utility to view adapter statistics and configure interface options.
For additional details, refer to qlcnic driver man page and ethtool man page.
Examples:
To disable transmit segmentation offload, issue the following command, where
[n] represents a numerical value for a specific instance:
ethtool -K eth[n] tso off
To list interface statistics, issue the following command, where [n] represents a
numerical value for a specific instance:
ethtool –S eth[n]
SN0054671-00 A 2-7
2–Configuring NIC
Configuring Driver Software Parameters
Sample Output 1:
ethtool -S eth8
NIC statistics:
xmit_called: 6
xmit_finished: 6
rx_dropped: 0
tx_dropped: 0
csummed: 0
rx_pkts: 0
lro_pkts: 0
rx_bytes: 0
tx_bytes: 468
lrobytes: 0
lso_frames: 0
xmit_on: 0
xmit_off: 0
skb_alloc_failure: 0
null skb: 0
null rxbuf: 0
rx dma map error: 0
In the following example, ethtool eth[n] lists interface settings.
Sample Output 2:
Ethtool eth8
Settings for eth8:
Supported ports: [ TP FIBRE ]
Supported link modes:
Supports auto-negotiation: No
Advertised link modes: 10000baseT/Full
Advertised auto-negotiation: No
Speed: 10000Mb/s
Duplex: Full
Port: FIBRE
PHYAD: 1
Transceiver: external
Auto-negotiation: off
Supports Wake-on: g
Wake-on: g
Current message level: 0x00000000 (0)
Link detected: yes
2-8 SN0054671-00 A
phantomcore Utility
Use the phantomcore utility to collect a firmware dump that is useful for forwarding
to QLogic Technical Support.
To collect a firmware dump:
1. To turn off auto recovery in the driver, issue the following command:
insmod qlcnic.ko auto_fw_reset=0
2. To collect the firmware dump, issue the following command:
phantomcore -i <interface name>
The utility generates a core file that contains the firmware dump.
Windows Property Pages
To access the property pages in Windows:
2–Configuring NIC
Windows Property Pages
1. Access the Device Manager as follows:
a. On the Windows desktop, click Start, Control Panel, click
Administrative Tools, and then click Computer Management.
b. In the Computer Management dialog box, click Device Manager.
2. In the left pane of the Device Manager dialog box, right-click QLogic 10Gb
Ethernet Adapter, and then click Properties.
3. On the adapter properties dialog box, click the Advanced tab to bring that
page to the front.
4. On the Advanced page, configure the parameters specified in the Tab le 2- 1.
5. (Optional) Click other tabs to bring those pages to the front and view or
change settings, for example:
Click the Information tab to view the configuration.
Click the Details tab to view NIC driver details. On the Details page,
click items under Property to view the selected item's value.
Click the Driver tab to update, rollback, disable, or uninstall the NIC
driver.
Click the Resource tab to view resource settings.
Click the Statistics tab to view the transmit and receive (general and
QLogic-customized) statistics gathered while the NIC is operational.
6. When you are through viewing and changing driver properties, click OK to
close the dialog box, or click Cancel to revert to the previous driver
configuration.
SN0054671-00 A 2-9
2–Configuring NIC
Windows Property Pages
Completion Queue Size Specifies the size for the ring where command com-
Flow Control Sets the hardware flow control parameters.
Table 2-1. Windows Driver Configurable Parameters
Property Description
pletion and incoming receive indication status will be
posted.
Registry Key: CompletionQueueSize
Default: 16384
Value s: 1024, 2048, 4096, 8192, 16384,
32768
Registry Key: *FlowControl
Default: Rx and Tx Enabled.
Value s: Disabled, Rx Enabled, Tx Enabled,
Rx and Tx Enabled
Health Monitoring Checks health of firmware, monitors normal opera-
tion, and ensures recovery of the firmware.
Interrupt Moderation Allows interrupt coalescing during receive and trans-
mit operation.
Registry Key: *InterruptModeration
Default: Disabled
Value s: Enabled, Disabled
IPv4 Checksum Offload Enables and disables IPv4 checksum offload.
Registry Key: *IPChecksumOffloadIPv4
Default: Rx and Tx Enabled.
Value s: Disabled, Rx and Tx Enabled, Rx
Enabled, Tx Enabled
Large Receive Offload Enables and disables TCP large receive offload.
Enables collapsing of multiple MTU size TCP packets
into bigger segments before handing these over to
the host.
Registry Key: LRO
Default: Enabled
Value s: Enabled, Disabled
2-10 SN0054671-00 A
2–Configuring NIC
Windows Property Pages
Table 2-1. Windows Driver Configurable Parameters (Continued)
Property Description
Large Send Offload V1 IP4 Enables and disables TCP large send offload. Allows
host TCP stack to give bigger than maximum segment size (MSS) packets to the driver, and then with
the help of hardware, splits the larger segments into
MTU size packets before sending on wire.
Registry Key: *LsoV1IPv4
Default: Enabled.
Value s: Enabled, Disabled
Size of LSO v1: 64K
Large Send Offload V2 IP4 Enables and disables TCP large send offload. Allows
host TCP stack to give bigger than MSS packets to
the driver, and then with the help of hardware, splits
the larger segments into MTU size packets before
sending on wire.
Registry Key: *LsoV2IPv4
Default: Enabled.
Value s: Enabled, Disabled
Size of LSO v2: 128K
Large Send Offload V2 IP6 Enables and disables TCP large send offload. Allows
host TCP stack to give bigger than MSS packets to
the driver, and then with the help of hardware, splits
the larger segments into MTU size packets before
sending on wire.
Registry Key: *LsoV2IPv6
Default: Enabled.
Value s: Enabled, Disabled
Size of LSO v2: 128K
Locally Administered Address Defines the locally administered address (LAA) that
users and administrators can set on this interface.
This address overrides the permanent address of the
adapter (that may have been Flashed into the hardware).
Registry Key: NetworkAddress
Format: Hexadecimal
Options: Value (a value is required, enter the 12 hex
bytes of the MAC address to be used), or not present.
SN0054671-00 A 2-11
2–Configuring NIC
Windows Property Pages
Table 2-1. Windows Driver Configurable Parameters (Continued)
Max Ethernet Frame Size Specifies the Ethernet frame size for packet transmis-
Max Jumbo Buffers Specifies the number of jumbo-sized receive buffers
Property Description
sion and receive (includes the MAC header).
Reg Key: MaxFrameSize
Default: 1514 (corresponds to 1514 bytes on the wire
+ 4 bytes of CRC)
Max: 9614
Min: 142 (Windows 2003), 590 (Windows 2008)
allocated for the jumbo ring (not frame).
Reg Key: RxJumboRingSize
Default: 4096
Value s: 1024, 2048, 4096, 8192
Number of Receive Buffers Specifies the number of buffers allocated for receiving
standard MTU size (1514 byte) packets.
Registry Key: *ReceiveBuffers
Value s: 1024, 2048,4096,8192,16384,32768.
Default: 16384
Number of Transmit buffers Specifies the number of stage buffers used by the
driver during transmit.
Registry Key: *TransmitBuffers
Value s: 1024, 2048, 4096
Default: 1024
Priority & VLAN Tag Enables and disables support for 802.1pQ priority
tagging. This property must be enabled to set the
VLAN ID.
Registry Key: PQTagging
Default: Priority and VLAN Enabled
Value s: Priority and VLAN Enabled, Prior-
ity and VLAN Disabled, Priority Enabled
and VLAN Enabled, Priority Disabled and
VLAN Disabled
Receive Side Scaling Enables and disables the RSS feature.
Registry Key: RSS
Default: Enabled
Value s: Enabled, Disabled
2-12 SN0054671-00 A
2–Configuring NIC
Windows Property Pages
Table 2-1. Windows Driver Configurable Parameters (Continued)
Property Description
Receive Side Scaling Rings Specifies the number of RSS rings used.
Registry Key: MaxStatusRings
Default: 2
Value s: 1-4
TCP Checksum Offload IPv4 Enables and disables TCP transmit and receive
checksum offload.
Registry Key: *TCPChecksumOffloadIPv4
Default: Rx and Tx Enabled
Value s: Disabled, Rx Enabled, Tx Enabled,
Rx and Tx Enabled
TCP Checksum Offload IPv6 Enables and disables the TCP transmit and receive
checksum offload.
Registry Key: *TCPChecksumOffloadIPv6
Default: Rx and Tx Enabled
Value s: Disabled, Rx Enabled, Tx Enabled,
Rx and Tx Enabled
UDP Checksum Offload IPv4 Enables and the disables user datagram protocol
(UDP) transmit and receive checksum offload.
Registry Key: *UDPChecksumOffloadIPv4
Default: Rx and Tx Enabled
Value s: Disabled, Rx Enabled, Tx Enabled,
Rx and Tx Enabled
UDP Checksum Offload IPv6 Enables and disables the UDP transmit and receive
checksum offload.
Registry Key: *UDPChecksumOffloadIPv6
Default: Rx and Tx Enabled
Value s: Disabled, Rx Enabled, Tx Enabled,
Rx and Tx Enabled
VLAN ID for setting If the Priority and VLAN Tag is enabled, this parame-
ter specifies a VLAN ID for this interface (also
exposed through the standard object identifier [OID]).
Registry Key: VlanId
Default: 0 (no VLAN)
Range: 0-4094
SN0054671-00 A 2-13
2–Configuring NIC
VLAN Configuration
Configuring NIC Driver Parameters with QCC GUI
Refer to the QConvergeConsole Help System: Setting General NIC Port
Parameters and Setting Advanced NIC Port Parameters for information.
Configuring NIC Driver Parameters with QCC Interactive CLI
Refer to the QConvergeConsole CLI User's Guide: section 7, “NIC Interactive
Commands,” for information.
Configuring NIC Driver Parameters with QCC Non-Interactive
CLI
Refer to the QConvergeConsole CLI User's Guide, section 4, “NIC Noninteractive
commands,” for information.
VLAN Configuration
VLAN Configuration with QCC GUI
Refer to the QConvergeConsole Help System: Setting Advanced NIC Port
Parameters for information.
VLAN Configuration with the QCC Interactive CLI
Refer to the appropriate section in the QConvergeConsole CLI User's Guide for
information.
VLAN Configuration with the QCC Non-Interactive CLI
Refer to the appropriate section in the QConvergeConsole CLI User's Guide for
information.
Teaming/Bonding
Windows Teaming
You can group together multiple network adapters in a server to make a team.
Individual adapters that are part of a team operate as a team rather than
standalone adapters. A team provides traffic load balancing across the member
adapters and fault tolerance when some, but not all, of the members lose
connectivity.
To enable teaming functionality, install the teaming driver in addition to the basic
NIC.
2-14 SN0054671-00 A
Team MAC Address
At initialization, the teaming driver selects the team’s MAC address to be the MAC
of one of the teamed adapters. In general, the first adapter to come up is chosen
to be the preferred primary adapter. The preferred primary’s MAC address is
assigned to the MAC address of the team. Alternately, you can choose any valid
MAC address as the team’s static MAC address, also called the locally
administered address (LAA). Make sure any provided LAA is unique for the local
Ethernet network. This provision gives the system administrator more flexibility in
configuring the MAC address for a team when necessary.
Teaming Modes
Teaming is designed to improve reliability and fault tolerance of networks and to
enhance performance by efficient load balancing.
The following NIC teaming modes are provided:
Failsafe Mode ensures that an alternate standby or redundant adapter
becomes active if the primary network connection fails.
Switch Independent Load-Balancing Mode ensures distribution of
transmit loads across the teamed adapters.
2–Configuring NIC
Teaming/Bonding
Link Aggregation Modes (802.3ad static, 802.3ad dynamic (active and
passive Link Aggregation Control Protocol [LACP])) enables the use of
multiple adapters together as a single, virtual adapter with the aggregated
capacity of its individual adapters.
All team types—failsafe, switch-independent load balancing, and link
aggregation—can be heterogeneous as well as homogeneous. Every team must
have at least one QLogic adapter.
Table 2-2 shows that failsafe and transmit load-balancing modes are switch
independent, which means they do not require switch configuration. LACP or
802.3ad require switch ports configured for LACP.
Table 2-2. Windows Teaming Modes
Mode
Failsafe Yes: Layer 2 No Yes No 2–16
Transmit load
balancing
Failover
Capability
Yes No Yes Yes: Layers
Switch
Dependency
System Fault
Tolerance
(SFT)
Load
Balancing
3 or 4
Number of
Ports per Team
(Range
2–16
a
)
Static
Yes Ye s Yes Yes 2–16
802.3ad
SN0054671-00 A 2-15
2–Configuring NIC
Teaming/Bonding
Table 2-2. Windows Teaming Modes (Continued)
Mode
Dynamic
802.3ad
a
16×16 ports can be aggregated per system: 16 ports per team and 16 teams per system.
Failover
Capability
Yes Yes Yes Yes 2–16
Switch
Dependency
System Fault
Tolerance
(SFT)
Load
Balancing
Failsafe Mode
The failsafe mode provides Layer 2 fault tolerance. Failsafe provides high
reliability through redundancy in the event of port failure. When the primary
network connection is down, data traffic is automatically transferred to a
secondary, standby connection. The preferred primary adapter can be specified
either by the system administrator or by the teaming driver (if the admin does not
select the preferred adapter). When the teaming driver needs to make the
selection, it selects the best adapter in terms of bandwidth, health, and capability.
The preferred primary must always be a QLogic adapter.
The administrator can also choose one of the following failback types to specify
the behavior when connection to preferred primary is restored after a period of
failure:
None—When the preferred primary becomes operational again, the driver
does not automatically switch back the primary to the active adapter.
Number of
Ports per Team
(Range
a
)
Preferred Primary—When the preferred primary becomes operational
again, the driver automatically switches back the primary as the active
adapter. The network traffic resumes to the primary adapter from the
standby adapter. The traffic stays with the secondary adapter only as long as
the primary adapter is down.
Auto Select—Use this option to enable the teaming driver to automatically
select the best adapter based on parameters such as bandwidth, link state,
health, and so on.
In failsafe mode, the standby adapter could be dissimilar in the individual features
supported and capacity, and may come from a different vendor.
All the adapters in the team share a common team MAC address. This is either a
locally administered MAC address or a default MAC address specified by the
driver. Only one adapter at a time in the team is active for network traffic. No two
same MAC addresses are exposed to the switch at the same time.
Failsafe mode is inherent in all other teaming modes and is switch agnostic.
2-16 SN0054671-00 A
2–Configuring NIC
Teaming/Bonding
Switch-Independent Load Balancing Mode
Switch-independent load balancing mode provides a failsafe feature and supports
transmit load balancing. For receive load balancing, use the 802.3ad modes.
In this mode, the outbound traffic is efficiently distributed across the member
adapters to increase the transmit bandwidth. Traffic load balancing is
connection-based to avoid out-of-order packet delivery. The administrator can
select one of the following load distribution types:
Auto Select indicates that the load is distributed based on the target IP
address (IPv4 or IPv6) and port number. This option ensures a one-to-one
correspondence between a traffic flow and a team adapter.
MAC address based indicates that the load is distributed based on the
target MAC address.
In switch-independent load balancing, a team receives the traffic on the preferred
primary adapter. If the preferred primary adapter fails, the receive load switches to
a secondary adapter (failover operation). If the preferred primary adapter
becomes operational again, the receive load fails back to the preferred primary
adapter (failback operation). Thus, a switch-independent load balancing team also
behaves like a failsafe team. Each time the preferred primary changes due to
failover or failback, other network elements are notified of the change in the
primary adapter through team gratuitous ARPs.
Link Aggregation Mode
Link aggregation provides increased bandwidth and high reliability by combining
several NICs into a single, logical, network interface called a link aggregation
group (LAG). The link aggregation is scalable, meaning an adapter can be added
or deleted either statically or dynamically from a team.
Traffic from all the team ports that form a LAG have the same MAC address,
which is the MAC address of the team. If a new adapter joins the LAG, or an
adapter forming the LAG fails, the LAG becomes operational again after a brief
exchange of protocols between the switch and the server. QLogic adapters are
rapidly aggregated, with a latency of one to two seconds.
Two options are available in the link aggregation mode:
Static link aggregation
Dynamic link aggregation
NOTE:
The switch must support the IEEE 802.3ad standard for the preceding two
link aggregation modes to work.
SN0054671-00 A 2-17
2–Configuring NIC
Teaming/Bonding
Static Link Aggregation (SLA)
Static link aggregation (SLA, 802.3ad static protocols with generic trunking) is a
switch-assisted teaming mode, where the switch must be 802.3ad compliant. The
switch ports must be configured so that the switch perceives adapters from a LAG
as a single, virtual adapter.
In SLA, the ports on the switch are active by default. There is no negotiation
between the switch and the teaming driver to decide on adapters participating in a
LAG.
In SLA mode, the protocol stack responds to ARP requests with a single,
advertised MAC address, and an IP address corresponding to the LAG. Each
physical adapter in the team uses the same team MAC address during
transmission. As the switch (at the other end of link) is aware of the trunking
teaming mode, it appropriately modifies the forwarding table to indicate the trunk
as a single virtual port. This modification ensures correct traffic routing on the
receive side as well. In this mode, the switch also distributes receive traffic across
the member adapters.
Dynamic Link Aggregation (DLA)
Dynamic link aggregation (DLA) with LACP is similar to SLA except that LACP
allows self configuration of LAG through handshaking between the switch and the
intermediate driver. For the team to function, LACP must be enabled at both ends
of the link: the server and the switch. LACP (802.3ad dynamic) allows switch ports
to dynamically communicate with the teaming driver, allowing controlled addition
and removal of ports from the team.
Link aggregation mode has transmit load balancing and fail safety support. If a
link connected through a participant port of a link-aggregated team goes down,
LACP provides failover and load balancing across the remaining members of the
team. In addition, if a new member port is added to the team or is removed from
the team, the switch performs load rebalancing for the receive operation and the
driver performs load balancing for the transmit operation, to accommodate the
change in configuration.
Transmit load distribution in LACP provides the following options:
None indicates no traffic distribution. Only a single "active" adapter is used
for transmit. The driver selects the active adapter based on LACP state
information.
Auto Select indicates that the load is distributed based on the target IP
address and port number. This option ensures a one-to-one correspondence
between a traffic flow and a team adapter.
MAC address based indicates that the load is distributed based on the
target MAC address.
2-18 SN0054671-00 A
Using the CLI for Teaming
You can view, create, configure, and delete teams using the QConvergeConsole
utility.
To view a list of teams, issue the following command:
qaucli -nic –teamlist
To view team information, issue the following command:
qaucli -nic -teaminfo <team_inst|ALL>
To preview available ports before configuring a new team, issue the following
command:
qaucli -nic -teamnew_portspreview
To configure a new team, issue the following command:
qaucli -nic -teamnew <team_type> <port_insts|ALL>
2–Configuring NIC
Teaming/Bonding
where port_insts are the ports indices separated by commas (for example,
1,2) and team_type is either 1=Fail Over or 2=Load Balanced.
To delete a team, issue the following command:
qaucli -nic -teamdel <team_inst|ALL>
Using the Team Management GUI
Use the Team Management property page to manage the following
teaming-related activities:
Viewing network topology
Creating, modifying, and deleting teams
Viewing and changing team properties
Adding and deleting virtual adapters
To open the Team Management property page:
1. In Windows, access the Computer Management dialog box, and then click
Device Manager in the left pane.
2. Under Network adapters, right-click the QLogic 10Gigabit Ethernet
adapter, and then select Properties.
SN0054671-00 A 2-19
2–Configuring NIC
Teaming/Bonding
3. Click the Team Management tab to bring that page to the front (Figure 2-5)
and perform teaming-related management.
Figure 2-5. Team Management Property Page
On the Team Management page, the Teams and Adapters pane on the left lists
the network devices currently present on this system, including:
Teams and virtual adapters, as well as their member physical adapters
QLogic and other vendor adapters
Teaming Configuration
Teaming configuration includes creating, modifying, and deleting teams, and
viewing team statistics on the Team Management property page. To launch the
Team Management property page, see Using the Team Management GUI.
2-20 SN0054671-00 A
Information on teaming configuration includes the following:
Creating a Team
Modifying a Team
Deleting a Team
Saving and Restoring Teaming Configuration
Creating a Team
To create a team:
1. To create a team, right-click the Teams folder icon, and then click Create
2–Configuring NIC
Teaming/Bonding
Team (Figure 2-6).
Figure 2-6. Creating a Team
2. The software automatically picks a unique team name, or you may choose
to enter your own team name. Team names must be unique on a system.
SN0054671-00 A 2-21
2–Configuring NIC
Teaming/Bonding
3. On the Create Team dialog box, specify the following (see the message
pane at the bottom of the dialog box for more details), and then click OK to
return to the adapter properties:
Name—Type a name for the new team.
Type—Select the teaming mode by clicking either Failsafe Team,
802.3ad Static Team, 802.3ad Dynamic Team, or Switch
Independent Load Balancing. If you select the 802.3ad dynamic
option, you must also select one of the following options:
Active LACP: LACP is a Layer 2 protocol that is used control the
teaming of physical ports into an aggregated set. LACP
discovers if a host’s ports are connected to a switch that supports
aggregation on the connected ports and configures those ports
into an aggregation bundle. For LACP to operate, one side has to
be Active LACP. The Active LACP side of the protocol initiates
the protocol.
Passive LACP: The Passive LACP side responds to the active
LACP requests.
Adapters to Add—Select the check box next to each adapter that
should form the team.
Use default MAC Address—Select this check box to have the driver
assign a MAC address, or clear the check box to select a
locally-administered MAC address from the list.
Select Preferred Primary Adapter—Choose a preferred primary
adapter for the team from the list of teamed adapters, or None to allow
the driver to assign the preferred primary adapter.
Failback Type—If this is a Failsafe Team, select a failback type of
either None, Auto Select, or Preferred Primary.
Load Balancing Type—If this is an 802.3ad Static Team or 802.3ad
Dynamic Team, select the type of load balancing: Auto, MAC Address
Based, or None.
Distribution Type—If this is a Switch Independent Load Balancing
team type, select a distribution type of either Auto Select or MAC
Address Based.
Advanced—Click this button to configure QLogic-specific team
capabilities such as RSS, MTU, or various offloads. These properties
configure the member adapters to avoid any conflict after a team has
been created.
2-22 SN0054671-00 A
2–Configuring NIC
Teaming/Bonding
The following figures show the configuration of various teaming modes.
Figure 2-7. Creating a Failsafe Team
SN0054671-00 A 2-23
2–Configuring NIC
Teaming/Bonding
Figure 2-8. Creating a Switch-Independent Load Balancing Team
2-24 SN0054671-00 A
2–Configuring NIC
Teaming/Bonding
Figure 2-9. Creating an 802.3ad Static Team
SN0054671-00 A 2-25
2–Configuring NIC
Teaming/Bonding
Figure 2-10. Creating an 802.3ad Dynamic Team
2-26 SN0054671-00 A
2–Configuring NIC
Teaming/Bonding
To confirm if a team has been successfully created, view the Team and Adapters
pane on the Team Management page.
Figure 2-11 shows an example of a newly-formed team. The Team Data pane on
the right shows the properties, information, and status of the team or adapter that
is currently selected in the Teams and Adapters pane on the left.
Figure 2-11. Confirming New Team Creation
Modifying a Team
A team can be modified by:
Adding or removing one or more team members to a team.
Modifying the team properties.
SN0054671-00 A 2-27
2–Configuring NIC
Teaming/Bonding
To add team members:
1. On the Team Management property page, right-click the unteamed adapter
2. On the shortcut menu, point to Add to Team, and then click the team to
NOTE:
to add to a team.
which you want to add the adapter (Figure 2-12).
You cannot add an adapter to a team that is already a member of another
team. Teaming of teams is not supported.
Figure 2-12. Adding a Team
2-28 SN0054671-00 A
2–Configuring NIC
Teaming/Bonding
To remove an adapter from a team:
NOTE:
A team must include at least one QLogic adapter. A QLogic adapter is
allowed to be deleted from a team only if it is not the last QLogic teamed
adapter.
1. On the Team Management property page, right-click the adapter to be
removed from the team.
2. On the shortcut menu, click Remove from Team.
3. At least two adapters must be present in a team. If an adapter is no longer
required to be a member of a team, it can be removed from the team.
To change a team property:
For the VLAN and teaming solution to work correctly, the properties of all teamed
adapters and adapters with multiple VLANs must remain synchronized with the
team properties. Ensure that you change the properties of a team and an adapter
with VLANs only on the Team Management page.
1. On the Team Management page, in the right pane under Team Data,
expand the Properties list.
2. Double-click the team property you need to change.
3. In the Advanced Team Properties dialog box (Figure 2-13), specify a new
property value, and then click OK.
Figure 2-13. Modifying Advanced Team Properties
SN0054671-00 A 2-29
2–Configuring NIC
Teaming/Bonding
The team properties change takes effect immediately. Changing team properties
causes the driver to reload, which could result in a momentary loss of connectivity.
NOTE:
To ensure that the properties of all teamed adapters and adapters with
VLANs remain synchronized with the team properties, do not directly modify
the adapter properties on the Advanced page. If an adapter property
becomes out of sync with its team properties, change either the team or
adapter property so that they are the same on each, and then reload the
team. To reload a team: On the Team Management page, in the left pane
under Teams and Adapters, right-click the team name, and then click
Reload Team.
2-30 SN0054671-00 A
2–Configuring NIC
Teaming/Bonding
To modify team composition:
1. On the Team Management page, in the left pane under Teams and
Adapters, right-click the team name whose properties are to be changed.
2. On the shortcut menu, click Modify Team (Figure 2-14).
Figure 2-14. Modifying Team Properties
3. In the Modify Team Properties dialog box, change the team parameters as
needed, and then click OK.
SN0054671-00 A 2-31
2–Configuring NIC
Teaming/Bonding
Example 1:
For a failsafe team, you can change the team name, assigned team static MAC
address, preferred primary adapter, and failback type (Figure 2-15).
Figure 2-15. Modifying Failsafe Team Properties
2-32 SN0054671-00 A
2–Configuring NIC
Teaming/Bonding
Example 2:
You can change the team type and the corresponding team attributes. For
example, you can change from failsafe to switch-independent load balancing, or
from 802.3ad static team to 802.3ad dynamic team. Figure 2-16 shows a failsafe
team modification, which shows the new team type and default values for team
attributes. You can manually change attribute values.
Figure 2-16. Modifying the Team Type
Deleting a Team
To delete a team:
1. On the Team Management property page, in the left pane under Teams
and Adapters, right-click the team name to be deleted.
2. On the shortcut menu, click Delete team.
SN0054671-00 A 2-33
2–Configuring NIC
Teaming/Bonding
Saving and Restoring Teaming Configuration
QLogic recommends that you periodically save the configuration to prevent any
accidental loss of network topology and settings. Current configuration including
the teams, VLANs, and properties can be saved to a file. Restoring an earlier
configuration results in the destruction of the current configuration.
To save a configuration:
1. On the Team Management page under Teams and Adapters, right-click
the Teams folder.
2. On the shortcut menu, click Save to File.
3. Enter a location to save the configuration.
To restore a configuration:
1. On the Team Management page under Teams and Adapters, right-click
the Teams folder.
2. On the shortcut menu, click Restore From File.
3. Select a previously saved configuration file.
Viewing Teaming Statistics
You can view teaming and Ethernet statistics using the QConvergeConsole
(QCC) CLI utility.
To view teaming statistics, issue the following command:
qaucli -nic -statport
To reset the Ethernet statistics counter, issue the following command:
qaucli -nic -sreset [cna_port_inst]
To display Ethernet port statistics, issue the following command:
qaucli -nic -statport [cna_port_inst]
To undo the reset of Ethernet statistics counters, issue the following command:
qaucli -nic -sunreset [cna_port_inst]
Linux Bonding/Failover/Aggregation
The Linux qlcnic driver supports all the standard bonding modes supported by
the Linux bonding driver for bonding, failover, and aggregation. Refer to the Linux
bonding driver documentation for additional details on the bonding modes.
2-34 SN0054671-00 A
NIC Partition (NPAR)
The NPAR feature in QLogic adapters provides the ability to create multiple PCIe
physical functions for each physical 10GbE port on the adapter. Each of the PCIe
functions appears as an independent interface to the host operating system or
hypervisor.
Dual-port, 10Gb adapters configured as Ethernet-only adapters contain eight
Ethernet functions. 8200 Series and 3200 Series adapter configurations can
contain up to four Ethernet functions corresponding to each physical port.
Configuration and Operation
By default, NPAR functionality is disabled on the adapters. Only two Ethernet
functions are enabled. Depending on the feature personality mapping supported
on the adapter, you can enable additional Ethernet or storage functions. The PCI
function number assignment is as follows:
Functions 0 and 1 are always NIC functions.
2–Configuring NIC
NIC Partition (NPAR)
Functions 4 and 5 are iSCSI functions if iSCSI is enabled.
Functions 6 and 7 are FCoE functions if FCoE is enabled.
If iSCSI and FCoE functions are not enabled, they can be configured as NIC
functions.
Only one iSCSI function per physical port.
Only one FCoE function per physical port.
The PCI function to port mapping is also fixed as follows:
Functions 0, 2, 4, and 6 share one physical port.
Functions 1, 3, 5, and 7 share the other physical port.
When performed, the following operations require a system reboot to take effect:
Enabling or disabling NPAR mode
Changing function type:
iSCSI to NIC
FCoE to NIC
NIC to FCoE
Perform NPAR configuration using any of the following methods:
OptROM
Lifecycle controller
Managements tools under various OSs
SN0054671-00 A 2-35
2–Configuring NIC
NIC Partition (NPAR)
After you have configured NPAR mode, you can modify the minimum and
maximum bandwidth per NPAR. The changes take effect immediately; no reboot
is required. The minimum and maximum bandwidths are specified as percentages
of the link bandwidth, where:
Minimum bandwidth is the minimum guaranteed bandwidth to a partition.
Maximum bandwidth is the maximum value that a partition is permitted to use.
NPAR mode supports iSCSI boot, FCoE boot, and PXE boot in their respective
partitions.
NOTE:
For additional information on configuring NPAR in the QConvergeConsole
utility, refer to the QConvergeConsole Help System.
Using NPAR under ESX
VMware vSphere provides a CIM monitoring framework for both classic ESX and
ESXi. Use this framework to configure and manage Ethernet interfaces. On an
ESX Server, you can configure and manage Ethernet interfaces using a command
line interface. On an ESXi Server, use the remote command line interfaces
(remote CLIs).
All NPAR Ethernet functions are enumerated by the hypervisor, controlled by the
driver running in the hypervisor, and configured similar to other Ethernet
interfaces. For more details, see NIC Partition (NPAR).
You would typically create a virtual switch (vSwitch) for each NPAR interface. You
can configure virtual machines (VMs) to use the standard virtual network devices,
such as VMXNET 3 adapters. On each interface, you can configure features such
as NetQueue. Although it is possible to configure all standard aggregation and
failover configurations supported by ESX using NPAR interfaces as uplinks, it is
not useful to have multiple uplinks with NPARs belonging to the same physical
port.
The vSwitch switches the packets when VMs are assigned to share the same
NPAR. The embedded switch (eSwitch) on the adapter switches packets when
packets are sent by a VM on an NPAR destined to another VM that is connected
to a vSwitch on a different NPAR belonging to the same physical port. If the two
NPARs are associated with different physical ports, the external switch forwards
packets between them.
Perform vSwitch configuration using either standard service console commands
or RCLI commands. For specific command options, refer to the VMware
documentation.
2-36 SN0054671-00 A
NOTE:
The 8200 and 3200 Series Adapters have eSwitches. Because all of the
interfaces are assigned to the hypervisor, eSwitch operation is transparent,
and the system administrator is not required to perform any additional
configuration.
Configuring NPAR in the BIOS
Refer to the Type section for information.
Configuring NPAR in QCC GUI
Refer to the QConvergeConsole Help System: Partitioning NIC Ports for
information.
Configuring NPAR in QCC Interactive CLI
Refer to the QConvergeConsole CLI User’s Guide for information.
2–Configuring NIC
NIC Partition (NPAR)
Configuring NPAR in QCC Non-Interactive CLI
Refer to the QConvergeConsole CLI User’s Guide, “NIC Noninteractive
Commands” section for information.
Configuring NPAR in the QLogic Adapter vCenter Plug-in
The QLogic Adapter vCenter Plug-in provides the QLogic Adapter tab. Use this
tab to manage the 8200 and 3200 Series Adapters in the VMware ESX/ESXi
environment.
With the QLogic Adapter tab, you can:
Enable/Disable NPAR
Enable/Disable functions
Configure function personalities
Configure the relative bandwidth of NIC functions
Configure eSwitch
View the eSwitch Statistics
The default configuration of the 8200 Series Adapters is a NIC function, iSCSI
function, and FCoE function. There is an additional NIC function that is defaulted
as disabled, but is presented to the user to be optionally enabled.
SN0054671-00 A 2-37
2–Configuring NIC
NIC Partition (NPAR)
Figure 2-17 shows the default view of QLogic Adapter tab in the vCenter Plug-in.
Figure 2-17. vCenter Plug-in QLogic Adapter Tab Default View
Figures 2-18 shows the configuration range of the 8200 Series Adapters without
NPAR.
Figure 2-18. 8200 Series Configuration Range Without NPAR
2-38 SN0054671-00 A
2–Configuring NIC
NIC Partition (NPAR)
Figures 2-19 shows the configuration range of the 8200 Series Adapters with
NPAR.
Figure 2-19. 8200 Series Configuration Range With NPAR
Figures 2-20 shows the Configuration Range of the 3200 Series Adapters with
NPAR. Physical functions 2–7 can be independently disabled.
Figure 2-20. 3200 Series Configuration Range With NPAR
To configure a physical function:
1. Select the function you want to change in the hierarchy on the left side of the
screen.
The Function Attributes on the right side of the screen reflect the selected
physical function.
2. Make a selection from the Function Type menu.
a. If the Function Type is NIC, iSCSI, or FCoE, select Disabled to disable
the function.
b. If the Function Type is Disabled, select the appropriate function type.
SN0054671-00 A 2-39
2–Configuring NIC
NIC Partition (NPAR)
In the example in Figure 2-21, function 2 is disabled. To enable the function,
NIC is selected from the Function Type menu.
Figure 2-21. Enabling a Physical Function
3. Click Save Configuration.
4. Reboot your system for the change to take effect.
5. Open vCenter Plug-in.
6. Click the QLogic Adapter tab.
7. Right-click the adapter icon on the left side of the page, and then select
Refresh.
2-40 SN0054671-00 A
2–Configuring NIC
NIC Partition (NPAR)
The selected function now reflects the change made in Step 2. For example,
the change made in Figure 2-21 is reflected in Figure 2-22 (function 2
changed from Disabled to NIC.
Figure 2-22. Port One Configured with NPAR Enabled
NPAR Personality Changes
Changing a function's personality requires the ESX Host to be rebooted for
the change to take effect.
Each personality configuration change must be saved using the Save
Configuration button.
This means that to change two functions' personalities, each change must
be separately saved using the Save Configuration button.
Multiple personality changes may be made before rebooting the ESX server
after saving the individual changes.
The Function Type options for the FCoE and iSCSI capable functions do not
reflect the total range of personalities that these ports may transition into.
To transition from FCoE or iSCSI to NIC, the FCoE or iSCSI port must be
first disabled, rebooted, configured as NIC, and then rebooted again.
SN0054671-00 A 2-41
2–Configuring NIC
NIC Partition (NPAR)
Enabling NPAR
To enable NPAR for a port in the QLogic vCenter Plug-in, do the following:
1. Select function 2 for port 0 and function 3 for port 1.
2. Click OK to accept the NPAR parameter(s) Successfully Changed!
3. Reboot the ESX Host.
4. Wait until the ESX Host again becomes connected in the Data Center. The
5. After the ESX Host connects again, on the shortcut menu on the QLogic
confirmation message.
NOTE:
This is the Server where the Converged Network Adapter or Intelligent
Ethernet Adapter is installed.
ESX Host's Name (IP Address) will be italicized (not responding) while the
ESX Host reboots.
Adapter tab, click Refresh.
Function 2 of port 0 is now configured for NIC; this enables NPAR.
NPAR enabled on port 0—function 2 on port 0 is enabled.
NPAR disabled on port 1—function 3 on port 1 is disabled.
NPAR is now enabled, and the configuration range of the FCoE and iSCSI storage
functions is extended. The FCoE Function Type options are extended FCoE, NIC,
and Disabled (see Figure 2-22).
Quality of Service
The QLogic vCenter Plug-in provides control of the NPAR quality of service (QoS)
capability of the 8200 and 3200 Series Adapters. QoS is enabled whenever FCoE
is not enabled. This is because FCoE requires ETS, which supersedes NPAR's
QoS.
The vCenter QoS controls allocate bandwidth to NIC functions in increments of
1 percent of 10Gb. There is a Maximum Bandwidth control and a Bandwidth
Weight. The Maximum Bandwidth control specifies the maximum bandwidth that
the NIC function is allowed take in congested conditions. A NIC function can take
more bandwidth than the Maximum Bandwidth setting if there is no other demand
for that bandwidth. The Bandwidth control specifies the minimum band width that
a NIC function is guaranteed in congested conditions.
2-42 SN0054671-00 A
See Figure 2-23 for an illustration.
2–Configuring NIC
NIC Partition (NPAR)
Figure 2-23. QLogic Adapter vCenter Plug-in with QoS Interface, Function eSwitch
Configuration, and eSwitch Statistics
eSwitch
The 8200 and 3200 Series adapters connect the physical ports to the physical
functions on the PCIe bus through eSwitches. An eSwitch is a VLAN aware MAC
lookup virtual switch implemented in the 8200 and 3200 Series Adapters. Each
port provides the uplink for an eSwitch with the enabled associated Physical PCI
Functions connected through switch ports to the eSwitch. Functions 0, 2, 4, and 6
are connected through the port 0 eSwitch; and functions 1, 3, 5, and 7 are
connected through the port 1 eSwitch. The eSwitch associated with a port will only
conduct traffic between PCIe Ethernet functions if the physical port is linked.
Control of the eSwitch is through the QLogic vCenter Plug-in. The eSwitch
management controls support VLAN configuration, promiscuous mode enable,
locally administered MAC addresses, IPv4 checksum offload enable, IPv4 and
IPv6 segmentation offloads, and MAC anti-spoof checking.
SN0054671-00 A 2-43
2–Configuring NIC
NIC TroubleShooting/Diagnostics
NIC TroubleShooting/Diagnostics
NIC Linux Diagnostics
Linux Diagnostics
This section covers the following information for user diagnostics for Linux NIC
driver management applications:
Running Linux User Diagnostics
Linux Diagnostic Test Descriptions
Linux Diagnostic Test Messages
NOTE:
The current release does not support external and internal loopback tests.
Support is expected in a future release.
Running Linux User Diagnostics
Linux user diagnostics include QConvergeConsole diagnostics and ethtool
diagnostics.
QConvergeConsole Diagnostics
NOTE:
Information on installing and starting the GUI version of QLogic's
QConvergeConsole utility is provided in the QConvergeConsole User's
Guide. All procedural information for that utility is covered in the
QConvergeConsole Help System.
QConvergeConsole CLI-based diagnostics include the following commands:
To enable or disable the port beacon, issue the following command:
qaucli -pr nic -beacon [cna_port_inst] <on|off>
To run an internal loopback test, issue the following command:
qaucli -pr nic -intloopback <cna_port_inst> <tests_num>
<on_error>
where tests_num is the number of tests (1–65535) and on_error is either
0=Ignore or 1=Abort
2-44 SN0054671-00 A
2–Configuring NIC
NIC TroubleShooting/Diagnostics
To perform a Flash test, issue the following command:
qaucli -pr nic testflash [cna_port_inst]
To perform a hardware test, issue the following command:
qaucli -pr nic -testhw [cna_port_inst]
To perform an interrupt test, issue the following command:
qaucli -pr nic -testinterrupt [cna_port_inst]
To perform a link test, issue the following command:
qaucli -pr nic -testlink [cna_port_inst]
To perform a register test, issue the following command:
qaucli -pr nic -testregister [cna_port_inst]
To display transceiver DMI data, issue the following command:
qaucli -pr nic -trans [cna_port_inst]
Ethtool Diagnostics
To perform an adapter self-test using ethtool-based diagnostics, issue the
following command:
# ethtool -t eth<x> offline
The self-test includes the following:
Loopback test
Interrupt test
Link test
Register test
Examples:
# ethtool -t eth8 offline
The test result is PASS
The test extra info:
Register_Test_on_offline 0
Link_Test_on_offline 0
Interrupt_Test_offline 0
Loopback_Test_offline 0
SN0054671-00 A 2-45
2–Configuring NIC
NIC TroubleShooting/Diagnostics
# ethtool -t eth4
The test result is PASS
The test extra info:
Register_Test_on_offline 0
Link_Test_on_offline 0
Interrupt_Test_offline 0
Loopback_Test_offline 0
Linux Diagnostic Test Descriptions
Internal Loopback Test performs internal packet loopback.
Flash Test verifies the Flash read and write.
Hardware Test verifies that the hardware is running.
Interrupt Test enables and disables the interrupt and functional verification
tests.
Link Test verifies that the port is linked, meaning that the port has a good
cable attached to the port and that other end of the cable is connected to an
operational Ethernet port, either another NIC port or a network device, such
as a switch.
Register Test verifies the NIC register read and write.
Linux Diagnostic Test Messages
Test information and PASS or FAIL messages are displayed for each of the tests
listed in Linux Diagnostic Test Descriptions.
Windows Property Page Diagnostics
This section covers the following information for user diagnostics for Windows NIC
driver management applications:
Running Windows User Diagnostics
Windows Diagnostic Test Descriptions
Windows Diagnostic Test Messages
NOTE:
The current release does not support external and internal loopback tests.
Support is expected in a future release.
Running Windows User Diagnostics
You can run user diagnostics using either the QConvergeConsole GUI or the CLI.
2-46 SN0054671-00 A
2–Configuring NIC
NIC TroubleShooting/Diagnostics
NOTE:
Information on installing and starting the GUI version of QLogic's
QConvergeConsole utility is provided in the QConvergeConsole User's
Guide. All procedural information for that utility is covered in the
QConvergeConsole Help System.
To run user diagnostics in the GUI:
1. Access the Windows Control Panel, and then open the Device Manager.
2. In the Device Manager, right-click the QLogic 10Gb Ethernet adapter, and
then on the shortcut menu, click Properties.
3. On the adapter properties page, click the Diagnostics tab. Figure 2-24
shows the Diagnostics page.
Figure 2-24. Diagnostics Tests on Windows
SN0054671-00 A 2-47
2–Configuring NIC
NIC TroubleShooting/Diagnostics
4. Under Diagnostic Tests, select one or more check boxes indicating the
tests you want to run: Hardware Test, Register Test, Interrupt Test,
Loopback Test, and Link Test. (Windows Diagnostic Test Descriptions
describes each test type.)
5. Click Run Tests.
NOTE:
Only one test can run at a time. Multiple tests can run sequentially.
To run user diagnostics in the CLI:
Use QConvergeConsole CLI (qaucli), a unified command line utility, to manage
all QLogic adapter models, including running user diagnostics. The overall option
(-pr <protocol>) allows you to start the utility with a specific protocol type:
NIC, iSCSI, or Fibre Channel. If you do not specify a protocol, all protocols are
enabled by default. Tab le 2 -3 and Table 2-4 list the QConvergeConsole
commands for selecting a protocol.
Table 2-3. Windows QConvergeConsole CLI—Selecting a Protocol in
Menu Mode
Command Description
qaucli Start QConvergeConsole CLI in interactive
mode
qaucli -pr nic [options] Issue NIC command line options
qaucli -pr iscsi [options] Issue iSCSI command line options
qaucli -pr fc [options] Issue Fibre Channel and FCoE command line
options
qaucli -npar [options] Issue NPAR command line options
Table 2-4. Windows QConvergeConsole CLI—Selecting a Protocol in
Legacy Mode
Command Description
qaucli -nic [options] Use NIC legacy command line
netscli [options] Use NIC legacy command line
qaucli iscsi [options] Use iSCSI legacy command line
iscli [options] Use iSCSI legacy command line
2-48 SN0054671-00 A
2–Configuring NIC
NIC TroubleShooting/Diagnostics
Table 2-4. Windows QConvergeConsole CLI—Selecting a Protocol in
Legacy Mode (Continued)
Command Description
qaucli -fc [options] Use Fibre Channel legacy command line
scli [options] Use Fibre Channel legacy command line
Diagnostic help commands, and command options available for each specific
protocol, are available by specifying -h to the protocol, as shown in Table 2-5.
Table 2-5. Windows QConvergeConsole CLI—Getting Help
Command Description
-h Print usage of a specific adapter type, and then exit
qaucli -pr nic -h Print NIC protocol usage, and then exit
qaucli -pr fc -h Print Fibre Channel and FCoE protocol usage, and then
exit
qaucli -pr iscsi -h Print iSCSI protocol usage, and then exit
qaucli -npar -h Print NPAR commands usage, and then exit
Table 2-6 lists miscellaneous Windows diagnostics commands.
Table 2-6. Windows QConvergeConsole CLI—Miscellaneous
Commands
Command Description
qaucli -v Print version number, and then exit
qaucli -h Print usage, and then exit
Table 2-7 lists the Windows CLI diagnostic test commands. Note that while
running these tests, network traffic is interrupted.
Table 2-7. Windows QConvergeConsole CLI—Diagnostic Test
Commands
Command Description
-i
--interface
SN0054671-00 A 2-49
Specifies the interface type (NX_NIC,
NX_NIC1, and so on)
2–Configuring NIC
NIC TroubleShooting/Diagnostics
Table 2-7. Windows QConvergeConsole CLI—Diagnostic Test
Command Description
Commands (Continued)
-a
--all
-D
--default
-R
--CRegs
-I
--IRQS
-L
--IntLB
-H
--Hw
-S
--LinkST
-nR
--noCRegs
-nl
--noIRQS
Perform all test, regardless of default
Perform only the default test
Test all control registers (default)
Test interrupt mechanism (default)
Internal loopback test (default)
Hardware test (default)
Link status test (default)
No control registers test (combine –D or –a)
No interrupt test (combine –D or –a)
-nL
--noIntLP
-nH
--noHw
-nS
--noLinkSt
-h
--help
2-50 SN0054671-00 A
No internal loopback test (combine –D or –a)
No hardware test (combine –D or –a)
No link status test (combine –D or –a)
View help text
2–Configuring NIC
NIC TroubleShooting/Diagnostics
For every test performed, the diagnostic utility shows the following data:
Total number of attempts
Number of successful completions
Number of failures
You can either perform all tests in succession, or perform only specific tests
specified by the preceding command-line parameters.
You can run additional diagnostics in the CLI as listed in the following table. To
determine the cna_port_inst, issue the qaucli -nic –i command as
shown in Tab le 2 -8 .
Table 2-8. Running Windows Diagnostic Tests in the CLI
Test Type Command
External Loopback qaucli -nic -extloopback <cna_port_inst>
<tests_num> <on_error>
Where <tests_num> specifies the number of tests,
1–65535, and <on_error> is either 0=Ignore or 1=Abort.
NOTE: This test requires a pass-through module to be configured for both ports. Test runs between two ports. Single
port loopback is not supported.
Flash qaucli –nic –testflash [cna_port_inst]
Hardware qaucli –nic –testhw [cna_port_inst]
Internal Loopback qaucli -nic -intloopback <cna_port_inst>
<tests_num> <on_error>
Where <tests_num> specifies the number of tests,
1–65535, and <on_error> is either 0=Ignore or 1=Abort.
Interrupt qaucli –nic –testinterrupt [cna_port_inst]
Link qaucli -nic -testlink [cna_port_inst]
Ping (IPv4) qaucli -nic -ping <cna_port_inst>
<hostname_or_IPv4> [<count> <pocket_size>
<timeout_ms> <TTL>]
Where the default values are count=5,
pocket_size=525, timeout_ms=1000, and
TTL=30.
Register qaucli -nic -testregister [cna_port_inst]
Transceiver DMI Data qaucli -nic -trans [cna_port_inst]
SN0054671-00 A 2-51
2–Configuring NIC
NIC TroubleShooting/Diagnostics
Windows Diagnostic Test Descriptions
This section provides descriptions of the following Windows diagnostic tests:
Hardware Test
Register Test
Interrupt Test
Loopback Test
Link Test
Hardware Test
The hardware test checks the status of various hardware blocks, including DMA
engines, receive engine, and on-board processor meta cores.
Register Test
The register test performs device register read/write accesses.
Interrupt Test
The interrupt test checks the ability of the hardware to create an interrupt and the
ability of the driver to process the interrupt by forcing the generation of a
predetermined number of interrupts. The test succeeds if the device generates the
interrupts and the driver processes all interrupts expected.
Loopback Test
The loopback test is a diagnostic tool that routes transmit data through a loopback
connector back to the same adapter.
Link Test
The link test inspects the link status (up or down) by checking the physical
communication channel between the host and the firmware.
2-52 SN0054671-00 A
Windows Diagnostic Test Messages
If a test fails, an appropriate error code is generated and displayed, as shown in
Table 2-9. Note that this table does not list error messages for the interrupt and
link tests.
Table 2-9. Windows Diagnostic Test Messages
Test Error Message Description
Loopback LB_TEST_OK Loopback test has passed
2–Configuring NIC
NIC TroubleShooting/Diagnostics
LB_SEND_WAIT_QUEUE_E
RR
LB_NORCV_ERR Receive packet not received
LB_NOMEM_ERR No memory error
LB_TX_QUEUE_ERR Transmit queue error
LB_SHORT_DATA_ERR Looped data short error
LB_SEQUENCE_ERR Looped data out of sequence
LB_DATA_ERR Looped data corrupted
LB_ERR_CNT Looped error count
Register CR_TEST_OK Control register test passed
CR_NIU_MODE Network interface unit (NIU) error
CR_PHY Physical layer (PHY) error
CR_ERRCNT Control register error count
Hardware HW_TEST_OK Hardware test has passed
HW_DMA_BZ_0 DMA channel 0 is busy
Send queue blocked
HW_DMA_BZ_1 DMA channel 1 is busy
HW_DMA_BZ_2 DMA channel 2 is busy
HW_DMA_BZ_3 DMA channel 3 is busy
SN0054671-00 A 2-53
2–Configuring NIC
NIC TroubleShooting/Diagnostics
Table 2-9. Windows Diagnostic Test Messages (Continued)
Test Error Message Description
HW_SRE_PBI_HALT Segmentation and reassembly engine
currently halted
HW_SRE_L1IPQ Segmentation and reassembly engine
currently paused due to L1 IPQ discard failure
HW_SRE_L2IPQ Segmentation and reassembly engine
currently paused due to L2 IPQ discard failure
HW_SRE_FREEBUF Segmentation and reassembly engine
free buffer list is currently empty
HW_IPQ IPQ is currently not empty
HW_PQ_W_PAUSE PQ write pause previously detected
HW_PQ_W_FULL PQ write full previously detected
HW_IFQ_W_PAUSE IFQ write pause previously detected
HW_IFQ_W_FULL IFQ write full previously detected
HW_MEN_BP_TOUT Memory backpressure timeout previ-
ously detected
HW_DOWN_BP_TOUT Downstream backpressure timeout
previously detected
HW_FBUFF_POOL_WM Free buffer pool low watermark previ-
ously detected
HW_PBUF_ERR Packet buffer error previously
detected
HW_PBUF_ERR Packet buffer error previously
detected
HW_FM_MSG_HDR FM message header error previously
detected
HW_FM_MSG FM message error previously
detected
HW_EPG_CTRL_Q Egress packet generator (EPG) con-
trol queue is backed up
HW_EPG_MSG_BUF EPG message buffer error
2-54 SN0054671-00 A
Loading...