Sun Microsystems SG-XPCIE20FC-NEM-Z User Manual

Sun StorageTek™4 Gb FC NEM

20-Port Host Bus Adapter

User’s Guide

For HBA Model SG-XPCIE20FC-NEM-Z

Sun Microsystems, Inc. www.sun.com

Part No. 819-7929-12 February 2008, Revision A

Submit comments about this document at: http://www.sun.com/hwdocs/feedback

Copyright 2008Sun Microsystems,Inc., 4150Network Circle, SantaClara, California95054, U.S.A.All rightsreserved. Sun Microsystems,Inc. hasintellectual property rightsrelating totechnology thatis describedin thisdocument. Inparticular,and without

limitation, theseintellectual propertyrights mayinclude oneor more ofthe U.S.patents listedat http://www.sun.com/patents andone or more additionalpatents orpending patentapplications inthe U.S.and inother countries.

This documentand theproduct towhich itpertains are distributedunder licensesrestricting theiruse, copying,distribution, and decompilation. Nopart ofthe productor ofthis documentmay bereproducedin anyform byany meanswithout priorwritten authorizationof Sun andits licensors,if any.

Third-party software, includingfont technology, is copyrighted and licensed from Sunsuppliers. Parts ofthe productmay bederived from BerkeleyBSD systems,licensed fromthe Universityof California.UNIX isa registered trademarkin

the U.S.and inother countries,exclusively licensedthrough X/OpenCompany, Ltd. Sun, SunMicrosystems, theSun logo,Java, AnswerBook2,docs.sun.com, StorEdge,Java, SunBlade, SunVTS,StorageTek, FlexLine,and Solaris

are trademarksor registered trademarksof SunMicrosystems, Inc.in theU.S. andin othercountries. All SPARC trademarks areused underlicense andare trademarksor registered trademarksof SPARC International,Inc. inthe U.S.and inother

countries. Productsbearing SPARCtrademarks arebased uponan architecture developedby SunMicrosystems, Inc. The OPENLOOK andSun™ GraphicalUser Interfacewas developedby SunMicrosystems, Inc.for itsusers andlicensees. Sunacknowledges

the pioneeringefforts ofXerox in researchingand developingthe conceptof visualor graphicaluser interfacesfor thecomputer industry.Sun holds anon-exclusive licensefrom Xerox tothe XeroxGraphical UserInterface, whichlicense alsocovers Sun’slicensees whoimplement OPEN LOOK GUIsand otherwisecomply withSun’s writtenlicense agreements.

U.S. GovernmentRights—Commercial use.Government usersare subject to the Sun Microsystems, Inc.standard licenseagreement and applicable provisionsof theFAR and its supplements.

DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES, INCLUDING ANYIMPLIED WARRANTY OFMERCHANTABILITY,FITNESS FOR A PARTICULAR PURPOSEOR NON-INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.

Copyright 2008Sun Microsystems,Inc., 4150Network Circle, SantaClara, Californie95054, États-Unis.Tousdroits réservés. Sun Microsystems,Inc. possèdeles droits depropriété intellectuelsrelatifs àla technologiedécrite dansce document.En particulier, et sans

limitation, cesdroits depropriété intellectuels peuvent inclure unou plusieursdes brevetsaméricains listéssur lesite http://www.sun.com/patents, un ou les plusieurs brevetssupplémentaires ainsique lesdemandes debrevet en attente aux les États-Unis et dans d’autrespays.

Ce documentet leproduit auquelil serapporte sontprotégés par un copyright etdistribués souslicences, celles-cien restreignentl’utilisation, la copie,la distribution,et ladécompilation. Aucunepartie dece produitou documentne peutêtrereproduite sousaucune forme,par quelque moyen quece soit,sans l’autorisationpréalable etécrite deSun etde sesbailleurs delicence, s’ily ena.

Tout logiciel tiers, sa technologie relativeaux policesde caractères,comprise, estprotégé par un copyright et licencié par des fournisseurs de Sun.

Des partiesde ceproduit peuventdériver dessystèmes BerkeleyBSD licenciéspar l’Universitéde Californie.UNIX estune marque déposée aux États-Uniset dansd’autres pays,licenciée exclusivementpar X/OpenCompany, Ltd.

Sun, SunMicrosystems, lelogo Sun,Java, AnswerBook2,docs.sun.com, StorEdge,Java, SunBlade, SunVTS,StorageTek, FlexLine,et Solaris sont desmarques defabrique oudes marques déposéesde SunMicrosystems, Inc.aux États-Uniset dansd’autres pays.

Toutes les marques SPARC sontutilisées souslicence etsont desmarquesde fabriqueou desmarques déposéesde SPARC International, Inc. aux États-Uniset dansd’autres pays.Les produits portantles marquesSPARCsont basés sur une architecturedéveloppée parSun Microsystems, Inc.

L’interfaceutilisateur graphiqueOPEN LOOKet Sun™a étédéveloppée parSun Microsystems, Inc. pour ses utilisateurs et licenciés. Sun reconnaît lesefforts de pionniers de Xeroxdans larecherche et le développement du concept des interfaces utilisateur visuelles ou graphiques pour l’industrieinformatique. Sundétient unelicense nonexclusive deXerox surl’interface utilisateurgraphique Xerox, cettelicence couvrant également leslicenciés deSun implémentantles interfacesutilisateur graphiquesOPEN LOOKet seconforment enoutre auxlicences écritesde Sun.

LA DOCUMENTATION EST FOURNIE "EN L’ÉTAT" ET TOUTES AUTRES CONDITIONS, DÉCLARATIONS ET GARANTIES EXPRESSES OU TACITES SONT FORMELLEMENT EXCLUES DANS LA LIMITE DE LA LOI APPLICABLE, Y COMPRIS NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVE À LA QUALITÉ MARCHANDE, À L’APTITUDE À UNE UTILISATION PARTICULIÈRE OU À L’ABSENCE DE CONTREFAÇON.

Please

Recycle

Preface xi

1. Network Express Module Overview 1

NEM Features and Specifications 1

ID Chip Feature 3

Operating System Requirements 4

System Interoperability 4

Host Platform Support 5

Storage System Support 5

Fibre Channel Switch Support 6

2. Hardware Installation and Removal 7

Observing ESD and Handling Precautions 8

Installing the NEM 8

▼ To Install the NEM 9

▼ To Connect the Optical Cables 11

Configuring the NEM For Hot-Plug Operation 14

Using the ILOM Web Interface 14

Using the ILOM Command-Line Interface 15

Verifying a Hot-Insert Operation 16

iii

Using the ILOM Web Interface 16

Using the ILOM CLI 17

▼ To Verify NEM Status 17

Replacing a NEM 19

▼ To Install the ID Chip Patch 19

▼ To Remove a NEM 19

▼ To Replace the ID Chip 20

3. HBA Software Installation 23

Driver Software for the Solaris OS 23

Solaris Diagnostic Support 23

Driver Software for Linux OSs 24

Red Hat Enterprise Linux 24

Novell SUSE Linux Enterprise Server 24

▼ To Update the Driver 24

▼ To Install SLES9-SP3 to FC Disk 25

▼ To Build the Linux 2.6 Driver 25

Driver Software for Windows 2003 OS 26

▼ To Install Windows OS Driver and Application Kits 26

Configuration and Diagnostic Utilities 26

4. Release Notes 29

Using the NEM With Sun StorEdge 3510 and 3511 Arrays 29

Solaris OS-Specific Issues 30

Out of Option ROM Memory Error in System BIOS 30

SUSE Linux Enterprise-Specific Issues 30

Windows Server 2003 OS-Specific Issues 30

A. Declaration of Conformity, Regulatory Compliance, and Safety Statements 31

iv Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008

Declaration of Conformity 33

Safety Agency Compliance Statement 35

Regulatory Compliance Statements 47

Index 51

Contents v

vi Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008

Figures

FIGURE 2-1 NEM Ejector Levers 9

FIGURE 2-2 Inserting the NEM Into the Chassis 10

FIGURE 2-3 Connecting the Optical Cables 12

FIGURE 2-4 Port Level LEDs 13

FIGURE 2-5 LEDs, Attention and Locator Buttons 18

FIGURE 2-6 Location of ID Chip 20

FIGURE 2-7 Installing the ID Chip 21

vii

viii Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008

Tables

TABLE 1-1 NEM Features and Specifications 2

TABLE 1-2 Supported Operating System Versions 4

TABLE 1-3 Platform and Operating System Support 5

TABLE 2-1 Optical Cable Specifications 11

TABLE 2-2 Port LED Indicator Status Definitions 13

TABLE 2-3 NEM LED Status 18

x Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008

Preface

This guide describes how to install and remove the Sun StorageTek™ 4 Gb Fibre Channel (FC) Network Express Module (NEM) Host Bus Adapter (HBA), 20-port pass-through RoHS 5 compliant module. This document is written for technicians, system administrators, application service providers (ASPs), and users who have advanced experience troubleshooting and replacing hardware.

How This Document Is Organized

Chapter 1 provides an overview of the product and lists the various operating

systems, host platforms, switches, and storage systems that support the NEM.

Chapter 2 describes how to install and remove the NEM.

Chapter 3 describes how to download and install the HBA drivers and patches.

Chapter 4 contains the latest supplementary information for the preceding chapters.

Appendix A provides the required product safety information.

Using UNIX Commands

This document might not contain information about basic UNIX®commands and procedures such as shutting down the system, booting the system, and configuring devices. Refer to the following for this information:

■ Software documentation that you received with your system

■ Solaris™ Operating System documentation, which is at:

http://docs.sun.com

Shell Prompts

Shell Prompt

C shell machine-name%

C shell superuser machine-name#

Bourne shell and Korn shell $

Bourne shell and Korn shell superuser #

xii Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008

Typographic Conventions

Typeface

AaBbCc123 The names of commands, files,

AaBbCc123 What you type, when contrasted

AaBbCc123 Book titles, new words or terms,

* The settings on your browser might differ from these settings.

Meaning Examples

Edit your.login file. and directories; on-screen computer output

with on-screen computer output

words to be emphasized. Replace command-line variables with real names or values.

Use ls -a to list all files.

% You have mail.

Password:

Read Chapter 6 in the User’s Guide.

These are called class options.

Yo u must be superuser to do this.

To delete a file, type rm filename.

Network Express Module Overview

This chapter provides a basic overview of the Sun StorageTek™ 4 Gb Fibre Channel (FC) Network Express Module (NEM) Host Bus Adapter (HBA). This chapter also describes the various operating systems, host platforms, storage, and infrastructure configurations that support the NEM. This chapter contains the following topics:

■ “NEM Features and Specifications” on page 1

■ “Operating System Requirements” on page 4

■ “System Interoperability” on page 4

NEM Features and Specifications

The Sun StorageTek 4 Gb FC NEM 20-Port HBA consists of a 20-port NEM bus expansion board that interfaces a FC optical media bus. The NEM provides closed chassis adapter installation, removal, integrated hot-plug, and protection from electrostatic discharge (ESD) handling damage.

The 20-port NEM consists of ten independent HBAs. Each HBA has two FC ports which provide exclusive connections to a single blade. The ports of each HBA cannot be shared with any other blade in the chassis.

The NEM supports 20 independent FC buses operating at 4.25 Gbits/sec. It is also backward compatible with 2.125-Gbit/sec and 1.0625-Gbit/sec devices. Small-Form Factor (SFF) optical transceivers are used to connect to the external FC buses.

Twenty SFP fiber-optic transceivers are included with each NEM. You can order additional NEMs and SFP transceivers from Sun Microsystems using the following part numbers:

Description Part Number

4 Gb FC NEM 20-port HBA SG-XPCIE20FC-NEM-Z

4 pack of Small-Form Pluggable shortwave FC optical transceivers capable of 4 Gb, 2 Gb, and 1 Gb transfer rates (RoHS-5 compliant)

Small-Form Pluggable shortwave FC optical transceiver capable of 4 Gb, 2 Gb, and 1 Gb transfer rates (RoHS-5 compliant)

See

TABLE 1-1 for a list of the NEM’s features.

TABLE 1-1 NEM Features and Specifications

Feature Description

NEM interface PCI Express ten x8 (ten x4 active links)

FC interface Dual port 4, 2, 1 Gbps auto-speed negotiation

FC topology Point-to-point (N-port), Arbitrated Loop (NL_port) and

Switched Fabric (N_port)

PCI transfer rate (maximum) PCI Express Generation One (2.5 Gbps) x4

Onboard memory One 4-MB flash ROM per chip, 40 MB total, field-

programmable One 1.5 MB SRAM per chip, 15 MB total NEM SRAM

ID chip Enables the HBA worldwide names (WWNs) to be

retained when a NEM is replaced. See “ID Chip

Feature” on page 3 for more information.

External FC connectors Small Form-Factor Pluggable (SFP) multimode optic

with LC-style connector

Maximum FC cable length 1 Gbps: 500 meters using 50/125 µm core fiber

300 meters using 62.5/125 µm core fiber

2 Gbps: 300 meters using 50/125 µm core fiber

150 meters using 62.5/125 µm core fiber

4 Gbps: 150 meters using 50/125 µm core fiber

70 meters using 62.5/125 µm core fiber

XSFP-SW-4GB-4PK

XSFP-SW-4GB

2 Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008

TABLE 1-1 NEM Features and Specifications (Continued)

Feature Description

LED indicators A blue (Ready to Remove), yellow (Service Action

Required) and green (Power, Attention, and Connected) LED on the front panel.

Two LEDs per channel (green and yellow) on the front panel used to indicate port status.

Buttons Attention button to support hot-swap functionality.

Locator button to assist in locating the module. (See

FIGURE 2-5 for button locations.)

Form Factor PCI Network Express Module

ID Chip Feature

The 20-port NEM has an ID chip on it that contains an Electrically Erasable Read Only Memory (EEPROM). This EEPROM stores the worldwide names (WWNs) for each of the ten HBAs and 20 FC ports on the NEM.

When you replace a failed NEM that is running firmware prior to version 2.72a, each of the ten HBAs and 20 FC ports on the NEM is assigned new port and node WWNs. Thus, you must update SAN components, such as FC switches and storage arrays, with the new WWN values.

However, if the failed NEM is running firmware version 2.72a, at minimum, you can retain the existing HBA and FC port WWNs by removing the ID chip from the failed NEM and installing the chip on the replacement NEM. Thus, you do not have to update any SAN components as part of the NEM replacement. In order for the ID chip feature to work, the replacement NEM must be running firmware version 2.72a, at minimum.

For information about determining and updating the firmware version, see the following Emulex documents:

■ Solaris:

http://www.emulex.com/support/solaris/sfs_100/manual.pdf#P4

Note – For the Solaris OS, the 2.72a firmware is embedded in the emlxs driver

version 2.21g, at minimum. This driver is part of s10u5 and available as Solaris 10 patch 120223-22 or 120222-22 at:

http://sunsolve.sun.com

■ Linux: www-dl.emulex.com/support/linux/81103/pdf/manual.pdf

Chapter 1 Network Express Module Overview 3

■ Windows: www-

dl.emulex.com/support/windows/storport/130a9/manual.pdf

If you replace the failed NEM (regardless of firmware version) and do not swap the ID chip, new WWNs are assigned to each of the ten HBAs and 20 FC ports; thus, requiring you to update SAN components with the new WWN values.

For more information about replacing a failed NEM, see “Replacing a NEM” on

page 19.

Operating System Requirements

The NEM requires the operating system (OS) levels listed in TABLE 1-2.

TABLE 1-2 Supported Operating System Versions

Operating System Supported Versions

Solaris (x64) Solaris 10 11/06, Solaris 10 06/06, or Solaris 10 01/06 and latest

Linux Red Hat Enterprise Linux (RHEL) 4 Update 3 and Update 4 x64

Microsoft Windows Windows Server 2003 Enterprise Edition x64

* Patches are available at http://sunsolve.sun.com. \ Packages are available for download at: the Sun Download Center (SDLC).

patches

Solaris 10, latest patches 119255, 119131, 120222, and 120223 plus packages

SUSE Linux Enterprise Server (SLES) 9 SP3 x64

Windows Server 2003 Enterprise Edition x86 w/SP1

Windows Server 2003 Standard Edition x86 w/SP1

119131, 120222, and 120223

SUNWemlxs and SUNWemlxu

System Interoperability

This section provides information about selected platforms, storage systems, and switches that are compatible with the heterogeneous FC network design of the NEM. This section contains the following topics:

■ “Host Platform Support” on page 5

■ “Storage System Support” on page 5

4 Sun StorageTek 4 Gb FC NEM 20-Port Host Bus Adapter User’s Guide • February 2008

■ “Fibre Channel Switch Support” on page 6

Host Platform Support

The NEM is supported by the platforms and operating systems (OSs) listed in

TABLE 1-3.

TABLE 1-3 Platform and Operating System Support

Platform Supported OSs

Sun Blade™ 8000 Modular System Sun Solaris, Linux, and Windows

Sun Blade 8000 P Modular System Sun Solaris, Linux, and Windows

You can install the NEM in an available NEM slot of the Sun Blade 8000 Chassis or Sun Blade 8000 P chassis.

For information about updating the ILOM firmware for the chassis monitoring module (CMM) or the service processor (SP) go to

http://www.sun.com/servers/blades/8000/downloads.jsp. For firmware

upgrade instructions, see Preparing to Upgrade the ILOM Firmware in the Sun Blade 8000 Series Online Information System.

Storage System Support

The NEM supports the following storage systems:

■ Sun StorEdge™ 3510 and 3511 FC Arrays (see “Using the NEM With Sun

StorEdge 3510 and 3511 Arrays” on page 29)

■ Sun StorEdge 6020 and 6120 Arrays

■ Sun StorEdge 6130 Array

■ Sun StorageTek 6140 Array

■ Sun StorageTek 6540 Array

■ Sun StorageTek FlexLine™ 380 Storage System

■ Sun StorEdge 6320 system

■ Sun StorEdge L25 and L100 tape libraries with Fibre Channel / LVD Internal

Bridge

■ Sun StorEdge C4 tape library with LVD SCSI to Fibre Channel Card

■ Sun StorEdge L500 tape library

■ Sun StorEdge L180, L700 tape libraries

Chapter 1 Network Express Module Overview 5

+ 47 hidden pages