Sun Microsystems Ethernet PCI-X Adapter User Manual
Sun™10-Gigabit Ethernet PCI-X
Adapter Installation and User’s
Guide
Sun Microsystems, Inc.
www.sun.com
Part No. 819-0938-12
December 2005, Revision A
Submit comments about this document at: http://www.sun.com/hwdocs/feedback
Copyright 2005 Sun Microsystems, Inc., 4150 Network Circle,SantaClara,California95054,U.S.A.Allrightsreserved.
Sun Microsystems, Inc. has intellectual propertyrightsrelatingtotechnologythatisdescribedinthisdocument.Inparticular, and without
limitation, these intellectual property rights may include one or moreoftheU.S.patentslistedathttp://www.sun.com/patents and one or
more additional patents or pending patent applications in the U.S. and in other countries.
This document and the product to which it pertains aredistributedunderlicensesrestrictingtheiruse,copying,distribution,and
decompilation. No part of the product or of this document may be reproducedinanyformbyanymeanswithoutpriorwrittenauthorizationof
Sun and its licensors, if any.
Third-party software, including font technology, is copyrighted and licensed from Sun suppliers.
Parts of the product may be derived fromBerkeleyBSDsystems,licensedfromtheUniversityofCalifornia.UNIXisaregistered trademark in
the U.S. and in other countries, exclusively licensed through X/Open Company, Ltd.
Sun, Sun Microsystems, the Sun logo, AnswerBook2, docs.sun.com, Sun Fire,andSolarisaretrademarksorregistered trademarks of Sun
Microsystems, Inc. in the U.S. and in other countries.
All SPARC trademarks are used under license and are trademarks or registeredtrademarksofSPARC International, Inc. in the U.S. and in other
countries. Products bearing SPARC trademarks are based upon an architecturedevelopedbySunMicrosystems,Inc.
The OPEN LOOK and Sun™ Graphical User Interface was developed by Sun Microsystems, Inc. for its users and licensees. Sunacknowledges
the pioneering efforts of Xeroxinresearchinganddevelopingtheconceptofvisualorgraphicaluser interfaces for the computer industry. Sun
holds a non-exclusive license from Xerox to the Xerox Graphical User Interface, which license also covers Sun’s licensees who implement OPEN
LOOK GUIs and otherwise comply with Sun’s written license agreements.
U.S. Government Rights—Commercial use. Government users are subject to the Sun Microsystems, Inc. standard license agreement and
applicable provisions of the FAR and its supplements.
DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES,
INCLUDING ANY IMPLIED WARRANTYOF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT,
ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Copyright 2005 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, Californie 95054, Etats-Unis. Tousdroits réservés.
Sun Microsystems, Inc. a les droits de propriété intellectuels relatants à la technologie qui est décrit dans ce document. En particulier, et sans la
limitation, ces droits de propriété intellectuels peuvent inclure un ou plus des brevets américains énumérés à http://www.sun.com/patents et
un ou les brevets plus supplémentaires ou les applications de brevet en attente dans les Etats-Unis et dans les autres pays.
Ce produit ou document est protégé par un copyright et distribué avec des licences qui en restreignent l’utilisation, la copie, la distribution, et la
décompilation. Aucune partie de ce produit ou document ne peut être reproduite sous aucune forme, par quelque moyen que ce soit, sans
l’autorisation préalable et écrite de Sun et de ses bailleurs de licence, s’il y en a.
Le logiciel détenu par des tiers, et qui comprend la technologie relative aux polices de caractères, est protégé par un copyright et licencié par des
fournisseurs de Sun.
Des parties de ce produit pourront être dérivées des systèmes Berkeley BSD licenciés par l’Université de Californie. UNIX est une marque
déposée aux Etats-Unis et dans d’autres pays et licenciée exclusivement par X/Open Company,Ltd.
Sun, Sun Microsystems, le logo Sun, AnswerBook2, docs.sun.com,Sun Fire, et Solaris sont des marques de fabrique ou des marques déposées de
Sun Microsystems, Inc. aux Etats-Unis et dans d’autres pays.
Toutes les marques SPARCsont utilisées sous licence et sont des marques de fabrique ou des marques déposées de SPARCInternational, Inc.
aux Etats-Unis et dans d’autres pays. Les produits portant les marques SPARCsont basés sur une architecture développée par Sun
Microsystems, Inc.
L’interfaced’utilisation graphique OPEN LOOK et Sun™ a été développée par Sun Microsystems, Inc. pour ses utilisateurs et licenciés. Sun
reconnaît les efforts de pionniers de Xerox pour la recherche et le développement du concept des interfaces d’utilisation visuelle ou graphique
pour l’industrie de l’informatique. Sun détient une license non exclusive de Xerox sur l’interface d’utilisation graphique Xerox, cette licence
couvrant également les licenciées de Sun qui mettent en place l’interface d ’utilisation graphique OPEN LOOK et qui en outre se conforment
aux licences écrites de Sun.
LA DOCUMENTATION EST FOURNIE "EN L’ÉTAT" ET TOUTES AUTRES CONDITIONS, DECLARATIONS ET GARANTIES EXPRESSES
OU TACITES SONT FORMELLEMENT EXCLUES, DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE, Y COMPRIS NOTAMMENT
TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE, A L’APTITUDE A UNE UTILISATION PARTICULIERE OU A
L’ABSENCE DE CONTREFAÇON.
Please
Recycle
Contents
Preface xiii
1. Product Overview 1
Product Description 1
Hardware and Software Requirements 2
Features 3
2. Installing the Adapter 5
Installing the Adapter Without Dynamic Reconfiguration 5
▼ To Install the Adapter 6
▼ To Install the Optical Transceiver 7
▼ To Verify the Hardware Installation 9
Rebooting the System 10
Installing the Adapter With Dynamic Reconfiguration 11
Using the Installation Script 11
▼ To Install the Software Using the Installation Script 11
Verifying the Software Installation 14
Configuring the Network Host Files 15
3. Configuring Driver Parameters 19
10-Gigabit Ethernet Device Driver Parameters 19
iii
10-Gigabit Ethernet Driver Parameter Values and Definitions 20
Flow Control Parameters 20
Interrupt Parameters 21
Jumbo Frames 22
▼ To Configure Jumbo Frames Using ndd 22
▼ To Configure Jumbo Frames in a Linux Environment 23
Setting ixge Driver Parameters 23
Setting Parameters Using the ndd Utility 23
▼ To Specify Device Instances for the ndd Utility 24
Noninteractive and Interactive Modes 24
▼ To Use the ndd Utility in Noninteractive Mode 24
▼ To Use the ndd Utility in Interactive Mode 25
Setting Parameters Using the ixge.conf File 26
▼ To Set Driver Parameters Using a ixge.conf File 27
10-Gigabit Ethernet Driver Operating Statistics 29
▼ To Check Link Partner Settings 32
▼ To Discover Device Capabilities 34
▼ To Discover Link Settings 35
Configuration Checking 35
4. Configuring VLANs 37
Overview of VLANs 37
Configuring VLANs 39
▼ To Configure Static VLANs 40
A. Specifications 43
Performance Specifications 43
Physical Characteristics 44
Power Requirements 44
iv Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005
B. Diagnostic Software 45
SunVTS Diagnostic Software 45
Updating SunVTS to Recognize the Adapter 46
▼ To Update SunVTS to Recognize the Adapter 46
Using the SunVTS netlbtest 47
▼ To Use the netlbtest 47
C. Installing the Software Manually 49
▼ To Install the Driver Software Manually 49
D. Installing the Sun 10-Gigabit Ethernet Device Driver on Linux Platforms 53
Setting Up the Driver in a Linux Platform 53
▼ To Set Up the Driver in a Linux Platform 53
Setting Driver Parameters in a Linux Environment 56
▼ To Set ixge Parameters in a Linux Environment 57
▼ To Configure VLANs in a Linux Environment 59
▼ To Configure Bonding for Multiple ixge Interfaces 60
Index 61
Contents v
vi Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005
Tables
TABLE 1-1 Hardware and Software Requirements for Sun SPARC Servers 2
TABLE 3-1 ixge Driver Parameter, Status, and Descriptions 20
TABLE 3-2 Read-Write Flow Control Keyword Descriptions 21
TABLE 3-3 RX Blanking Register for Alias Read 21
TABLE 3-4 accept-jumbo Parameters 22
TABLE 3-5 Read-Only ixge Device Capabilities 29
TABLE 3-6 Receive and Transmit Parameters 30
TABLE A-1 Performance Specifications 43
TABLE A-2 Physical Characteristics 44
TABLE A-3 Power Requirements 44
TABLE B-1 SunVTS Documentation 46
TABLE C-1 Files and Directories on the CD-ROM 50
TABLE D-1 Tunable ixge Driver Parameters for Linux Operating Systems 58
vii
viii Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005
Figures
FIGURE 1-1 Sun 10-Gigabit Ethernet PCI-X Adapter with Optical Transceiver Installed 2
FIGURE 1-2 Sun 10-Gigabit Ethernet PCI-X Adapter Fiber Optic Channels 3
FIGURE 4-1 Example of Servers Supporting Multiple VLANs With Tagging Adapters 38
FIGURE 4-2 Ethernet Tag Header Format 40
ix
x Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005
Declaration of Conformity
Compliance Model Number: Kirkwood
Product Family Name:
EMC
USA—FCC Class A
This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions:
1. This equipment may not cause harmful interference.
2. This equipment must accept any interference that may cause undesired operation.
European Union
This equipment complies with the following requirements of the EMC Directive 89/336/EEC:
As Telecommunication Network Equipment (TNE) in Both Telecom Centers and Other Than Telecom Centers per (as applicable):
EN300-386 V.1.3.1 (09-2001) Required Limits:
EN55022/CISPR22 Class A
EN61000-3-2 Pass
EN61000-3-3 Pass
EN61000-4-2 6 kV (Direct), 8 kV (Air)
EN61000-4-3 3 V/m 80-1000MHz, 10 V/m 800-960 MHz, and 1400-2000 MHz
EN61000-4-4 1 kV AC and DC Power Lines, 0.5 kV Signal Lines
EN61000-4-5 2 kV AC Line-Gnd, 1 kV AC Line-Line and Outdoor Signal Lines, 0.5 kV Indoor signal Lines > 10m
EN61000-4-6 3 V
EN61000-4-11 Pass
As Information Technology Equipment (ITE) Class A per (as applicable):
EN55022:1998/CISPR22:1997 Class A
EN55024:1998 Required Limits:
EN61000-4-2 4 kV (Direct), 8 kV (Air)
EN61000-4-3 3 V/m
EN61000-4-4 1 kV AC Power Lines, 0.5 kV Signal and DC Power Lines
EN61000-4-5 1 kV AC Line-Line and Outdoor Signal Lines, 2 kV AC Line-Gnd, 0.5 kV DC Power Lines
EN61000-4-6 3 V
EN61000-4-8 1 A/m
EN61000-4-11 Pass
EN61000-3-2:1995 + A1, A2, A14 Pass
EN61000-3-3:1995 Pass
Safety: This equipment complies with the following requirements of the Low Voltage Directive 73/23/EEC:
EC Type Examination Certificates:
EN60950:2000, 3rd Edition TÜV Rheinland Certificate No. xxxxxxxxxxxx
IEC 60950:2000, 3rd Edition CB Scheme Certificate No. xxxxxxxxxxxx
Evaluated to all CB Countries
UL 60950, 3rd Edition, CSA C22.2 No. 60950-00 File: Vol. Sec.
UL 60950, 3rd Edition, CSA C22.2 No. 950-00 File: Vol. Sec.
FDA DHHS Accession Number (Monitors Only)
Supplementary Information: This product was tested and complies with all the requirements for the CE Mark.
Sun 10-GB Ethernet PCIX (X5558A
/S/ /S/
Dennis P. Symanski DATE
Manager, Compliance Engineering
Sun Microsystems, Inc.
4150 Network Circle, MPK15-102
Santa Clara, CA 95054 U.S.A.
Tel: 650-786-3255
Fax: 650-786-3723
Pamela J. Dullaghan DATE
Quality Program Manager
Sun Microsystems Scotland, Limited
Springfield, Linlithgow
West Lothian, EH49 7LR
Scotland, United Kingdom
Tel: +44 1 506 672 395 Fax: +44 1 506 670 011
xi
xii Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005
Preface
The Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide provides
installation instructions for the Sun 10-Gigabit Ethernet PCI-X adapter. This
document also describes how to configure the driver software.
These instructions are designed for enterprise system administrators with experience
installing network hardware and software.
How This Book Is Organized
Chapter 1 provides a description of the adapter, including hardware and software.
Chapter 2 describes how to install the adapter in your system, verify that it is
correctly installed, and install the driver software using the automated script.
Chapter 3 describes how to configure the driver parameters used by the Sun 10Gigabit Ethernet PCI-Xadapter.
Chapter 4 explains VLANs in detail, and provides configuration instructions and
examples.
Appendix A provides specifications for the Sun 10-Gigabit Ethernet PCI-Xadapter.
Appendix B provides an overview of the SunVTS diagnostic application and
instructions for updating the SunVTS software to recognize the adapter.
Appendix C describes how to install the driver software manually.
Appendix D explains how to install and configure the Sun 10-Gigabit Ethernet PCIX device driver in a Linux environment.
xiii
Using UNIX Commands
This document might not contain information on basic UNIX®commands and
procedures such as shutting down the system, booting the system, and configuring
devices. Refer to the following for this information:
■ Software documentation that you received with your system
■ Solaris™ Operating System documentation, which is at:
http://docs.sun.com
Shell Prompts
Shell Prompt
C shell machine-name%
C shell superuser machine-name#
Bourne shell and Korn shell $
Bourne shell and Korn shell superuser #
xiv Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005
Typographic Conventions
Typeface
AaBbCc123 The names of commands, files,
AaBbCc123
AaBbCc123 Book titles, new words or terms,
* The settings on your browser might differ from these settings.
*
Meaning Examples
Edit your.login file.
and directories; on-screen
computer output
What you type, when contrasted
with on-screen computer output
words to be emphasized.
Replace command-line variables
with real names or values.
Use ls -a to list all files.
% You have mail.
% su
Password:
Read Chapter 6 in the User’s Guide.
These are called class options.
Yo u must be superuser to do this.
To delete a file, type rm filename.
Accessing Sun Documentation
You can view, print, or purchase a broad selection of Sun documentation, including
localized versions, at:
http://www.sun.com/documentation
Third-Party Web Sites
Sun is not responsible for the availability of third-party web sites mentioned in this
document. Sun does not endorse and is not responsible or liable for any content,
advertising, products, or other materials that are available on or through such sites
or resources. Sun will not be responsible or liable for any actual or alleged damage
or loss caused by or in connection with the use of or reliance on any such content,
goods, or services that are available on or through such sites or resources.
Preface xv
Contacting Sun Technical Support
If you have technical questions about this product that are not answered in this
document, go to:
http://www.sun.com/service/contacting
Sun Welcomes Your Comments
Sun is interested in improving its documentation and welcomes your comments and
suggestions. You can submit your comments by going to:
http://www.sun.com/hwdocs/feedback
Please include the title and part number of your document with your feedback:
Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide, part number 8xxxxxx-xx
xvi Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005
CHAPTER
1
Product Overview
This chapter contains an overview of the Sun 10-Gigabit Ethernet PCI-X adapter,
including:
■ “Product Description” on page 1
■ “Hardware and Software Requirements” on page 2
■ “Features” on page 3
Product Description
The Sun 10-Gigabit Ethernet PCI-X adapter is a low profile 133 MHz 10 gigabit
Ethernet card utilizing the Intel 82597EX PCI-X MAC controller with XFP-based 10gigabit Ethernet optics.
FIGURE 1-1 shows the adapter with the optical transceiver inserted.
Note – The adapter must be inserted into the system first. Then insert the optical
transceiver into the adapter.
1
FIGURE 1-1 Sun 10-Gigabit Ethernet PCI-X Adapter with Optical Transceiver Installed
Hardware and Software Requirements
Before installing the adapter, make sure your system meets the required hardware
and software.
TABLE 1-1 lists the supported hardware and software for Sun SPARC
systems.
TABLE1-1 Hardware and Software Requirements for Sun SPARC Servers
Requirements Hardware or Software
Hardware Sun Fire™ V440, 490, 880, V890, T2000
Sun Fire V40z, X4200
Operating System Solaris 9 9/04, and 10 SPARC Operating System
RedHat Enterprise Linux 3.0 and 4.0
SuSe Linux Enterprise Server 9.0 SP1
Note – The preceding information is up-to-date as of the printing of this manual.
Visit Sun on the World Wide Web at http://www.sun.com/ for the latest
information.
2 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005
®
FIGURE 1-2 Sun 10-Gigabit Ethernet PCI-X Adapter Fiber Optic Channels
Features
The Sun 10-Gigabit Ethernet PCI-X adapter addresses the following requirements
and provides additional features and benefits:
■ One full-duplex 10 gigabit Ethernet interface that uses a small form factor
pluggable (XFP) optical transceiver duplex LC fiber connector
■ PCI-X -133MHz compatible and PCI-66 MHz compliant
■ Uses the Intel 82597EX PCI-X MAC controller
■ Uses XAUI to XFI Serdes
■ Dynamic reconfiguration (DR) and redundancy/failover support
■ kstat and snoop support
■ Support for promiscuous and multicast modes
■ Jumbo frames support up to 8000 bytes
■ Low profile 64-bit PCI-X plug-in card
■ PCI Local Bus Rev 2.3-compliant (6.6-inch x 2.536-inch short card)
■ Implements PCI-X addendum to PCI Local Bus specifications, Revision 1.0A
■ IPv4, IPv6, and IPMP support
■ TCP, UDP, and IP hardware checksum offload
■ 802.1Q VLAN support
■ IEEE 802.3ad link aggregation (trunking)
■ NDD physical layer management configuration capability
Chapter 1 Product Over view 3
4 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005
CHAPTER
2
Installing the Adapter
This chapter describes how to install the Sun 10-Gigabit Ethernet PCI-X adapter in
your system and verify that it has been installed correctly. The chapter then
describes how to install the driver software using the automated script. Finally, this
chapter describes how to edit the network host files after installing the adapter on
your system.
This chapter contains the following sections:
■ “Installing the Adapter Without Dynamic Reconfiguration” on page 5
■ “Installing the Adapter With Dynamic Reconfiguration” on page 11
■ “Using the Installation Script” on page 11
■ “Verifying the Software Installation” on page 14
■ “Configuring the Network Host Files” on page 15
Note – If you are installing the Sun 10-Gigabit Ethernet PCI-X adapter in a machine
running the Solaris x86 Operating System Dynamic Reconfiguration (DR) is not
supported.
Installing the Adapter Without Dynamic Reconfiguration
Caution – If your are installing the Sun 10-Gigabit Ethernet PCI-X adapter into a
machine running Solaris 10, you must install the software before you install the
hardware. Failure to install the software before installing the hardware will allow the
Sun 10-Gigabit Ethernet PCI-X adapter to attach to an older version of the software.
See “Using the Installation Script” on page 11.
5
▼ To Install the Adapter
The following instructions describe the basic tasks required to install the adapter.
Refer to your system installation or service manual for detailed PCI adapter
installation instructions.
1. Halt and power off your system.
2. Power off all of the peripherals connected to your system.
3. Open the system unit.
4. Attach the antistatic wrist strap to yourself and to the system.
Attach the adhesive copper strip of the antistatic wrist strap to the metal casing of
the power supply. Wrap the other end twice around your wrist, with the adhesive
side against your skin.
5. Holding the PCI adapter by the edges, unpack it and place it on an antistatic
surface.
6. Using a No. 2 Phillips screwdriver, remove the PCI filler panel from the slot in
which you want to insert the PCI adapter.
Save the filler panel screw for Step 9.
7. Insert the adapter into the PCI opening.
Holding the PCI adapter by the edges, align the adapter edge connector with a 66
MHz PCI slot or a PCI-X slot. Slide the adapter face plate into the small slot at the
end of the PCI opening.
8. Applying even pressure at both corners of the adapter, push the PCI adapter until
it is firmly seated in the slot.
Caution – Do not use excessive force when installing the adapter into the PCI slot.
You might damage the adapter’s PCI connector. If the adapter does not seat properly
when you apply even pressure, remove the adapter and carefully reinstall it.
9. Secure the adapter to the PCI slot using the screw you removed in Step 6.
10. Close the system.
Note – Green LEDs do not light until the correct driver is installed.
6 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005
▼ To Install the Optical Transceiver
The Sun 10-Gigabit Ethernet PCI-Xadapter requires an optical transceiver to create
and Ethernet connection. The optical transceiver Part Number: 135-1172-01 is
available from Sun Microsystems.
1. Pull the white locking handle into the full horizontal position.
You will feel the handle click into position when it is fully opened.
2. Holding the optical transceiver by the edges, align the transceiver with the slot in
the Sun 10-Gigabit Ethernet PCI-Xadapter and slide it into the opening.
3. Applying even pressure at both corners of the transceiver, push the transceiver
until it is firmly seated in the slot.
Chapter 2 Installing the Adapter 7
4. Push the handle closed to lock the optical transceiver in place.
5. Detach the wrist strap.
Caution – If you pull the locking handle down when the optical transceiver is
installed, remove the optical transceiver entirely and reinstall it. The handle operates
an internal lock. Pulling the handle down can disconnect the optical transceiver,
even though it might appear to be connected.
6. Connect the Ethernet cable.
8 Sun 10-Gigabit Ethernet PCI-X Adapter Installation and User’s Guide • December 2005
Loading...