Sun Microsystems,Inc. hasintellectual property rightsrelating totechnology embodiedin theproduct that is described in this document. In
particular,and withoutlimitation, theseintellectual property rights may include one or more ofthe U.S.patents listedat
http://www.sun.com/patents and one or more additionalpatents orpending patentapplications inthe U.S.and inother countries..
Sun, SunMicrosystems, theSun logo,SunVTS, andSolaris are trademarksor registered trademarksof SunMicrosystems, Inc.in theU.S. and
other countries.
UNIX isa registered trademarkin theU.S. andother countries,exclusively licensedthrough X/OpenCompany, Ltd.
Products covered byand informationcontained inthis servicemanual arecontrolled by U.S. Export Control laws and may be subject to the
export orimport lawsin othercountries. Nuclear, missile, chemical biological weapons or nuclear maritime end uses or end users, whether
direct orindirect, are strictly prohibited. Exportor reexport to countries subject to U.S. embargo orto entitiesidentified onU.S. exportexclusion
lists, including,but notlimited to,the deniedpersons andspecially designatednationals listsis strictlyprohibited.
DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES,
INCLUDING ANY IMPLIED WARRANTY OFMERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT,
ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Sun Microsystems,Inc. détientles droits depropriété intellectuelsrelatifs à la technologie incorporée dans le produit qui est décrit dans ce
document. Enparticulier,et cesans limitation,ces droits de propriété intellectuellepeuvent inclure un ou plus des brevetsaméricains listésà
l’adresse http://www.sun.com/patents et un ou les brevets supplémentaires oules applicationsde brevet enattente auxEtats -Unis etdans les
autres pays.
Toutes les marques SPARC sont utilisées sous licence et sont des marques de fabrique ou des marquesdéposées deSPARC International,Inc.
aux Etats-Uniset dansd’autres pays.Les produits portantles marquesSPARC sont basés sur une architecture développéepar Sun
Microsystems, Inc.
UNIX®. PCI-Express®. Lelogo Adobe.et lelogo PostScriptsont desmarques de fabrique ou des marques déposées de Adobe Systems,
Incorporated.
Ce produit est soumis à la législation américaine en matière de contrôle des exportations et peut être soumis à la règlementation en vigueur
dans d’autres pays dans le domaine des exportations et importations. Les utilisations , ou utilisateurs finaux, pour des armes nucléaires, des
missiles, des armes biologiques et chimiques ou du nucléaire maritime, directement ou indirectement, sont strictement interdites. Les
exportations ou reexportations vers les pays sous embargo américain, ou vers des entités figurant sur les listes d’exclusion d’exportation
américaines, y compris, mais demanière non exhaustive, la liste de personnes qui font objet d’un ordre de ne pas participer, d’une façon directe
ou indirecte, aux exportations des produits ou des services qui sont régis par la législation américaine en matière de contrôle des exportations
et la liste de ressortissants spécifiquement désignés, sont rigoureusement interdites. L’utilisation de pièces détachées ou d’unités centrales de
remplacement est limitée aux réparations ou à l’échange standard d’unités centrales pour les produits exportés, conformément à la législation
américaine enmatière d’exportation.Sauf autorisationpar les autorités des Etats-Unis, l’utilisation d’unités centrales pour procéder àdes mises
à jour de produits est rigoureusement interdite.
LA DOCUMENTATION EST FOURNIE "EN L’ETAT" ET TOUTES AUTRES CONDITIONS, DECLARATIONS ET GARANTIES EXPRESSES
OU TACITES SONT FORMELLEMENTEXCLUES, DANSLA MESUREAUTORISEE PARLA LOIAPPLICABLE, YCOMPRIS NOTAMMENT
TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE, A L’APTITUDE A UNE UTILISATION PARTICULIERE OU A
L’ABSENCE DE CONTREFACON.
Please
Recycle
Contents
Prefacexiii
1.Product Overview1
Components1
Product Description1
Hardware and Software Requirements2
Features3
2.Installing and Setting Up the Driver5
Downloading and Installing the Driver on a Solaris SPARC or x86 Platform5
▼To Download the Driver on a Solaris Platform5
▼To Remove the Driver from a Solaris Platform8
Downloading and Installing the Driver on a Linux Platform9
▼To Remove the Driver From a Linux Platform10
3.Installing the Adapter11
Installing the Adapter11
▼To Install the Adapter12
Installing an Optical Transceiver15
▼To Install an Optical Transceiver16
Verifying the Hardware Installation18
iii
▼To Verify the Hardware Installation18
Rebooting the System20
4.Network Configuration21
Configuring the Network Host Files21
Setting Up a 10-Gigabit Ethernet Network on a Diskless Client System23
▼To Set Up a 10-Gigabit Ethernet Port on a Diskless Client24
Installing the Solaris Operating System Over a 10-Gigabit Ethernet Network25
▼To Install the Solaris Operating System Over a 10-Gigabit Ethernet
Network25
Booting Over the 10-Gigabit Ethernet Network for Solaris x86 and Linux
Systems29
▼To Boot Over the Network on Solaris x86 and Linux Systems29
5.Configuring the nxge Device Driver Parameters33
nxge Hardware and Software Overview33
Setting nxge Driver Parameters on a Solaris Platform34
Setting Parameters Using the ndd Utility34
Noninteractive and Interactive Modes34
▼To Specify Device Instances for the ndd Utility35
▼To Specify Parameter Values Using the ndd Utility35
▼To Use the ndd Utility in Interactive Mode35
Setting Parameters Using the nxge.conf File36
▼To Set Driver Parameters Using an nxge.conf File37
Tuning for Maximum Performance on a Solaris Platform41
▼To Improve Performance on an UltraSPARC CPU Based Sun Platform41
▼To Improve Performance on an AMD CPU Based Sun Platform42
▼To Obtain Higher Throughput Using the Generic Tunables for the Solaris
Compliance Model Number:ATLS2XGF
Product Family Name:Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter
EMC
USA—FCC Class A
This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions:
1. This equipment may not cause harmful interference.
2. This equipment must accept any interference that may cause undesired operation.
European Union
This equipment complies with the following requirements of the EMC Directive 89/336/EEC:
As Information Technology Equipment (ITE) Class A per (as applicable):
EN 55022:1994 +A1:1995 +A2:1997 Class A
EN 61000-3-2:2000Pass
EN 61000-3-3:1995 +A1:2000Pass
EN 55024:1998 +A1:2001 +A2:2003 Required Limits:
IEC 61000-4-24 kV (Direct), 8kV (Air)
IEC 61000-4-33 V/m
IEC 61000-4-41 kV AC Power Lines, 0.5 kV Signal and DC Power Lines
IEC 61000-4-51 kV AC Line-Line and Outdoor Signal Lines, 2 kV AC Line-Gnd, 0.5 kV DC Power Lines
IEC 61000-4-63 V
IEC 61000-4-81 A/m
IEC 61000-4-11Pass
Safety
This equipment complies with the following requirements of the Low Voltage Directive 73/23/EEC:
EC Type Examination Certificates:
EN 60950-1:2001, 1st Edition
IEC 60950-1:2001, 1st EditionCB Scheme Certificate No.
Evaluated to all CB Countries
UL and cUL/CSA 60950-1:2001, CSA C22.2 No. 60950-00 File:E138989-A82Vol. 54
FDA DHHS Accession Number (Monitors Only)
Supplementary Information
This equipment was tested and complies with all the requirements for the CE Mark.
This equipment complies with the Restriction of Hazardous Substances (RoHS) directive 2002/95/EC.
/S//S/
Dennis P. SymanskiDATE
Worldwide Compliance Engineering
Sun Microsystems, Inc.
4150 Network Circle, MPK15-102
Santa Clara, CA 95054 U.S.A.
Tel: 650-786-3255
Fax: 650-786-3723
Donald CameronDATE
Program Manager/Customer Quality
Sun Microsystems Scotland, Limited
Blackness Road, Phase I, Main Bldg.
Springfield, EH49 7LR
Scotland, United Kingdom
Tel: +44 1 506 672 539Fax: +44 1 506 670 011
This guide provides instructions for installing both the hardware and software for
the Sun Dual 10GbE XFP PCI Express card. This manual also describes how to
configure the nxge driver, which controls the card.
These instructions are designed for enterprise system administrators with experience
installing network hardware and software.
Note – In this document the term x86 refers to 64-bit and 32-bit systems
manufactured using processors compatible with the AMD64 or Intel Xeon/Pentium
product families. For supported systems, see the Solaris Hardware Compatibility Guide.
How This Document Is Organized
Chapter 1 provides an overview of the Sun x8 Express Dual 10 Gigabit Ethernet
Fiber XFP Low Profile Adapter.
Chapter 2 explains how to install the nxge device driver software in a Solaris
SPARC, Solaris x86, or Linux environment.
Chapter 3 describes how to install the Sun x8 Express Dual 10 Gigabit Ethernet Fiber
XFP Low Profile Adapter in your system and verify that it has been installed
correctly.
Chapter 4 describes how to edit the network host files after the adapter has been
installed on your system.
Chapter 5 explains how to set the nxge device driver parameters to customize each
device in your system.
xiii
Chapter 6 describes how to configure the Jumbo Frame feature.
Chapter 7 describes how to configure link aggregation.
Chapter 8 explains Virtual Local Area Networks (VLANs) in detail and provides
configuration instructions and examples.
Appendix A lists the specifications for the Sun x8 Express Dual 10 Gigabit Ethernet Fiber
XFP Low Profile Adapter.
Appendix B provides an overview of the SunVTS™ diagnostic application and
instructions for updating the SunVTS software to recognize the adapter.
Using UNIX Commands
This document might not contain information about basic UNIX®commands and
procedures such as shutting down the system, booting the system, and configuring
devices. Refer to the following for this information:
■ Software documentation that you received with your system
■ Solaris™ Operating System documentation, which is at:
http://docs.sun.com
xiv Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009
Shell Prompts
ShellPrompt
C shellmachine-name%
C shell superusermachine-name#
Bourne shell and Korn shell$
Bourne shell and Korn shell superuser#
Typographic Conventions
Typeface
AaBbCc123The names of commands, files,
AaBbCc123What you type, when contrasted
AaBbCc123Book titles, new words or terms,
* The settings on your browser might differ from these settings.
*
MeaningExamples
and directories; on-screen
computer output
with on-screen computer output
words to be emphasized.
Replace command-line variables
with real names or values.
Edit your.login file.
Use ls -a to list all files.
% You have mail.
su
%
Password:
Read Chapter 6 in the User’s Guide.
These are called class options.
Yo u must be superuser to do this.
To delete a file, type rm filename.
Sun is not responsible for the availability of third-party web sites mentioned in this
document. Sun does not endorse and is not responsible or liable for any content,
advertising, products, or other materials that are available on or through such sites
or resources. Sun will not be responsible or liable for any actual or alleged damage
or loss caused by or in connection with the use of or reliance on any such content,
goods, or services that are available on or through such sites or resources.
xvi Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009
Sun Welcomes Your Comments
Sun is interested in improving its documentation and welcomes your comments and
suggestions. You can submit your comments by going to:
http://www.sun.com/hwdocs/feedback
Please include the title and part number of your document with your feedback:
Sun Dual 10GbE XFP PCI Express Card User’s Guide, part number 820-0184-13
Prefacexvii
xviii Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009
CHAPTER
1
Product Overview
This chapter provides an overview of the Sun x8 Express Dual 10 Gigabit Ethernet
Fiber XFP Low Profile Adapter, including:
■ “Components” on page 1
■ “Product Description” on page 1
■ “Hardware and Software Requirements” on page 2
■ “Features” on page 3
Components
The carton in which your Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low
Profile Adapter was shipped should contain the following items:
■ Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter with a
The Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter is a low
profile x8 lane PCI-Express 10 gigabit Ethernet card utilizing the Sun ASIC with
XFP-based 10-gigabit Ethernet optics. The Sun x8 Express Dual 10 Gigabit Ethernet
Fiber XFP Low Profile Adapter requires an optical transceiver.
This chapter explains how to download and install the nxge driver. The nxge gigabit
Ethernet driver (nxge(7D)) is a multi-threaded, loadable, clonable, GLD-based
STREAMS driver. The nxge driver is managed by the dladm(1M) command line
utility, which allows VLANs to be defined on top of nxge instances and for nxge
instances to be aggregated. See the dladm(1M) man page for more details on
configuring the data-link interfaces and link aggregations.
This chapter contains the following sections:
■ “Downloading and Installing the Driver on a Solaris SPARC or x86 Platform” on
page 5
■ “Downloading and Installing the Driver on a Linux Platform” on page 9
Downloading and Installing the Driver
on a Solaris SPARC or x86 Platform
If your system uses the Solaris SPARC or x86 operating system you will need to
download and install the nxge device driver for Solaris platforms.
▼ To Download the Driver on a Solaris Platform
1. Locate and download the nxge device driver software at the following web site:
5. For x86 systems, install the software packages by typing the following at the
command line:
# /usr/sbin/pkgadd -d
A menu similar to the following displays:
The following packages are available:
1 SUNWnxge Sun PCI-E 10G/1G Ethernet Adapter Driver (i386)
1.0,REV=2006.12.05.10.0
Select package(s) you wish to process (or ’all’ to process
all packages). (default: all) [?,??,q]:
6. Select the packages you want to install:
■ Press Return or type all to accept the default and install all packages.
■ Type the specific numbers, separated by a space, if you prefer not to install any
optional packages.
Chapter 2 Installing and Setting Up the Driver7
7. Verify that the nxge driver is installed on the system:
Sun PCI-E 10G/1G Ethernet Adapter Driver(i386)
1.0,REV=2006.12.05.10.0 Copyright 2006 Sun Microsystems,
Inc. All rights reserved. Use is subject to license terms.
## Executing checkinstall script. Using as the package base directory.
## Processing package information.
## Processing system information.
4 package pathnames are already properly installed.
## Verifying package dependencies.
## Verifying disk space requirements.
## Checking for conflicts with packages already installed.
## Checking for setuid/setgid programs. This package contains
scripts which will be executed with super-user permission
during the process of installing this package.
Do you want to continue with the installation of [y,n,?] y
Installing Sun PCI-E 10G/1G Ethernet Adapter Driver as
## Installing part 1 of 1.
/kernel/drv/amd64/nxge [ verifying class ]
# Executing postinstall script.
# Installation of was successful.
▼ To Remove the Driver from a Solaris Platform
1. To discover the driver packages run the pkginfo command:
3. Discover the network interfaces before adding the package by using the
ifconfig -a command:
# ifconfig -a |grep eth
eth0 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DC
eth1 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DD
eth2 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DE
eth3 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DF
4. Use the rpm tool to install the driver on SuSe and RedHat Linux.
Note – In RHEL5.0 and later releases, the driver is packaged in the kmod driver
binary package format. This packaging allows forward and backward driver binary
compatibility within the same flavors of RHEL5 releases. Driver packages nxge
version 2.0.0 and later are not compatible with the earlier nxge-1.x-x releases. To
upgrade from 1.x-x to 2.x.x rpm package, it is necessary to remove nxge-1.x-x package before installing the 2.x.x package.
The RHEL5 nxge 2.x.x kmod package contains two separate packages: One for the
driver and another one for applications like nxge_config. You must install both of
the following packages:
To ensure that the driver is loaded after the rpm installation, enter the following:
# modprobe nxge
5. Verify the new network interface instances corresponding to the Sun x8 Express
Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter:
# ifconfig -a |grep eth
eth0 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DC
eth1 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DD
eth2 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DE
eth3 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DF
eth4 Link encap:Ethernet HWaddr 00:14:4F:6C:78:E8
eth5 Link encap:Ethernet HWaddr 00:14:4F:6C:78:E9
The Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter
instances, eth4 and eth5, are shown in
bold italics.
6. Add the nxge interfaces to the /etc/modules.conf file to automatically load
the driver after system reboot: