intellectual propertylaws. Exceptas expressly permitted in your license agreementor allowedby law, you may not use, copy,reproduce, translate,
broadcast, modify,license, transmit,distribute, exhibit,perform, publish,or displayany part,in anyform, orby anymeans. Reverseengineering,
disassembly, or decompilation of this software,unless required bylaw forinteroperability, isprohibited.
The informationcontained hereinis subjectto changewithout noticeand isnot warrantedto beerror-free.If youfind anyerrors, pleasereport them to us
in writing.
If thisis softwareor related softwaredocumentation thatis deliveredto theU.S. Governmentor anyonelicensing iton behalfof theU.S. Government,the
following noticeis applicable:
U.S. GOVERNMENTRIGHTS. Programs,software, databases, and related documentation and technical data deliveredto U.S.Government customers
are "commercial computer software" or"commercial technicaldata" pursuantto theapplicable FederalAcquisition Regulationand agency-specific
supplemental regulations.As such,the use,duplication, disclosure, modification, and adaptation shall be subject to the restrictionsand licenseterms set
forth inthe applicableGovernment contract,and, tothe extentapplicable bythe termsof theGovernment contract,the additionalrights setforth inFAR
52.227-19, CommercialComputer Software License (December 2007). Oracle USA, Inc., 500 Oracle Parkway, Redwood City, CA 94065.
This softwareor hardware isdeveloped forgeneral use in a varietyof informationmanagement applications.It isnot developed or intended for use inany
inherently dangerous applications, including applications which may create arisk ofpersonal injury.If youuse thissoftware orhardware in dangerous
applications, thenyou shallbe responsibleto takeall appropriate fail-safe, backup, redundancy,and othermeasures toensure the safe use. Oracle
Corporation andits affiliatesdisclaim anyliability forany damagescaused byuse ofthis software or hardware indangerous applications.
Oracle andJava areregistered trademarks of Oracle and/or its affiliates.Other namesmay betrademarks oftheir respectiveowners.
AMD, Opteron,the AMDlogo, andthe AMDOpteron logo are trademarks or registered trademarksof AdvancedMicro Devices. Intel and Intel Xeon are
trademarks orregistered trademarks of Intel Corporation. All SPARC trademarksare used under license and are trademarks or registeredtrademarks of
SPARCInternational, Inc.UNIX is a registered trademarklicensed throughX/Open Company,Ltd.
This software or hardware and documentation may provide access to or information on content, products, and services from third parties. Oracle
Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and
services. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party
content, products, or services.
restrictions d’utilisationet dedivulgation. Saufdisposition devotre contrat de licence ou de la loi, vous ne pouvez pas copier, reproduire, traduire,
diffuser,modifier, breveter, transmettre, distribuer, exposer, exécuter, publier ou afficher lelogiciel, mêmepartiellement, sousquelque formeet par
quelque procédéque cesoit. Parailleurs, ilest interdit de procéder àtoute ingénierieinverse dulogiciel, dele désassemblerou dele décompiler, exceptéà
des finsd’interopérabilité avecdes logicielstiers outel queprescrit par la loi.
Les informationsfournies dansce documentsont susceptiblesde modificationsans préavis.Par ailleurs,Oracle Corporationne garantitpas qu’elles
soient exemptesd’erreurs etvous invite,le caséchéant, àlui enfaire part par écrit.
U.S. GOVERNMENT RIGHTS. Programs, software, databases, and related documentation and technical data delivered to U.S. Government
customers are "commercial computer software" or "commercial technical data" pursuant to the applicable Federal Acquisition Regulation and
agency-specific supplemental regulations. As such, the use, duplication, disclosure, modification, and adaptation shall be subject to the
restrictions and license terms set forth in the applicable Government contract, and, to the extent applicable by the terms of the Government
contract, the additional rights set forth in FAR 52.227-19, Commercial Computer Software License (December 2007). Oracle America, Inc., 500
Oracle Parkway, Redwood City, CA 94065.
Ce logicielou matériela étédéveloppé pourun usagegénéral dansle cadred’applications degestion desinformations. Celogiciel oumatériel n’estpas
conçu nin’est destinéà êtreutilisé dansdes applicationsà risque,notamment dansdes applicationspouvant causerdes dommagescorporels. Si vous
utilisez celogiciel oumatériel dansle cadred’applications dangereuses, il est de votre responsabilitéde prendre toutesles mesuresde secours,de
sauvegarde, deredondance et autres mesures nécessairesà sonutilisation dansdes conditionsoptimales desécurité. OracleCorporation etses affiliés
déclinent touteresponsabilité quantaux dommagescausés parl’utilisation dece logicielou matérielpour cetype d’applications.
Oracle etJava sontdes marquesdéposées d’OracleCorporation et/oude sesaffiliés.Tout autre nom mentionné peut correspondre àdes marques
appartenant àd’autres propriétaires qu’Oracle.
AMD, Opteron,le logoAMD etle logoAMD Opteron sont des marquesou desmarques déposéesd’Advanced Micro Devices. Intel et Intel Xeon sont des
marques oudes marques déposées d’Intel Corporation. Toutesles marques SPARC sontutilisées souslicence etsont desmarques ou des marques
déposées deSPARCInternational, Inc.UNIX est une marque déposée concédée sous licence par X/Open Company, Ltd.
Please
Recycle
Contents
Using This Documentationvii
1.Product Overview1
Components1
Product Description1
Hardware and Software Requirements3
Features3
Declaration of Conformity5
2.Installing and Setting Up the Driver7
Downloading and Installing the Driver on a Solaris SPARC or x86 Platform7
▼To Download the Driver on a Solaris Platform7
▼To Remove the Driver from a Solaris Platform9
Downloading and Installing the Driver on a Linux Platform10
▼To Remove the Driver From a Linux Platform12
3.Installing the Adapter13
Installing the Adapter13
▼To Install the Adapter14
Installing an Optical Transceiver17
▼To Install an Optical Transceiver18
iii
Verifying the Hardware Installation20
▼To Verify the Hardware Installation20
Rebooting the System22
4.Network Configuration23
Configuring the Network Host Files23
Setting Up a 10-Gigabit Ethernet Network on a Diskless Client System25
▼To Set Up a 10-Gigabit Ethernet Port on a Diskless Client26
Installing the Solaris Operating System Over a 10-Gigabit Ethernet Network27
▼To Install the Solaris Operating System Over a 10-Gigabit Ethernet
Network27
Booting Over the 10-Gigabit Ethernet Network for Solaris x86 and Linux
Systems30
▼To Boot Over the Network on Solaris x86 and Linux Systems30
5.Configuring the nxge Device Driver Parameters33
nxge Hardware and Software Overview33
Setting nxge Driver Parameters on a Solaris Platform34
Setting Parameters Using the ndd Utility34
Noninteractive and Interactive Modes34
▼To Specify Device Instances for the ndd Utility35
▼To Specify Parameter Values Using the ndd Utility35
▼To Use the ndd Utility in Interactive Mode35
Setting Parameters Using the nxge.conf File36
▼To Set Driver Parameters Using an nxge.conf File37
Tuning for Maximum Performance on a Solaris Platform41
▼To Improve Performance on an UltraSPARC CPU Based Sun Platform41
▼To Improve Performance on an AMD CPU Based Sun Platform42
▼To Obtain Higher Throughput Using the Generic Tunables for the Solaris
This guide provides instructions for installing both the hardware and software for
the Sun Dual 10GbE XFP PCI Express card from Oracle. This manual also describes
how to configure the nxge driver, which controls the card.
These instructions are designed for enterprise system administrators with experience
installing network hardware and software.
Note – In this document the term x86 refers to 64-bit and 32-bit systems
manufactured using processors compatible with the AMD64 or Intel Xeon/Pentium
product families. For supported systems, see the Solaris Hardware Compatibility Guide.
Using UNIX Commands
This document might not contain information about basic UNIX commands and
procedures such as shutting down the system, booting the system, and configuring
devices. Refer to the following for this information:
■ Software documentation that you received with your system
■ Solaris Operating System documentation, which is at:
The Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter is a low
profile x8 lane PCI-Express 10 gigabit Ethernet card utilizing the Sun ASIC with
XFP-based 10-gigabit Ethernet optics. The Sun x8 Express Dual 10 Gigabit Ethernet
Fiber XFP Low Profile Adapter requires an optical transceiver.
TABLE 1-1 lists the supported hardware and software.
Features
The Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter
provides the following features:
■ Two full-duplex 10 gigabit Ethernet interface that use a 10 gigabit Ethernet small
form factor pluggable (XFP), optical transceiver with duplex LC fiber connector
■ IEEE 802.3ae 2002 compliant
■ Uses Sun’s own ASIC and software for innovative throughput networking design
■ Networking I/O virtualization supporting Solaris LDOM 1.0. (VMware support
planned for mid 07)
■ Hardware-based flow classification for extending parallelism and virtualization to
networking
■ Up to 16 Receive DMA channels and up to 24 Transmit DMA channels, multiple
receive and transmit Descriptor Rings and dedicated networking hardware
resources (DMA, interrupts, buffer, and more) for each thread or strand
■ CPU/thread affinity and CPU load balancing at L1,L2,L3 and L4
■ Dynamic Reconfiguration (DR)
■ Jumbo frame support (up to 9KBytes)
■ IPv4/IPv6 and IPMP support
■ TCP/UDP/IP checksum and CRC32C support
■ IEEE 802.1Q VLAN support
Chapter 1 Product Overview3
Declaration of Conformity
Compliance Model Number:ATLS2XGF
Product Family Name:Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter
EMC
USA—FCC Class A
This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions:
1. This equipment may not cause harmful interference.
2. This equipment must accept any interference that may cause undesired operation.
European Union
This equipment complies with the following requirements of the EMC Directive 89/336/EEC:
As Information Technology Equipment (ITE) Class A per (as applicable):
EN 55022:1994 +A1:1995 +A2:1997 Class A
EN 61000-3-2:2000Pass
EN 61000-3-3:1995 +A1:2000Pass
EN 55024:1998 +A1:2001 +A2:2003 Required Limits:
IEC 61000-4-24 kV (Direct), 8kV (Air)
IEC 61000-4-33 V/m
IEC 61000-4-41 kV AC Power Lines, 0.5 kV Signal and DC Power Lines
IEC 61000-4-51 kV AC Line-Line and Outdoor Signal Lines, 2 kV AC Line-Gnd, 0.5 kV DC Power
IEC 61000-4-63 V
IEC 61000-4-81 A/m
IEC 61000-4-11Pass
Lines
Safety
This equipment complies with the following requirements of the Low Voltage Directive 73/23/EEC:
EC Type Examination Certificates:
EN 60950-1:2001, 1st Edition
IEC 60950-1:2001, 1st EditionCB Scheme Certificate No.
Evaluated to all CB Countries
UL and cUL/CSA 60950-1:2001, CSA C22.2 No. 60950-00 File:E138989-A82Vol. 54
FDA DHHS Accession Number (Monitors Only)
Supplementary Information
This equipment was tested and complies with all the requirements for the CE Mark.
This equipment complies with the Restriction of Hazardous Substances (RoHS) directive 2002/95/EC.
Worldwide Compliance Engineering
Sun Microsystems, Inc.
4150 Network Circle, MPK15-102
Santa Clara, CA 95054 U.S.A.
Tel: 650-786-3255
Fax: 650-786-3723
Donald Cameron
Program Manager/Customer Quality
Sun Microsystems Scotland, Limited
Blackness Road, Phase I, Main Bldg.
Springfield, EH49 7LR
Scotland, United Kingdom
Tel: +44 1 506 672 539Fax: +44 1 506 670 011
This chapter explains how to download and install the nxge driver. The nxge gigabit
Ethernet driver (nxge(7D)) is a multi-threaded, loadable, clonable, GLD-based
STREAMS driver. The nxge driver is managed by the dladm(1M) command line
utility, which allows VLANs to be defined on top of nxge instances and for nxge
instances to be aggregated. See the dladm(1M) man page for more details on
configuring the data-link interfaces and link aggregations.
This chapter contains the following sections:
■ “Downloading and Installing the Driver on a Solaris SPARC or x86 Platform” on
page 7
■ “Downloading and Installing the Driver on a Linux Platform” on page 10
Downloading and Installing the Driver
on a Solaris SPARC or x86 Platform
If your system uses the Solaris SPARC or x86 operating system you will need to
download and install the nxge device driver for Solaris platforms.
▼ To Download the Driver on a Solaris Platform
1. Locate and download the nxge device driver software at the following web
■ Press Return or type all to accept the default and install all packages.
■ Type the specific numbers, separated by a space, if you prefer not to install any
optional packages.
7. Verify that the nxge driver is installed on the system:
Sun PCI-E 10G/1G Ethernet Adapter Driver(i386)
1.0,REV=2006.12.05.10.0 Copyright 2006 Sun Microsystems,
Inc. All rights reserved. Use is subject to license terms.
## Executing checkinstall script. Using as the package base
directory.
## Processing package information.
## Processing system information.
4 package pathnames are already properly installed.
## Verifying package dependencies.
## Verifying disk space requirements.
## Checking for conflicts with packages already installed.
## Checking for setuid/setgid programs. This package contains
scripts which will be executed with super-user permission
during the process of installing this package.
Do you want to continue with the installation of [y,n,?] y
Installing Sun PCI-E 10G/1G Ethernet Adapter Driver as
## Installing part 1 of 1.
/kernel/drv/amd64/nxge [ verifying class ]
# Executing postinstall script.
# Installation of was successful.
▼ To Remove the Driver from a Solaris Platform
1. To discover the driver packages run the pkginfo command:
3. Discover the network interfaces before adding the package by using the
ifconfig -a command:
# ifconfig -a |grep eth
eth0 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DC
eth1 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DD
eth2 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DE
eth3 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DF
4. Use the rpm tool to install the driver on SuSe and RedHat Linux.
Note – In RHEL5.0 and later releases, the driver is packaged in the kmod driver
binary package format. This packaging allows forward and backward driver binary
compatibility within the same flavors of RHEL5 releases. Driver packages nxge
version 2.0.0 and later are not compatible with the earlier nxge-1.x-x releases. To
upgrade from 1.x-x to 2.x.x rpm package, it is necessary to remove nxge-1.x-x package before installing the 2.x.x package.
The RHEL5 nxge 2.x.x kmod package contains two separate packages: One for
the driver and another one for applications like nxge_config. You must install
both of the following packages:
To ensure that the driver is loaded after the rpm installation, enter the following:
# modprobe nxge
5. Verify the new network interface instances corresponding to the Sun x8 Express
Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter:
# ifconfig -a |grep eth
eth0 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DC
eth1 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DD
eth2 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DE
eth3 Link encap:Ethernet HWaddr 00:14:4F:20:F1:DF
eth4 Link encap:Ethernet HWaddr 00:14:4F:6C:78:E8
eth5 Link encap:Ethernet HWaddr 00:14:4F:6C:78:E9
The Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter
instances, eth4 and eth5, are shown in
bold italics.
6. Add the nxge interfaces to the /etc/modules.conf file to automatically load
the driver after system reboot:
alias eth4 nxge
alias eth5 nxge
Chapter 2 Installing and Setting Up the Driver11
7. Use the ethtool command to check the parameter configurations that apply to
the nxge driver.
This chapter describes how to install the Sun x8 Express Dual 10 Gigabit Ethernet
Fiber XFP Low Profile Adapter in your system and verify that it has been installed
correctly.
This chapter contains the following section:
■ “Installing the Adapter” on page 13
■ “Installing an Optical Transceiver” on page 17
■ “Verifying the Hardware Installation” on page 20
Note – If you are installing the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP
Low Profile Adapter in a machine running either the Solaris x86 Operating System
or the Linux x86 Operating System, Dynamic Reconfiguration (DR) is not supported.
Installing the Adapter
If you are installing the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low
Profile Adapter into a machine running Solaris 10, you must install the software
before you install the hardware.
The following instructions describe the basic tasks required to install the adapter.
Refer to your system installation or service manual for detailed PCI-Express adapter
installation instructions, specifically you must check which bracket your server
requires (low profile or standard height), and install the standard height bracket if
required.
mechanical fit limitations:
Do not install the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile
Adapter in slot-2 of a Sun Fire T2000 system. The SATA cables from the adjacent
card slot prevent the proper installation of an Sun x8 Express Dual 10 Gigabit
Ethernet Fiber XFP Low Profile Adapter in this slot. (Note that this issue does not
exist for Sun Fire T2000 that is RoHS compliant.)
Caution – Do not install the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP
Low Profile Adapter in slot-5 of a Sun Fire X4600 system because the heatsink on the
adapter will sit against the daughter card of the Sun Fire X4600 system.
Note – When you install the adapter, ensure that the optical transceiver has not been
installed. The optical transceiver must be installed into the adapter when it is in
place.
This section contains the following topics:
■ “To Install the Adapter” on page 14
■ “Installing an Optical Transceiver” on page 17
■ “Verifying the Hardware Installation” on page 20
▼ To Install the Adapter
1. Halt and power off your system.
2. Power off all of the peripherals connected to your system.
3. Open the system unit.
4. Attach the adhesive copper strip of the antistatic wrist strap to the metal casing
of the power supply. Wrap the other end twice around your wrist, with the
adhesive side against your skin.
5. Remove the filler panel from the PCI-E opening.
Note – These illustrations show the Sun x8 Express Dual 10 Gigabit Ethernet Fiber
XFP Low Profile Adapter being installed into a Sun Fire T2000, which requires a
standard height bracket for the low profile adapter.
6. Open the retaining clip at the edge of the PCI-E opening.
7. Holding the adapter by the edges, align the adapter edge connector with the
PCI-E slot. Slide the adapter face plate into the small slot at the end of the PCIE opening.
8. Applying even pressure at both corners of the adapter, push the PCI-Express
adapter until it is firmly seated in the slot.
Chapter 3 Installing the Adapter15
9. Secure the retaining clip
Caution – Do not use excessive force when installing the adapter into the PCI-E
slot. You might damage the adapter ’s PCI connector. If the adapter does not seat
properly when you apply even pressure, remove the adapter and carefully reinstall
it.
10. Detach the wrist strap and close the system unit.