subsidiaries, inthe U.S.and othercountries.
UNIX isa registered trademarkin theU.S. andother countries,exclusively licensedthrough X/OpenCompany,Ltd.
Intel isa trademarkor registered trademarkof IntelCorporation orits subsidiariesin theUnited Statesand othercountries. IntelXeon isa
trademark orregistered trademark of Intel Corporation or its subsidiaries in the United States and other countries. The Adobe logo is a
registered trademark of Adobe Systems, Incorporated.
DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES,
INCLUDING ANYIMPLIED WARRANTY OF MERCHANTABILITY, FITNESSFOR APARTICULAR PURPOSEOR NON-INFRINGEMENT,
ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Inc., ou ses filiales, aux Etats-Unis et dans d’autres pays.
UNIX est une marque déposée aux Etats-Unis et dans d’autres pays et licenciée exlusivement par X/Open Company, Ltd.
Intel est une marque de fabrique ou une marque déposée de Intel Corporation ou de sa filiale aux Etats-Unis et dans d’autres pays. Intel Xeon
est une marque de fabrique ou une marque déposée de Intel Corporation ou de sa filiale aux Etats-Unis et dans d’autres pays. Le logo Adobe
est une marque déposée de Adobe Systems, Incorporated.
L’utilisation de pieces detachees ou d’unites centrales de remplacement est limitee aux reparations ou a l’echange standard d’unites centrales
pour les produits exportes, conformement a la legislation americaine en matiere d’exportation. Sauf autorisation par les autorites des EtatsUnis, l’utilisation d’unites centrales pour proceder a des mises a jour de produits est rigoureusement interdite.
LA DOCUMENTATION EST FOURNIE "EN L’ETAT" ET TOUTES AUTRES CONDITIONS, DECLARATIONS ET GARANTIES EXPRESSES
OU TACITESSONT FORMELLEMENTEXCLUES, DANSLA MESUREAUTORISEE PAR LA LOIAPPLICABLE, YCOMPRIS NOTAMMENT
TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE, A L’APTITUDE A UNE UTILISATION PARTICULIERE OU A
L’ABSENCE DE CONTREFACON.
Your Sun product is marked to indicate its compliance class:
• Federal Communications Commission (FCC) — USA
• Industry Canada Equipment Standard for Digital Equipment (ICES-003) — Canada
• Voluntary Control Council for Interference (VCCI) — Japan
• Bureau of Standards Metrology and Inspection (BSMI) — Taiwan
Please read the appropriate section that corresponds to the marking on your Sun product before attempting to install the
product.
FCC Class A Notice
This device complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions:
1. This device may not cause harmful interference.
2. This device must accept any interference received, including interference that may cause undesired operation.
Note: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of
the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment
is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy, and if it is
not installed and used in accordance with the instruction manual, it may cause harmful interference to radio communications.
Operation of this equipment in a residential areais likely to cause harmful interference,in which casethe user will be required
to correct the interference at his own expense.
Modifications: Any modificationsmade to this device that arenot approvedby SunMicrosystems, Inc.may voidthe authority
granted to the user by the FCC to operate this equipment.
ICES-003 Class A Notice - Avis NMB-003, Classe A
This Class A digital apparatus complies with Canadian ICES-003.
Cet appareil numérique de la classe A est conforme à la norme NMB-003 du Canada.
vii
BSMI Class A Notice
The following statement is applicable to products shipped to Taiwan and marked as Class A on the product compliance
label.
T33012
CCC Class A Notice
The following statement is applicable to products shipped to China and marked with “Class A” on the product’s compliance
label.
Read this section before beginning any procedure. The
following text provides safety precautions to follow when
installing a Sun Microsystems product.
Safety Precautions
For your protection, observe the following safety
precautions when setting up your equipment:
■ Follow all cautions and instructions marked on the
equipment.
■ Ensure that the voltage and frequency of your power
source match the voltage and frequency inscribed on
the equipment’s electrical rating label.
■ Never push objects of any kind through openings in
the equipment. Dangerous voltages may be present.
Conductive foreign objects could produce a short
circuit that could cause fire, electric shock, or damage
to your equipment.
Symbols
The following symbols may appear in this book:
Caution – There is a risk of personal injury
and equipment damage. Follow the
instructions.
Depending on the type of power switch your device has,
one of the following symbols may be used:
On – Applies AC power to the system.
Off – Removes AC power from the system.
Standby – The On/Standby switch is in the
standby position.
Modifications to Equipment
Do not make mechanical or electrical modifications to the
equipment. Sun Microsystems is not responsible for
regulatory compliance of a modified Sun product.
Placement of a Sun Product
Caution – Do not block or cover the openings
of your Sun product. Never place a Sun
product near a radiator or heat register.
Failure to follow these guidelines can cause
overheating and affect the reliability of your
Sun product.
Caution – Hot surface. Avoid contact.
Surfaces are hot and may cause personal
injury if touched.
Caution – Hazardous voltages are present. To
reduce the risk of electric shock and danger to
personal health, follow the instructions.
System Unit Cover
You must remove the cover of your Sun computer system
unit to add cards, memory, or internal storage devices. Be
sure toreplace the cover before powering on your computer
system.
Caution – Do not operate Sun products
without the cover in place. Failure to take this
precaution may result in personal injury and
system damage.
ix
Conformité aux normes de sécurité
Veuillez lire attentivement cette section avant de
commencer. Ce texte traite des mesures de sécurité qu’il
convient de prendre pour l’installation d’un produit Sun
Microsystems.
Mesures de sécurité
Pour votre sécurité, nous vous recommandons de suivre
scrupuleusement lesmesures de sécurité ci-dessous lorsque
vous installez votre matériel:
■ Suivez tous les avertissements et toutes les
instructions inscrites sur le matériel.
■ Assurez-vous que la tension et la fréquence de votre
source d'alimentation correspondent à la tension et à
la fréquence indiquées sur l'étiquette de la tension
électrique nominale du matériel
■ N'introduisez jamais d'objets quels qu'ils soient dans
les ouvertures de l'équipement. Vous pourriez vous
trouver en présence de hautes tensions dangereuses.
Tout objet étranger conducteur risque de produire un
court-circuit pouvant présenter un risque d'incendie
ou de décharge électrique, ou susceptible
d'endommager le matériel.
Symboles
Vous trouverez ci-dessous la signification des différents
symboles utilisés:
Attention – Vous risquez d'endommager le
matériel ou de vous blesser. Veuillez suivre les
instructions.
Attention – Surfaces brûlantes. Evitez tout
contact. Les surfaces sont brûlantes. Vous
risquez de vous blesser si vous les touchez.
Attention – Tensions dangereuses. Pour
réduire les risques de décharge électrique et
de danger physique, observez les consignes
indiquées.
Marche – Met le système sous tension
alternative.
Arret – Met le système hors tension
alternative.
Veilleuse – L'interrupteur Marche/Veille est
sur la position de veille.
Modification du matériel
N'apportez aucune modification mécanique ou électrique
au matériel. Sun Microsystems décline toute responsabilité
quant à la non-conformité éventuelle d'un produit Sun
modifié.
Positionnement d’un produit Sun
Attention – Evitez d'obstruer ou de recouvrir
les orifices de votre produit Sun. N'installez
jamais un produit Sun près d'un radiateur ou
d'une source de chaleur. Si vous ne respectez
pas ces consignes, votre produit Sun risque de
surchauffer et son fonctionnement en sera
altéré.
Couvercle de l'unité
Pour ajouterdes cartes,de la mémoire ou des périphériques
de stockage internes, vous devez retirer le couvercle de
votre système Sun. Remettez le couvercle supérieur en
place avant de mettre votre système sous tension.
Attention – Ne mettez jamais des produits
Sun sous tension si leur couvercle supérieur
n'est pas mis en place. Si vous ne prenez pas
ces précautions, vous risquez de vous blesser
ou d'endommager le système.
Selon le type d'interrupteur marche/arrêt dont votre
appareil est équipé, l'un des symboles suivants sera utilisé:
Lesen Sie vor dem Ausführen von Arbeiten diesen
Abschnitt. Im folgenden Text werden Sicherheitsvorkehrungen beschrieben, die Sie bei der Installation eines
Sun Microsystems-Produkts beachten müssen.
Sicherheitsvorkehrungen
Treffen Sie zu Ihrem eigenen Schutzbei der Installation des
Geräts die folgenden Sicherheitsvorkehrungen:
■ Beachten Sie alle auf den Geräten angebrachten
Warnhinweise und Anweisungen.
■ Stellen Sie sicher, dass Spannung und Frequenz der
Stromversorgung den Nennleistungen auf dem am
Gerät angebrachten Etikett entsprechen.
■ Führen Sie niemals Fremdobjekte in die Öffnungen
am Gerät ein. Es können gefährliche Spannungen
anliegen. Leitfähige Fremdobjekte können einen
Kurzschluss verursachen, der einen Brand, Stromschlag oder Geräteschaden herbeiführen kann.
Aus– Unterbricht die Wechselstromzufuhr
zum Gerät.
Wartezustand – Der Ein-/Standby-Netz-
schalter befindet sich in der Standby-Position.
Modifikationen des Geräts
Nehmen Sie keine elektrischen oder mechanischen
Gerätemodifikationen vor. Sun Microsystems ist für die
Einhaltung der Sicherheitsvorschriften von modifizierten
Sun-Produkten nicht haftbar.
Gehäuseabdeckung
Sie müssen die Abdeckung Ihres Sun-Computersystems
entfernen, um Karten, Speicher oderinterne Speichergeräte
hinzuzufügen. Bringen Sie vor dem Einschalten des
Systems die Gehäuseabdeckung wieder an.
Symbole
Die Symbole in diesem Handbuch haben folgende
Bedeutung:
Achtung – Gefahr von Verletzung und
Geräteschaden. Befolgen Sie die Anweisungen.
Achtung – Heiße Oberfläche. Nicht berühren,
da Verletzungsgefahr durch heiße Oberfläche
besteht.
Achtung – Gefährliche Spannungen.
Befolgen Sie die Anweisungen, um
Stromschläge und Verletzungen zu vermeiden.
Je nach Netzschaltertyp an Ihrem Gerät kann eines der
folgenden Symbole verwendet werden:
Ein – Versorgt das System mit Wechselstrom.
Achtung – Nehmen Sie Sun-Geräte nicht
ohne Abdeckung in Betrieb. Die
Nichtbeachtung dieses Warnhinweises kann
Verletzungen oder Geräteschaden zur Folge
haben.
Safety Agency Compliance Statementsxi
Normativas de seguridad
Lea esta sección antes de realizar cualquier operación. En
ella se explican las medidasde seguridad que debe tomaral
instalar un producto de Sun Microsystems.
Apagado – Corta la alimentación de CA del
sistema.
Medidas de seguridad
Para su protección, tome las medidas de seguridad
siguientes durante la instalación del equipo:
■ Siga todos los avisos e instrucciones indicados en el
equipo.
■ Asegúrese de que el voltaje y frecuencia de la fuente
de alimentación coincidan con el voltaje y frecuencia
indicados en la etiqueta de clasificación eléctrica del
equipo.
■ No introduzca objetos de ningún tipo por las rejillas
del equipo, ya que puede quedar expuesto a voltajes
peligrosos. Los objetos conductores extraños pueden
producir cortocircuitos y, en consecuencia, incendios,
descargas eléctricas o daños en el equipo.
Símbolos
En este documento aparecen los siguientes símbolos:
Precaución – Existe el riesgo de que se
produzcan lesiones personales y daños en el
equipo. Siga las instrucciones.
Precaución – Superficie caliente. Evite todo
contacto. Las superficies están calientes y
pueden causar lesiones personales si se tocan.
Espera – El interruptor de encendido/espera
está en la posición de espera.
Modificaciones en el equipo
No realicemodificaciones detipo mecánico ni eléctrico en el
equipo. Sun Microsystems no se hace responsable del
cumplimiento de normativas en caso de que un producto
Sun se haya modificado.
Colocación de un producto Sun
Precaución – No obstruya ni tape las rejillas
del producto Sun. Nunca coloque un producto
Sun cerca de radiadores ni fuentes de calor. Si
no sigue estas indicaciones, el producto Sun
podría sobrecalentarse y la fiabilidad de su
funcionamiento se vería afectada.
Precaución – Voltaje peligroso. Para reducir
el riesgo de descargas eléctricas y lesiones
personales, siga las instrucciones.
En función del tipo de interruptor de alimentación del que
disponga el dispositivo, se utilizará uno de los símbolos
siguientes:
Compliance Model Number:5945532
Product Family Name:Sun Dual 10GbE SFP+ PCIe ExpressModule
EMC
USA—FCC Class A
This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions:
1. This equipment may not cause harmful interference.
2. This equipment must accept any interference that may cause undesired operation.
Canada
This Class A digital apparatus complies with Canadian ICES-003.
European Union
This equipment complies with the following requirements of the EMC Directive 2004/108/EC:
As Information Technology Equipment (ITE) Class A per (as applicable):
EN 55022:2006Class A
EN 61000-3-2:2000 +A2:2005Pass
EN 61000-3-3:1995 +A1:2001Pass
EN 55024:1998 +A1:2001 +A2:2003 Required Limits:
IEC61000-4-24 kV (Direct), 8 kV (Air)
IEC61000-4-33 V/m
IEC61000-4-41 kV AC Power Lines, 0.5 kV Signal and DC Power Lines
IEC61000-4-51 kV AC Line-Line and Outdoor Signal Lines, 2 kV AC Line-Gnd, 0.5 kV DC Power Lines
IEC61000-4-63 V
IEC61000-4-81 A/m
IEC61000-4-11Pass
Safety
This equipment complies with the following requirements of the Low Voltage Directive2006/95/EC:
EC Type Examination Certificates:
EN 60950-1:2001, 1st Edition
IEC 60950-1:2001, 1st EditionCB Scheme Certificate No. NO47596
Evaluated to all CB Countries
UL 60950-1:2003, CSA C22.2 No. 60950-03File: E139761Vol. 7
Supplementary Information
This equipment was tested and complies with all the requirements for the CE Mark.
This equipment complies with the Restriction of Hazardous Substances (RoHS) directive 2002/95/EC.
.
/S/
Dennis P. SymanskiDATE
Worldwide Compliance Office
Sun Microsystems, Inc.
4150 Network Circle, MPK15-102
Santa Clara, CA 95054 U.S.A.
Tel: 650-786-3255 Fax: 650-786-3723
This user’s guide provides hardware and software installation instructions for the
Sun™ Dual 10GbE SFP+ PCIe Express Module. This document also describes how to
configure the driver software for the ixgbe driver for Linux operating systems and
Microsoft Windows Server 2003.
These instructions are designed for enterprise system administrators with experience
installing network hardware and software.
Note – In this document the term x86 refers to 64-bit and 32-bit systems
manufactured using processors compatible with the AMD64, Intel® Xeon®, or Intel
Pentium product families.
How This Document Is Organized
Chapter 1 describes the Sun 10GbE XFP SR PCI Express Card hardware and
software.
Chapter 2 explains how to download, install, and verify the ixgbe device driver
software on Linux and Microsoft Windows systems.
Chapter 3 describes how to install the Ethernet adapter in your system and verify
that it has been installed correctly.
Chapter 4 describes how to edit the network host files after the Ethernet adapter has
been installed on your system.
Chapter 5 describes how to configure the ixgbe driver parameters.
xv
Chapter 6 explains virtual local area networks (VLANs), and provides configuration
instructions and examples.
Appendix A lists the specifications for the Sun 10GbE XFP SR PCI Express Card.
Typographic Conventions
*
Typeface
AaBbCc123The names of commands, files,
AaBbCc123What you type, when contrasted
AaBbCc123Book titles, new words or terms,
* The settings on your browser might differ from these settings.
MeaningExamples
Edit your.login file.
and directories; on-screen
computer output
with on-screen computer output
words to be emphasized.
Replace command-line variables
with real names or values.
Use ls -a to list all files.
% You have mail.
su
%
Password:
Read Chapter 6 in the User’s Guide.
These are called class options.
Yo u must be superuser to do this.
To delete a file, type rm filename.
Shell Prompts
ShellPrompt
C shellmachine-name%
C shell superusermachine-name#
Bourne shell and Korn shell$
Bourne shell and Korn shell superuser#
xvi Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008
Related Documentation
The documents listed as online are available at:
http://docs.sun.com/app/docs/prod/dual.sfp.pcie
ApplicationTitlePart NumberFormatLocation
Release NotesSun 10GbE XFP SR PCI Express Card, Sun Dual
10GbE XFP 2 SR PCI Express Card, and Sun Dual
10GbE SFP+ PCIe ExpressModule Release Notes
Safety and Compliance Manual816-7190Hardcopy Ship kit
820-4505PDF
HTML
820-4981Hardcopy Ship kit
Online
Documentation, Support, and Training
Sun FunctionURL
Documentationhttp://www.sun.com/documentation/
Supporthttp://www.sun.com/support/
Traininghttp://www.sun.com/training/
Third-Party Web Sites
Sun is not responsible for the availability of third-party web sites mentioned in this
document. Sun does not endorse and is not responsible or liable for any content,
advertising, products, or other materials that are available on or through such sites
or resources. Sun will not be responsible or liable for any actual or alleged damage
or loss caused by or in connection with the use of or reliance on any such content,
goods, or services that are available on or through such sites or resources.
Prefacexvii
Sun Welcomes Your Comments
Sun is interested in improving its documentation and welcomes your comments and
suggestions. You can submit your comments by going to:
http://www.sun.com/hwdocs/feedback
Please include the title and part number of your document with your feedback:
Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide, part number 820-4979-10
xviii Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008
CHAPTER
1
Sun Dual 10GbE SFP+ PCIe
ExpressModule Overview
This chapter describes the Sun 10GbE XFP SR PCI Express Card hardware and
software, and includes the following sections:
■ “Shipping Kit Contents” on page 1
■ “ExpressModule Hardware Overview” on page 1
■ “Hardware and Software Requirements” on page 5
■ “Patch Requirements” on page 5
■ “Patches and Updates” on page 6
Shipping Kit Contents
The carton in which your Sun 10GbE XFP SR PCI Express Card was shipped should
contain the following items:
■ Sun 10GbE XFP SR PCI Express Card
■ Sun Dual 10GbE SFP+ PCIe ExpressModule Getting Started Guide
■ Safety and Compliance Manual
ExpressModule Hardware Overview
The Sun 10GbE XFP SR PCI Express Card is a 10 Gigabit Ethernet (10GbE) fiber
network interface card (NIC) for PCI Express systems. The ExpressModule is based
on the dual-port Intel 82598EB 10GbE controller.
1
The ExpressModule is optimized for Intel I/O Acceleration Technology (I/OAT),
which is designed to optimize network I/O. The ExpressModule is a highperformance, highly integrated 10 Gigabit Ethernet LAN card with PCIe host
interface and fiber LAN connectors on the optical modules.
The product conforms to the IEEE 802.3 standard and supports standards for system
manageability and power management.
FIGURE 1-1 Sun Dual 10GbE SFP+ PCIe ExpressModule
ExpressModule Features
The Sun 10GbE XFP SR PCI Express Card provides the following features and
benefits:
■ Intel 82598EB 10 Gigabit Ethernet controller
■ Load balancing on multiple CPUs
■ Intel I/O Acceleration Technology (I/OAT)
■ iSCSI remote boot support
■ MSI-X support
■ Virtual Machine Device queues (VMDq)
■ Low latency
■ Optimized queues – 32 transmit (Tx) and 64 receive (Rx) per port
■ Compatible with x8 standard and low-profile PCI Express slots
■ Support for most network operating systems (NOS)
■ Remote management support
■ Support for SFP+ form factor transceivers
■ RoHS compliant, lead-free technology
■ Intel PROSet Utility for Windows Device Manager
Indicator Lights on the ExpressModule
On the front panel of the ExpressModule (shown in FIGURE 1-2) next to each port,
there are viewing holes for two lights dedicated to that port.
FIGURE 1-2 Front Panel Lights and Attention Switch
TABLE 1-1 explains the meaning of the lights for each port.
Chapter 1 Sun Dual 10GbE SFP+ PCIe ExpressModule Overview3
TABLE 1-1Indicator Lights for Each Port on the ExpressModule
LabelColorMeaning
ACT/LINKGreenActivity
10G/1GGreen10GbE link
10G/1GAmber1GbE link
Two LEDs are on the ExpressModule next to the Attention switch. One LED emits
green light, the LED other emits amber light. Each light can be on, off, or blinking.
TABLE 1-2 explains the meaning of these lights.
TABLE 1-2LED Indicator Lights on the ExpressModule
LED ColorLED StateMeaningAction
GreenOffPower offInsertion or removal of add-in cards is
permitted. All supply voltages (except Vaux)
have been removed from the slot if required
for add-in card removal.
GreenOnPower onThe slot is powered on. Insertion or removal of
add-in cards is not permitted.
GreenBlinkingPower
transition
AmberOffNormalOperation is normal.
AmberOnAttentionThere is an operation problem at this slot.
AmberBlinkingLocateThis slot is being identified at user request.
The slot is in the process of powering up or
down. Insertion of removal of add-in cards is
not permitted.
Note – The Attention switch currently is not supported.
Before using the Sun 10GbE XFP SR PCI Express Card, ensure that your system
meets the hardware and software requirements in
TABLE 1-3Hardware and Software Requirements
RequirementsSupported Products
HardwareSun Blade X6220 Server Module
Sun Blade X6250 Server Module
Sun Blade X6450 Server Module
Sun Blade X8420 Server Module
Operating systemRed Hat Enterprise Linux 5.1 (32-bit and 64-bit)
Red Hat Enterprise Linux 4.6 (32-bit and 64-bit)
SUSE 10-Sp1 (64-bit)
Microsoft Windows 2008 (32-bit and 64-bit)
Microsoft Windows 2003 (32-bit and 64-bit)
* Sun Blade X6450 Server Module supports Linux only.
Note – The preceding information is up-to-date at the time this manual was written.
Go to http://www.sun.com/ for the latest information. Subsequent versions of
this document have a higher number following the final dash. That is, 820-4979-10,
becomes 820-4979-11.
TABLE 1-3.
*
Patch Requirements
You must install the latest version of the patch from the following web site:
http://sunsolve.sun.com
If the patch is not available on the SunSolve
service representative.
Chapter 1 Sun Dual 10GbE SFP+ PCIe ExpressModule Overview5
SM
web site, contact your local sales or
Patches and Updates
Check the Sun Update Connection to ensure that you have the latest recommended
patch clusters and security patches. You can download the latest recommended
patch clusters and security patches at:
This chapter describes how to install the ExpressModule in your system and verify
that it is recognized by the operating system.
This chapter contains the following sections:
■ “Installing an Optical Transceiver” on page 13
■ “Installing the ExpressModule” on page 16
■ “Verifying the Installation” on page 19
Installing an Optical Transceiver
The Sun 10GbE XFP SR PCI Express Card requires a short-range optical transceiver
in at least one port to create an Ethernet connection. The short-range optical
transceiver (part number X5561A-Z) is available from Sun Microsystems.
Note – Install the optical transceivers into the ExpressModule before installing the
ExpressModule into the system.
▼ To Install an Optical Transceiver
1. Pull the locking handle into the full horizontal position.
You will feel the handle click into position when it is fully opened.
13
2. Holding the optical transceiver by the edges, align the transceiver with the slot
in the ExpressModule and slide the transceiver into the opening.
3. Applying even pressure at both corners of the transceiver, push the transceiver
until it is firmly seated in the slot.
4. Push the handle closed to lock the optical transceiver in place.
5. Repeat Step 1 through Step 4 to install the second optical transceiver.
Caution – If you pull the locking handle down when the optical transceiver is
installed, remove the optical transceiver entirely and reinstall it. The handle operates
an internal lock. Pulling the handle down can disconnect the optical transceiver,
even though it might appear to be connected.
Chapter 3 Installing the ExpressModule15
Installing the ExpressModule
The following instructions describe the basic tasks required to install the
ExpressModule. Refer to your system installation or service manual for detailed
ExpressModule installation instructions.
Note – To maintain proper cooling for the ExpressModule in your chassis, all
ExpressModule slots must be filled with either operating ExpressModules or filler
panels.
▼ To Install the ExpressModule With the Power
Off
1. Halt and power off your system.
2. Power off all peripherals connected to your system.
3. Attach the adhesive copper strip of the antistatic wrist strap to the metal casing
of the power supply. Wrap the other end twice around your wrist, with the
adhesive side against your skin.
4. Remove the filler panel from the ExpressModule opening.
6. Align the ExpressModule with the vacant ExpressModule slot (1 in the
following figure).
Ensure that the ExpressModule’s indicator lights on the front panel are facing
toward you and that the ExpressModule ejector lever on the bottom is fully
opened.
Chapter 3 Installing the ExpressModule17
7. Slide the ExpressModule into the vacant ExpressModule chassis slot until the
ejector lever engages and starts to close (2 in the preceding figure).
Failure to align the ExpressModule correctly can result in damage with the
ExpressModule’s internal connection to the chassis midplane.
8. Complete the installation by closing the ejector lever until the latch snaps into
place (3 in the preceding figure).
Caution – Do not use excessive force when installing the ExpressModule into the
slot. You might damage the ExpressModule’s connector. If the ExpressModule does
not seat properly when you apply even pressure, remove and carefully reinstall the
ExpressModule.
The Ethernet adapter interfaces labeled as "Intel(R) 82598EB 10 Gigabit AF Dual
Port Network Connection" will be displayed at the Network Connection window
screen, if the driver is installed successfully.
3. To check the driver version, use the Administration Tool.
The minimum Windows Server 2003 driver version is 1.2.22.0.
4. In the Administration Tool click Computer Management, Device Manager, and
Network Adapter.
This chapter describes how to edit the network host files after the card has been
installed on your system. This chapter contains the following section:
■ “Configuring the Network Host Files for Booting Over the Gigabit Ethernet
Network for Linux Systems” on page 21
Note – To do a PXE boot (or netboot) on a dual-port card, you must use the topmost
port. That port is the logical Port 0, and it has the lowest MAC address.
Configuring the Network Host Files for
Booting Over the Gigabit Ethernet
Network for Linux Systems
▼ To Boot Over the Network on Linux Systems
1. Obtain the MAC address of the first Sun 10GbE XFP SR PCI Express Card port
by checking the label of the card.
The MAC address of the first port should be the MAC address from the label
plus 1.
2. Set up the PXE boot server with the MAC addresses.
3. Use the first Ethernet adapter port as the boot interface.
Only the first port is enabled for booting over the network.
21
4. Plug the Ethernet cable into the card port.
5. Power on the system.
6. Press the F2 key or the Control-E keys to go to the BIOS.
7. Check and ensure that the boot order of the network devices is higher than the
hard drive.
8. Press the F10 key to save the boot configuration changes and exit.
The system should reboot after saving the boot configuration.
9. Press the F12 key to install the OS from the network.
If the cable is connected to the correct port, you should see the MAC address that
you assigned to your PXE server displayed by BIOS.
image : pxe-mac-addr
PXE-E61: Media test failure, check cable
PXE-MOF: Exiting Intel Boot Agent.
10. Install the ixgbe driver and configure the Ethernet adapter.
11. After the Linux OS install completes, use the BIOS to change the boot device
priority to Boot from Hard Disk in order to boot up the newly installed OS.
Unless the boot device priority is changed, the OS installation process will repeat.
The ixgbe device driver controls the Sun 10GbE SFP+ PCIe ExpressModule
interfaces. You can manually set the ixgbe device driver parameters to customize
each device in your system.
This chapter lists the available device driver parameters and describes how you can
set these parameters.
■ “Driver Overview” on page 23
■ “Driver Parameters for Linux Systems” on page 24
■ “Setting ixgbe Driver Parameters in Linux Systems” on page 25
Driver Overview
Each ixgbe channel provides 10000BASE-T networking interfaces.
The ixgbe driver is capable of supporting 10000 Mbit/sec, full-duplex.
23
Driver Parameters for Linux Systems
TABLE 5-1 lists the tunable ixgbe driver parameters for Linux operating systems and
describes their function.
TABLE 5-1Tunable ixgbe Driver Parameters for Linux Operating Systems
KeywordValid RangeDefault ValueDescription
FlowControl0to3
(0=none, 1=Rx
only, 2=Tx only,
3=Rx and Tx)
RxDescriptiors64 to 512512This value is the number of receive descriptors
RxIntDelay0 to 65535
(0=off)
TxDescriptors80 to 4096256This value is the number of transmit descriptors
XsumRX0 to 11A value of 1 indicates that the driver should
Read from the
EEPROM.
If EEPROM is not
detected, default
is 3.
72This value delays the generation of receive
This parameter controls the automatic
generation (Tx) and response (Rx) to Ethernet
PAUSE frames.
allocated by the driver. Increasing this value
allows the driver to buffer more incoming
packets. Each descriptor is 16 bytes. A receive
buffer is also allocated for each descriptor and
can be either 2048, 4056, 8192, or 16384 bytes,
depending on the MTU setting. When the MTU
size is 1500 or less, the receive buffer size is
2048 bytes. When the MTU is greater than 1500,
the receive buffer size will be either 4056, 8192,
or 16384 bytes. The maximum MTU size is
16114.
interrupts in units of 0.8192 microseconds.
Receive interrupt reduction can improve CPU
efficiency if properly tuned for specific network
traffic. Increasing this value adds extra latency
to frame reception and can end up decreasing
the throughput of TCP traffic. If the system is
reporting dropped receives, this value might be
set too high, causing the driver to run out of
available receive descriptors.
allocated by the driver. Increasing this value
allows the driver to queue more transmits. Each
descriptor is 16 bytes.
enable IP checksum offload for received packets
(both UDP and TCP) to the Ethernet adapter
hardware.
This chapter describes how to configure virtual local area networks (VLANs).
This chapter contains the following sections:
■ “VLAN Overview” on page 27
■ “Configuring VLANs” on page 30
■ “Configuring Bonding for Multiple Interfaces” on page 32
Note – If you change any of the VLAN configuration parameters, you must reboot
the system before the changes take effect. If you make changes and do not reboot,
you might experience configuration problems.
VLAN Overview
With multiple VLANs on a card, a server with a single card can have a logical
presence on multiple IP subnets. By default, 128 VLANs can be defined for each
VLAN-aware card on your server. However, this number can be increased by
changing the system parameters.
If your network does not require multiple VLANs, you can use the default
configuration, in which case no further configuration is necessary.
VLANs enable you to split your physical LAN into logical subparts, providing an
essential tool for increasing the efficiency and flexibility of your network.
27
VLANs are commonly used to separate groups of network users into manageable
broadcast domains, to create logical segmentation of workgroups, and to enforce
security policies among each logical segment. Each defined VLAN behaves as its
own separate network, with its traffic and broadcasts isolated from the others,
increasing the bandwidth efficiency within each logical group.
Although VLANs are commonly used to create individual broadcast domains or
separate IP subnets, it can be useful for a server to have a presence on more than one
VLAN simultaneously. Several Sun products support multiple VLANs on a per-port
or per-interface basis, allowing very flexible network configurations.
FIGURE 6-1 shows an example network that uses VLANs.
FIGURE 6-1 Example of Servers Supporting Multiple VLANs With Tagging Adapters
Engineering/
Software PC 5
Adapter
Gigabit/Tagged
(VLAN 1 & 2)
The physical LAN network consists of a switch, two servers, and five clients. The
LAN is logically organized into three different VLANs, each representing a different
IP subnet.
■ VLAN 1 is an IP subnet consisting of the Main Server, Client 3, and Client 5. This
represents an engineering group.
■ VLAN 2 includes the Main Server, Clients 1 and 2 by means of a shared media
segment, and Client 5. This is a software development group.
■ VLAN 3 includes the Main Server, the Accounting Server, and Client 4. This is an
accounting group.
The Main Server is a high-use server that needs to be accessed from all VLANs and
IP subnets. The server has a Sun 10GbE XFP SR PCI Express Card installed. All three
IP subnets are accessed by means of the single physical Ethernet adapter interface.
The server is attached to one of the switch’s Gigabit Ethernet ports, which is
configured for VLANs 1, 2, and 3. Both the Ethernet adapter and the connected
switch port have tagging turned on. Because of the tagging VLAN capabilities of
both devices, the server is able to communicate on all three IP subnets in this
network, but continues to maintain broadcast separation between all of those
subnets. The following list describes the components of this network:
■ The Accounting Server is available to only VLAN 3. The Accounting Server is
isolated from all traffic on VLANs 1 and 2. The switch port connected to the
server has tagging turned off.
■ Clients 1 and 2 are attached to a shared media hub that is then connected to the
switch. Clients 1 and 2 belong only to VLAN 2. Those clients are logically in the
same IP subnet as the Main Server and Client 5. The switch port connected to this
segment has tagging turned off.
■ Client 3 is a member of VLAN 1. This client can communicate only with the Main
Server and Client 5. Tagging is not enabled on Client 3’s switch port.
■ Client 4 is a member of VLAN 3. This client can communicate only with the
servers. Tagging is not enabled on Client 4’s switch port.
■ Client 5 is a member of both VLANs 1 and 2. This client has a Sun 10GbE XFP SR
PCI Express Card installed. Client 5 is connected to switch port 10. Both the
Ethernet adapter and the switch port are configured for VLANs 1 and 2, and both
have tagging enabled.
VLAN tagging is only required to be enabled on switch ports that create trunk links
to other VLAN-aware Ethernet switches, or on ports connected to tag-capable endstations, such as servers or workstations with VLAN-aware Ethernet adapters.
Chapter 6 Configuring VLANs29
Configuring VLANs
VLANs can be created according to various criteria, but each VLAN must be
assigned a VLAN tag or VLAN ID (VID). The VID is a 12-bit identifier between 1
and 4094 that identifies a unique VLAN. For each network interface (ixgbe0,ixgbe1, ixgbe2, and so on), 4094 possible VLAN IDs can be selected for each port.
Tagging an Ethernet frame requires the addition of a tag header to the frame. The
header is inserted immediately following the destination MAC address and the
source MAC address. The tag header consists of two bytes of Ethernet Tag Protocol
identifier (TPID, 0x8100) and two bytes of tag control information (TCI).
shows the Ethernet tag header format.
FIGURE 6-2 Ethernet Tag Header Format
Octet
1
2
3
4
3 bits
TPID (0x8100
1
12 bytes
bit
FIGURE 6-2
User_priority
By default, a single VLAN is configured for every port, which groups all ports into
the same broadcast domain, just as if there were no VLANs at all. This means that
VLAN tagging for the switch port is turned off.
CFI
VID
Note – If you configure a VLAN virtual device for an Ethernet adapter, all traffic
sent or received by that Ethernet adapter must be in VLAN-tagged format.