Supermicro AOC-MTG-i4S User Manual

AOC-MTG-i4S

User's Guide

Revision 2.00

The information in this user's guide has been carefully reviewed and is believed to be accurate. The
vendor assumes no responsibility for any inaccuracies that may be contained in this document, and
makes no commitment to update or to keep current the information in this user's guide, or to notify
any person or organization of the updates. Please Note: For the most up-to-date version of this

user's guide, please see our website at www.supermicro.com.

Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this user's guide at any time and without notice. This product, including software and
documentation, is the property of Supermicro and/or its licensors, and is supplied only under a
license. Any use or reproduction of this product is not allowed, except as expressly permitted by
the terms of said license.

IN NO EVENT WILL SUPER MICRO COMPUTER, INC. BE LIABLE FOR DIRECT, INDIRECT,
SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE
USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF
THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC.
SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED
WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING,
INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.

Any disputes arising between the manufacturer and the customer shall be governed by the laws of
Santa Clara County in the State of California, USA. The State of California, County of Santa Clara
shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for
all claims will not exceed the price paid for the hardware product.

FCC Statement: This equipment has been tested and found to comply with the limits for a Class
A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide
reasonable protection against harmful interference when the equipment is operated in a commercial
environment. This equipment generates, uses, and can radiate radio frequency energy and, if not
installed and used in accordance with the manufacturer’s instruction manual, may cause harmful
interference with radio communications. Operation of this equipment in a residential area is likely
to cause harmful interference, in which case you will be required to correct the interference at your
own expense.

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate
warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”.

WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to
the State of California to cause birth defects and other
reproductive harm.

User's Guide Revision 2.00

Release Date: April 4, 2018

Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.

Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.

Copyright © 2018 by Super Micro Computer, Inc.
All rights reserved.

Printed in the United States of America

Preface

About this User's Guide

This user's guide is written for system integrators, IT technicians, and

knowledgeable end users. It provides information for the installation and use of the

AOC-MTG-i4S add-on card.

About this Add-on Card

The AOC-MTG-i4S is the most advanced, market-leading SIOM add-on card that

provides exible I/O networking options with support of up to 10GbE LAN connec-

tions in the SFP+form-factor. This card expands virtualization beyond the server

level to the network level and combines with hardware optimizations and o󰀪oads. It

provides unmatched features for virtualization, exibility for LAN and SAN networks,

and reliable performance.

This product is sold only as part of an integrated solution with Supermicro server

systems.

An Important Note to the User

Preface

All images and layouts shown in this user's guide are based upon the latest PCB

revision available at the time of publishing. The card you have received may or may

not look exactly the same as the graphics shown in this user's guide.

Returning Merchandise for Service

A receipt or copy of your invoice marked with the date of purchase is required before

any warranty service will be rendered. You can obtain service by calling your vendor

for a Returned Merchandise Authorization (RMA) number. This number should be

prominently displayed on the outside of the shipping carton when returning the

motherboard to the manufactuer, while the shipping package will be mailed prepaid

or hand-carried. Shipping and handling charges will be applied for all orders that

must be mailed when service is complete. For faster service, you can also request

a RMA authorization online http://www.supermicro.com/RmaForm/.

This warranty only covers normal consumer use and does not cover damages in-

curred in shipping or from failure due to the alternation, misuse, abuse or improper

maintenance of products.

During the warranty period, contact your distributor rst for any product problems.

iii

AOC-MTG-i4S Add-on Card User's Guide

Conventions Used in the User's Guide

Pay special attention to the following symbols for proper system installation and for

safety instructions to prevent damage to the system or injury to yourself:

Warning: Important information given to ensure proper system installation

or to prevent damage to the components or injury to yourself.

Note: Additional information given for proper system setup.

Naming Convention

Networking Add-on Cards List

iv

Preface

v

AOC-MTG-i4S Add-on Card User's Guide

Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.

Tel: [phone]

Fax: [phone]

Email: [email protected] (General Information)

[email protected] (Technical Support)

Website: www.supermicro.com

Europe

Address: Super Micro Computer B.V.

Het Sterrenbeeld 28, 5215 ML

's-Hertogenbosch, The Netherlands

Tel: [phone]

Fax: [phone]

Email: [email protected] (General Information)

[email protected] (Technical Support)

[email protected] (Customer Support)

Website: www.supermicro.nl

Asia-Pacic

Address: Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.

Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)

Tel: [phone]

Fax: [phone]

Email: [email protected]

Website: www.supermicro.com.tw

vi

AOC-MTG-i4S Add-on Card User's Guide

Table of Contents

Preface

Chapter 1 Overview

1-1 Overview ......................................................................................................... 1-1

1-2 Product Highlights ........................................................................................... 1-1

1-3 Technical Specications .................................................................................. 1-2

Chapter 2 Hardware Components

2-1 Add-On Card Image and Layout ..................................................................... 2-1

2-2 Major Components .......................................................................................... 2-2

2-3 LAN Ports and LAN LED Indicators ................................................................ 2-3

LAN Ports ................................................................................................... 2-3

LAN Port LED Indicators ............................................................................ 2-3

2-4 Jumpers ........................................................................................................... 2-4

Explanation of Jumpers .................................................................................. 2-4

Standby Power Header .............................................................................. 2-4

LAN Port Enable/Disable ........................................................................... 2-4

DIP Switch .................................................................................................. 2-5

Chapter 3 Installation

3-1 Static-Sensitive Devices .................................................................................. 3-1

Precautions ..................................................................................................... 3-1

Unpacking ....................................................................................................... 3-1

3-2 Before Installation ........................................................................................... 3-2

3-3 Installing the Add-on Card .............................................................................. 3-2

3-4 Installing Drivers on Windows ......................................................................... 3-4

3-5 Installing Drivers on Linux ............................................................................. 3-4

Build a Binary RPM Package.......................................................................... 3-4

3-6 Installing Drivers on FreeBSD ........................................................................ 3-6

viii

Chapter 1: Overview

Chapter 1

Overview

1-1 Overview

Congratulations on purchasing your add-on card from an acknowledged leader in

the industry. Supermicro products are designed with the utmost attention to detail

to provide you with the highest standards in quality and performance. For product

support and updates, please refer to our website at http://www.supermicro.com/

products/nfo/networking.cfm#adapter.

1-2 Product Highlights

• Quad SFP+ connectors

• Super I/O Module (SIOM) Form Factor

• Network Virtualization O󰀪oads including VXLAN and NVGRE

• Small packet performance

• Data Plane Developer Kit for e󰀩cient packet processing

• Low power consumption

• Intel® Flow Director

• Intelligent O󰀪oads

• Unied networking providing a single wire support for LAN and storage

• Asset Management features

• RoHS compliant 6/6

• Both-direct-attach copper and ber cable supported

1-1

AOC-MTG-i4S Add-on Card User's Guide

1-3 Technical Specications

General

• Intel® XL710-BM1 controller

• Super I/O Module (SIOM) Form Factor

• Quad SFP+ connectors with speed up to 10Gbps per port

• Load balancing on multiple CPUs

• Intel® PROSet Utility for Windows Device Manager

• Time Sync (IEEE 1588)

• Energy E󰀩cient Ethernet (EEE)

I/O Features

• Intel® Flow Director

• MSI-X support

• Multiple Queues: 1,536 TX and RX queues per port

• Tx/Rx IP, SCTP, TCP, and UDP checksum o󰀪oading (IPv4, IPv6) capabilities

• Jumbo Frame (9.5KB)

Virtualization Features

• Next-Generation VMDq with up to 256 VMDq VMs supported

• PCI-SIG SR-IOV with up to 128 virtual ports

• Virtual Machine Load Balancing (VMLB)

• Advanced Packet Filtering

• VLAN support for up to 4096 VLAN tags

• VXLAN and NVGRE support

1-2

Chapter 1: Overview

Storage Interface Features

• Preboot eXecution Environment (PXE) support

• iSCSI remote boot

• Simple Network Management Protocol (SNMP) and Remote Network Monitoring

(RMON) static counters

Management Features

• Asset Management support on Supermicro platforms

• Controller asset tags such as part number, revision, serial number, and MAC

addresses

• Controller thermal sensor

• NC-SI for remote management

Advanced Software Features

• Teaming support

• IEEE 802.3ad (link aggregation control protocol)

• IEEE 802.1Q VLANs

• IEEE 802.3 2005 ow control support

• TCP segmentation/large send o󰀪oad

• Interrupt moderation

OS Support

The AOC-MTG-i4S add-on card supports the following operating systems:

• Windows® Server 2012 R2, 2012, 2008 R2 X86-64

• Linux RedHat EL 6.5 and 7.0 IA-32, X86-64, and IA-64

• Linux SuSE SLES 11 SP3 and 12 IA-32, X86-64, and IA-64

1-3

AOC-MTG-i4S Add-on Card User's Guide

• FreeBSD 9 and 10 IA-32, X86-64, and IA-64

• UEFI 2.1 and 2.3 X86-64 and I-64

• VMware ESXi 5.1, ESXi 5.5 and ESXi 6.0 X86-64

Cable Support

• SFP+ direct-attach twinaxial copper cables up to 7m

• Fiber-optic cables (with required optional SFP+ transceivers)

Power Consumption

• Typical power consumption: 4W

• Maximum power consumption: 7W

Operating Conditions

• Operating temperature: 0°C to 55°C (32°F to 131°F)

• Storage temperature: -40°C to 70°C (-40°F to 158°F)

• Storage humidity: 90% non-condensing relative humidity at 35°C

Physical Dimensions

• Card PCB dimensions: 92mm (3.62in) x 87.1mm (3.43in) (W x D)

Optional Accessories

• AOC-E10GSFPSR: SFP+ transceiver module for short range ber cables (up to

300m), 10G/1G, 850nm, MMF, LC

• AOC-E10GSFPLR: SFP+ transceiver module for long range ber cables (up to

10km), 10G/1G, 1310nm, MMF, LC

• AOC-TSR-FS: SFP+ transceiver module for short range ber cables (up to

300m), 10G/1G, 850nm, MMF, LC

1-4

Chapter 1: Overview

• AOM-TSFP-709DMZ-AVG: SFP+ transceiver module for short range ber

cables, 10G/1G, 850nm, MMF, LC

• CBL-0347L: 1m 10GbE SFP+ to SFP+ copper cable, Passive, 30AWG, Pull Type

• CBL-NTWK-0347: 1m 10GbE SFP+ to SFP+ copper cable, Passive, 30AWG,

Push Type

• CBL-NTWK-0456: 2m 10GbE SFP+ to SFP+ copper cable, Passive, 30AWG,

Push Type

• CBL-0348L: 3m 10GbE SFP+ to SFP+ copper cable, Passive, 24AWG, Pull

release

• CBL-0349L: 5m 10GbE SFP+ to SFP+ copper cable, Passive, 24AWG, Pull

release

• CBL-SFP+AOC-1M: 1m 10GbE SFP+ to SFP+ Fiber Active Optical Cable (AOC)

• CBL-SFP+AOC-3M: 3m 10GbE SFP+ to SFP+ Fiber Active Optical Cable (AOC)

• CBL-SFP+AOC-5M: 5m 10GbE SFP+ to SFP+ Fiber Active Optical Cable (AOC)

Compliance Platforms

• RoHS Compliant 6/6, Pb Free

Supported Platforms

• Supermicro® motherboards with Super I/O Module slots

• Supermicro® server systems with Super I/O Module slots

1-5

AOC-MTG-i4S Add-on Card User's Guide

Notes

1-6

Chapter 2: Hardware Components

Chapter 2

Hardware Components

2-1 Add-On Card Image and Layout

1

2

1

3

1

4

1

5

1

6

1

1

1

7

LED1

DESIGNED IN USA

1

6

S1

1

7

The AOC-MTG-i4S Image

1

1

4

SFP3

LAN3

Intel XL710-BM1

LAN2

1

3

1

1

5

A

C

6

1

LAN4

12

7

JP1

J*

The AOC-MTG-i4S Layout

2-1

1

SFP1SFP2SFP4

LAN1

2

JP1:
1-2:3.3V STBY EN
2-3:3.3V STBY DIS

JPL1:
1-2:LAN EN
2-3:LAN DIS

REV: 1.01

AOC-MTG-i4S

JPL1

AOC-MTG-i4S Add-on Card User's Guide

2-2 Major Components

The following major components are on the AOC-MTG-i4S

1. Intel XL710-BM1 5. SFP+ Port 4

2. SFP+ Port 1 6. DIP Switch

3. SFP+ Port 2 7. 3.3V Standby

4. SFP+ Port 3

2-2

Chapter 2: Hardware Components

2-3 LAN Ports and LAN LED Indicators

LAN Ports

There are four SFP+ LAN ports on the add-on card. These LAN ports support con-

nection speeds of 10Gbps and 1Gbps. Use a direct-attach twinaxial copper cable.

Note: Please refer to "Optional Accessories" on page 1-4 for recommended

cables.

LAN Port LED Indicators

Each LAN port has two LEDs to indicate speed and data activity. Refer to the table

below for LED color and denition.

Link LED

Activity LED

LED Color Denition

LNK Green 10 Gb Link Speed

Yellow 1 Gb Link Speed

ACT Blinking Green Activity

2-3

LAN Ports

1. SFP+ Port 0

2. SFP+ Port 1

3. SFP+ Port 2

4. SFP+ Port 3

AOC-MTG-i4S Add-on Card User's Guide

2-4 Jumpers

Explanation of Jumpers

To modify the operation of the add-on card, a jumper can be used to choose between

optional settings. A jumper creates shorts between two pins to change the function

of the connector. Pin 1 is identied with a square solder pad on the printed circuit

board. See the add-on card layout on page 2-1 for the jumper location.

Note: On two-pin jumpers, "Closed" means the jumper is on and "Open"

means the jumper is o󰀨 the pins.

Standby Power Header

The Standby Power header is located

at JSTBY1 on the add-on card. See

the table on the right for pin deni-

tions.

Standby Power

Pin Denitions

Pin# Denition

1 +5V Standby

2 Ground

3 Wake-up

2-4

Chapter 2: Hardware Components

DIP Switch

The DIP switch at S1 provides SMBUS address selection. You can congure the

card with static SMBUS address. Please refer to the tables below for address sec-

tions and page 2-1 for the location of the switch.

2-5

AOC-MTG-i4S Add-on Card User's Guide

Notes

2-6

Chapter 3: Installation

Chapter 3

Installation

3-1 Static-Sensitive Devices

Electrostatic Discharge (ESD) can damage electronic com ponents. To avoid dam-

aging your add-on card, it is important to handle it very carefully. The following

measures are generally su󰀩cient to protect your equipment from ESD.

Precautions

• Use a grounded wrist strap designed to prevent static discharge.

• Touch a grounded metal object before removing the add-on card from the

antistatic bag.

• Handle the add-on card by its edges only; do not touch its components.

• Put the add-on card back into the antistatic bags when not in use.

• For grounding purposes, make sure that your system chassis provides excellent

conductivity between the power supply, the case, the mounting fasteners and

the add-on card.

Unpacking

The add-on card is shipped in antistatic packaging to avoid static damage. When

unpacking your component or system, make sure that you are static protected.

Note: To avoid damaging your components and to ensure proper instal-

lation, always connect the power cord last, and always remove it before

adding, removing or changing any hardware components.

3-1

AOC-MTG-i4S Add-on Card User's Guide

3-2 Before Installation

Before you install the add-on card, follow the instructions below.

1. Power down the system.

2. Unplug the power cord.

3. Use industry-standard anti-static equipment such as gloves or a wrist strap

and follow the precaution s on page 3-1 to avoid damage caused by ESD.

4. Familiarize yourself with the server, motherboard, and/or chassis documenta-

tion.

5. Conrm that your operating system includes the latest updates and hotxes.

3-3 Installing the Add-on Card

Follow the steps below to install the add-on card into your system.

1. Remove the server cover and, if any, set aside any screws for later use.

2. Remove the add-on card slot cover. If the slot cover has a screw, place it

aside for later use.

3. Position the add-on card in front of the SIOM slot and gently press both sides

of the card until it slides into the slot.

Insert the SIOM
card into this slot

SIOM card with the
bracket installed

Note: This add-on card does not support hot plug. Please turn o󰀨 the AC

power and remove the power cord from the wall socket before you install

or remove the add-on card.

3-2

Chapter 3: Installation

1

2

3

4

Follow this step to install the add-on card if your system does not support a swap-

pable bracket. Insert the SIOM card in the motherboard and then install the moth-

erboard in the chassis. An internal bracket comes with the SIOM card 1U chassis

SKU. It needs to be installed onto the chassis.

Insert the SIOM card
into the motherboard

Tighten the screw

Install the bracket
onto the chassis

Install the motherboard
in the chassis

Note: It is recommended that the SIOM card installation above be com-

pleted by a system integrator or the manufacturer.

4. Secure the add-on card to the chassis. If required, use the screw that you

previously removed.

5. Attach any necessary external cables to the add-on card.

6. Replace the system cover.

7. Plug in the power cord and power up the system.

3-3

AOC-MTG-i4S Add-on Card User's Guide

3-4 Installing Drivers on Windows

Follow the steps below to install the drivers for Windows. Download the drivers from

the Supermicro FTP site at ftp://ftp.supermicro.com/Networking_Drivers/.

1. Run CDR-NIC.

2. When the SUPERMICRO window appears, click on the computer icon next to

the product model.

Note: If the FOUND NEW HARDWARE WIZARD screen displays on your

system, click CANCEL.

3. Click on INSTALL DRIVERS AND SOFTWARE.

4. Follow the prompts to complete the installation.

3-5 Installing Drivers on Linux

Follow the steps below to install the drivers in Linux.

Build a Binary RPM Package

1. Run ‘rpmbuild -tb <lename.tar.gz>’

2. Replace <lename.tar.gz> with the specic lename of the driver.

Note: For the build to work properly, the current running kernel MUST

match the version and conguration of the installed kernel sources. If you

have just recompiled the kernel, reboot the system at this time.

3-4

Chapter 3: Installation

Follow the instructions below to build the driver manually.

1. Move the base driver tar le to the directory of your choice. For example:

/home/username/ixgbe

or

/usr/local/src/ixgbe

2. Untar/unzip archive, where <x.x.x> is the version number for the driver tar le:

tar zxf ixgbe-x.x.x.tar.gz

3. Change to the driver src directory, where <x.x.x> is the version number for

the driver tar:

cd ixgbe-x.x.x/src/

4. Compile the driver module:

make install

The binary will be installed as:

/lib/modules/[KERNEL_VERSION]/kernel/drivers/net/ixgbe/ixgbe.[k]o

The install locations listed above are the default locations. They may not be

correct for certain Linux distributions. For more information, see the ldistrib.txt

le included in the driver tar.

Note: IXGBE_NO_LRO is a compile time ag. The user can enable it at

compile time to remove support for LRO from the driver. The ag is used

by adding CFLAGS_EXTRA=-”DIXGBE_NO_LRO” to the make le when

it’s being compiled.

make CFLAGS_EXTRA=”-DIXGBE_NO_LRO” install

5. Load the module:

For kernel 2.6.x, use the modprobe command:

modprobe ixgbe <parameter>=<value>

For 2.6 kernels, the insmod command can be used if the full path to the driver

module is specied. For example:

insmod /lib/modules/<KERNEL VERSION>/kernel/drivers/net/

ixgbe/ixgbe.ko

3-5

AOC-MTG-i4S Add-on Card User's Guide

In addition, when using 2.6-based kernels, make sure that older ixgbe drivers

are removed from the kernel before loading the new module. To do this, use:

rmmod ixgbe; modprobe ixgbe

6. Assign an IP address to the interface by entering the following, where x is the

interface number:

ifcong ethx <IP_address> netmask <netmask>

7. Verify that the interface works. Enter the following, where <IP_address> is the

IP address for another machine on the same subnet as the interface that is

being tested:

ping <IP_address>

3-6 Installing Drivers on FreeBSD

Follow the instructions below to install the drivers in FreeBSD kernel 4.8 or later.

In the instructions below, x.x.x is the driver version as indicated in the name of the

drive tar le.

Note: You must have kernel sources installed in order to compile the

driver module.

1. Move the base driver tar le to the dirctory of your choice. For example, use

/home/username/ixgb or /usr/local/src/ixgb.

2. Untar/unzip the archive:

tar xfz ixgb-x.x.x directory

3. To install man page:

cd ixgb-x.x.x

gzip -c ixgb.4 > /usr/share/man/man4/ixgb.4.gz

4. To load the driver onto a running system, perform the following steps:

cd ixgb-x.x.x

make

or

cd ixgb-x.x.x/src

make load

5. To assign an IP address to the interface, enter the following:

3-6

Chapter 3: Installation

ifcong ixgb<interface_num> <IP_address>

6. Verify that the interface works. Enter the following, where <IP_address> is the

IP address for another machine on the same subnet as the interface that is

being tested:

ping <IP_address>

7. If you want the driver to load automatically when the system is booted:

cd ixgb-x.x.x/src

make load

cp if_ixgb.ko /modules

Edit /boot/loader.conf, and add the following line:

if_ixgb_load="YES"

or

compile the driver into the kernel (see item 8). Edit /etc/rc.conf, and create the

appropriate ifcong_ixgb<interface_num> entry:

ifcong_ixgb<interface_num>="<ifcong_settings>"

Example usage:

ifcong_ixgb0="inet 192.168.10.1 netmask 255.255.255.0"

8. If you want to compile the driver into the kernel, enter:

cd ixgb-x.x.x/src

mkdir /usr/src/sys/dev/ixgb

cp if_ixgb* /usr/src/sys/dev/ixgb

cp ixgb* /usr/src/sys/dev/ixgb

cp Makele.kernel /usr/src/sys/modules/ixgb/Makele

Edit the /usr/src/sys/conf/les.i386 le, and add the following line:

dev/ixgb/ixgb_hw.c optional ixgb

dev/ixgb/ixgb_ee.c optional ixgb

dev/ixgb/if_ixgb.c optional ixgb

Remove the following lines from the /usr/src/sys/conf/les.i386 le if they exist:

/dev/ixgb/if_ixgb_fx_hw.c optional ixgb

/dev/ixgb/if_ixgb_phy.c optional ixgb

3-7

AOC-MTG-i4S Add-on Card User's Guide

Edit the kernel conguration le (i.e., GENERIC or MYKERNEL) in /usr/src/sys/

i386/conf, and ensure the following line is present:

device ixgb

Compile and install the kernel. Reboot the system for the kernel updates to

take a󰀨ect.

3-8

(Disclaimer Continued)

The products sold by Supermicro are not intended for and will not be used in life support systems,
medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency com­munication devices or other critical systems whose failure to perform be reasonably expected to result

in signicant injury or loss of life or catastrophic property damage. Accordingly, Supermicro disclaims

any and all liability, and should buyer use or sell such products for use in such ultra-hazardous ap­plications, it does so entirely at its own risk. Furthermore, buyer agrees to fully indemnify, defend
and hold Supermicro harmless for and against any and all claims, demands, actions, litigation, and
proceedings of any kind arising out of or related to such ultra-hazardous use or sale.