Supermicro AOC-S25G-m2S operation manual

AOC-S25G-m2S

User's Guide

Revision 1.0

The information in this User's Guide has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
and makes no commitment to update or to keep current the information in this user's guide, or to
notify any person or organization of the updates. Please Note: For the most up-to-date version

of this user's guide, please see our Website at www.supermicro.com.

Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this user's guide at any time and without notice. This product, including software and
documentation, is the property of Supermicro and/or its licensors, and is supplied only under a
license. Any use or reproduction of this product is not allowed, except as expressly permitted by
the terms of said license.

IN NO EVENT WILL SUPER MICRO COMPUTER, INC. BE LIABLE FOR DIRECT, INDIRECT,
SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE
USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF
THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC.
SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED
WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING,
INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.

Any disputes arising between the manufacturer and the customer shall be governed by the laws of
Santa Clara County in the State of California, USA. The State of California, County of Santa Clara
shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for
all claims will not exceed the price paid for the hardware product.

FCC Statement: This equipment has been tested and found to comply with the limits for a Class
A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide
reasonable protection against harmful interference when the equipment is operated in a commercial
environment. This equipment generates, uses, and can radiate radio frequency energy and, if not
installed and used in accordance with the manufacturer’s instruction manual, may cause harmful
interference with radio communications. Operation of this equipment in a residential area is likely
to cause harmful interference, in which case you will be required to correct the interference at your
own expense.

California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate
warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”.

WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to
the State of California to cause birth defects and other
reproductive harm.

User's Guide Revision 1.0

Release Date: March 16, 2017

Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.

Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.

Copyright © 2017 by Super Micro Computer, Inc.
All rights reserved.

Printed in the United States of America

Preface

About this User's Guide

This user's guide is written for system integrators, IT technicians and

knowledgeable end users. It provides information for the installation and use of the

AOC-S25G-m2S add-on card.

About this Add-on Card

The Supermicro AOC-S25G-m2S is a leading edge 25GbE controller. Based on the

Mellanox ConnectX®-4 Lx EN chipset with features such as VXLAN and NVGRE,

it is backward compatible with 10GbE networks and addresses bandwidth demand

from virtualized infrastructures in data centers or cloud deployments. It supports the

RoCE specication with CPU ofoad, delivering low-latency and high-performance

over Ethernet networks. Supermicro® Asset Management and thermal detection

give an extra layer of controller health management and peace of mind. The

Supermicro AOC-S25G-m2S high performance 25GbE adapter solution is an excel-

lent choice to enhance network connectivity in data centers and enterprise environ-

ments. For more information regarding product support or updates, please refer to

our website at http://www.supermicro.com/products/nfo/networking.cfm#adapter.

Preface

An Important Note to the User

All images and layouts shown in this user's guide are based upon the latest PCB

Revision available at the time of publishing. The card you have received may or

may not look exactly the same as the graphics shown in this user's guide.

Returning Merchandise for Service

A receipt or copy of your invoice marked with the date of purchase is required before

any warranty service will be rendered. You can obtain service by calling your ven-

dor for a Returned Merchandise Authorization (RMA) number. When returning the

motherboard to the manufacturer, the RMA number should be prominently displayed

on the outside of the shipping carton, and the shipping package is mailed prepaid

or hand-carried. Shipping and handling charges will be applied for all orders that

must be mailed when service is complete. For faster service, you can also request

a RMA authorization online (http://www.supermicro.com/RmaForm/).

iii

AOC-S25G-m2S Add-on Card User's Guide

This warranty only covers normal consumer use and does not cover damages in-

curred in shipping or from failure due to the alternation, misuse, abuse or improper

maintenance of products.

During the warranty period, contact your distributor rst for any product problems.

Conventions Used in the User's Guide

Pay special attention to the following symbols for proper system installation and to

prevent damage to the system or injury to yourself:

Warning: Important information given to ensure proper system installation

or to prevent damage to the components or injury to yourself.

Note: Additional information given to differentiate between various models

or provides information for correct system setup.

iv

Preface

A O C – S T G N – i 2 S

Naming Convention

1 – 2 3 4 – 5 6 7

Character Representation Options

1st Product Family AOC: Add On Card

2nd Form Factor S: Standard, P: Proprietary, C: MicroLP, U: UIO

3rd Product Type/Speed

4th Chipset Model (Optional)

5th Chipset Manufacturer i: Intel, m: Mellanox, b: Broadcom

6th Number of Ports 1: 1 port, 2: 2 ports, 4: 4 ports

7th Connector Type (Optional) S: SFP+, T: 1

G: GbE (1Gb/s), TG: 10GbE (10Gb/s), 40G: 40GbE
(40Gb/s), IBF: FDR IB (56Gb/s), IBQ: QDR IB (40Gb/s)

N: Niantec (82599), P: Powerville (i350),
S: Sageville (X550), F: Fortville (XL710)

0GBase-T, Q: QSFP+, C: QSFP28

SMC Networking Add-on Cards

Model Type Form Factor Interface Controller Connection

AOC-MGP-i2 GbE SIOM Intel® i350 AM2 2 RJ45 (1Gb/port) 3.622" (92mm) x 3.428" (87mm) 3.7

AOC-MPG-i4

AOC-MTGN-i2S

AOC-MTG-i4S

AOC-MTG-i2T

AOC-MTG-i4T

AOC-MHIBF-m1Q2G

AOC-MHIBF-m2Q2G

AOC-MH25G-b2S2G

AOC-MHIBF-m2S2T

AOC-MHFI-i1C

AOC-SGP-i2

AOC-SGP-i4

AOC-STG-i2T

AOC-STGS-i1T

AOC-STGS-i2T

AOC-STG-i4T

AOC-STGN-i1S

AOC-STGN-i2S

AOC-STGF-i2S

AOC-STG-b4S

AOC-STG-i4S

AOC-S25G-b2S

AOC-S25G-m2S

AOC-S40G-i1Q

AOC-S40G-i2Q

AOC-S100G-m2C

AOC-PTG-i1S

AOC-UG-i4

AOC-CGP-i2

AOC-CG-i2

AOC-CIBF-m1

AOC-CTG-i1S

AOC-CTG-i2S

AOC-CTG-i2T

AOC-CTGS-i2T

AOC-C25G-m2S

GbE SIOM Intel® i350 AM4 4 RJ45 (1Gb/port) 3.622" (92mm) x 3.428" (87mm)

10GbE SIOM Intel® 82599ES 2 SFP+ (10Gb/port) 3.622" (92mm) x 3.428" (87mm) 7.2

10GbE SIOM Intel® XL710-BM1 4 SFP+ (10Gb/port) 3.622" (92mm) x 3.428" (87mm) 7

10GbE SIOM Intel® X550-AT2 2 RJ45 (10GBase-T) 3.622" (92mm) x 3.428" (87mm) 13

10GbE SIOM 2x Intel® X550-AT2 4 RJ45 (10GBase-T) 3.622" (92mm) x 3.428" (87mm) 2

FRD IB

GbE

FRD IB

GbE

25GbE

GbE

25GbE SIOM

Omni-

Path

GbE Standard LP PCI-E x4 Intel® i350 AM2 2 RJ45 (1Gb/port) 3.9” (99mm) x 2.73” (69mm) 3.5

GbE

Standard LP PCI-E x4 Intel® i350 AM4 4 RJ45 (1Gb/port) 3.9” (99mm) x 2.73” (69mm) 5

10GbE Standard LP PCI-E x8 Intel® X540-AT2 2 RJ45 (10GBase-T) 5.9” (150mm) x 2.73” (69mm) 13

10GbE Standard LP PCI-E x4 Intel® X550-AT 1 RJ45 (10GBase-T) 5.9” (150mm) x 2.73” (69mm) 9

10GbE Standard LP PCI-E x4 Intel® X550-AT2 2 RJ45 (10GBase-T) 5.9” (150mm) x 2.73” (69mm) 11

10GbE Standard LP PCI-E x8 Intel® XL710-BM1 4 RJ45 (10GBase-T) 5.9” (150mm) x 2.73” (69mm) 15.5

10GbE Standard LP PCI-E x8 Intel® 82598EN 1 SFP+ (10Gb/port) 4.0” (102mm) x 2.73” (69mm) 10

10GbE Standard LP PCI-E x8 Intel® 82599ES 2 SFP+ (10Gb/port) 4.0” (102mm) x 2.73” (69mm) 11.2

10GbE Standard LP PCI-E x8 Intel® X710-BM2 2 SFP+ (10Gb/port) 5” (127mm) x 2.73” (69mm) 15

10GbE Standard LP PCI-E x8 Broadcom® BCM57840S 4 SFP+ (10Gb/port) 5.4” (137mm) x 2.73” (69mm) 14

10GbE Standard LP PCI-E x8 Intel® XL710-BM1 4 SFP+ (10Gb/port) 5.9” (150mm) x 2.73” (69mm) 8

25GbE Standard LP PCI-E x8 Broadcom® BCM57414 2 SFP28 (25Gb/port) 5.9” (150mm) x 2.73” (69mm) 7

25GbE Standard LP PCI-E x8 Mellanox® CX-4 LX 2 SFP28 (25Gb/port) 5.6” (142mm) x 2.71” (69mm) 8.7

40GbE Standard LP PCI-E x8 Intel® XL710-BM1 1 QSFP+ (40Gb/port) 5.9” (150mm) x 2.73” (69mm) 6.5

40GbE Standard LP PCI-E x8 Intel® XL710-BM2 2 QSFP+ (40Gb/port) 5.9” (150mm) x 2.73” (69mm) 7

100GbE Standard LP PCI-E x16 Mellanox® CX-4 EN 2 QSFP28 (100Gb/port) 6.6” (167mm) x 2.71” (69mm) 16.3

10GbE Proprietary PCI-E x8 Intel® 82599EN 1 SFP+ (10Gb/port) 10.04” (255mm) x .78” (20mm)

GbE UIO FH PCI-E x8 Intel® 82571EB 4 RJ45 (1Gb/port) 6.6” (167mm) x 3.9” (98mm) 10

GbE MicroLP PCI-E x4 Intel®

GbE MicroLP PCI-E x4 Intel® 82580 2 RJ45 (1Gb/port) 4.45” (113mm) x 1.3” (34mm) 4

FDR IB MicroLP PCI-E x8 Mellanox® ConnectX-3 1 QSFP (56Gb/port) 4.85" (123mm) x 1.54" (39mm) 7

10GbE MicroLP PCI-E x8 Intel® 82599EN 1 SFP+ (10Gb/port) 4.85" (123mm) x 1.54" (39mm) 10

10GbE MicroLP PCI-E x8 Intel® 82599ES 2 SFP+ (10Gb/port) 4.85" (123mm) x 1.54" (39mm) 11

10GbE MicroLP PCI-E x8 Intel® X540-AT2 2 RJ45 (10GBase-T) 4.8” (123mm) x 2.75” (77mm) 13

10GbE MicroLP PCI-E x4 Intel® X550-AT2 2 RJ45 (10GBase-T) 4.45” (113mm) x 1.54” (39mm) 12

25GbE Micr

**

**

**

**

**

**

SIOM

SIOM

SIOM

SIOM

oLP

Mellanox® ConnectX-3 Pro

**

Intel® i350

Mellanox® ConnectX-3 Pro

**

Intel® i350

Broadcom® BCM57414

**

Intel® i350

Mellanox® ConnectX-4 Lx EN

**

Intel® X550-AT2

Intel® OP HFI ASIC

**

(Wolf River WFR-B)

i350 AM2 2 RJ45 (1Gb/port) 4.45” (113mm) x 1.54” (39mm) 4

PCI-E x8 Mellanox® CX-4 Lx EN 2 SFP28 (25Gb/port) 4.45” (113mm) x 1.54” (39mm) 9

1 QSFP (56Gb/port)
2 RJ45 (1Gb/port)
2 QSFP (56Gb/port)
2 RJ45 (1Gb/port)
2 SFP28 (25Gb/port)
2 RJ45 (1Gb/port)
2 SFP28 (25Gb/port)
2 RJ45 (10GBase-T)

1 QSFP28 (100Gb/port) 3.622" (92mm) x 3.428" (87mm) 15

Dimension

(w/o Brackets) (L x H)

3.622" (92mm) x 3.428" (87mm) 9

3.622" (92mm) x 3.428" (87mm) 11

3.622" (92mm) x 3.428" (87mm) 9

3.622" (92mm) x 3.428" (87mm) 25

Power

(W)

4.4

7.5

6

v

AOC-S25G-m2S Add-on Card User's Guide

Contacting Supermicro

Headquarters

Address: Super Micro Computer, Inc.

980 Rock Ave.

San Jose, CA 95131 U.S.A.

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

Website: www.supermicro.com

Europe

Address: Super Micro Computer B.V.

Het Sterrenbeeld 28, 5215 ML

's-Hertogenbosch, The Netherlands

Tel: [phone]

Fax: [phone]

Email: [e-mail] (General Information)

[e-mail] (Technical Support)

[e-mail] (Customer Support)

Website: www.supermicro.nl

Asia-Pacic

Address: Super Micro Computer, Inc.

3F, No. 150, Jian 1st Rd.

Zhonghe Dist., New Taipei City 235

Taiwan (R.O.C)

Tel: [phone]

Fax: [phone]

Email: [e-mail]

Website: www.supermicro.com.tw

vi

Preface

Table of Contents

Preface

Chapter 1 Overview

1-1 Overview ......................................................................................................... 1-1

1-2 Key Features ................................................................................................... 1-1

1-3 Specications .................................................................................................. 1-2

General ............................................................................................................ 1-2

Host Interface .................................................................................................. 1-2

Networking Features ....................................................................................... 1-2

CPU Ofoad Features ..................................................................................... 1-3

Overlay Networks ............................................................................................ 1-3

Hardware-Based I/O Virtualization .................................................................. 1-3

Storage Ofoads ............................................................................................. 1-3

Management Features .................................................................................... 1-3

Virtualization Features..................................................................................... 1-4

Operating System Support .............................................................................. 1-4

Remote Boot ................................................................................................... 1-4

Operating Conditions ...................................................................................... 1-4

Physical Dimensions ....................................................................................... 1-5

Weight ............................................................................................................. 1-5

Supported Platforms ....................................................................................... 1-5

Compliance/Environmental ............................................................................. 1-5

1-4 Similar Products .............................................................................................. 1-6

1-5 Optional Parts List ........................................................................................... 1-6

Chapter 2 Hardware Components

2-1 Add-On Card Image and Layout ..................................................................... 2-1

2-2 Major Components .......................................................................................... 2-2

2-3 SFP28 Ethernet Connections.......................................................................... 2-3

2-4 NC-SI Header & PCI-E 3.0 x8 Golden Finger ................................................ 2-4

Chapter 3 Installation

3-1 Static-Sensitive Devices .................................................................................. 3-1

3-2 Before Installation ........................................................................................... 3-2

3-3 Installing the Add-on Card .............................................................................. 3-2

3-4 Installing Drivers from the CD-ROM CDR-NIC ............................................... 3-3

Windows Drivers ............................................................................................. 3-4

3-5 Installing Drivers ............................................................................................ 3-4

Linux Drivers ................................................................................................... 3-4

Firmware Update Procedures ......................................................................... 3-5

vii

AOC-S25G-m2S Add-on Card User's Guide

Notes

viii

Chapter 1: Overview

Chapter 1

Overview

1-1 Overview

Congratulations on purchasing your add-on card from an acknowledged leader in

the industry. Supermicro products are designed with the utmost attention to detail

to provide you with the highest standards in quality and performance. For product

support and updates, please refer to our website at http://www.supermicro.com/

products/nfo/networking.cfm#adapter.

1-2 Key Features

The key features of this add-on card include the following:

• Dual SFP28 Connectors

• Low-Prole, Short Length Standard Form Factor

• PCI-E 3.0 x8

• Mellanox ConnectX®-4 Lx EN Ethernet Controller

• Asset Management Features with thermal sensor

• Hardware ofoads for VXLAN, NVGRE and GENEVE encapsulated trafc

• Low latency RDMA over Converged Ethernet (RoCE)

• PCI-SIG SR-IOV compliant

• Jumbo Frames support up to 9.6kB

• PXE support

• Erasure Coding Ofoad

• NC-SI for IPMI support

• RoHS compliant 6/6

1-1

AOC-S25G-m2S Add-on Card User's Guide

1-3 Specications

General

• Mellanox ConnectX®-4 Lx EN dual-port 25Gbps controller

• Compact size low-prole standard form factor

• PCI-E 3.0 x8 (8GT/s, 5GT/s or 2.5GT/s) interface

• Dual SFP28 connectors

• Typical power consumption: 8.7W

Host Interface

• PCI-E 3.0 x8

• Message Signal Interrupt (MSI-X)

Networking Features

• 25G Ethernet Consortium 25 Gigabit Ethernet

• IEEE 802.3ae 10 Gigabit Ethernet

• IEEE 802.3az Energy Efcient Ethernet

• IEEE 802.3ap based auto-negotiation and KR startup

• IEEE 802.ad, 802.1AX Link Aggregation

• IEEE 802.1Q, 802.1p VLAN tags and priority

• IEEE 802.1Qau (QCN) – Congestion Notication

• IEEE 802.1Qaz (ETS)

• IEEE 802.1Qbb (PFC)

• IEEE 802.1Qbg

• IEEE 1588v2

1-2

Chapter 1: Overview

• Jumbo frame support (9.6KB)

CPU Ofoad Features

• RDMA over Converged Ethernet (RoCE)

• TCP/UDP/IP stateless ofoad

• LSO, LRO, checksum ofoad

• RSS, TSS, HDS, VLAN insertion/stripping. Receive ow steering

• Intelligent interrupt coalescence

Overlay Networks

• Stateless ofoads for overlay networks and tunneling protocols

• Hardware ofoad of encapsulation and decapsulation of NVGRE and VXLAN

overlay networks

Hardware-Based I/O Virtualization

• Single Root IOV

• Multi-function per port

• Address translation and protection

• Multiple queues per virtual machine

• Enhanced QoS for vNICs

• VMware NetQueue support

Storage Ofoads

• RAID ofoad – erasure coding (Reed-Solomon) ofoad

Management Features

• Asset Management features with thermal sensor

1-3

AOC-S25G-m2S Add-on Card User's Guide

• NC-SI for IPMI Support

Virtualization Features

• SR-IOV: up to 256 Virtual Functions

• SR-IOV: up to 16 Physical Functions per port

• 1K ingress and egress QoS levels

• Guaranteed QoS for VMs

Operating System Support

• RHEL/CentOS

• Windows

• FreeBSD

• VMware

• OpenFabrics Enterprise Distribution (OFED)

• OpenFabrics Windows Distribution (WinOF-2)

Remote Boot

• Remote boot over iSCSi

• PXE and UEFI

Operating Conditions

• Operating temperature: 0°C to 55°C (32°F to 131°F)

• Storage temperature: -40°C to 70°C (-40°F to 158°F)

• Storage humidity: 90% non-condensing relative humidity at 35°C

1-4

Chapter 1: Overview

Physical Dimensions

• Card PCB dimensions: 14.2cm x 6.89cm (5.6in x 2.71in) (LxW)

• Height of end brackets: standard – 12cm (4.725in), low-prole – 8cm (3.15in)

Weight

• 89.58g (0.1975lb)

Supported Platforms

• Motherboards with minimum PCI-E 3.0 x8 expansion slot

• Server Systems with low-prole or full-height PCI-E 3.0 x8 expansion slots

• NC-SI feature is only supported by Supermicro® motherboards with correspond-

ing NC-SI connectors

Note: This product is intended to be used with Supermicro server systems

or motherboards as an integrated solution package.

Compliance/Environmental

• RoHS Compliant 6/6, Pb Free

1-5

AOC-S25G-m2S Add-on Card User's Guide

1-4 Similar Products

Product Part

Number

AOC-STG-i4S Standard

AOC-STG-b4S Standard

AOC-STGN-i1S Standard

AOC-STGN-i2S Standard

AOC-STG-i2T Standard

AOC-STG-i4T Standard

AOC-STGS-i1T Standard

AOC-STGS-i2T Standard

AOC-S40G-i1Q Standard

AOC-S40G-i2Q Standard

AOC-S100G-

m2C

Form

Factor

Low Prole

Low Prole

Low Prole

Low Prole

Low Prole

Low Prole

Low Prole

Low Prole

Low Prole

Low Prole

Standard

Low Prole

Speed PCI-E Connector

10GbE PCI-E 3.0 x8 SFP+ 4 Intel® XL710

10GbE PCI-E 3.0 x8 SFP+ 4 Broadcom® BCM57840S

10GbE PCI-E 2.0 x8 SFP+ 1 Intel® 82599EN

10GbE PCI-E 2.0 x8 SFP+ 2 Intel® 82599ES

10GbE PCI-E 2.1 x8 RJ45 2 Intel® X540

10GbE PCI-E 3.0 x8 RJ45 4 Intel® XL710

10GbE PCI-E 3.0 x4 RJ45 1 Intel® X550

10GbE PCI-E 3.0 x4 RJ45 2 Intel® X550

40GbE PCI-E 3.0 x8 QSFP+ 1 Intel® XL710

40GbE PCI-E 3.0 x8 QSFP+ 2 Intel® XL710

100GbE PCI-E 3.0

x16

Type

QSFP28 2 Mellanox ConnectX-4 EN

Total

Ports

Chipset

1-5 Optional Parts List

Product Part Number Description

CBL-NTWK-0944-MS28C05M SFP28 Copper Cable 0.5m 25GbE SFP28 to SFP28, Passive

CBL-NTWK-0944-MS28C10M SFP28 Copper Cable 1m 25GbE SFP28 to SFP28, Passive

CBL-NTWK-0944-MS28C15M SFP28 Copper Cable 1.5m 25GbE SFP28 to SFP28, Passive

CBL-NTWK-0944-MS28C20M SFP28 Copper Cable 2m 25GbE SFP28 to SFP28, Passive

CBL-NTWK-0944-MS28C25M SFP28 Copper Cable 2.5m 25GbE SFP28 to SFP28, Passive

CBL-NTWK-0944-MS28C30M SFP28 Copper Cable 3m 25GbE SFP28 to SFP28, Passive

AOM-SFP28-25GbE-SR-1 SFP28 Transceiver 25GbE SFP28 Transceiver

1-6

Chapter 2: Hardware Components

Chapter 2

Hardware Components

2-1 Add-On Card Image and Layout

1

2

6

3

7

4

5

The AOC-S25G-m2S Image

J_SFP1_1

2

4

PORT1 LED

JGF1

J_SFP2_1

SFP2SFP1

1

Mellanox

ConnectX®-4 Lx EN

3

5

PORT2 LED

JGF1

AOC-S25G-m2S

REV: 1.00

6

JNCSI1

DESIGNED IN USA

7

The AOC-S25G-m2S Layout

1. Mellanox ConnectX®-4 Lx EN 5. SFP28 Port2 Link LED

2. SFP28 Port1 6. NC-SI header

3. SFP28 Port2 7. PCI-E 3.0 x8

4. SFP28 Port1 Link LED

2-1

AOC-S25G-m2S Add-On Card User's Guide

2-2 Major Components

The following major components are installed on the AOC-S25G-m2S:

1. Mellanox ConnectX®-4 Lx EN Controller

2. Dual SFP28 (Small Form Factor Pluggable) Ports

3. Two (2) SFP28 Link/Activity LED Indicators

4. NC-SI for IPMI support

2-2

Chapter 2: Hardware Components

J_SFP1_1

J_SFP2_1

SFP2SFP1

JGF1

JNCSI1

JGF1

AOC-S25G-m2S

REV: 1.00

DESIGNED IN USA

PORT1 LED

PORT2 LED

Mellanox

ConnectX®-4 Lx EN

2-3 SFP28 Ethernet Connections

SFP28 (SFP1/SFP2) Connectors

Two small form-factor pluggable (SFP28) optical transceiver connectors (SFP1/

SFP2) are located on the add-on card. These SFP28 por ts provide Ethernet up to

25GbE network connections. See the layout below for the locations.

SFP28 (SFP1/SFP2) Link/Activity LED Indicators

Two LAN Link/Activity LED indicators are located at PORT1 LED and PORT2

LED on the add-on card. PORT1 LED is used for the SFP28 SFP1 connector, and

PORT2 LED, for SFP28 SFP2 connector. See the table below for the LED states.

LAN Port Activity LED Indicators

Assignment/State

LED LAN Port Assigned

PORT1 LED SFP1 Active

PORT2 LED SFP2 Active

Green SFP28 LAN Port Active

1

3

2

4

LED Color Denition

Amber 10 Gbps

Green 25 Gbps

2-3

LAN Port Link LEDs

LED State

1. SFP1: SFP28 Port1

2. SFP2: SFP28 Port2

3. SFP28 Port1 Link LED

4. SFP28 Port1 Link LED

AOC-S25G-m2S Add-On Card User's Guide

J_SFP1_1

J_SFP2_1

SFP2SFP1

JGF1

JNCSI1

JGF1

AOC-S25G-m2S

REV: 1.00

DESIGNED IN USA

PORT1 LED

PORT2 LED

Mellanox

ConnectX®-4 Lx EN

2-4 NC-SI Header & PCI-E 3.0 x8 Golden Finger

NC-SI Header

A Network-Controller Sideband Interface (NC-SI) header is located at JNCSI1 on

the add-on card. Connect an appropriate cable from this header to a motherboard

to provide the out-of-band (sideband) connection between the onboard Baseboard

Management Controller (BMC) and a Network Interface Controller (NIC) for remote

management. For the network sideband interface to work properly, you will need

to use a motherboard that supports NC-SI and also need to have a special cable.

Please contact Supermicro at www.supermicro.com to purchase the cable for this

header. See the layout below for the location of the JNCSI1 header.

PCI-E 3.0 x8 Golden Finger

A PCI-E 3.0 x8 Golden Finger is located at JGF1 on the add-on card. Insert this

connector into a PCI-E 3.0 x8 slot on a motherboard to use this add-on card. See

the layout below for the location.

1

1. NS-CI Header

2. PCI-E 3.0 x8 Golden
Finger

2

2-4

Chapter 3: Installation

Chapter 3

Installation

3-1 Static-Sensitive Devices

Electrostatic Discharge (ESD) can damage electronic com ponents. To avoid dam-

aging your add-on card, it is important to handle it very carefully. The following

measures are generally sufcient to protect your equipment from ESD.

Precautions

• Use a grounded wrist strap designed to prevent static discharge.

• Touch a grounded metal object before removing the add-on card from the

antistatic bag.

• Handle the add-on card by its edges only; do not touch its components, or

peripheral chips.

• Put the add-on card back into the antistatic bags when not in use.

• For grounding purposes, make sure that your system chassis provides excellent

conductivity between the power supply, the case, the mounting fasteners and

the add-on card.

Unpacking

The add-on card is shipped in antistatic packaging to avoid static damage. When

unpacking your component or your system, make sure that the person handling it

is static protected.

Warning: To avoid damaging your components and to ensure proper

installation, be sure to always connect the power cord last, and always

remove it before adding, removing or changing any hardware components.

3-1

AOC-S25G-m2S Add-on Card User's Guide

3-2 Before Installation

To install the add-on card properly, be sure to follow the instructions below.

1. Power down the system.

2. Unplug the power cord.

3. Use industry standard anti-static equipment (such as gloves or wrist strap)

and follow the precautions on Page 3-1 to avoid damage caused by ESD.

4. Familiarize yourself with the server, motherboard, and/or chassis documenta-

tion.

5. Conrm that your operating system includes the latest updates and hotxes.

3-3 Installing the Add-on Card

Follow the steps below to install the add-on card into your system.

1. Remove the server cover and, if any, set aside any screws for later use.

2. Remove the add-on card slot cover. If the case requires a screw, place the

screw aside for later use.

3. Position the add-on card in the slot directly over the connector, and gently

push down on both sides of the card until it slides into the PCI connector.

4. Secure the add-on card to the chassis. If required, use the screw that you

previously removed.

5. Attach any necessary external cables to the add-on card.

6. Replace the chassis cover.

7. Plug the power cord into the wall socket and power up the system.

3-2

Chapter 3: Installation

3-4 Installing Drivers from the CD-ROM CDR-NIC

Follow the steps below to install the drivers needed for your Windows OS support.

The controller comes with a driver on the CD-ROM CDR-NIC.

1. Run the CDR-NIC. (If you do not have a product CD-ROM, download drivers

from the Supermicro Support Website and then transfer them to your system.)

2. When the SUPERMICRO window appears, click on the computer icon next to

the product model.

Note: If the FOUND NEW HARDWARE WIZARD screen displays on your

system, click CANCEL.

3. Click on INSTALL DRIVERS AND SOFTWARE.

4. The Install Shield Wizard will start .Follow the prompts to complete the instal-

lation.

3-3

AOC-S25G-m2S Add-on Card User's Guide

3-5 Installing Drivers

Use the procedures below to install drivers for the AOC-S25G-m2S add-on card

for both Linux and Windows.

Linux Drivers

Use the following procedures to install drivers on the Linux operating system.

Installing 25G Drivers for the Linux Operating System

1. From the CDR-NIC LAN driver CD, go to the following directory: Mellanox

> Linux. You may also go to the Supermicro FTP site at ftp://ftp.super-

micro.com/Networking_Drivers/CDR-NIC_1.50_for_Add-on_NIC_Cards/

Mellanox/25GbE/Linux/.

2. Download the Linux driver package le.

3. Install the driver by entering the following commands:

tar xzvf mlnx-en–<ver>.tgz

cd mlnx-en–<ver>

./install.sh

This installs the Linux drivers to your system.

Note: Driver installation may require root privileges.

Windows Drivers

Use the following procedures to install drivers on the Windows operating system.

Installing 25G Drivers for the Windows Operating System

1. From the CDR-NIC LAN driver CD, go to the following directory: Mellanox

> Windows. You may also go to the Supermicro FTP site at ftp://ftp.super-

micro.com/Networking_Drivers/CDR-NIC_1.50_for_Add-on_NIC_Cards/

Mellanox/25GbE/Windows/.

2. Choose the desired Windows driver package le.

3. Double -click to run and install the executable (.exe ) le in the driver pack-

age.

4. The Install Shield Wizard will start .Follow the prompts to complete the instal-

lation.

3-4

Chapter 3: Installation

Firmware Update Procedures

Use the following procedures for updating the AOC-S25G-m2S add-on card rm-

ware for both the Linux and Windows operating systems.

Updating Firmware for the Linux Operating System

1. From the CDR-NIC LAN driver CD, go to the following directory: Mellanox

Firmware_Tool > Linux. You may also go to the Supermicro FTP site at ftp://

ftp.supermicro.com/Networking_Drivers/CDR-NIC_1.50_for_Add-on_NIC_

Cards/Mellanox/Firmware_Tool/Linux/.

2. Choose the MFT Linux package le and untar the package le.

3. Install the package by entering the following command:

cd mft–<ver>

./install.sh

4. Install the rmware by the following commands:

mst start

mst status *write down the pci_cr0 device name*

int –d <pci_cr0 device name> –i <rmware le name>.

bin burn

Updating Firmware for the Windows Operating System

1. From the CDR-NIC LAN driver CD, go to the following directory: Mellanox

Firmware_Tool > Linux. You may also go to the Supermicro FTP site at ftp://

ftp.supermicro.com/Networking_Drivers/CDR-NIC_1.50_for_Add-on_NIC_

Cards/Mellanox/Firmware_Tool/Windows/.

2. Choose the desired MFT Windows package le.

3. Double-click to run and install the MFT package le.

4. Open the DOS command prompt and locate the MFT folder.

3-5

AOC-S25G-m2S Add-on Card User's Guide

5. Install the rmware by entering the following commands:

mst start

mst status *write down the pci_cr0 device name*

int –d <pci_cr0 device name> –i <rmware le name>.

bin burn

3-6

(Disclaimer Continued)

The products sold by Supermicro are not intended for and will not be used in life support systems,
medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency com­munication devices or other critical systems whose failure to perform be reasonably expected to result

in signicant injury or loss of life or catastrophic property damage. Accordingly, Supermicro disclaims

any and all liability, and should buyer use or sell such products for use in such ultra-hazardous ap­plications, it does so entirely at its own risk. Furthermore, buyer agrees to fully indemnify, defend
and hold Supermicro harmless for and against any and all claims, demands, actions, litigation, and
proceedings of any kind arising out of or related to such ultra-hazardous use or sale.