The information in this User's Guide has been carefully reviewed and is believed to be accurate.
The vendor assumes no responsibility for any inaccuracies that may be contained in this document,
and makes no commitment to update or to keep current the information in this user's guide, or to
notify any person or organization of the updates. Please Note: For the most up-to-date version
of this user's guide, please see our Website at www.supermicro.com.
Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product
described in this user's guide at any time and without notice. This product, including software and
documentation, is the property of Supermicro and/or its licensors, and is supplied only under a
license. Any use or reproduction of this product is not allowed, except as expressly permitted by
the terms of said license.
IN NO EVENT WILL SUPER MICRO COMPUTER, INC. BE LIABLE FOR DIRECT, INDIRECT,
SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE
USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF
THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC.
SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED
WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING,
INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.
Any disputes arising between the manufacturer and the customer shall be governed by the laws of
Santa Clara County in the State of California, USA. The State of California, County of Santa Clara
shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for
all claims will not exceed the price paid for the hardware product.
FCC Statement: This equipment has been tested and found to comply with the limits for a Class
A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide
reasonable protection against harmful interference when the equipment is operated in a commercial
environment. This equipment generates, uses, and can radiate radio frequency energy and, if not
installed and used in accordance with the manufacturer’s instruction manual, may cause harmful
interference with radio communications. Operation of this equipment in a residential area is likely
to cause harmful interference, in which case you will be required to correct the interference at your
own expense.
California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate
warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate
Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate”.
WARNING: Handling of lead solder materials used in this
product may expose you to lead, a chemical known to
the State of California to cause birth defects and other
reproductive harm.
User's Guide Revision 1.0a
Release Date: December 5, 2014
Unless you request and receive written permission from Super Micro Computer, Inc., you may not
copy any part of this document.
Information in this document is subject to change without notice. Other products and companies
referred to herein are trademarks or registered trademarks of their respective companies or mark
holders.
Congratulations on purchasing your add-on card from an acknowledged leader in
the industry. Supermicro products are designed with the utmost attention to detail
to provide you with the highest standards in quality and performance. For product
support and updates, please refer to our website at http://www.supermicro.com/
products/nfo/networking.cfm#adapter.
1-2 Key Features
The key features of this add-on card include the following:
•Single QSFP (Quad Small Form Factor Pluggable) Connector
•Low-prole UIO Form Factor
•PCI Express 3.0 (up to 8GT/s)
•Virtual Protocol Interconnect (VPI)
•Up to 56Gbps InniBand or 40Gbps Ethernet
•CPU ofoad of transport operations
•Application ofoad
•GPU communication acceleration
•End-to-end QoS and congestion control
•Hardware-based I/O virtualization
•Ethernet encapsulation (EoIB)
•RoHS compliant 6/6
1-3 Specications General
•Mellanox
®
ConnectX-3 FDR controller
1-1
AOC-UIBF-m1 Add-on Card User's Guide
•Compact size UIO form factor
•Single QSFP port
•PCI-E 3.0 x8 (8GT/s) interface
Connectivity
•Interoperable with InniBand or 10/40GbE switches
•Passive copper cable with ESD protection
•Powered connectors for optical and active cable support
InniBand
•IBTA Specication 1.2.1 compliant
•Hardware-based congestion control
•16 million I/O channels
•256 to 4Kbyte MTU, 1Gbyte messages
Enhanced InniBand
•Hardware-based reliable transport
•Collective operations ofoads
•GPU communication acceleration
•Hardware-based reliable multicast
•Extended Reliable Connected transport
•Enhanced Atomic operations
Ethernet
•IEEE Std 802.3ae 10 Gigabit Ethernet
1-2
•IEEE Std 802.3ba 40 Gigabit Ethernet
•IEEE Std 802.3ad Link Aggregation and Failover
•IEEE Std 802.3az Energy Efcient Ethernet
•IEEE Std 802.1Q, .1p VLAN tags and priority
•IEEE Std 802.1Qau Congestion Notication
•IEEE P802.1Qaz D0.2 ETS
•IEEE P802.1Qbb D1.0 Priority-based Flow Control
•Jumbo frame support (9.6KB)
Hardware-based I/O Virtualization
•Single Root IOV
•Address translation and protection
•Dedicated adapter resources
Chapter 1: Overview
•Multiple queues per virtual machine
•Enhanced QoS for vNICs
•VMware NetQueue support
Manageability Features
•RDMA over Converged Ethernet
•TCP/UDP/IP stateless ofoad
•Intelligent interrupt coalescence
Flexboot™ Technology
•Remote boot over InniBand
1-3
AOC-UIBF-m1 Add-on Card User's Guide
•Remote boot over Ethernet
•Remote boot over iSCSI
Protocol Support
•Open MPI, OSU MVAPICH, Intel MPI, MS MPI, PLATFORM MPI
•TCP,UDP, EoIB, IPoIB, SDP, RDS
•SRP, iSER, NFS RDMA
•uDAPL
Operating Systems/Distributions
•Novell SLES, Red Hat Enterprise Linux (RHEL), and other Linux distributions
•Microsoft Windows Server 2008/CCS 2003, HPC Server 2008
•OpenFabrics Enterprise Distribution (OFED)
•OpenFabrics Windows Distribution (WinOF)
•VMware ESX Server 3.5, vSphere 4.0/4.1
Physical Dimensions
•Card PCB dimensions (without end brackets): 14.29cm (5.63in) x 6.35cm
(2.50in) (LxW)
•Height of end brackets: Standard - 12cm (4.73in), Low Prole - 7.94cm (3.13in)
Operating Condition
•Operating temperature: 0°C to 55°C (32°F to 131°F)
Compliance/Environmental
•RoHS Compliant 6/6, Pb Free
1-4
Supported Platforms
•Supermicro UIO Server Systems with UIO slot
Chapter 1: Overview
1-5
AOC-UIBF-m1 Add-on Card User's Guide
Notes
1-6
Chapter 2: Hardware Components
Chapter 2
Hardware Components
2-1 Add-On Card Image and Layout
The AOC-UIBF-m1 Image
1
2
The AOC-UIBF-m1 Layout
Mellanox
ConnectX-3 FDR
1
AOC-UIBF-M1
Rev. 1.0
2-2 Major Components
The following major components are installed on the AOC-UIBF-m1:
1. Mellanox ConnectX-3 FDR Controller
2. QSFP (Quad Small Form Factor Pluggable) Port
2-1
2
AOC-UIBF-m1 Add-on Card User's Guide
2-3 Connectors: QSPF Port and LEDs
QSFP Port
A single QSFP port is located on the
add-on card. Connect a QSFP cable to
the port to provide Inniband (56Gb/s)
and Ethernet (40Gbp/s) communica-
tion. Refer to the add-on card layout
on Page 2-1 for the location of the
QSPF port.
QSFP Port LEDs
Two LEDs are located to the right of
the QSFP port. A blinking yellow LED
on the top indicates activity. A solid
green, yellow or off LED on the bottom
indicates the type of link-up connec-
tion. See the table to the right for more
information.
Activity LED
Link LED
QSFP Port LEDs
LEDColorDenition
ActivityYellow
LinkYellowLogical Link-up
(Blinking)
GreenPhysical Link-up
OffNo Connection
Port activity
2-2
Chapter 3: Installation
Chapter 3
Installation
3-1 Static-Sensitive Devices
Electrostatic Discharge (ESD) can damage electronic com ponents. To avoid dam-
aging your add-on card, it is important to handle it very carefully. The following
measures are generally sufcient to protect your equipment from ESD.
Precautions
•Use a grounded wrist strap designed to prevent static discharge.
•Touch a grounded metal object before removing the add-on card from the
antistatic bag.
•Handle the add-on card by its edges only; do not touch its components, or
peripheral chips.
•Put the add-on card back into the antistatic bags when not in use.
•For grounding purposes, make sure that your system chassis provides excellent
conductivity between the power supply, the case, the mounting fasteners and
the add-on card.
Unpacking
The add-on card is shipped in antistatic packaging to avoid static damage. When
unpacking your component or your system, make sure that the person handling it
is static protected.
Warning: To avoid damaging your components and to ensure proper
installation, be sure to always connect the power cord last, and always
remove it before adding, removing or changing any hardware components.
3-1
AOC-UIBF-m1 Add-on Card User's Guide
3-2 Before Installation
To install the add-on card properly, be sure to follow the instructions below.
1. Power down the system.
2. Remove the power cord from the wall socket.
3. Use industry standard anti-static equipment (such as gloves or wrist strap)
and follow the instructions listed on Page 3-1 to avoid damage caused by
ESD.
4. Familiarize yourself with the server, motherboard, and/or chassis documenta-
tion.
5. Conrm that your operating system includes the latest updates and hotxes.
3-3 Installing the Add-on Card
Follow the steps below to install the add-on card into your system.
1. Remove the server cover and, if necessary, set aside any screws for later
use.
2. Remove the add-on card slot cover. If the case requires a screw, place the
screw aside for later use.
3. Position the add-on card in the slot directly over the connector, and gently
push down on both sides of the card until it slides into the PCI connector.
4. Secure the add-on card to the chassis. If required, use the screw that you
previously removed.
5. Attach any necessary external cables to the add-on card.
6. Replace the chassis cover.
7. Plug the power cord into the wall socket, and power up the system.
3-2
Chapter 3: Installation
3-4 Installing the Windows Operating System
Follow the steps below to install the drivers needed for your Windows OS support.
The controller comes with a driver on the CD-ROM CDR-NIC.
1. Run the CDR-NIC. (If you do not have a product CD-ROM, download drivers
from the Supermicro Support Website and then transfer them to your system.)
2. When the SUPERMICRO window appears, click on the computer icon next to
the product model.
Note: If the FOUND NEW HARDWARE WIZARD screen displays on your
system, click CANCEL.
3. Click on INSTALL DRIVERS AND SOFTWARE.
4. Follow the prompts to complete the installation.
3-5 Installing Drivers and Firmware
Use the procedures below to install both drivers and rmware for the AOC-UIBF-m1
add-on card for both Linux and Windows.
Linux Drivers
Use the following procedures for installing AOC-UIBF-m1 drivers for the Linux
operating system.
Installing InniBand Drivers for the Linux Operating System
1. From the CDR-NIC LAN driver CD or FTP site, go to the following directory:
Mellanox > InniBand > Linux.
3-3
AOC-UIBF-m1 Add-on Card User's Guide
2. Choose the InniBand Linux driver package le.
3. Install the driver by entering the following commands:
tar xzvf OFED–<ver>.tgz
cd OFED–<ver>
./install.pl
This installs the Linux drivers to your system.
Installing 10G Drivers for the Linux Operating System
1. From the CDR-NIC LAN driver CD or FTP site, go to the following directory:
Mellanox > ConnectX_EN > Linux.
2. Choose the 10G Linux driver package le.
3. Install the driver by entering the following commands:
tar xzvf mlnx_en–<ver>.tgz
cd mlnx_en–<ver>
./install.sh
This installs the 10G drivers to your system.
Windows Drivers
Use the following procedures for installing AOC-UIBF-m1 add-on card drivers for
the Windows operating system.
Installing InniBand Drivers for the Windows Operating System
1. From the CDR-NIC LAN driver CD or FTP site, go to the following directory:
Mellanox > InniBand > Windows.
2. Choose the desired InniBand Windows driver package le.
3. Double-click to run and install the driver package le.
3-4
Chapter 3: Installation
Installing 10G Drivers for the Windows Operating System
1. From the CDR-NIC LAN driver CD or FTP site, go to the following directory:
Mellanox > ConnectX_EN > Windows.
2. Choose the desired 10G Windows driver package le.
3. Double-click to run and install the driver package le.
Firmware Update Procedures
Use the following procedures for updating the AOC-UIBF-m1 add-on card rmware
for both the Linux and Windows operating systems.
Updating Firmware for the Linux Operating System
1. From the CDR-NIC LAN driver CD or FTP site, go to the following directory:
Mellanox > Firmware_Tool > Linux.
2. Choose the MFT Linux package le and untar the package le.
3. Install the package by entering the following command:
cd mft–<ver>
./install.sh
4. Install the rmware by the following commands:
mst start
mst status *write down the pci_cr0 device name*
int –d <pci_cr0 device name> –i <rmware le name>.bin b
Updating Firmware for the Windows Operating System
1. From the CDR-NIC LAN driver CD or FTP site, go to the following directory:
Mellanox > Firmware_Tool > Windows
2. Choose the desired MFT Windows package le.
3. Double-click to run and install the MFT package le.
3-5
AOC-UIBF-m1 Add-on Card User's Guide
4. Open the DOS command prompt and locate the MFT folder.
5. Install the rmware by entering the following commands:
mst start
mst status *write down the pci_cr0 device name*
int –d <pci_cr0 device name> –i <rmware le name>.bin b
3-6
(Disclaimer Continued)
The products sold by Supermicro are not intended for and will not be used in life support systems,
medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical systems whose failure to perform be reasonably expected to result
in signicant injury or loss of life or catastrophic property damage. Accordingly, Supermicro disclaims
any and all liability, and should buyer use or sell such products for use in such ultra-hazardous applications, it does so entirely at its own risk. Furthermore, buyer agrees to fully indemnify, defend
and hold Supermicro harmless for and against any and all claims, demands, actions, litigation, and
proceedings of any kind arising out of or related to such ultra-hazardous use or sale.
Loading...
+ hidden pages
You need points to download manuals.
1 point = 1 manual.
You can buy points or you can get point for every manual you upload.