Dell PowerEdge M805 User Manual

M2401G 24 Port 20Gb/s InfiniBand Switch

for the Dell M1000e Chassis User Manual

Rev 1.0

Mellanox Technologies

Mellanox Technologies, InfiniScale® is a registered trademark of Mellanox Technologies, Inc. All other marks and names mentioned herein may be trademarks of their respective companies.

M2401G 24 Port 20Gb/s InfiniBand Switch

Document Number: 2948

Mellanox Technologies, Inc. 2900 Stender Way Santa Clara, CA 95054 U.S.A.

www.Mellanox.com

Tel: (408) 970-3400 Fax: (408) 970-3403

Mellanox Technologies Ltd PO Box 586 Hermon Building Yokneam 20692 Israel

Tel: +972-4-909-7200 Fax: +972-4-959-3245

NOTE:

THIS INFORMATION IS PROVIDED BY MELLANOX FOR INFORMATIONAL PURPOSES ONLY AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSE QUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLI GENCE OR OTHERWISE) ARISING IN ANY WA Y OUT OF THE USE OF THIS HARDWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

Rev 1.0 Mellanox Technologies

M2401G 24 Port 20Gb/s InfiniBand Switch for the Dell M1000e Chassis User Manual

Contents 3 About this Manual 4 Revision History 6 Chapter 1 Overview 7 Chapter 2 Installation and Basic Operation 8

2.1 Switch Platform Hardware Overview 8

2.1.1 InfiniBand Connect ors 8

2.1.2 Switch Status Lights 9

2.2 Switch Platform Installation and Operation 10

2.2.1 Installation Safety Warnings 10

2.2.2 Mechanical Installation 11

2.2.2.1 Removing an Old Switch From the Chassis 12

2.2.2.2 Removing a Blank Cover Plate From the Chassis 12

2.2.2.3 Installing the Mellanox M2401G Switch Into the Dell Chassis 12

2.2.3 Power Connections and Initial Power On 13

2.2.4 InfiniBand Cable Installation 13

2.2.5 InfiniBand Optical Cable Installation 13

Chapter 3 Management Tools Overview 14

3.1 Updating Firmware 14

Chapter 4 Troubleshooting 15 Appendix A Specification 16

Appendix B Mechanical Drawing 17 Appendix C EMC Certification Statements 18 Appendix D InfiniBand Connector Pinout 20 Appendix E Local Authorization Form 21

Mellanox Technologies Rev 1.0

About this Manual

This manual describes the electrical and physical specifications of Mellanox Technologies’ M2401G 24 Port 20Gb/s InfiniBand Switch for the Dell M1000e Chassis.

Intended Audience

This manual is intended for users and system administrators responsible for installing and setting up the switch platforms listed above.

The manual assumes familiarity with the InfiniBand® Architecture Specification.

Related Documentation

The documentation set accompanying the Mellanox M2401G includes the following:

Table 1 - Reference Documents

InfiniBand Architecture Specification Volume 1 Release 1.2.1 and Volume 2 release 1.2.1

Mellanox Firmware Tools (MFT) User’s Manual Document # 2329

Online Resources

• Mellanox Technologies Web pages: http://www.mellanox.com

• Dell Support W eb pages: http://support.dell.com

Conventions

Throughout this manual, the name M2401G and the term switch are used to describe the 24-port 20Gb/s InfiniBand switch for the Dell M1000e, unless explicitly indicated otherwise.

Trademarks and Service M arks

InfiniBand architecture specification descriptions

The MFT (Mellanox Firmware Tools) package is a set of firmware tools. The manual supplied with this package provides an overview of the firmware its installation and replacement. The MFT can be down loaded with its documentation at:

http://www.mellanox.com under “Firmware” downloads.

The following are Mellanox Technologies registered trademarks:

InfiniHost®, ConnectX®, and InfiniScale

Rev 1.0 Mellanox Technologies

M2401G 24 Port 20Gb/s InfiniBand Switch for the Dell M1000e Chassis User Manual

Table 2 - Switch Products Covered in this User’s Manual

Product Number Description

M2401G 24 Port 20 Gb/s unmanaged switch including 8 external ports for the Dell M1000e chassis.

This product does not require Advanced Management.

Mellanox Technologies Rev 1.0

Revision History

Table 3 - Revision History Table

Date Revision Description

June 2008 Rev 1.0 First Draft

Rev 1.0 Mellanox Technologies

M2401G 24 Port 20Gb/s InfiniBand Switch for the Dell M1000e Chassis User Manual

1 Overview

This User’s Manual provides an overview of the M2401G 24-port 20Gb/s InfiniBand switch for the Dell M1000e. The switch supports 16 switch ports towards the midplane and 8 external port s. In addition to supporting passive copper InfiniBand cables, the external ports can provide power for supporting active cables and optical cables through the use of media adapters.

The switch supports 16 switch ports towards the midplane and 8 external ports. In add ition to supporting passive copper InfiniBand cables, the external ports can provide power for supporting active cables and optical cables through the use of media adapters.

The switch platform comes pre-installed with all necessary firmware, and configured for standard operation with InfiniBand fabric, and requires an InfiniBand compliant Subnet Manager running from one of the hosts. All that is required for normal operation is to follow the usual precautions for installation and connection from the switch to the HCAs or other switches. Once connected, the Subnet Management software automatically configures and begins utilizing the switch.

Maintenance and configuration of the switch is done in-band over the InfiniBand fabric using the Mellanox Technologies InfiniBand Administration (IBADM) tools package. This package provides the ability to upgrade firmware and monitor the temperature, voltage, port utilization, and other sta tus parameters in the switch.

Basic installation, hot-swapping components and hardware maintenance is covered in “Installa- tion and Basic Operation” on page 8.

The M2401G switch has a Hot Swap controller and a PSOC Management IC

Mellanox Technologies Rev 1.0

+ 15 hidden pages