Cisco Systems SFS 7000D User Manual

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

November 2006

Corporate Headquarters

Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000

800 553-NETS (6387)

Fax: 408 526-4100

Text Part Number: OL-10853-01

THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.

THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.

The following information is for FCC compliance of Class A devices: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part 15 of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio-frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case users will be required to correct the interference at their own expense.

The following information is for FCC compliance of Class B devices: The equipment described in this manual generates and may radiate radio-frequency energy. If it is not installed in accordance with Cisco’s installation instructions, it may cause interference with radio and television reception. This equipment has been tested and found to comply with the limits for a Class B digital device in accordance with the specifications in part 15 of the FCC rules. These specifications are designed to provide reasonable protection against such interference in a residential installation. However, there is no guarantee that interference will not occur in a particular installation.

Modifying the equipment without Cisco’s written authorization may result in the equipment no longer complying with FCC requirements for Class A or Class B digital devices. In that event, your right to use the equipment may be limited by FCC regulations, and you may be required to correct any interference to radio or television communications at your own expense.

You can determine whether your equipment is causing interference by turning it off. If the interference stops, it was probably caused by the Cisco equipment or one of its peripheral devices. If the equipment causes interference to radio or television reception, try to correct the interference by using one or more of the following measures:

• Turn the television or radio antenna until the interference stops.

• Move the equipment to one side or the other of the television or radio.

• Move the equipment farther away from the television or radio.

• Plug the equipment into an outlet that is on a different circuit from the television or radio. (That is, make certain the equipment and the television or radio are on circuits controlled by different circuit breakers or fuses.)

Modifications to this product not authorized by Cisco Systems, Inc. could void the FCC approval and negate your authority to operate the product.

The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain version of the UNIX operating system. All rights reserved. Copyright © 1981, Regents of the University of California.

NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS” WITH ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE.

IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

CCVP, the Cisco Logo, and the Cisco Square Bridge logo are trademarks of Cisco Systems, Inc.; Changing the Way We Work, Live, Play, and Learn is a service mark of Cisco Systems, Inc.; and Access Registrar, Aironet, BPX, Catalyst, CCDA, CCDP, CCIE, CCIP, CCNA, CCNP, CCSP, Cisco, the Cisco Certified Internetwork Expert logo, Cisco IOS, Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Cisco Unity, Enterprise/Solver, EtherChannel, EtherFast, EtherSwitch, Fast Step, Follow Me Browsing, FormShare, GigaDrive, GigaStack, HomeLink, Internet Quotient, IOS, iPhone, IP/TV, iQ Expertise, the iQ logo, iQ Net Readiness Scorecard, iQuick Study, LightStream, Linksys, MeetingPlace, MGX, Networking Academy, Network Registrar, Pack et , PIX, ProConnect, RateMUX, ScriptShare, SlideCast, SMARTnet, StackWise, The Fastest Way to Increase Your Internet Quotient, and TransPath are registered trademarks of Cisco Systems, Inc. and/or its affiliates in the United States and certain other countries.

All other trademarks mentioned in this document or Website are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any other company. (0612R)

Any Internet Protocol (IP) addresses used in this document are not intended to be actual addresses. Any examples, command display output, and figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses in illustrative content is unintentional and coincidental.

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

Audience vii

Organization vii

Conventions viii

Audience

Preface

This preface describes who should read the Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide, how it is organized, and its document conventions.

Only trained and qualified service personnel (as defined in IEC 60950 and AS/NZS3260) should install, replace, or service the equipment described in this publication.

Organization

This publication is organized as follows:

Chapter Title Description

Chapter 1 Product Overview Provides an overview of the

Chapter 2 Preparation for

Chapter 3 Installing the Switches Describes how to install the switches in a rack.

Chapter 4 Installing Field

Chapter 5 Managing the Switch Provides upgrade procedures for switch components.

Chapter 6 Hardware Diagnostic

Appendix A Specifications and

Appendix B Acronyms and

Installation

Replaceable Units

Tes ts

Compliance Certifications

Abbreviations

Cisco SFS 7000P and SFS 7000D Server Switches features.

Provides an overview about safety and site preparation requirements.

Describes how to install and remove field-replaceable units (FRUs) on the switches.

Describes how to monitor the performance of the switches.

Provides specifications and compliance information.

Defines the acronyms and abbreviations that are used in this publication.

OL-10853-01

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

vii

Conventions

This publication uses the following conventions:

Convention Description

boldface font Commands, command options, and keywords are in boldface.

italic font Arguments for which you supply values are in italics.

[ ] Elements in square brackets are optional.

{ x | y | z } Alternative keywords are grouped in braces and separated by vertical bars.

[ x | y | z ] Optional alternative keywords are grouped in brackets and separated by

string A nonquoted set of characters. Do not use quotation marks around the string

screen font Terminal sessions and information the system displays are in screen font.

boldface screen font Information you must enter is in boldface screen font.

italic screen font Arguments for which you supply values are in italic screen font.

^ The symbol ^ represents the key labeled Control. For example, the key

< > Nonprinting characters, such as passwords, are in angle brackets.

Preface

vertical bars.

or the string will include the quotation marks.

combination ^D in a screen display means hold down the Control key while you press the D key.

Notes use the following conventions:

Note Means reader take note. Notes contain helpful suggestions or references to material not covered in the

publication.

Cautions use the following conventions:

Caution Means reader be careful. In this situation, you might do something that could result in equipment

damage or loss of data.

viii

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

OL-10853-01

Preface

Conventions

Warnings use the following conventions:

Warning

Waarschuwing

Varoitus

IMPORTANT SAFETY INSTRUCTIONS

This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents. Use the statement number provided at the end of each warning to locate its translation in the translated safety warnings that accompanied this device.

Statement 1071

SAVE THESE INSTRUCTIONS

BELANGRIJKE VEILIGHEIDSINSTRUCTIES

Dit waarschuwingssymbool betekent gevaar. U verkeert in een situatie die lichamelijk letsel kan veroorzaken. Voordat u aan enige apparatuur gaat werken, dient u zich bewust te zijn van de bij elektrische schakelingen betrokken risico's en dient u op de hoogte te zijn van de standaard praktijken om ongelukken te voorkomen. Gebruik het nummer van de verklaring onderaan de waarschuwing als u een vertaling van de waarschuwing die bij het apparaat wordt geleverd, wilt raadplegen.

BEWAAR DEZE INSTRUCTIES

TÄRKEITÄ TURVALLISUUSOHJEITA

Tämä varoitusmerkki merkitsee vaaraa. Tilanne voi aiheuttaa ruumiillisia vammoja. Ennen kuin käsittelet laitteistoa, huomioi sähköpiirien käsittelemiseen liittyvät riskit ja tutustu onnettomuuksien yleisiin ehkäisytapoihin. Turvallisuusvaroitusten käännökset löytyvät laitteen mukana toimitettujen käännettyjen turvallisuusvaroitusten joukosta varoitusten lopussa näkyvien lausuntonumeroiden avulla.

Attention

Warnung

SÄILYTÄ NÄMÄ OHJEET

IMPORTANTES INFORMATIONS DE SÉCURITÉ

Ce symbole d'avertissement indique un danger. Vous vous trouvez dans une situation pouvant entraîner des blessures ou des dommages corporels. Avant de travailler sur un équipement, soyez conscient des dangers liés aux circuits électriques et familiarisez-vous avec les procédures couramment utilisées pour éviter les accidents. Pour prendre connaissance des traductions des avertissements figurant dans les consignes de sécurité traduites qui accompagnent cet appareil, référez-vous au numéro de l'instruction situé à la fin de chaque avertissement.

CONSERVEZ CES INFORMATIONS

WICHTIGE SICHERHEITSHINWEISE

Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut. Suchen Sie mit der am Ende jeder Warnung angegebenen Anweisungsnummer nach der jeweiligen Übersetzung in den übersetzten Sicherheitshinweisen, die zusammen mit diesem Gerät ausgeliefert wurden.

BEWAHREN SIE DIESE HINWEISE GUT AUF.

OL-10853-01

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

Conventions

Preface

Avvertenza

Advarsel

Aviso

IMPORTANTI ISTRUZIONI SULLA SICUREZZA

Questo simbolo di avvertenza indica un pericolo. La situazione potrebbe causare infortuni alle persone. Prima di intervenire su qualsiasi apparecchiatura, occorre essere al corrente dei pericoli relativi ai circuiti elettrici e conoscere le procedure standard per la prevenzione di incidenti. Utilizzare il numero di istruzione presente alla fine di ciascuna avvertenza per individuare le traduzioni delle avvertenze riportate in questo documento.

CONSERVARE QUESTE ISTRUZIONI

VIKTIGE SIKKERHETSINSTRUKSJONER

Dette advarselssymbolet betyr fare. Du er i en situasjon som kan føre til skade på person. Før du begynner å arbeide med noe av utstyret, må du være oppmerksom på farene forbundet med elektriske kretser, og kjenne til standardprosedyrer for å forhindre ulykker. Bruk nummeret i slutten av hver advarsel for å finne oversettelsen i de oversatte sikkerhetsadvarslene som fulgte med denne enheten.

TA VARE PÅ DISSE INSTRUKSJONENE

INSTRUÇÕES IMPORTANTES DE SEGURANÇA

Este símbolo de aviso significa perigo. Você está em uma situação que poderá ser causadora de lesões corporais. Antes de iniciar a utilização de qualquer equipamento, tenha conhecimento dos perigos envolvidos no manuseio de circuitos elétricos e familiarize-se com as práticas habituais de prevenção de acidentes. Utilize o número da instrução fornecido ao final de cada aviso para localizar sua tradução nos avisos de segurança traduzidos que acompanham este dispositivo.

¡Advertencia!

Varning !

GUARDE ESTAS INSTRUÇÕES

INSTRUCCIONES IMPORTANTES DE SEGURIDAD

Este símbolo de aviso indica peligro. Existe riesgo para su integridad física. Antes de manipular cualquier equipo, considere los riesgos de la corriente eléctrica y familiarícese con los procedimientos estándar de prevención de accidentes. Al final de cada advertencia encontrará el número que le ayudará a encontrar el texto traducido en el apartado de traducciones que acompaña a este dispositivo.

GUARDE ESTAS INSTRUCCIONES

VIKTIGA SÄKERHETSANVISNINGAR

Denna varningssignal signalerar fara. Du befinner dig i en situation som kan leda till personskada. Innan du utför arbete på någon utrustning måste du vara medveten om farorna med elkretsar och känna till vanliga förfaranden för att förebygga olyckor. Använd det nummer som finns i slutet av varje varning för att hitta dess översättning i de översatta säkerhetsvarningar som medföljer denna anordning.

SPARA DESSA ANVISNINGAR

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

OL-10853-01

Preface

Conventions

OL-10853-01

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

Conventions

Preface

Aviso

Advarsel

INSTRUÇÕES IMPORTANTES DE SEGURANÇA

Este símbolo de aviso significa perigo. Você se encontra em uma situação em que há risco de lesões corporais. Antes de trabalhar com qualquer equipamento, esteja ciente dos riscos que envolvem os circuitos elétricos e familiarize-se com as práticas padrão de prevenção de acidentes. Use o número da declaração fornecido ao final de cada aviso para localizar sua tradução nos avisos de segurança traduzidos que acompanham o dispositivo.

GUARDE ESTAS INSTRUÇÕES

VIGTIGE SIKKERHEDSANVISNINGER

Dette advarselssymbol betyder fare. Du befinder dig i en situation med risiko for legemesbeskadigelse. Før du begynder arbejde på udstyr, skal du være opmærksom på de involverede risici, der er ved elektriske kredsløb, og du skal sætte dig ind i standardprocedurer til undgåelse af ulykker. Brug erklæringsnummeret efter hver advarsel for at finde oversættelsen i de oversatte advarsler, der fulgte med denne enhed.

GEM DISSE ANVISNINGER

xii

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

OL-10853-01

Preface

Conventions

OL-10853-01

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

xiii

Obtaining Documentation

Cisco documentation and additional literature are available on Cisco.com. This section explains the product documentation resources that Cisco offers.

Cisco.com

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

xiv

You can access the most current Cisco documentation at this URL:

http://www.cisco.com/techsupport

You can access the Cisco website at this URL:

http://www.cisco.com

OL-10853-01

Preface

You can access international Cisco websites at this URL:

http://www.cisco.com/public/countries_languages.shtml

Product Documentation DVD

The Product Documentation DVD is a library of technical product documentation on a portable medium. The DVD enables you to access installation, configuration, and command guides for Cisco hardware and software products. With the DVD, you have access to the HTML documentation and some of the PDF files found on the Cisco website at this URL:

http://www.cisco.com/univercd/home/home.htm

The Product Documentation DVD is created and released regularly. DVDs are available singly or by subscription. Registered Cisco.com users can order a Product Documentation DVD (product number DOC-DOCDVD= or DOC-DOCDVD=SUB) from Cisco Marketplace at the Product Documentation Store at this URL:

http://www.cisco.com/go/marketplace/docstore

Documentation Feedback

Ordering Documentation

You must be a registered Cisco.com user to access Cisco Marketplace. Registered users may order Cisco documentation at the Product Documentation Store at this URL:

http://www.cisco.com/go/marketplace/docstore

If you do not have a user ID or password, you can register at this URL:

http://tools.cisco.com/RPF/register/register.do

Documentation Feedback

You can provide feedback about Cisco technical documentation on the Cisco Technical Support & Documentation site area by entering your comments in the feedback form available in every online document.

Cisco Product Security Overview

Cisco provides a free online Security Vulnerability Policy portal at this URL:

http://www.cisco.com/en/US/products/products_security_vulnerability_policy.html

From this site, you will find information about how to do the following:

• Report security vulnerabilities in Cisco products

OL-10853-01

• Obtain assistance with security incidents that involve Cisco products

• Register to receive security information from Cisco

A current list of security advisories, security notices, and security responses for Cisco products is available at this URL:

http://www.cisco.com/go/psirt

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

Product Alerts and Field Notices

To see security advisories, security notices, and security responses as they are updated in real time, you can subscribe to the Product Security Incident Response Team Really Simple Syndication (PSIRT RSS) feed. Information about how to subscribe to the PSIRT RSS feed is found at this URL:

http://www.cisco.com/en/US/products/products_psirt_rss_feed.html

Reporting Security Problems in Cisco Products

Cisco is committed to delivering secure products. We test our products internally before we release them, and we strive to correct all vulnerabilities quickly. If you think that you have identified a vulnerability in a Cisco product, contact PSIRT:

• For emergencies only—security-alert@cisco.com

An emergency is either a condition in which a system is under active attack or a condition for which a severe and urgent security vulnerability should be reported. All other conditions are considered nonemergencies.

• For nonemergencies —psirt@cisco.com

In an emergency, you can also reach PSIRT by telephone:

• 1 877 228-7302

• 1 408 525-6532

Preface

Tip We encourage you to use Pretty Good Privacy (PGP) or a compatible product (for example, GnuPG) to

encrypt any sensitive information that you send to Cisco. PSIRT can work with information that has been encrypted with PGP versions 2.x through 9.x.

Never use a revoked encryption key or an expired encryption key. The correct public key to use in your correspondence with PSIRT is the one linked in the Contact Summary section of the Security Vulnerability Policy page at this URL:

http://www.cisco.com/en/US/products/products_security_vulnerability_policy.html

The link on this page has the current PGP key ID in use.

If you do not have or use PGP, contact PSIRT to find other means of encrypting the data before sending any sensitive material.

Product Alerts and Field Notices

Modifications to or updates about Cisco products are announced in Cisco Product Alerts and Cisco Field Notices. You can receive Cisco Product Alerts and Cisco Field Notices by using the Product Alert Tool on Cisco.com. This tool enables you to create a profile and choose those products for which you want to receive information.

To access the Product Alert Tool, you must be a registered Cisco.com user. (To register as a Cisco.com user, go to this URL: http://tools.cisco.com/RPF/register/register.do) Registered users can access the tool at this URL: http://tools.cisco.com/Support/PAT/do/ViewMyProfiles.do?local=en

xvi

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

OL-10853-01

Preface

Obtaining Technical Assistance

Cisco Technical Support provides 24-hour-a-day award-winning technical assistance. The Cisco Technical Support & Documentation website on Cisco.com features extensive online support resources. In addition, if you have a valid Cisco service contract, Cisco Technical Assistance Center (TAC) engineers provide telephone support. If you do not have a valid Cisco service contract, contact your reseller.

Cisco Technical Support & Documentation Website

The Cisco Technical Support & Documentation website provides online documents and tools for troubleshooting and resolving technical issues with Cisco products and technologies. The website is available 24 hours a day at this URL:

http://www.cisco.com/techsupport

Access to all tools on the Cisco Technical Support & Documentation website requires a Cisco.com user ID and password. If you have a valid service contract but do not have a user ID or password, you can register at this URL:

Obtaining Technical Assistance

http://tools.cisco.com/RPF/register/register.do

Note Use the Cisco Product Identification Tool to locate your product serial number before submitting a

request for service online or by phone. You can access this tool from the Cisco Technical Support & Documentation website by clicking the Tools & Resources link, clicking the All Tools (A-Z) tab, and then choosing Cisco Product Identification Tool from the alphabetical list. This tool offers three search options: by product ID or model name; by tree view; or, for certain products, by copying and pasting show command output. Search results show an illustration of your product with the serial number label location highlighted. Locate the serial number label on your product and record the information before placing a service call.

Tip Displaying and Searching on Cisco.com

If you suspect that the browser is not refreshing a web page, force the browser to update the web page by holding down the Ctrl key while pressing F5.

To find technical information, narrow your search to look in technical documentation, not the entire Cisco.com website. On the Cisco.com home page, click the Advanced Search link under the Search box and then click the Technical Support & Documentation radio button.

To provide feedback about the Cisco.com website or a particular technical document, click Contacts & Feedback at the top of any Cisco.com web page.

OL-10853-01

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

xvii

Obtaining Additional Publications and Information

Submitting a Service Request

Using the online TAC Service Request Tool is the fastest way to open S3 and S4 service requests. (S3 and S4 service requests are those in which your network is minimally impaired or for which you require product information.) After you describe your situation, the TAC Service Request Tool provides recommended solutions. If your issue is not resolved using the recommended resources, your service request is assigned to a Cisco engineer. The TAC Service Request Tool is located at this URL:

http://www.cisco.com/techsupport/servicerequest

For S1 or S2 service requests, or if you do not have Internet access, contact the Cisco TAC by telephone. (S1 or S2 service requests are those in which your production network is down or severely degraded.) Cisco engineers are assigned immediately to S1 and S2 service requests to help keep your business operations running smoothly.

To open a service request by telephone, use one of the following numbers:

Asia-Pacific: +61 2 8446 7411 Australia: 1 800 805 227 EMEA: +32 2 704 55 55 USA: 1 800 553 2447

For a complete list of Cisco TAC contacts, go to this URL:

http://www.cisco.com/techsupport/contacts

Preface

Definitions of Service Request Severity

To ensure that all service requests are reported in a standard format, Cisco has established severity definitions.

Severity 1 (S1)—An existing network is “down” or there is a critical impact to your business operations. You and Cisco will commit all necessary resources around the clock to resolve the situation.

Severity 2 (S2)—Operation of an existing network is severely degraded, or significant aspects of your business operations are negatively affected by inadequate performance of Cisco products. You and Cisco will commit full-time resources during normal business hours to resolve the situation.

Severity 3 (S3)—Operational performance of the network is impaired while most business operations remain functional. You and Cisco will commit resources during normal business hours to restore service to satisfactory levels.

Severity 4 (S4)—You require information or assistance with Cisco product capabilities, installation, or configuration. There is little or no effect on your business operations.

Obtaining Additional Publications and Information

Information about Cisco products, technologies, and network solutions is available from various online and printed sources.

• The Cisco Online Subscription Center is the website where you can sign up for a variety of

Cisco e-mail newsletters and other communications. Create a profile and then select the subscriptions that you would like to receive. To visit the Cisco Online Subscription Center, go to this URL:

http://www.cisco.com/offer/subscribe

xviii

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

OL-10853-01

Preface

Obtaining Additional Publications and Information

• The Cisco Product Quick Reference Guide is a handy, compact reference tool that includes brief

product overviews, key features, sample part numbers, and abbreviated technical specifications for many Cisco products that are sold through channel partners. It is updated twice a year and includes the latest Cisco channel product offerings. To order and find out more about the Cisco Product Quick Reference Guide, go to this URL:

http://www.cisco.com/go/guide

• Cisco Marketplace provides a variety of Cisco books, reference guides, documentation, and logo

merchandise. Visit Cisco Marketplace, the company store, at this URL:

http://www.cisco.com/go/marketplace/

• Cisco Press publishes a wide range of general networking, training, and certification titles. Both new

and experienced users will benefit from these publications. For current Cisco Press titles and other information, go to Cisco Press at this URL:

http://www.ciscopress.com

• Internet Protocol Journal is a quarterly journal published by Cisco Systems for engineering

professionals involved in designing, developing, and operating public and private internets and intranets. You can access the Internet Protocol Journal at this URL:

http://www.cisco.com/ipj

• Networking products offered by Cisco Systems, as well as customer support services, can be

obtained at this URL:

http://www.cisco.com/en/US/products/index.html

• Networking Professionals Connection is an interactive website where networking professionals

share questions, suggestions, and information about networking products and technologies with Cisco experts and other networking professionals. Join a discussion at this URL:

http://www.cisco.com/discuss/networking

• “What’s New in Cisco Documentation” is an online publication that provides information about the

latest documentation releases for Cisco products. Updated monthly, this online publication is organized by product category to direct you quickly to the documentation for your products. You can view the latest release of “What’s New in Cisco Documentation” at this URL:

http://www.cisco.com/univercd/cc/td/doc/abtunicd/136957.htm

• World-class networking training is available from Cisco. You can view current offerings at

this URL:

http://www.cisco.com/en/US/learning/index.html

OL-10853-01

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

xix

Obtaining Additional Publications and Information

Preface

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

OL-10853-01

Product Overview

The Cisco SFS 7000P and SFS 7000D Server Switches provide high-class data center infrastructure that interconnect discreet server resources together into high-performance, low-latency fabric switches.

The Cisco SFS 7000P and SFS 7000D Server Switches are described in the following sections:

• Introduction to Switches, page 1-1

• Switch Connectors, page 1-2

• Switch Components, page 1-2

• System Features, page 1-3

• Administrative Features, page 1-5

Introduction to Switches

CHA PT ER

The Cisco SFS 7000P and SFS 7000D Server Switches offer features that are described in the following sections. Figure 1-1 shows an illustration of the Cisco SFS 7000P Server Switch, and Figure 1-2 shows an illustration of the Cisco SFS 7000D Server Switch.

Figure 1-1 Cisco SFS 7000P Server Switch

w e

r S

Power Supply

154903

OL-10853-01

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

1-1

Switch Connectors

Figure 1-2 Cisco SFS 7000D Server Switch

Switch Connectors

The Cisco SFS 7000P Server Switch uses the following connectors:

• Twenty-four 10-Gbps 4x copper InfiniBand ports for server and interswitch connectivity

Chapter 1 Product Overview

Power Supply

180600

• One 10/100 Ethernet RJ-45 management-Ethernet port for out-of-band management

• One RJ-45 console port used to configure and monitor the Cisco SFS 7000P Server Switch

The Cisco SFS 7000D Server Switch uses the following connectors:

• Twenty-four dual-speed 20-Gbps 4x copper InfiniBand ports that are capable of operating in either

20-Gbps DDR or 10-Gbps SDR mode for server and interswitch connectivity

• One 10/100 Ethernet RJ-45 management-Ethernet port for out-of-band management

• One RJ-45 console port used to configure and monitor the Cisco SFS 7000D Server Switch

Note There is a performance degradation if you mix 10-Gbps and 20-Gbps InfiniBand ports.

Switch Components

This section describes the following components of the Cisco SFS 7000P and SFS 7000D Server Switches and contains these sections:

• LEDs, page 1-3

• Power Supply Bay, page 1-3

• Power Supply Module, page 1-3

1-2

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

OL-10853-01

Chapter 1 Product Overview

LEDs

The Cisco SFS 7000P and SFS 7000D Server Switches feature the following LEDs:

• Chassis LEDs—Show overall system status, power status, and fan status. LEDs and their use are

described in the “Chassis Status LEDs” section on page 5-1.

• InfiniBand Port LEDs—Show link status, diagnostics, and network traffic. LEDs and their uses are

described in the “InfiniBand Port LEDs” section on page 5-3.

Power Supply Bay

The chassis provides dual independent IEC connectors that are left- and right-justified.

Power Supply Module

The power supply module, which contains the power supply and fan unit, has the following features:

• Redundant and hot-swappable— The replacement of any one power supply module does not disrupt

the operation of the device and can be successfully completed without removing the device from a rack or disconnecting any cables.

System Features

• Auto-ranging 90 to 264 VAC, 47 to 63 Hz.

• Redundant, hot-swappable cooling.

See the “Installing a Power Supply Module” section on page 4-2 for more information.

System Features

This section describes the system features of the Cisco SFS 7000P and SFS 7000D Server Switches and includes the following topics:

• InfiniBand Connectivity, page 1-3

• Scalability, page 1-4

• High Availability, page 1-4

• Nonblocking Architecture, page 1-5

InfiniBand Connectivity

The Cisco SFS 7000P and SFS 7000D Server Switches can be used in a variety of networking environments, including database tiers, application tiers, and World Wide Web tiers.

The Cisco SFS 7000P Server Switch provides 10 Gbps connectivity to servers, while the Cisco SFS 7000D Server Switch provides 20 Gbps DDR or 10 Gbps SDR modes for connectivity to servers.

OL-10853-01

Note Copper passive DDR cables are limited to 8 meters in length. If you want to use a longer SDR cable in

place of a DDR cable, the port must be comfigured manually to run an SDR rate.

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

1-3

System Features

Scalability

The embedded subnet manager running on the Cisco SFS 7000P and SFS 7000D Server Switches can manage up to 1,152 hosts.

High Availability

High availability operates at the hardware, port, and fabric level. These features are described below.

Hardware

High availability at the hardware level means that the Cisco SFS 7000P and SFS 7000D Server Switches feature hot-swappable redundant power and cooling.

Ports

High availability is supported at the ports level such that if any single InfiniBand port fails, none of the other ports have interrupted service.

Chapter 1 Product Overview

Fabric

High availability is supported at the fabric level as well. For redundancy, InfiniBand HCAs can be dual-connected to a redundant pair of switches.

When an InfiniBand fabric includes more than one Cisco SFS 7000P Server Switch or Cisco SFS 7000D Server Switch, and the subnet manager fails on the Cisco SFS 7000P Server Switch or the Cisco SFS 7000D Server Switch that is acting as the master, another subnet manager takes over within seconds. (See Figure 1-3.)

Figure 1-3 Example of Redundant InfiniBand Fabric

IB Host 1 IB Host 2

HCA HCA

InfiniBand

Chassis A

Switch 1 Switch 1

InfiniBand connections

EN mgmt

ports

EN mgmt

ports

InfiniBand Chassis B

154001

1-4

Note A performance degradation occurs if you mix 10-Gbps and 20-Gbps InfiniBand ports.

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

OL-10853-01

+ 56 hidden pages

Cisco Systems SFS 7000D User Manual

Cisco SFS 7000P and SFS 7000D InfiniBand Server Switches Hardware Installation Guide

Audience

Preface

Organization

Conventions

Related Documentation

Obtaining Documentation

Cisco.com

Product Documentation DVD

Documentation Feedback

Ordering Documentation

Product Alerts and Field Notices

Obtaining Technical Assistance

Obtaining Additional Publications and Information

Submitting a Service Request

Definitions of Service Request Severity

Product Overview

Introduction to Switches

Switch Connectors

Switch Components

LEDs

Power Supply Bay

Power Supply Module

System Features

InfiniBand Connectivity

Scalability

High Availability

Hardware

Ports

Fabric