Cisco Systems SFS 3012R User Manual

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

Release 2.8.0

Corporate Headquarters

Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000

800 553-NETS (6387)

Fax: 408 526-4100

Text Part Number: OL-11187-01

THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.

THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.

The following inform ation is for FCC compliance of Class A devices: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part 15 of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio-frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case users will be required to correct the interference at their own expense.

The following information is for FCC compliance of Class B devices: The equipment described in this manual generates and may radiate radio-frequency energy. If it is not installed in accordance with Cisco’s installation instructions, it may cause interference with radio and television reception. This equipment has been tested and found to comply with the limits for a Class B digital device in accordance with the specifications in part 15 of the FCC rules. These specifications are designed to provide reasonable protection against such interference in a residential installation. However, there is no guarantee that interference will not occur in a particular installation.

Modifying the equipment without Cisco’s written authorization may result in the equipment no longer complying with FCC requirements for Class A or Class B digital devices. In that event, your right to use the equipment may be limited by FCC regulations, and you may be required to correct any interference to radio or television communications at your own expense.

You can determine whether your equipment is causing interference by turning it off. If the interference stops, it was probably caused by the Cisco equipment or one of its peripheral devices. If the equipment causes interference to radio or television reception, try to correct the interference by using one or more of the following measures:

• Turn the television or radio antenna until the interference stops.

• Move the equipment to one side or the other of the television or radio.

• Move the equipment farther away from the television or radio.

• Plug the equipment into an outlet that is on a different circuit from the television or radio. (That is, make certain the equipment and the television or radio are on circuits controlled by different circuit breakers or fuses.)

Modifications to this product not authorized by Cisco Systems, Inc. could void the FCC approval and negate your authority to operate the product.

The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain version of the UNIX operating system. All rights reserved. Copyright © 1981, Regents of the University of California.

NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS” WITH ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE.

IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

Any Internet Protocol (IP) addresses used in this document are not intended to be actual addresses. Any examples, command display output, and figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses in illustrative content is unintentional and coincidental.

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

Preface vii

Audience vii

Organization vii

Conventions viii

Statement 1071—Warning Definition ix

Preface

Audience

The intended audience is the administrator responsible for installing, configuring, and managing server switch equipment. This administrator should have experience administering similar networking or storage equipment.

Organization

This publication is organized as follows:

Chapter Title Description

Chapter 1 Cisco SFS 3012R Server Switch

Overview

Chapter 2 Installing and Booting the

Cisco SFS 3012R Server Switch

Chapter 3 Installing and Removing Server

Switch Field Replaceable Units (FRUs)

Chapter 4 Viewing and Updating the

Software Image

Chapter 5 Cisco SFS 3012R Server Switch

LEDs

Appendix A Specifications and Compliance Provides details about product

Describes the server switch features including its performance, topology, availability, and scalability. Introduces the components that populate the chassis.

Provides step-by-step procedures for installing and booting the Cisco SFS 3012R Server Switch.

Provides installation and removal instructions for field replaceable units (FRUs) such as controller modules, expansion modules, InfiniBand switch modules, power modules, and blower modules.

Provides step-by-step procedures for viewing and updating the software image on all modules in the Cisco SFS 3012R Server Switch.

Explains the LEDs.

specifications and compliance certifications.

OL-11187-01

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

vii

Conventions

This document uses the following conventions:

Convention Description

boldface font Commands, command options, and keywords are in

boldface. Bold text indicates text that you must enter as-is.

italic font Arguments in commands for which you supply values are in

italics. Italics not used in commands indicate emphasis.

Menu1 > Menu2 > Item…

[ ] Elements in square brackets are optional.

{ x | y | z } Alternative keywords are grouped in braces and separated by

[ x | y | z ] Optional alternative keywords are grouped in brackets and

string A nonquoted set of characters. Do not use quotation marks

screen font Terminal sessions and information the system displays are in

boldface screen

font

italic screen font Arguments for which you supply values are in italic screen

^ The symbol ^ represents the key labeled Control—for

< > Nonprinting characters, such as passwords are in angle

[ ] Default responses to system prompts are in square brackets.

!, # An exclamation point (!) or a pound sign (#) at the beginning

Series indicate a pop-up menu sequence to open a form or execute a desired function.

vertical bars. Braces can also be used to group keywords and/or arguments; for example, {interface interface type}.

separated by vertical bars.

around the string or the string will include the quotation marks.

screen font.

Information you must enter is in boldface screen font.

font.

example, the key combination ^D in a screen display means hold down the Control key while you press the D key.

brackets.

of a line of code indicates a comment line.

Preface

viii

Notes use the following conventions:

Note Means reader take note. Notes contain helpful suggestions or references to material not covered in

the publication.

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

OL-11187-01

Preface

Cautions use the following conventions:

Caution Means reader be careful. In this situation, you might do something that could result in equipment

damage or loss of data.

Statement 1071—Warning Definition

This section repeats in multiple languages the basic warning appropriate for the Cisco SFS 3012R Server Switch. Refer to the Regulatory Compliance and Safety Information for the Cisco SFS 7000P, SFS 7008P, and SFS 3012R Switches for translations of all warning messages.

Conventions

Warning

Waarschuwing

Varoitus

IMPORTANT SAFETY INSTRUCTIONS

This warning symbol means danger. You are in a situation that could cause bodily injury. Before you work on any equipment, be aware of the hazards involved with electrical circuitry and be familiar with standard practices for preventing accidents. Use the statement number provided at the end of each warning to locate its translation in the translated safety warnings that accompanied this device.

SAVE THESE INSTRUCTIONS

BELANGRIJKE VEILIGHEIDSINSTRUCTIES

Dit waarschuwingssymbool betekent gevaar. U verkeert in een situatie die lichamelijk letsel kan veroorzaken. Voordat u aan enige apparatuur gaat werken, dient u zich bewust te zijn van de bij elektrische schakelingen betrokken risico's en dient u op de hoogte te zijn van de standaard praktijken om ongelukken te voorkomen. Gebruik het nummer van de verklaring onderaan de waarschuwing als u een vertaling van de waarschuwing die bij het apparaat wordt geleverd, wilt raadplegen.

BEWAAR DEZE INSTRUCTIES

TÄRKEITÄ TURVALLISUUSOHJEITA

Tämä varoitusmerkki merkitsee vaaraa. Tilanne voi aiheuttaa ruumiillisia vammoja. Ennen kuin käsittelet laitteistoa, huomioi sähköpiirien käsittelemiseen liittyvät riskit ja tutustu onnettomuuksien yleisiin ehkäisytapoihin. Turvallisuusvaroitusten käännökset löytyvät laitteen mukana toimitettujen käännettyjen turvallisuusvaroitusten joukosta varoitusten lopussa näkyvien lausuntonumeroiden avulla.

OL-11187-01

SÄILYTÄ NÄMÄ OHJEET

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

Conventions

Preface

Attention

Warnung

Avvertenza

IMPORTANTES INFORMATIONS DE SÉCURITÉ

Ce symbole d'avertissement indique un danger. Vous vous trouvez dans une situation pouvant entraîner des blessures ou des dommages corporels. Avant de travailler sur un équipement, soyez conscient des dangers liés aux circuits électriques et familiarisez-vous avec les procédures couramment utilisées pour éviter les accidents. Pour prendre connaissance des traductions des avertissements figurant dans les consignes de sécurité traduites qui accompagnent cet appareil, référez-vous au numéro de l'instruction situé à la fin de chaque avertissement.

CONSERVEZ CES INFORMATIONS

WICHTIGE SICHERHEITSHINWEISE

Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut. Suchen Sie mit der am Ende jeder Warnung angegebenen Anweisungsnummer nach der jeweiligen Übersetzung in den übersetzten Sicherheitshinweisen, die zusammen mit diesem Gerät ausgeliefert wurden.

BEWAHREN SIE DIESE HINWEISE GUT AUF.

IMPORTANTI ISTRUZIONI SULLA SICUREZZA

Questo simbolo di avvertenza indica un pericolo. La situazione potrebbe causare infortuni alle persone. Prima di intervenire su qualsiasi apparecchiatura, occorre essere al corrente dei pericoli relativi ai circuiti elettrici e conoscere le procedure standard per la prevenzione di incidenti. Utilizzare il numero di istruzione presente alla fine di ciascuna avvertenza per individuare le traduzioni delle avvertenze riportate in questo documento.

Advarsel

Aviso

CONSERVARE QUESTE ISTRUZIONI

VIKTIGE SIKKERHETSINSTRUKSJONER

Dette advarselssymbolet betyr fare. Du er i en situasjon som kan føre til skade på person. Før du begynner å arbeide med noe av utstyret, må du være oppmerksom på farene forbundet med elektriske kretser, og kjenne til standardprosedyrer for å forhindre ulykker. Bruk nummeret i slutten av hver advarsel for å finne oversettelsen i de oversatte sikkerhetsadvarslene som fulgte med denne enheten.

TA VARE PÅ DISSE INSTRUKSJONENE

INSTRUÇÕES IMPORTANTES DE SEGURANÇA

Este símbolo de aviso significa perigo. Você está em uma situação que poderá ser causadora de lesões corporais. Antes de iniciar a utilização de qualquer equipamento, tenha conhecimento dos perigos envolvidos no manuseio de circuitos elétricos e familiarize-se com as práticas habituais de prevenção de acidentes. Utilize o número da instrução fornecido ao final de cada aviso para localizar sua tradução nos avisos de segurança traduzidos que acompanham este dispositivo.

GUARDE ESTAS INSTRUÇÕES

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

OL-11187-01

Preface

Conventions

¡Advertencia!

Varning!

INSTRUCCIONES IMPORTANTES DE SEGURIDAD

Este símbolo de aviso indica peligro. Existe riesgo para su integridad física. Antes de manipular cualquier equipo, considere los riesgos de la corriente eléctrica y familiarícese con los procedimientos estándar de prevención de accidentes. Al final de cada advertencia encontrará el número que le ayudará a encontrar el texto traducido en el apartado de traducciones que acompaña a este dispositivo.

GUARDE ESTAS INSTRUCCIONES

VIKTIGA SÄKERHETSANVISNINGAR

Denna varningssignal signalerar fara. Du befinner dig i en situation som kan leda till personskada. Innan du utför arbete på någon utrustning måste du vara medveten om farorna med elkretsar och känna till vanliga förfaranden för att förebygga olyckor. Använd det nummer som finns i slutet av varje varning för att hitta dess översättning i de översatta säkerhetsvarningar som medföljer denna anordning.

SPARA DESSA ANVISNINGAR

OL-11187-01

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

Conventions

Preface

Aviso

Advarsel

INSTRUÇÕES IMPORTANTES DE SEGURANÇA

Este símbolo de aviso significa perigo. Você se encontra em uma situação em que há risco de lesões corporais. Antes de trabalhar com qualquer equipamento, esteja ciente dos riscos que envolvem os circuitos elétricos e familiarize-se com as práticas padrão de prevenção de acidentes. Use o número da declaração fornecido ao final de cada aviso para localizar sua tradução nos avisos de segurança traduzidos que acompanham o dispositivo.

GUARDE ESTAS INSTRUÇÕES

VIGTIGE SIKKERHEDSANVISNINGER

Dette advarselssymbol betyder fare. Du befinder dig i en situation med risiko for legemesbeskadigelse. Før du begynder arbejde på udstyr, skal du være opmærksom på de involverede risici, der er ved elektriske kredsløb, og du skal sætte dig ind i standardprocedurer til undgåelse af ulykker. Brug erklæringsnummeret efter hver advarsel for at finde oversættelsen i de oversatte advarsler, der fulgte med denne enhed.

GEM DISSE ANVISNINGER

xii

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

OL-11187-01

Preface

Conventions

OL-11187-01

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

xiii

Obtaining Documentation

Cisco documentation and additional literature are available on Cisco.com. This section explains the product documentation resources that Cisco offers.

Cisco.com

You can access the most current Cisco documentation at this URL:

http://www.cisco.com/techsupport

Obtaining Documentation

You can access the Cisco website at this URL:

http://www.cisco.com

You can access international Cisco websites at this URL:

http://www.cisco.com/public/countries_languages.shtml

Product Documentation DVD

The Product Documentation DVD is a library of technical product documentation on a portable medium. The DVD enables you to access installation, configuration, and command guides for Cisco hardware and software products. With the DVD, you have access to the HTML documentation and some of the PDF files found on the Cisco website at this URL:

http://www.cisco.com/univercd/home/home.htm

The Product Documentation DVD is created and released regularly. DVDs are available singly or by subscription. Registered Cisco.com users can order a Product Documentation DVD (product number DOC-DOCDVD= or DOC-DOCDVD=SUB) from Cisco Marketplace at the Product Documentation Store at this URL:

http://www.cisco.com/go/marketplace/docstore

Ordering Documentation

OL-11187-01

You must be a registered Cisco.com user to access Cisco Marketplace. Registered users may order Cisco documentation at the Product Documentation Store at this URL:

http://www.cisco.com/go/marketplace/docstore

If you do not have a user ID or password, you can register at this URL:

http://tools.cisco.com/RPF/register/register.do

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

Documentation Feedback

You can provide feedback about Cisco technical documentation on the Cisco Technical Support & Documentation site area by entering your comments in the feedback form available in every online document.

Cisco Product Security Overview

Cisco provides a free online Security Vulnerability Policy portal at this URL:

http://www.cisco.com/en/US/products/products_security_vulnerability_policy.html

From this site, you will find information about how to do the following:

• Report security vulnerabilities in Cisco products

• Obtain assistance with security incidents that involve Cisco products

• Register to receive security information from Cisco

A current list of security advisories, security notices, and security responses for Cisco products is available at this URL:

http://www.cisco.com/go/psirt

Preface

To see security advisories, security notices, and security responses as they are updated in real time, you can subscribe to the Product Security Incident Response Team Really Simple Syndication (PSIRT RSS) feed. Information about how to subscribe to the PSIRT RSS feed is found at this URL:

http://www.cisco.com/en/US/products/products_psirt_rss_feed.html

Reporting Security Problems in Cisco Products

Cisco is committed to delivering secure products. We test our products internally before we release them, and we strive to correct all vulnerabilities quickly. If you think that you have identified a vulnerability in a Cisco product, contact PSIRT:

• For emergencies only — security-alert@cisco.com

An emergency is either a condition in which a system is under active attack or a condition for which a severe and urgent security vulnerability should be reported. All other conditions are considered nonemergencies.

• For nonemergencies — psirt@cisco.com

In an emergency, you can also reach PSIRT by telephone:

• 1 877 228-7302

• 1 408 525-6532

Tip We encourage you to use Pretty Good Privacy (PGP) or a compatible product (for example, GnuPG) to

encrypt any sensitive information that you send to Cisco. PSIRT can work with information that has been encrypted with PGP versions 2.x through 9.x.

xvi

Never use a revoked encryption key or an expired encryption key. The correct public key to use in your correspondence with PSIRT is the one linked in the Contact Summary section of the Security

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

OL-11187-01

Preface

Vulnerability Policy page at this URL:

http://www.cisco.com/en/US/products/products_security_vulnerability_policy.html

The link on this page has the current PGP key ID in use.

If you do not have or use PGP, contact PSIRT to find other means of encrypting the data before sending any sensitive material.

Product Alerts and Field Notices

Modifications to or updates about Cisco products are announced in Cisco Product Alerts and Cisco Field Notices. You can receive Cisco Product Alerts and Cisco Field Notices by using the Product Alert Tool on Cisco.com. This tool enables you to create a profile and choose those products for which you want to receive information.

To access the Product Alert Tool, you must be a registered Cisco.com user. (To register as a Cisco.com user, go to this URL: http://tools.cisco.com/RPF/register/register.do) Registered users can access the tool at this URL: http://tools.cisco.com/Support/PAT/do/ViewMyProfiles.do?local=en

Product Alerts and Field Notices

Obtaining Technical Assistance

Cisco Technical Support provides 24-hour-a-day award-winning technical assistance. The Cisco Technical Support & Documentation website on Cisco.com features extensive online support resources. In addition, if you have a valid Cisco service contract, Cisco Technical Assistance Center (TAC) engineers provide telephone support. If you do not have a valid Cisco service contract, contact your reseller.

Cisco Technical Support & Documentation Website

The Cisco Technical Support & Documentation website provides online documents and tools for troubleshooting and resolving technical issues with Cisco products and technologies. The website is available 24 hours a day at this URL:

http://www.cisco.com/techsupport

Access to all tools on the Cisco Technical Support & Documentation website requires a Cisco.com user ID and password. If you have a valid service contract but do not have a user ID or password, you can register at this URL:

http://tools.cisco.com/RPF/register/register.do

Note Use the Cisco Product Identification Tool to locate your product serial number before submitting a

request for service online or by phone. You can access this tool from the Cisco Technical Support & Documentation website by clicking the Tools & Resources link, clicking the All Tools (A-Z) tab, and then choosing Cisco Product Identification Tool from the alphabetical list. This tool offers three search options: by product ID or model name; by tree view; or, for certain products, by copying and pasting

OL-11187-01

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

xvii

Obtaining Technical Assistance

show command output. Search results show an illustration of your product with the serial number label location highlighted. Locate the serial number label on your product and record the information before placing a service call.

Tip Displaying and Searching on Cisco.com

If you suspect that the browser is not refreshing a web page, force the browser to update the web page by holding down the Ctrl key while pressing F5.

To find technical information, narrow your search to look in technical documentation, not the entire Cisco.com website. On the Cisco.com home page, click the Advanced Search link under the Search box and then click the Technical Support & Documentation radio button.

To provide feedback about the Cisco.com website or a particular technical document, click Contacts & Feedback at the top of any Cisco.com web page.

Submitting a Service Request

Preface

Using the online TAC Service Request Tool is the fastest way to open S3 and S4 service requests. (S3 and S4 service requests are those in which your network is minimally impaired or for which you require product information.) After you describe your situation, the TAC Service Request Tool provides recommended solutions. If your issue is not resolved using the recommended resources, your service request is assigned to a Cisco engineer. The TAC Service Request Tool is located at this URL:

http://www.cisco.com/techsupport/servicerequest

For S1 or S2 service requests, or if you do not have Internet access, contact the Cisco TAC by telephone. (S1 or S2 service requests are those in which your production network is down or severely degraded.) Cisco engineers are assigned immediately to S1 and S2 service requests to help keep your business operations running smoothly.

To open a service request by telephone, use one of the following numbers:

Asia-Pacific: +61 2 8446 7411 Australia: 1 800 805 227 EMEA: +32 2 704 55 55 USA: 1 800 553 2447

For a complete list of Cisco TAC contacts, go to this URL:

http://www.cisco.com/techsupport/contacts

Definitions of Service Request Severity

To ensure that all service requests are reported in a standard format, Cisco has established severity definitions.

xviii

Severity 1 (S1)—An existing network is “down” or there is a critical impact to your business operations. You and Cisco will commit all necessary resources around the clock to resolve the situation.

Severity 2 (S2)—Operation of an existing network is severely degraded, or significant aspects of your business operations are negatively affected by inadequate performance of Cisco products. You and Cisco will commit full-time resources during normal business hours to resolve the situation.

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

OL-11187-01

Preface

Obtaining Additional Publications and Information

Severity 3 (S3)—Operational performance of the network is impaired while most business operations remain functional. You and Cisco will commit resources during normal business hours to restore service to satisfactory levels.

Severity 4 (S4)—You require information or assistance with Cisco product capabilities, installation, or configuration. There is little or no effect on your business operations.

Obtaining Additional Publications and Information

Information about Cisco products, technologies, and network solutions is available from various online and printed sources.

• The Cisco Online Subscription Center is the website where you can sign up for a variety of

Cisco e-mail newsletters and other communications. Create a profile and then select the subscriptions that you would like to receive. To visit the Cisco Online Subscription Center, go to this URL:

http://www.cisco.com/offer/subscribe

• The Cisco Product Quick Reference Guide is a handy, compact reference tool that includes brief

product overviews, key features, sample part numbers, and abbreviated technical specifications for many Cisco products that are sold through channel partners. It is updated twice a year and includes the latest Cisco channel product offerings. To order and find out more about the Cisco Product Quick Reference Guide, go to this URL:

http://www.cisco.com/go/guide

• Cisco Marketplace provides a variety of Cisco books, reference guides, documentation, and logo

merchandise. Visit Cisco Marketplace, the company store, at this URL:

http://www.cisco.com/go/marketplace/

• Cisco Press publishes a wide range of general networking, training, and certification titles. Both new

and experienced users will benefit from these publications. For current Cisco Press titles and other information, go to Cisco Press at this URL:

http://www.ciscopress.com

• Internet Protocol Journal is a quarterly journal published by Cisco Systems for engineering

professionals involved in designing, developing, and operating public and private internets and intranets. You can access the Internet Protocol Journal at this URL:

http://www.cisco.com/ipj

• Networking products offered by Cisco Systems, as well as customer support services, can be

obtained at this URL:

http://www.cisco.com/en/US/products/index.html

• Networking Professionals Connection is an interactive website where networking professionals

share questions, suggestions, and information about networking products and technologies with Cisco experts and other networking professionals. Join a discussion at this URL:

http://www.cisco.com/discuss/networking

• “What’s New in Cisco Documentation” is an online publication that provides information about the

latest documentation releases for Cisco products. Updated monthly, this online publication is organized by product category to direct you quickly to the documentation for your products. You can view the latest release of “What’s New in Cisco Documentation” at this URL:

OL-11187-01

http://www.cisco.com/univercd/cc/td/doc/abtunicd/136957.htm

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

xix

Obtaining Additional Publications and Information

• World-class networking training is available from Cisco. You can view current offerings at

this URL:

http://www.cisco.com/en/US/learning/index.html

Preface

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

OL-11187-01

Introduction

CHAPTER

Cisco SFS 3012R Server Switch Overview

The following sections appear in this chapter:

• Introduction, page 1-1

• Features, page 1-2

• Cisco SFS 3012R Server Switch Chassis, page 1-4

• Cisco SFS 3012R Server Switch Components, page 1-5

The Cisco SFS 3012R Server Switch provides data center managers with a high-performance, low-latency interconnect that runs Fibre Channel and Ethernet traffic transparently over an InfiniBand backplane. Figure 1-1 displays the front of the Cisco SFS 3012R Server Switch (with the bezel attached).

Figure 1-1 Cisco SFS 3012R Server Switch Chassis - Front View (Bezel End)

180739

OL-11187-01

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

1-1

Features

Performance

Unified Fabric

Chapter 1 Cisco SFS 3012R Server Switch Overview

The Cisco SFS 3012R Server Switch provides unprecedented levels of availability, scalability, and manageability for deploying server clusters and on-demand computing. Server switch modules provide up to one terabit of internal bandwidth, and Ethernet or Fibre Channel field-replaceable interface modules enable up to 72 Ethernet ports or up to 24 Fibre Channel ports and up to 24 InfiniBand ports in a single chassis.

Expressly designed to apply networking principles to computing problems, the Cisco SFS 3012R Server Switch uses a switched InfiniBand fabric to interconnect server resources at 10 Gbps. The combination of high bandwidth and low latency allows resources to be disaggregated and dynamically reassembled without the limits of the shared PCI bus.

The Cisco SFS 3012R Server Switch integrates storage, server, and networking I/O into one unified fabric. With only one interface module in each host, you can manage all resources on one fabric and eliminate the need to install and manage multiple Ethernet, Fibre Channel, and inter-process communications (IPC) modules. The Cisco SFS 3012R Server Switch aggregates and load balances all types of I/O, significantly reducing the number of managed ports in your environment and increasing availability.

Transparent Topology

Based on the Transparent Topology architecture, the Cisco SFS 3012R Server Switch creates virtual IP and Fibre Channel interfaces on every server, allowing existing IP and storage area network (SAN) resources to seamlessly extend to server clusters. Using Fibre Channel gateways, SAN management technologies can access each individual node, enabling critical storage management and security models, such as Fibre Channel fabric zoning and storage-based logical unit number (LUN) zoning. By adding Ethernet gateways, IT managers can also enable full Internet Protocol (IP) connectivity, extending the value of server clusters to the rest of the enterprise.

Redundancy and High-Availability

The Cisco SFS 3012R Server Switch is architected for full redundancy within a single box. Every component in the data path can be dual-connected from end to end. For example, a server with a 2-port Host Channel Adaptor (HCA) can be dual-attached to the two InfiniBand switch modules on the Cisco SFS 3012R Server Switch. Each gateway is also dual attached to the dual switch module. In turn, the gateway modules are dual attached to Ethernet or Fibre Channel networks in pairs. With the addition of centralized load balancing and port aggregation, Ethernet and Fibre Channel uplink connections can be trunked and load balanced, allowing the Cisco SFS 3012R Server Switch to reroute around failures. Each independently removable component is hot-swappable.

1-2

Figure 1-2 shows the internal Cisco SFS 3012R Server Switch architecture. Components within the

dotted line reside within the Cisco SFS 3012R Server Switch chassis.

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

OL-11187-01

Chapter 1 Cisco SFS 3012R Server Switch Overview

Figure 1-2 Fully Redundant System Architecture

Management

workstation

Controller cards

InfiniBand backplane

Server Switch

Host Host

IB switchIB switch

Ethernet gateway

Features

Fibre Channel gateways

180741

Scalability

Ethernet switches

Fibre Channel

switches

The Cisco SFS 3012R Server Switch can be used in a variety of networking environments, including database tiers, application tiers, and Web tiers. The Cisco SFS 3012R Server Switch provides 10 Gbps per port connectivity to servers, 1 Gbps per port connectivity to Ethernet networks, and 2 Gbps per port connectivity to Fibre Channel networks. You can also aggregate uplinks for greater bandwidth and redundancy.

You can populate the cable end of the Cisco SFS 3012R Server Switch with additional Fibre Channel gateways, Ethernet gateways, and a second InfiniBand switch module to increase the port count of your server switch. A second InfiniBand switch module adds 12 InfiniBand ports. Each additional Fibre Channel gateway adds 2 Fibre Channel ports. Each additional Ethernet gateway adds 4 or 6 Ethernet ports.

OL-11187-01

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

1-3

Cisco SFS 3012R Server Switch Chassis

Figure 1-3 displays the back of the Cisco SFS 3012R Server Switch and numbers the slots on the chassis.

Figure 1-3 Cisco SFS 3012R Server Switch Chassis - Back View (cable End) with Slot Numbers

1 3 5 7 9 11 13

Chapter 1 Cisco SFS 3012R Server Switch Overview

2 4 6 8 10 12 14

1 Slot 1—Primary Controller module 15 Slot 15—InfiniBand switch module 2 - 13 Slots 2 through 13—Expansion

gateways (Ethernet or Fibre Channel)

14 Slot 14—Standby Controller module

The vertical slots at the top of the cable end of the Cisco SFS 3012R Server Switch are numbered 1 to 14 from left to right. The horizontal slots at the bottom of the cable end of the chassis are numbered 15 to 16 from top to bottom. Field replaceable units (FRUs) with interfaces populate the cable end of the chassis. FRUs such as power supplies and blower modules populate the front of the chassis, behind the bezel, as shown in Figure 1-4.

16 Slot 16—InfiniBand switch module

180740

1-4

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

OL-11187-01

Chapter 1 Cisco SFS 3012R Server Switch Overview

Figure 1-4 Cisco SFS 3012R Server Switch Chassis, Front View, Bezel Removed

Cisco SFS 3012R Server Switch Components

1 Power supply 4 Power supply (shown empty and covered with

2 Blower module 1 5 System and Blower modules LEDs 3 Blower module 2

blanking panel)

Cisco SFS 3012R Server Switch Components

The Cisco SFS 3012R Server Switch components support scalability and high availability. They are all field replaceable. These components include the following:

• Controller modules

• Input/output (I/O) gateways; Fibre Channel and Ethernet

• InfiniBand switch modules

• Power supplies

• Blower modules

180760

Controller Modules

Controller modules manage the Cisco SFS 3012R Server Switch and provide Ethernet and Serial Console port access to the server switch. You can install controller modules in slots 1 and 14 of the Cisco SFS 3012R Server Switch. Figure 1-5 displays the Cisco SFS 3012R Server Switch controller module.

OL-11187-01

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

1-5

Cisco SFS 3012R Server Switch Components

Figure 1-5 Cisco SFS 3012R Server Switch Controller Module

Chapter 1 Cisco SFS 3012R Server Switch Overview

180749

1 Serial console port 3 Ejector lever 2 Management Ethernet port 4 Controller module LEDs

The following points apply to the controller modules:

• Each Cisco SFS 3012R Server Switch comes with one active controller and, optionally, one warm

standby controller.

• Upon power-up, the controller in slot 1 becomes the master (active). The controller in slot 14, if

present, becomes the standby.

• The startup configuration file can be synchronized between the active and the standby controllers.

The Command Line Interface (CLI) prompts users to synchronize the controllers.

• When the master controller fails or reboots, the standby controller automatically takes over as the

new master. All I/O modules (InfiniBand switch modules, Fibre Channel gateways and Ethernet gateways) reboot when a failover occurs.

• Users can force a fail-over with the Element Manager graphic user interface (GUI) or with the CLI.

• The software upgrade/install process upgrades both the master controller and the standby controller

at the same time. You do not need to upgrade them separately.

• A subnet manager (SM) runs on each controller module. The SM can manage a single

Cisco SFS 3012R Server Switch or redundant Cisco SFS 3012R Server Switches.

1-6

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

OL-11187-01

+ 58 hidden pages

Cisco Systems SFS 3012R User Manual

Specifications and Main Features

Frequently Asked Questions

User Manual

Cisco SFS 3012R Multifabric Server Switch Hardware Installation Guide

Preface

Audience

Organization

Conventions

Statement 1071—Warning Definition

Related Documentation

Obtaining Documentation

Cisco.com

Product Documentation DVD

Ordering Documentation

Documentation Feedback

Product Alerts and Field Notices

Obtaining Technical Assistance

Submitting a Service Request

Definitions of Service Request Severity

Obtaining Additional Publications and Information

Introduction

Features

Performance

Unified Fabric

Transparent Topology

Redundancy and High-Availability

Scalability

Controller Modules