Cisco Systems 4x InfiniBand Switch Module User Manual

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

Corporate Headquarters

Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com Tel: 408 526-4000

800 553-NETS (6387)

Fax: 408 526-4100

Text Part Number: 78-17838-01

THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.

THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.

The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain version of the UNIX operating system. All rights reserved. Copyright © 1981, Regents of the University of California.

NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS” WITH ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE.

IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

CCSP, CCVP, the Cisco Square Bridge logo, Follow Me Browsing, and StackWise are trademarks of Cisco Systems, Inc.; Changing the Way We Work, Live, Play, and Learn, and iQuick Study are service marks of Cisco Systems, Inc.; and Access Registrar, Aironet, BPX, Catalyst, CCDA, CCDP, CCIE, CCIP, CCNA, CCNP, Cisco, the Cisco Certified Internetwork Expert logo, Cisco IOS, Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Cisco Unity, Enterprise/Solver, EtherChannel, EtherFast, EtherSwitch, Fast Step, FormShare, GigaDrive, GigaStack, HomeLink, Internet Quotient, IOS, IP/TV, iQ Expertise, the iQ logo, iQ Net Readiness Scorecard, LightStream, Linksys, MeetingPlace, MGX, the Networkers logo, Networking Academy, Network Registrar, Pack et , PIX, Post-Routing, Pre-Routing, ProConnect, RateMUX, ScriptShare, SlideCast, SMARTnet, The Fastest Way to Increase Your Internet Quotient, and TransPath are registered trademarks of Cisco Systems, Inc. and/or its affiliates in the United States and certain other countries.

All other trademarks mentioned in this document or Website are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any other company. (0601R)

Any Internet Protocol (IP) addresses used in this document are not intended to be actual addresses. Any examples, command display output, and figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses in illustrative content is unintentional and coincidental.

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

Preface v

Audience v Organization v Conventions v Related Documentation vi Contacting Technical Support vii

IBM Support Contact Information vii Before You Call viii

Determining the Software Version viii Downloading the Latest Software Release viii

Cisco Systems Support Contact Information viii

Cisco Technical Support & Documentation Website ix Submitting a Service Request ix Definitions of Service Request Severity ix

IBM Statement of Limited Warranty Z125-4753-08 04/2004 xi

Part 1 - General Terms xi

What this Warranty Covers xi What This Warranty Does Not Cover xii How to Obtain Warranty Service xii What IBM Will Do to Correct Problems xii Exchange of a Machine or Part xiii Your Additional Responsibilities xiii Limitation of Liability xiii Governing Law xiv Jurisdiction xiv

Part 2 - Country-unique Terms xiv

AMERICAS xiv

ARGENTINA xiv BOLIVIA xiv BRAZIL xv CHILE xv COLOMBIA xv

78-17838-01

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

Contents

EQUADOR xv MEXICO xv PARAGUAY xv PERU xv URUGUAY xvi VENEZUELA xvi

NORTH AMERICA xvi

CANADA xvi UNITED STATES xvi

ASIA PACIFIC xvi

AUSTRALIA xvi CAMBODIA AND LAOS xvii CAMBODIA, INDONESIA, AND LAOS xvii HONG KONG S.A.R. OF CHINA AND MACAU S.A.R. OF CHINA xvii INDIA xviii JAPAN xviii MALAYSIA xviii NEW ZEALAND xviii PEOPLE'S REPUBLIC OF CHINA (PRC) xix PHILIPPINES xix

SINGAPORE xix EUROPE, MIDDLE EAST, AFRICA (EMEA) xix EUROPEAN UNION (EU) xxi CONSUMERS xxii

FRANCE AND BELGIUM xxii THE FOLLOWING TERMS APPLY TO THE COUNTRY SPECIFIED: xxiii

AUSTRIA xxiii

EGYPT xxiii

FRANCE xxiii

GERMANY xxiv

HUNGARY xxiv

IRELAND xxiv

SLOVAKIA xxv

SOUTH AFRICA, NAMIBIA, BOTSWANA, LESOTHO AND SWAZILAND xxv

UNITED KINGDOM xxv

Part 3 - Warranty Information xxvi

Warranty Period xxvi

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

78-17838-01

Types of Warranty Service xxvii EU Country Telephone List xxviii

Notices xxix

Edition Notice xxx Trademarks xxx Important Notes xxxi Product Recycling and Disposal xxxi Battery Return Program xxxi Electronic Emission Notices xxxii

Federal Communications Commission (FCC) Statement xxxii Industry Canada Class A emission compliance statement xxxiii Australia and New Zealand Class A statement xxxiii United Kingdom telecommunications safety requirement xxxiii European Union EMC Directive conformance statement xxxiii Taiwanese Class A warning statement xxxiii Chinese Class A warning statement xxxiv Japanese Voluntary Control Council for Interference (VCCI) statement xxxiv

Contents

CHAPTER

WEEE Notice xxxv

Safety xxxvii

1 About the Server Switch Module 1-1

Introduction 1-1

Server Switch Module and HCA Expansion Cards 1-2

Topologies 1-3

Single-Switch Topology 1-3

Dual-Switch Topology 1-3 Module Management 1-3 LEDs 1-4

Server Switch Module Status LEDs 1-4

Port Status LEDs 1-5 External InfiniBand Ports 1-5

2 Installing and Configuring the Server Switch 2-1

Installing the Server Switch Module 2-1

78-17838-01

Downloading Operating System Software from Cisco.com 2-1 Configuring the Server Switch Module 2-2

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

iii

Contents

Changing the Default Password 2-3 Configuring the System Clock 2-3

Connecting Beyond BladeCenter 2-5

Connecting InfiniBand Cables 2-5

CHAPTER

NDEX

3 Specifications 3-1

Electrical Requirements 3-1 Environmental Requirements 3-1

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

78-17838-01

Preface

Audience

The intended audience is the administrator responsible for installing, configuring, and managing Server Switch equipment. This administrator should have experience administering similar networking or storage equipment.

Organization

This publication is organized as follows:

Chapter Title Description

Chapter 1 About the Server Switch Module Describes the server switch module and

Chapter 2 Installing and Configuring the

Chapter 3 Specifications Electrical and environmental requirements

Server Switch

HCA expansion cards, including topology, management, the LEDs, and external InfiniBand ports.

Installation, configuration, and external connection of the server switch module are described.

are described in this chapter.

Conventions

This document uses the following conventions:

78-17838-01

Convention Description

boldface font Commands, command options, and keywords are in

boldface. Bold text indicates Chassis Manager elements or

text that you must enter as-is.

italic font Arguments in commands for which you supply values are in

italics. Italics not used in commands indicate emphasis.

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

Related Documentation

• Cisco 4x InfiniBand HCA Expansion Card for IBM BladeCenter User Guide

• Cisco Boot over IB User Guide for Linux

• Cisco Boot over IB User Guide for Windows

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

78-17838-01

Preface

• Cisco Command Line Interface Reference Guide

• Cisco Chassis Manager User Guide (Web GUI)

• Cisco Element Manager User Guide

Contacting Technical Support

Please read this section before contacting IBM or Cisco technical support.

IBM Support Contact Information

For technical support, see the following Web site: http://www.ibm.com/support To contact technical support, send E-mail to support@ibm.com or see one of the telephone numbers

below. To obtain warranty service contact IBM or your IBM reseller. In Canada or the United States, call

1-800-IBM-SERV (426-7378). In the EU countries, see the telephone numbers in Table 1.

Contacting Technical Support

Table 1 EU Country Telephone List

Austria—43-1-24592-5901 Italy—9-02-482-9202 Belgium—02-718-4339 Luxembourg—352-360385-1 Denmark—4520-8200 Netherlands—020-514-5770 Finland—358-9-4591 Portugal—351-21-7915-147 France—0238-557-450 Spain—34-91-662-4916 Germany—07032-15-4920 Sweden—46-8-477-4420 Greece—30-210-688-1220 United Kingdom—01475-555-055 Ireland—353-1-815-4000

Phone numbers are subject to change without notice.

Note IBM and Cisco are both available for more information. For support, contact IBM before Cisco.

78-17838-01

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

vii

Contacting Technical Support

Before You Call

Be prepared to provide the following information to support personnel.

General Information

Server configuration

Topspin Chassis configuration

Preface

• Technical Support registration number, if applicable

• Error messages received

• Detailed description of the problem and specific questions

• Description of any troubleshooting steps already performed and results

• Type of server, chip set, CPU, amount of RAM, # of nodes

• Attached storage devices (output from cat /proc/scsi/scsi)

• InfiniBand configuration (output from /usr/local/topspin/sbin/hca_self_test)

• Chassis model

• Output from the show running-status all command

Topspin Chassis Serial Number

The chassis serial number and corresponding bar code are provided on the serial number label. This can be found on the bottom of the chassis or the outside of the Topspin chassis box packaging. It can also be found in the output of the show backplane command.

Determining the Software Version

If InfiniBand drivers are already installed on the host, to determine the version of the Topspin Linux host drivers you are running, enter the following command at the prompt.

$ rpm -qa | grep topspin

topspin-ib-mod-rhel3-2.4.21-32.ELsmp-3.2.0-82 topspin-ib-mpi-rhel3-3.2.0-82 topspin-ib-rhel3-3.2.0-82

Downloading the Latest Software Release

To verify that you are running the latest available release, compare your version against the latest version on the Cisco support website at http://www.cisco.com/cgi-bin/tablebuild.pl/sfs-linux. After registering your product, you should have received a username and password to give you access to this site.

Cisco Systems Support Contact Information

viii

Cisco Technical Support provides 24-hour-a-day award-winning technical assistance. The Cisco Technical Support & Documentation website on Cisco.com features extensive online support resources. In addition, if you have a valid Cisco service contract, Cisco Technical Assistance Center (TAC) engineers provide telephone support. If you do not have a valid Cisco service contract, contact your reseller.

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

78-17838-01

Preface

Cisco Technical Support & Documentation Website

The Cisco Technical Support & Documentation website provides online documents and tools for troubleshooting and resolving technical issues with Cisco products and technologies. The website is available 24 hours a day, at this URL:

http://www.cisco.com/techsupport

Access to all tools on the Cisco Technical Support & Documentation website requires a Cisco.com user ID and password. If you have a valid service contract but do not have a user ID or password, you can register at this URL:

http://tools.cisco.com/RPF/register/register.do

Note Use the Cisco Product Identification (CPI) tool to locate your product serial number before submitting

a web or phone request for service. You can access the CPI tool from the Cisco Technical Support & Documentation website by clicking the Tools & Resources link under Documentation & Tools. Choose

Cisco Product Identification Tool from the Alphabetical Index drop-down list, or click the Cisco Product Identification Tool link under Alerts & RMAs. The CPI tool offers three search options: by

product ID or model name; by tree view; or for certain products, by copying and pasting show command output. Search results show an illustration of your product with the serial number label location highlighted. Locate the serial number label on your product and record the information before placing a service call.

Contacting Technical Support

Submitting a Service Request

Using the online TAC Service Request Tool is the fastest way to open S3 and S4 service requests. (S3 and S4 service requests are those in which your network is minimally impaired or for which you require product information.) After you describe your situation, the TAC Service Request Tool provides recommended solutions. If your issue is not resolved using the recommended resources, your service request is assigned to a Cisco engineer. The TAC Service Request Tool is located at this URL:

http://www.cisco.com/techsupport/servicerequest

For S1 or S2 service requests or if you do not have Internet access, contact the Cisco TAC by telephone. (S1 or S2 service requests are those in which your production network is down or severely degraded.) Cisco engineers are assigned immediately to S1 and S2 service requests to help keep your business operations running smoothly.

To open a service request by telephone, use one of the following numbers: Asia-Pacific: +61 2 8446 7411 (Australia: 1 800 805 227)

EMEA: +32 2 704 55 55 USA: 1 800 553-2447

For a complete list of Cisco TAC contacts, go to this URL:

http://www.cisco.com/techsupport/contacts

Definitions of Service Request Severity

To ensure that all service requests are reported in a standard format, Cisco has established severity definitions.

78-17838-01

Severity 1 (S1)—Your network is “down,” or there is a critical impact to your business operations. You and Cisco will commit all necessary resources around the clock to resolve the situation.

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

Contacting Technical Support

Severity 2 (S2)—Operation of an existing network is severely degraded, or significant aspects of your business operation are negatively affected by inadequate performance of Cisco products. You and Cisco will commit full-time resources during normal business hours to resolve the situation.

Severity 3 (S3)—Operational performance of your network is impaired, but most business operations remain functional. You and Cisco will commit resources during normal business hours to restore service to satisfactory levels.

Severity 4 (S4)—You require information or assistance with Cisco product capabilities, installation, or configuration. There is little or no effect on your business operations.

Preface

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

78-17838-01

IBM Statement of Limited Warranty Z125-4753-08 04/2004

Part 1 - General Terms

Part 1 - General Terms This Statement of Limited Warranty includes Part 1 - General Terms, Part 2 - Country-unique Terms,

and Part 3 - Warranty Information. The terms of Part 2 replace or modify those of Part 1. The warranties provided by IBM in this Statement of Limited Warranty apply only to Machines you purchase for your use, and not for resale. The term “Machine” means an IBM machine, its features, conversions, upgrades, elements, or accessories, or any combination of them. The term “Machine” does not include any software programs, whether pre-loaded with the Machine, installed subsequently or otherwise. Nothing in this

Statement of Limited Warranty affects any statutory rights of consumers that cannot be waived or limited by contract.

What this Warranty Covers

IBM warrants that each Machine 1) is free from defects in materials and workmanship and 2) conforms to IBM's Official Published Specifications (“Specifications”) which are available on request. The warranty period for the Machine starts on the original Date of Installation and is specified in Part 3 Warranty Information. The date on your invoice or sales receipt is the Date of Installation unless IBM or your reseller informs you otherwise. Many features, conversions, or upgrades involve the removal of parts and their return to IBM. A part that replaces a removed part will assume the warranty service status of the removed part. Unless IBM specifies otherwise, these warranties apply only in the country or region in which you purchased the Machine.

78-17838-01

THESE WARRANTIES ARE YOUR EXCLUSIVE WARRANTIES AND REPLACE ALL OTHER WARRANTIES OR CONDITIONS, EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OR CONDITIONS OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. SOME STATES OR JURISDICTIONS DO NOT ALLOW THE EXCLUSION OF EXPRESS OR IMPLIED WARRANTIES, SO THE ABOVE EXCLUSION MAY NOT APPLY TO YOU. IN THAT EVENT, SUCH WARRANTIES ARE LIMITED IN DURATION TO THE WARRANTY PERIOD. NO WARRANTIES APPLY AFTER THAT PERIOD. SOME STATES OR JURISDICTIONS DO NOT ALLOW LIMITATIONS ON HOW LONG AN IMPLIED WARRANTY LASTS, SO THE ABOVE LIMITATION MAY NOT APPLY TO YOU.

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

Part 1 - General Terms

What This Warranty Does Not Cover

This warranty does not cover the following:

• any software programs, whether pre-loaded or shipped with the Machine, or installed subsequently;

• failure resulting from misuse (including but not limited to use of any Machine capacity or capability,

other than that authorized by IBM in writing), accident, modification, unsuitable physical or operating environment, or improper maintenance by you;

• failure caused by a product for which IBM is not responsible; and

• any non-IBM products, including those that IBM may procure and provide with or integrate into an

IBM Machine at your request. The warranty is voided by removal or alteration of identification labels on the Machine or its parts. IBM does not warrant uninterrupted or error-free operation of a Machine. Any technical or other support provided for a Machine under warranty, such as assistance with “how-to”

questions and those regarding Machine set-up and installation, is provided WITHOUT WARRANTIES OF ANY KIND.

IBM Statement of Limited Warranty Z125-4753-08 04/2004

How to Obtain Warranty Service

If the Machine does not function as warranted during the warranty period, contact IBM or your reseller to obtain warranty service. If you do not register the Machine with IBM, you may be required to present proof of purchase as evidence of your entitlement to warranty service.

What IBM Will Do to Correct Problems

When you contact IBM for service, you must follow the problem determination and resolution procedures that IBM specifies. An initial diagnosis of your problem can be made either by a technician over the telephone or electronically by access to an IBM website.

The type of warranty service applicable to your Machine is specified in Part 3 - Warranty Information. You are responsible for downloading and installing designated Machine Code (microcode, basic

input/output system code (called “BIOS”), utility programs, device drivers, and diagnostics delivered with an IBM Machine) and other software updates from an IBM Internet Web site or from other electronic media, and following the instructions that IBM provides.

If your problem can be resolved with a Customer Replaceable Unit (“CRU”) (e.g., keyboard, mouse, speaker, memory, hard disk drive), IBM will ship the CRU to you for you to install.

If the Machine does not function as warranted during the warranty period and your problem cannot be resolved over the telephone or electronically, through your application of Machine Code or software updates, or with a CRU, IBM or your reseller, if approved by IBM to provide warranty service, will either, at its discretion, 1) repair it to make it function as warranted, or 2) replace it with one that is at least functionally equivalent. If IBM is unable to do either, you may return the Machine to your place of purchase and your money will be refunded.

xii

IBM or your reseller will also manage and install selected engineering changes that apply to the Machine.

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

78-17838-01

IBM Statement of Limited Warranty Z125-4753-08 04/2004

Exchange of a Machine or Part

When the warranty service involves the exchange of a Machine or part, the item IBM or your reseller replaces becomes its property and the replacement becomes yours. You represent that all removed items are genuine and unaltered. The replacement may not be new, but will be in good working order and at least functionally equivalent to the item replaced. The replacement assumes the warranty service status of the replaced item.

Your Additional Responsibilities

Before IBM or your reseller exchanges a Machine or part, you agree to remove all features, parts, options, alterations, and attachments not under warranty service.

You also agree to:

1. ensure that the Machine is free of any legal obligations or restrictions that prevent its exchange;

2. obtain authorization from the owner to have IBM or your reseller service a Machine that you do not

own; and

Part 1 - General Terms

3. where applicable, before service is provided: a. follow the service request procedures that IBM or your reseller provides; b. backup or secure all programs, data, and funds contained in the Machine; c. provide IBM or your reseller with sufficient, free, and safe access to your facilities to permit

IBM to fulfill its obligations; and

d. inform IBM or your reseller of changes in the Machine's location.

4. (a) ensure all information about identified or identifiable individuals (Personal Data) is deleted from

the Machine (to the extent technically possible), (b) allow IBM, your reseller or an IBM supplier to process on your behalf any remaining Personal Data as IBM or your reseller considers necessary to fulfill its obligations under this Statement of Limited Warranty (which may include shipping the Machine for such processing to other IBM service locations around the world), and (c) ensure that such processing complies with any laws applicable to such Personal Data.

Limitation of Liability

IBM is responsible for loss of, or damage to, your Machine only while it is 1) in IBM's possession or 2) in transit in those cases where IBM is responsible for the transportation charges.

Neither IBM nor your reseller are responsible for any of your confidential, proprietary or personal information contained in a Machine which you return to IBM for any reason. You should remove all such information from the Machine prior to its return.

Circumstances may arise where, because of a default on IBM's part or other liability, you are entitled to recover damages from IBM. In each such instance, regardless of the basis on which you are entitled to claim damages from IBM (including fundamental breach, negligence, misrepresentation, or other contract or tort claim), except for any liability that cannot be waived or limited by applicable laws, IBM is liable for no more than

78-17838-01

1. damages for bodily injury (including death) and damage to real property and tangible personal

property; and

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

xiii

Part 2 - Country-unique Terms

This limit also applies to IBM's suppliers and your reseller. It is the maximum for which IBM, its suppliers, and your reseller are collectively responsible.

UNDER NO CIRCUMSTANCES IS IBM, ITS SUPPLIERS OR RESELLERS LIABLE FOR ANY OF THE FOLLOWING EVEN IF INFORMED OF THEIR POSSIBILITY: 1) THIRD PARTY CLAIMS AGAINST YOU FOR DAMAGES (OTHER THAN THOSE UNDER THE FIRST ITEM LISTED ABOVE); 2) LOSS OF, OR DAMAGE TO, DATA; 3) SPECIAL, INCIDENTAL, OR INDIRECT DAMAGES OR FOR ANY ECONOMIC CONSEQUENTIAL DAMAGES; OR 4) LOST PROFITS, BUSINESS REVENUE, GOODWILL OR ANTICIPATED SAVINGS. SOME STATES OR JURISDICTIONS DO NOT ALLOW THE EXCLUSION OR LIMITATION OF INCIDENTAL OR CONSEQUENTIAL DAMAGES, SO THE ABOVE LIMITATION OR EXCLUSION MAY NOT APPLY TO YOU. SOME STATES OR JURISDICTIONS DO NOT ALLOW LIMITATIONS ON HOW LONG AN IMPLIED WARRANTY LASTS, SO THE ABOVE LIMITATION MAY NOT APPLY TO YOU.

Governing Law

IBM Statement of Limited Warranty Z125-4753-08 04/2004

2. the amount of any other actual direct damages, up to the charges (if recurring, 12 months' charges

apply) for the Machine that is subject of the claim. For purposes of this item, the term “Machine” includes Machine Code and Licensed Internal Code (“LIC”).

Both you and IBM consent to the application of the laws of the country in which you acquired the Machine to govern, interpret, and enforce all of your and IBM's rights, duties, and obligations arising from, or relating in any manner to, the subject matter of this Statement of Limited Warranty, without regard to conflict of law principles.

THESE WARRANTIES GIVE YOU SPECIFIC LEGAL RIGHTS AND YOU MAY ALSO HAVE OTHER RIGHTS WHICH VARY FROM STATE TO STATE OR JURISDICTION TO JURISDICTION.

Jurisdiction

All of our rights, duties, and obligations are subject to the courts of the country in which you acquired the Machine.

Part 2 - Country-unique Terms

AMERICAS

ARGENTINA

Jurisdiction: The following is added after the first sentence: Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the

Ordinary Commercial Court of the city of Buenos Aires.

BOLIVIA

xiv

Jurisdiction: The following is added after the first sentence:

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

78-17838-01

IBM Statement of Limited Warranty Z125-4753-08 04/2004

Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the courts of the city of La Paz.

BRAZIL

Jurisdiction: The following is added after the first sentence: Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the court

of Rio de Janeiro, RJ.

CHILE

Jurisdiction: The following is added after the first sentence: Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the Civil

Courts of Justice of Santiago.

COLOMBIA

Part 2 - Country-unique Terms

EQUADOR

MEXICO

PARAGUAY

Jurisdiction: The following is added after the first sentence: Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the Judges

of the Republic of Colombia.

Jurisdiction: The following is added after the first sentence: Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the Judges

of Quito.

Jurisdiction: The following is added after the first sentence: Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the Federal

Courts of Mexico City, Federal District.

Jurisdiction: The following is added after the first sentence: Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the courts

of the city of Asuncion.

PERU

78-17838-01

Limitation of Liability: The following is added at the end of this section: In accordance with Article 1328 of the Peruvian Civil Code the limitations and exclusions specified in

this section will not apply to damages caused by IBM's willful misconduct (“dolo”) or gross negligence (“culpa inexcusable”).

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

Part 2 - Country-unique Terms

URUGUAY

Jurisdiction: The following is added after the first sentence: Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the City of

Montevideo Court’s Jurisdiction.

VENEZUELA

Jurisdiction: The following is added after the first sentence: Any litigation arising from this Statement of Limited Warranty will be settled exclusively by the Courts

of the Metropolitan Area Of the City of Caracas.

NORTH AMERICA

How to Obtain Warranty Service: The following is added to this Section: To obtain warranty service from IBM in Canada or the United States, call 1-800-IBM-SERV (426-7378).

IBM Statement of Limited Warranty Z125-4753-08 04/2004

CANADA

UNITED STATES

ASIA PACIFIC

AUSTRALIA

Limitation of Liability: The following replaces item 1 of this section:

1. damages for bodily injury (including death) or physical harm to real property and tangible personal

property caused by IBM's negligence; and

Governing Law: The following replaces “laws of the country in which you acquired the Machine” in the first sentence:

laws in the Province of Ontario.

Governing Law: The following replaces “laws of the country in which you acquired the Machine” in the first sentence:

laws of the State of New York.

What this Warranty Covers: The following paragraph is added to this section: The warranties specified in this Section are in addition to any rights you may have under the Trade

Practices Act 1974 or other similar legislation and are only limited to the extent permitted by the applicable legislation.

xvi

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

78-17838-01

+ 40 hidden pages

Cisco Systems 4x InfiniBand Switch Module User Manual

Cisco 4x InfiniBand Switch Module for IBM BladeCenter User Guide

CONTENTS

Preface

IBM Statement of Limited Warranty Z125-4753-08 04/2004