Oracle InfiniBand Switch IS2-46 Service Manual

Download

Page 1

Oracle® InfiniBand Switch IS2-46 Service Manual

Part No: E65869-01

September 2016

Page 2

Page 3

Oracle InfiniBand Switch IS2-46 Service Manual

Part No: E65869-01

This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited.

The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.

If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, then the following notice is applicable:

U.S. GOVERNMENT END USERS. Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, delivered to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.

This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications.

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.

Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered trademark of The Open Group.

This software or hardware and documentation may provide access to or information about content, products, and services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services unless otherwise set forth in an applicable agreement between you and Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.

Documentation Accessibility

For information about Oracle's commitment to accessibility, visit the Oracle Accessibility Program website at http://www.oracle.com/pls/topic/lookup?ctx=acc&id=docacc.

Access to Oracle Support

Oracle customers that have purchased support have access to electronic support through My Oracle Support. For information, visit http://www.oracle.com/pls/topic/lookup?

ctx=acc&id=info or visit http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs if you are hearing impaired.

Page 4

Référence: E65869-01

Ce logiciel et la documentation qui l’accompagne sont protégés par les lois sur la propriété intellectuelle. Ils sont concédés sous licence et soumis à des restrictions d’utilisation et de divulgation. Sauf stipulation expresse de votre contrat de licence ou de la loi, vous ne pouvez pas copier, reproduire, traduire, diffuser, modifier, accorder de licence, transmettre, distribuer, exposer, exécuter, publier ou afficher le logiciel, même partiellement, sous quelque forme et par quelque procédé que ce soit. Par ailleurs, il est interdit de procéder à toute ingénierie inverse du logiciel, de le désassembler ou de le décompiler, excepté à des fins d’interopérabilité avec des logiciels tiers ou tel que prescrit par la loi.

Les informations fournies dans ce document sont susceptibles de modification sans préavis. Par ailleurs, Oracle Corporation ne garantit pas qu’elles soient exemptes d’erreurs et vous invite, le cas échéant, à lui en faire part par écrit.

Si ce logiciel, ou la documentation qui l’accompagne, est livré sous licence au Gouvernement des Etats-Unis, ou à quiconque qui aurait souscrit la licence de ce logiciel pour le compte du Gouvernement des Etats-Unis, la notice suivante s’applique:

Ce logiciel ou matériel a été développé pour un usage général dans le cadre d’applications de gestion des informations. Ce logiciel ou matériel n’est pas conçu ni n’est destiné à être utilisé dans des applications à risque, notamment dans des applications pouvant causer des dommages corporels. Si vous utilisez ce logiciel ou matériel dans le cadre d’ applications dangereuses, il est de votre responsabilité de prendre toutes les mesures de secours, de sauvegarde, de redondance et autres mesures nécessaires à son utilisation dans des conditions optimales de sécurité. Oracle Corporation et ses affiliés déclinent toute responsabilité quant aux dommages causés par l’utilisation de ce logiciel ou matériel pour ce type d’applications.

Oracle et Java sont des marques déposées d’Oracle Corporation et/ou de ses affiliés. Tout autre nom mentionné peut correspondre à des marques appartenant à d’autres propriétaires qu’Oracle.

Intel et Intel Xeon sont des marques ou des marques déposées d’Intel Corporation. Toutes les marques SPARC sont utilisées sous licence et sont des marques ou des marques déposées de SPARC International, Inc. AMD, Opteron, le logo AMD et le logo AMD Opteron sont des marques ou des marques déposées d’Advanced Micro Devices. UNIX est une marque déposée d’The Open Group.

Ce logiciel ou matériel et la documentation qui l’accompagne peuvent fournir des informations ou des liens donnant accès à des contenus, des produits et des services émanant de tiers. Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l’accès à des contenus, produits ou services tiers, ou à leur utilisation, sauf mention contraire stipulée dans un contrat entre vous et Oracle.

Accessibilité de la documentation

Pour plus d’informations sur l’engagement d’Oracle pour l’accessibilité à la documentation, visitez le site Web Oracle Accessibility Program, à l’adresse http://www.oracle.com/

pls/topic/lookup?ctx=acc&id=docacc.

Accès aux services de support Oracle

Les clients Oracle qui ont souscrit un contrat de support ont accès au support électronique via My Oracle Support. Pour plus d’informations, visitez le site http://www.oracle.com/

pls/topic/lookup?ctx=acc&id=info ou le site http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs si vous êtes malentendant.

Page 5

Using This Documentation ................................... .............................................. 9

Product Documentation Library . ..................................................................... ... 9

Feedback ................................... .................................................................... 9

Identifying Components ................................................................ .................... 11

Switch Components ............................................ .................... ....................... 12

Front Panel Components ................. ................................................................ 13

Rear Panel Components .............................................. .................................... 14

Detecting and Managing Faults ............ .................... ........................................ 15

Troubleshooting the Switch .................................... .................... ..................... 15

▼ Begin the Diagnostic Process ......................................................... .... 16

▼ Perform Diagnostics at the Switch ............. .......................................... 17

▼ Perform Additional Diagnostics at the Switch ........................... ............. 19

▼ Perform Diagnostics Remotely ............... .................... ........................ 21

▼ Perform Oracle ILOM Target Diagnostics .................. .................... ....... 25

Identifying Components of Faulted Targets ............ ............................................ 26

Oracle ILOM /HOST and /SP Target Replaceable Components ...................... 27

Oracle ILOM /System Target Replaceable Components ................. ............... 27

Oracle ILOM Legacy Target Replaceable Components ................................. 28

Faulted Item Replaceable Components ...................................................... 30

Diagnostic Tools .......................................................... ................................. 31

Troubleshooting (LEDs) ............................................................... .................. 31

▼ Inspect the LEDs ...... ..................................................................... .. 32

Front Panel LEDs ................................. ................................................. 33

SFP+ Link LEDs ............. ..................................................................... . 33

RJ-45 Link LEDs ............. .................... ................................................. 34

Chassis Status LEDs ................................... ........................................... 35

Component LEDs ........................ .................... ...................................... 36

Accessing the SP .. .................... ................................................. .................... 37

Page 6

Contents

▼ Access the SP (RJ-45 Port) ........ ........................................................ 37

▼ Access the SP (SER MGT Port) .... ..................................................... 38

▼ Access the SCP (RJ-45 Port) ......................................... .................... . 39

▼ Configure and Enable Network Management (SER MGT Port) ............ ..... 39

Troubleshooting (Oracle ILOM /SP Targets) .. .................................................... 42

▼ Display Oracle ILOM Log Entries ............. .................... ..................... 43

Oracle ILOM Log Entry Filters ........... .................................................... 44

▼ Display Network Management Configuration Properties ................... ....... 45

▼ Display User Session Information ....................................................... 45

▼ Display the SP Firmware Version ....................................................... . 46

Troubleshooting (Oracle ILOM /System Targets) ............................ .................... 47

▼ Display Problematic Components ................... ..................................... 47

Open Problem Faults ....................................................... ...................... 48

▼ Display the General Health of Components and Systems ......................... 49

Oracle ILOM Target Health States ........................ .................... ............... 50

▼ Display Active Power Consumption ................................................. ... 51

Troubleshooting (Oracle ILOM Legacy Targets) ................................................. 52

▼ Enable Oracle ILOM Legacy Targets ............................ ....................... 52

▼ Display Status for Specific Components ......................... ...................... 53

▼ Clear a Fault Manually ........................................................ .............. 54

Oracle ILOM Legacy Targets for Fault State and FRUID ............................ .. 55

Oracle ILOM Legacy Targets for Alarm State ...................................... ...... 56

Oracle ILOM Legacy Targets for Power Consumption ................................. 58

Oracle ILOM Legacy Targets for Voltage .............................. .................... 58

Oracle ILOM Legacy Targets for Temperature ...... ...................................... 59

Oracle ILOM Legacy Targets for Fan Speeds ........................... .................. 60

Oracle ILOM Legacy Targets for LED States ........................... .................. 61

Resettable Targets .... ..................................................................... ......... 62

Preparing for Service .. ..................................................................... ................. 63

Safety Information ........................ ................................................................. 64

Safety Symbols ................................. .................... ................................ 64

ESD Measures ............. .................... ..................................................... 64

Antistatic Wrist Strap Use .................... ................................................... 65

Antistatic Mat ............. ..................................................................... ..... 65

Service Tools ............................................... .................... ............................. 65

▼ Read the Switch Serial Number (Oracle ILOM) ............. ................................ 66

▼ Locate the Switch ................................................................ .................... 67

▼ Prevent ESD Damage ........................................................... .................... 67

6 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 7

Contents

▼ Remove the Air Duct Assembly .................................................... ............. 68

▼ Remove a Snap Bracket ..... ................................................. .................... .. 72

▼ Prepare to Power Off the Switch .......................................... .................... ... 75

▼ Power Off a Power Supply .............................................. .......................... 76

Servicing Data Cables .......................................... .................... ......................... 81

Identifying Data Cable Types ......................................................... ................. 82

PrizmMT Cables .... ..................................................................... .......... 83

SFP+ Cable Transceivers ................ .................... .................................... 84

RJ-45 Cables .............................................................. .......................... 84

▼ Locate a Faulty Data Cable ................................. ....................................... 85

▼ Remove a Data Cable ..................... .......................................................... 89

▼ (Optional) Assemble the Optical Fiber SFP+ Cables .................................. ..... 96

▼ Install a Data Cable ......................................................... ......................... 98

▼ Verify a Data Cable .................................. .............................................. 104

▼ (Optional) Clean the PrizmMT Receptacle or Connector Ferrule ...................... 104

Servicing the Battery .......................................... .................... ......................... 107

▼ Determine if the Battery Is Faulty ........................ .................... ................. 107

▼ Remove the Battery .................................................................... ............ 109

▼ Install the Battery ...... .................... ......................................................... 113

▼ Verify the Battery .................................................. .................... ............. 117

Servicing Fan Modules .... .................... ................................................. ........... 119

Fan Module LED ............. ..................................................................... ....... 120

▼ Locate a Faulty Fan Module ......................................................... ............ 120

▼ Remove a Fan Module ..... ..................................................................... .. 123

▼ Install a Fan Module ......................................... ...................................... 125

▼ Verify a Fan Module ................................................................. .............. 127

Servicing Power Supplies .......................... ..................................................... 129

Power Supply LEDs ............... ..................................................................... . 130

▼ Locate a Faulty Power Supply ......................................... .................... ..... 131

▼ Remove a Power Supply .................. ........................................................ 133

▼ Install a Power Supply ...................................................... ...................... 135

▼ Verify a Power Supply ......... ................................................................... 137

Replacing the Switch .......................................... .................... ......................... 139

Page 8

Contents

Switch LEDs .............................................................. ................................ 140

▼ Determine if the Switch Is Faulty ................................. .................... ......... 141

▼ Remove the Switch ............................ .................... ................................. 143

▼ Install the Switch ....................................................... ............................. 145

▼ Verify the Switch .......... ..................................................................... ..... 148

Returning the Switch to Operation ............................... ................................... 153

▼ Retrieve the Power Cords and SER MGT Cable ........................... ................ 154

▼ Power On a Power Supply ........................ ............................................... 157

▼ Connect the SER MGT Cable . .................................................................. 158

▼ Configure the Replacement Switch ..... ................................................. ...... 161

▼ Install a Snap Bracket ........................................... .................................. 164

▼ Install the Air Duct Assembly . .................... .............................................. 166

Glossary ................................... ..................................................................... .. 169

Index ................................... ..................................................................... ........ 177

8 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 9

Using This Documentation

■

Overview – Describes how to troubleshoot and service the Oracle InfiniBand Switch IS2-

46.

■

Audience – Technicians, system administrators, and authorized service providers.

■

Required knowledge – Advanced experience servicing network hardware.

Product Documentation Library

Documentation and resources for this product and related products are available at http://www.

oracle.com/goto/is2-46/docs.

Feedback

Provide feedback about this documentation at http://www.oracle.com/goto/docfeedback.

Using This Documentation 9

Page 10

10 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 11

Identifying Components

These topics identify switch components and provide links to service tasks.

■

“Switch Components” on page 12

■

“Front Panel Components” on page 13

■

“Rear Panel Components” on page 14

Related Information

■

“Detecting and Managing Faults” on page 15

■

“Preparing for Service” on page 63

■

“Servicing Data Cables” on page 81

■

“Servicing the Battery” on page 107

■

“Servicing Fan Modules” on page 119

■

“Servicing Power Supplies” on page 129

■

“Replacing the Switch” on page 139

■

“Returning the Switch to Operation” on page 153

Identifying Components 11

Page 12

Switch Components

No. Description Links

1 Fan module “Servicing Fan Modules” on page 119

2 SER MGT module (SMM) (battery inside) “Servicing the Battery” on page 107

3 Power supply “Servicing Power Supplies” on page 129

Related Information

■

“Front Panel Components” on page 13

■

“Rear Panel Components” on page 14

12 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 13

Front Panel Components

Item Description Links

1 Power supplies “Servicing Power Supplies” on page 129

2 Power cord receptacles “Power Off a Power Supply” on page 76

Front Panel Components

“Power On a Power Supply” on page 157

3 Fan modules “Servicing Fan Modules” on page 119

4 RFID tag “Read the Switch Serial Number (Oracle ILOM)” on page 66

“Remove the Air Duct Assembly” on page 68

5 SER MGT port “Access the SP (SER MGT Port)” on page 38

6 SMM, with battery inside “Servicing the Battery” on page 107

Related Information

■

“Switch Components” on page 12

■

“Rear Panel Components” on page 14

Identifying Components 13

Page 14

Rear Panel Components

Item Description Links

1 PrizmMT connectors

■ Ports 1 to 24 – IB 4x

■ Ports 25 and 26 – Either IB 4x or 10GbE

■ Ports 27 to 30 – IB 12x

2 SFP+ connectors

■ Ports 1 to 8 (left) – 10GbE Ethernet overlay network (IB switch chip)

■ Ports 1 and 2 (right) – 10GbE network management uplinks (Ethernet switch chip)

3 RJ-45 connectors “RJ-45

4 Chassis status LEDs “Front Panel

“PrizmMT Cables” on page 83

“SFP+ Cable Transceivers” on page 84

Cables” on page 84

LEDs” on page 33

Related Information

■

“Switch Components” on page 12

■

“Front Panel Components” on page 13

14 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 15

Detecting and Managing Faults

These topics describe the troubleshooting process.

■

“Troubleshooting the Switch” on page 15

■

“Identifying Components of Faulted Targets” on page 26

■

“Diagnostic Tools” on page 31

■

“Troubleshooting (LEDs)” on page 31

■

“Accessing the SP” on page 37

■

“Troubleshooting (Oracle ILOM /SP Targets)” on page 42

■

“Troubleshooting (Oracle ILOM /System Targets)” on page 47

■

“Troubleshooting (Oracle ILOM Legacy Targets)” on page 52

Related Information

■

“Identifying Components” on page 11

■

“Preparing for Service” on page 63

■

“Servicing Data Cables” on page 81

■

“Servicing the Battery” on page 107

■

“Servicing Fan Modules” on page 119

■

“Servicing Power Supplies” on page 129

■

“Replacing the Switch” on page 139

■

“Returning the Switch to Operation” on page 153

Troubleshooting the Switch

These topics describe how to troubleshoot the switch.

■

“Begin the Diagnostic Process” on page 16

■

“Perform Diagnostics at the Switch” on page 17

■

“Perform Additional Diagnostics at the Switch” on page 19

■

“Perform Diagnostics Remotely” on page 21

■

“Perform Oracle ILOM Target Diagnostics” on page 25

Detecting and Managing Faults 15

Page 16

Begin the Diagnostic Process

Related Information

■

“Identifying Components of Faulted Targets” on page 26

■

“Diagnostic Tools” on page 31

■

“Troubleshooting (LEDs)” on page 31

■

“Accessing the SP” on page 37

■

“Troubleshooting (Oracle ILOM /SP Targets)” on page 42

■

“Troubleshooting (Oracle ILOM /System Targets)” on page 47

■

“Troubleshooting (Oracle ILOM Legacy Targets)” on page 52

Begin the Diagnostic Process

Follow this process when you are informed of or recognize a problem.

Are you sure you know the cause of the problem?

■ Yes – Go to Step 2.

■ No – Go to Step 5.

Is the cause from a software failure or hardware failure?

■ Hardware – Go to Step 3.

■ Software – The solution is beyond the scope of this document.

Refer to the Oracle EDR InfiniBand Switch and Virtualized I/O Systems Administration Guide and the software troubleshooting documentation. If necessary, contact your authorized Oracle Service Provider.

Are you sure you know the solution to the hardware problem?

■ Yes – Go to Step 4.

■ No – Go to Step 5.

Replace the problematic component.

See “Faulted Item Replaceable Components” on page 30 for links to component service tasks.

Are you in the physical presence of the switch?

16 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 17

Perform Diagnostics at the Switch

■ Yes – Go to “Perform Diagnostics at the Switch” on page 17.

■ No – Go to “Perform Diagnostics Remotely” on page 21.

Related Information

■

“Perform Diagnostics at the Switch” on page 17

■

“Perform Additional Diagnostics at the Switch” on page 19

■

“Perform Diagnostics Remotely” on page 21

■

“Perform Oracle ILOM Target Diagnostics” on page 25

Perform Diagnostics at the Switch

Note - This procedure assumes that the air duct assembly has been removed and the SER MGT

cable remains attached. See “Remove the Air Duct Assembly” on page 68 for instructions.

Are you starting a new troubleshooting session with this task?

■ Yes – Go to “Begin the Diagnostic Process” on page 16 and start your troubleshooting session there.

■ No – Go to Step 2.

Are any power supply LEDs on?

■ Yes – Go to Step 4.

■ No – Go to Step 3.

Check the power cords and supplied power, and correct as necessary.

Refer to the Oracle InfiniBand Switch IS2-46 Installation Guide, then return to Step 2.

Is a power supply amber Attention LED on?

■ Yes – Go to Step 5.

■ No – Go to Step 7.

Release the tab and unseat the faulted power supply, wait a minute, then reseat the power supply and secure the tab.

Detecting and Managing Faults 17

Page 18

Perform Diagnostics at the Switch

Does the power supply Attention LED persist?

■ Yes – Go to Step 16.

■ No – Go to Step 7.

Is the green SP LED off?

■ Yes – Go to Step 16.

■ No – Go to Step 8.

Is a 1GBASE-T port or SFP+ port used for the network management interface?

■ Yes – Go to Step 9.

■ No – Go to Step 17.

Is the port's Link LED on?

■ Yes – Go to Step 10.

■ No – Go to Step 11.

10.

Does the Link LED flash on occasion?

■ Yes – Go to Step 17.

■ No – Go to Step 13.

11.

Are you sure you know that the cabling is wired correctly with good cables and firm connections?

■ Yes – Go to Step 13.

■ No – Go to Step 12.

12.

Inspect and replace cabling as necessary.

Then return to Step 9.

13.

Are you sure you know that the communication hardware (terminals, routers, and switches) are fully functional?

■ Yes – Go to Step 15.

18 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 19

Perform Additional Diagnostics at the Switch

■ No – Go to Step 14.

14.

Inspect and replace communication hardware as necessary.

Then return to Step 9.

15.

Use new cabling and connect to a different 1GBASE-T port or SFP+ port.

Go to Step 9. If you arrive back at this step a second time, go to Step 16.

16.

Remove the faulted component and install a new component.

See “Faulted Item Replaceable Components” on page 30 for links to service tasks.

17.

Perform further diagnostics.

See “Perform Additional Diagnostics at the Switch” on page 19.

Related Information

■

“Begin the Diagnostic Process” on page 16

■

“Perform Additional Diagnostics at the Switch” on page 19

■

“Perform Diagnostics Remotely” on page 21

■

“Perform Oracle ILOM Target Diagnostics” on page 25

Perform Additional Diagnostics at the Switch

Note - This procedure assumes that the air duct assembly has been removed and the SER MGT

cable remains attached. See “Remove the Air Duct Assembly” on page 68 for instructions.

Are you starting a new troubleshooting session with this task?

■ Yes – Go to “Begin the Diagnostic Process” on page 16 and start your troubleshooting session there.

■ No – Go to Step 2.

Is the chassis status amber Attention LED on to indicate a fault?

■ Yes – Go to Step 3.

■ No – Go to Step 15.

Is a fan module amber Attention LED on?

Detecting and Managing Faults 19

Page 20

Perform Additional Diagnostics at the Switch

■ Yes – Go to Step 4.

■ No – Go to Step 6.

Fully loosen the thumbscrew and unseat the faulted fan module, wait a minute, then reseat the fan module and tighten the thumbscrew finger-tight.

Does the fan module Attention LED persist?

■ Yes – Go to Step 14.

■ No – Go to Step 6.

Are magenta-colored PrizmMT cables connected in ports 1 through 26?

■ Yes – Go to Step 7.

■ No – Reattach the magenta-colored PrizmMT cables to ports 1 through 26,

then go to Step 7.

Are black-colored PrizmMT cables connected in ports 27 through 30?

■ Yes – Go to Step 8.

■ No – Reattach the black-colored PrizmMT cables to ports 27 through 30,

then go to Step 8.

Are all cabled Ethernet port Link LEDs on?

■ Yes – Go to Step 9.

■ No – Go to Step 10.

Does any cabled Ethernet port Link LED flash on occasion?

■ Yes – Go to Step 15.

■ No – Go to Step 12.

10.

Are you sure you know that the cabling for the suspect ports is wired correctly with good cables and firm connections?

■ Yes – Go to Step 12.

20 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 21

Perform Diagnostics Remotely

■ No – Go to Step 11.

11.

Inspect and replace cabling as necessary.

Then return to Step 8.

12.

Are you sure you know that the communication hardware (NICs, hosts, routers, and switches) are fully functional?

■ Yes – The switch itself is defective. Go to Step 14.

■ No – Go to Step 13.

13.

Inspect and replace communication hardware as necessary.

Then return to Step 8.

14.

Remove the faulted component and install a new component.

See “Faulted Item Replaceable Components” on page 30 for links to service tasks.

15.

Perform further diagnostics.

See “Perform Diagnostics Remotely” on page 21.

Related Information

■

“Begin the Diagnostic Process” on page 16

■

“Perform Diagnostics at the Switch” on page 17

■

“Perform Diagnostics Remotely” on page 21

■

“Perform Oracle ILOM Target Diagnostics” on page 25

Perform Diagnostics Remotely

Are you starting a new troubleshooting session with this task?

■ Yes – Go to “Begin the Diagnostic Process” on page 16 and start your troubleshooting session there.

■ No – Go to Step 2.

Do you access the SP from the network or terminal server?

■ Network – Go to Step 3.

Detecting and Managing Faults 21

Page 22

Perform Diagnostics Remotely

■ Terminal server (serial interface) – Go to Step 8.

Can you access the SP from the network?

See “Access the SP (RJ-45 Port)” on page 37, then return to this step.

■ Yes – Go to Step 17.

■ No – Go to Step 4.

Can you ping the switch from the network?

■ Yes – Go to Step 6.

■ No – Go to Step 5.

Are you sure that the network parameters are configured correctly?

■ Yes – Go to Step 12.

■ No – Go to Step 7.

From the terminal server (serial interface), enable the network administrative interface and network services through Oracle ILOM.

-> set /SP/network state=enabled

-> set /SP/services/ssh state=enabled

-> set /SP/services/https servicestate=enabled

Then return to Step 3.

From the terminal server (serial interface), configure the correct network parameters through Oracle ILOM.

See “Access the SP (SER MGT Port)” on page 38, then return to this step.

Type:

-> set /SP/network pendingipdiscovery=static

-> set /SP/network pendingipaddress=IP_address_for_SP

-> set /SP/network pendingipgateway=IP_address_for_gateway

-> set /SP/network pendingipnetmask=255.255.255.0

-> set /SP/network commitpending=true

Then return to Step 3.

Can you access the SP from the terminal server or serial interface?

See “Access the SP (SER MGT Port)” on page 38, then return to this step.

22 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 23

Perform Diagnostics Remotely

■ Yes – Go to Step 17.

■ No – Go to Step 9.

Are you sure that the serial parameters are configured correctly?

■ Yes – Go to Step 12.

■ No – Go to Step 10.

10.

Configure the correct serial parameters for the terminal server or serial console.

■

Baud – 9600

■

Data bits – 8

■

Parity – N

■

Stop bits – 1

■

Flow control – none

11.

From the network, configure the correct serial parameters through Oracle ILOM.

See “Access the SP (RJ-45 Port)” on page 37, then return to this step. Type:

-> set /SP/serial/external pendingflowcontrol=none

-> set /SP/serial/external pendingspeed=9600

-> set /SP/serial/external commitpending=true

Then return to Step 8.

12.

Are you sure that the cabling is wired correctly with good cables and firm connections?

■ Yes – Go to Step 14.

■ No – Go to Step 13.

13.

Inspect and replace cabling as necessary.

Then return to Step 2.

14.

Are you sure that the communication hardware (NICs, hosts, terminals, routers, and switches) is fully functional?

■ Yes – Go to Step 16.

■ No – Go to Step 15.

Detecting and Managing Faults 23

Page 24

Perform Diagnostics Remotely

15.

Inspect and replace communication hardware as necessary.

Then return to Step 2.

16.

Perform a visual inspection of the switch.

See “Perform Diagnostics at the Switch” on page 17.

17.

Display the log files from Oracle ILOM.

-> show /SP/logs/event/list Class==Fault Type==Fault

18.

Do the log entries identify the problem?

■ Yes – Go to Step 19.

■ No – Go to Step 22.

19.

Is the problem hardware or software related?

■ Hardware – Go to Step 20.

■ Software – The solution is beyond the scope of this document. Refer to the

switch Oracle InfiniBand Switch and Virtualized I/O Systems Administration Guide and the software troubleshooting documentation. If necessary,

contact your authorized Oracle Service Provider.

20.

Has enough information been provided to justify a service operation?

■ Yes – Go to Step 21.

■ No – Go to Step 22.

21.

Remove the faulted component and install a new component.

See “Faulted Item Replaceable Components” on page 30 or “Oracle ILOM Legacy Target

Replaceable Components” on page 28 for links to component service tasks.

22.

Perform Oracle ILOM target diagnostics.

See “Perform Oracle ILOM Target Diagnostics” on page 25.

Related Information

■

“Begin the Diagnostic Process” on page 16

■

“Perform Diagnostics at the Switch” on page 17

■

“Perform Additional Diagnostics at the Switch” on page 19

■

“Perform Oracle ILOM Target Diagnostics” on page 25

24 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 25

Perform Oracle ILOM Target Diagnostics

Are you starting a new troubleshooting session with this task?

■ Yes – Go to “Begin the Diagnostic Process” on page 16 and start your troubleshooting session there.

■ No – Go to Step 2.

Display problematic components with Oracle ILOM.

-> show /System/Open_Problems

Are there any problematic components?

■ Yes – Go to Step 11.

■ No – Go to Step 4.

Display the subsystems' health with Oracle ILOM.

-> show /System -t health

Are there any unhealthy subsystems?

■ Yes – Go to Step 6.

■ No – Go to Step 7.

Are any individual components unhealthy?

■ Yes – Go to Step 11.

■ No – Go to Step 7.

Are you sure that Oracle ILOM legacy targets are enabled?

■ Yes – Go to Step 9.

■ No – Go to Step 8.

Enable Oracle ILOM legacy targets.

-> set /SP/cli legacy_targets=enabled

Detecting and Managing Faults 25

Page 26

Identifying Components of Faulted Targets

Investigate the sensors of suspect components.

See “Display Status for Specific Components” on page 53, then return to this step. Use these tables for legacy targets.

Legacy Target Type Links

Alarm state and FRUID “Oracle ILOM Legacy Targets for Fault State and FRUID” on page 55

Power consumption “Oracle ILOM Legacy Targets for Power Consumption” on page 58

Voltage “Oracle ILOM Legacy Targets for Voltage” on page 58

Temperature “Oracle ILOM Legacy Targets for Temperature” on page 59

Fan speed “Oracle ILOM Legacy Targets for Fan Speeds” on page 60

LED state “Oracle ILOM Legacy Targets for LED States” on page 61

10.

Were any displayed values outside the range of normal operation or indicative of an alarm or fault?

■ Yes – Go to Step 11.

■ No – Continued diagnostics are beyond the scope of this document.

Refer to the software documentation or contact your Authorized Oracle Service Provider.

11.

Use the component Oracle ILOM path or component name to determine which component to service.

See “Oracle ILOM Legacy Target Replaceable Components” on page 28 and “Faulted Item

Replaceable Components” on page 30 for links to component service tasks.

Related Information

■

“Begin the Diagnostic Process” on page 16

■

“Perform Diagnostics at the Switch” on page 17

■

“Perform Additional Diagnostics at the Switch” on page 19

■

“Perform Diagnostics Remotely” on page 21

Identifying Components of Faulted Targets

These topics map targets and faulted components to their service tasks.

■

“Oracle ILOM /HOST and /SP Target Replaceable Components” on page 27

■

“Oracle ILOM /System Target Replaceable Components” on page 27

■

“Oracle ILOM Legacy Target Replaceable Components” on page 28

■

“Faulted Item Replaceable Components” on page 30

26 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 27

Related Information

■

“Troubleshooting the Switch” on page 15

■

“Diagnostic Tools” on page 31

■

“Troubleshooting (LEDs)” on page 31

■

“Accessing the SP” on page 37

■

“Troubleshooting (Oracle ILOM /SP Targets)” on page 42

■

“Troubleshooting (Oracle ILOM /System Targets)” on page 47

■

“Troubleshooting (Oracle ILOM Legacy Targets)” on page 52

Oracle ILOM /HOST and /SP Target Replaceable Components

Oracle ILOM Target Component Links

/HOST and all subtargets

/SP and all subtargets

/SP/clock

Switch “Replacing the Switch” on page 139

Battery “Servicing the Battery” on page 107

Identifying Components of Faulted Targets

Related Information

■

“Oracle ILOM /System Target Replaceable Components” on page 27

■

“Oracle ILOM Legacy Target Replaceable Components” on page 28

■

“Faulted Item Replaceable Components” on page 30

Oracle ILOM /System Target Replaceable Components

Oracle ILOM Target Component Links

/System

/System/Cooling

/System/Cooling/Fans/Fan_0

/System/Cooling/Fans/Fan_1

/System/Cooling/Fans/Fan_2

/System/Cooling/Fans/Fan_3

/System/Cooling/Fans/Fan_4

Switch “Replacing the Switch” on page 139

Fan modules “Servicing Fan Modules” on page 119

Fan module 0 “Servicing Fan Modules” on page 119

Fan module 1 “Servicing Fan Modules” on page 119

Fan module 2 “Servicing Fan Modules” on page 119

Detecting and Managing Faults 27

Page 28

Identifying Components of Faulted Targets

Oracle ILOM Target Component Links

/System/Cooling/Fans/Fan_5

/System/Cooling/Fans/Fan_6

/System/Cooling/Fans/Fan_7

/System/Firmware

/System/Firmware/Other_Firmware/Firmware_x

/System/Log

/System/Networking

/System/Networking/Switches/Switch_x

/System/Power

/System/Power/Power_Supplies/Power_Supply_0

/System/Power/Power_Supplies/Power_Supply_1

Fan module 2 “Servicing Fan Modules” on page 119

Fan module 3 “Servicing Fan Modules” on page 119

Firmware Oracle EDR InfiniBand and Virtualized I/

O Systems Administration Guide

Firmware Oracle EDR InfiniBand and Virtualized I/

O Systems Administration Guide

Switch “Replacing the Switch” on page 139

Power supplies “Servicing Power

Supplies” on page 129

Power supply 0 “Servicing Power

Supplies” on page 129

Power supply 1 “Servicing Power

Supplies” on page 129

Related Information

■

“Oracle ILOM /HOST and /SP Target Replaceable Components” on page 27

■

“Oracle ILOM Legacy Target Replaceable Components” on page 28

■

“Faulted Item Replaceable Components” on page 30

Oracle ILOM Legacy Target Replaceable Components

Oracle ILOM Target Component Links

/SYS

/SYS/COMe

/SYS/ETHSWITCH0

/SYS/FMx

/SYS/FMx/FANy

/SYS/FMx/FANy/TACH

/SYS/FMx/PRSNT

/SYS/IBSWITCH0

/SYS/LOCATE

/SYS/MB

/SYS/MB/T_AMB

Switch “Replacing the Switch” on page 139

Fan module x “Servicing Fan Modules” on page 119

Switch “Replacing the Switch” on page 139

28 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 29

Oracle ILOM Target Component Links

/SYS/MB/T_HCA

/SYS/MB/T_IBSWITCH

/SYS/MB/T_OUT

/SYS/MB/V_+1V0

/SYS/MB/V_+1V2

/SYS/MB/V_+1V5

/SYS/MB/V_+1V8

/SYS/MB/V_+2V5

/SYS/MB/V_+3V3

/SYS/MB/V_+0V85_HCA

/SYS/MB/V_+1V05_HCA

/SYS/MB/V_+0V85_IBSW

/SYS/MB/V_+1V05_IBSW

/SYS/MB/V_+3V3_MBOMA

/SYS/MB/V_VBAT

/SYS/OK

/SYS/PSx

/SYS/PSx/INPUT_POWER

/SYS/PSx/I_IN

/SYS/PSx/I_OUT

/SYS/PSx/OUTPUT_POWER

/SYS/PSx/PRSNT

/SYS/PSx/PWROK

/SYS/PSx/V_IN

/SYS/PSx/V_OUT

/SYS/SERVICE

/SYS/SP

/SYS/SP/OK

/SYS/SP/V_+1V0

/SYS/SP/V_+1V5

/SYS/SP/V_+1V8

/SYS/SP/V_+3V3

Switch “Replacing the Switch” on page 139

Battery “Servicing the Battery” on page 107

Switch “Replacing the Switch” on page 139

Power supply x “Servicing Power Supplies” on page 129

Power cord Oracle InfiniBand Switch IS2-46 Installation

Guide

Power supply x “Servicing Power Supplies” on page 129

Power cord Oracle InfiniBand Switch IS2-46 Installation

Guide

Power supply x “Servicing Power Supplies” on page 129

Switch “Replacing the Switch” on page 139

Identifying Components of Faulted Targets

Related Information

■

“Oracle ILOM /HOST and /SP Target Replaceable Components” on page 27

■

“Oracle ILOM /System Target Replaceable Components” on page 27

Detecting and Managing Faults 29

Page 30

Identifying Components of Faulted Targets

■

“Faulted Item Replaceable Components” on page 30

Faulted Item Replaceable Components

Faulted Item Component Links

Battery Battery “Servicing the Battery” on page 107

Battery voltage Battery “Servicing the Battery” on page 107

Cables Cables “Servicing Data Cables” on page 81

Chassis LEDs Switch “Replacing the Switch” on page 139

Date Battery “Servicing the Battery” on page 107

Ethernet switch chip Switch “Replacing the Switch” on page 139

Fan module Fan module “Servicing Fan Modules” on page 119

Fan module Attention LED Fan module “Servicing Fan Modules” on page 119

Fan module fan speed Fan module “Servicing Fan Modules” on page 119

Fan module presence Fan module “Servicing Fan Modules” on page 119

IB switch chip Switch “Replacing the Switch” on page 139

Link LEDs Switch

“Replacing the Switch” on page 139

Cable

Main board Switch “Replacing the Switch” on page 139

Main board LEDs Switch “Replacing the Switch” on page 139

Main board temperatures Switch “Replacing the Switch” on page 139

Main board voltages Switch “Replacing the Switch” on page 139

PrizmMT cable Cable “Servicing Data Cables” on page 81

Power consumption Power supply

Power cord

Switch

Power supply Power supply “Servicing Power Supplies” on page 129

Power supply Attention LED Power supply “Servicing Power Supplies” on page 129

Power supply current Power supply “Servicing Power Supplies” on page 129

Power supply fan Power supply “Servicing Power Supplies” on page 129

Power supply output voltage Power supply “Servicing Power Supplies” on page 129

Power supply presence Power supply “Servicing Power Supplies” on page 129

RJ-45 cable Cable “Servicing Data Cables” on page 81

SFP+ cable Cable “Servicing Data Cables” on page 81

SP Switch “Replacing the Switch” on page 139

SP LED Switch “Replacing the Switch” on page 139

Time Battery “Servicing the Battery” on page 107

“Servicing Data Cables” on page 81

“Servicing Power Supplies” on page 129

Oracle InfiniBand Switch IS2-46 Installation Guide

“Replacing the Switch” on page 139

30 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 31

Related Information

■

“Oracle ILOM /HOST and /SP Target Replaceable Components” on page 27

■

“Oracle ILOM /System Target Replaceable Components” on page 27

■

“Oracle ILOM Legacy Target Replaceable Components” on page 28

Diagnostic Tools

Tool Links

Status LEDs – Indicate the condition or state of the chassis and components.

■ Chassis

■ Fan module

■ Power supply

■ SP

Oracle ILOM /SP targets – Provide information about services, sessions, and configuration parameters for Oracle ILOM.

Oracle ILOM logs – Provide an accounting of events that happened with the switch hardware.

Oracle ILOM/System targets – Provide information about the hardware of the switch.

Oracle ILOM legacy targets – Provide detailed component and environmental information about the switch.

“Troubleshooting (LEDs)” on page 31

“Troubleshooting (Oracle ILOM /SP Targets)” on page 42

“Display Oracle ILOM Log Entries” on page 43

“Troubleshooting (Oracle ILOM /System Targets)” on page 47

“Troubleshooting (Oracle ILOM Legacy Targets)” on page 52

Diagnostic Tools

Related Information

■

“Troubleshooting the Switch” on page 15

■

“Identifying Components of Faulted Targets” on page 26

■

“Diagnostic Tools” on page 31

■

“Troubleshooting (LEDs)” on page 31

■

“Accessing the SP” on page 37

■

“Troubleshooting (Oracle ILOM /SP Targets)” on page 42

■

“Troubleshooting (Oracle ILOM /System Targets)” on page 47

■

“Troubleshooting (Oracle ILOM Legacy Targets)” on page 52

Troubleshooting (LEDs)

These topics enable you to visually inspect the state of the switch.

Detecting and Managing Faults 31

Page 32

Inspect the LEDs

■

“Inspect the LEDs” on page 32

■

“Front Panel LEDs” on page 33

■

“SFP+ Link LEDs” on page 33

■

“RJ-45 Link LEDs” on page 34

■

“Chassis Status LEDs” on page 35

■

“Component LEDs” on page 36

Related Information

■

“Troubleshooting the Switch” on page 15

■

“Identifying Components of Faulted Targets” on page 26

■

“Diagnostic Tools” on page 31

■

“Accessing the SP” on page 37

■

“Troubleshooting (Oracle ILOM /SP Targets)” on page 42

■

“Troubleshooting (Oracle ILOM /System Targets)” on page 47

■

“Troubleshooting (Oracle ILOM Legacy Targets)” on page 52

Inspect the LEDs

At the switch, observe and record the state of each LED.

Compare your observations with the status descriptions.

See:

■

“Front Panel LEDs” on page 33

■

“SFP+ Link LEDs” on page 33

■

“RJ-45 Link LEDs” on page 34

■

“Chassis Status LEDs” on page 35

■

“Component LEDs” on page 36

If the information provided is sufficient to justify a service operation, perform service on that component.

See “Faulted Item Replaceable Components” on page 30 for links to service tasks.

Related Information

■

“Front Panel LEDs” on page 33

■

“SFP+ Link LEDs” on page 33

■

“RJ-45 Link LEDs” on page 34

32 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 33

Inspect the LEDs

■

“Chassis Status LEDs” on page 35

■

“Component LEDs” on page 36

Front Panel LEDs

Other than the power supply LEDs and the fan module LEDs, there are no other LEDs on the front panel of the switch. See “Component LEDs” on page 36.

Related Information

■

“Inspect the LEDs” on page 32

■

“SFP+ Link LEDs” on page 33

■

“RJ-45 Link LEDs” on page 34

■

“Chassis Status LEDs” on page 35

■

“Component LEDs” on page 36

SFP+ Link LEDs

No. LED Description

1 SFP+ Link LED (left of pair, green) Indicates these conditions for the upper row of SFP+ connectors:

■ On – A link is established and up.

Detecting and Managing Faults 33

Page 34

Inspect the LEDs

No. LED Description

■ Flashing – There is activity on the link.

■ Off – No link is established or the link is down.

2 SFP+ Link LED (right of pair, green) Indicates these conditions for the lower row of SFP+ connectors:

■ On – A link is established and up.

■ Flashing – There is activity on the link.

■ Off – No link is established or the link is down.

Related Information

■

“Inspect the LEDs” on page 32

■

“Front Panel LEDs” on page 33

■

“RJ-45 Link LEDs” on page 34

■

“Chassis Status LEDs” on page 35

■

“Component LEDs” on page 36

RJ-45 Link LEDs

No. LED Description

1 RJ-45 Link LED (left of connector, green) Indicates these conditions for the upper row of RJ-45 connectors:

■ On – A link is established and up.

■ Flashing – There is activity on the link.

■ Off – No link is established or the link is down.

2 RJ-45 Link LED (right of connector, green) Indicates these conditions for the lower row of RJ-45 connectors:

34 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 35

No. LED Description

■ On – A link is established and up.

■ Flashing – There is activity on the link.

■ Off – No link is established or the link is down.

Related Information

■

“Inspect the LEDs” on page 32

■

“Front Panel LEDs” on page 33

■

“SFP+ Link LEDs” on page 33

■

“Chassis Status LEDs” on page 35

■

“Component LEDs” on page 36

Chassis Status LEDs

Inspect the LEDs

No. LED Description

1 Locate LED (top, white) Indicates these conditions:

■ Fast blink – Switch is identifying itself. To turn on a Locate LED, at the Oracle ILOM CLI type:

set /SYS/LOCATE value=Fast_Blink

■ Off – Switch is not identifying itself. To turn off a Locate LED, at the Oracle ILOM CLI type:

set /SYS/LOCATE value=Off

2 Service Action Required LED

(middle, amber)

Indicates these conditions:

Detecting and Managing Faults 35

Page 36

Inspect the LEDs

No. LED Description

■ On – Service is required. Oracle ILOM can detect a fault or failure resulting in this indication.

The Oracle ILOM /System/Open_Problems target provides details about any faults that cause this indicator to light.

Under some fault conditions, individual component fault LEDs are turned on in addition to the Service Required LED.

■ Off – Switch is running in its normal state. There are no faults.

3 System OK LED (middle,

green)

4 SP LED (bottom, green) Indicates these conditions:

Indicates these conditions:

■ On – Switch is powered on and is running in its normal operating state. No service actions are required.

■ Off – Switch is not running in its normal state. Switch power might be off. The SP might be booting.

■ On – SP is powered on and is running in its normal operating state. No service actions are required.

■ Slow blink – The SP is booting.

■ Off – SP is not running in its normal state. Power is off or the SP has faulted.

Related Information

■

“Inspect the LEDs” on page 32

■

“Front Panel LEDs” on page 33

■

“SFP+ Link LEDs” on page 33

■

“RJ-45 Link LEDs” on page 34

■

“Component LEDs” on page 36

Component LEDs

Component Links

Power supply “Power Supply LEDs” on page 130

Fan module “Fan Module LED” on page 120

Related Information

■

“Inspect the LEDs” on page 32

■

“Front Panel LEDs” on page 33

■

“SFP+ Link LEDs” on page 33

■

“RJ-45 Link LEDs” on page 34

36 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 37

■

“Chassis Status LEDs” on page 35

Accessing the SP

These topics describe how to access the SP for switch chassis management.

■

“Access the SP (RJ-45 Port)” on page 37

■

“Access the SP (SER MGT Port)” on page 38

■

“Access the SCP (RJ-45 Port)” on page 39

■

“Configure and Enable Network Management (SER MGT Port)” on page 39

Related Information

■

“Troubleshooting the Switch” on page 15

■

“Identifying Components of Faulted Targets” on page 26

■

“Diagnostic Tools” on page 31

■

“Troubleshooting (LEDs)” on page 31

■

“Troubleshooting (Oracle ILOM /SP Targets)” on page 42

■

“Troubleshooting (Oracle ILOM /System Targets)” on page 47

■

“Troubleshooting (Oracle ILOM Legacy Targets)” on page 52

Accessing the SP

Access the SP (RJ-45 Port)

Access a network terminal device that is connected to the SP through the management network.

Using an SSH session, log in to the Oracle ILOM interface.

% ssh user@IP_address

where:

■

user is the user name that manages the SP. The default user is root.

■

IP_address is the IP address or host name of the SP.

At the prompt, type the password for the user.

The default password is changeme.

The Oracle ILOM CLI prompt is displayed, and you can now manage the SP.

Detecting and Managing Faults 37

Page 38

Access the SP (SER MGT Port)

If you performed this task as part of a troubleshooting operation, return to the troubleshooting process.

See “Perform Diagnostics Remotely” on page 21.

Related Information

■

“Access the SP (SER MGT Port)” on page 38

■

“Access the SCP (RJ-45 Port)” on page 39

■

“Configure and Enable Network Management (SER MGT Port)” on page 39

Access the SP (SER MGT Port)

Access a terminal server or serial interface connected to the SER MGT port.

Ensure that the serial device is configured with correct parameters.

■

Baud – 9600

■

Data bits – 8

■

Parity – N

■

Stop bits – 1

■

Flow control – None

Press the Return or Enter key on the serial device several times to synchronize the connection.

hostname login:

where hostname is the host name of the SP.

The default user name is root, and the password is changeme.

The CLI prompt is displayed, and you can now manage the SP.

Consider your next steps.

■ If you performed this task as part of a troubleshooting operation, return to the troubleshooting process.

See “Perform Diagnostics Remotely” on page 21.

■ If you performed this task as part of configuring a replacement switch,

return to that procedure.

38 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 39

Access the SCP (RJ-45 Port)

See “Configure the Replacement Switch” on page 161.

Related Information

■

“Access the SP (RJ-45 Port)” on page 37

■

“Access the SCP (RJ-45 Port)” on page 39

■

“Configure and Enable Network Management (SER MGT Port)” on page 39

Access the SCP (RJ-45 Port)

From a management network attached host, start a web browser.

https://SCP_IP_address:8443/xms

where SCP_IP_address is the IP address of the SCP you configured in “Configure and Enable

Network Management (SER MGT Port)” on page 39.

The Oracle Fabric Manager login page is displayed.

Type the username and password of the Oracle Fabric Manager administrator.

The default username is root, and the password is changeme.

If you performed this task as part of configuring a replacement switch, return to that procedure.

See “Configure the Replacement Switch” on page 161.

Related Information

■

“Access the SP (RJ-45 Port)” on page 37

■

“Access the SP (SER MGT Port)” on page 38

■

“Configure and Enable Network Management (SER MGT Port)” on page 39

Configure and Enable Network Management (SER MGT Port)

Note - In some situations, this task can be performed from the network management interface at

RJ-45 ports. Upon completion of the task, the connection is severed and you must re-access the SP for continued management.

Detecting and Managing Faults 39

Page 40

Configure and Enable Network Management (SER MGT Port)

Access the Oracle ILOM CLI from the SER MGT port.

See “Access the SP (SER MGT Port)” on page 38.

Configure the SP network management parameters.

-> set /SP/network property=value property=value ...

where:

■

property is the parameter of the network to configure.

■

value is the value of the property being configured.

These properties are supported:

■

pendingipdiscovery – value is the method of IP discovery to be configured, either static or dhcp.

Note - If the value is dhcp, you must know how your DHCP server assigns an IP address

and host name to the SP.

■

pendingipaddress – value is the IP address of the SP to be configured. Not needed for DHCP.

■

pendingipgateway – value is the IP address of the routing gateway of the management network. Not needed for DHCP.

■

pendingipnetmask – value is the netmask for the management network. Not needed for DHCP.

Note - You can configure one to all properties on one command line.

Enable SP network management by IPv4.

-> set /SP/network state=ipv4-only

Enable secure connections to the SP.

For the CLI interface and SSL, type:

-> set /SP/services/ssh state=enabled

For the web interface and HTTPS, type:

-> set /SP/services/https servicestate=enabled

Commit the SP network management configuration.

-> set /SP/network commitpending=true

40 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 41

Configure and Enable Network Management (SER MGT Port)

The new configuration parameters take effect immediately.

Start the host console.

-> start /HOST/console Are you sure you want to start /HOST/console (y/n)? y Serial console started. To stop, type ESC (

Press the Enter key.

Oracle Linux Server release 6.6 Kernel 4.0.4-15.el6uek.x86_64 on an x86_64 hostname login:

hostname login: root Password:password Last login: Fri May 25 09:51:36 on ttyS0 [root@hostname ~]#

The default password is changeme.

Set the SCP IP address.

[root@hostname ~]# nm3tool ipaddress SCP_IP_address|dhcp|ilom

where SCP_IP_address is the IP address to be assigned to the SCP. Alternatively, you can configure IP address assignment by DHCP or Oracle ILOM. If you provide a static IP address, you will also need to provide the netmask and the IP address of the management network gateway. For example:

[root@hostname ~]# nm3tool ipaddress 123.45.67.90 Enter netmask: 255.255.255.0 Enter default gateway: 123.45.67.1 Restart network now? (Y/n)

10.

Restart the network to use the new values.

Restart network now? (Y/n)Y Shutting down interface eth0: [ OK ] Shutting down interface eth1: [ OK ] Shutting down loopback interface: [ OK ] Bringing up loopback interface: [ OK ] Bringing up interface eth0: Determining IP information for eth0... done. [ OK ] Bringing up interface eth1: Determining if ip address 169.254.2.1 is already in use for device eth1... [ OK ]

Detecting and Managing Faults 41

Page 42

Troubleshooting (Oracle ILOM /SP Targets)

[root@hostname ~]#

11.

(Optional) Set the hostname.

Provide the new host name. For example:

[root@hostname ~]# nm3tool hostname hostname

where hostname is the host name of the SCP. For example:

[root@hostname ~]# nm3tool hostname hostwiththemost [root@hostname ~]#

12.

Apply the changes.

[root@hostname ~]# nm3tool apply Setting network configuration from XML [root@hostname ~]#

13.

Consider your next steps.

■ If you performed this task as part of a troubleshooting operation, return to the troubleshooting process.

See “Perform Diagnostics Remotely” on page 21.

■ If you performed this task as part of replacement switch configuration,

return to that procedure.

See “Configure the Replacement Switch” on page 161.

Related Information

■

“Access the SP (RJ-45 Port)” on page 37

■

“Access the SP (SER MGT Port)” on page 38

■

“Access the SCP (RJ-45 Port)” on page 39

Troubleshooting (Oracle ILOM /SP Targets)

These topics display logs, check network management parameters, display user sessions, and verify firmware versions.

■

“Display Oracle ILOM Log Entries” on page 43

■

“Oracle ILOM Log Entry Filters” on page 44

■

“Display Network Management Configuration Properties” on page 45

42 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 43

■

“Display User Session Information” on page 45

■

“Display the SP Firmware Version” on page 46

Related Information

■

“Troubleshooting the Switch” on page 15

■

“Identifying Components of Faulted Targets” on page 26

■

“Diagnostic Tools” on page 31

■

“Troubleshooting (LEDs)” on page 31

■

“Accessing the SP” on page 37

■

“Troubleshooting (Oracle ILOM /System Targets)” on page 47

■

“Troubleshooting (Oracle ILOM Legacy Targets)” on page 52

Display Oracle ILOM Log Entries

Access the Oracle ILOM CLI.

See “Accessing the SP” on page 37.

Display Oracle ILOM Log Entries

Display the Oracle ILOM event log.

-> show /SP/logs/event/list Class==class Type==type

where class and type are chosen from the table in “Oracle ILOM Log Entry

Filters” on page 44.

For example, to display log entries pertaining to faults, type:

-> show /SP/logs/event/list Class==Fault Type==Fault Event ID Date/Time Class Type Severity

----- ------------------------ -------- -------- -------1741 Tue Mar 6 20:13:05 2012 Fault Fault critical Fault detected at time = Tue Mar 6 20:13:05 2012. The suspect component: /SYS/PS1 has fault.chassis.power.ext-fail with probability=100. Refer to ...

For this example, power supply 1 has had a fault. A URL is provided for more information about the fault.

Related Information

■

“Oracle ILOM Log Entry Filters” on page 44

■

“Display Network Management Configuration Properties” on page 45

Detecting and Managing Faults 43

Page 44

Display Oracle ILOM Log Entries

■

“Display User Session Information” on page 45

■

“Display the SP Firmware Version” on page 46

Oracle ILOM Log Entry Filters

When you display the Oracle ILOM log, you can filter the output to specific classes and types of entries using combinations of the Class and Type parameters. See “Display Oracle

ILOM Log Entries” on page 43. This table describes the combinations and entries that are

displayed.

Parameters Entries Displayed

Class==Audit Type==Log

Class==IPMI Type==Log

Class==Chassis Type==State

Class==Chassis Type==Action

Class==Fault Type==Fault

Class==Fault Type==Repair

Commands that result in a configuration change. Description includes user, command, command parameters, and success or failure.

Any event that is placed in the IPMI system event log is also put into the management log.

Changes to the component inventory and general switch state.

Shutdown events for switch chassis, hot-insert, and hot-removal of components.

Fault management faults. Description gives the time the fault was detected and the suspect component.

Fault management repairs. Description gives the component name.

The output can be further filtered with the Severity parameter, which has one of five values:

■

Debug

■

Down

■

Critical

■

Major

■

Minor

For example, to display only log entries indicating a minor change to the switch inventory, type:

-> show /SP/logs/event/list Class==Chassis Type==State Severity==Minor

Related Information

■

“Display Oracle ILOM Log Entries” on page 43

■

“Display Network Management Configuration Properties” on page 45

■

“Display User Session Information” on page 45

■

“Display the SP Firmware Version” on page 46

44 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 45

Display Network Management Configuration Properties

Access the Oracle ILOM CLI.

See “Accessing the SP” on page 37.

Display the parameters configured for the SP to communicate over the network.

-> show -d properties /SP/network /SP/network Properties: commitpending = (Cannot show property) dhcp_clientid = none dhcp_server_ip = none ipaddress = 10.153.113.85 ipdiscovery = static ipgateway = 10.153.113.1 ipnetmask = 255.255.255.0 . . . state = ipv4-only vland_id - (none)

Related Information

■

“Display Oracle ILOM Log Entries” on page 43

■

“Oracle ILOM Log Entry Filters” on page 44

■

“Display User Session Information” on page 45

■

“Display the SP Firmware Version” on page 46

Display User Session Information

Access the Oracle ILOM CLI.

See “Accessing the SP” on page 37.

Display the user session numbers.

-> show -d targets /SP/sessions /SP/sessions Targets: 4 (current)

Detecting and Managing Faults 45

Page 46

Display the SP Firmware Version

In this example, there is only one user session, number 4.

Display information about a particular session.

-> show -d properties /SP/sessions/x

where x is the session number. For example:

-> show -d properties /SP/sessions/4

/SP/sessions/4 Properties: username = root role = aucro starttime = Wed Sep 16 20:15:36 2015 type = shell mode = normal

Related Information

■

“Display Oracle ILOM Log Entries” on page 43

■

“Oracle ILOM Log Entry Filters” on page 44

■

“Display Network Management Configuration Properties” on page 45

■

“Display the SP Firmware Version” on page 46

Display the SP Firmware Version

When referencing external resources, it might be helpful to know the firmware versions for bug fixes or upgrades.

Access the Oracle ILOM CLI.

See “Accessing the SP” on page 37.

Display the SP firmware version and build time.

-> version /SP

SP firmware 3.2.0.0 SP firmware build number: 102282 SP firmware date: Fri Aug 28 13:41:21 CEST 2015 SP filesystem version: 0.2.10

Related Information

■

“Display Oracle ILOM Log Entries” on page 43

46 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 47

Troubleshooting (Oracle ILOM /System Targets)

■

“Oracle ILOM Log Entry Filters” on page 44

■

“Display Network Management Configuration Properties” on page 45

■

“Display User Session Information” on page 45

Troubleshooting (Oracle ILOM /System Targets)

These topics display the health state of various systems and components.

■

“Display Problematic Components” on page 47

■

“Open Problem Faults” on page 48

■

“Display the General Health of Components and Systems” on page 49

■

“Oracle ILOM Target Health States” on page 50

■

“Display Active Power Consumption” on page 51

Related Information

■

“Troubleshooting the Switch” on page 15

■

“Identifying Components of Faulted Targets” on page 26

■

“Diagnostic Tools” on page 31

■

“Troubleshooting (LEDs)” on page 31

■

“Accessing the SP” on page 37

■

“Troubleshooting (Oracle ILOM /SP Targets)” on page 42

■

“Troubleshooting (Oracle ILOM Legacy Targets)” on page 52

Display Problematic Components

Access the Oracle ILOM CLI.

See “Accessing the SP” on page 37.

Display problematic components.

-> show /System/Open_Problems Open Problems (0) Date/Time Subsystems Component

------------------------ ------------------ -----------Thu Dec 17 05:00:01 2015 System MB (Motherboard) fault.chassis.battery.fail (Probability:100, UUID:76a2179a-51bd-c836-a7f1-af62953577fa, Resource:/SYS/MB, Part Number:7092577, Serial Number:AK00329231, Reference Document:http://support.oracle.com/ msg/---)

Detecting and Managing Faults 47

Page 48

Display Problematic Components

In this example, the backup battery is problematic as identified by the text following the words fault.chassis.

Compare the output with the examples in “Open Problem Faults” on page 48.

Consider your next step.

■ Replace the component identified in the output.

See “Oracle ILOM Legacy Target Replaceable Components” on page 28 and “Faulted

Item Replaceable Components” on page 30 for links to service tasks.

■ Perform further troubleshooting.

See “Display the General Health of Components and Systems” on page 49 and

“Display Status for Specific Components” on page 53.

Related Information

■

“Open Problem Faults” on page 48

■

“Display the General Health of Components and Systems” on page 49

■

“Oracle ILOM Target Health States” on page 50

■

“Display Active Power Consumption” on page 51

Open Problem Faults

In the output of the /System/Open_Problems target, the string of text that begins with fault. chassis. identifies the faulty component. Additionally, the text that follows Resourceis the

Oracle ILOM target of the component that faulted. This table provides example output for various component faults. Once you identify the component that has faulted, see “Oracle ILOM

Legacy Target Replaceable Components” on page 28 and “Faulted Item Replaceable Components” on page 30 for links to service tasks.

Component Faulted

Ambient temperature

Battery

48 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

/System/Open_Problems Output

Date/Time Subsystems Component ------------------------ ------------------ ------------ Thu Dec 17 05:11:35 2015 System MB (Motherboard) fault.chassis.env.temp.over-fail (Probability: 100, UUID:4c4bdfa1-f7d5-c7a7-e59e-f9a8ce4fab21, Resource:/SYS/MB, Part Number:7092577, Serial Number:BS00329231, Reference Document:http://support.oracle.com/msg/---)

Date/Time Subsystems Component ------------------------ ------------------ ------------ Thu Dec 17 05:00:01 2015 System MB (Motherboard) fault.chassis.battery.fail (Probability:100, UUID:76a2179a-51bd-c836-a7f1-af62953577fa, Resource:/SYS/MB, Part Number:7092577, Serial Number:BS00329231, Reference Document:http://support.oracle.com/msg/---)

Page 49

Display the General Health of Components and Systems

Component Faulted

Fan module

Main board temperature

Main board voltage

Power supply

Related Information

■

/System/Open_Problems Output

Date/Time Subsystems Component ------------------------ ------------------ ------------ Thu Dec 17 05:18:44 2015 System FMx (Fan Module) fault.chassis.device.fan.fail (Probability: 100, UUID:0ebf1655-8700-c90e-fa53-ea6c3b2b25a0, Resource:/SYS/FMx, Part Number:N/A, Serial Number:N/A, Reference Document:http://support.oracle.com/msg/---)

Date/Time Subsystems Component ------------------------ ------------------ ------------ Thu Dec 17 05:04:16 2015 System MB (Motherboard) fault.chassis.temp.shutdown (Probability:50, UUID:01bacc0f-986e-e346-94aa-84e41a1c1595, Resource:/SYS/MB, Part Number:7092577, Serial Number:BS00329231, Reference Document:http://support.oracle.com/msg/---)

Date/Time Subsystems Component ------------------------ ------------------ ------------ Thu Dec 17 05:13:26 2015 System SP (Service Processor) fault.chassis.voltage.fail (Probability: 100, UUID:0a408985-6011-ccd7-c3a1-e01c7254ea87, Resource:/SYS/SP, Part Number:7096151, Serial Number:BS9089M+15306P00M0, Reference Document:http://support.oracle.com/msg/---)

Date/Time Subsystems Component ------------------------ ------------------ ------------ Thu Dec 17 05:17:11 2015 Power PSx (Power Supply 1) fault.chassis.device.psu.fail (Probability: 100, UUID:b516a939-23c2-ee8b-e997-d915ca03d044, Resource:/SYS/PSx, Part Number:7065505-01, Serial Number:BS2517, Reference Document:http://support.oracle.com/msg/---)

“Display Problematic Components” on page 47

“Display the General Health of Components and Systems” on page 49

“Oracle ILOM Target Health States” on page 50

“Display Active Power Consumption” on page 51

Display the General Health of Components and Systems

Access the Oracle ILOM CLI.

See “Accessing the SP” on page 37.

Display the health of the switch components.

-> show /System -t health Target | Property | Value

Detecting and Managing Faults 49

Page 50

Display the General Health of Components and Systems

In the output, identify the health state from the value column.

See “Oracle ILOM Target Health States” on page 50.

Use this table to help identify unhealthy components.

Target Component

/System

/System/Cooling

/System/Networking

/System/Power

Switch

Fan elements

Switch chips

Power supplies

Consider your next step.

■ Perform further troubleshooting.

See “Display Status for Specific Components” on page 53.

■ Replace the component.

See “Oracle ILOM /System Target Replaceable Components” on page 27 or “Faulted

Item Replaceable Components” on page 30 for links to service tasks.

Related Information

■

“Display Problematic Components” on page 47

■

“Open Problem Faults” on page 48

■

“Oracle ILOM Target Health States” on page 50

■

“Display Active Power Consumption” on page 51

Oracle ILOM Target Health States

Use this table to clarify health states as seen in the health property of Oracle ILOM /System targets.

50 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 51

Health state Description

Not Available

Service Required

Switch or hardware component is fully functional.

Oracle ILOM is unable to provide health status for this hardware component.

Oracle ILOM might require HMP to be installed. See the Oracle HMP documentation library at http://

docs.oracle.com/cd/E20451_01/.

Oracle ILOM has detected a problem with the component that requires a service action to resolve the issue.

If this health status appears at the system level, view the /System/Open_Problems target. See “Display

Problematic Components” on page 47. If the health status appears in the Open Problems table, refer to

the URL provided in the table for further details.

Related Information

■

“Display Problematic Components” on page 47

■

“Open Problem Faults” on page 48

■

“Display the General Health of Components and Systems” on page 49

■

“Display Active Power Consumption” on page 51

Display Active Power Consumption

Access the Oracle ILOM CLI.

See “Accessing the SP” on page 37.

Display the power consumed in real time.

-> show /System/Power actual_power_consumption /System/Power Properties: actual_power_consumption = 188 watts

The power is displayed in watts.

Related Information

■

“Display Problematic Components” on page 47

■

“Open Problem Faults” on page 48

■

“Display the General Health of Components and Systems” on page 49

■

“Oracle ILOM Target Health States” on page 50

Detecting and Managing Faults 51

Page 52

Troubleshooting (Oracle ILOM Legacy Targets)

These topics describe how to display measured values for component parameters.

■

“Enable Oracle ILOM Legacy Targets” on page 52

■

“Display Status for Specific Components” on page 53

■

“Clear a Fault Manually” on page 54

■

“Oracle ILOM Legacy Targets for Fault State and FRUID” on page 55

■

“Oracle ILOM Legacy Targets for Alarm State” on page 56

■

“Oracle ILOM Legacy Targets for Power Consumption” on page 58

■

“Oracle ILOM Legacy Targets for Voltage” on page 58

■

“Oracle ILOM Legacy Targets for Temperature” on page 59

■

“Oracle ILOM Legacy Targets for Fan Speeds” on page 60

■

“Oracle ILOM Legacy Targets for LED States” on page 61

■

“Resettable Targets” on page 62

Related Information

■

“Troubleshooting the Switch” on page 15

■

“Identifying Components of Faulted Targets” on page 26

■

“Diagnostic Tools” on page 31

■

“Troubleshooting (LEDs)” on page 31

■

“Accessing the SP” on page 37

■

“Troubleshooting (Oracle ILOM /SP Targets)” on page 42

■

“Troubleshooting (Oracle ILOM /System Targets)” on page 47

Enable Oracle ILOM Legacy Targets

Oracle ILOM legacy targets are not available or functional until you perform this task.

Access the Oracle ILOM CLI.

See “Accessing the SP” on page 37.

Enable the Oracle ILOM legacy targets.

-> set /SP/cli legacy_targets=enabled

Set 'legacy_targets' to 'enabled'

52 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 53

Display Status for Specific Components

You can now perform diagnostics with Oracle ILOM legacy targets.

See “Display Status for Specific Components” on page 53.

Related Information

■

“Display Status for Specific Components” on page 53

■

“Clear a Fault Manually” on page 54

■

“Oracle ILOM Legacy Targets for Fault State and FRUID” on page 55

■

“Oracle ILOM Legacy Targets for Alarm State” on page 56

■

“Oracle ILOM Legacy Targets for Power Consumption” on page 58

■

“Oracle ILOM Legacy Targets for Voltage” on page 58

■

“Oracle ILOM Legacy Targets for Temperature” on page 59

■

“Oracle ILOM Legacy Targets for Fan Speeds” on page 60

■

“Oracle ILOM Legacy Targets for LED States” on page 61

■

“Resettable Targets” on page 62

Display Status for Specific Components

Access the Oracle ILOM CLI.

See “Accessing the SP” on page 37.

If not already done, enable Oracle ILOM legacy targets.

See “Enable Oracle ILOM Legacy Targets” on page 52.

For the type of component status, type the appropriate command.

■ For fault state, type:

-> show target fault_state

where target is from the table in “Oracle ILOM Legacy Targets for Fault State and

FRUID” on page 55. A fault state of OK means no fault. A fault state of Faulted meas

there is a fault.

■ For FRUID, type:

-> show target -d properties

where the target capable of displaying FRUID is from the table in “Oracle ILOM Legacy

Targets for Alarm State” on page 56.

■ For alarm state, type:

Detecting and Managing Faults 53

Page 54

Clear a Fault Manually

-> show target alarm_status

where target is from the table in “Oracle ILOM Legacy Targets for Alarm

State” on page 56. An alarm state of cleared means no alarm. An alarm state of state

asserted means there is an alarm.

■ For power, voltage, temperature, fan speed, or LED state of a component,

type:

-> show target value

where target is from the tables in:

■

“Oracle ILOM Legacy Targets for Power Consumption” on page 58

■

“Oracle ILOM Legacy Targets for Voltage” on page 58

■

“Oracle ILOM Legacy Targets for Temperature” on page 59

■

“Oracle ILOM Legacy Targets for Fan Speeds” on page 60

■

“Oracle ILOM Legacy Targets for LED States” on page 61

If the output of the command indicates a fault or displays values outside normal operating parameters, replace the component indicated by the respective table.

See “Oracle ILOM Legacy Target Replaceable Components” on page 28 or “Faulted Item

Replaceable Components” on page 30 for a link to the service task for that component.

Related Information

■

“Enable Oracle ILOM Legacy Targets” on page 52

■

“Clear a Fault Manually” on page 54

■

“Oracle ILOM Legacy Targets for Fault State and FRUID” on page 55

■

“Oracle ILOM Legacy Targets for Alarm State” on page 56

■

“Oracle ILOM Legacy Targets for Power Consumption” on page 58

■

“Oracle ILOM Legacy Targets for Voltage” on page 58

■

“Oracle ILOM Legacy Targets for Temperature” on page 59

■

“Oracle ILOM Legacy Targets for Fan Speeds” on page 60

■

“Oracle ILOM Legacy Targets for LED States” on page 61

■

“Resettable Targets” on page 62

Clear a Fault Manually

Faults can be detected by Oracle ILOM or the native OS of the SP. The native OS communicates the faults it has discovered to Oracle ILOM.

54 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 55

Clear a Fault Manually

If Oracle ILOM detects a fault and subsequent component replacement, Oracle ILOM automatically clears the fault. However, if the native OS detects a fault, you might need to manually clear the fault from Oracle ILOM after resolution.

If the fault persists after a replacement operation with a known good component, use this procedure to clear the fault.

Access the Oracle ILOM CLI.

See “Accessing the SP” on page 37.

Reset the component to clear the fault manually.

-> set target clear_fault_action=true

where target is the Oracle ILOM target of the faulted component. See “Resettable

Targets” on page 62 for a list of targets.

For example, to reset and clear a fault with power supply 0, type:

-> set /SYS/PS0 clear_fault_action=true Are you sure you want to clear /SYS/PS0 (y/n)? y Set 'clear_fault_action' to 'true'

Related Information

■

“Enable Oracle ILOM Legacy Targets” on page 52

■

“Display Status for Specific Components” on page 53

■

“Oracle ILOM Legacy Targets for Fault State and FRUID” on page 55

■

“Oracle ILOM Legacy Targets for Alarm State” on page 56

■

“Oracle ILOM Legacy Targets for Power Consumption” on page 58

■

“Oracle ILOM Legacy Targets for Voltage” on page 58

■

“Oracle ILOM Legacy Targets for Temperature” on page 59

■

“Oracle ILOM Legacy Targets for Fan Speeds” on page 60

■

“Oracle ILOM Legacy Targets for LED States” on page 61

■

“Resettable Targets” on page 62

Oracle ILOM Legacy Targets for Fault State and FRUID

This table lists components that might be in a fault state, or have FRUID information. See

“Oracle ILOM Legacy Target Replaceable Components” on page 28 or “Faulted Item Replaceable Components” on page 30 for a link to the service task for that component.

Detecting and Managing Faults 55

Page 56

Clear a Fault Manually

Faulted Sensor Oracle ILOM Target Component to Be Replaced

Fan module x fault

Fan module x fan y fault

Main board fault and FRUID

Power supply x fault and FRUID

SP fault and FRUID

System fault and FRUID

/SYS/FMx

/SYS/FMx/FANy

/SYS/MB

/SYS/PSx

/SYS/SP

/SYS

Fan module x

Switch

Power supply x

Switch

Related Information

■

“Enable Oracle ILOM Legacy Targets” on page 52

■

“Display Status for Specific Components” on page 53

■

“Clear a Fault Manually” on page 54

■

“Oracle ILOM Legacy Targets for Alarm State” on page 56

■

“Oracle ILOM Legacy Targets for Power Consumption” on page 58

■

“Oracle ILOM Legacy Targets for Voltage” on page 58

■

“Oracle ILOM Legacy Targets for Temperature” on page 59

■

“Oracle ILOM Legacy Targets for Fan Speeds” on page 60

■

“Oracle ILOM Legacy Targets for LED States” on page 61

■

“Resettable Targets” on page 62

Oracle ILOM Legacy Targets for Alarm State

This table lists components that might be in an alarm state. See “Oracle ILOM Legacy

Target Replaceable Components” on page 28 or “Faulted Item Replaceable Components” on page 30 for a link to the service task for that component.

Sensor in Alarm State Oracle ILOM Target Component to Be Replaced

Exhaust air temperature

Fan module x fan y speed

Fan module x presence

HCA temperature

IB switch chip temperature

Intake air temperature

Main board fault and FRUID

Main board 1.0 VDC

Main board 1.2 VDC

56 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

/SYS/MB/T_OUT

/SYS/FMx/FANy/TACH

/SYS/FMx/PRSNT

/SYS/MB/T_HCA

/SYS/MB/T_IBSWITCH

/SYS/MB/T_AMB

/SYS/MB

/SYS/MB/V_+1V0

/SYS/MB/V_+1V2

Switch

Fan module x

Switch

Page 57

Clear a Fault Manually

Sensor in Alarm State Oracle ILOM Target Component to Be Replaced

Main board 1.5 VDC

Main board 1.8 VDC

Main board 2.5 VDC

Main board 3.3 VDC

Main board HCA 0.85 VDC

Main board HCA 1.05 VDC

Main board IB switch chip 0.85 VDC

Main board IB switch chip 1.05 VDC

Main board MBOM 3.3 VDC

Main board Standby 3.3 VDC

MBOM temperature

Power supply x fault and FRUID

Power supply x input current

Power supply x input power consumed

Power supply x input voltage

Power supply x OK state

Power supply x output current

Power supply x output power delivered

Power supply x output voltage

Power supply x presence

RTC backup battery

SP 1.0 VDC

SP 1.5 VDC

SP 1.8 VDC

SP 3.3 VDC

/SYS/MB/V_+1V5

/SYS/MB/V_+1V8

/SYS/MB/V_+2V5

/SYS/MB/V_+3V3

/SYS/MB/V_+0V85_HCA

/SYS/MB/V_+1V05_HCA

/SYS/MB/V_+0V85_IBSW

/SYS/MB/V_+1V05_IBSW

/SYS/MB/V_+3V3_MBOMA

/SYS/MB/V_+3V3_STDBY

/SYS/MB/T_MBOMx

/SYS/PSx

/SYS/PSx/I_IN

/SYS/PSx/INPUT_POWER

/SYS/PSx/V_IN

/SYS/PSx/PWROK

/SYS/PSx/I_OUT

/SYS/PSx/OUTPUT_POWER

/SYS/PSx/V_OUT

/SYS/PSx/PRSNT

/SYS/MB/V_VBAT

/SYS/SP/V_+1V0

/SYS/SP/V_+1V5

/SYS/SP/V_+1V8

/SYS/SP/V_+3V3

Switch

Power supply x

Battery

Switch

Related Information

■

“Enable Oracle ILOM Legacy Targets” on page 52

■

“Display Status for Specific Components” on page 53

■

“Clear a Fault Manually” on page 54

■

“Oracle ILOM Legacy Targets for Fault State and FRUID” on page 55

■

“Oracle ILOM Legacy Targets for Power Consumption” on page 58

■

“Oracle ILOM Legacy Targets for Voltage” on page 58

■

“Oracle ILOM Legacy Targets for Temperature” on page 59

■

“Oracle ILOM Legacy Targets for Fan Speeds” on page 60

■

“Oracle ILOM Legacy Targets for LED States” on page 61

■

“Resettable Targets” on page 62

Detecting and Managing Faults 57

Page 58

Clear a Fault Manually

Oracle ILOM Legacy Targets for Power Consumption

This table lists power consumption sensors. An excessive or negligible value might indicate a faulted component. See “Oracle ILOM Legacy Target Replaceable

Components” on page 28 or “Faulted Item Replaceable Components” on page 30 for a

link to the service task for that component.

Power Parameter Oracle ILOM Target Component to Be Replaced

Power supply 0 input power consumed

Power supply 0 output power delivered

Power supply 1 input power consumed

Power supply 1 output power delivered

Related Information

■

“Enable Oracle ILOM Legacy Targets” on page 52

■

“Display Status for Specific Components” on page 53

■

“Clear a Fault Manually” on page 54

■

“Oracle ILOM Legacy Targets for Fault State and FRUID” on page 55

■

“Oracle ILOM Legacy Targets for Alarm State” on page 56

■

“Oracle ILOM Legacy Targets for Voltage” on page 58

■

“Oracle ILOM Legacy Targets for Temperature” on page 59

■

“Oracle ILOM Legacy Targets for Fan Speeds” on page 60

■

“Oracle ILOM Legacy Targets for LED States” on page 61

■

“Resettable Targets” on page 62

/SYS/PS0/INPUT_POWER

/SYS/PS0/OUTPUT_POWER

/SYS/PS1/INPUT_POWER

/SYS/PS1/OUTPUT_POWER

Power supply 0

Power supply 1

Oracle ILOM Legacy Targets for Voltage

This table lists voltage sensors. An out-of-range value might indicate a faulted component. See “Oracle ILOM Legacy Target Replaceable Components” on page 28 or “Faulted Item

Replaceable Components” on page 30 for a link to the service task for that component.

Voltage Sensor Oracle ILOM Target

Line voltage into PS 0

Line voltage into PS 1

Main board 1.0 VDC

58 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

/SYS/PS0/V_IN

/SYS/PS1/V_IN

/SYS/MB/V_+1V0

value Range

100 to 252 volts Power source or power cord

0.931 to 1.058 volts Switch

Component to Be Replaced

Page 59

Clear a Fault Manually

Voltage Sensor Oracle ILOM Target

Main board 1.2 VDC

Main board 1.5 VDC

Main board 1.8 VDC

Main board 2.5 VDC

Main board 3.3 VDC

Main board HCA 0.85 VDC

Main board HCA 1.05 VDC

Main board IB switch chip 0.85 VDC

Main board IB switch chip 1.05 VDC

Main board MBOM 3.3 VDC

Main board Standby 3.3 VDC

RTC backup battery

SP 1.0 VDC

SP 1.5 VDC

SP 1.8 VDC

SP 3.3 VDC

Supplied voltage out of PS 0

Supplied voltage out of PS 1

/SYS/MB/V_+1V2

/SYS/MB/V_+1V5

/SYS/MB/V_+1V8

/SYS/MB/V_+2V5

/SYS/MB/V_+3V3

/SYS/MB/V_+0V85_HCA

/SYS/MB/V_+1V05_HCA

/SYS/MB/V_+0V85_IBSW

/SYS/MB/V_+1V05_IBSW

/SYS/MB/V_+3V3_MBOMA

/SYS/MB/V_+3V3_STDBY

/SYS/MB/V_VBAT

/SYS/SP/V_+1V0

/SYS/SP/V_+1V5

/SYS/SP/V_+1V8

/SYS/SP/V_+3V3

/SYS/PS0/V_OUT

/SYS/PS1/V_OUT

value Range

1.127 to 1.274 volts Switch

1.352 to 1.646 volts Switch

1.686 to 1.911 volts Switch

2.359 to 2.652 volts Switch

3.120 to 3.490 volts Switch

0.823 to 0.931 volts Switch

1.000 to 1.127 volts Switch

0.823 to 0.931 volts Switch

1.000 to 1.127 volts Switch

3.120 to 3.490 volts Switch

> 2.548 volts Battery

0.872 to 1.117 volts Switch

1.352 to 1.646 volts Switch

1.578 to 2.009 volts Switch

2.944 to 3.685 volts Switch

10 to 14 volts Power supply 0

10 to 14 volts Power supply 1

Component to Be Replaced

Related Information

■

“Enable Oracle ILOM Legacy Targets” on page 52

■

“Display Status for Specific Components” on page 53

■

“Clear a Fault Manually” on page 54

■

“Oracle ILOM Legacy Targets for Fault State and FRUID” on page 55

■

“Oracle ILOM Legacy Targets for Alarm State” on page 56

■

“Oracle ILOM Legacy Targets for Power Consumption” on page 58

■

“Oracle ILOM Legacy Targets for Temperature” on page 59

■

“Oracle ILOM Legacy Targets for Fan Speeds” on page 60

■

“Oracle ILOM Legacy Targets for LED States” on page 61

■

“Resettable Targets” on page 62

Oracle ILOM Legacy Targets for Temperature

This table lists temperature sensors. An out-of-range value might indicate a faulted component. See “Oracle ILOM Legacy Target Replaceable Components” on page 28 or “Faulted Item

Replaceable Components” on page 30 for a link to the service task for that component.

Detecting and Managing Faults 59

Page 60

Clear a Fault Manually

Temperature Sensor Oracle ILOM Target

Exhaust air temperature

HCA temperature

IB switch chip temperature

Intake air temperature

MBOM x temperature

/SYS/MB/T_OUT

/SYS/MB/T_HCA

/SYS/MB/T_IBSWITCH

/SYS/MB/T_AMB

/SYS/MB/T_MBOMx

Related Information

■

“Enable Oracle ILOM Legacy Targets” on page 52

■

“Display Status for Specific Components” on page 53

■

“Clear a Fault Manually” on page 54

■

“Oracle ILOM Legacy Targets for Fault State and FRUID” on page 55

■

“Oracle ILOM Legacy Targets for Alarm State” on page 56

■

“Oracle ILOM Legacy Targets for Power Consumption” on page 58

■

“Oracle ILOM Legacy Targets for Voltage” on page 58

■

“Oracle ILOM Legacy Targets for Fan Speeds” on page 60

■

“Oracle ILOM Legacy Targets for LED States” on page 61

■

“Resettable Targets” on page 62

value Range

0 to 65 degrees C Switch

0 to 100 degrees C Switch

0 to 40 degrees C Switch

0 to 70 degrees C Switch

Component to Be Replaced

Oracle ILOM Legacy Targets for Fan Speeds

This table lists speed sensors. An out-of-range value might indicate a faulted component. See

“Oracle ILOM Legacy Target Replaceable Components” on page 28 or “Faulted Item Replaceable Components” on page 30 for a link to the service task for that component.

Speed Sensor Oracle ILOM Target

Fan 0 speed of fan module 0

Fan 1 speed of fan module 0

Fan 0 speed of fan module 1

Fan 1 speed of fan module 1

Fan 0 speed of fan module 2

Fan 1 speed of fan module 2

Fan 0 speed of fan module 3

Fan 1 speed of fan module 3

60 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

/SYS/FM0/FAN0/TACH

/SYS/FM0/FAN1/TACH

/SYS/FM1/FAN0/TACH

/SYS/FM1/FAN1/TACH

/SYS/FM2/FAN0/TACH

/SYS/FM2/FAN1/TACH

/SYS/FM3/FAN0/TACH

/SYS/FM3/FAN1/TACH

value Range

6000 to 24000 RPM Fan module 0

6000 to 24000 RPM Fan module 1

6000 to 24000 RPM Fan module 2

6000 to 24000 RPM Fan module 3

Component to Be Replaced

Page 61

Clear a Fault Manually

Related Information

■

“Enable Oracle ILOM Legacy Targets” on page 52

■

“Display Status for Specific Components” on page 53

■

“Clear a Fault Manually” on page 54

■

“Oracle ILOM Legacy Targets for Fault State and FRUID” on page 55

■

“Oracle ILOM Legacy Targets for Alarm State” on page 56

■

“Oracle ILOM Legacy Targets for Power Consumption” on page 58

■

“Oracle ILOM Legacy Targets for Voltage” on page 58

■

“Oracle ILOM Legacy Targets for Temperature” on page 59

■

“Oracle ILOM Legacy Targets for LED States” on page 61

■

“Resettable Targets” on page 62

Oracle ILOM Legacy Targets for LED States

This table lists components with LEDs, the value property of which might indicate a fault state. See “Oracle ILOM Legacy Target Replaceable Components” on page 28 or “Faulted Item

Replaceable Components” on page 30 for a link to the service task for that component.

Component LED Oracle ILOM Target Component to Be Replaced

Attention LED

Fan module Attention LED

Locate LED

OK LED

SP LED

/SYS/SERVICE

/SYS/FMx/SERVICE

/SYS/LOCATE

/SYS/OK

/SYS/SP/OK

Switch

Fan module x

Switch

Related Information

■

“Enable Oracle ILOM Legacy Targets” on page 52

■

“Display Status for Specific Components” on page 53

■

“Clear a Fault Manually” on page 54

■

“Oracle ILOM Legacy Targets for Fault State and FRUID” on page 55

■

“Oracle ILOM Legacy Targets for Alarm State” on page 56

■

“Oracle ILOM Legacy Targets for Power Consumption” on page 58

■

“Oracle ILOM Legacy Targets for Voltage” on page 58

■

“Oracle ILOM Legacy Targets for Temperature” on page 59

■

“Oracle ILOM Legacy Targets for Fan Speeds” on page 60

■

“Resettable Targets” on page 62

Detecting and Managing Faults 61

Page 62

Clear a Fault Manually

Resettable Targets

This table lists Oracle ILOM targets that are resettable through their clear_fault_action property and the related components with manual reset capability. Use this table for the task

“Clear a Fault Manually” on page 54.

Target Component

/SYS

/SYS/MB

/SYS/FMx Fan module x, where x is 0 to 3

/SYS/FMx/FANy Fan unit y installed in module x, where y is either 0 or 1 and x is 0 to 3

/SYS/PSx Power supply x, where x is either 0 or 1

/SYS/SP

Related Information

Switch

Main board

■

“Enable Oracle ILOM Legacy Targets” on page 52

■

“Display Status for Specific Components” on page 53

■

“Clear a Fault Manually” on page 54

■

“Oracle ILOM Legacy Targets for Fault State and FRUID” on page 55

■

“Oracle ILOM Legacy Targets for Alarm State” on page 56

■

“Oracle ILOM Legacy Targets for Power Consumption” on page 58

■

“Oracle ILOM Legacy Targets for Voltage” on page 58

■

“Oracle ILOM Legacy Targets for Temperature” on page 59

■

“Oracle ILOM Legacy Targets for Fan Speeds” on page 60

■

“Oracle ILOM Legacy Targets for LED States” on page 61

62 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 63

Preparing for Service

These topics describe how to prepare the switch for servicing.

Step Description Link

1. Review safety and handling information. “Safety Information” on page 64

2. Gather the tools for service. “Service Tools” on page 65

3. Read the switch serial number through Oracle ILOM. “Read the Switch Serial Number (Oracle

4. Identify the switch to be serviced. “Locate the Switch” on page 67

5. Locate the component service information. “Faulted Item Replaceable Components” on page 30

6. Take antistatic precautions. “Prevent ESD Damage” on page 67

You can now service the PrizmMT, SFP+, and RJ-45 cables. “Servicing Data Cables” on page 81

7. Remove the air duct assembly.

Note - You can now physically read the serial number.

You can now service these components:

ILOM)” on page 66

“Remove the Air Duct Assembly” on page 68

“Servicing the Battery” on page 107

■ Battery

■ Fan modules

8. Remove the snap brackets. “Remove a Snap Bracket” on page 72

9. Power off the power supply. “Prepare to Power Off the Switch” on page 75

You can now service these components:

■ Power supplies

■ Switch

“Servicing Fan Modules” on page 119

“Power Off a Power Supply” on page 76

“Servicing Power Supplies” on page 129

“Replacing the Switch” on page 139

Related Information

■

“Identifying Components” on page 11

■

“Detecting and Managing Faults” on page 15

■

“Servicing Data Cables” on page 81

■

“Servicing the Battery” on page 107

■

“Servicing Fan Modules” on page 119

■

“Servicing Power Supplies” on page 129

Preparing for Service 63

Page 64

Safety Information

■

“Replacing the Switch” on page 139

■

“Returning the Switch to Operation” on page 153

Safety Information

For your protection, observe these safety precautions when setting up your equipment:

■

Follow all cautions and instructions marked on the equipment and described in the documentation shipped with your switch.

■

Follow all cautions and instructions marked on the equipment and described in the switch's safety and compliance guide.

■

Ensure that the voltage and frequency of your power source match the voltage and frequency inscribed on the equipment's electrical ratings label.

■

Follow the electrostatic discharge safety practices as described here.

Safety Symbols

Note the meanings of these symbols that might appear in this document.

Caution - There is a risk of personal injury or equipment damage. To avoid personal injury and

equipment damage, follow the instructions.

Caution - Hot surface. Avoid contact. Surfaces are hot and might cause personal injury if

touched.

Caution - Hazardous voltages are present. To reduce the risk of electric shock and danger to

personal health, follow the instructions.

ESD Measures

Some ESD-sensitive devices require special handling.

Caution - Circuit boards contain electronic components that are extremely sensitive to static

electricity. Ordinary amounts of static electricity from clothing or the work environment can destroy the components located on these boards. Do not touch the components along their connector edges.

64 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 65

Service Tools

Antistatic Wrist Strap Use

Wear an antistatic wrist strap and use an antistatic mat when handling components such as power supplies and fan modules. When servicing or removing switch components, attach an antistatic strap to your wrist and then to a metal area on the chassis. Following this practice equalizes the electrical potentials between you and the switch.

Antistatic Mat

Place ESD-sensitive components on an antistatic mat. These items can be used as an antistatic mat:

■

Antistatic bag used to wrap a replacement part

■

ESD mat

■

Disposable ESD mat (shipped with some replacement parts)

Related Information

■

“Service Tools” on page 65

■

“Read the Switch Serial Number (Oracle ILOM)” on page 66

■

“Locate the Switch” on page 67

■

“Prevent ESD Damage” on page 67

■

“Remove the Air Duct Assembly” on page 68

■

“Remove a Snap Bracket” on page 72

■

“Prepare to Power Off the Switch” on page 75

■

“Power Off a Power Supply” on page 76

Service Tools

You need these tools for most service operations:

■

Antistatic wrist strap

■

Antistatic mat

■

No. 1 Phillips screwdriver

■

No. 2 Phillips screwdriver

■

Paper clip

■

PrizmMT ferrule cleaner - USConec part number 16899

Preparing for Service 65

Page 66

Read the Switch Serial Number (Oracle ILOM)

Related Information

■

“Safety Information” on page 64

■

“Read the Switch Serial Number (Oracle ILOM)” on page 66

■

“Locate the Switch” on page 67

■

“Prevent ESD Damage” on page 67

■

“Remove the Air Duct Assembly” on page 68

■

“Remove a Snap Bracket” on page 72

■

“Prepare to Power Off the Switch” on page 75

■

“Power Off a Power Supply” on page 76

Read the Switch Serial Number (Oracle ILOM)

If you require technical support for your switch, you will be asked to provide the chassis serial number. You can read the chassis serial number from a pull-out strip located on the front of the switch, to the left of the left power supply. Additionally, there is an RFID tag on the SER MGT module.

You must remove the air duct assembly to access the strip or RFID tag. See “Remove the Air

Duct Assembly” on page 68 for instructions on how to read the serial number from the

plastic strip or RFID tag.

If it is not convenient to read the strip or the RFID tag, you can use Oracle ILOM to obtain the chassis serial number.

Access the Oracle ILOM CLI.

See “Accessing the SP” on page 37.

Display the serial number.

-> show /SYS product_serial_number

 /SYS Properties: product_serial_number = 1133BDN082

Related Information

■

“Safety Information” on page 64

■

“Service Tools” on page 65

■

“Locate the Switch” on page 67

■

“Prevent ESD Damage” on page 67

66 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 67

■

“Remove the Air Duct Assembly” on page 68

■

“Remove a Snap Bracket” on page 72

■

“Prepare to Power Off the Switch” on page 75

■

“Power Off a Power Supply” on page 76

Locate the Switch

You can use the Locate LED to pinpoint the location of a switch. This task is helpful when you need to identify one particular switch from many other rack components.

Note - Unlike other Oracle products, the Locate LED is only at the rear of the switch and does

not have button functionality. You control the Locate LED through Oracle ILOM.

Access the Oracle ILOM CLI.

See “Accessing the SP” on page 37.

Set the Locate LED to blink.

-> set /SYS/LOCATE value=Fast_Blink

Locate the Switch

The white Locate LED blinks.

After servicing the switch with the blinking Locate LED, turn the LED off.

-> set /SYS/LOCATE value=off

Related Information

■

“Safety Information” on page 64

■

“Service Tools” on page 65

■

“Read the Switch Serial Number (Oracle ILOM)” on page 66

■

“Prevent ESD Damage” on page 67

■

“Remove the Air Duct Assembly” on page 68

■

“Remove a Snap Bracket” on page 72

■

“Prepare to Power Off the Switch” on page 75

■

“Power Off a Power Supply” on page 76

Prevent ESD Damage

Many components housed within the chassis can be damaged by electrostatic discharge. To protect these components from damage, perform these steps before opening the chassis for service. See “Safety Information” on page 64.

Preparing for Service 67

Page 68

Remove the Air Duct Assembly

Prepare an antistatic surface to set parts on during the removal, installation, or replacement process.

Place ESD-sensitive components, such as printed circuit boards, on an antistatic mat.

Attach an antistatic wrist strap.

When servicing or removing switch components, attach an antistatic strap to your wrist and then to a metal area on the chassis.

Consider your next task.

■ If you are servicing a data cable, see “Remove a Data Cable” on page 89.

■ If you are servicing any other component, see “Remove the Air Duct

Assembly” on page 68.

Related Information

■

“Safety Information” on page 64

■

“Service Tools” on page 65

■

“Read the Switch Serial Number (Oracle ILOM)” on page 66

■

“Locate the Switch” on page 67

■

“Remove the Air Duct Assembly” on page 68

■

“Remove a Snap Bracket” on page 72

■

“Prepare to Power Off the Switch” on page 75

■

“Power Off a Power Supply” on page 76

Remove the Air Duct Assembly

If the rack front door is installed, open it.

68 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 69

Grasp the air duct assembly at the left and right edges.

Remove the Air Duct Assembly

Pull the air duct assembly straight out of the rack.

Consider your next step.

■ If there is no SER MGT connection, set the air duct assembly aside.

■ If you have a full-time SER MGT connection:

Disconnect the SER MGT cable from the SER MGT port.

Preparing for Service 69

Page 70

Remove the Air Duct Assembly

Pass the SER MGT cable back through the air duct assembly until the cable is free.

Set the air duct assembly aside.

(Optional) Read the chassis serial number from the plastic strip.

70 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 71

Pull the plastic strip that is to the left of the left power supply.

Read the serial number.

Remove the Air Duct Assembly

Slide the strip back into the chassis.

If you are not performing further service on the switch, install the air duct assembly.

See “Install the Air Duct Assembly” on page 166.

(Optional) Read the chassis serial number from the RFID tag.

Place the RFID reader sensor next to the RFID tag on the SMM.

Read the serial number.

If you are not performing further service on the switch, install the air duct assembly.

See “Install the Air Duct Assembly” on page 166.

Consider your next task.

■ Remove the battery

See “Remove the Battery” on page 109.

■ Remove a fan module

Preparing for Service 71

Page 72

Remove a Snap Bracket

See “Remove a Fan Module” on page 123.

■ If you are removing a power supply or removing the switch, first see

“Remove a Snap Bracket” on page 72.

Related Information

■

“Safety Information” on page 64

■

“Service Tools” on page 65

■

“Read the Switch Serial Number (Oracle ILOM)” on page 66

■

“Locate the Switch” on page 67

■

“Prevent ESD Damage” on page 67

■

“Remove a Snap Bracket” on page 72

■

“Prepare to Power Off the Switch” on page 75

■

“Power Off a Power Supply” on page 76

Remove a Snap Bracket

Consider your next step.

■ If you are removing a power supply, perform the next step on the snap bracket in front of that power supply.

■ If you are removing the switch, perform the next step on either snap bracket.

Using a No. 2 Phillips screwdriver, loosen the two screws securing the snap bracket by one rotation.

72 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 73

Note - Do not remove the screws, just loosen them for one rotation.

Remove a Snap Bracket

Preparing for Service 73

Page 74

Remove a Snap Bracket

Slide off the snap bracket and set it aside.

Consider your next step.

■ If you are removing a power supply, turn the power supply off.

See “Power Off a Power Supply” on page 76.

■ If you are removing the switch, repeat Step 2 and Step 3 for the other snap

bracket.

Prepare to power off the switch.

See “Prepare to Power Off the Switch” on page 75.

Related Information

■

“Safety Information” on page 64

■

“Service Tools” on page 65

■

“Read the Switch Serial Number (Oracle ILOM)” on page 66

■

“Locate the Switch” on page 67

74 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 75

■

“Prevent ESD Damage” on page 67

■

“Remove the Air Duct Assembly” on page 68

■

“Prepare to Power Off the Switch” on page 75

■

“Power Off a Power Supply” on page 76

Prepare to Power Off the Switch

Perform this task before powering off the switch for a switch replacement.

Note - The steps of this task are a generalization of what is to be done. For more thorough

instructions on how to accomplish these steps, refer to the Oracle EDR InfiniBand Switch and Virtualized I/O Systems Administration Guide, the Oracle Fabric Manager 5.0 Administration Guide, and the Oracle Fabric OS 1.0 Administration Guide.

Notify affected users that the switch is to be shut down.

Access the SCP on the switch to be removed.

See “Access the SCP (RJ-45 Port)” on page 39.

Prepare to Power Off the Switch

If the switch to be removed is configured with the master Subnet Manager, initiate a handover to the standby Subnet Manager.

Refer to the Oracle Fabric Manager 5.0 Administration Guide. Wait for any handover to complete.

If the switch to be removed is configured with any Subnet Manager, set the priority to the lowest.

Refer to the Oracle Fabric Manager 5.0 Administration Guide.

Create a backup of the switch configuration for the switch to be removed.

On the switch, create a backup of the Oracle Fabric Manager configuration.

Refer to the Oracle Fabric Manager 5.0 Administration Guide.

On the switch, create a backup of the Oracle Fabric OS configuration.

Refer to the Oracle Fabric OS 1.0 Administration Guide.

Access the SP.

See “Access the SP (RJ-45 Port)” on page 37

Write the SEFOS configuration to Oracle ILOM, and create a backup of the Oracle ILOM configuration.

Preparing for Service 75

Page 76

Power Off a Power Supply

Power off the switch.

See “Power Off a Power Supply” on page 76.

Related Information

■

This backs up the SEFOS configuration. Refer to the Oracle EDR InfiniBand Switch and Virtualized I/O Systems Administration Guide.

Transfer the backup files to a safe place.

“Safety Information” on page 64

“Service Tools” on page 65

“Read the Switch Serial Number (Oracle ILOM)” on page 66

“Locate the Switch” on page 67

“Prevent ESD Damage” on page 67

“Remove the Air Duct Assembly” on page 68

“Remove a Snap Bracket” on page 72

“Power Off a Power Supply” on page 76

Power Off a Power Supply

Note - Powering off both power supplies powers off the switch.

Consider your first step.

■ If you are removing a power supply, locate the power supply to be removed and its power cord.

Note - If a power supply has failed, its Attention LED lights.

■ If you are powering off the switch, choose either power cord.

76 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 77

Remove the power cord from the power supply.

Power Off a Power Supply

Remove the power cord in a slow wiggling motion.

Caution - Pulling or jerking the cord out from the power supply might cause your hand to catch

on the snap brackets, if they are installed.

The power supply is completely powered off.

Consider your next step.

■ If you are powering off the power supply for switch configuration, go to Step

■ If you are powering off the power supply to remove the power supply or switch, go to Step 4.

Preparing for Service 77

Page 78

Power Off a Power Supply

Feed the power cord back through the opening in the long front mounting bracket.

78 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 79

Power Off a Power Supply

If the SER MGT cable also passes through the opening with the power cord, feed the SER MGT cable back through the opening.

Consider your next step.

■ If you powered off the power supply to remove it, do that now.

See “Remove a Power Supply” on page 133.

■ If you powered off a power supply to power off the switch, repeat from Step

2 to power off the other power supply, and power off the switch.

Consider your next step.

■ If you are removing the switch, disconnect the data cables from the switch.

See “Remove a Data Cable” on page 89.

■ If you are configuring the switch, connect the data cables to the switch.

See “Install a Data Cable” on page 98.

Preparing for Service 79

Page 80

Power Off a Power Supply

Related Information

■

“Safety Information” on page 64

“Service Tools” on page 65

“Read the Switch Serial Number (Oracle ILOM)” on page 66

“Locate the Switch” on page 67

“Prevent ESD Damage” on page 67

“Remove the Air Duct Assembly” on page 68

“Remove a Snap Bracket” on page 72

“Prepare to Power Off the Switch” on page 75

80 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 81

Servicing Data Cables

Data cables provide a conduit for high-speed Ethernet network and IB fabric communication. The data cables are located across the rear of the switch. PrizmMT cables are on the left, SFP+ cables are in the center, and RJ-45 cables are on the right. See “Identifying

Components” on page 11.

Description Links

Familiarize yourself with the three cable types. “Identifying Data Cable Types” on page 82

Replace a faulty data cable. “Locate a Faulty Data Cable” on page 85

“Remove a Data Cable” on page 89

“(Optional) Assemble the Optical Fiber SFP+ Cables” on page 96

“Install a Data Cable” on page 98

“Verify a Data Cable” on page 104

Remove a data cable as part of another component's service operation.

Install a data cable as part of another component's service operation.

Add additional data cables. “(Optional) Assemble the Optical Fiber SFP+

“Remove a Data Cable” on page 89

“Install a Data Cable” on page 98

“(Optional) Clean the PrizmMT Receptacle or Connector Ferrule” on page 104

Cables” on page 96

“Install a Data Cable” on page 98

“(Optional) Clean the PrizmMT Receptacle or Connector Ferrule” on page 104

“Verify a Data Cable” on page 104

Decrease the number of existing data cables. “Remove a Data Cable” on page 89

Identify a faulty data cable. “Locate a Faulty Data Cable” on page 85

“Detecting and Managing Faults” on page 15

Related Information

■

“Identifying Components” on page 11

Servicing Data Cables 81

Page 82

Identifying Data Cable Types

■

“Detecting and Managing Faults” on page 15

■

“Preparing for Service” on page 63

■

“Servicing the Battery” on page 107

■

“Servicing Fan Modules” on page 119

■

“Servicing Power Supplies” on page 129

■

“Replacing the Switch” on page 139

■

“Returning the Switch to Operation” on page 153

Identifying Data Cable Types

These topics discuss the data cables for the switch.

■

“PrizmMT Cables” on page 83

■

“SFP+ Cable Transceivers” on page 84

■

“RJ-45 Cables” on page 84

Related Information

■

“Locate a Faulty Data Cable” on page 85

■

“Remove a Data Cable” on page 89

■

“(Optional) Assemble the Optical Fiber SFP+ Cables” on page 96

■

“Install a Data Cable” on page 98

■

“Verify a Data Cable” on page 104

■

“(Optional) Clean the PrizmMT Receptacle or Connector Ferrule” on page 104

82 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 83

PrizmMT Cables

Identifying Data Cable Types

No. Description

1 PrizmMT ferrule

2 Magenta-colored housing (4x technology)

Black-colored housing (12x technology)

This table lists the marketing part numbers for the supported cables.

Length 12x PrizmMT 4x PrizmMT 4x PrizmMT to 4x Standard MT

1m 7111615 7111595 7111607

2m 7111616 7111596 7111608

3m 7111617 7111598 7111609

5m 7111618 7111599 7111610

10m 7111642 7111600 7111611

20m 7111644 7111601 7111612

50m 7111646 7111603 7111613

70m 7111647 7111605 7111614

Related Information

■

“SFP+ Cable Transceivers” on page 84

Servicing Data Cables 83

Page 84

Identifying Data Cable Types

■

“RJ-45 Cables” on page 84

SFP+ Cable Transceivers

This table lists the marketing part numbers for the supported transceivers.

Part Number Technology

7111909 SFP+ 10GBASE-T adapter (transceiver)

Related Information

■

“PrizmMT Cables” on page 83

■

“RJ-45 Cables” on page 84

RJ-45 Cables

RJ-45 cables should be of Category 6, 6e, or 7 specifications.

84 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 85

Related Information

■

“PrizmMT Cables” on page 83

■

“SFP+ Cable Transceivers” on page 84

Locate a Faulty Data Cable

You must determine which data cable is faulty before you replace it.

Consider your first step.

■ If you are at the switch, go to Step 2.

■ If you are remote to the switch, go to Step 3.

At the rear of the switch, check the Link LEDs of the SFP+ and RJ-45 connectors.

For each cable connected to a known functional host, the Link LED should be on. See “SFP+

Link LEDs” on page 33 and “RJ-45 Link LEDs” on page 34.

■ If the Link LED of the data cable is off, replace that cable. See “Remove a Data Cable” on page 89.

■ If you cannot determine if a cable is faulty, go to Step 3.

Access the Oracle ILOM CLI.

See “Accessing the SP” on page 37.

Verify Ethernet connectivity.

Start the EMS console.

Servicing Data Cables 85

Page 86

Locate a Faulty Data Cable

-> start /System/Networking/Switches/Switch_0/fs_cli Are you sure you want to start /System/Networking/Switches/Switch_0/fs_cli (y/n)? y Management Switch for Oracle InfiniBand Switch IS2-46 SEFOS login:

SEFOS login: root Password: password SEFOS#

The default password is admin123.

Display the state of the Ethernet ports.

SEFOS# show interfaces status

Port Status Duplex Speed Negotiation Capability

---- ------ ------ ----- ----------- ---------Gi0/1 not connected Half - Auto Auto-MDIX on Gi0/2 connected Full 1 Gbps Auto Auto-MDIX on Gi0/3 connected Full 1 Gbps Auto Auto-MDIX on Gi0/4 not connected Half - Auto Auto-MDIX on Gi0/5 not connected Half - Auto Auto-MDIX on Gi0/6 connected Full 1 Gbps Auto Auto-MDIX on Gi0/7 not connected Half - Auto Auto-MDIX on ... Gi0/13 connected Full 1 Gbps Auto Auto-MDIX on ... Gi0/23 not connected Half - Auto Auto-MDIX on Gi0/23 connected Full 1 Gbps Auto Auto-MDIX on Gi0/25 connected Full 1 Gbps Auto Auto-MDIX on Gi0/26 connected Full 1 Gbps Auto Auto-MDIX on Ex0/1 not connected Full 10 Gbps No-Negotiation Auto-MDIX on Ex0/2 not connected Full 10 Gbps No-Negotiation Auto-MDIX on SEFOS#

In the output, Port is the port as seen on the rear panel. Ports Gi0/25 and Gi0/26 are internal to the switch architecture. Ports Ex0/1 and Ex0/2 are the two SFP+ uplink ports. The Status is the state of the port. The Duplex, Speed, and Negotiation are the parameters of the link. The Capability indicates if auto-crossover capability is on.

If the status of a known-connected port is anything other than connected, replace the cable attached to that port.

See “Remove a Data Cable” on page 89.

Exit the EMS console.

86 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 87

SEFOS# exit Connection closed by foreign host

Entering character mode Escape character is '^]'. start: The session with /System/Networking/Switches/Switch_0/fs_cli has ended.

Verify IB and gateway connectivity.

Start the host.

-> start /HOST/console Are you sure you want to start /HOST/console (y/n)? y  Serial console started. To stop, type ESC (

Press Enter.

[user@hostname ~]#

where:

Locate a Faulty Data Cable

■

user is the current username.

■

hostname is the host name of the SCP.

Switch to user admin with password admin.

[user@hostname ~]# su admin Welcome to IBOS Controller Copyright (c) 2012-2015 Oracle Corp. All rights reserved. Enter "help" for information on available commands. Enter the command "show system copyright" for licensing information admin@hostname[OFOS]

Note - From here forward in this document, the admin@hostname[OFOS] prompt is replaced

with simply [OFOS].

If this is the first time OFOS is accessed, the OFOS configuration wizard might start. If this happens, refer to the Oracle InfiniBand Switch IS2-46 Installation Guide, running the OFOS configuration wizard.

Display the state of the gateway ports.

[OFOS] show ioports name type state descr v-resources

-----------------------------------------------------------------------------0/1 gwEthernet10GbPort up/indeterminate 0

Servicing Data Cables 87

Page 88

Locate a Faulty Data Cable

0/2 gwEthernet10GbPort up/indeterminate 0 0/3 gwEthernet10GbPort up/indeterminate 0 0/4 gwEthernet10GbPort up/indeterminate 0 0/5 gwEthernet10GbPort up/indeterminate 0 0/6 gwEthernet10GbPort up/indeterminate 0 0/7 gwEthernet10GbPort up/indeterminate 0 0/8 gwEthernet10GbPort up/indeterminate 0 8 records displayed [OFOS]

In the output, the name is the port number as seen on the rear panel. The state is of the local port/peer port. The descr is the node descriptor of the peer port. The v-resources are the number of VLANs and VNICs supported on that port.

Display the state of the IB ports.

[OFOS] show infiniband-port name state mode_state guid

-----------------------------------------------------------------------------0/1 up/down switching 0 0/2 up/down switching 0 0/3 up/down switching 0 0/4 up/down switching 0 . . . 0/27 up/down switching 0 0/28 up/down switching 0 0/29 up/down switching 0 0/30 up/down switching 0 30 records displayed [OFOS]

In the output, the name is the port number as seen on the rear panel. The state is of the local port/peer port. The mode_state is the condition of the link. The guid is the GUID of the peer port.

If in the output of these commands a port is identified as being in a down state, or if a link mode_state is other than switching, replace the cable attached to that port.

See “Remove a Data Cable” on page 89.

Exit the host console.

Type exit and press the Enter key, then press the Esc key and type (.

[OFOS] exit [root@nsn156-168 ~]# Serial console stopped.

88 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 89

If you are unable to determine if a data cable is faulty, seek further information.

See “Detecting and Managing Faults” on page 15.

Related Information

■

“Identifying Data Cable Types” on page 82

■

“Remove a Data Cable” on page 89

■

“(Optional) Assemble the Optical Fiber SFP+ Cables” on page 96

■

“Install a Data Cable” on page 98

■

“Verify a Data Cable” on page 104

■

“(Optional) Clean the PrizmMT Receptacle or Connector Ferrule” on page 104

Remove a Data Cable

Removing a single data cable is a hot-swap operation. If you are removing all data cables as part of a switch replacement, the switch must be powered off.

This task describes how to remove the cables from the switch, so that the cable can be replaced. If you are removing all cables for switch replacement, start removing the cables from the left side of the switch, working your way to the right.

Note - These instructions are valid for both IB and Ethernet data cables.

Determine which data cable to remove.

See “Locate a Faulty Data Cable” on page 85.

Consider your next step.

■ If you have not prepared for service, you must do so now.

See “Preparing for Service” on page 63.

■ If you have completed those prerequisite tasks, go to Step 3.

Servicing Data Cables 89

Page 90

Remove a Data Cable

Loosen the thumbscrews and remove the cover for the CMB.

Locate the cable to be removed.

(Optional) If necessary, label that cable so that its corresponding port, its peer, or both, are identified.

Consider your next steps.

If you are removing all cables for switch replacement, start with the PrizmMT cables.

■ If you are removing a PrizmMT cable, go to Step 7.

■ If you are removing a one-piece copper core SFP+ cable, go to Step 8.

■ If you are removing an assembled fiber optic SFP+ cable, go to Step 9.

■ If you are removing an RJ-45 cable, go to Step 10.

Remove a PrizmMT cable.

Pinch the PrizmMT cable connector housing between your thumb and forefinger.

90 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 91

The housing is either magenta or black colored.

Remove a Data Cable

With a steady force, pull the PrizmMT connector straight out of the receptacle.

Go to Step 11.

Remove a one-piece copper core SFP+ cable.

Grasp the cable connector to support its weight, and apply the removal force.

Pull on the retractor strap while simultaneously pulling on the cable connector.

Servicing Data Cables 91

Page 92

Remove a Data Cable

The cable connector comes free.

Go to Step 11.

Remove an assembled fiber optic SFP+ cable.

92 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 93

Press the release tab on the LC connector and pull back.

Remove a Data Cable

The LC connector and fiber optic cable come free of the transceiver.

Servicing Data Cables 93

Page 94

Remove a Data Cable

Release the latch on the SFP+ transceiver and pull on the latch to remove the transceiver.

The transceiver comes free.

Set the transceiver aside.

Go to Step 11.

10.

Remove an RJ-45 cable.

Pinch the top and bottom of the RJ-45 connector between your thumb and forefinger.

94 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 95

Use either your thumb or forefinger to depress the release tab.

Pull the RJ-45 connector straight out of the receptacle.

11.

Carefully move the cable out of the CMB.

Remove a Data Cable

12.

Cap the end of the cable if possible.

13.

Repeat Step 4 and Step 12 for any additional cables to be removed.

14.

Consider your next steps.

■ If you removed a data cable as part of a replacement operation, disconnect the other end of the cable, and install a new data cable.

See “Install a Data Cable” on page 98.

■ If you removed all of the data cables for switch removal task, do that now.

See “Remove the Switch” on page 143.

■ If you are not replacing the data cable, go to Step 15.

15.

If you removed a PrizmMT cable, put a filler plug into that receptacle.

Servicing Data Cables 95

Page 96

(Optional) Assemble the Optical Fiber SFP+ Cables

16.

Replace the cover for the CMB and tighten the thumbscrews.

Related Information

■

“Identifying Data Cable Types” on page 82

■

“Locate a Faulty Data Cable” on page 85

■

“(Optional) Assemble the Optical Fiber SFP+ Cables” on page 96

■

“Install a Data Cable” on page 98

■

“Verify a Data Cable” on page 104

■

“(Optional) Clean the PrizmMT Receptacle or Connector Ferrule” on page 104

(Optional) Assemble the Optical Fiber SFP+ Cables

If the optical SFP+ cables are unassembled, you must assemble the cables before connecting them to the switch.

Note - The ends of the optical fiber cable and the receptacles of the transceivers must be clean

and optically clear before assembly. Do not remove the protective caps from the optical fiber cable or the plugs from the transceivers until instructed to do so.

96 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 97

(Optional) Assemble the Optical Fiber SFP+ Cables

Identify the prerequisite and subsequent installation tasks that you must perform in conjunction with this task.

See “Servicing Data Cables” on page 81.

Remove the SFP+ optical transceivers and fiber optic cables from their packaging.

Remove the plug from an SFP+ optical transceiver.

Remove the caps from an LC connector of the fiber optic cable.

Holding the shafts of the LC connector, insert the LC connector into the receptacles of the SFP+ optical transceiver.

Note - The LC connector and SFP+ receptacles are keyed for proper fitting.

Push the connector into the transceiver until it clicks.

Repeat Step 3 through Step 6 for the other end of the cable.

Servicing Data Cables 97

Page 98

Install a Data Cable

Repeat Step 2 through Step 7 for any additional optical fiber SFP+ cables to be installed.

Install the cable or return to that task.

See “Install a Data Cable” on page 98.

Related Information

■

“Identifying Data Cable Types” on page 82

■

“Locate a Faulty Data Cable” on page 85

■

“Remove a Data Cable” on page 89

■

“Install a Data Cable” on page 98

■

“Verify a Data Cable” on page 104

■

“(Optional) Clean the PrizmMT Receptacle or Connector Ferrule” on page 104

Install a Data Cable

Installing a single data cable is a hot-swap operation. If you are installing all data cables at one time, the switch should be in a powered off state.

Consider your first steps.

■ If you are replacing a data cable, remove the faulty or obsolete data cable first, then return to Step 3 of this task.

See “Remove a Data Cable” on page 89.

■ If you are installing a replacement cable, go to Step 3.

■ If you are adding an additional data cable, see “Preparing for

Service” on page 63, and then go to Step 2.

■ If you are installing a data cable as part of a switch installation task, go to

Step 6.

98 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016

Page 99

Install a Data Cable

If you have not already done so, loosen the thumbscrews and remove the cover for the CMB.

If you are installing an optical fiber SFP+ cable that needs assembly, assemble the cable now.

See “(Optional) Assemble the Optical Fiber SFP+ Cables” on page 96.

Connect the replacement cable to the remote location, and route it to the switch.

See the Oracle InfiniBand Switch IS2-46 Installation Guide, routing data cables.

Bring the cable to the switch and remove its protective cap, if installed.

Consider your next steps.

If you are installing all cables as part of a switch replacement, start with the RJ-45 cables.

■ If you are installing an RJ-45 cable, go to Step 7.

■ If you are installing an SFP+ cable, go to Step 8.

■ If you are installing a PrizmMT cable, go to Step 9.

Install an RJ-45 cable.

Servicing Data Cables 99

Page 100

Install a Data Cable

Align the RJ-45 connector to where it will install into the receptacle.

The tab on the connector is up for the upper row of receptacles and down for the lower row of receptacles.

Firmly press the RJ-45 connector into the receptacle until you hear a click.

Go to Step 10.

Install an SFP+ cable.

Align the SFP+ connector to where it will install into the receptacle.

100 Oracle InfiniBand Switch IS2-46 Service Manual • September 2016