Sgi UV 3000 User Manual

SGI® UV 3000 System User Guide
Document Number 007-6402-001
COPYRIGHT
© 2015 SGI. All rights reserved; provided portions may be copyright in third parties, as indicated elsewhere herein. No permission is granted to copy, distribute, or create derivative works from the contents of this electronic documentation in any manner, in whole or in part, without the prior written permission of SGI.
LIMITED RIGHTS LEGEND
The electronic (software) version of this document was developed at private expense; if acquired under an agreement with the USA government or any contractor thereto, it is acquired as “commercial computer software” subject to the provisions of its applicable license agreement, as specified in (a) 48 CFR
12.212 of the FAR; or, if acquired for Department of Defense units, (b) 48 CFR 227-7202 of the DoD FAR Supplement; or sections succeeding thereto. Contractor/manufacturer is SGI, 900 North McCarthy Blvd. Milpitas, CA 95035.
TRADEMARKS AND ATTRIBUTIONS
Silicon Graphics, SGI, the SGI logo, NUMAlink, NUMAflex, FullCare, FullExpress, and HardwareCare are trademarks or registered trademarks of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries worldwide.
Intel, Itanium and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.
UNIX is a registered trademark in the United States and other countries, licensed exclusively through X/Open Company, Ltd.
Infiniband is a trademark of the InfiniBand Trade Association.
LSI, MegaRAID, and MegaRAID Storage Manager are trademarks or registered trademarks of LSI Corporation.
Linux is a registered trademark of Linus Torvalds in the U.S. and other countries.
Red Hat and all Red Hat-based trademarks are trademarks or registered trademarks of Red Hat, Inc. in the United States and other countries.
SUSE LINUX is a registered trademark of Novell Inc.
Windows is a registered trademark of Microsoft Corporation in the United States and other countries.
All other trademarks mentioned herein are the property of their respective owners.
Record of Revision
Version Description
-001 August, 2015
First Release
007-6402-001 iii
Contents
List of Figures . . . . . . . . . . . . . . . . . . . . . . . . xi
List of Tables . . . . . . . . . . . . . . . . . . . . . . . . xiii
Audience. . . . . . . . . . . . . . . . . . . . . . . . . . xv
Important Information . . . . . . . . . . . . . . . . . . . . . . xv
Chapter Descriptions . . . . . . . . . . . . . . . . . . . . . . xvi
Related Publications . . . . . . . . . . . . . . . . . . . . . . .xvii
Conventions . . . . . . . . . . . . . . . . . . . . . . . . . xix
Product Support . . . . . . . . . . . . . . . . . . . . . . . . xx
Reader Comments . . . . . . . . . . . . . . . . . . . . . . . xx
1. Operation Procedures . . . . . . . . . . . . . . . . . . . . . . 1
Precautions . . . . . . . . . . . . . . . . . . . . . . . . . 1
ESD Precaution . . . . . . . . . . . . . . . . . . . . . . . 1
Safety Precautions . . . . . . . . . . . . . . . . . . . . . . 2
Power Connections Overview . . . . . . . . . . . . . . . . . . . . 2
Preparing to Power On . . . . . . . . . . . . . . . . . . . . . 3
SGI UV 3000 PDUs . . . . . . . . . . . . . . . . . . . . . 4
North America PDU Options . . . . . . . . . . . . . . . . . . 4
International PDU Options. . . . . . . . . . . . . . . . . . . 5
Additional PDU Overview information . . . . . . . . . . . . . . . 5
System Connections Overview . . . . . . . . . . . . . . . . . . . . 8
Connecting to the UV System Control Network . . . . . . . . . . . . . . 8
RMC System Control Access . . . . . . . . . . . . . . . . . . . 9
007-6402-001 v
Contents
UV 3000 System Connections . . . . . . . . . . . . . . . . . . . . 10
Serial Port Connection to the RMC . . . . . . . . . . . . . . . . . . 10
USB-Connected Console Hardware Requirements. . . . . . . . . . . . . 11
Ethernet (LAN) Connection to the RMC . . . . . . . . . . . . . . . . 11
Establishing RMC IP Hardware Connections . . . . . . . . . . . . . . . 12
Using DHCP to Establish an IP Address . . . . . . . . . . . . . . . 12
Using a Static IP Address . . . . . . . . . . . . . . . . . . . 13
Controlling the UV 3000 System . . . . . . . . . . . . . . . . . . . 13
UV 3000 IPMI 2.x Administration Overview . . . . . . . . . . . . . . . 13
Power On Example Using the RMC Network Connection . . . . . . . . . . . . 14
The Command Line Interface . . . . . . . . . . . . . . . . . . . 14
Example CLI Commands Used. . . . . . . . . . . . . . . . . . 15
Powering On and Off from the Command Line Interface . . . . . . . . . . . . 16
Power On Example . . . . . . . . . . . . . . . . . . . . . 16
Power Down Example . . . . . . . . . . . . . . . . . . . . 16
Reset System Example . . . . . . . . . . . . . . . . . . . . 16
Power Status Check Example . . . . . . . . . . . . . . . . . . 16
Monitoring Power On Example . . . . . . . . . . . . . . . . . . . 16
Power off an SGI UV 3000 System . . . . . . . . . . . . . . . . . . 17
Optional In-Rack Console Server and Flat-Panel Interface . . . . . . . . . . . . . 19
Optional In-Rack Console Server . . . . . . . . . . . . . . . . . . 19
Optional SGI Remote Services (SGI RS) . . . . . . . . . . . . . . . . . 21
SGI Remote Services Primary Capabilities . . . . . . . . . . . . . . . . 22
SGI Remote Services Benefits . . . . . . . . . . . . . . . . . . . 22
SGI Remote Service Operations Overview . . . . . . . . . . . . . . . . 22
Optional Components . . . . . . . . . . . . . . . . . . . . . . 24
PCIe Cards . . . . . . . . . . . . . . . . . . . . . . . . 24
PCIe Drive Controllers in BaseIO Blade . . . . . . . . . . . . . . . . 26
RAID PCIe Disk Controller . . . . . . . . . . . . . . . . . . 26
Non-RAID PCIe Disk Controller . . . . . . . . . . . . . . . . . 27
vi 007-6402-001
Contents
2. System Control . . . . . . . . . . . . . . . . . . . . . . . . 29
Levels of System Control . . . . . . . . . . . . . . . . . . . . . 29
RMC and System Management Overview . . . . . . . . . . . . . . . . 30
CMC Overview . . . . . . . . . . . . . . . . . . . . . . . 31
BMC Overview . . . . . . . . . . . . . . . . . . . . . . . 32
System Controller Interaction . . . . . . . . . . . . . . . . . . . . 33
IRU Controllers . . . . . . . . . . . . . . . . . . . . . . . . 34
Chassis Management Controller Functions. . . . . . . . . . . . . . . . 34
1U Console Plus Admin Server Option . . . . . . . . . . . . . . . . 34
Flat Panel Rackmount Console Option Features . . . . . . . . . . . . . 35
3. System Overview . . . . . . . . . . . . . . . . . . . . . . . 37
System Models . . . . . . . . . . . . . . . . . . . . . . . . 39
System Architecture . . . . . . . . . . . . . . . . . . . . . . . 41
System Features . . . . . . . . . . . . . . . . . . . . . . . . 43
Modularity and Scalability . . . . . . . . . . . . . . . . . . . . 43
Distributed Shared Memory (DSM) . . . . . . . . . . . . . . . . . 43
Distributed Shared I/O . . . . . . . . . . . . . . . . . . . . . 45
Chassis Management Controller (CMC) . . . . . . . . . . . . . . . . 45
ccNUMA Architecture . . . . . . . . . . . . . . . . . . . . . 45
Cache Coherency . . . . . . . . . . . . . . . . . . . . . 45
Non-uniform Memory Access (NUMA) . . . . . . . . . . . . . . . 46
Reliability, Availability, and Serviceability (RAS) . . . . . . . . . . . . . 46
System Components . . . . . . . . . . . . . . . . . . . . . . . 48
Optional BaseIO SSDs . . . . . . . . . . . . . . . . . . . . . 50
MIC/GPU Enabled Compute Blade . . . . . . . . . . . . . . . . . 51
Bay (Unit) Numbering . . . . . . . . . . . . . . . . . . . . . 52
Rack Numbering . . . . . . . . . . . . . . . . . . . . . . 52
Optional System Components . . . . . . . . . . . . . . . . . . . 52
4. Rack Information . . . . . . . . . . . . . . . . . . . . . . . 53
Overview . . . . . . . . . . . . . . . . . . . . . . . . . 53
SGI UV 3000 Series Rack (42U) . . . . . . . . . . . . . . . . . . . 54
SGI UV 3000 42U System Rack Technical Specifications . . . . . . . . . . . . . 58
007-6402-001 vii
Contents
The 24U (Short) Rack . . . . . . . . . . . . . . . . . . . . . . 59
5. Optional Octal Router Chassis Information . . . . . . . . . . . . . . . . 61
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . 61
SGI UV 3000 Series NUMAlink Octal Router Chassis . . . . . . . . . . . . . . 62
SGI UV 3000 External NUMAlink System Technical Specifications . . . . . . . . . . 64
6. Add or Replace Procedures . . . . . . . . . . . . . . . . . . . . 65
Maintenance Precautions and Procedures . . . . . . . . . . . . . . . . . 65
Preparing the System for Maintenance or Upgrade . . . . . . . . . . . . . . 66
Returning the System to Operation . . . . . . . . . . . . . . . . . . 66
Removing and Replacing an IRU Enclosure Power Supply . . . . . . . . . . . . . 67
Replacing a System Fan (Blower) . . . . . . . . . . . . . . . . . . . 69
Replacing a Blade-Mounted Drive . . . . . . . . . . . . . . . . . . . 72
7. Troubleshooting and Diagnostics . . . . . . . . . . . . . . . . . . . 75
Troubleshooting Chart . . . . . . . . . . . . . . . . . . . . . . 76
LED Status Indicators . . . . . . . . . . . . . . . . . . . . . . 77
IRU Power Supply LEDs . . . . . . . . . . . . . . . . . . . . 77
Compute/Memory Blade LEDs . . . . . . . . . . . . . . . . . . . 78
SGI Electronic Support . . . . . . . . . . . . . . . . . . . . . . 79
SGI Remote Services (SGI RS) . . . . . . . . . . . . . . . . . . . 79
SGI Knowledgebase . . . . . . . . . . . . . . . . . . . . . . 79
SGI Warranty Levels . . . . . . . . . . . . . . . . . . . . . 79
A. Technical Specifications and Pinouts . . . . . . . . . . . . . . . . . . 81
System-level Specifications . . . . . . . . . . . . . . . . . . . . . 81
Physical Specifications . . . . . . . . . . . . . . . . . . . . . . 82
Environmental Specifications . . . . . . . . . . . . . . . . . . . . 83
Power Specifications . . . . . . . . . . . . . . . . . . . . . . . 84
I/O Port Specifications . . . . . . . . . . . . . . . . . . . . . . 85
BaseIO VGA Port Information . . . . . . . . . . . . . . . . . . . 85
Ethernet Port. . . . . . . . . . . . . . . . . . . . . . . . 87
Serial Ports . . . . . . . . . . . . . . . . . . . . . . . . 88
USB Type A Connector . . . . . . . . . . . . . . . . . . . . . 90
viii 007-6402-001
Contents
B. Safety Information and Regulatory Specifications . . . . . . . . . . . . . . 91
Safety Information . . . . . . . . . . . . . . . . . . . . . . . 91
Regulatory Specifications . . . . . . . . . . . . . . . . . . . . . 93
CMN Number . . . . . . . . . . . . . . . . . . . . . . . 93
CE Notice and Manufacturer’s Declaration of Conformity . . . . . . . . . . . 93
Electromagnetic Emissions . . . . . . . . . . . . . . . . . . . . 94
FCC Notice (USA Only) . . . . . . . . . . . . . . . . . . . 94
Industry Canada Notice (Canada Only) . . . . . . . . . . . . . . . 95
VCCI Notice (Japan Only). . . . . . . . . . . . . . . . . . . 95
Korean Class A Regulatory Notice . . . . . . . . . . . . . . . . 95
Shielded Cables . . . . . . . . . . . . . . . . . . . . . . . 96
Electrostatic Discharge . . . . . . . . . . . . . . . . . . . . . 96
Laser Compliance Statements . . . . . . . . . . . . . . . . . . . 97
Lithium Battery Statement . . . . . . . . . . . . . . . . . . . . 98
007-6402-001 ix

List of Figures

Figure 1-1 UV 3000 Blade Enclosure Power Supply and Cable Location Example . 3
Figure 1-2 Single-Phase 8-Outlet PDU Example . . . . . . . . . . 6
Figure 1-3 Three-Phase PDU Example . . . . . . . . . . . . . 7
Figure 1-4 SGI UV RMC Front Panel Connections Example . . . . . . . 9
Figure 1-5 RMC Ethernet LAN (WAN Port) and CNSL Location Example . . . 11
Figure 1-6 Optional In-Rack Console Server Example (Front View) . . . . . 19
Figure 1-7 Optional (In-Rack) Administrative Console Server Rear View Example . 20
Figure 1-8 Flat Panel Rackmount Console Interface Option . . . . . . . 21
Figure 1-9 SGI Remote Services Process Overview. . . . . . . . . . 23
Figure 1-10 PCIe Option Blade Example with Full-Height and Low-Profile Slots . . 25
Figure 1-11 PCIe Option Blade Example with Two Low-Profile Slots . . . . . 25
Figure 1-12 BaseIO Blade and PCIe Disk Controller Example . . . . . . . 26
Figure 2-1 RMC Node Front Panel Example . . . . . . . . . . . 31
Figure 2-2 SGI UV 3000 LAN-attached Remote System Control Example . . . 32
Figure 2-3 Optional 1U Rackmount Console . . . . . . . . . . . 35
Figure 2-4 Optional (In-Rack) 1U System Administration Node Rear View . . . 36
Figure 3-1 SGI UV 3000 D-Rack System and Front Lock Example . . . . . 38
Figure 3-2 SGI UV 3000 IRU and Rack Example . . . . . . . . . . 40
Figure 3-3 Functional Block Diagram of the Individual Rack Unit (IRU) . . . . 42
Figure 3-4 SGI UV 3000 Blade Nodes Block Diagram Example . . . . . . 44
Figure 3-5 SGI UV 3000 IRU System Components Example . . . . . . . 49
Figure 3-6 BaseIO Riser Enabled Blade Front Panel Example . . . . . . . 50
Figure 3-7 MIC/GPU Enabled Compute Blade Example Front View . . . . . 51
Figure 4-1 SGI UV Air-cooled D-Rack Example (Rear Lock Shown) . . . . . 55
Figure 4-2 Front Lock on Tall (42U) Rack . . . . . . . . . . . . 56
Figure 4-3 Optional Water-Chilled Cooling Units on Rear of SGI 42U Rack . . . 57
Figure 4-4 UV 24U (Short) Rack Example Front View . . . . . . . . . 59
007-6402-001 xi
List of Figures
Figure 4-5 SGI 24U (Short) Rack Rear View Example . . . . . . . . . 60
Figure 5-1 SGI UV 3000 Optional NUMAlink ORC (Rear View) . . . . . . 62
Figure 5-2 SGI UV 3000 Optional ORC Chassis Example (Front View) . . . . 63
Figure 6-1 Removing an Enclosure Power Supply . . . . . . . . . . 67
Figure 6-2 Replacing an IRU Enclosure Power Supply . . . . . . . . . 68
Figure 6-3 UV 3000 Rear Fan Assembly (Blowers) . . . . . . . . . . 70
Figure 6-4 Removing a Fan From the Rear Assembly . . . . . . . . . 71
Figure 6-5 Replacing an Enclosure Fan . . . . . . . . . . . . . 72
Figure 6-6 Removing the UV 3000 System Disk Example . . . . . . . . 73
Figure 6-7 Replacing a UV 3000 Blade-Mounted Disk Example . . . . . . 74
Figure 7-1 UV Compute Blade Status LED Locations Example . . . . . . . 78
Figure A-1 VGA Port Pinouts . . . . . . . . . . . . . . . . 85
Figure A-2 Ethernet Port . . . . . . . . . . . . . . . . . 87
Figure A-3 Serial Port Connector . . . . . . . . . . . . . . . 88
Figure A-4 Pin Number Locations for USB Type A Connector . . . . . . . 90
Figure B-1 VCCI Notice (Japan Only) . . . . . . . . . . . . . 95
Figure B-2 Korean Class A Regulatory Notice . . . . . . . . . . . 95
xii 007-6402-001

List of Tables

Table 4-1 Tall Rack Technical Specifications . . . . . . . . . . . 58
Table 4-2 Short (24U) Rack Technical Specifications . . . . . . . . . 60
Table 5-1 External NUMAlink Technical Specifications . . . . . . . . 64
Table 7-1 Troubleshooting Chart . . . . . . . . . . . . . . 76
Table 7-2 Power Supply LED States . . . . . . . . . . . . . 77
Table A-1 SGI UV 3000 System Configuration Ranges . . . . . . . . 81
Table A-2 SGI UV 3000 Physical Specifications . . . . . . . . . . 82
Table A-3 Environmental Specifications . . . . . . . . . . . . 83
Table A-4 Power Specifications . . . . . . . . . . . . . . . 84
Table A-5 VGA Pin Functions . . . . . . . . . . . . . . . 86
Table A-6 Ethernet Pinouts . . . . . . . . . . . . . . . . 87
Table A-7 Serial Port Pinout. . . . . . . . . . . . . . . . 89
Table A-8 Pin Assignments for USB Type A Connector . . . . . . . . 90
007-6402-001 xiii

About This Guide

This guide provides an overview of the architecture, general operation and descriptions of the major components that compose the SGI procedures for powering on and powering off the system, basic troubleshooting and maintenance information, and important safety and regulatory specifications.

Audience

This guide is written for owners, system administrators, and users of SGI UV 3000 computer systems. It is written with the assumption that the reader has a good working knowledge of computers and computer systems.

Important Information

Warning: To avoid problems that could void your warranty, your SGI or other approved
installation or service provider should perform all the set up, addition, or replacement of parts, cabling, and service of your SGI UV 3000 system, with the exception of the following items that you can perform yourself as needed:
Using your system console controller to enter commands and perform system functions such as powering on and powering off, as described in this guide.
UV 3000 family of servers. It also provides the standard
Adding and replacing PCIe cards in stand-alone service nodes.
Adding and replacing disk drives in stand-alone service nodes.
Using the On/Off switch and other switches on the rack PDUs.
Using the ESI/ops panel (operating panel) on optional mass storage bricks.
007-6402-001 xv
About This Guide

Chapter Descriptions

The following topics are covered in this guide:
Chapter 1, “Operation Procedures,” provides instructions for powering on and powering off
Chapter 2, “System Control,” describes the function of the overall system control network
Chapter 3, “System Overview,” provides technical overview information needed to
Chapter 4, “Rack Information,” describes the rack sizes and general features.
Chapter 5, “Optional Octal Router Chassis Information,” describes the optional NUMAlink
Chapter 6, “Add or Replace Procedures,” provides instructions for installing or removing the
Chapter 7, “Troubleshooting and Diagnostics,” provides recommended actions if problems
Appendix A, “Technical Specifications and Pinouts‚" provides physical, environmental, and
your system.
interface and provides basic instructions for operating the controllers.
understand the basic functional architecture of the SGI UV 3000 systems.
router technology available in SGI UV 3000 systems consisting of two or more racks. This router technology is available in an enclosure “package” known as the Octal Router Chassis.
customer-replaceable components of your system.
occur on your system.
power specifications for your system. Also included are the pinouts for the non-proprietary connectors.
Appendix B, “Safety Information and Regulatory Specifications‚" lists regulatory information related to use of the UV 3000 system in the United States and other countries. It also provides a list of safety instructions to follow when installing, operating, or servicing the product.
xvi 007-6402-001

Related Publications

The following SGI documents are relevant to the UV 3000 series system at the time this document was published:
Related Publications
SGI UV CMC Software User Guide
(P/N 007-5636-00x)
This guide describes how to use the system console controller commands to monitor and manage your SGI UV 3000 system via line commands. Coverage of control includes descriptions of the interface and usage of the commands. Note that it does not cover controller command information for the SGI UV 10, UV 20, UV 30, UV 300 or UV 300EX.
SGI UV RMC Software User Guide
(P/N 007-6361-00x)
At time of publication, each UV 3000 system includes a rack management controller (RMC). The SGI UV RMC Software User Guide describes:
Connecting to the RMC
Using RMC commands
Using open source ipmitool(1) commands for remote management
You can use the RMC commands and open source ipmitool(1) commands to monitor and manage SGI UV 3000 systems locally or remotely.
SGI UV System Software Installation and Configuration Guide
(P/N 007-5948-00x)
In UV systems that come with pre-installed Linux software operating systems; this document describes how to re-install it when necessary. Also, this guide is a reference document for people who manage the operation of SGI UV 3000 systems. It explains how to perform general system configuration and operation under Linux for SGI UV. For a list of manuals supporting SGI Linux releases and SGI online resources, see the SGI Performance Suite documentation.
Linux Application Tuning Guide for SGI X86-64 Based Systems
(P/N 007-5646-00x)
This guide includes a chapter that covers advanced tuning strategies for applications running on SGI UV systems as well as other SGI X86 based systems.
Man pages (online)
Man pages locate and print the titled entries from the online reference manuals.
007-6402-001 xvii
About This Guide
You can obtain SGI documentation, release notes, or man pages in the following ways:
See the SGI Technical Publications Library at http://docs.sgi.com
Various formats are available. This library contains the most recent and most comprehensive set of online books, release notes, man pages, and other information.
SGI Foundation Software release notes and the SGI Performance Suite release notes contain information about the specific software packages provided in those products. The release notes also list SGI publications that provide information about the products. The release notes are available in the following locations:
Online at Supportfolio (only by signing in to Supportfolio): https://support.sgi.com/login
SGI Foundation Software release notes are posted to the following website:
https://support.sgi.com/content_request/194480/index.html
The SGI Performance Suite release notes are posted to the following website:
https://support.sgi.com/content_request/786853/index.html
On the product media. The release notes reside in a text file in the /docs directory on the product media. For example, /docs/SGI-MPI-1.x-readme.txt.
On the system. After installation, the release notes and other product documentation reside in the /usr/share/doc/packages/product directory.
You can also view man pages by typing man <title> on a command line.
SGI systems shipped with Linux include a set of Linux man pages, formatted in the standard UNIX “man page” style. Important system configuration files and commands are documented on man pages. These are found online on the internal system disk (or DVD) and are displayed using the man command. References in the documentation to these pages include the name of the command and the section number in which the command is found. For example, to display a man page, type the request on a command line:
man commandx
For additional information about displaying man pages using the man command, see man(1). In addition, the apropos command locates man pages based on keywords. For example, to display a list of man pages that describe disks, type the following on a command line:
apropos disk
For information about setting up and using apropos, see apropos(1).
xviii 007-6402-001

Conventions

Conventions
The following conventions are used throughout this document:
Convention Meaning
Command This fixed-space font denotes literal items such as commands, files,
routines, path names, signals, messages, and programming language structures.
variable The italic typeface denotes variable entries and words or concepts being
defined. Italic typeface is also used for book titles.
user input This bold fixed-space font denotes literal items that the user enters in
interactive sessions. Output is shown in nonbold, fixed-space font.
[ ] Brackets enclose optional portions of a command or directive line.
... Ellipses indicate that a preceding element can be repeated.
man page(x) Man page section identifiers appear in parentheses after man page names.
GUI element This font denotes the names of graphical user interface (GUI) elements such
as windows, screens, dialog boxes, menus, toolbars, icons, buttons, boxes, fields, and lists.
007-6402-001 xix
About This Guide

Product Support

Reader Comments

SGI provides a comprehensive product support and maintenance program for its products, as follows:
If you are in North America, contact the Technical Assistance Center at +1 800 800 4SGI or contact your authorized service provider.
If you are outside North America, contact the SGI subsidiary or authorized distributor in your country. International customers can visit http://www.sgi.com/support/ Click on the “Support Centers” link under the “Online Support” heading for information on how to contact your nearest SGI customer support center.
If you have comments about the technical accuracy, content, or organization of this document, contact SGI. Be sure to include the title and document number of the manual with your comments. (Online, the document number is located in the front matter of the manual. In printed manuals, the document number is located at the bottom of each page.)
You can contact SGI in any of the following ways:
Send e-mail to the following address: techpubs@sgi.com
Contact your customer service representative and ask that an incident be filed in the SGI incident tracking system.
SGI values your comments and will respond to them promptly.
xx 007-6402-001
Chapter 1

1. Operation Procedures

This chapter explains the basics of how to operate your new system in the following sections:
“Precautions” on page 1
“Power Connections Overview” on page 2
“System Connections Overview” on page 8
“UV 3000 System Connections” on page 10
“Controlling the UV 3000 System” on page 13
“Optional In-Rack Console Server and Flat-Panel Interface” on page 19
“Optional SGI Remote Services (SGI RS)” on page 21
“Optional Components” on page 24

Precautions

Before operating your system, familiarize yourself with the safety information in the following sections:
“ESD Precaution” on page 1
“Safety Precautions” on page 2

ESD Precaution

Caution: Observe all ESD precautions. Failure to do so can result in damage to the equipment.
Wear a grounding wrist strap when you handle any ESD-sensitive device to eliminate possible ESD damage to equipment. Connect the wrist strap cord directly to earth ground.
007-6402-001 1
1: Operation Procedures

Safety Precautions

Warning: Before operating or servicing any part of this product, read the “Safety
Information” on page 91.
Danger: Keep fingers and conductive tools away from high-voltage areas. Failure to
follow these precautions will result in serious injury or death. The high-voltage areas of the system are indicated with high-voltage warning labels.
Caution: !Power off the system only after the system software has been shut down in an orderly
manner. If you power off the system before you halt the operating system, data may be corrupted.
Warning: If a lithium battery is installed in your system as a soldered part, only qualified
SGI service personnel should replace this lithium battery. For a battery of another type, replace it only with the same type or an equivalent type recommended by the battery manufacturer, or an explosion could occur. Discard used batteries according to the manufacturer’s instructions.

Power Connections Overview

Prior to operation, your SGI UV 3000 system should be set up and connected by a professional installer. If you are powering on the system for the first time or want to confirm proper power connections, follow these steps:
1. Check to ensure that the power connector on the cable between the rack’s power distribution units (PDUs) and the wall power-plug receptacles are securely plugged in.
2. Setting the circuit breakers on the PDUs to the “On” position will apply power to the system’s blade enclosures and will start the CMC in each of the enclosures. Note that the CMC in each blade enclosure stays powered on as long as there is power coming into the unit. Turn off the PDU breaker switch on each of the PDUs that supply voltage to the enclosure’s power supplies if you want to remove all power from the unit.
2 007-6402-001
Power Connections Overview
When possible, each power supply in a blade enclosure should be connected to a different PDU within the rack. This will ensure the maximum amperage output of a single PDU is not exceeded if a power supply fails.
Power cord
Figure 1-1 UV 3000 Blade Enclosure Power Supply and Cable Location Example
3. If you plan to power on a server that includes optional mass storage enclosures, make sure
that the power switch on the rear of each PSU/cooling module (one or two per storage enclosure) is in the
1 (on) position.
4. Make sure that all PDU circuit breaker switches (see the examples in Figure 1-2 on page 6
and Figure 1-3 on page 7) are turned on to provide power to the server when the system is powered on.

Preparing to Power On

To prepare to power on your system, follow these steps:
1. Check to ensure that the power connector on the cable between th
units (PDUs) and the wall power-plug receptacles are securely plugged in.
2. For each individual UV 3000 blade enclosure that you want to power on, make sure that the
power cables are plugged into all the power supplies correctly, see the example in Figure 1-1. Setting the circuit breakers on the PDUs to the “On” position will apply power to
007-6402-001 3
e rack’s power distribution
1: Operation Procedures
3. If you plan to power on a UV 3000 system that includes optional mass storage enclosures,
4. Make sure that all PDU circuit breaker switches are turned on to provide power to the server

SGI UV 3000 PDUs

The SGI UV 3000 systems can use different types of power distribution units (PDUs). The type used can depend on operating location (country) and power needs. The following subsections list optional North American and International PDU information available at the time this document was published. Check with your SGI sales or service organization for additional information.
North America PDU Options
Two outlet single-phase 220V PDU (C19 outlets @ 16 Amps max per outlet)
the individual UV 3000 IRUs and will start the RMC node if it is plugged into the same PDU. Turn off the PDU breaker switch on the PDU(s) that supply voltage to the chassis or RMC power supplies if you want to remove all power from a particular unit.
make sure that the power switch on the rear of each PSU/cooling module (one or two per enclosure) is in the
1 (on) position.
when the system is powered on.
NEMA L6-30 plug with 3.66 m cable (24 Amp max output per PDU)
Eight outlet single-phase 220V PDU (IEC320 C13 outlets 15 Amp max on each)
NEMA L6-30 plug with 3.66 m cable (24 Amp max output per PDU)
Nine outlet three-phase 220V PDU (IEC320 C19 outlets @ 20 Amps max per outlet)
4-wire, delta-connected 60 Amp IEC60309 plug with 3.66 m cable
Nine outlet three-phase 220V PDU w/monitoring (C19 outlets)
same specifications as (9-outlet unit) above
Eighteen outlet three-phase 480V PDU w/monitoring (three-pin Souriau outlets for North America only)
60A, 277/480V, IEC60309 560P7W plug with 2.44 m cable
4 007-6402-001
International PDU Options
Two outlet single-phase 220V PDU (IEC320 C19 outlets A 16 Amps max per outlet)
NEMA L6-30 plug with 3.66 m cable (24 Amp max output per PDU)
Eight outlet single-phase 220V PDU (IEC320 C13 outlets @ 15 Amps max per outlet)
IEC60309 plug with 3.66 m cable (32 Amp max output per PDU)
Nine outlet three-phase 220V PDU (IEC320 19 outlets @ 20 Amps max per outlet)
5-wire, 415V, 32A IEC60309 plug (WYE) with 3.66 m cable (60 Amp max per PDU)
Nine outlet three-phase 220V PDU w/monitoring (C19 outlets)
same specifications as (9-outlet unit) above
Additional PDU Overview information
Note: SGI PDUs are designed to fit into SGI racks. The use of SGI PDUs in 3rd-party racks may require custom mounting hardware. If SGI PDUs are not used, the installer needs to connect each power supply to a 20-Amp certified circuit breaker with properly rated C13/C14 cordage.
Power Connections Overview
Figure 1-2 on page 6 shows an example of an eight-plug single-phase PDU that can be used in the SGI UV 3000 rack system. This unit is primarily used to support auxiliary equipment in the rack.
007-6402-001 5
Power distribution unit (PDU)
Power source
1: Operation Procedures
Figure 1-2 Single-Phase 8-Outlet PDU Example
6 007-6402-001
Power Connections Overview
Figure 1-3 shows an example of a three-phase PDU that can be used in the SGI UV 3000 system. These PDUs are used to distribute
power to the UV blade enclosures when the system is
configured with three-phase power.
Figure 1-3 Three-Phase PDU Example
007-6402-001 7
1: Operation Procedures

System Connections Overview

You can monitor and interact with your SGI UV 3000 server from the following sources:
Using the optional SGI 1U rackmount console option you can connect directly to the system console node for basic monitoring and administration of the system. See Admin Server Option” in Chapter 2 for more information.
A PC or workstation on the local area network (LAN) can connect to the RMC’s external Ethernet port and set up remote console sessions.
These console connections enable you to view the status and error messages generated by the chassis management controllers in your SGI UV 3000 system. For example, you can monitor error messages that warn of power or temperature values that are out of tolerance. See the section Console Plus Admin Server Option” in Chapter 2, for additional information. The following subsections describe the options for establishing and using communication connections to work with your SGI UV 3000.

Connecting to the UV System Control Network

“1U Console Plus
“1U
All SGI UV 3000 systems use a rack management controller (RMC) node which communicates with the chassis management controllers (CMCs) which in turn communicate with the blade management controllers (BMCs). These components in concert are generically known as the system control network. The SGI UV 3000 system control network provides control and monitoring functionality for each chassis, blade, power supply, and fan assembly in the system.
The RMC is connected to each of the CMCs in the system via an external Ethernet cable. CMCs are connected to the BMCs via the chassis backplane. Note that the RMC supports a maximum of 24 Ethernet ports for CMC interconnect. The CMCs and their enclosures must all be localized.
Note that the RMC does not contain a BMC or directly physically connect with any blade BMC.
The RMC/CMC network provides the following functionality:
Powering the entire system on and off.
Powering individual UV chassis on and off.
Monitoring the environmental state of the system, including voltage levels.
Monitors and controls status LEDs on the enclosure.
8 007-6402-001
System Connections Overview
Supports entry of controller commands to view and/or change system configuration
parameters. See the SGI UV RMC Software User Guide (P/N 007-6361-00x) for a complete list of command line interface (CLI) commands.
Provides access to the system OS console allow
Provides the ability to flash system BIOS.

RMC System Control Access

Access to the SGI UV 3000 system controller network is accomplished by the following methods:
A LAN connection to the RJ-45
A USB-to-micro-USB serial connection to the
the RMC front panel example.
ing you to run diagnostics and boot the OS.
WAN port on the RMC node, (see Figure 1-4).
“Console” port (see CNSL in Figure 1-4) on
WAN LAN connector
CNSL micro-USB connector
Figure 1-4 SGI UV RMC Front Panel Connections Example
Once a connection to the RMC is established, the connection can be used to monitor, configure, power on and power off the UV3000 system.
007-6402-001 9
1: Operation Procedures

UV 3000 System Connections

Administrative commands for the SGI UV 3000 system are through the RMC interface/UV command line interface (CLI) or through an IPMI 2.x LAN interface.
The Ethernet connection is the most common method of accessing the system console. The RMC acts as an administrative focal-point for UV 3000 systems.
Administrators/users can perform one of the following options for connectivity:
An in-rack or portable system console can be directly connected to the RMC micro-USB connect port, (labeled laptop or workstation that is physically located near the system. Note that the USB connection requires use of a terminal emulator on the connected system.
A LAN connection allows access to the RMC via ssh, or via an IPMI 2.x client. The RMC supports a limited IPMI 2.x interface, basically allowing powering the system on/off from an IPMI client. This LAN connection must be made to the RJ-45 connection can be used with a local or remote IPMI-enabled console device.
Note: The RMC firmware is not fully IPMI 2.x compliant and IPMI 2.x is not a supported interface if the UV3000 system is partitioned.
CNSL- see Figure 1-4 on page 9). This requires connecting from a
WAN port on the RMC. The

Serial Port Connection to the RMC

Use a USB-to-micro-USB cable to administer your system locally from the RMC.
Connect the cable from your administrative laptop or other device directly to the port labeled
CNSL on the RMC, reference the location shown in Figure 1-5 on page 11. Note that the RMC
will not (by default) require a password when you login via the CNSL port.
The console type and how these console types are connected to the SGI UV 3000 systems is determined by what console option is chosen. Establishing a serial console connection to the RMC does require specific functional parameters which are listed in the next subsection.
10 007-6402-001
Loading...
+ 88 hidden pages