IBM BladeCenter JS12 7998 Installation And User Manual

IBM

BladeCenter JS12 Type 7998

Installation and User's Guide

IBM

BladeCenter JS12 Type 7998

Installation and User's Guide

Note

Before using this information and the product it supports, read the general information in Appendix B, “Notices,” on page 59 and the Warranty and Support Information document for your blade server type on the Documentation CD.

Second Edition (November 2009) © Copyright IBM Corporation 2008.

US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

Safety ............... v

Safety statements ............ vi

Chapter 1. Product overview ...... 1

Safety

Before installing this product, read the Safety Information.

Antes de instalar este produto, leia as Informações de Segurança.

Læs sikkerhedsforskrifterne, før du installerer dette produkt.

Lees voordat u dit product installeert eerst de veiligheidsvoorschriften.

Ennen kuin asennat tämän tuotteen, lue turvaohjeet kohdasta Safety Information.

Avant d'installer ce produit, lisez les consignes de sécurité.

Vor der Installation dieses Produkts die Sicherheitshinweise lesen.

Prima di installare questo prodotto, leggere le Informazioni sulla Sicurezza.

Les sikkerhetsinformasjonen (Safety Information) før du installerer dette produktet.

Antes de instalar este produto, leia as Informações sobre Segurança.

Antes de instalar este producto, lea la información de seguridad.

Läs säkerhetsinformationen innan du installerar den här produkten.

Safety statements

Important: Each caution and danger statement in this documentation is labeled with a number. This number is used to cross reference an English-language caution or danger statement with translated versions of the caution or danger statement in the Safety Information document.

For example, if a caution statement is labeled, "Statement 1," translations for that caution statement are in the Safety Information document under "Statement 1." Be sure to read all caution and danger statements in this documentation before you perform the procedures. Read any additional safety information that comes with your blade server or optional device before you install the device.

Statement 1

vi JS12 Type 7998: Installation and User's Guide

DANGER

Electrical current from power, telephone, and communication cables is hazardous.

To avoid a shock hazard: v Do not connect or disconnect any cables or perform installation,

maintenance, or reconfiguration of this product during an electrical storm.

v Connect all power cords to a properly wired and grounded electrical outlet. v Connect to properly wired outlets any equipment that will be attached to

this product.

v When possible, use one hand only to connect or disconnect signal cables. v Never turn on any equipment when there is evidence of fire, water, or

structural damage.

v Disconnect the attached power cords, telecommunications systems,

networks, and modems before you open the device covers, unless instructed otherwise in the installation and configuration procedures.

v Connect and disconnect cables as described in the following table when

installing, moving, or opening covers on this product or attached devices.

To Connect: To Disconnect:

1. Turn everything OFF.

2. First, attach all cables to devices.

3. Attach signal cables to connectors.

4. Attach power cords to outlet.

5. Turn device ON.

1. Turn everything OFF.

2. First, remove power cords from outlet.

3. Remove signal cables from connectors.

4. Remove all cables from devices.

Statement 2

CAUTION: When replacing the lithium battery, use only IBM®Part Number 16G8095 or an equivalent type battery recommended by the manufacturer. If your system has a module containing a lithium battery, replace it only with the same module type made by the same manufacturer. The battery contains lithium and can explode if not properly used, handled, or disposed of.

Do not:

v Throw or immerse into water v Heat to more than 100°C (212°F) v Repair or disassemble

Dispose of the battery as required by local ordinances or regulations.

Safety vii

Statement 3

CAUTION: When laser products (such as CD-ROMs, DVD drives, fiber optic devices, or transmitters) are installed, note the following:

v Do not remove the covers. Removing the covers of the laser product could

result in exposure to hazardous laser radiation. There are no serviceable parts inside the device.

v Use of controls or adjustments or performance of procedures other than those

specified herein might result in hazardous radiation exposure.

DANGER

Some laser products contain an embedded Class 3A or Class 3B laser diode. Note the following.

Laser radiation when open. Do not stare into the beam, do not view directly with optical instruments, and avoid direct exposure to the beam.

Statement 4

≥ 18 kg (39.7 lb) ≥ 32 kg (70.5 lb) ≥ 55 kg (121.2 lb)

CAUTION: Use safe practices when lifting.

viii JS12 Type 7998: Installation and User's Guide

Statement 5

CAUTION: The power control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device. The device also might have more than one power cord. To remove all electrical current from the device, ensure that all power cords are disconnected from the power source.

Statement 8

CAUTION: Never remove the cover on a power supply or any part that has the following label attached.

Hazardous voltage, current, and energy levels are present inside any component that has this label attached. There are no serviceable parts inside these components. If you suspect a problem with one of these parts, contact a service technician.

Safety ix

Statement 10

CAUTION: Do not place any object on top of rack-mounted devices.

x JS12 Type 7998: Installation and User's Guide

Chapter 1. Product overview

The IBM BladeCenter JS12 Type 7998 blade server is based on IBM Performance Optimization with Enhanced RISC (POWER®) Architecture technologies. The BladeCenter JS12 Type 7998 blade server runs in BladeCenter units to provide a high-density, high-performance blade server environment using advanced processing technology.

Note: Unless otherwise stated, references to the BladeCenter unit apply to BladeCenter E (8677), BladeCenter H (8852), BladeCenter HT (8740 and 8750), BladeCenter S (8886), and to BladeCenter T (8720 and 8730) units.

The Installation and User's Guide comes with the blade server on the IBM BladeCenter Documentation CD. All of the following information is in the document and also in the online information center:

v Setting up the blade server v Starting and configuring the blade server v Installing optional hardware devices v References to information about installing supported operating systems v Performing basic troubleshooting of the blade server

Packaged with the hardcopy Installation and User's Guide are software CDs that help you to configure hardware, install device drivers, and install the operating system.

The blade server comes with a limited warranty. For information about the terms of the warranty and getting service and assistance, see the online information center or the Warranty and Support Information document that is on the IBM BladeCenter Documentation CD.

The blade server might have features that are not described in the documentation that comes with the blade server, and the documentation might be updated occasionally to include information about those features, or technical updates might be available to provide additional information that is not included in the original blade server documentation. The most recent version of all BladeCenter JS12 Type 7998 documentation is in the BladeCenter information center.

The online BladeCenter information center is available in the IBM Systems Information Center.

Download and install updated device drivers and the JS12 firmware. Go to the IBM Support site to download the updates. Select your product, type, model, and operating system, and then click Go. Click the Download tab, if necessary, for device driver and firmware updates.

Note: Changes are made periodically to the IBM Web site. Procedures for locating firmware and documentation might vary slightly from what is described in this documentation.

Print Table 1 on page 2 and use it to record information about your blade server.

You will need this information when you register the blade server with IBM. You can register the blade server at http://www.ibm.com/support/mysupport/.

Table 1 includes a place for you to record the JS12 vital product data.

To determine the values for your JS12 blade server, use the management module and the lsvpd command. If you are running Linux, download and install the service and productivity tools for Linux on POWER systems to install the lsvpd command.

Table 1. JS12 vital product data

Vital product data field Vital product data How to find this data Product name BladeCenter JS12

Type model number 7998-60X

Serial number

System unique ID

WorldWide port number

Brand B0 (B followed by zero)

________________________ (7 characters)

_________________________________ (12 characters)

Advanced management module HW VPD

lsvpd | grep SU

command

lsvpd | grep WN

command

lsvpd | grep BR

command

The model number and serial number are on the ID label that is behind the control panel door on the front of the blade server, and on a label on the side of the blade server that is visible when the blade server is not in the BladeCenter unit.

A set of blank labels comes with the blade server. When you install the blade server in the BladeCenter unit, write identifying information on a label and place the label on the BladeCenter unit bezel. See the documentation for your BladeCenter unit for recommended label placement.

Important: Do not place the label where it will block any ventilation holes on the blade server or the BladeCenter unit.

The IBM Documentation CD

You can run the IBM BladeCenter Documentation CD on any personal computer that meets the hardware and software requirements.

The IBM BladeCenter Documentation CD contains documentation for your blade server in Portable Document Format (PDF) and includes the IBM Documentation Browser to help you find information quickly.

Chapter 1. Product overview 3

Hardware and software requirements

The IBM BladeCenter Documentation CD requires the following minimum hardware and software levels.

v Microsoft Windows NT XP, Windows 2000, or Red Hat Linux v 100 MHz microprocessor v 32 MB of RAM v Adobe Acrobat Reader 3.0 (or later) or xpdf, which comes with Linux operating

systems

Using the Documentation Browser

Use the Documentation Browser to browse the contents of the CD, read brief descriptions of the documents, and view documents, using Adobe Acrobat Reader or xpdf.

The Documentation Browser automatically detects the regional settings in your system and displays the documents in the language for that region (if available). If a document is not available in the language for that region, the English-language version is displayed.

Use one of the following procedures to start the Documentation Browser: v If Autostart is enabled, insert the CD into the CD or DVD drive. The

Documentation Browser starts automatically.

v If Autostart is disabled or is not enabled for all users, use one of the following

procedures: – If you are using a Windows operating system, insert the CD into the CD or

DVD drive and click Start --> Run. In the Open field, type

e:\win32.bat

where e is the drive letter of the CD or DVD drive, and click OK.

– If you are using Red Hat Linux, insert the CD into the CD or DVD drive;

then, run the following command from the /mnt/cdrom directory:

sh runlinux.sh

Select the blade server from the Product menu. The Available Topics list displays all the documents for the blade server. Some documents might be in folders. A plus sign (+) indicates each folder or document that has additional documents under it. Click the plus sign to display the additional documents.

When you select a document, a description of the document is displayed under Topic Description. To select more than one document, press and hold the Ctrl key while you select the documents. Click View Book to view the selected document or documents in Acrobat Reader or xpdf. If you selected more than one document, all the selected documents are opened in Acrobat Reader or xpdf.

To search all the documents, type a word or word string in the Search field and click Search. The documents in which the word or word string occurs are listed in order of the most occurrences. Click a document to view it, and press Crtl+F to use the Acrobat search function, or press Alt+F to use the xpdf search function within the document.

Click Help for detailed information about using the Documentation Browser.

4 JS12 Type 7998: Installation and User's Guide

Notices and statements in this documentation

The caution and danger statements in this document are also in the multilingual Safety Information. Each statement is numbered for reference to the corresponding statement in your language in the Safety Information document.

The following notices and statements are used in this document:

v Note: These notices provide important tips, guidance, or advice. v Important: These notices provide information or advice that might help you

avoid inconvenient or problem situations.

v Attention: These notices indicate potential damage to programs, devices, or data.

An attention notice is placed just before the instruction or situation in which damage might occur.

v Caution: These statements indicate situations that can be potentially hazardous

to you. A caution statement is placed just before the description of a potentially hazardous procedure step or situation.

v Danger: These statements indicate situations that can be potentially lethal or

extremely hazardous to you. A danger statement is placed just before the description of a potentially lethal or extremely hazardous procedure step or situation.

Features and specifications

Features and specifications of the IBM BladeCenter JS12 Type 7998 blade server are summarized in this overview.

The JS12 blade server is used in one of the following IBM BladeCenter units: BladeCenter E (8677), BladeCenter H (8852), BladeCenter HT (8740 and 8750), BladeCenter S (8886), and BladeCenter T (8720 and 8730) units.

Notes:

v Power, cooling, removable-media drives, external ports, and advanced system

management are provided by the BladeCenter unit.

v The operating system in the blade server must provide support for the Universal

Serial Bus (USB), to enable the blade server to recognize and communicate internally with the removable-media drives and front-panel USB ports.

Chapter 1. Product overview 5

Microprocessor:

Support for one dual-core, 64-bit POWER6®microprocessor; 3.8 GHz

Support for Energy Scale thermal management for power management/oversubscription (throttling) and environmental sensing

Memory:

v Dual-channel (DDR2) with 8 slots

for very low profile (18.3 mm) DIMMs

v Supports 1 GB, 2 GB, 4 GB, and 8

GB DDR2 DIMMs for a maximum of 64 GB

v Supports 2-way interleaved, DDR2,

PC2-4200 or PC2-5300, ECC SDRAM registered x4, memory scrubbing, Chipkill, and bit steering DIMMs

Virtualization:

PowerVM Standard Edition hardware feature supports Integrated Virtualization Manager and Virtual I/O Server

Integrated functions:

v Two 1 Gigabit Ethernet controllers v Expansion card interface v The baseboard management

controller (BMC) is a flexible service processor with Intelligent Platform Management Interface (IPMI) firmware and SOL support

v ATI RN 50 ES1000 video controller v SAS RAID controller v Light path diagnostics v RS-485 interface for

communication with the management module

v Automatic server restart (ASR) v Serial over LAN (SOL) v Support for local keyboard and

video

v Four Universal Serial Bus (USB)

buses for communication with keyboard and removable-media drives

v Transferable Anchor function

(Renesas Technology HD651330 microcontroller) in the management card

Storage:

Predictive Failure Analysis (PFA) alerts:

v Microprocessor v Memory

Electrical input: 12 V dc

Environment:

v Air temperature:

– Blade server on: 10° to 35°C (50°

to 95°F). Altitude: 0 to 914 m (3000 ft)

– Blade server on: 10° to 32°C (50°

to 90°F). Altitude: 914 m to 2133 m (3000 ft to 7000 ft)

– Blade server off: -40° to 60°C (-40°

to 140°F)

v Humidity:

– Blade server on: 8% to 80% – Blade server off: 8% to 80%

Size:

v Height: 24.5 cm (9.7 inches) v Depth: 44.6 cm (17.6 inches) v Width: 2.9 cm (1.14 inches) v Maximum weight: 5.0 kg (11 lb)

Support for two internal small-form-factor (SFF) Serial Attached SCSI (SAS) drives

See the ServerProven Web site for information about supported operating-system versions and all JS12 blade server optional devices.

What your blade server offers

The design of the blade server takes advantage of advancements in chip technology, memory management, and data storage.

6 JS12 Type 7998: Installation and User's Guide

The blade server uses the following features and technologies:

v Baseboard management controller (BMC)

The enhanced BMC for the JS12 blade server is a flexible service processor that provides support for the following functions:

– Alert Standard Format (ASF) and RS-485 interfaces to the management

modules – Intelligent Platform Management Interface (IPMI) – The operating system – Power control and advanced power management – Reliability, availability, and serviceability (RAS) features – Serial over LAN (SOL) – Continuous health monitoring and control – Configurable notification and alerts – Event logs that are time stamped and saved in nonvolatile memory and that

can be attached to e-mail alerts – Point-to-point protocol (PPP) support – Remote power control – Remote firmware update and access to critical blade server settings

v Disk drive support

The blade server supports two 2.5 inch (small-form-factor) Serial Attached SCSI (SAS) hard disk drives.

v IBM Director

IBM Director is a workgroup-hardware-management tool that you can use to centrally manage the JS12 blade server.

For more information, see the IBM Director documentation on the IBM Director CD.

v Impressive performance using the latest microprocessor technology

The blade server comes with a POWER6 dual-core microprocessor.

v Integrated network support

The blade server has two integrated (onboard) 1 gigabit-per-second (Gbps) Host Ethernet Adapter (HEA) controllers that provide advanced acceleration features, such as checksum offload, TCP large send, and jumbo frames. Capabilities include virtualized adapter sharing among logical partitions that does not require the shared Ethernet adapters of Virtual I/O Server. TCP advanced features include hardware de-multiplexing and per connection queues.

v I/O expansion

The blade server has connectors on the system board for optional PCI-X and PCIe expansion cards, such as Fibre Channel and InfiniBand expansion cards, for adding more network communication capabilities to the blade server.

v Large system memory capacity

The memory bus in the JS12 Type 7998 Model 60X blade server supports up to 64 GB of system memory. For the official list of supported very-low-profile, 18.3 mm DIMMs, see the ServerProven Web site at http://www.ibm.com/servers/ eserver/serverproven/compat/us/.

v Light path diagnostics

Light path diagnostics provides light-emitting diodes (LEDs) to help you diagnose problems. An LED on the blade server control panel is lit if an unusual condition or a problem occurs. If this happens, you can look at the LEDs on the system board to locate the source of the problem.

Chapter 1. Product overview 7

For more information, see the online information or the Problem Determination and Service Guide.

v Power throttling

If your BladeCenter unit supports power management, the power consumption of the blade server can be dynamically managed through the management module. For more information, see the online management-module documentation or the IBM support site at http://www.ibm.com/systems/ support/.

Reliability, availability, and serviceability features

Three of the most important features in server design are reliability, availability, and serviceability (RAS). The reliability of the BladeCenter JS12 starts with components, devices, and subsystems that are fault tolerant.

Reliability, availability, and serviceability protect the integrity of the data that is stored in the blade server, maintain the availability of the blade server when you need it, and enhance the ease with which you can diagnose and correct problems.

Component-level RAS features

The blade server has the following component-level RAS features:

v Alternate processor recovery v Bit steering v Chipkill memory for dual inline memory modules (DIMMs) v Diagnostic support of Ethernet controllers v Dual inline memory module (DIMM) failure isolation

– DIMM pair identification through unrecoverable error (UE) checkpointing and

message-related recovery actions

– Single DIMM identification through recoverable component error (CE)

checkpointing and garding

v Dynamic deallocation (runtime POWER6 garding of microprocessor and

memory)

v L2 cache line delete v Memory chip kill - Chipkill memory for DIMMs v Memory Predictive Failure Analysis (PFA) alerts through scrubbing and

error-checking and correction (ECC)

v Memory scrubbing v Peripheral component interconnect (PCI) bus parity, ECRC, and surprise link

down

v PFA thresholding of correctable hardware errors of the microprocessor and L2

cache

v Processor runtime diagnostics (PRD) that initiates the following actions to

recover from errors: – Self-healing, such as redundant bit steering for memory – Deallocation at runtime of a failing resource, such as a processor core, a

memory page

– Identifying parts for service – Runtime error persistent deallocation, if necessary, for I-Cash, D-cash, L2

cache, L3 cache

– Transparent microprocessor hardware error recovery (for example, for L2

cache errors)

v Single processor checkstop (including a partition checkstop)

8 JS12 Type 7998: Installation and User's Guide

Blade-level RAS features

The blade server has the following blade-level RAS features: v Automatic service processor (BMC) reset and reload recovery for service

processor errors

v Automatic server recovery and restart that provides automatic reboot after boot

hangs or detection of checkstop conditions

v Automatic server restart (ASR) v Built-in monitoring for temperature, voltage, hard disk drives, and flash drives v Call Home v Checkstop analysis v Checkstop detection with automated restart v Customer-upgradeable basic input/output system (BIOS) code (firmware code) v Customer support center 24 hours per day, 7 days a week v Degraded boot support (memory and microprocessor) v Repeat Gard v Extended Error Handling (EEH) for PCI host and root complex, PCIe link, and

PCI adapter failures

v Emergency power off (EPOW) for the blade server and expansion cards v Environmental monitors and alerts v Error codes and messages v ECC memory v Failover Ethernet support v First Failure Data Capture (FFDC) for determining failure root cause v Service processor communication with the management module to enable

remote blade server management

v Light emitting diodes (LEDs) for identifying failing customer replaceable units

(CRUs) or field replaceable units (FRUs)

v Light path diagnostics v POWER6 RAS design and objectives v POWER6 Hypervisor (PHYP) partition recovery or partition termination when

unrecoverable errors occur

v Power-on self-test (POST) v SDRAM with serial presence detect (SPD) and vital product data (VPD) v System error logging v System Management Services (SMS) menu support v System-wide checkstop v Vital product data (VPD) unique identifiers on blade server and all major

electronic components with information stored in nonvolatile memory for remote viewing

1. Service availability will vary by country. Response time will vary depending on the number and nature of incoming calls.

Chapter 1. Product overview 9

BladeCenter unit-level RAS features

Cover

SAS hard disk drive

Hard disk drive tray

DIMM

DIMMXXXX

Bezel assembly

Expansion bracket

Small form factor high speed expansion card

Standard form factor PCI-X expansion card

Small form factor PCI-X expansion card

Management card

The BladeCenter unit provides the following RAS features:

v Power-supply error detection v Redundant power supplies v Remote power control v Management-module system-event log v Redundant blowers, I/O modules (switches) v Hot plug of BladeCenter CRUs (blowers, switches, power supplies)

Major components of the blade server

Remove the blade server from the BladeCenter unit and remove the blade server cover to see its components.

Illustrations in this information might differ slightly from your hardware. The following illustration shows the major components of the blade server.

Figure 1. Major components of the blade server

Note: The microprocessor is soldered onto the system board and is not removable.

10 JS12 Type 7998: Installation and User's Guide

IBM Director

Use IBM Director to perform network and system management tasks.

With IBM Director, a network administrator can perform the following tasks:

v View the hardware configuration of remote systems, in detail v Monitor the usage and performance of critical components, such as the

microprocessor, disks, and memory

v Centrally manage individual or large groups of IBM and non-IBM

x86-processor-based servers, desktop computers, workstations, and notebook computers on a variety of platforms

IBM Director provides a comprehensive entry-level workgroup hardware manager. It includes the following key features:

v Advanced self-management capabilities for maximum system availability. v Multiple operating-system platform support, including Microsoft Windows

Server 2003, Windows 2000 Server, Windows XP Professional, Red Hat Linux, SUSE Linux, VMware, Novell NetWare, AIX®, and IBM i operating system (formerly known as i5/OS™).

v Support for IBM and non-IBM servers, desktop computers, workstations, and

notebook computers.

v Support for systems-management industry standards. v Integration into leading workgroup and enterprise systems-management

environments.

v Ease of use, training, and setup.

IBM Director also provides an extensible platform that supports advanced server tools that are designed to reduce the total cost of managing and supporting networked systems. By deploying IBM Director, you can achieve reductions in ownership costs through the following benefits:

v Reduced downtime v Increased productivity of IT personnel and users v Reduced service and support costs

Chapter 1. Product overview 11

12 JS12 Type 7998: Installation and User's Guide

Chapter 2. Power, controls, indicators, and connectors

You can use the control panel to turn the blade server on or off and to view some controls and indicators. Other indicators are on the system board. The system board also has connectors for various components.

Blade server control panel buttons and LEDs

Blade server control panel buttons and LEDs provide operational controls and status indicators.

Note: Figure 2 shows the control-panel door in the closed (normal) position. To access the power-control button, you must open the control-panel door.

Figure 2. Blade server control panel buttons and LEDs

Keyboard/video select button: When you use an operating system that supports a local console and keyboard, press this button to associate the shared BladeCenter unit keyboard and video ports with the blade server.

Notes:

v The operating system in the blade server must provide USB support for the

blade server to recognize and use the keyboard, even if the keyboard has a PS/2-style connector.

v The keyboard and video are available after partition firmware loads and is

running. Power-on self-test (POST) codes and diagnostics are not supported using the keyboard and video. Use the management module to view checkpoints.

The LED on this button flashes while the request is being processed, then is lit when the ownership of the keyboard and video has been transferred to the blade server. It can take approximately 20 seconds to switch control of the keyboard and video to the blade server.

Using a keyboard that is directly attached to the management module, you can press keys in the following sequence to switch keyboard and video control between blade servers:

NumLock NumLock blade_server_number Enter Where blade_server_number is the two-digit number for the blade bay in which

the blade server is installed. When you use some keyboards, such as the 28L3644 (37L0888) keyboard, hold down the Shift key while you enter this key sequence.

If there is no response when you press the keyboard/video select button, you can use the Web interface of the management module to determine whether local control has been disabled on the blade server.

Media-tray select button: Press this button to associate the shared BladeCenter unit media tray (removable-media drives and front-panel USB ports) with the blade server. The LED on the button flashes while the request is being processed, then is lit when the ownership of the media tray has been transferred to the blade server. It can take approximately 20 seconds for the operating system in the blade server to recognize the media tray.

If there is no response when you press the media-tray select button, use the management module to determine whether local control has been disabled on the blade server.

Note: The operating system in the blade server must provide USB support for the blade server to recognize and use the removable-media drives and USB ports.

14 JS12 Type 7998: Installation and User's Guide

+ 60 hidden pages

IBM BladeCenter JS12 7998 Installation And User Manual

Specifications and Main Features

Frequently Asked Questions

User Manual

Contents

Safety

Safety statements

Chapter 1. Product overview

Related documentation

The IBM Documentation CD

Hardware and software requirements

Using the Documentation Browser

Notices and statements in this documentation

Features and specifications

What your blade server offers

Reliability, availability, and serviceability features

Major components of the blade server

IBM Director

Chapter 2. Power, controls, indicators, and connectors

Blade server control panel buttons and LEDs