NEC Express5800-1320Xd, Express5800-1160Xd User's Guide

EXPRESS5800/1160Xd/1320Xd

■■■■■■■

User’s Guide

■■■■■■■

Proprietary Notice and Liability Disclaimer

The information disclosed in this document, including all designs and related materials, is the valuable property of NEC Solutions (America), Inc. and/or its licensors. NEC Solutions (America), Inc. and/or its licensors, as appropriate, reserve all patent, copyright and other proprietary rights to this document, including all design, manufacturing, reproduction, use, and sales rights thereto, except to the extent said rights are expressly granted to others.

The NEC Solutions (America), Inc. product(s) discussed in this document are warranted in accordance with the terms of the Warranty Statement accompanying each product. However, actual performance of each product is dependent upon factors such as system configuration, customer data, and operator control. Since implementation by customers of each product may vary, the suitability of specific product configurations and applications must be determined by the customer and is not warranted by NEC Solutions (America), Inc.

To allow for design and specification improvements, the information in this document is subject to change at any time, without notice. Reproduction of this document or portions thereof without prior written approval of NEC Solutions (America), Inc. is prohibited.

Trademarks

Windows is a registered trademark of Microsoft Corporation. Intel and Itanium are registered trademarks of Intel Corporation.

All other product, brand, or trade names used in this publication are the trademarks or registered

trademarks of their respective trademark owners.

PN: 456-01686-000 November 2003

NEC Solutions (America), Inc

10850 Gold Center Drive, Suite 200,

Rancho Cordova, CA 95670

Proprietary Notice Using This Guide

Text Conventions...............................................................................................................viii

Related Documents .............................................................................................................. ix

Safety Notices....................................................................................................................... x

Safety Notices for Users Outside of the U.S.A. and Canada.......................................... xi

Care and Handling...............................................................................................................xii

1 System Overview

Overview............................................................................................................................ 1-2

System Features..................................................................................................................1-3

System Configurations.......................................................................................................1-4

Main Components............................................................................................................ 1-10

Itanium 2 Processors...................................................................................................1-10

System Memory..........................................................................................................1-10

XBC Board..................................................................................................................1-10

PCIX Unit ...................................................................................................................1-10

Service Processor Board.............................................................................................1-11

Clock Boards...............................................................................................................1-11

Power Bay Unit........................................................................................................... 1-11

System Functions.............................................................................................................1-12

Partitioning..................................................................................................................1-12

Chipset and Crossbar Switch......................................................................................1-13

Server Management....................................................................................................1-13

Expansion.........................................................................................................................1-14

Cell Board................................................................................................................... 1-17

CPUs...........................................................................................................................1-17

Memory....................................................................................................................... 1-17

Optional PCIX Unit ....................................................................................................1-18

Power Bay Unit........................................................................................................... 1-18

Peripheral Devices......................................................................................................1-18

Security ............................................................................................................................ 1-18

2 System Operation

Setting Up the Server.........................................................................................................2-2

Starting Up the System.......................................................................................................2-4

Shutting Down the System................................................................................................. 2-7

Using Exception Procedures..............................................................................................2-9

Dump.............................................................................................................................2-9

Cold Reset.....................................................................................................................2-9

Restart.........................................................................................................................2-10

Power On Reset...........................................................................................................2-10

Reviewing Firmware Operations......................................................................................2-11

Startup Triggers...........................................................................................................2-11

SP FW.........................................................................................................................2-11

BIOS Transfer/OS Loading ........................................................................................ 2-11

Contents iii

Booting the OS.................................................................................................................2-12

OS Boot from Boot Manager ......................................................................................2-12

OS Boot from the EFI Boot Manager..........................................................................2-12

EFI Shell......................................................................................................................2-13

EFI Shell Commands...................................................................................................2-14

OS Boot from EFI Shell..............................................................................................2-16

Notes for OS Installation.............................................................................................2-17

EFI Device Path...........................................................................................................2-17

Checking Failure.........................................................................................................2-18

Using the DVD-ROM Drive.............................................................................................2-19

Inserting a Disc in the DVD-ROM Drive....................................................................2-19

Removing a Disc from the DVD-ROM Drive.............................................................2-19

Using an Optional Tape Drive..........................................................................................2-20

Environmental DAT Specifications ............................................................................2-20

DAT Cartridge Labels.................................................................................................2-21

Write Protection ..........................................................................................................2-22

DAT Cartridge Insertion and Removal.......................................................................2-22

3 Service Processor

SP Console..........................................................................................................................3-2

SP Console Connections ...............................................................................................3-2

Console Operations.......................................................................................................3-3

Console Status and Login Authentication.....................................................................3-3

Login and Main Menu...................................................................................................3-5

OS (BIOS) Console............................................................................................................3-8

Virtual SOP.......................................................................................................................3-10

Partition State Display.................................................................................................3-11

SP Command Console......................................................................................................3-13

SP Command Console Buffer .....................................................................................3-14

SP Command Prompt..................................................................................................3-14

SP Message Header.....................................................................................................3-14

SP Command List........................................................................................................3-15

SP Command Reference...................................................................................................3-17

CM (Change Command Mode)...................................................................................3-18

DF (Shut Down System Power <override>)...............................................................3-19

DL (Display SP Logs).................................................................................................3-20

DN (Shut Down System Power)..................................................................................3-24

DP (System Dump) .....................................................................................................3-25

DT (SP Date and Time)...............................................................................................3-26

EN (Environmental Information)................................................................................3-27

FV (Firmware Versions)..............................................................................................3-32

HC (Hardware Configuration).....................................................................................3-33

HE (Help)....................................................................................................................3-53

ML (Message Log)......................................................................................................3-54

PC (Power Cycle)........................................................................................................3-55

RS (Cold Reset System)..............................................................................................3-56

UP (Bring Up System) ................................................................................................3-57

iv Contents

4 BIOS Setup

Setup Overview..................................................................................................................4-2

What is Setup? ..............................................................................................................4-2

When You Should Change the Settings........................................................................ 4-2

Some Setting Errors Exist..................................................................................... 4-2

Settings of CMOS and/or NVRAM Are Cleared..................................................4-3

Adding or Deleting a Boot Device........................................................................ 4-3

The BIOS Version Has Changed ..........................................................................4-4

The Host Bus Bridge Configuration Has Changed...............................................4-4

Starting Setup................................................................................................................ 4-4

Screen Description........................................................................................................4-5

Menu Tree..........................................................................................................................4-6

Main Menu Overview...................................................................................................4-7

Advanced Menu Overview...........................................................................................4-8

Security Menu Overview.............................................................................................. 4-9

System Hardware Menu Overview............................................................................. 4-10

Exit Menu Overview...................................................................................................4-12

Menu Options and Settings.............................................................................................. 4-13

Main Menu.................................................................................................................. 4-13

Advanced Menu.......................................................................................................... 4-15

Advanced Submenu ............................................................................................ 4-17

Peripheral Configuration Submenu.....................................................................4-18

Monitoring Configuration Submenu................................................................... 4-20

Option ROM Submenu ....................................................................................... 4-22

Extended PCI Slot Submenu...............................................................................4-24

Numlock Submenu.............................................................................................. 4-27

Security Menu.............................................................................................................4-29

System Hardware Menu..............................................................................................4-31

HBB Configuration Submenu.............................................................................4-33

PCI Bus Parity Error Assert Submenu................................................................4-35

Master Latency Timer Submenu......................................................................... 4-37

Multi Transaction Timer Subm enu..................................................................... 4-39

Low MMIO Configuration Submenu.................................................................. 4-41

High MMIO Configuration Submenu................................................................. 4-43

IO Space Configuration Submenu.......................................................................4-45

PCI Bus Configuration Submenu........................................................................4-47

Console Redirection Submenu............................................................................4-49

Console Redirection – System Serial Port ..........................................................4-51

Console Redirection – Serial Port 1....................................................................4-53

Shrink Total Number of Interrupt Vectors Submenu..........................................4-55

Memory Mapped I/O > 4GB Submenu...............................................................4-56

Exit Menu............................................................................................................ 4-57

BIOS Virtual DIP Switch................................................................................................. 4-59

What is BIOS Virtual DIP Switch?.............................................................................4-59

PCI Online Maintenance (PCI Hot Plug).........................................................................4-60

Available PCI Online Maintenance Function.............................................................4-60

Preparing the Resources..............................................................................................4-60

If a Reboot Occurs......................................................................................................4-61

Contents v

5 I/O Board Installation

Identifying PCI Slots..........................................................................................................5-2

Selecting a Slot...................................................................................................................5-5

Installing a Board in the PCIX Unit ...................................................................................5-6

6 Problem Solving

Solving Simple Problems ...................................................................................................6-2

Troubleshooting the System...............................................................................................6-4

A Technical Specifications

Main Cabinet.....................................................................................................................A-2

DVD-ROM Drive..............................................................................................................A-4

Tape Drive.........................................................................................................................A-5

FDD...................................................................................................................................A-6

B Memory Upgrades

Memory Configurations ....................................................................................................B-2

DIMM Installation.............................................................................................................B-2

C Windows 2003 Installation

Installing Microsoft Windows 2003..................................................................................C-2

Creating a Mirrored Drive of Windows 2003....................................................................C-3

Glossary Index

vi Contents

Using This Guide

This User’s Guide provides a quick reference to information about your server system. Its goal is to familiarize you with your system and the tasks necessary for system setup and operation.

This guide contains the following information:

! Chapter 1, “System Overview,” provides an overview of your system and describes your

system’s major system components. See this chapter to familiarize yourself with your system.

! Chapter 2, “System Operation,” tells you how to set up the server, how to start up, shut

down, and reboot the system, how to boot the OS, and how to use the DVD-ROM drive and optional tape drive.

! Chapter 3, “Service Processor,” describes service processor functions. This chapter

includes information about the SP console, OS console, Virtual SOP, and service processor commands.

! Chapter 4, “BIOS Setup,” provides you with a description of the BIOS Setup utility and

its options for configuring the server.

! Chapter 5, “I/O Board Installation,” shows you how to install I/O boards in the server.

Information includes slot identification and board installation in the PCIX unit.

! Chapter 6, “Problem Solving” contains helpful information for solving problems that

might occur with your system.

! Appendix A, “Technical Specifications” provides specifications for your server system. ! Appendix B, “Memory Upgrade” provides memory configuration information necessary

for adding memory to the server. Information includes allowable memory configurations, memory slot locations, and how to allocate memory.

! Appendix C, “Windows 2003 Installation” provides information for installing

Microsoft

Windows® 2003 on the Express5800/1000 series server and for creating a

mirrored drive of Windows 2003.

Using This Guide vii

Text Conventions

This guide uses the following text conventions. Warnings, cautions, and notes have the following meanings:

Warnings alert you to situations that could result in serious personal injury or loss of life.

Cautions indicate situations that can damage the system hardware or software.

Note: Notes give important information about the material being described.

! Names of keyboard keys are printed as they appear on the keyboard. For example, Ctrl,

Alt, or Enter.

WARNING

CAUTION

! Text or keystrokes that you enter appear as boldface type. For example, type abc123 and

press ENTER.

! File names are printed in uppercase letters. For example, AUTOEXEC.BAT.

viii Using This Guide

Safety Notices

To avoid a risk of injuries, installation should be performed by trained technical personnel.

Your server is equipped with a front stabilizer. Engage the front stabilizer during installation. For stability and to distribute the weight, also attach side stabilizers. Otherwise, the rack may topple over and cause injuries.

If you extend two or more devices from the rack at the same time, the rack may topple over on you. Extend only one device from the rack at a time.

Exercise great care not to hurt your fingers on the rail when you mount/dismount the equipment into/from the rack.

Lithium batteries can be dangerous. Improper handling of lithium batteries may result in an explosion. Dispose of lithium batteries as required by local ordinance. Replace only with the same or equivalent type battery.

The DVD-ROM drive uses a laser beam. Do not look or insert a mirror inside while the system is on. A laser beam is invisible; if your eyes get exposed to it, there is a risk of losing your eyesight.

WARNING

! Elevated Operating Ambient Temperature – If installed in a closed or multi-unit rack

assembly, the operating ambient temperature of the rack environment may be greater than the room ambient environment. Therefore, consideration should be given to installing the equipment in an environment compatible with the maximum rated ambient temperature of 89.6°F.

! Reduced air Flow – Installation of the equipment in a rack should be such that the

amount of air flow required for safe operation of the equipment is not compromised. Ensure that nothing is placed on top of the system cabinet.

! To prevent fires, and damage to rack equipment and supply wiring, make sure that the

rated load of the power branch circuit is not exceeded. Equipment nameplate ratings should be used when addressing this concern. For more information on installation and wiring of power-related facilities, contact your electrician or local power company.

! To prevent electrical shock, connect all rack and rack support equipment to the same

electrical circuit of the building wiring. If you are unsure, check the building wiring to avoid remote earth conditions.

! For safe operation, only connect the equipment to a building supply that is in accordance

with current wiring regulations in your country. In the USA those wiring standards are regulated by Underwriter Laboratories (UL); in the U.K. by the Institution of Electrical Engineers, (IEE) and in Canada by the Canadian Standards Association (CSA).

x Using This Guide

WARNING

Some locations within the server have high voltage and therefore are very

dangerous. To avoid risk of electric shock, turn off all server power and

disconnect power cables before working inside the server unit.

The main power of your server is turned off by turning off the power source to the

server or removing the power cable.

Before touching the parts in the server, wait for at least 10 to 15 seconds until

residual voltage is disc harged.

Safety Notices for Users Outside of the U.S.A. and Canada

PELV (Protected Extra-Low Voltage) Integrity: To ensure the extra-low voltage integrity of the equipment, connect only equipment with mains-protected electricallycompatible circuits to the external ports.

! Remote Earths: To prevent electrical shock, connect all local (individual office)

computers and computer support equipment to the same electrical circuit of the building wiring. If you are unsure, check the building wiring to avoid remote earth conditions.

! Earth Bonding: For safe operation, only connect the equipment to a building supply

that is in accordance with current wiring regulations in your country. In the USA those wiring standards are regulated by Underwriter Laboratories (UL); in the U.K., by the Institution of Electrical Engineers, (IEE) and in Canada by the Canadian Standards Association (CSA).

Using This Guide xi

Care and Handling

Use the following guidelines to properly handle and care for your system.

Protect the system from extremely low or high temperatures. Let the system warm (or cool) to room temperature before using it.

Keep the system away from magnetic forces.

Keep the system dry. Do not wash the system with a wet cloth or pour fluid into it.

Protect the system from being bumped or dropped.

Check the system for condensation. If condensation exists, allow it to evaporate before powering on the system.

Keep the system away from dust, sand, and dirt.

xii Using This Guide

System Overview

! Overview ! System Features ! System Configurations

! Main Components ! System Functions ! Expansion ! Security

Overview

Your Express5800/1000 series server is a modular, multiprocessing server based on the Intel® Itanium® 2 64-bit processor. The combination of Intel Itanium 2 architecture, along with your server’s innovative crossbar switch and high-speed memory access technology, provides for massive power and scalability using the latest available operating systems. Your server is ideal for large-scale applications as well as compute intensive environments. Your server is conveniently housed in a standalone cabinet (see Figure 1-1).

Advanced features of your Express5800/1000 series server include:

! High-speed processing and high scalability

High-speed processing is realized through a combination of the new Intel CPU and NEC crossbar switch and high-speed memory access technologies. Supporting up to 32 CPUs (32-way model) and employing the advanced PCI-X bus to connect peripheral and network devices, the Express5800/1000 series server can be configured with up to 112 I/O slots (32-way model), demonstrating the high scalability ideal for large-scale configurations.

! Partitioning functionality for flexible system operation

Your server can be partitioned at the hardware level, enabling each subsystem to operate as an independent computer system. It is possible to divide a 32 CPU system configuration into 8 subsystems, each of which has 4 CPUs, and let them each operate separately. In this way, it’s possible to allocate processor capacity according to workload status, resulting in flexible system operation and guaranteed security.

1-2 System Overview

Figure 1-1. Express5800/1160Xd/1320Xd Server

! High reliability and availability

Many hardware components, such as the clock, power, fan, and service processor, allow redundancy, and the CPU/memory cell board and I/O card hardware are hot-swap compliant. Easy system recovery is possible even at the time of failure.

System Features

The Express5800/1000 series servers feature:

! Quad high-performance Intel

processors per Cell Board.

! Cell Board supporting the installation of up to 4 CPUs (Intel Itanium 2

processors). In addition, each Cell Board has 16 DIMM sockets plus a memory daughterboard

with 16 DIMM sockets for a total of 32 DIMM sockets. Each Cell Board/daughterboard combination supports from 4 GB (using four 1-GB DIMMs) up to 32 GB (using thirty-two 1-GB DIMMs) of ECC SDRAM fourway interleaved memory.

! Intelligent Service Processor (iSP) Board which provides system management

and diagnostic functions

Itanium® 2 64-bit 1.3GHz/3MB or 1.5GHz/6MB

! Clock Board which provides clock distribution ! PCIX Unit in two versions, Base Unit and Core Unit:

 14 available PCI-X expansion slots in a Base Unit model; includes eight

64-bit/66-MHz hot-swap PCI-X slots and six 64-bit/133-MHz hot-swap PCI-X slots.

 12 available PCI-X expansion slots, a Basic I/O Board with 2 USB, 2 IDE,

and 1 Keyboard interfaces, a VGA card with an analog interface, and a DVD-ROM unit in a Core Unit model to allow a bootable partition. The Core Unit model includes eight (six available) 64-bit/66-MHz hot-swap PCI-X slots and six available 64-bit/133-MHz hot-swap PCI-X slots.

 DVD-ROM unit in a Core Unit  Bay for an optional DAT unit or optional USB FDD  Six hot-swap SCSI hard disk drive bays accessible from the front of the unit;

each drive bay can contain a 36-GB, 73-GB, or 146-GB SCSI hard disk drive.

! Hot-swap SCSI disk drive backplane; a failed drive can be removed and replaced

with a new drive without system power being turned off (if software mirror has been configured).

! Hardware monitors (temperature, fans, and voltage) and software monitors to

indicate failures.

System Overview 1-3

! Up to two Power Bay Units can be installed in the Main Cabinet. Up to 12

Distributed Power Supply (DPS) modules can be installed. When a 2N redundant system is configured, up to 3 Power Bay Units can be installed. In this case, the primary power is supplied from two AC power distribution units.

! One Power Bay Unit can be installed in the I/O Expansion Cabinet. Up to six

DPSs can be installed. When a 2N redundant system is configured, up to 2 Power Bay Units can be installed.

! Six fans are installed in the 16-way server and 11 fans are installed in the 32-way

server. Any fan module can easily be removed and installed, without powering down the system.

System Configurations

Main system features are described for each of the Express5800/1000 series standalone models as follows.

! Express5800/1160Xd Main Cabinet — 16-way server; supporting up to 4 Cell

Boards, with a total of up to 16 CPUs and memory expandability up to 128 GB using 1-GB DIMMs.

The 16-way server supports the installation of up four PCIX units (one is required). See Figure 1-2.

! Express5800/1320Xd Main Cabinet — 32-way server, supporting up to 8 Cell

Boards, with up to 32 CPUs and memory expandability up to 256 GB using 1-GB DIMMs.

The 32-way server supports the installation of up two PCIX units (one is required). See Figure 1-3.

! Express5800/1320Xd I/O Expansion Cabinet — expansion cabinet supporting up

to six PCIX units (one is required). See Figure 1-4.

Figure 1-5 shows PCIX unit features. Figure 1-6 shows internal views of Cell Board features. For memory slot locations and configuration information, see Appendix B.

See Appendix A, “Technical Specifications,” for a list of system specifications.

1-4 System Overview

Front View Rear View

A Front Stabilizer Handle G Front Fans B Power Bay Units H Front Cell Boards C Base or Core PCIX Units I XBC Boards D UUID Label J Rear Fans

E Clock Boards K Rear Cell Boards F iSP Boards Note: Maximum configuration shown.

Figure 1-2. 16-Way Server Configuration

System Overview 1-5

Front View Rear View

A Front Stabilizer Handle G Front Fans B Power Bay Units H Front Cell Boards C Base or Core PCIX Units I XBC Boards D Clock Boards J Rear Fans

E iSP Boards K Rear Cell Boards F UUID Label Note: Maximum configuration shown.

Figure 1-3. 32-Way Server Configuration

1-6 System Overview

Front View Rear View

A Front Stabilizer Handle B Power Bay Units C Base or Core PCIX Units Note: Maximum Configuration shown.

Figure 1-4. I/O Expansion Cabinet Configuration

System Overview 1-7

A PCI Expansion Slots D Bay for DAT Tape

Drive or USB FDD

B PCI Expansion Slot

Cover

C DVD-ROM Drive

(Core Unit)

E Hard Disk Drive Bays

(behind panel)

Figure 1-5. PCIX Unit Features

1-8 System Overview

Side A

BC D

Side B

GFIH

A Power Pods F CPU Slot #0 B CPU Slot #1 G CPU Slot #2 C CPU Slot # 3 H DIMM Slots D DIMM Slots I Memory Daughter Board E Power Pods

Figure 1-6. CELL Board Features

System Overview 1-9

Main Components

The following sections provide information about server components.

Itanium 2 Processors

Depending on system configuration, your system uses Intel Itanium 2 64-bit

1.3-GHz/3-MB or 1.5-GHz/6-MB processors. Four Intel Itanium 2 processors are installed within one Cell Board. See Figure 1-6.

Up to 4 Cell Boards with a total of up to 16 CPUs can be installed in the 16-way server (1160Xd) and up to 8 Cell Boards with a total of up to 32 CPUs can be installed in the 32-way server (1320Xd). All processors installed in your system must be of identical bus and core speed.

System Memory

Each Cell Board in your system contains sixteen 168-pin DIMM sockets on the Cell Board and another sixteen DIMM sockets on the Cell Board daughterboard. See Figure 1-6. Memory DIMMs must be populated four at a time with 1-GB ECC SDRAM DIMMs. Depending on the number and capacity of DIMMs installed, each Cell Board can include from 4 GB up to 32 GB of memory using 1-GB DIMMs.

The 16-way server (1160Xd)supports up to 128 GB of memory using 1-GB DIMMs. The 32-way server (1320Xd) supports up to 256 GB of memory using 1-GB DIMMs.

XBC Board

The XBC Board consists of one Cross-Bar Controller (XBC). You can connect this board with up to 4 Cell Boards to perform data transfer among Cell Boards. In a standard configuration, a 16-way server has 2 XBC Boards and a 32-way server has 4 XBC Boards – however, the system configuration you have might vary.

PCIX Unit

The server’s PCIX Unit expansion capabilities meet the needs of file and application servers for high performance I/O by providing 14 hot-swap PCI-X expansion slots.

The PCI-X slots allow PCI-X boards to be installed or removed while the server is powered on (if the operating system supports the Hot Plug PCI function). A Basic I/O Board supporting the standard I/O interface and a video VGA controller board are installed in the Core Unit model. The Basic I/O Board and video VGA board are not hot-swappable.

Note: Your operating system must support the Hot Plu g PCI

function.

1-10 System Overview

Installation of a board in a particular slot and with other boards can determine the actual operating frequency of a board within a bus group. See Chapter 5, “I/O Board Installation” for information about installing a board in a particular slot for optimum operation.

A DVD-ROM drive is installed in the Core Unit as standard equipment. Optionally, a DAT tape drive or USB FDD and up to 6 disk storage hard disk drives may be added to the PCIX Unit. See Figure 1-5.

Service Processor Board

The Service Processor Board (iSP Board) controls power and monitors status of all components (see Figure 1-2 and 1-3). The board uses a PowerPC chip as the processor for iSP, memory, LAN, and serial interface functionality. The Service Processor Board performs initialization of the system, RAS functions, diagnostic functions, and failure management of the system.

The 16-way and 32-way servers each have two Service Processor Boards (one for redundancy).

Clock Boards

The 16-way and 32-way servers each have two Clock Boards for clock generation and distribution. One of the Clock Boards provides redundancy.

Power Bay Unit

Up to 6 Distributed Power Supply Modules can be installed in each Power Bay Unit. Power Bay Units can be installed as follows:

! 16-Way Server – one unit is installed in the main cabinet; two units can be

installed for AC redundancy.

! 32-Way Server – two units are installed in the main cabinet; three units can be

installed for AC redundancy.

! I/O Expansion Cabinet – one unit is installed in the cabinet; two units can be

installed for AC redundancy.

System Overview 1-11

System Functions

The following subsections describe select system functions.

Partitioning

The Express5800/1000 series server can run more than one operating system or instances of an operating system in the same main cabinet. For example, a configuration containing 4 Cell Boards (Cells hereafter), Cell #0, Cell #1, Cell #2, and Cell #3, can operate as follows:

! Cell #0 and Cell #1can operate under the same operating system #0 as an SMP

(symmetric multi processor) configuration.

! Cell #2 can operate under operating system #1, which is different from Cell #0,

Cell #1, and Cell #3.

! Similarly, Cell #3 can operate under operating system #2, which is different from

Cell #0, Cell #1, and Cell #3.

Here, the Cell group which operates under the same operating system is called a partition. In the example below, Cell #0 and Cell #1 can be Partition #0, Cell #2 can be Partition #1, and Cell #3 can be Partition #2.

Partitioning makes it possible to allocate processor capacity according to workload status, resulting in flexible system operation.

1-12 System Overview

Figure 1-7. Example of Partitioning Cells

Each partition is physically isolated by the hardware settings; a software error does not affect the other partitions. Thus the system can maintain high security.

Each partition consists of a Cell Board and a core PCIX unit. Multiple OS instances can run on different partitions independently. If a partition has at least one PCIX unit with basic I/O, the Cell Boards and the PCIX units can be flexibly assigned to any partition. Even if a failure occurs in a Cell Board, the system can disable the failed Cell Board and reboot the partition by reassigning a spare Cell Board. This feature minimizes partition down time.

The Service Processor manages the partitioning settings and configuration changes. You can change the partition configuration in the main cabinet by using the CC command in the SP command mode (see Chapter 3).

Chipset and Crossbar Switch

NEC developed a high-performance chipset and crossbar switch that is based on supercomputer mainframe technology. The crossbar switch connects the Cell Boards The crossbar switch has a low latency as well as high data bandwidth. While comprising Cache Coherent Non-Uniform Memory Access (cc-NUMA) architecture, the system employs the chipset and crossbar switch technology in achieving near uniform high-speed memory access.

Server Management

The Service Processor supports many management functions compatible to the Advanced Configuration and Power Interface (ACPI) and Intelligent Platform Management Interface (IPMI).

The system supports the following ACPI features:

! Configuration information tables interface from a platform. ! Software power off controls, etc.

The Service Processor also works as a management controller defined in IPMI. It supports the following IPMI features.

! Provides Field Replaceable Unit (FRU) information to System Management

Services (SMS) running on the operating system.

! Monitors system power, fan speed, and temperature conditions. ! Monitors stall occurrences during the power-up sequence, OS loading, and

normal running using a watchdog timer, etc.

The Service Processor provides the following management features:

! Error handling (error monitoring, logging, diagnostics, and reporting) ! System reset ! System configuration management ! Firmware update, etc.

System Overview 1-13

The SMS running on a PC can control the above functions using the Service Processor’s system management LAN port, which can support TELNET, FTP, and SNMP protocol. With the combination of the Service Processor and the SystemGlobe/GlobalMaster software, the Express 5800/1000 series supports automatic reconfiguration of partitions based on the conditions pre-defined in the SystemGlobe/GlobalMaster.

Expansion

The Express5800/1000 series server can be expanded by adding:

! Memory ! I/O boards ! Cell boards ! Disk drives ! PCIX Expansion Units.

See Figures 1-8 and 1-9 for diagrams of the Express5800/1160Xd and Express5800/1320 system configurations. See the following sections for a description of system expansion capabilities.

CAUTION

Contact qualified personnel, such as your System Administrator or an NEC Technician, for adding or removing server components.

1-14 System Overview

Itanium 2

Standard: 4 CPUs on a 1 CELL Board

Up to 4 CELL Board upgrade kits can be added

RS232C

(Console)

Ethernet cable

1-GB memory upgrade

Up to 8 sets of the above memory per CELL Board or up to 32 GB per board can be added.

SP Console (Standard)

etwork devices such as HUB or router

Core PCIX Unit (At least 1 unit required)

DVD-ROM

DVD-ROM/

CD-ROM

Magnetic Tape

Drive

DDS-4*

(Optional)

10/100BASE-TX

Optional PCIX Unit

Magnetic Tape

Up to 6 HDDs can be installed in a PCIX unit. Up to 4 PCIX units can be installed in the Main Cabinet.

*Either an optional DAT drive or an optional USB FDD can be installed in the PCIX Unit DAT bay.

Drive

DDS-4*

(Optional)

1.6G X2

Server ma nageme nt L AN interface

Figure 1-8. Express5800/1160Xd 16-Way System Configuration

System Overview 1-15

Itanium 2

1-GB memory upgrade

Up to 8 sets of the above memory per CELL Board or up to 32 GB per board can be added.

SP Console (Standard)

RS232C

(Console)

etwork devices

such as HUB or router

Server ma nageme nt L AN interface

Standard: 4 CPUs on a 1 CELL Board

Up to 8 CELL Board upgrade kits can be added

Ethernet cable

10/100BASE-TX

Core PCIX Unit

(At least 1 unit required)

DVD-ROM

DVD-ROM/

CD-ROM

Optional PCIX Unit

Up to 6 HDDs can be installed in a PCIX Unit.

*Either an optional DAT drive or optional USB FDD can be installed in the PCIX Unit DAT bay.

Magnetic Tape

Drive

DDS-4*

(Optional)

Magnetic Tape

Drive

DDS-4*

(Optional)

1.6G X2

Optional PCIX Unit

1.6G cable

Up to 6 PCIX units can be installed in the I/O Expansion Cabinet.

Optional PCIX Unit

Magnetic Tape

DDS-4

(Optional)

Magnetic Tape

Drive

DDS-4

(Optional)

Figure 1-9. Express5800/1320Xd 32-Way System Configuration

1-16 System Overview

+ 184 hidden pages