NEC Express5800-320Fc, Express5800-320Fd Administration Manual
Express5800/ftServer:
System Administrator’s Guide
for the Linux
®
Operating System
NEC Corporation of America
456-01730-000
Notice
The information contained in this document is subject to change without notice.
UNLESS EXPRESSLY SET FORTH IN A WRITTEN AGREEMENT SIGNED BY AN AUTHORIZED REPRESENTATIVE
OF NEC, NEC MAKES NO WARRANTY OR REPRESENTATION OF ANY KIND WITH RESPECT TO THE
INFORMATION CONTAINED HEREIN, INCLUDING WARRANTY OF MERCHANTABILITY AND FITNESS FOR A
PURPOSE. NEC assumes no responsibility or obligation of any kind for any errors contained herein or in connection with
the furnishing, performance, or use of this document.
Software described in NEC (a) is the property of NEC and/or its licensees, (b) is furnished only under license, and (c) may
be copied or used only as expressly permitted under the terms of the license.
NEC documentation describes all supported features of the user interfaces and the application programming interfaces
(API) developed by NEC and/or its licensees. Any undocumented features of these interfaces are intended solely for use
by NEC personnel and are subject to change without warning.
This document is protected by copyright. All rights are reserved. No part of this document may be copied, reproduced, or
translated, either mechanically or electronically, without the prior written consent of NEC Corporation of America. Portions
of this document are copyrights of Stratus Technologies and are reprinted here, under permission from Stratus
Technologies Bermuda, Ltd.
The NEC Corporation of America logo, Express5800/
Corporation of America. ActiveService Network is a trademark of Stratus Technologies Bermuda, Ltd. All other
trademarks and trade names are the property of their respective owners.
ftServer, and the Express5800/ftServer logo, are trademarks of NEC
The registered trademark Linux is used pursuant to a sublicense from the Linux Mark Institute, the exclusive licensee of
Linus Torvalds, owner of the mark on a worldwide basis. NEBS is a trademark of Telcordia Technologies, Inc.
Red Hat, Red Hat Linux, and Red Hat Enterprise Linux are registered trademarks of Red Hat, Inc. in the US and other
countries. UNIX is a registered trademark of X/Open Company, Ltd., in the U.S.A. and other countries.
Manual Name: Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
Part Number:
Revision Number: 04
Publication Date: January 2008
NEC Corporation of America
6535 N. State Highway 161
Irving, Texas 75038-2402
© 2006 NEC Corporation of America. All rights reserved.
456-01730-000
Contents
Preface xi
1. Introduction to ftServer System Administration
ftServer System Terminology 1-2
System and Network Administration Overview 1-2
Installing and Updating So ftware on ftServer Systems 1-2
Updating ftServer System Firmware 1-2
Conguring Your ftServer System 1-3
Managing Data Storage Devices 1-3
Using the Express5800/ftServer Fault-Tolerant Express Builder 1-3
Network Management and Reporting 1-3
Troubleshooting ftServer Systems 1-3
Additional Documentation and Resources 1-3
Red Hat Enterprise Linux 1-4
Express5800/ ftServer Documentation 1-4
Linux and UNIX Documents 1-4
2. Installing the Operating System and Express5800/ftServer System Software 2-1
Installation Overview 2-2
Boot Media 2-3
Default System Setup 2-3
Linux Version Information 2-4
Storage Default Settings 2-4
Ethernet Default Conguration 2-5
USB and RS232C Default Settings 2-5
Default System Initialization and Run-Level Control 2-6
Default User Environments, Shells, and Access
Control 2-6
System Indicators and Switches 2-6
Separately Released and Optional Distribution Components 2-6
Installation Interfaces 2-7
Supported Hardware and Firmware 2-7
1-1
Contents iii
Contents
Pre-Installation Checklist 2-7
Initial Linux Operating System and Express Builder Installation or
Default Reinstallation 2-10
Booting the Operating System 2-10
Installing the Operating System 2-11
Installing Express Builder for Fault Tolerance 2-13
Avoiding CD-ROM Mount Command Failure After
Disabling SELinux 2-14
Reinstalling Express Builder After a Failed Installation 2-14
Booting in Linux Rescue Mode 2-15
Post-Installation Tasks and Considerations 2-17
Default Configuration Notes 2-17
Configuring the Network 2-17
Adding Fault-Tolerant Utilities to PATH 2-18
Performing an Installation Without a Kickstart File 2-18
Additional Documentation and Resources 2-19
3. Updating ftServer System Firmware
Updating the System BIOS 3-1
Updating BMC Firmware 3-5
4. Updating the Operating System and Express5800/ftServer
System Software
General Upgrade Considerations 4-2
Upgrade Requirements 4-2
Related Considerations 4-2
Upgrading or Restoring the Linux Operating System 4-3
Express5800/ftServer Kernel Modules 4-4
Upgrading the Linux Operating System 4-4
Restoring the Linux Operating System 4-5
Upgrading or Restoring Express Builder 4-6
Creating a Backup System Disk 4-7
Recovering from a Failed Software Upgrade 4-8
Related Information and Resources 4-8
5. Setting Up the ftServer System
Setting Up Internal Disk Storage 5-2
Internal Disk Storage Overview 5-2
The Console Log and the
/var/log/messages File
Configuring Internal Disks 5-3
Managing Partitions 5-4
3-1
4-1
5-1
5-2
iv Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
Contents
Default Internal Disk Configuration for a Newly
Installed System 5-8
Checking the Current State of the Internal Disk Subsystem 5-8
Storage Device Definition 5-9
Setting Up RAID Arrays 5-9
RAID Array Overview 5-9
Creating a RAID-1 Array 5-10
Creating a RAID-0 Array 5-12
Creating and Mounting a File System 5-14
Checking the Current State of RAID 5-14
Removing and Replacing Disks 5-15
Disk Insertion 5-16
Administering RAID Arrays 5-16
To Stop a RAID Array and Move It to Another System 5-16
Errors and Faulty Mirrors 5-17
Removing a Faulty Mirror 5-17
Resynchronization 5-18
Replacing a Failed Disk 5-19
Configuring Safe Mode 5-20
Manually Creating Partitions on Blank Disks and Adding
to RAID-1 Arrays 5-20
Replacing Defective Disks Interactively 5-21
Replacing Defective Disks Manually 5-21
The
duplex_blank_disk Command
5-25
System Backup and Disaster Recovery 5-26
Ethernet Devices 5-26
Physical Device Naming 5-26
Monitoring and Configuring Channel-Bonding Interfaces 5-28
Monitoring Channel-Bonding Interfaces 5-28
Configuring Channel-Bonding Interfaces 5-29
Determining Interface Device Names 5-30
MAC Addresses 5-31
Other System Configuration Information 5-31
Disabling Hyperthreading 5-32
Configuring the System Video Display 5-33
Managing the System Clock 5-33
Additional Documentation and Resources 5-34
6. Managing Data Storage Devices
CD-ROM Drives 6-1
USB Storage Devices 6-1
USB Floppy Drives 6-4
USB Solid-State Devices 6-4
Additional Resources 6-5
6-1
Contents v
Contents
7. Using ftServer Fault-Tolerant Utilities and Software
The
ftsmaint Command
Device Path Enumeration 7-5
ftServer System Device Path Enumeration 7-5
ftsmaint
Examples 7-10
Displaying System Status 7-10
Bringing System Components Down and Up 7-12
Removing a PCI Adapter From Service and Bringing
It Into Service 7-13
Kernel Memory Dump File Management 7-13
8. Simple Network Management Using Net-SNMP and ftlSNMP
Installing and Configuring ftlSNMP 8-1
ftlSNMP Inventory 8-2
Manually Installing and Upgrading the ftlSNMP RPM 8-3
ftlSNMP Prerequisites 8-4
SNMP Configuration File Updates 8-4
The
snmpd.conf File
The
ftlsubagent.conf and
ftltrapsubagent.conf Files
Configuring SNMP to Start at System Initialization 8-6
Configuring SNMP for Service Management 8-6
SNMP Foundations and Concepts 8-8
ftlSNMP Management Commands 8-9
The Basic Net-SNMP Commands 8-10
MIBs 8-11
Some Objects Defined by Standard MIBs 8-12
SNMPv3 Support 8-14
SNMP’s View of a Network 8-14
Extensions and Fault-Tolerant SNMP Operation 8-15
Installing Remote Network Management Services 8-16
Configuring SNMP for Remote Service Management 8-17
Deploying SNMP Agents and Subagents 8-17
Verifying Traps 8-18
Managing SNMP 8-18
Testing Your SNMP Configuration 8-19
Managing ftServer Hardware Components 8-20
Example: Managing Hardware 8-21
Testing Ethernet Ports 8-23
Example: Testing Ethernet Ports 8-23
SNMP and MIBS 8-24
Device Enumeration 8-25
7-1
7-1
8-1
8-5
8-5
vi Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
ftServer System Operation State Management 8-25
SNMP Network Management Station Considerations 8-26
Initial SNMP Testing 8-27
Initial Testing of
Initial Testing of
ftltrapsubagent
ftlsubagent
8-27
8-29
Removing ftlSNMP 8-29
OpState:State Definitions 8-30
OpState:Reason Definitions 8-31
GET and SET Operations for ftlSNMP MIB Objects 8-32
SRA-ftLinux-MIB OID Values and Properties 8-32
Trap Filtering 8-33
Trap-Filtering Capability 8-33
Activating and Deactivating Trap Filtering 8-33
Trap-Filtering Examples 8-34
Contents
9. Troubleshooting ftServer Systems
LED and Visual Diagnostics 9-1
System Boot Problems 9-1
Normal Boot Sequence 9-2
Possible Boot Problems 9-3
Missing Drivers Prevent Booting 9-3
GRUB Problem 9-4
RAID Problem 9-5
Automatic Reboot After Boot Monitoring Timeout 9-5
System Log Messages 9-6
Error and Log Messages Regarding Keyboard and Mouse 9-6
Index
9-1
Index-1
Contents vii
Figures
Figure 2-1. SAS (SATA) Drive Arrangement for Installation 2-9
Figure 5-1. CPU-I/O Enclosures: Front Panel with Drive Slots
Fully Populated 5-3
Figure 7-1. ftServer Enclosures: Locations of Major Enumerated Devices
(Front View) 7-8
Figure 7-2. ftServer Enclosures: Locations of Major Enumerated Devices
(Rear View) 7-9
Figure 8-1. AgentX-Enabled Extensions and Subagents 8-17
Figure 8-2. Operational State Management on ftServer Systems 8-25
viii Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
Tables
Table 2-1.
Table 5-2. Ethernet Devices in ftServer CPU-I/O Enclosures 5-27
Table 7-1. Device Paths of ftServer Devices 7-5
Table 8-1. Meaning of
Table 8-2. Operation State Values, Names, and Definitions 8-30
Table 8-3. Reason Codes, Names, and Definitions 8-31
Table 8-4. Set Operations Currently Implemented in ftlSNMP 8-32
CD-ROMs Included With ftServer Systems
Duplex for ftServer System Components
2-2
8-26
Tables ix
Examples
Example 5-1. Checking the Current State of the Internal Storage
Subsystem 5-9
Example 5-2. Checking the Current State of RAID 5-15
Example 5-3. Resynchronization 5-18
Example 5-4. Running GRUB 5-24
Example 5-5. Pairing a Spare Internal Disk with the Running
System Disk 5-25
Example 5-6. Default Configuration of Embedded Ethernet Devices 5-28
Example 7-1. Displaying System Status with the ftsmaint Command 7-10
Example 8-1. Traps that Can Occur for I/O Element 11 When Trap
Filtering Is Off 8-34
Example 8-2. Traps That Can Occur for I/O Element 11 when Trap
Filtering Is On 8-38
Example 8-3. Traps That Can Occur for When Trap Filtering Is Off 8-40
Example 8-4. Traps That Can Occur When Trap Filtering Is On 8-41
Example 9-1. Possible Keyboard and Mouse Error Messages at
Boot Time 9-6
x Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
The Express5800/ftServer: System Administrator’s Guide for the Linux Operating
System
systems running a supported Linux distribution and ftControl system software
sfor the Linux Operating System (Express Builder).
This document is intended for system and network administrators using or migrating to
Express5800/ftServer systems running a supported Linux distribution and Express
Builder, and for system and application programmers who develop tools and scripts for
use on these systems. Background knowledge of Linux or UNIX
systems, and Linux or UNIX and TCP/IP network server and network administration
technologies is assumed.
documents tasks and information for system administrators of NECAM
Revision Information
This document is a revision.
This revision incorporates the following changes:
•
It documents the Express5800/ftServer Dual-Core and Quad-Core hardware platforms.
Preface
®
shells, tools, and
•
It documents the changed system software installation procedures.
•
It documents the internal storage SAS (SATA) disk drives.
•
It documents added functionality of the ftsmaint command.
•
It includes various updates and corrections.
Notation Conventions
This document uses the notation conventions described in this section.
Warnings, Cautions, and Notes
Warnings, cautions, and notes provide special information and have the following
meanings:
WARNING
!
A warning indicates a situation where failure to take
or avoid a specified action could cause bodily harm
or loss of life.
Preface xi
Preface
CAUTION
!
A caution indicates a situation where failure to take or
avoid a specified action could damage a hardware device,
program, system, or data.
NOTE
A note provides important information about the operation
of an ftServer system.
Typographical Conventions
The following typographical conventions are used in this document:
•
The italic font introduces or defines new terms. For example:
ftServer systems use replicated, fault-tolerant hardware to eliminate single
points of failure and protect data integrity
•
The bold font emphasizes words in text. For example:
Update the BIOS before you install or upgrade Express Builder.
•
The monospace font represents text that would appear on your display screen. The
monospace bold font represents text you must type in examples that contain both
user input and system output. The monospace italic font represents terms in
command lines that are to be replaced by literal values. For
example:
To display the state of a CPU enclosure, type a command in the following
format:
/opt/ft/bin/ftsmaint ls n
If you type /opt/ft/bin/ftsmaint ls 0 at the prompt, the following
output appears:
H/W Path : 0
Description : CPU Node Assembly
.
.
.
•
The percent sign (%) and the number sign (#) are standard default prompt signs
that have a specific meaning at a command prompt. Although a prompt is
sometimes shown at the beginning of a command line as it would appear on the
screen, you do not type it.
xii Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
•
% indicates you are logged in to a user account and are subject to certain
access limitations.
•
# indicates you are logged in to the system administrator account and have
superuser access. Users of this account are referred to as root. The # prompt
sign used in an example indicates the command can only be issued by root.
Syntax Notation
This document uses the following format conventions for documenting commands:
•
Square brackets ([ ]) enclose command argument choices that are optional. For
example:
cflow [-r] [-ix] [-i] [-d num] files
•
The vertical bar (|) separates mutually exclusive arguments from which you choose
one. For example, the following shows two mutually exclusive, but optional,
argurments:
command [arg1 | arg2]
The following example shows two mutually exclusive argurments, one of which is
required:
Preface
In either case, you may use either arg1 or arg2 when you type the command.
•
Ellipsis (...) indicates that you can specify the preceding argument as many times
as you need to on a single command line. For example,
Getting Help
If your Express5800/ftServer system is covered by a service agreement, please contact
NEC Corporation of America Technical Support (866-269-1239).
Notices
•
All regulatory notices are provided in the site planning guide for your system.
command arg1 | arg2
command [arg1 arg2 arg3 ...]
NOTE
Dots, brackets, and braces are not literal characters; you
should not type them. Any list or set of arguments can
contain more than two elements. Brackets and braces are
sometimes nested.
Preface xiii
Preface
•
VTM is not available with Express5800/ftServer for Linux systems.
•
Express Service Network is not available with Linux systems.
•
Although this guide may document modem functionality, modems are not available
for all systems. Ask your sales representative about modem availability.
xiv Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
Chapter 1
Introduction to ftServer System Administration
This chapter discusses the following topics:
•
‘‘ftServer System Terminology”
•
‘‘System and Network Administration Overview”
•
‘‘Additional Documentation and Resources”
ftServer systems running a supported Linux distribution together with
Express5800/ftServer System Software for the Linux Operating System (Express Builder)
operate as fault-tolerant servers. The supported server models are the Express5800/
ftServer Dual-Core and Quad-Core systems. Every Express5800/ftServer system uses
replicated, fault-tolerant hardware to eliminate single points of failure and protect data
integrity in all areas of data handling, including:
•
Processing. Replicated, fault-tolerant processing components process the same
instructions at the same time. In the event of a component malfunction, the partner
component acts as an active spare that continues normal operation, preventing
system downtime and data loss.
•
Internal Storage. Mirrored RAID
Serial attached SCSI and Serial Advanced Technology Attachment SAS (SATA)
disks prevent single disk failures from causing data loss. Replacement disks are
automatically recognized and mirrored.
1 (Redundant arrays of inexpensive disks) arrays
1-
•
Networking. Duplexed network components maintain network connectivity. When
the operating system detects a malfunction in the primary member of a duplexed
pair, it automatically fails over to the secondary member.
Express Service architecture built into ftServer systems supports these features with
self-checking hardware and onboard diagnostics to detect, isolate, and report potential
problems before they affect server operation, offering complete hardware diagnostics
and alarms.
Introduction to ftServer System Administration 1-1
ftServer System Terminology
ftServer System Terminology
Each ftServer system houses two CPU-I/O enclosures. Each CPU-I/O enclosure
includes a CPU element and an I/O element, as follows:
•
CPU element 0 and I/O element 10: The upper enclosure, also referred to as
CPU-0, I/O-10.
•
CPU element 1 and I/O element 11: The lower enclosure, also referred to as
CPU-1, I/O-11.
System and Network Administration Overview
Most examples and discussions in this guide assume that you are acting with root-user
or superuser privileges. They do not always specify when you should (or should not)
be acting as root.
Installing and Updating Software on ftServer Systems
If you ordered the operating system from NECAM, the supported Linux distribution and
Express Builder were installed at the factory. You also received distribution CDs containing
Express Builder and the operating system. These CDs are provided so that you can,
if necessary, reinstall your ftServer system’s software.
If you ordered a supported Linux distribution from a vendor other than NECAM, the
vendor can also provide you with distribution CDs for installing or reinstalling the
system software. You need to use the Express Builder CD with the CDs for the supported
Linux distribution to achieve a fault-tolerant ftServer system.
Before you install your ftServer system’s software, you must prepare your ftServer
system by following the hardware installation instructions provided in the installation
guide for your system.
See Chapter 2 and Chapter 4 for software installation and update procedures.
Updating ftServer System Firmware
Specific firmware versions are required for a given release of Express Builder. The
firmware in an ftServer system delivered from the factory does not require updating.
However, subsequent updates to Express Builder may require firmware updates. When
updating Express Builder, use the versions of firmware and software that are supplied
on the ExpressBuilder for Linux CD.
your system BIOS and Baseboard Management Controller (BMC) firmware.
1-2 Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
Chapter 3 provides procedures for updating
Additional Documentation and Resources
Configuring Your ftServer System
After installing the Linux operating system and Express Builder, you must configure
your system. See
Chapter 5 for configuration information.
Managing Data Storage Devices
In addition to the SAS (SATA) disk storage discussed in Chapter 5, your system supports
CD-ROM drives and USB storage devices. Chapter 6 provides a discussion of these
devices and the information needed to manage them.
Using the Express5800/ftServer Fault-Tolerant Express Builder
While you can use standard Linux tools to perform many system administration tasks
on your ftServer systems, some tasks on fault-tolerant systems require specialized
supporting utilities. The Express Builder includes libraries and utilities to support
fault-tolerant system administration tasks.
and utilities to manage fault-tolerant features and supporting applications of your
system. They include the Express Service Network package that provides support
for Express Service Network access using an attached modem. This package allows
the NEC Corporation of America Customer Support Center or your authorized NEC
service representative to provide remote support for your system. Your system comes
with Express Service Network installed.
Chapter 7 discusses management tasks
Network Management and Reporting
Express Builder includes optional utilities to allow remote support of your ftServer system.
These include an extensible network administration framework and a server-monitoring
utility that provides notification services.
the optional ftlSNMP package implementing Simple Network Management Protocol
(SNMP) for managing network objects. The ftlSNMP package is typically installed with
Express Builder.
Chapter 8 discusses the configuration and use of
Troubleshooting ftServer Systems
Problem identification, system and application diagnostics, and system configuration to
resolve problems with ftServer systems are essential troubleshooting tasks.
discusses system features and procedures to assist you in troubleshooting ftServer
systems.
Additional Documentation and Resources
The following resources provide additional information that may be helpful to you in
administering your ftServer system.
Introduction to ftServer System Administration 1-3
Chapter 9
Additional Documentation and Resources
Red Hat Enterprise Linux
Documentation for the Red Hat Linux operating system is available at
http://www.redhat.com/docs.
Express5800/ftServer Documentation
The ExpressBuilder CD-ROM provided with your system contains all of the
system documentation for ftServer systems that run the Linux operating system. It is
®
provided in Adobe Acrobat
Portable Document Format (PDF) for viewing and printing.
This manual occasionally refers to other documentation that is specific to your
particular ftServer system.
Linux and UNIX Documents
The following sources provide further information about the Linux and UNIX operating
systems.
•
The Linux Documentation Project: http://www.tldp.org/
The System Administrator’s Guide LDP v0.8 and the Network Administrators
Guide LDP v2.0 are two freely redistributable publications available from the Linux
Documentation Project Web site that you can use to supplement this
Express5800/ftServer: System Administrator’s Guide for the Linux Operating
System
. The LDP also provides other online manuals, how-to
documents, and links to additional online-accessible data.
• Sunsite Web page, University of North Carolina, provides well-ordered archives
and links to many resources:
• Linux Administration Handbook
ftp://sunsite.unc.edu/pub/Linux/.
, by Nemeth, Snyder, and Hein, copyright 2002,
Prentice Hall PTR, div. of Pearson Education, Inc.:
1-4 Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
Additional Documentation and Resources
http://vig.prenhall.com/catalog/academic/product/0,4096,0130084662,00.html
This volume is a reference manual for both system and network administration of
the Linux operating system. It focuses on available (at time of publication) open
source tools but incorporates in-depth knowledge of UNIX administration utilities
and network management practices.
Linux in a Nutshell--A Desktop Quick Reference, 4th Ed., by Siever, Figgens, and
•
Weber, copyright 2003, O’Reilly & Associates, Inc.:
This book can help you assess available tools and assemble an effective toolkit for
managing servers and networks, for example.
Open Source Network Administration, by James Kretchmar, copyright 2004,
•
Prentice Hall PTR, div. of Pearson Education, Inc.:
http://vig.prenhall.com/catalog/academic/product/0,4096,0130462101,00.html
This volume is a basic reference for common open source TCP/IP network
administration utilities and technologies, including SNMP tools and methods.
UNIX Systems: Advanced Administration and Management Handbook, Bruce H.
•
and Karen B. Hunter, copyright 1996, Pearson Education. Although this book is an
older book that covers only the UNIX operating system, the advice and wisdom
packaged here for administrators of UNIX-type operating systems and TCP/IP
networks is usually available only through intensive experience.
Introduction to ftServer System Administration 1-5
Additional Documentation and Resources
1-6 Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
Chapter 2
Installing the
Operating
Express5800/
System and
ftServer System
Software
This chapter discusses the following topics:
•
‘‘Installation Overview”
•
‘‘Separately Released and Optional Distribution Components”
•
‘‘Installation Interfaces”
•
‘‘Supported Hardware and Firmware”
•
‘‘Pre-Installation Checklist”
•
‘‘Initial Linux Operating System and Express Builder Installation or Default Reinstallation”
•
‘‘Post-Installation Tasks and Considerations”
•
‘‘Performing an Installation Without a Kickstart File”
•
‘‘Additional Documentation and Resources”
The procedures described in this chapter are for a fresh installation or complete
reinstallation of a supported Linux operating system and the Express5800/ftServer
System Software for the Linux Operating System (Express Builder) on ftServer systems.
Chapter 4 describes an upgrade procedure and system and package restoration
procedures for upgrading a recent distribution to the current software distribution level.
2-
NOTE
Be sure to read the accompanying Release Notes:
Express5800/ftServer for the Linux Operating
System
initial installation or a reinstallation of Linux and Express Builder.
Installing the Operating System and Express5800/ftServer System Software 2-1
document before you undertake an
Installation Overview
Installation Overview
An installable distribution CD-ROM (CD) set is provided. Table 2-1 lists the CDs
included in this distribution.
Table 2-1. CD-ROMs Which May Be Included With ftServer Systems
ExpressBuilder for Linux CD Express5800/ftServer fault-tolerant system
ftControl Software Update Updated ftServer fault-tolerant
Express Builder Debug Info Includes debuginfo RPMs.
stnetnoCMOR-DC
software
system software.
Set of Red Hat® Enterprise Linux
operating system CDs
Red Hat Enterprise Linux operating
system, related packages, and
documentation
If your site did not purchase the Linux operating system distribution from NECAM, you
must perform the complete initial Linux operating system installation. However, if you
purchased an ftServer system and the Linux operating system from NECAM, the Linux
operating system and Express Builder are preinstalled. You do not need to reinstall or
upgrade this software. You should familiarize yourself with this chapter, then log in.
To log in to the system
1. Log in as root.
2. Enter the root password.
(A password must have at least six characters.) After you read and accept the
necessary end-user license agreements, continue to
Chapter 5 to begin configuring
the ftServer system.
If you have a current installation that requires only minor upgrading review your Release
Notes:Express5800/ftServer for the Linux Operating System, then see Chapter4 and,
if necessary, Chapter 3.
If some time has elapsed since your Express5800/ftServer system was delivered, there
may be updated documentation and software that may be useful to you.
N O T E
Firmware updates may require Express Builder updates. Express Builder
updates may require firmware updates. When updating
2-2 Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
From time to time, NECAM may issue an update to Express Builder. See Chapter 4
for information about updating from an Express Builder update disk.
If you need to repair a corrupted system, or update the system to a new release,
determine whether the upgrade procedure in
before doing a full installation.
Boot Media
Installation Overview
Express Builder, use the versions of firmware and software that are
supplied on the ExpressBuilder for Linux (1 of 2) CD.
CAUTIONCAUTION
!
The procedure described in this chapter is for a full
installation or reinstallation of a supported Linux operating
system and Express Builder. It is assumed that no valuable
data exists on the target system disks. The installation and
upgrade installation procedures will destroy existing
data on the drives in the bottom slot (labeled 1) of
each CPU-I/O enclosure
Chapter 4 will meet your requirements
The supported Linux operating system is provided on a set of distribution CDs available
from NECAM or the Linux operating system vendor.
Default System Setup
This section provides an overview of the default setup that is provided on initial
installation or complete reinstallation of the Linux operating system distribution. It does
not reflect installation of optional packages.
Installing the Operating System and Express5800/ftServer System Software 2-3
Installation Overview
NOTE
The Linux operating system installer program does not
anticipate customer-added and unknown hardware. Any
such hardware should be added, and the system
configured as required to support it, only after installation
procedures have been completed and the system has
been determined to function as expected.
Linux Version Information
You can check the installed version of the Linux operating system on your system using
the uname command. The -r specifies that the kernel release level be returned.
# uname -r
2.6.9-34.EL.serial.idesmp
To check the installed Express Builder distribution release level using the rpm command, enter:
$ rpm -q lsb-ft-eula_display
lsb-ft-eula_display-4.0-65
Storage Default Settings
CAUTIONCAUTION
!
Prepare for installation by installing disk drives of identical
size and geometry into the internal storage in the bottom
slot (the two slots labeled 1: sda and sdd) of each
CPU-I/O enclosure. Remove all internal drives from the
other four slots (sdb, sdc, sde, and sdf). The installation
process pairs the two installed drives.
NOTES
Do not install SATA disk drives in slots sda and sdd.
1.
For performance reasons, these drives are not supported
as boot disks, but can be used freely as data disks.
2. Express5800/ftServer Dual-Core and Quad-Core
systems may be mounted in a rack or in a pedestal.
The terms upper, top, lower, and bottom assume a
rack (horizontal) installation. In pedestals, systems
are rotated 90 degrees counterclockwise from their
rack-mounted position, so upper becomes left, lower
becomes middle or right, and bottom becomes right.
2-4 Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
Installation Overview
The installation process creates a disk drive RAID array, pairing sda and sdd drives as
a mirrored set that holds the entire installed Linux software distribution and Express
Builder. On this mirrored drive set, the GRUB bootloader on the master boot record at
track 0 makes both drives in the set bootable using GRUB configuration data stored in
the /boot partition. Storage is allocated as shown in
•
The /boot directory is installed as an ext2 file system on /dev/sda1 and
Ta bl e 5-1.
/dev/sdd1, on a partition of at least 256 MB. This partition contains the GRUB
boot loader configuration file and GRUB restricted shell, as well as the Linux kernel
and initial RAM disk files.
•
A swap partition provides 2048 MB of swap space.
NOTE
Regardless of installed system memory, the current Linux
kernel can only use about 2 GB of swap space per swap
partition. The kernel can address swap partitions on more
than one drive, so it is possible to improve swap
performance on multi-drive systems by using swap
partitions on each installed drive pair. However, for fault
tolerance, always use mirrored swap partitions. See
‘‘Setting Up Internal Disk Storage’’ on page 5-2 for more
information.
•
The root partition comprises 32 GB.
•
The remainder of the space is an extended partition that includes 36 GB or more
of unused space. This extended partition can be further divided by logical
partitions.
All internal drives used in mirrored RAID arrays in the internal hot-swap drive bays must
have firmware that meets ftServer specifications. Do not update your internal drives
with firmware from sources other than NEC Corporation of America. Contact your
NEC Corporation of America Customer Support Center or your authorized NEC service
representative for your internal SAS (SATA) drive support requirements.
Ethernet Default Configuration
At installation, the 10/100/1000-Megabits per second (Mbps) embedded Ethernet
adapters of each CPU-I/O enclosure are configured. For more information about
configuring Ethernet interfaces, see
USB and RS232C Default Settings
Only the USB keyboard and, optionally, a USB mouse should be attached to the
system during an initial installation of the operating system.
Installing the Operating System and Express5800/ftServer System Software 2-5
‘‘Ethernet Devices’’ on page 5-26.
Separately Released and Optional Distribution Components
In most cases, attached devices are recognized and addressable on installation (as is
a standard USB keyboard, for example), although hot-plugged devices may not be.
USB 2.0 interface specifications are supported.
After installation, you may need to set serial-port flow control and data-rate
characteristics for attaching serial data communications equipment or data terminal
equipment, such as an asynchronous terminal, a printer, or attached modem. Note that
the Linux operating system and most application software treat data communications
equipment somewhat differently from data terminal equipment.
Default System Initialization and Run-Level Control
Default system initialization and run-level-controlled process configuration are basic
and not tailored specifically for server operations. You will need to configure the system
as required for your specific application.
Default User Environments, Shells, and Access Control
The GRUB bootloader package supplied with the Linux distribution includes a
restricted GRUB shell that can be entered at system boot for boot loader configuration
and boot recovery operations. See grub(1) for a discussion of this feature. Make sure
that GRUB requires root privilege, and password-protect this shell for system security.
System Indicators and Switches
See the User Guide and User Guide (Setup) for your system for information about the
LED indicators and switches of your ftServer system.
Separately Released and Optional Distribution Components
You can install and use provided optional tools. You can install optional packages by
using the rpm command to select and install packages from a mounted CD-ROM drive.
C A U T I O NC A U T I O N
!
Some installed and optional utilities may depend on
specific versions of other packages required by your
system for fault-tolerant operation. Always use the
software packages that are provided with the Express Builder
distribution, unless you have good reason to replace a
package. Before updating a distribution package, use rpm
2-6 Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
to check dependencies. Note that rpm does not always
reveal specific release-level dependencies.
From the Express Builder distribution, Express Service Network and ftlSNMP packages
are installed as options and require additional configuration before they can be used. See
‘‘Kernel Memory Dump File Management’’ on page 7-13 and Chapter 8 for information
on configuring and using these utilities.
Installation Interfaces
The installation process has two parts. First, you install the Linux operating system, and
then you perform the Express Builder installation.
You must connect a supported monitor to the VGA port on the rear of the system, and
a supported USB mouse and keyboard to a USB port on the rear of the system.
The Linux operating system and Express Builder installation process use an attached LCD
or SVGA-capable monitor attached to the SVGA connector at the ftServer back panel and
a USB mouse and keyboard attached to a USB port.
Installation Interfaces
Supported Hardware and Firmware
The Linux operating system combined with Express Builder can be installed only on
supported Express5800/ftServer Dual-Core and Quad-Core systems. Do not attempt to
install this software combination on an ftServer system that does not support it. Express
Builder interfaces with ftServer firmware that has been tuned to support fault tolerance.
Specific Express Builder releases may require corresponding updates to the system BIOS
or baseboard management controller (BMC) firmware.
Pre-Installation Checklist
The following checklist is provided for an initial installation or a full reinstallation of a
supported Linux operating system and Express Builder. If you need to upgrade an existing
Express Builder release, see
❏
Check that you have current release notes and installation guides for your
distribution. To restore your installation, make sure you have the appropriate
version of the release level that you will restore. The Release Notes:
Express5800/ftServer for the Linux Operating System
the ExpressBuilder for Linux CD, provides the information that you need.
Also check the system hardware against the release notes. The I/O elements and
installed devices must comply with any identified configuration requirements and
Installing the Operating System and Express5800/ftServer System Software 2-7
Chapter 4.
in PDF format, on
Pre-Installation Checklist
support restrictions on hardware that apply either to this installation procedure or
to the current Express Builder release generally.
❏
The installation CDs ask that you read and accept end user license agreements
(EULAs). You should not perform the installation if you cannot accept the EULAs
or are not authorized to accept them. Installation terminates without completion if
you decline a required EULA. You can read the text of the required EULAs in the
installation guide for your system.
❏
If you are reinstalling a release, back up all data files and prepare backup files to
reconfigure the system for security and network operation after the installation
procedure has been performed.
❏
Verify that your system BIOS and BMC firmware versions are compatible with the
Express Builder release you are about to install. You can obtain required versions
of firmware from the Express Builder CD-ROM.
If system BIOS or BMC firmware updates are needed, you must update the
firmware before you begin the installation or upgrade process. You can obtain the
required firmware from the Express Builder CD that comes with the distribution.
See
Chapter 3 for details.
❏
Use the CD-ROM drive in the top CPU-I/O enclosure during the installation. Do not
use the drive in the lower CPU-I/O enclosure. Verify that the top enclosure is the
active enclosure.
❏
Ensure that the keyboard, mouse, and console are attached to the system. The
installer uses a graphical user interface on the ftServer system console, which
consists of a monitor attached to an SVGA port and an attached USB keyboard and
mouse.
❏
With the ftServer system halted, detach all peripheral devices from the system.
This includes unsupported adapters, USB, and other serial devices.
No USB devices other than the keyboard and mouse should be attached to the
ftServer system.
❏
No external modem or other devices should be attached to the serial ports of the
ftServer system.
❏
The bottom slots (slots sda and sdd) in the internal storage enclosures must
contain a matched pair of supported disk drives having the same model, firmware
level, and geometry. These must not be SATA drives. All other drives must be
removed from the system. See the drive arrangement in
Figure 2-1. For
information about the supported disk drives, see the operation and maintenance
guide for your system.
During the installation, the two installed drives will be paired and configured using
RAID-1 mirroring. A Linux boot partition, a swap partition, and a root partition will
be installed on the paired drives.
2-8 Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
Initial Linux Operating System and Express Builder Installation or Default Reinstallation
Figure 2-1. SAS (SATA) Drive Arrangement for Installation
sdc
sdb
sda
sdf
sde
sdd
asys076
Make sure that the system and monitor power connections are secure and firmly
plugged in before beginning an installation procedure. Power cabling should be
guarded against inadvertent disconnection during the installation process. The
monitor may use a separate power source.
Begin the installation process with both CPU-I/O enclosures inserted and with the
ftServer system halted. A red LED is lit at the left side of each CPU-I/O enclosure.
Ensure that the green power button at the right side of the upper CPU-I/O
enclosure is lit; the lit LED indicates that it is the active (primary) enclosure. If the
upper CPU-I/O enclosure is not the active enclosure, you must make it the active
enclosure by performing the actions listed in step
2 of the installation procedure in
‘‘Initial Linux Operating System and Express Builder Installation or Default
Reinstallation’’ on page 2-10.
For security during installation and initial configuration, isolate the ftServer system
from networks and other communicating hosts.
Be aware that a system with a newly installed operating system and Express
Builder is not secure until it has been configured. In addition, you may want to change
the default network settings.
Initial Linux Operating System and Express Builder Installation
or Default Reinstallation
The User Guide (Setup) contains detail procedures to install the Linux operationg system
and the ftControl Software.
Installing the Operating System and Express5800/ftServer System Software 2-9
Initial Linux Operating System and Express Builder Installation or Default Reinstallation
Avoiding CD-ROM Mount Command Failure After Disabling SELinux
During the installation of Express Builder, you choose whether to enable or disable
SELinux. If you choose to enable SELinux, and then disable SELinux at a later time,
the command to mount the CD-ROM device fails unless you edit the /etc/fstab file
to remove a parameter that is added to the file when you disable SELinux.
To allow the command to mount a CD-ROM to function properly, edit the /etc/fstab
file.
On the /dev/hda /media/cdrecorder line, replace the following text:
fscontext=system_u:object_r:removable_t
with the following:
fscontext=system_u:object_r:removable_t,exec,noauto,managed 0 0
When you disable SELinux, this parameter is added to the /etc/fstab file, which
causes the command to mount the CD-ROM to fail.
Reinstalling Express Builder After a Failed Installation
If the attempt to install Express Builder fails, before again trying to install it, perform the
following steps to uninstall the requisite files and attempt to reinstall Express Builder in
the correct sequence.
1. Remove all NECAM packages except eula_display with this command:
rpm -e --nodeps --allmatches `rpm -qa | grep lsb-ft | grep
-v eula_display`
2. Remove eula_display with this command:
rpm -e --nodeps lsb-ft-eula_display
3. Reinstall Express Builder by mounting the CD and issuing the install.sh command.
If the system does not then reboot automatically, reboot the system manually.
Booting in Linux Rescue Mode
If the OS installation fails, whether or not Express Builder installed successfully, attempt to
boot the system in rescue mode. Use the Red Hat Enterprise Linux CD-ROM #1 to boot in
rescue mode.
2-14 Express5800/ftServer: System Administrator’s Guide for the Linux Operating System
Loading...