This document contains release notes for HP XC System Software Version 3.2. This document
contains important information about firmware, software, or hardware that might affect the
system.
An HP XC system is integrated with several open source software components. Some open source
software components are being used for underlying technology, and their deployment is
transparent. Some open source software components require user-level documentation specific
to HP XC systems, and that kind of information is included in this document when required.
HP relies on the documentation provided by the open source developers to supply the information
you need to use their product. For links to open source software documentation for products
that are integrated with the HP XC system, see “Supplementary Software Products” (page 9).
Documentation for third-party hardware and software components that are supported on the
HP XC system is supplied by the third-party vendor. However, information about the operation
of third-party software is included in this document if the functionality of the third-party
component differs from standard behavior when used in the XC environment. In this case, HP
XC documentation supersedes information supplied by the third-party vendor. For links to
related third-party Web sites, see “Supplementary Software Products” (page 9).
Standard Linux® administrative tasks or the functions provided by standard Linux tools and
commands are documented in commercially available Linux reference manuals and on various
Web sites. For more information about obtaining documentation for standard Linux administrative
tasks and associated topics, see the list of Web sites and additional publications provided in
“Related Software Products and Additional Publications” (page 11).
Intended Audience
The release notes are intended for anyone who installs and configures an HP XC system, for
system administrators who maintain the system, for programmers who write applications to run
on the system, and for general users who log in to the system to run jobs.
The information in this document assumes that you have knowledge of the Linux operating
system.
Typographic Conventions
This document uses the following typographical conventions:
%, $, or #
audit(5)A manpage. The manpage name is audit, and it is located in
Command
Computer output
Ctrl+xA key sequence. A sequence such as Ctrl+x indicates that you
ENVIRONMENT VARIABLEThe name of an environment variable, for example, PATH.
[ERROR NAME]
KeyThe name of a keyboard key. Return and Enter both refer to the
TermThe defined use of an important word or phrase.
User input
A percent sign represents the C shell system prompt. A dollar
sign represents the system prompt for the Korn, POSIX, and
Bourne shells. A number sign represents the superuser prompt.
Section 5.
A command name or qualified command phrase.
Text displayed by the computer.
must hold down the key labeled Ctrl while you press another
key or mouse button.
The name of an error, usually returned in the errno variable.
same key.
Commands and other text that you type.
Intended Audience7
Variable
The name of a placeholder in a command, function, or other
syntax display that you replace with an actual value.
[ ]The contents are optional in syntax. If the contents are a list
separated by |, you can choose one of the items.
{ }The contents are required in syntax. If the contents are a list
separated by |, you must choose one of the items.
. . .The preceding element can be repeated an arbitrary number of
times.
|Separates items in a list of choices.
WARNINGA warning calls attention to important information that if not
understood or followed will result in personal injury or
nonrecoverable system problems.
CAUTIONA caution calls attention to important information that if not
understood or followed will result in data loss, data corruption,
or damage to hardware or software.
IMPORTANTThis alert provides essential information to explain a concept or
to complete a task.
NOTEA note contains additional information to emphasize or
supplement important points of the main text.
HP XC and Related HP Products Information
The HP XC System Software Documentation Set, the Master Firmware List, and HP XC HowTo
documents are available at this HP Technical Documentation Web site:
http://www.docs.hp.com/en/linuxhpc.html
The HP XC System Software Documentation Set includes the following core documents:
HP XC System Software Release Notes
HP XC Hardware Preparation Guide
HP XC System Software Installation Guide
HP XC System Software Administration Guide
HP XC System Software User's Guide
QuickSpecs for HP XC System Software
Describes important, last-minute information about firmware,
software, or hardware that might affect the system. This
document is not shipped on the HP XC documentation CD. It
is available only on line.
Describes hardware preparation tasks specific to HP XC that
are required to prepare each supported hardware model for
installation and configuration, including required node and
switch connections.
Provides step-by-step instructions for installing the HP XC
System Software on the head node and configuring the system.
Provides an overview of the HP XC system administrative
environment, cluster administration tasks, node maintenance
tasks, LSF® administration tasks, and troubleshooting
procedures.
Provides an overview of managing the HP XC user environment
with modules, managing jobs with LSF, and describes how to
build, run, debug, and troubleshoot serial and parallel
applications on an HP XC system.
Provides a product overview, hardware requirements, software
requirements, software licensing information, ordering
information, and information about commercially available
software that has been qualified to interoperate with the HP XC
System Software. The QuickSpecs are located on line:
http://www.hp.com/go/clusters
See the following sources for information about related HP products.
8
HP XC Program Development Environment
The Program Development Environment home page provide pointers to tools that have been
tested in the HP XC program development environment (for example, TotalView® and other
HP Message Passing Interface (HP-MPI) is an implementation of the MPI standard that has been
integrated in HP XC systems. The home page and documentation is located at the following Web
site:
http://www.hp.com/go/mpi
HP Serviceguard
HP Serviceguard is a service availability tool supported on an HP XC system. HP Serviceguard
enables some system services to continue if a hardware or software failure occurs. The HP
Serviceguard documentation is available at the following Web site:
http://www.docs.hp.com/en/ha.html
HP Scalable Visualization Array
The HP Scalable Visualization Array (SVA) is a scalable visualization solution that is integrated
with the HP XC System Software. The SVA documentation is available at the following Web site:
http://www.docs.hp.com/en/linuxhpc.html
HP Cluster Platform
The cluster platform documentation describes site requirements, shows you how to set up the
servers and additional devices, and provides procedures to operate and manage the hardware.
These documents are available at the following Web site:
http://www.docs.hp.com/en/linuxhpc.html
HP Integrity and HP ProLiant Servers
Documentation for HP Integrity and HP ProLiant servers is available at the following Web site:
http://www.docs.hp.com/en/hw.html
Related Information
This section provides useful links to third-party, open source, and other related software products.
Supplementary Software ProductsThis section provides links to third-party and open source
software products that are integrated into the HP XC System Software core technology. In the
HP XC documentation, except where necessary, references to third-party and open source
software components are generic, and the HP XC adjective is not added to any reference to a
third-party or open source command or product name. For example, the SLURM srun command
is simply referred to as the srun command.
The location of each Web site or link to a particular topic listed in this section is subject to change
without notice by the site provider.
•http://www.platform.com
Home page for Platform Computing Corporation, the developer of the Load Sharing Facility
(LSF). LSF-HPC with SLURM, the batch system resource manager used on an HP XC system,
is tightly integrated with the HP XC and SLURM software. Documentation specific to
LSF-HPC with SLURM is provided in the HP XC documentation set.
Related Information9
Standard LSF is also available as an alternative resource management system (instead of
LSF-HPC with SLURM) for HP XC. This is the version of LSF that is widely discussed on
the Platform Web site.
For your convenience, the following Platform Computing Corporation LSF documents are
shipped on the HP XC documentation CD in PDF format:
— Administering Platform LSF
— Administration Primer
— Platform LSF Reference
— Quick Reference Card
— Running Jobs with Platform LSF
LSF procedures and information supplied in the HP XC documentation, particularly the
documentation relating to the LSF-HPC integration with SLURM, supersedes the information
supplied in the LSF manuals from Platform Computing Corporation.
The Platform Computing Corporation LSF manpages are installed by default. lsf_diff(7)
supplied by HP describes LSF command differences when using LSF-HPC with SLURM on
an HP XC system
The following documents in the HP XC System Software Documentation Set provide
information about administering and using LSF on an HP XC system:
— HP XC System Software Administration Guide
— HP XC System Software User's Guide
•http://www.llnl.gov/LCdocs/slurm/
Documentation for the Simple Linux Utility for Resource Management (SLURM), which is
integrated with LSF to manage job and compute resources on an HP XC system.
•http://www.nagios.org/
Home page for Nagios®, a system and network monitoring application that is integrated
into an HP XC system to provide monitoring capabilities. Nagios watches specified hosts
and services and issues alerts when problems occur and when problems are resolved.
•http://oss.oetiker.ch/rrdtool
Home page of RRDtool, a round-robin database tool and graphing system. In the HP XC
system, RRDtool is used with Nagios to provide a graphical view of system status.
•http://supermon.sourceforge.net/
Home page for Supermon, a high-speed cluster monitoring system that emphasizes low
perturbation, high sampling rates, and an extensible data protocol and programming
interface. Supermon works in conjunction with Nagios to provide HP XC system monitoring.
•http://www.llnl.gov/linux/pdsh/
Home page for the parallel distributed shell (pdsh), which executes commands across HP
XC client nodes in parallel.
•http://www.balabit.com/products/syslog_ng/
10
Home page for syslog-ng, a logging tool that replaces the traditional syslog functionality.
The syslog-ng tool is a flexible and scalable audit trail processing tool. It provides a
centralized, securely stored log of all devices on the network.
•http://systemimager.org
Home page for SystemImager®, which is the underlying technology that distributes the
golden image to all nodes and distributes configuration changes throughout the system.
•http://linuxvirtualserver.org
Home page for the Linux Virtual Server (LVS), the load balancer running on the Linux
operating system that distributes login requests on the HP XC system.
•http://www.macrovision.com
Home page for Macrovision®, developer of the FLEXlm™ license management utility, which
is used for HP XC license management.
•http://sourceforge.net/projects/modules/
Web site for Modules, which provide for easy dynamic modification of a user's environment
through modulefiles, which typically instruct the module command to alter or set shell
environment variables.
•http://dev.mysql.com/
Home page for MySQL AB, developer of the MySQL database. This Web site contains a link
to the MySQL documentation, particularly the MySQL Reference Manual.
Related Software Products and Additional PublicationsThis section provides pointers to Web
sites for related software products and provides references to useful third-party publications.
The location of each Web site or link to a particular topic is subject to change without notice by
the site provider.
Linux Web Sites
•http://www.redhat.com
Home page for Red Hat®, distributors of Red Hat Enterprise Linux Advanced Server, a
Linux distribution with which the HP XC operating environment is compatible.
•http://www.linux.org/docs/index.html
This Web site for the Linux Documentation Project (LDP) contains guides that describe
aspects of working with Linux, from creating your own Linux system from scratch to bash
script writing. This site also includes links to Linux HowTo documents, frequently asked
questions (FAQs), and manpages.
•http://www.linuxheadquarters.com
Web site providing documents and tutorials for the Linux user. Documents contain
instructions for installing and using applications for Linux, configuring hardware, and a
variety of other topics.
•http://www.gnu.org
Home page for the GNU Project. This site provides online software and information for
many programs and utilities that are commonly used on GNU/Linux systems. Online
information include guides for using the bash shell, emacs, make, cc, gdb, and more.
MPI Web Sites
•http://www.mpi-forum.org
Contains the official MPI standards documents, errata, and archives of the MPI Forum. The
MPI Forum is an open group with representatives from many organizations that define and
maintain the MPI standard.
•http://www-unix.mcs.anl.gov/mpi/
A comprehensive site containing general information, such as the specification and FAQs,
and pointers to other resources, including tutorials, implementations, and other MPI-related
sites.
Provides information about how to use the mdadm RAID management utility.
Additional Publications
For more information about standard Linux system administration or other related software
topics, consider using one of the following publications, which must be purchased separately:
•Linux Administration Unleashed, by Thomas Schenk, et al.
•Linux Administration Handbook, by Evi Nemeth, Garth Snyder, Trent R. Hein, et al.
•Managing NFS and NIS, by Hal Stern, Mike Eisler, and Ricardo Labiaga (O'Reilly)
•MySQL, by Paul Debois
•MySQL Cookbook, by Paul Debois
•High Performance MySQL, by Jeremy Zawodny and Derek J. Balling (O'Reilly)
•Perl Cookbook, Second Edition, by Tom Christiansen and Nathan Torkington
•Perl in A Nutshell: A Desktop Quick Reference , by Ellen Siever, et al.
Manpages
Manpages provide online reference and command information from the command line. Manpages
are supplied with the HP XC system for standard HP XC components, Linux user commands,
LSF commands, and other software components that are distributed with the HP XC system.
Manpages for third-party software components might be provided as a part of the deliverables
for that component.
Using discover(8) as an example, you can use either one of the following commands to display a
manpage:
$ man discover
$ man 8 discover
If you are not sure about a command you need to use, enter the man command with the -k option
to obtain a list of commands that are related to a keyword. For example:
$ man -k keyword
12
HP Encourages Your Comments
HP encourages comments concerning this document. We are committed to providing
documentation that meets your needs. Send any errors found, suggestions for improvement, or
compliments to:
feedback@fc.hp.com
Include the document title, manufacturing part number, and any comment, error found, or
suggestion for improvement you have concerning this document.
HP Encourages Your Comments13
14
1 New and Changed Features
This chapter describes the new and changed features delivered in HP XC System Software Version
3.2.
1.1Base Distribution and Kernel
The following table lists information about the base distribution and kernel for this release as
compared to the last HP XC release.
HP XC Version 3.1HP XC Version 3.2
Enterprise Linux 4 Update 3Enterprise Linux 4 Update 4
HP XC kernel version 2.6.9-34.7hp.XCHP XC kernel version 2.6.9-42.9hp.XC
Based on Red Hat kernel version 2.6.9-34.0.2.ELBased on Red Hat kernel version 2.6.9-42.0.8.EL
1.2Support for Additional Hardware Models
In this release, the following additional hardware models and hardware components are supported
in an HP XC hardware configuration.
•HP ProLiant servers:
— HP ProLiant DL360 G5
— HP ProLiant DL380 G5
— HP ProLiant DL580 G4
— HP ProLiant DL145 G3
— HP ProLiant DL385 G2
— HP ProLiant DL585 G2
•HP Integrity servers and workstations:
— HP Integrity rx2660
— HP Integrity rx4640
— HP xw9400 workstation
1.3OpenFabrics Enterprise Distribution for InfiniBand
Starting with this release, the HP XC System Software uses the OpenFabrics Enterprise Distribution
(OFED) InfiniBand software stack.
OFED is an open software stack supported by the major InfiniBand vendors as the future of
InfiniBand support. OFED offers improved support of multiple HCAs per node. The OFED stack
has a different structure and different commands from the InfiniBand stack that was used in
previous HP XC releases.
See the following web page for more information about OFED:
http://www.openfabrics.org/
The HP XC System Software Administration Guide provides OFED troubleshooting information.
1.4HP Scalable Visualization Array
HP Scalable Visualization Array (SVA) software is now included on the HP XC System Software
DVD distribution media. SVA provides a comprehensive set of services for deployment of
visualization applications, allowing them to be conveniently run in a Linux clustering
environment.
1.1 Base Distribution and Kernel15
The following are the key features of SVA:
•Capturing and managing visualization-specific cluster information
•Managing visualization resources and providing facilities for requesting and allocating
resources for a job in a multi-user, multi-session environment
•Providing display surface configuration tools to allow easy configuration of multi-panel
displays
•Providing launch tools, both generic and tailored to a specific application, that launch
applications with appropriate environments and display surface configurations
•Providing tools that extend serial applications to run in a clustered, multi-display
environment
See the HP XC QuickSpecs and the SVA documentation set for more information about SVA
features. The SVA documentation set is included on the HP XC Documentation CD.
Because the SVA RPMs are included on the HP XC distribution media, the SVA installation
process has been integrated with the HP XC installation process. The HP XC System SoftwareInstallation Guide was revised where appropriate to accommodate SVA installation and
configuration procedures.
1.5Partition Size Limits on Installation Disk
Because the installation disk size can vary, partition sizes are calculated as a percentage of total
disk size. However, using a fixed percentage of the total disk size to calculate the size of each
disk partition can result in needlessly large partition sizes when the installation disk is larger
than 36 GB. Thus, for this release, limits have been set on the default partition sizes to leave space
on the disk for other user-defined file systems and partitions.
1.6More Flexibility in Customizing Client Node Disk Partitions
You can configure client node disks on a per-image and per-node basis to create an optional
scratch partition to maximize file system performance. Partition sizes can be fixed or they can
be based on a percentage of total disk size. To do so, you set the appropriate variables in the
/opt/hptc/systemimager/etc/make_partitions.sh file or set the variables in
user-defined files with a .part extension.
The procedure that describes how to customize client node disk partitions is documented in the
HP XC System Software Installation Guide.
1.7Enhancements to the discover Command
. The following options were added to the discover command:
•The --nodesonly option reads in the database and discover all nodes if the hardware
configuration contains HP server blades and enclosures. This option is valid only when the
--enclosurebased option is also used
•The --nothreads option runs the node discovery process without threads if the hardware
configuration contains HP server blades and enclosures. This option is valid only when the
--enclosurebased option is also used.
1.8Enhancements to the cluster_config Utility
The cluster_config utility prompts you to specify whether you want to configure the Linux
virtual server (LVS) director to act as a real server, that is, a node that accepts login sessions.
If you answer yes, the LVS director is configured to act as a login session server in addition to
arbitrating and dispersing the login session connections.
If you answer no, the LVS director does not participate as a login session server; its only function
is to arbitrate and disperse login sessions to other nodes. This gives you the flexibility to place
16New and Changed Features
the login role on the head node yet keep the head node load to a minimum because login
sessions are not being spawned.
This configuration choice is documented in the HP XC System Software Installation Guide.
1.9System Management and Monitoring Enhancements
System management and monitoring utilities have been enhanced as follows:
•A new resource monitoring tool, resmon, has been added. resmon is a job-centric resource
monitoring Web page initially inspired by the open-source clumon product. resmon invokes
useful commands to collect and present data in a scalable and intuitive fashion. The resmon
Web pages update automatically at a preconfigured interval (120 seconds by default).
See resmon(1) for more information.
•The HP Graph Web interface has been enhanced to include a cpu temperature graph.
To access this new graph, select temperature from the Metrics pull-down menu at the top
of the Web page.
1.10Enhancements to the OVP
The operation verification program (OVP) performance health tests were updated to accept an
option to specify an LSF queue. In addition, you can run two performance health tests,
network_stress and network_bidirectional, on systems that are configured with standard
LSF or configured with LSF-HPC with SLURM.
1.11Installing and Upgrading HP XC System Software On Red Hat
Enterprise Linux
The HP XC System Software Installation Guide contains two new chapters that describes the
following topics:
•Installing HP XC System Software Version 3.2 on Red Hat Enterprise Linux
•Upgrading HP XC System Software Version 3.1 on Red Hat Enterprise Linux to HP XC
System Software Version 3.2 on Red Hat Enterprise Linux
1.12Support For HP Unified Parallel C
This release provides support for the HP Unified Parallel C (UPC) application development
environment.
HP UPC is a parallel extension of the C programming language, which runs on both common
types of multiprocessor systems: those with a common global address space (such as SMP) and
those with distributed memory. UPC provides a simple shared memory model for parallel
programming, allowing data to be shared or distributed among a number of communicating
processors. Constructs are provided in the language to permit simple declaration of shared data,
distribute shared data across threads, and synchronize access to shared data across threads. This
model promises significantly easier coding of parallel applications and maximum performance
across shared memory, distributed memory, and hybrid systems.
See the following Web page for more information about HP UPC:
http://www.hp.com/go/upc
1.9 System Management and Monitoring Enhancements17
Loading...
+ 37 hidden pages
You need points to download manuals.
1 point = 1 manual.
You can buy points or you can get point for every manual you upload.