Intel S5000PAL User Manual

205.95 Kb
Loading...

How to Build a Cluster

Intel® Server Board S5000PAL

Recipe ID: 15PLTF240000000100-04

How to Build a Cluster - Intel® Server Board S5000PAL

Contents

Introduction .........................................................................................................................

4

Overview ..............................................................................................................................

4

Hardware Components ......................................................................................................

5

Software Used in the Installation ....................................................................................

7

Hardware Installation.........................................................................................................

7

Server racks...................................................................................................................................................................................................................................................

7

Remote console configuration / KVMIP ...............................................................................................................................................................

8

Ethernet Switches and Cables...........................................................................................................................................................................................

8

Infiniband Switches and Host Channel Adapters....................................................................................................................................

8

Handling InfiniBand Cables......................................................................................................................................................................................................

8

Rotating InfiniBand Connectors......................................................................................................................................................................................

9

Minimum Cable Bend Radius............................................................................................................................................................................................

10

Server Management ........................................................................................................

12

BIOS and Firmware Provisioning...................................................................................

12

OS Provisioning and Cluster Management ..................................................................

13

Platform OCS 4.1.1-1.1/4.1.1-2.1 ............................................................................................................................................................................

13

Z RESEARCH GlusterHPC ....................................................................................................................................................................................................

13

2

How to Build a Cluster - Intel® Server Board S5000PAL

http://www.intel.com/go/esaa

The information contained in this document is provided for informational purposes only and represents the current view of Intel Corporation (“Intel”) and its contributors ("Contributors") on, as of the date of publication. Intel and the Contributors make no commitment to update the information contained in this document, and Intel reserves the right to make changes at any time, without notice.

DISCLAIMER. THIS DOCUMENT, IS PROVIDED “AS IS.” NEITHER INTEL, NOR THE CONTRIBUTORS MAKE ANY REPRESENTATIONS OF ANY KIND WITH RESPECT TO PRODUCTS REFERENCED HEREIN, WHETHER SUCH PRODUCTS ARE THOSE OF INTEL, THE CONTRIBUTORS, OR THIRD PARTIES. INTEL, AND ITS CONTRIBUTORS EXPRESSLY DISCLAIM ANY AND ALL WARRANTIES, IMPLIED OR EXPRESS, INCLUDING WITHOUT LIMITATION, ANY WARRANTIES OF MERCHANTABILITY, FITNESS FOR ANY PART ICULAR PURPOSE, NON-INFRINGEMENT, AND ANY WARRANTY ARISING OUT OF THE INFORMATION CONTAINED HEREIN, INCLUDING WITHOUT LIMITATION, ANY PRODUCTS, SPECIFICATIONS, OR OTHER MATERIALS REFERENCED HEREIN. INTEL, AND ITS CONTRIBUTORS DO NOT WARRANT THAT THIS DOCUMENT IS FREE FROM ERRORS, OR THAT ANY PRODUCTS OR OTHER TECHNOLOGY DEVELOPED IN CONFORMANCE WITH THIS DOCUMENT WILL PERFORM IN THE INTENDED MANNER, OR WILL BE FREE FROM INFRINGEMENT OF THIRD PARTY PROPRIETARY RIGHTS, AND INTEL, AND ITS CONTRIBUTORS DISCLA IM ALL LIABILITY THEREFOR.

INTEL, AND ITS CONTRIBUTORS DO NOT WARRANT THAT ANY PRODUCT REFERENCED HEREIN OR ANY PRODUCT OR TECHNOLOGY DEVELOPED IN RELIANCE UPON THIS DOCUMENT, IN WHOLE OR IN PART, WILL BE SUFFICIENT, ACCURATE, RELIABLE, COMPLETE, FREE FROM DEFECTS OR SAFE FOR ITS INTENDED PURPOSE, AND HEREBY DISCLAIM ALL LIABILITIES THEREFOR. ANY PERSON MAKING, USING OR SELLING SUCH PRODUCT OR TECHNOLOGY DOES SO AT HIS OR HER OWN RISK.

Licenses may be required. Intel, its contributors and others may havepatents or pending patent applications, trademarks, copyrights or other intellectual proprietary rights covering subject matter contained or described in this document. No license, express, implied, by estoppel or otherwise, to any intellectual property rights of Intel or any other party is granted herein. It is your responsibility to seek licenses for such intellectual property rights from Intel and others where appropriate.

Limited License Grant. Intel hereby grants you a limited copyright license to copy this document for your use and internal distribution only. You may not distribute this document externally, in whole or in part, to any other person or entity.

LIMITED LIABILITY. IN NO EVENT SHALL INTEL, OR ITS CONTRIBUTORS HAVE ANY LIABILITY TO YOU OR TO ANY OTHER THIRD PARTY, FOR ANY LOST PROFITS, LOST DATA, LOSS OF USE OR COSTS OF PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES, OR FOR ANY DIRECT, INDIRECT, SPECIAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF YOUR USE OF THIS DOCUMENT OR RELIANCE UPON THE INFORMATION CONTAINED HEREIN, UNDER ANY CAUSE OF ACTION OR THEORY OF LIABILITY, AND IRRESPECTIVE OF WHETHER INTEL, OR ANY CONTRIBUTOR HAS ADVANCE NOTICE OF THE POSSIBILITY OF SUCH DAMAGES. THESE LIMITATIONS SHALL APPLY NOTWITHSTANDING THE FAILURE OF THE ESSENTIAL PURPOSE OF ANY LIMITED REMEDY.

Intel, the Intel logo, and Intel Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.

*Other names and brands may be claimed as the property of others. Copyright © 2007, Intel Corporation. All Rights Reserved.

3

How to Build a Cluster - Intel® Server Board S5000PAL

Introduction

This Intel ESAA recipe describes the steps required to build a High Performance Computing (HPC) cluster based upon the Intel S5000PAL server board; from hardware assembly through performance testing and cluster application development. It includes various options for hardware design, interconnects, management, BIOS and OS provisioning, job schedulers, cluster tools and cluster application development packages and runtime environments.

Note: It is recommended that the entire document is read prior to any installation activity

Overview

As mentioned above, this recipe illustrates the beginning to end setup and implementation of a HPC cluster. The basic outline of the recipe is as follows:

1)Cluster hardware setup – racks, power, cabling, switches, etc.

2)Server management – application options for pre boot and post boot system management

3)Node BIOS provisioning – a PXE environment to boot nodes to DOS for updates

4)Node OS provisioning and Cluster Management with Platform Open Cluster Stack (OCS) – An OS provisioning solution for easily deploying, running and managing cluster operating environments

5)Cluster Application Development and Application Execution Environments – Complete packages for running, developing and optimizing cluster applications, and testing cluster performance.

Each of these sections will include either references to locations of existing documentation or detailed instructions on how to setup specific installation requirements.

4

 

 

 

How to Build a Cluster - Intel® Server Board S5000PAL

Hardware Components

 

 

Quantity per

Item

 

Manufacturer

 

Model

node

 

 

 

 

 

 

 

 

 

 

 

1

Intel® Server Board

 

Intel

 

S5000PAL

 

 

 

 

 

 

1

Intel® Server Chassis

 

Intel

 

SR1500

 

 

 

 

 

 

1

Intel® HDD

 

Intel

 

ASR1500PASBP

 

Backplane –

 

 

 

 

 

SR1500 1U

 

 

 

 

 

SATA/SAS passive

 

 

 

 

 

 

 

 

 

 

4GB Per

Memory

 

Any supported

 

Please refer to the Tested Memory List at

Server

 

 

 

 

http://www.intel.com/support/motherboards/server/s5000

Board

 

 

 

 

pal/sb/CS-022919.htm

 

 

 

 

 

 

2 Per Server

Intel® Xeon®

 

Intel

 

Please refer to the Qualified and Supported Processor List

Board

Processors

 

 

 

at Please refer to the Tested Memory List at

 

 

 

 

 

http://www.intel.com/support/motherboards/server/sb/CS-

 

 

 

 

 

022346.htm

 

 

 

 

 

 

2 Per Server

1U passive heatsink

 

Intel

 

AXXUPHS

Board

(light weight with

 

 

 

 

 

heat pipe)

 

 

 

 

 

 

 

 

 

 

1 (minimum)

SATA 3.5” hard

 

Any supported

 

Please refer to the Intel® Tested Hardware and Operating

Per Server

drive

 

 

 

System List at

Board

 

 

 

 

http://www.intel.com/support/motherboards/server/sb/CS-

 

 

 

 

 

022920.htm

 

 

 

 

 

 

1 Per Server

PCI-E InfiniBand*

 

 

 

7104-HCA-LPX2P - Dual port PCIExpress 8x SDR

Board

Host Channel

 

 

 

MemFree

 

Adapter

 

QLogic

 

7104-HCA-LPX2P-DDR - Dual port PCIExpress 8x DDR

 

 

 

 

 

 

 

 

MemFree

 

 

 

 

 

 

 

 

 

 

Please refer to SilverStorm (QLogic) recipes for cluster

 

 

 

 

 

configurations from 8 to 256 nodes for SDR or DDR

 

 

 

 

 

 

1 Optional

InfiniBand* Host

 

 

 

QLE 7140-CK - Single Port 10 GBs InfiniBand to x8 PCI

Per Server

Channel Adapter

 

Qlogic

 

Express Adapter

Board

 

 

 

Please refer to SilverStorm (QLogic) recipes for cluster

 

 

 

 

 

 

 

 

 

 

 

 

 

 

configurations from 8 to 256 nodes for SDR or DDR

 

 

 

 

 

 

 

 

 

5

+ 11 hidden pages