Lenovo LiCO 6.0.0 Installation Manual

LiCO 6.0.0 Installation Guide (for EL8)

Seventh Edition (August 2020)

LIMITED AND RESTRICTED RIGHTS NOTICE: If data or software is delivered pursuant to a General Services Administration (GSA) contract, use, reproduction, or disclosure is subject to restrictions set forth in Contract No. GS-35F-

05925.

Reading instructions

• To ensure that you get correct command lines using the copy/paste function, open this Guide with Adobe Acrobat Reader, a free PDF viewer. You can download it from the official Web site

reader/

• Replace values in angle brackets with the actual values. For example, when you see <*_USERNAME> and <*_PASSWORD>, enter your actual username and password.

• Between the command lines and in the configuration files, ignore all annotations starting with “#”.

https://get.adobe.com/

iii LiCO 6.0.0 Installation Guide (for EL8)

Contents

Reading instructions. . . . . . . . . . . ii

Chapter 1. Overview. . . . . . . . . . . 1

Introduction to LiCO . . . . . . . . . . . . . . 1

Typical cluster deployment . . . . . . . . . . . 1

Operating environment . . . . . . . . . . . . . 2

Supported servers and chassis models . . . . . . 3

Prerequisites . . . . . . . . . . . . . . . . . 4

Chapter 2. Deploy the cluster

environment . . . . . . . . . . . . . . . 5

Install an OS on the management node . . . . . . 5

Deploy the OS on other nodes in the cluster. . . . . 5

Configure environment variables . . . . . . . 5

Create a local repository . . . . . . . . . . 8

Install Lenovo xCAT . . . . . . . . . . . 10

Prepare OS mirrors for other nodes . . . . . 10

Set xCAT node information . . . . . . . . 11

Add host resolution . . . . . . . . . . . 11

Configure DHCP and DNS services . . . . . 12

Install a node OS through the network . . . . 12

Create local repository for other nodes . . . . 13

Enable nginx for other nodes . . . . . . . . 13

Configure the memory for other nodes . . . . 13

Checkpoint A . . . . . . . . . . . . . . 13

Install infrastructure software for nodes . . . . . 14

List of infrastructure software to be installed . . 14 Configure a local repository for the

management node . . . . . . . . . . . . 14

Configure a local repository for login and

compute nodes . . . . . . . . . . . . . 14

Configure LiCO dependencies repositories . . 15

Obtain the LiCO installation package. . . . . 16

Configure the local repository for LiCO . . . . 16

Configure the xCAT local repository . . . . . 16

Install Slurm . . . . . . . . . . . . . . 16

Configure NFS . . . . . . . . . . . . . 17

Configure Chrony . . . . . . . . . . . . 18

GPU driver installation . . . . . . . . . . 18

Configure Slurm . . . . . . . . . . . . . 19

Install Icinga2 . . . . . . . . . . . . . . 20

Install MPI . . . . . . . . . . . . . . . 22

Install Singularity . . . . . . . . . . . . 23

Checkpoint B . . . . . . . . . . . . . . 24

Chapter 3. Install LiCO

dependencies . . . . . . . . . . . . . 27

Cluster check. . . . . . . . . . . . . . . . 27

Check environment variables. . . . . . . . 27

Check the LiCO dependencies repository . . . 27

Check the LiCO repository . . . . . . . . . 27

Check the OS installation . . . . . . . . . 28

Check NFS . . . . . . . . . . . . . . . 28

Check Slurm . . . . . . . . . . . . . . 28

Check MPI and Singularity . . . . . . . . . 29

Check OpenHPC installation . . . . . . . . 29

List of LiCO dependencies to be installed. . . . . 29

Install RabbitMQ . . . . . . . . . . . . . . 29

Install MariaDB . . . . . . . . . . . . . . . 30

Install InfluxDB . . . . . . . . . . . . . . . 30

Install Confluent. . . . . . . . . . . . . . . 31

Configure user authentication . . . . . . . . . 31

Install OpenLDAP-server . . . . . . . . . 31

Install libuser . . . . . . . . . . . . . . 32

Install OpenLDAP-client . . . . . . . . . . 32

Install nss-pam-ldapd . . . . . . . . . . 32

Install authselect-nslcd-config . . . . . . . 33

Chapter 4. Install LiCO . . . . . . . . 35

List of LiCO components to be installed . . . . . 35

Install LiCO on the management node . . . . . . 36

Install LiCO on the login node . . . . . . . . . 36

Install LiCO on the compute nodes . . . . . . . 36

Configure the LiCO internal key. . . . . . . . . 36

Chapter 5. Configure LiCO . . . . . . 37

Configure the service account . . . . . . . . . 37

Configure cluster nodes . . . . . . . . . . . 37

Room information . . . . . . . . . . . . 37

Logic group information. . . . . . . . . . 37

Room row information . . . . . . . . . . 38

Rack information . . . . . . . . . . . . 38

Chassis information . . . . . . . . . . . 38

Node information . . . . . . . . . . . . 39

Configure generic resources . . . . . . . . . . 40

Gres information. . . . . . . . . . . . . 40

List of cluster services . . . . . . . . . . . . 40

Configure LiCO components. . . . . . . . . . 41

lico-vnc-mond . . . . . . . . . . . . . 41

lico-portal . . . . . . . . . . . . . . . 41

Initialize the system . . . . . . . . . . . . . 42

Initialize users . . . . . . . . . . . . . . . 42

Import system images . . . . . . . . . . . . 43

Chapter 6. Start and log in to LiCO . . 45

Start LiCO . . . . . . . . . . . . . . . . . 45

Configure LiCO services . . . . . . . . . . . 45

Chapter 7. Appendix: Important

information . . . . . . . . . . . . . . . 47

Configure VNC . . . . . . . . . . . . . . . 47

Standalone VNC installation . . . . . . . . 47

VNC batch installation . . . . . . . . . . 47

Configure the Confluent Web console . . . . . . 48

For CentOS . . . . . . . . . . . . . . 48

For RHEL . . . . . . . . . . . . . . . 48

LiCO commands . . . . . . . . . . . . . . 48

Change a user’s role . . . . . . . . . . . 48

Resume a user . . . . . . . . . . . . . 49

Delete a user . . . . . . . . . . . . . . 49

Import a user . . . . . . . . . . . . . . 49

Import AI images . . . . . . . . . . . . 49

Generate nodes.csv in confluent . . . . . . 49

Firewall settings. . . . . . . . . . . . . . . 49

Set the firewall on the management node . . . 50

Set the firewall on the login node . . . . . . 51

SSHD settings . . . . . . . . . . . . . . . 51

Improve SSHD security . . . . . . . . . . 51

Slurm issues troubleshooting . . . . . . . . . 52

Node status check . . . . . . . . . . . . 52

Memory allocation error . . . . . . . . . . 52

Status setting error. . . . . . . . . . . . 52

InfiniBand issues troubleshooting . . . . . . . . 52

Installation issues troubleshooting . . . . . . . 53

XCAT issues troubleshooting . . . . . . . . . 53

Running job issue troubleshooting . . . . . . . 53

MPI issues troubleshooting . . . . . . . . . . 54

Edit nodes.csv from xCAT dumping data . . . . . 54

Notices and trademarks . . . . . . . . . . . 55

ii LiCO 6.0.0 Installation Guide (for EL8)

Chapter 1. Overview

Public network

Nodes BMC interface

Nodes eth interface

High speed network interface

TCP networking

Compute node

High speed

network

Parallel file system

Management node

Introduction to LiCO

Lenovo Intelligent Computing Orchestration (LiCO) is an infrastructure management software for highperformance computing (HPC) and artificial intelligence (AI). It provides features like cluster management and monitoring, job scheduling and management, cluster user management, account management, and file system management.

With LiCO, users can centralize resource allocation in one supercomputing cluster and carry out HPC and AI jobs simultaneously. Users can perform operations by logging in to the management system interface with a browser, or by using command lines after logging in to a cluster login node with another Linux shell.

Typical cluster deployment

This Guide is based on the typical cluster deployment that contains management, login, and compute nodes.

Figure 1. Typical cluster deployment

Elements in the cluster are described in the table below.

Table 1. Description of elements in the typical cluster

Element

Management node

Compute node Completes computing tasks.

Parallel file system

Nodes BMC interface

Nodes eth interface

High speed network interface

Description

Core of the HPC/AI cluster, undertaking primary functions such as cluster management, monitoring, scheduling, strategy management, and user & account management.

Connects the cluster to the external network or cluster. Users must use the login node to log in and upload application data, develop compilers, and submit scheduled tasks.

Provides a shared storage function. It is connected to the cluster nodes through a highspeed network. Parallel file system setup is beyond the scope of this Guide. A simple NFS setup is used instead.

Used to access the node’s BMC system.

Used to manage nodes in cluster. It can also be used to transfer computing data.

Optional. Used to support the parallel file system. It can also be used to transfer computing data.

Note: LiCO also supports the cluster deployment that only contains the management and compute nodes. In this case, all LiCO modules installed on the login node need to be installed on the management node.

Operating environment

Cluster server:

Lenovo ThinkSystem servers

Operating system:

CentOS / Red Hat Enterprise Linux (RHEL) 8.1

Client requirements:

• Hardware: CPU of 2.0 GHz or above, memory of 8 GB or above

• Browser: Chrome (V 62.0 or higher) or Firefox (V 56.0 or higher) recommended

• Display resolution: 1280 x 800 or above

LiCO 6.0.0 Installation Guide (for EL8)

Supported servers and chassis models

LiCO can be installed on certain servers, as listed in the table below.

Table 2. Supported servers

Product code

sd530 7X21

sd650 7X58

sr630

sr645

sr650

sr655

sr665

sr670

Machine type

7X01, 7X02

7D2X, 7D2Y

7X05, 7X06

7Y00, 7Z01

7D2V, 7D2W

7Y36, 7Y37, 7Y38

Product name

Lenovo ThinkSystem SD530 (0.5U)

Lenovo ThinkSystem SD650 (2 nodes per 1U tray)

Lenovo ThinkSystem SR630 (1U)

Lenovo ThinkSystem SR645 (1U)

Lenovo ThinkSystem SR650 (2U)

Lenovo ThinkSystem SR655 (2U)

Lenovo ThinkSystem SR665 (2U)

Lenovo ThinkSystem SR670 (2U)

Appearance

sr850

sr850p

sr950

7X18, 7X19

7D2F, 7D2G, 7D2H

7X11, 7X12, 7X13

Lenovo ThinkSystem SR850 (2U)

Lenovo ThinkSystem SR850P (2U)

Lenovo ThinkSystem SR950 (4U)

LiCO can be installed on certain chassis models, as listed in the table below.

Chapter 1. Overview 3

Table 3. Supported chassis models

Product code

d2 7X20

n1200

Machine type

5456, 5468, 5469

Model name

D2 Enclosure (2U)

NeXtScale n1200 (6U)

Appearance

Prerequisites

• Refer to LiCO best recipe to ensure that the cluster hardware uses proper firmware levels, drivers, and settings:

• Refer to the OS part of LeSI 20A_SI best recipe to install the OS security patch:

us/en/solutions/HT510293

• Unless otherwise stated in this Guide, all commands are executed on the management node.

• To enable the firewall, modify the firewall rules according to “Firewall settings” on page 49.

• It is important to regularly patch and update components and the OS to prevent security vulnerabilities.

• Additionally it is recommended that known updates at the time of installation be applied during or immediately after the OS deployment to the managed nodes and prior to the rest of the LiCO setup steps.

https://support.lenovo.com/us/en/solutions/ht507011.

https://support.lenovo.com/

LiCO 6.0.0 Installation Guide (for EL8)

Chapter 2. Deploy the cluster environment

If the cluster environment already exists, you can skip this chapter.

Install an OS on the management node

Install an official version of CentOS 8.1 or RHEL 8.1 on the management node. You can select the minimum installation.

Run the following commands to configure the memory and restart OS:

echo '* soft memlock unlimited' >> /etc/security/limits.conf

echo '* hard memlock unlimited' >> /etc/security/limits.conf

reboot

Deploy the OS on other nodes in the cluster

Configure environment variables

Step 1. Log in to the management node.

Step 2. Run the following commands to configure environment variables for the entire installation process:

su root

cd ~

vi lico_env.local

Step 3. Run the following commands to edit the lico_env.local file:

# Management node hostname

sms_name="head"

# Set the domain name

domain_name="hpc.com"

# Set OpenLDAP domain name

lico_ldap_domain_name="dc=hpc,dc=com"

# set OpenLDAP domain component

lico_ldap_domain_component="hpc"

# IP address of management node in the cluster intranet

sms_ip="192.168.0.1"

# The network adapter name corresponding to the management node IP address

sms_eth_internal="eth0"

# Subnet mask in the cluster intranet. If all nodes in the cluster already have

# OS installed, retain the default configurations.

internal_netmask="255.255.0.0"

# BMC username and password

bmc_username="<BMC_USERNAME>"

bmc_password="<BMC_PASSWORD>"

# original OS repository directory

repo_backup_dir="/install/custom/backup"

# OS mirror pathway for xCAT

iso_path="/isos"

# Local repository directory for OS

os_repo_dir="/install/custom/server"

sdk_repo_dir="/install/custom/sdk"

# Local repository directory for xCAT

xcat_repo_dir="/install/custom/xcat"

# link name of repository directory for Lenovo OpenHPC

link_ohpc_repo_dir="/install/custom/ohpc"

# link name of repository directory for LiCO

link_lico_repo_dir="/install/custom/lico"

# link name of repository directory for LiCO-dep

link_lico_dep_repo_dir="/install/custom/lico-dep"

# Local repository directory for Lenovo OpenHPC, please change it

# according to this version.

ohpc_repo_dir="/install/custom/ohpc-2.0.0"

# LiCO repository directory for LiCO, please change it according to this version.

lico_repo_dir="/install/custom/lico-6.0.0"

# LiCO repository directory for LiCO-dep, please change it according to this version.

lico_dep_repo_dir="/install/custom/lico-dep-6.0.0"

# Total compute nodes

num_computes="2"

# Prefix of compute node hostname. If OS has already been installed on all nodes in the

# cluster, change the configuration according to actual conditions.

compute_prefix="c"

# Compute node hostname list. If OS has already been installed on all nodes

# in the cluster, change the configuration according to actual conditions.

c_name[0]=c1

6 LiCO 6.0.0 Installation Guide (for EL8)

c_name[1]=c2

# Compute node IP list. If OS has already been installed on all nodes in the cluster,

# change the configuration according to actual conditions.

c_ip[0]=192.168.0.6

c_ip[1]=192.168.0.16

# Network interface card MAC address corresponding to the compute node IP. If OS has

# already been installed on all nodes in the cluster, change the configuration according

# to actual conditions.

c_mac[0]=fa:16:3e:73:ec:50

c_mac[1]=fa:16:3e:27:32:c6

# Compute node BMC address list.

c_bmc[0]=192.168.1.6

c_bmc[1]=192.168.1.16

# Total login nodes. If there is no login node in the cluster, the number of logins

# must be "0". And the 'l_name', 'l_ip', 'l_mac', and 'l_bmc' lines need to be removed.

num_logins="1"

# Login node hostname list. If OS has already been installed on all nodes in the cluster,

# change the configuration according to actual conditions.

l_name[0]=l1

# Login node IP list. If OS has already been installed on all nodes in the cluster,

# change the configuration according to actual conditions.

l_ip[0]=192.168.0.15

# Network interface card MAC address corresponding to the login node IP.

# If OS has already been installed on all nodes in the cluster, change the configuration

# according to actual conditions.

l_mac[0]=fa:16:3e:2c:7a:47

# Login node BMC address list.

l_bmc[0]=192.168.1.15

# icinga api listener port

icinga_api_port=5665

Step 4. Save the changes to lico_env.local.

This Guide assumes that the node's BMC username and password are consistent. If they are inconsistent, they need to be modified during the installation.

Step 5. Run the following commands to make the configuration file take effect:

chmod 600 lico_env.local

source lico_env.local

Chapter 2

. Deploy the cluster environment 7

After the cluster environment is set up, configure the IP address of the public network on the login or management node. In this way, you can log in to LiCO Web portal from external network.

Create a local repository

Different steps should be followed depending on the operating system.

For CentOS

Step 1. Run the following command to create a directory for ISO storage:

mkdir -p ${iso_path}

Step 2. Download the CentOS-8.1.1911-x86_64-dvd1.iso and CHECKSUM file from http://vault.centos.org/

8.1.1911/isos/x86_64/

Step 3. Copy the file to ${iso_path}.

Step 4. Run the following commands to get verification code of the iso file, ensure this verification code is

the same as the verification code in CHECKSUM.

cd ${iso_path}

sha256sum CentOS-8.1.1911-x86_64-dvd1.iso

cd ~

Step 5. Run the following commands to mount image:

mkdir -p ${os_repo_dir}

mount -o loop ${iso_path}/CentOS-8.1.1911-x86_64-dvd1.iso ${os_repo_dir}

Step 6. Run the following commands to configure local repository:

cat << eof > ${iso_path}/EL8-OS.repo

[AppStream]

name=appstream

baseurl=file://${os_repo_dir}/AppStream/

enabled=1

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial

[BaseOS]

name=baseos

baseurl=file://${os_repo_dir}/BaseOS/

enabled=1

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial

eof

cp -a ${iso_path}/EL8-OS.repo /etc/yum.repos.d/

Step 7. Run the following commands to close the original repo:

mkdir -p ${repo_backup_dir}

8 LiCO 6.0.0 Installation Guide (for EL8)

mv /etc/yum.repos.d/CentOS* ${repo_backup_dir}

dnf clean all

dnf makecache

Step 8. Run the following commands to enable nginx:

dnf module reset nginx

dnf module enable -y nginx:1.16

For RHEL

Step 1. Run the following command to create a directory for ISO storage:

mkdir -p ${iso_path}

Step 2. Copy the RHEL-8.1.0-20191015.0-x86_64-dvd1.iso and RHEL-8.1.0-20191015.0-x86_64-dvd1.iso.

MD5SUM files to the ${iso_path} directory.

Step 3. Run the following commands to check the validity of the iso file:

cd ${iso_path}

md5sum -c RHEL-8.1.0-20191015.0-x86_64-dvd1.iso.MD5SUM

cd ~

Step 4. Run the following commands to mount image:

mkdir -p ${os_repo_dir}

mount -o loop ${iso_path}/RHEL-8.1.0-20191015.0-x86_64-dvd1.iso ${os_repo_dir}

Step 5. Run the following commands to configure local repository:

cat << eof > ${iso_path}/EL8-OS.repo

[AppStream]

name=appstream

baseurl=file://${os_repo_dir}/AppStream/

enabled=1

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release

[BaseOS]

name=baseos

baseurl=file://${os_repo_dir}/BaseOS/

enabled=1

gpgcheck=1

gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-release

eof

cp -a ${iso_path}/EL8-OS.repo /etc/yum.repos.d/

Step 6. Run the following commands to enable nginx:

dnf module reset nginx

Chapter 2

. Deploy the cluster environment 9

dnf module enable -y nginx:1.16

Install Lenovo xCAT

Step 1. Download the package from https://hpc.lenovo.com/downloads/20a.7/xcat-2.15.1.lenovo4_confluent-

2.5.2-el8.tar.bz2

Step 2. Upload the package to the /root directory on the management node.

Step 3. Run the following commands to create xcat local repository:

dnf install -y bzip2 tar

mkdir -p $xcat_repo_dir

cd /root

tar -xvf xcat-2.15.1.lenovo4_confluent-2.5.2-el8.tar.bz2 -C $xcat_repo_dir

cd $xcat_repo_dir/lenovo-hpc-el8

./mklocalrepo.sh

cd ~

Step 4. Run the following commands to install xcat:

dnf install -y xCAT

source /etc/profile.d/xcat.sh

Prepare OS mirrors for other nodes

For CentOS

Step 1. Run the following command to prepare the OS image for the other nodes:

copycds ${iso_path}/CentOS-8.1.1911-x86_64-dvd1.iso

Step 2. Run the following command to confirm that the OS image has been copied:

lsdef -t osimage

Note: The output should be as follows:

centos8.1-x86_64-install-compute (osimage)

centos8.1-x86_64-install-service (osimage)

centos8.1-x86_64-netboot-compute (osimage)

centos8.1-x86_64-statelite-compute (osimage)

Step 3. Run the following command to disable the Nouveau module:

chdef -t osimage centos8.1-x86_64-install-compute addkcmdline=\

"rdblacklist=nouveau nouveau.modeset=0 R::modprobe.blacklist=nouveau"

Note: The Nouveau module is an accelerated open-source driver for NVIDIA cards. This module should disabled before the installation of the CUDA driver.

For RHEL

Step 1. Run the following command to prepare the OS image for the other nodes:

copycds ${iso_path}/RHEL-8.1.0-20191015.0-x86_64-dvd1.iso -n rhels8.1

10 LiCO 6.0.0 Installation Guide (for EL8)

Step 2. Run the following commands to confirm that the OS image has been copied:

lsdef -t osimage

Note: The output should be as follows:

rhels8.1-x86_64-install-compute (osimage)

rhels8.1-x86_64-install-service (osimage)

rhels8.1-x86_64-netboot-compute (osimage)

rhels8.1-x86_64-statelite-compute (osimage)

Step 3. Run the following command to disable the Nouveau module:

chdef -t osimage rhels8.1-x86_64-install-compute addkcmdline=\

"rdblacklist=nouveau nouveau.modeset=0 R::modprobe.blacklist=nouveau"

Note: The Nouveau module is an accelerated open-source driver for NVIDIA cards. This module should be disabled before installation of the CUDA driver.

Set xCAT node information

Note: If the ThinkSystem SR635/SR655 server is used in other nodes, change “serialport=0” to “serialport=

1” before running the following commands.

Step 1. Run the following commands to import the compute node configuration in the lico_env.local file to

xCAT:

for ((i=0; i<$num_computes; i++)); do

mkdef -t node ${c_name[$i]} groups=compute,all arch=x86_64 netboot=xnba mgt=ipmi \

bmcusername=${bmc_username} bmcpassword=${bmc_password} ip=${c_ip[$i]} \

mac=${c_mac[$i]} bmc=${c_bmc[$i]} serialport=0 serialspeed=115200;

done

Step 2. Run the following commands to import the login node configuration to xCAT:

for ((i=0; i<$num_logins; i++)); do

mkdef -t node ${l_name[$i]} groups=login,all arch=x86_64 netboot=xnba mgt=ipmi \

bmcusername=${bmc_username} bmcpassword=${bmc_password} ip=${l_ip[$i]} \

mac=${l_mac[$i]} bmc=${l_bmc[$i]} serialport=0 serialspeed=115200;

done

Step 3. (Optional) If the BMC username and password of the node are inconsistent, run the following

command to make them consistent:

tabedit ipmi

Step 4. Run the following command to configure the root account password for the node:

chtab key=system passwd.username=root passwd.password=<ROOT_PASSWORD>

Add host resolution

Note: If the cluster already has the OS installed and can resolve the IP address through the hostname, skip

this section.

Chapter 2. Deploy the cluster environment 11

Run the following commands to add host resolution:

chdef -t site domain=${domain_name}

chdef -t site master=${sms_ip}

chdef -t site nameservers=${sms_ip}

sed -i "/^\s*${sms_ip}\s*.*$/d" /etc/hosts

sed -i "/\s*${sms_name}\s*/d" /etc/hosts

echo "${sms_ip} ${sms_name} ${sms_name}.${domain_name} " >> /etc/hosts

makehosts

Configure DHCP and DNS services

Note: If all nodes in the cluster have the OS installed, skip this step.

Run the following commands to configure DHCP and DNS services:

makenetworks

makedhcp -n

makedhcp -a

makedns -n

echo "search ${domain_name}" > /etc/resolv.conf

echo "nameserver ${sms_ip}" >> /etc/resolv.conf

Note: To ensure that the management node is pointing at the same DNS as other nodes, refer to the following two Web sites:

https://sourceforge.net/p/xcat/wiki/XCAT_iDataPlex_Cluster_Quick_Start/#install-xcat-on-the-management-node

https://sourceforge.net/p/xcat/wiki/Cluster_Name_Resolution/

Install a node OS through the network

Note: If all nodes in the cluster have the OS installed, skip this section.

For CentOS, run the following commands to set and install the necessary OS mirror:

nodeset all osimage=centos8.1-x86_64-install-compute

rsetboot all net -u

rpower all reset

For RHEL, run the following commands to set and install the necessary OS mirror:

nodeset all osimage=rhels8.1-x86_64-install-compute

rsetboot all net -u

rpower all reset

Note: It takes several minutes to complete the OS installation. You can use the following command to check the progress:

nodestat all

12 LiCO 6.0.0 Installation Guide (for EL8)

Create local repository for other nodes

cp /etc/yum.repos.d/EL8-OS.repo /var/tmp

sed -i '/^baseurl=/d' /var/tmp/EL8-OS.repo

sed -i "/name=appstream/a\baseurl=http://${sms_name}${os_repo_dir}/AppStream/" \

/var/tmp/EL8-OS.repo

sed -i "/name=baseos/a\baseurl=http://${sms_name}${os_repo_dir}/BaseOS/" \

/var/tmp/EL8-OS.repo

xdcp all /var/tmp/EL8-OS.repo /etc/yum.repos.d/

Attention: If the OS of other nodes are CentOS, run the following commands to close the repo:

psh all "mkdir -p ${repo_backup_dir}"

psh all "mv /etc/yum.repos.d/CentOS* ${repo_backup_dir}"

psh all "dnf clean all"

psh all "dnf makecache"

Enable nginx for other nodes

Run the following commands to enable nginx for other nodes:

psh all dnf module reset nginx

psh all dnf module enable -y nginx:1.16

Configure the memory for other nodes

Run the following commands:

xdcp all /etc/security/limits.conf /etc/security/limits.conf

psh all reboot

Checkpoint A

Run the following commands to check and ensure that the installation is complete:

psh all uptime

Note: The output should be as follows:

c1: 05:03am up 0:02, 0 users, load average: 0.20, 0.13, 0.05

c2: 05:03am up 0:02, 0 users, load average: 0.20, 0.14, 0.06

l1: 05:03am up 0:02, 0 users, load average: 0.17, 0.13, 0.05

……

Note: If you cannot run these commands,check if the xCAT is successfully installed on the management node, and passwordless SSH is set between the management node and other nodes. You can copy the id_ rsa file and the id_rsa.pub file from the management node to other nodes, and run these commands again.

Chapter 2. Deploy the cluster environment 13

+ 43 hidden pages