Hewlett Packard Enterprise M-Series User Manual

M-Series ONIE Switch User Manual

Rev 1.6 Mellanox ONIE Ver. 5.2.0004

Part number: P12821-001

Published: December 12, 2018

Edition: 1

Notices

The information contained herein is subject to change without notice. The only warranties for Hewlett Packard En te rpri se pro du cts and ser vices are set for t h in the expres s warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. Hewlett Packard Enterprise shall not be liable for technical or editorial errors or omissions contained herein. Links to third-party websites take you outside the Hewlett Packard En ter prise w ebsi te. Hewlett Pa cka rd Enterp rise has no control over and is not responsible for information outside the Hewlett Packard Enterprise website. Confidential computer software. Valid license from Hewlett Packard Enterprise required for possession, use or copying. Consistent with FAR 12.211 and 12.212, Commercial Compute r Sof tware, Comp ute r So ft ware Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor's standard commercial license.

Mellanox®, Mellanox logo, ConnectX®, MLNX-OS®, SwitchX®, Virtual Protocol Interconnect®, are registered tradema rks of Mell ano x Te ch nol ogi es, Ltd.

Al l othe r t rademarks are p rope rty of their resp ective owners .

For the most updated list of Mellanox trademarks, visit http://www.mellanox.com/page/trademarks

Document Revision History . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Chapter 1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . .

1.1 Accessing the Mellanox System for the First Time . . . . . . . . . . . . . . . . . . . 7

1.2 Log Facilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

1.3 Booting Into ONIE System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

. . . . . . . . . . . . . . . . . . . . . 5

. . . . . . . . . . . . . . . . . . 7

Chapter 2 How-Tos . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

2.1 Install Network OS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

2.1.1 From DHCP Server. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

2.1.2 From TFTP Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

2.1.3 From IPv6 Neighbors. . . . . . . . .

2.1.4 From Local USB Drive . . . . . . . . . . . . . . . . . . . . . . . . . . .

2.1.5 Via SCP Local File . . . . . . . . . . . .

2.2 Boot Modes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

2.2.1 Rescue Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

2.2.2 Mellanox ONIE Update . . . . . . .

2.2.3 Uninstall . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

2.2.4 Embed . . . . . . . . . . . . . . . . . . . .

2.2.5 Reinstall . . . . . . . . . . . . . . . . . . .

2.3 Update BIOS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

. . . . . . . . . . . . . . . 11

. . . . . . . . . . . . . . . 13

. . . . . . . . . . . . . . . 16

Chapter 3 CLI Reference . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

3.1 ONIE Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

Support and Other Resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25

Customer Self Repair . . . . . . . . . . . . . . . . . . . . . . . .

Remote Support . . . . . . . . . . . . . . . . . . . . . . . . . . . .

Websites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . . 26

. . . . . . . . . . . . . . . . . . . . 26

. . . . . . . . . . . . . . . . . . . . 28

Document Revision History

Table 1 - Document Revision History

Revision Date Description

Rev 1.6 December 07, 2018

Rev 1.5 January 25, 2018

Rev 1.4 May 31, 2016

Added Section 2.3, “Update BIOS,” on page 18 Enhanced user manual with printouts of ONIE Grub Menu Updated Section 2.2, “Boot Modes,” on page 14

Added:

• “onie-sysinfo -v” on page 24

Updated:

• “onie-sysinfo” on page 24

Updated:

• UM to reflect new software printouts

• Chapter 3, “CLI Reference” on page 19 with commands “onie-nos-install”, “onie-stop”, “onie-start”, and “onie-sysinfo”

Rev 1.3 January 15, 2015

Removed PPC content Updated:

• Section “Related Documentation” on page 5

• Section 2.1.2, “From TFTP Server,” on page 11

• Section 2.1.4, “From Local USB Drive,” on page 13

• Section 2.2.5, “Reinstall,” on page 18

• Section 2.2.3, “Uninstall,” on page 16

• Chapter 3, “CLI Reference” on page 19

Rev 1.2 August 31, 2014

Updated Section 2.1.4, “From Local USB Drive,” on page 13

Rev 1.1 July 2014 Removed sections 1.2, 1.3, 1.4 and 2.3.

Added Section 2.2.4, “Embed,” on page 17 Updated:

Table 2, “Reference Documents,” on page 5

•

• Chapter 3, “CLI Reference” on page 19

Rev 1.0 September 2013 First release

Preface

Intended Audience

This document and the system is a bundle intended for system engineers and system developers interested in assembling their own OS on top of Mellanox switch systems. The system provides an easy way to install a user-defined OS over a Mellanox switch system.

This document contains instructions supplementary to the official O enced in the

“Related Documentation” section.

NIE documentation refer-

Documentation Conventions

Typographical Conventions

Table 3 - Typographical Conventions

Description Convention Example

File names file.extension

Directory names directory

Commands and their parameters command param1 mts3610-1 > show hosts

Required item < >

Optional item [ ]

Mutually exclusive parameters { p1, p2, p3 } or {p1 | p2 |

}

Opt

ional mutually exclusive

parameters

[ p1 | p2 | p3 ]

Table 3 - Typographical Conventions

Description Convention Example

Comments to explain command examples

Variables for which users supply specific values

Emphasized words Italic font These are emphasized words

Note

Warni ng

// // This is a comment

Italic font enable

<text> This is a note.

<text> Make sure to connect to the

RS-232 RJ-45 port of the switch and no port.

Common Abbreviations and Acronyms

Table 4 - Abbreviations and Acronyms

Abbreviations Description

ONIE Open Network Install Environment

NOS Network OS

t to the MGT

1 Introduction

Console

ONIE (Open Network Install Environment) is an open source initiative which enables automatic installation of user-defined OS whose function is to setup a network OS that provides the following services:

• Re/installing an OS

• Booting in "rescue" mode

• Formatting the system

For more information please refer to the following website:

https://github.com/opencomputeproject/onie.

1.1 Accessing the Mellanox System for the First Time

The system provided has DHCP enabled by default, therefore, login may be performed through the management ports (using "root" username and no password) and/or the serial console as explained in the following steps:

Introduction

Step 1. Connect the host PC to the CONSOLE (RJ-45) port of the switch system using the supplied

cable. The CONSOLE ports are shown below as examples.

Figure 1: Console Port

Make sure to connect to the CONSOLE port of the switch and not to the MGT port.

Introduction

Step 2.

Configure a serial terminal program (for example, HyperTerminal, minicom, or Tera Term) on your host PC with the settings described in the table below.

Table 5 - Serial Terminal Program Configuration for 2016.11-5.2.0004-115200

Baud rate 115200

Data bits 8

Stop bits 1

Parity None

Flow Control None

Step 3. Activate the console by pressing Enter.

Please press Enter to activate this console. Info: eth0: Checking link... up. ** Installer Mode Enabled **

Step 4. (Optional) The system is configured to fetch an image using auto-discovery which is

enabled by default. To disable auto discovery, run:

ONIE:/ # onie-stop Stopping: discover... done.

1.2 Log Facilities

Parameter Setting

Mellanox ONIE uses the following log facilities:

• dmesg

• /var/log/messages

• /var/log/onie.log (Mellanox ONIE OS only)

• /var/log/syslog

The following is an example of

Nov 25 12:47:42 sys-hostname local0.info onie: Starting: klogd... Nov 25 12:47:42 sys-hostname local0.info onie: done. Nov 25 12:47:42 sys-hostname local0.info onie: Starting: dropbear ssh daemon... Nov 25 12:47:43 sys-hostname local0.info onie: done. Nov 25 12:47:43 sys-hostname local0.info onie: Starting: telnetd...

cat /var/log/onie.log:

Nov 25 12:47:43 sys-hostname local0.info onie: done. Nov 25 12:47:43 sys-hostname local0.info onie: Starting: discover... Nov 25 12:47:43 sys-hostname local0.info onie: done. Nov 25 12:47:43 sys-hostname local0.info onie: Info: eth0: Checking link... Nov 25 12:47:43 sys-hostname local0.info onie: up. Nov 25 12:47:43 sys-hostname local0.info onie: Info: Trying DHCPv4 on interface: eth0 Nov 25 12:47:43 sys-hostname local0.info onie: ONIE: Using DHCPv4 addr: eth0: 10.7.144.133 / 255.255.248.0 Nov 25 12:47:43 sys-hostname local0.info discover: ONIE: Starting ONIE Service Discovery Nov 25 12:47:51 sys-hostname local0.info discover: [truncated] onie_neighs =

.144.1,10.7.150.251,10.7.150.252,[fe80::7efe:90ff:fe65:dca0-eth0],[fe80::e61d:2dff:fe5a:d72a-

0.250,10.7

10.7.15 eth0],[fe80::fe15:b4ff:fe97:224c-eth0],[fe80::2e0:86ff:fe29:5f74-eth0],[fe80::7efe:90ff: Nov 25 12:47:51 sys-hostname local0.info discover: [truncated] 61d:2dff:fef7:d984-eth0],[fe80::f652:14ff:fed5:b3c4-

fe80::268a

eth0],[ eth0],[fe80::f652:14ff:fefb:9294-eth0],[fe80::7efe:90ff:fec5:72 Nov 25 12:47:51 sys-hostname local0.info discover: [truncated] :2a8e-eth0],[fe80::202:c9ff:fe5e:da96eth0],[ eth0],[fe80::ee0d:9aff:fe9f:cade-eth0],[fe80::7210:6fff:feba:930c-eth0],[fe Nov 25 12:47:51 sys-hostname local0.info discover: ,[fe80::ee0d:9aff:feab:39bc-eth0],[fe80::da9d:67ff:fe65:e5e1eth0],[ eth0],[fe80::202:c9ff:fe63:e88e-eth0],[fe80::7efe:90ff:fe57:3e34Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_router = 10.7.144.1 Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_subnet = 255.255.248.0 Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_domain = mtl.labs.mlnx Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_interface = eth0 Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_dns = 10.7.77.192 10.7.77.135 10.198.0.169 10.211.0.124 Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_siaddr = 10.7.1.114 Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_serverid = 10.7.77.135 Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_boot_reason = install Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_broadcast = 10.7.151.255 Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_boot_file = pxelinux.0 Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_ip = 10.7.144.133 Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_nmi_watchdog = 0 Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_lease = 36000 Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_ntpsrv = 10.7.77.134 10.7.77.135 Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_mask = 21 Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_hostname = sys-hostname Nov 25 12:47:51 sys-hostname local0.info discover: onie_disco_opt53 = 05 Nov 25 12:48:00 sys-hostname local0.info onie-exec: Info: Attempting http://10.7.1.114/onie-installer-x86_64-mlnx_msn2100-r0 ... Nov 25 12:48:00 sys-hostname local0.info onie-exec: Info: Attempting http://10.7.1.114/onie-installer-x86_64-mlnx_msn2100-r0.bin ... Nov 25 12:48:00 sys-hostname local0.info onie-exec: Info: Attempting http://10.7.1.114/onie-installer-x86_64-mlnx_msn2100 ... Nov 25 12:48:00 sys-hostname local0.info onie-exec: Info: Attempting http://10.7.1.114/onie-installer-x86_64-mlnx_msn2100.bin ... Nov 25 12:48:00 sys-hostname local0.info onie-exec: Info: Attempting http://10.7.1.114/onie-installer-mlnx_msn2100 ... Nov 25 12:48:00 sys-hostname local0.info onie-exec: Info: Attempting http://10.7.1.114/onie-installer-mlnx_msn2100.bin ... Nov 25 12:48:00 sys-hostname local0.info onie-exec: Info: Attempting http://10.7.1.114/onie-installer-x86_64-mlnx ... Nov 25 12:48:00 sys-hostname local0.info onie-exec: Info: Attempting http://10.7.1.114/onie-installer-x86_64-mlnx.bin ... Nov 25 12:48:00 sys-hostname local0.info onie-exec: Info: Attempting http://10.7.1.114/onie-installer-x86_64 ... Nov 25 12:48:00 sys-hostname local0.info onie-exec: Info: Attempting http://10.7.1.114/onie-installer-x86_64.bin ... Nov 25 12:48:00 sys-hostname local0.info onie-exec: Info: Attempting http://10.7.1.114/onie-installer ... Nov 25 12:48:00 sys-hostname local0.info onie-exec: Info: Attempting http://10.7.1.114/onie-installer.bin ...

:7ff:fe47:b480-eth0],[fe80::7210:6fff:febb:9966-eth0],[fe80::202:c9ff:fe63:242e-

fe80::7210

:6fff:febb:99ea-eth0],[fe80::7210:6fff:febb:995e-eth0],[fe80::e61d:2dff:fe6a:cb70-

fe80::7210

:6fff:feba:9364-eth0],[fe80::e61d:2dff:feff:3830-eth0],[fe80::202:c9ff:fe62:1fd8-

Introduction

+ 19 hidden pages

Hewlett Packard Enterprise M-Series User Manual

Specifications and Main Features

Frequently Asked Questions

User Manual

Table of Contents

Document Revision History

Preface

Intended Audience

Related Documentation

Documentation Conventions

Common Abbreviations and Acronyms

1 Introduction

1.1 Accessing the Mellanox System for the First Time

1.2 Log Facilities