Oracle Exalogic Elastic Cloud Owner's Manual

Oracle® Exalogic Elastic Cloud

Machine Owner's Guide

Release 12.2.1.0.0

E18478-21

April 2017

This document describes how to manage and configure an
Exalogic machine.

Release 12.2.1.0.0 is for Oracle Exalogic Elastic Cloud X6-2,
X5-2, X4-2, X3-2, and X2-2.

Oracle Exalogic Elastic Cloud Machine Owner's Guide, Release 12.2.1.0.0

E18478-21

Copyright © 2017, Oracle and/or its affiliates. All rights reserved.

Primary Author: Salvador Esparza, Ashish Thomas

This software and related documentation are provided under a license agreement containing restrictions on
use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your
license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license,
transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse
engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is
prohibited.

The information contained herein is subject to change without notice and is not warranted to be error-free. If
you find any errors, please report them to us in writing.

If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on
behalf of the U.S. Government, then the following notice is applicable:

U.S. GOVERNMENT END USERS: Oracle programs, including any operating system, integrated software,
any programs installed on the hardware, and/or documentation, delivered to U.S. Government end users are
"commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency­specific supplemental regulations. As such, use, duplication, disclosure, modification, and adaptation of the
programs, including any operating system, integrated software, any programs installed on the hardware,
and/or documentation, shall be subject to license terms and license restrictions applicable to the programs.
No other rights are granted to the U.S. Government.

This software or hardware is developed for general use in a variety of information management applications.
It is not developed or intended for use in any inherently dangerous applications, including applications that
may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you
shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its
safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this
software or hardware in dangerous applications.

Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of
their respective owners.

Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are
used under license and are trademarks or registered trademarks of SPARC International, Inc. AMD, Opteron,
the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro
Devices. UNIX is a registered trademark of The Open Group.

This software or hardware and documentation may provide access to or information about content, products,
and services from third parties. Oracle Corporation and its affiliates are not responsible for and expressly
disclaim all warranties of any kind with respect to third-party content, products, and services unless
otherwise set forth in an applicable agreement between you and Oracle. Oracle Corporation and its affiliates
will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party
content, products, or services, except as set forth in an applicable agreement between you and Oracle.

Contents

Preface............................................................................................................................................................. xvii

Audience .................................................................................................................................................... xvii

Revision History ....................................................................................................................................... xvii

Documentation Accessibility .................................................................................................................... xx

Related Documents..................................................................................................................................... xx

Conventions................................................................................................................................................. xx

1 Learn About the Exalogic Machine

1.1 About Oracle Exalogic ..................................................................................................................... 1-1

1.1.1 Features of Exalogic .............................................................................................................. 1-1

1.2 Hardware Components of Exalogic............................................................................................... 1-2

1.2.1 PDUs in Exalogic ................................................................................................................... 1-3

1.2.2 Spares Kit for Exalogic.......................................................................................................... 1-3

1.2.3 Pre-cabling for Exalogic X4-2 and newer Machines......................................................... 1-3

1.3 Exalogic Machine Rack Layout....................................................................................................... 1-3

1.4 Operational Procedures for Exalogic Machines ........................................................................... 1-4

1.4.1 Non-emergency Power Procedure...................................................................................... 1-5

1.4.2 Emergency Power-off Considerations................................................................................ 1-6

1.4.3 Cautions and Warnings........................................................................................................ 1-6

2 Site Requirements

2.1 Environmental Requirements ......................................................................................................... 2-1

2.2 Space Requirements ......................................................................................................................... 2-1

2.2.1 Receiving and Unpacking Requirements .......................................................................... 2-2

2.2.2 Maintenance Access Requirements .................................................................................... 2-2

2.3 Flooring Requirements..................................................................................................................... 2-3

2.4 Electrical Power Requirements....................................................................................................... 2-3

2.4.1 Facility Power Requirements............................................................................................... 2-5

2.4.2 Circuit Breaker Requirements ............................................................................................. 2-5

2.4.3 Grounding Guidelines.......................................................................................................... 2-5

2.5 Temperature and Humidity Requirements .................................................................................. 2-6

2.6 Ventilation and Cooling Requirements ......................................................................................... 2-7

iii

3 Install Planning and Procedure

3.1 Installation Overview....................................................................................................................... 3-1

3.2 Prepare to Install an Exalogic Machine ......................................................................................... 3-2

3.2.1 Before You Begin ................................................................................................................... 3-2

3.2.2 Exalogic Installation Safety Guidelines.............................................................................. 3-2

3.2.3 Unpack the Exalogic Machine Rack.................................................................................... 3-3

3.2.4 Tools for Installation ............................................................................................................. 3-4

3.2.5 Prepare the Installation Site ................................................................................................. 3-5

3.2.6 Place the Exalogic Machine in Its Allocated Space........................................................... 3-5

3.3 Power on the System the First Time ............................................................................................ 3-12

3.3.1 Inspect the Machine After It Is in Place............................................................................ 3-12

3.3.2 Connect the Power Cords................................................................................................... 3-13

3.3.3 Power On the Exalogic Machine ....................................................................................... 3-14

3.4 Connect a Laptop to the Exalogic Machine................................................................................. 3-18

3.5 What Next? ...................................................................................................................................... 3-20

4 Default IP Addresses and Ports

4.1 Exalogic Machine Full Rack ............................................................................................................ 4-1

4.2 Exalogic Machine Half Rack ........................................................................................................... 4-4

4.3 Exalogic Machine Quarter Rack ..................................................................................................... 4-6

4.4 Exalogic Machine Eighth Rack........................................................................................................ 4-9

4.5 Default Port Assignments.............................................................................................................. 4-12

5 Add the Exalogic Machine to Your Network

5.1 Default State of the Exalogic Machine Network Configuration ................................................ 5-1

5.2 Verify the Factory Configuration ................................................................................................... 5-1

5.3 Prerequisites for Connecting Exalogic Machine to External Ethernet Network ..................... 5-5

5.4 Initial Network Configuration of Exalogic Machine ................................................................... 5-5

5.4.1 Configuring the Cisco Ethernet Switch.............................................................................. 5-5

6 Understand Network Requirements and Configuration

6.1 Overview of Network Requirements............................................................................................. 6-1

6.2 Naming Conventions ....................................................................................................................... 6-5

6.3 Important Notes for Oracle Solaris Users ..................................................................................... 6-5

6.4 Network Connection and IP Address Requirements.................................................................. 6-5

6.4.1 Network Connection Requirements ................................................................................... 6-6

6.4.2 IP Address Requirements..................................................................................................... 6-7

6.5 Default InfiniBand Bonded IP Addresses ................................................................................... 6-10

6.6 Introduction to Oracle Exalogic Network Configuration......................................................... 6-10

6.6.1 InfiniBand Fabric ................................................................................................................. 6-11

6.6.2 InfiniBand Switches ............................................................................................................ 6-11

6.6.3 Default Bonded Interfaces.................................................................................................. 6-11

iv

6.6.4 IPMP Overview for Oracle Solaris Users......................................................................... 6-12

6.6.5 Connectivity Between Exalogic Compute Nodes........................................................... 6-13

6.6.6 Connectivity Between Exalogic Machine and External LAN Through Sun Network

QDR InfiniBand Gateway Switch........................................................................................... 6-13

6.6.7 Additional InfiniBand Network Requirements and Specifications ............................. 6-15

6.7 Prepare to Reconfigure the Networking of Exalogic Machine................................................. 6-16

6.8 Subnet Manager Requirements for Connecting Exalogic to Exadata ..................................... 6-16

6.9 Network Configuration Worksheets............................................................................................ 6-16

6.9.1 General Network Configuration Worksheet (Required)............................................... 6-17

6.9.2 Management Network Configuration Worksheet (Required)...................................... 6-17

6.9.3 Client Access Network Configuration Worksheet (Required) ..................................... 6-18

6.9.4 Private InfiniBand Network Configuration Worksheet (Required) ............................ 6-19

7 Set Up ILOM on the Compute Nodes

7.1 ILOM Overview................................................................................................................................ 7-1

7.1.1 ILOM Interfaces..................................................................................................................... 7-2

7.2 Important Notes Before You Begin ................................................................................................ 7-2

7.3 Management Network Diagram for Exalogic Machine .............................................................. 7-2

7.4 ILOM IP Addresses for Exalogic Machine Components ............................................................ 7-3

7.5 Connect to ILOM via the Network................................................................................................. 7-3

7.5.1 Connect to the CLI................................................................................................................. 7-4

7.5.2 Connect to the Web GUI....................................................................................................... 7-4

7.5.3 Launch a Remote KVM Session .......................................................................................... 7-4

7.6 Connect to ILOM via a Serial Connection..................................................................................... 7-5

7.6.1 Connect to the ILOM of a Compute Node......................................................................... 7-5

7.6.2 Connect to the ILOM of a Sun Network QDR InfiniBand Gateway Switch................. 7-6

7.7 Reconfigure the Network Access ................................................................................................... 7-6

7.7.1 Reconfigure the Network Access Using a Serial Connection ......................................... 7-7

7.7.2 Reconfigure the Network Access Using the Ethernet Connection ................................ 7-7

7.7.3 Use the Ipmitool Commands when SP Network Information is Lost........................... 7-7

7.7.4 Configure ILOM IP Addresses Manually.......................................................................... 7-8

7.8 What Next? ........................................................................................................................................ 7-9

8 Configure the Storage Appliance

8.1 Prerequisites ...................................................................................................................................... 8-1

8.2 Getting Started .................................................................................................................................. 8-1

8.3 Storage Appliance Overview .......................................................................................................... 8-3

8.3.1 Introduction to Projects ....................................................................................................... 8-3

8.3.2 Introduction to Shares .......................................................................................................... 8-3

8.4 Configuration Overview.................................................................................................................. 8-3

8.4.1 Initial Configuration ............................................................................................................. 8-3

8.4.2 Connect Storage Heads to the Management Network and Accessing the Web

Interface........................................................................................................................................ 8-4

v

8.4.3 Cluster Network Configuration .......................................................................................... 8-6

8.4.4 Network Configuration Options......................................................................................... 8-7

8.4.5 Default Storage Configuration .......................................................................................... 8-13

8.4.6 Custom Configuration........................................................................................................ 8-14

8.5 Create Custom Projects.................................................................................................................. 8-15

8.6 Create Custom Shares .................................................................................................................... 8-17

8.7 Use the Phone Home Service to Manage the Storage Appliance ............................................ 8-20

8.7.1 Register Your Storage Appliance ...................................................................................... 8-21

9 Configure NFS Version 4 on Exalogic

9.1 Overview............................................................................................................................................ 9-1

9.1.1 NFSv3...................................................................................................................................... 9-1

9.1.2 NFSv4...................................................................................................................................... 9-1

9.1.3 Naming Service...................................................................................................................... 9-1

9.2 Verify the NIS Setting on Exalogic................................................................................................. 9-2

9.3 Configure the Storage Appliance ................................................................................................... 9-2

9.3.1 Configure the NFS Service ................................................................................................... 9-3

9.3.2 Configure the NIS Service.................................................................................................... 9-4

9.4 Configure an Exalogic Linux Compute Node to Use NFSv4..................................................... 9-4

9.5 Create NFSv4 Mount Points on Oracle Linux .............................................................................. 9-6

10 Configure Ethernet Over InfiniBand

10.1 Introduction to Virtual NICs (VNICs)....................................................................................... 10-1

10.1.1 VNIC Resource Limit........................................................................................................ 10-1

10.2 Set Up Ethernet Over InfiniBand (EoIB) on Oracle Linux...................................................... 10-2

10.3 Set Up Ethernet Over InfiniBand (EoIB) on Oracle Solaris..................................................... 10-7

10.3.1 Set Up Ethernet Over InfiniBand on Oracle Solaris 11.1 ............................................. 10-7

10.3.2 Set Up Ethernet Over InfiniBand on Oracle Solaris 11.2 ........................................... 10-12

11 Set Up Virtual LANs

11.1 Introduction to VLAN.................................................................................................................. 11-1

11.2 Example Scenario.......................................................................................................................... 11-1

11.3 Tag the Ethernet Connectors With a VLAN Identifier............................................................ 11-2

11.4 Oracle Linux: Creating VNICs and Associating Them with VLANs.................................... 11-3

11.5 Oracle Solaris: Creating VNICs and Associating Them with VLANs .................................. 11-4

12 Use the InfiniBand Gateway Switches

12.1 Using Sun Network QDR InfiniBand Gateway Switches....................................................... 12-1

12.1.1 Physical Specifications...................................................................................................... 12-1

12.1.2 Access the Command-Line Interface (CLI) of a Gateway Switch .............................. 12-2

12.1.3 Verify the Status of a Gateway Switch ........................................................................... 12-2

12.1.4 Start the Subnet Manager Manually............................................................................... 12-4

12.1.5 Check Link Status.............................................................................................................. 12-4

vi

12.1.6 Verify the InfiniBand Fabric ............................................................................................ 12-5

12.1.7 Monitor a Gateway Switch Using Web Interface ......................................................... 12-7

12.2 What Next? .................................................................................................................................... 12-8

13 Manage the InfiniBand Network Using Subnet Manager

13.1 Understand Administrative Commands................................................................................... 13-1

13.1.1 Hardware Command Overview ..................................................................................... 13-1

13.1.2 InfiniBand Command Overview..................................................................................... 13-1

13.2 Manage InfiniBand Network Using Subnet Manager............................................................. 13-2

13.2.1 Overview of Subnet Manager.......................................................................................... 13-2

13.2.2 Subnet Manager Operation in Different Rack Configurations................................... 13-2

13.2.3 Monitor the Subnet Manager........................................................................................... 13-4

13.2.4 Control the Subnet Manager............................................................................................ 13-4

13.3 Work with the Default Rack-Level InfiniBand Partition ........................................................ 13-5

13.3.1 Partition in Exalogic Machine.......................................................................................... 13-6

13.3.2 Verify the Default Partition.............................................................................................. 13-6

14 Use the Sun Datacenter InfiniBand Switch 36 in Multirack Configurations

14.1 Physical Specifications ................................................................................................................. 14-1

14.2 Access the CLI of a Sun Datacenter InfiniBand Switch 36...................................................... 14-2

14.3 Verify the Switch Status............................................................................................................... 14-2

14.4 Start the Subnet Manager in Multirack Configuration Scenarios.......................................... 14-4

14.5 Check Link Status ......................................................................................................................... 14-5

14.6 Verify the InfiniBand Fabric in a Multirack Configuration.................................................... 14-5

14.6.1 Discover the InfiniBand Network Topology in a Multirack Configuration............. 14-6

14.6.2 Perform Diagnostics on the InfiniBand Fabric in a Multirack Configuration.......... 14-6

14.6.3 Check for Errors in the InfiniBand Fabric in a Multirack Configuration.................. 14-7

14.7 Monitor the Spine Switch Using Web Interface ....................................................................... 14-8

14.8 What Next? .................................................................................................................................... 14-8

15 Monitor and Control the InfiniBand Fabric

15.1 Monitor the InfiniBand Fabric .................................................................................................... 15-1

15.1.1 Identify All Switches in the Fabric.................................................................................. 15-1

15.1.2 Identify All HCAs in the Fabric ...................................................................................... 15-2

15.1.3 Display the InfiniBand Fabric Topology........................................................................ 15-2

15.1.4 Display a Route Through the Fabric............................................................................... 15-3

15.1.5 Display the Link Status of a Node .................................................................................. 15-4

15.1.6 Display Counters for a Node........................................................................................... 15-4

15.1.7 Display Data Counters for a Node.................................................................................. 15-5

15.1.8 Display Low-Level Detailed Information for a Node.................................................. 15-5

15.1.9 Display Low-Level Detailed Information for a Port .................................................... 15-6

15.1.10 Map LIDs to GUIDs ........................................................................................................ 15-7

15.1.11 Perform Comprehensive Diagnostics for the Entire Fabric ...................................... 15-8

vii

15.1.12 Perform Comprehensive Diagnostics for a Route ...................................................... 15-8

15.1.13 Determine Changes to the InfiniBand Topology........................................................ 15-8

15.1.14 Determine Which Links Are Experiencing Significant Errors................................ 15-10

15.1.15 Check All Ports .............................................................................................................. 15-10

15.2 Control the InfiniBand Fabric ................................................................................................... 15-11

15.2.1 Clear Error Counters....................................................................................................... 15-11

15.2.2 Clear Data Counters........................................................................................................ 15-11

15.2.3 Reset a Port....................................................................................................................... 15-11

15.2.4 Set Port Speed .................................................................................................................. 15-12

15.2.5 Disable a Port ................................................................................................................... 15-13

15.2.6 Enable a Port .................................................................................................................... 15-14

15.3 For More Information................................................................................................................. 15-14

16 Use InfiniBand Partitions in Exalogic Physical Environments

16.1 Overview of Partitioning ............................................................................................................. 16-1

16.2 Understand Partition Keys.......................................................................................................... 16-2

16.2.1 Guidelines for Managing pkey Allocation in a Hybrid Rack ..................................... 16-2

16.3 Before You Begin........................................................................................................................... 16-3

16.3.1 Verify the Firmware of InfiniBand Switch..................................................................... 16-3

16.3.2 Gather Port GUIDs of Compute Nodes and BridgeX Ports of Gateway Switches.. 16-3

16.3.3 Identify All InfiniBand Switches in the Fabric.............................................................. 16-5

16.3.4 Determine the SM Priority on an InfiniBand Switch ................................................... 16-5

16.3.5 Log In to the InfiniBand Switch That Runs Master SM ............................................... 16-5

16.4 Move from a Default Partition to a Custom Partition............................................................. 16-5

16.5 Create an IPoIB Partition and Adding Ports............................................................................. 16-6

16.6 Delete a Partition........................................................................................................................... 16-9

16.7 Create a Partition for EoIB and Associating the pkey with a VNIC and VLAN................. 16-9

16.8 Perform the Post-Configuration Steps..................................................................................... 16-15

16.9 Important Notes for Combined Exalogic-Exadata Fabric Users.......................................... 16-15

16.10 Partitioning Limitations........................................................................................................... 16-16

17 Monitoring the Exalogic Machine Using Oracle Enterprise Manager Ops Center

17.1 Overview........................................................................................................................................ 17-2

17.2 Key Features .................................................................................................................................. 17-2

17.3 Prerequisites .................................................................................................................................. 17-3

17.4 Accessing Oracle Enterprise Manager Ops Center Documentation ..................................... 17-3

17.5 Launching Oracle Enterprise Manager Ops Center ................................................................ 17-3

17.6 Understanding the Workflow..................................................................................................... 17-4

17.7 Managing Users and Roles.......................................................................................................... 17-6

17.8 Discovering and Managing Exalogic Machine Hardware...................................................... 17-6

17.9 Grouping Exalogic Machine Hardware Assets ........................................................................ 17-9

17.9.1 Prerequisites....................................................................................................................... 17-9

17.9.2 Creating the Exalogic Top-Level Group ........................................................................ 17-9

viii

17.9.3 Creating a Sub-Group for Exalogic Compute Nodes................................................. 17-11

17.9.4 Creating a Sub-Group for the Storage Appliance....................................................... 17-12

17.9.5 Creating a Sub-Group for InfiniBand Switches .......................................................... 17-14

17.9.6 Adding Assets to a Group.............................................................................................. 17-15

17.10 Viewing Exalogic Compute Nodes ........................................................................................ 17-16

17.11 Viewing InfiniBand Switches.................................................................................................. 17-19

17.12 Viewing the Storage Appliance .............................................................................................. 17-22

17.13 Viewing the InfiniBand Fabric and Its Nodes ...................................................................... 17-24

17.14 About Problem Management.................................................................................................. 17-28

17.15 Using Monitoring Profiles and Rules .................................................................................... 17-29

17.15.1 Creating a Monitoring Profile...................................................................................... 17-29

17.15.2 Adding a Monitoring Rule from the Asset View...................................................... 17-30

17.16 Using Reports in Oracle Enterprise Manager Ops Center.................................................. 17-31

17.17 Using Oracle Services in Oracle Enterprise Manager Ops Center .................................... 17-32

17.17.1 Prerequisites for Using Oracle Services in Oracle Enterprise Manager Ops Center

................................................................................................................................................... 17-32

17.17.2 Viewing Service Requests ............................................................................................ 17-33

17.17.3 Filing a Service Request................................................................................................ 17-35

18 Install the ASR Software

18.1 About Oracle Auto Service Request (ASR) ............................................................................... 18-1

18.2 Recommended Configuration..................................................................................................... 18-2

18.3 Before You Begin........................................................................................................................... 18-2

18.4 Prerequisites for Installing ASR Manager................................................................................. 18-2

18.5 Install ASR Manager on a Standalone System.......................................................................... 18-2

18.5.1 Install Service Tags for Oracle Linux.............................................................................. 18-2

18.5.2 Install SASM Package ....................................................................................................... 18-3

18.5.3 Install ASR Package .......................................................................................................... 18-3

18.6 Register the ASR Manager........................................................................................................... 18-4

18.7 Activate ILOM for Exalogic Compute Nodes .......................................................................... 18-4

18.8 Activate the Storage Appliance .................................................................................................. 18-4

18.9 Approve and Verify ASR Activation for Exalogic Machine Assets ...................................... 18-6

18.9.1 Approve Exalogic Machine Assets in My Oracle Support.......................................... 18-7

18.9.2 View and Verify ASR Assets ........................................................................................... 18-7

A Configure the Exalogic Machine Using ECU

A.1 Overview........................................................................................................................................... A-1

A.2 Important Notes Before You use the ECU ................................................................................... A-1

A.3 Configuration Tasks ........................................................................................................................ A-2

B Site Checklists

B.1 System Components Checklist....................................................................................................... B-1

B.2 Data Center Room Checklist........................................................................................................... B-2

ix

B.3 Data Center Environment Checklist.............................................................................................. B-3

B.4 Access Route Checklist.................................................................................................................... B-3

B.5 Facility Power Checklist.................................................................................................................. B-5

B.6 Power Checklist ................................................................................................................................ B-6

B.7 Safety Checklist................................................................................................................................. B-6

B.8 Logistics Checklist............................................................................................................................ B-7

B.9 Network Specification Checklist.................................................................................................... B-8

B.10 Reracking Checklists.................................................................................................................... B-10

B.10.1 Rack Recycling................................................................................................................... B-12

C Cabling Diagrams

C.1 Exalogic Eighth Rack....................................................................................................................... C-1

C.2 Exalogic Quarter Rack..................................................................................................................... C-2

C.3 Exalogic Half Rack........................................................................................................................... C-3

C.4 Exalogic Full Rack............................................................................................................................ C-4

D Replacement Units

D.1 Rack-Level FRUs for Exalogic X5-2............................................................................................... D-2

D.2 Rack-Level FRUs for Exalogic X4-2............................................................................................... D-2

D.3 Rack-Level FRUs for Exalogic X2-2 and X3-2.............................................................................. D-3

D.4 Parts for ZS3-ES Storage Appliance for Exalogic X5-2............................................................... D-4

D.5 Parts for ZS3-ES Storage Appliance for Exalogic X4-2............................................................... D-5

D.6 Parts for Sun ZFS Storage 7320 Appliance................................................................................... D-6

D.7 Parts for Oracle Server X5-2 Compute Nodes ............................................................................. D-7

D.8 Parts for Sun Server X4-2 Compute Nodes.................................................................................. D-8

D.9 Parts for Sun Server X3-2 Compute Nodes.................................................................................. D-9

D.10 Parts for X4170 M2 Compute Nodes........................................................................................ D-10

D.11 Parts for Sun Network QDR InfiniBand Gateway Switch for Exalogic X5-2..................... D-11

D.12 Parts for Sun Network QDR InfiniBand Gateway Switch for Exalogic X4-2..................... D-12

D.13 Parts for Sun Network QDR InfiniBand Gateway Switch for Exalogic X2-2 and X3-2.... D-12

D.14 Parts for Sun Datacenter InfiniBand Switch 36 for Exalogic X5-2 ....................................... D-13

D.15 Parts for Sun Datacenter InfiniBand Switch 36 for Exalogic X4-2 ....................................... D-13

D.16 Parts for Sun Datacenter InfiniBand Switch 36 for Exalogic X2-2 and X3-2 ...................... D-14

D.17 Parts for the Cisco Catalyst 4948E-F-S Switch........................................................................ D-14

D.18 Parts for the Cisco Catalyst 4948 Switch ................................................................................. D-15

D.19 Parts for the Gari DE2-24C Disk Enclosure for Exalogic X5-2 ............................................. D-15

D.20 Parts for the Gari DE2-24C Disk Enclosure ............................................................................ D-15

E Cabling Tables

E.1 Administrative Gigabit Ethernet Network-Cabling Tables ....................................................... E-1

E.2 InfiniBand Network Cabling Tables.............................................................................................. E-7

E.2.1 Exalogic Machine Full Rack................................................................................................. E-7

E.2.2 Exalogic Machine Half Rack.............................................................................................. E-14

x

E.2.3 Exalogic Machine Quarter Rack........................................................................................ E-18

E.2.4 Exalogic Machine Eighth Rack.......................................................................................... E-20

E.3 Power Distribution Unit Cabling Tables..................................................................................... E-22

E.3.1 Single Phase PDU Power Cabling Full Rack................................................................... E-23

E.3.2 Single Phase PDU Power Cabling Half Rack.................................................................. E-24

E.3.3 Single Phase PDU Power Cabling Quarter Rack............................................................ E-25

E.3.4 Single Phase PDU Power Cabling Eighth Rack.............................................................. E-26

E.3.5 Three Phase PDU Power Cabling Full Rack ................................................................... E-27

E.3.6 Three Phase PDU Power Cabling Half Rack .................................................................. E-28

E.3.7 Three Phase PDU Power Cabling Quarter Rack ............................................................ E-29

E.3.8 Three Phase PDU Power Cabling Eighth Rack .............................................................. E-30

F Manage Solaris Zones on Exalogic

F.1 Requirements .................................................................................................................................... F-1

F.2 Terminology ...................................................................................................................................... F-1

F.3 Create a Solaris Zone........................................................................................................................ F-2

F.3.1 Prerequisites .......................................................................................................................... F-2

F.3.2 Set Up a Solaris Zone............................................................................................................ F-8

F.4 Migrate a Zone to a New Host ..................................................................................................... F-12

G Customize Linux on the Compute Nodes

G.1 RPMs That Must Not Be Modified or Removed ........................................................................ G-1

G.2 Prepare the Compute Nodes for Yum Updates ......................................................................... G-2

G.3 Install, Update, and Remove RPMs Using Yum ........................................................................ G-2

xi

xii

List of Figures

2-1
3-1
3-2
3-3
3-4
3-5

3-6
3-7
3-8
3-9
3-10
3-11
3-12
3-13
3-14
6-1
6-2
7-1
7-2
8-1
8-2
8-3
8-4
8-5
8-6
8-7
9-1
9-2
9-3
17-1
17-2

17-3
17-4
17-5
17-6
17-7
17-8
17-9
17-10
17-11
17-12
17-13
17-14
17-15
17-16
17-17
17-18
17-19
17-20

Typical Data Center Configuration for Perforated Floor Tiles............................................. 2-8

Unpacking Exalogic Machine Rack........................................................................................... 3-4

Location of Leveling Feet on Exalogic Machine...................................................................... 3-7

Securing Exalogic Machine Using the Leveling Feet............................................................. 3-8

Location of Mounting Brackets on Rack.................................................................................. 3-9

Bottom View of Exalogic Machine Showing Mounting Hole and Floor Cutout

Dimensions............................................................................................................................. 3-9

Base Position to Measure.......................................................................................................... 3-10

Securing Exalogic Machine Using Mounting Brackets........................................................ 3-11

Earth Ground Attachment Bolt Location............................................................................... 3-12

Power Cord Routing from the Bottom of the Rack.............................................................. 3-14

Power Cord Routing Example from the Top of the Rack.................................................... 3-14

PDU Switch Locations.............................................................................................................. 3-15

Exalogic Compute Node LED Lights..................................................................................... 3-16

Soft Switches on the Server Heads in the Sun ZFS Storage 7320 appliance..................... 3-16

Soft Switch and LED Lights on Server Heads....................................................................... 3-17

Network Diagram for Exalogic Machine................................................................................. 6-4

Connectivity Between NM2-GW and External 10 GB Ethernet Switch............................ 6-14

Management Network in Exalogic Machine........................................................................... 7-3

Configuring ILOM IP Using Serial Port Connection.............................................................. 7-8

Network Ports on the Storage Appliance................................................................................ 8-4

Network Configuration Screen.................................................................................................. 8-5

Network Interface Settings......................................................................................................... 8-6

igb2 and igb3 in an IPMP Group............................................................................................... 8-9

Creating a New IPMP Group Interface.................................................................................. 8-10

IPMP Network Interface Settings............................................................................................ 8-12

Create Filesystem....................................................................................................................... 8-18

NIS Service.................................................................................................................................... 9-2

NFS Service................................................................................................................................... 9-3

NIS Service.................................................................................................................................... 9-4

Oracle Enterprise Manager Home Page................................................................................. 17-4

Management of Exalogic Machine Hardware Using Oracle Enterprise Manager Ops

Center.................................................................................................................................... 17-5

Custom Asset Discovery Screen.............................................................................................. 17-7

Configure Group..................................................................................................................... 17-10

Group Summary Screen......................................................................................................... 17-11

Configure Sub-Group for Compute Nodes......................................................................... 17-12

Configure Sub-Group for Storage Appliance..................................................................... 17-13

Configure Sub-Group for InfiniBand Switches.................................................................. 17-15

Exalogic Group View.............................................................................................................. 17-17

Compute Node Hardware Information............................................................................... 17-18

Launching Service Processor Console.................................................................................. 17-19

Switch View............................................................................................................................. 17-20

Switch Hardware Information.............................................................................................. 17-21

Storage Appliance View......................................................................................................... 17-22

Storage appliance Hardware View....................................................................................... 17-23

Viewing Shares Configured on the Storage Appliance..................................................... 17-24

Fabric View.............................................................................................................................. 17-25

Viewing a Switch in the Fabric.............................................................................................. 17-26

Switch Port Monitoring.......................................................................................................... 17-27

Viewing the Storage Appliance in the Fabric...................................................................... 17-28

xiii

18-1
18-2
18-3
C-1
C-2
C-3
C-4

Phone Home Tab on the List of Services................................................................................ 18-5

Phone Home Settings Page...................................................................................................... 18-6

ASR Activation - Asset Screen in My Oracle Support......................................................... 18-7

Exalogic Eighth Rack Network Connectivity......................................................................... C-2

Exalogic Quarter Rack Network Connectivity....................................................................... C-3

Exalogic Half Rack Network Connectivity............................................................................. C-3

Exalogic Full Rack Network Connectivity.............................................................................. C-4

xiv

List of Tables

1-1
1-2
2-1
2-2
2-3
2-4
2-5
2-6
4-1
4-2
4-3
4-4
4-5
6-1

6-2
6-3
6-4
6-5
6-6
6-7
6-8
8-1
8-2
8-3
8-4
8-5
12-1
13-1
14-1
D-1
D-2
D-3
D-4
D-5
D-6
D-7
D-8
D-9
D-10
D-11

D-12
D-13
D-14

D-15
D-16
D-17
D-18

Hardware Components of Exalogic.......................................................................................... 1-2

Layout for all Exalogic machine configurations..................................................................... 1-4

Access Route Requirements....................................................................................................... 2-2

Maintenance Access Requirements for Exalogic Machine.................................................... 2-3

Floor Load Requirements for Exalogic Machine..................................................................... 2-3

PDU Requirements for Low Voltage........................................................................................ 2-4

PDU Requirements for High Voltage....................................................................................... 2-4

Temperature, Humidity, and Altitude Requirements........................................................... 2-6

Default ILOM, NET0, and IB Bonded IP for Exalogic Full Rack.......................................... 4-1

Default ILOM, NET0, and IB Bonded IP for Exalogic Half Rack......................................... 4-4

Default ILOM, NET0, and IB Bonded IP for Exalogic Quarter Rack................................... 4-7

Default ILOM, NET0, and IB Bonded IP for Exalogic Eighth Rack................................... 4-10

Default Ports.............................................................................................................................. 4-13

Available network components and interfaces on the compute nodes and storage

appliance................................................................................................................................. 6-1

IP Address Requirements for Exalogic Machine.................................................................... 6-8

Transceivers and Cables........................................................................................................... 6-15

HCA, Port Specifications and Cable Requirements............................................................. 6-15

General Network Configuration Worksheet......................................................................... 6-17

Management Network Configuration Worksheet ............................................................... 6-18

Client Access Network Configuration Worksheet .............................................................. 6-19

Private InfiniBand Network Configuration Worksheet ..................................................... 6-19

Default Configuration of the storage appliance.................................................................... 8-14

Project Settings........................................................................................................................... 8-15

File System Access Types and Permissions........................................................................... 8-18

Case Sensitivity Values............................................................................................................. 8-19

Normalization Settings............................................................................................................. 8-20

NM2-GW Specifications........................................................................................................... 12-1

Running the Subnet Manager in Different Rack Configurations....................................... 13-2

Sun Datacenter InfiniBand Switch 36 Specifications............................................................ 14-1

Rack-Level Replacement Parts for EL X5-2............................................................................. D-2

Rack-Level Replacement Parts for EL X4-2............................................................................. D-2

Rack-Level Replacement Parts for EL X2-2 and X3-2............................................................ D-3

Replacement Parts for Oracle ZS3-ES Appliance................................................................... D-4

Replacement Parts for Oracle ZS3-ES Appliance................................................................... D-5

Replacement Parts for Sun ZFS Storage 7320 appliance....................................................... D-6

Replacement Parts for Oracle Server X5-2 Compute Nodes................................................ D-7

Replacement Parts for Sun Server X4-2 Compute Nodes..................................................... D-8

Replacement Parts for Sun Server X3-2 Compute Nodes..................................................... D-9

Replacement Parts for X4170 M2 Compute Nodes.............................................................. D-10

Replacement Parts for Sun Network QDR InfiniBand Gateway Switch for Exalogic

X5-2 Machines...................................................................................................................... D-12

Replacement Parts for Sun Network QDR InfiniBand Gateway Switch for Exalogic

X4-2 Machines...................................................................................................................... D-12

Replacement Parts for Sun Network QDR InfiniBand Gateway Switch for Exalogic

X2-2 and X3-2 Machines..................................................................................................... D-13

Replacement Parts for Sun Datacenter InfiniBand Switch 36............................................ D-13

Replacement Parts for Sun Datacenter InfiniBand Switch 36............................................ D-14

Replacement Parts for Sun Datacenter InfiniBand Switch 36............................................ D-14

Replacement Parts for the Cisco Catalyst 4948E-F-S Switch.............................................. D-14

Replacement Parts for Cisco Catalyst 4948 Switch.............................................................. D-15

xv

D-19
D-20
E-1
E-2
E-3
E-4
E-5
E-6
E-7
E-8
E-9
E-10
E-11
E-12
E-13
E-14
E-15
E-16
E-17
E-18
E-19
E-20
E-21
F-1

Replacement Parts for Gari DE2-24C Disk Enclosure ........................................................ D-15

Replacement Parts for Gari DE2-24C Disk Enclosure ........................................................ D-16

Gigabit Ethernet Cabling for Exalogic Machine Full Rack................................................... E-2

Gigabit Ethernet Cabling for Exalogic Machine Half Rack................................................... E-4

Gigabit Ethernet Cabling for Exalogic Machine Quarter Rack............................................ E-5

Gigabit Ethernet Cabling for Exalogic Machine Eighth Rack............................................... E-6

InfiniBand Network Cabling for Exalogic Machine Full Rack............................................. E-7

InfiniBand Gateway Switch Inter-Connections for Exalogic Machine Full Rack............ E-12

InfiniBand Gateway Switch Cross-Connections for Exalogic Machine Full Rack.......... E-13

InfiniBand Network Cabling for Exalogic Machine Half Rack.......................................... E-14

InfiniBand Gateway Switch Inter-Connections for Exalogic Machine Half Rack........... E-17

InfiniBand Network Cabling for Exalogic Machine Quarter Rack.................................... E-18

InfiniBand Gateway Switch Inter-Connections for Exalogic Machine Quarter Rack..... E-20

InfiniBand Network Cabling for Exalogic Machine Eighth Rack...................................... E-21

InfiniBand Gateway Switch Inter-Connections for Exalogic Machine Eighth Rack....... E-22

Single Phase PDU Power Cabling for Exalogic Machine Full Rack.................................. E-23

Single Phase PDU Power Cabling for Exalogic Machine Half Rack................................. E-25

Single Phase PDU Power Cabling for Exalogic Machine Quarter Rack........................... E-26

Single Phase PDU Power Cabling for Exalogic Machine Eighth Rack............................. E-26

Three Phase PDU Power Cabling for Exalogic Machine Full Rack................................... E-27

Three Phase PDU Power Cabling for Exalogic Machine Half Rack.................................. E-29

Three Phase PDU Power Cabling for Exalogic Machine Quarter Rack............................ E-30

Three Phase PDU Power Cabling for Exalogic Machine Eighth Rack.............................. E-30

Terminology................................................................................................................................. F-1

xvi

Preface

This guide describes the Oracle Exalogic machine, which is an integrated cloud
machine comprising hardware and software. It includes information about hardware
operations and site planning, as well as physical, electrical, and environmental
specifications.

Note:

All hardware-related specifications in this guide are based on information for
a typical deployment provided by Oracle at the time this guide was written.
Oracle is not responsible for hardware problems that may result from
following the average specifications in this document. For detailed
information about preparing your site for Oracle Exalogic machine
deployment, consult your hardware specification.

This preface contains the following sections:

• Audience

• Revision History

• Documentation Accessibility

• Related Documents

• Conventions

Audience

This guide is intended for Oracle Exalogic machine customers and those responsible
for data center site planning.

It is assumed that the readers of this manual have knowledge of the following:

• System administration concepts

• Hardware and networking concepts

Revision History

• E18478-18: April 2014

• E18478-17: February 2014

xvii

– Hardware Components of Exalogic: Added generic link that points to data

sheets.

– Environmental Requirements: Added generic link that points to data sheets.

– What Next?: Added note with a link to MOS document for changing

passwords.

– Cabling Diagrams : Removed sections about multirack cabling and added a

reference to the Exalogic Elastic Cloud Multirack Cabling Guide.

• E18478-16: December 2013

– Hardware Components of Exalogic: Added generic link that points to X4-2

data sheet.

– Hardware Components of Exalogic: Added precabling information for X4-2.

– Environmental Requirements: Added generic link that points to X4-2 data

sheet.

– Cabling Tables: Added precabling information for X4-2.

– Rebranded the document to cater to X4-2 in addition to X3-2 and X2-2.

• E18478-15: September 2013

– Added Guidelines for Managing pkey Allocation in a Hybrid Rack.

• E18478-14: August 2013

– Default Port Assignments: Added default ports assignments of the Exalogic

rack.

– Initial Configuration: Updated note about the initial configuration of the

storage appliance.

– Set Up Ethernet Over InfiniBand on Oracle Solaris 11.1: Added Oracle Solaris

11.1 procedure for setting up Ethernet over InfiniBand.

– Oracle Solaris: Creating VNICs and Associating Them with VLANs: Added

Oracle Solaris 11.1 procedure for creating VLAN-tagged VNICs.

– Activate the Storage Appliance: Updated the procedure and screenshot in this

section.

– Manage Solaris Zones on Exalogic: Created appendix describing the use of

Solaris zones on Exalogic.

– Customize Linux on the Compute Nodes: Created appendix describing how

to install, upgrade, and remove RPMs on Linux compute nodes.

• E18478-13: March 2013

xviii

– Hardware Components of Exalogic: Added direct links to the data sheets for

X2-2 and X3-2.

– Hardware Components of Exalogic: Added information about the spares kit

for Exalogic.

– Cabling Diagrams : Added additional Exalogic wiring configurations.

– Replacement Units: Added note about the spares kit for Exalogic.

– Cabling Tables: Corrected errors in the networking tables.

• E18478-12: February 2013

– Parts for Sun Server X3-2 Compute Nodes: Added the replacement part

numbers of the new BBU.

– Create an IPoIB Partition and Adding Ports: Corrected the smpartition

command syntax in step 3.

E18478-11: December 2012

•

– Hardware Components of Exalogic: Added generic link that points to both

X2-2 and X3-2 data sheets.

– Environmental Requirements: Added generic link that points to both X2-2

and X3-2 data sheets.

E18478-10: October 2012

•

– Environmental Requirements: Added environmental requirements for X3-2.

– Create an IPoIB Partition and Adding Ports: Added steps for configuring the

storage appliance when creating IB partitions.

– Chapter 16, "Monitoring the Exalogic Machine Using Oracle Enterprise

Manager Ops Center": Added information, up front, to clarify the scope of the
content in this chapter.

– Replacement Units: Added replacement parts list for the new hardware

components in X3-2.

– Rebranded the document cater to both X3-2 and X2-2.

• E18478-09: September 2012

– Configure Ethernet Over InfiniBand:

Updated the procedure to set up EoIB on Oracle Linux and Oracle Solaris, to
correct certain errors and inconsistencies.

Added information about the recommended naming convention for VNICs
on Oracle Linux.

– Subnet Manager Operation in Different Rack Configurations:

Updated Table 13-1 to make the information clearer.

Added information for running the SM in rack configurations with varying
switch-firmware versions.

– Create a Partition for EoIB and Associating the pkey with a VNIC and VLAN:

Added information about the recommended naming convention for VNICs
on Oracle Linux.

– Configuration Tasks: Updated with information about contacting Oracle

Advanced Customer Support.

xix

Documentation Accessibility

For information about Oracle's commitment to accessibility, visit the Oracle
Accessibility Program website at http://www.oracle.com/pls/topic/lookup?

ctx=acc&id=docacc.

Access to Oracle Support

Oracle customers that have purchased support have access to electronic support
through My Oracle Support. For information, visit http://www.oracle.com/pls/

topic/lookup?ctx=acc&id=info or visit http://www.oracle.com/pls/
topic/lookup?ctx=acc&id=trs if you are hearing impaired.

Related Documents

For more information, see the following documents:

• Oracle Exalogic Release Notes

• Oracle Exalogic Machine Multirack Cabling Guide

Conventions

The following text conventions are used in this document:

Convention

boldface

italic Italic type indicates book titles, emphasis, or placeholder variables for

monospace Monospace type indicates commands within a paragraph, URLs, code

Meaning

Boldface type indicates graphical user interface elements associated
with an action, or terms defined in text or the glossary.

which you supply particular values.

in examples, text that appears on the screen, or text that you enter.

xx

Learn About the Exalogic Machine

This chapter describes the features and hardware components of an Exalogic machine.
It also includes usage information related to the Exalogic machine.

This chapter contains these topics:

• About Oracle Exalogic

• Hardware Components of Exalogic

• Exalogic Machine Rack Layout

• Operational Procedures for Exalogic Machines

1.1 About Oracle Exalogic

Oracle Exalogic is an integrated hardware and software system designed to provide a
complete platform for a wide range of application types and widely varied workloads.
Exalogic is intended for large-scale, performance-sensitive, mission-critical application
deployments. It combines Oracle Fusion Middleware software and industry-standard
Sun hardware to enable a high degree of isolation between concurrently deployed
applications, which have varied security, reliability, and performance requirements.
Exalogic enables customers to develop a single environment that can support end-to­end consolidation of their entire applications portfolio.

1

Exalogic is designed to fully leverage an internal InfiniBand fabric that connects all of
the processing, storage, memory and external network interfaces within an Exalogic
machine to form a single, large computing device. Each Exalogic machine is connected
to the customer's data center networks via 10 GbE (traffic) and GbE (management)
interfaces.

Customers can integrate Exalogic machines with an Exadata machine or additional
Exalogic machines by using the available InfiniBand expansion ports and optional
data center switches. The InfiniBand technology used by Exalogic offers significantly
high bandwidth, low latency, hardware-level reliability, and security. If you are using
applications that follow Oracle's best practices for highly scalable, fault-tolerant
systems, you do not need to make any application architecture or design changes to
benefit from Exalogic. You can connect many Exalogic machines or a combination of
Exalogic machines and Oracle Exadata Database Machines to develop a single, large­scale environment.

1.1.1 Features of Exalogic

Exalogic includes the following features:

• complete, pre-assembled, and certified system for maximum performance

• best platform for end-to-end consolidation of large-scale application deployments

Learn About the Exalogic Machine

1-1

Hardware Components of Exalogic

• ready to deploy

• linearly scalable

• enterprise-ready

• enterprise-level software and hardware support

1.2 Hardware Components of Exalogic

The Exalogic machines consist of compute nodes, a storage appliance, and InfiniBand
and Ethernet networking components. The number of these components in each
machine varies based on the hardware configuration.

Note:

The hardware components listed in this chapter are for Exalogic machines
shipped from the factory.

Table 1-1 Hardware Components of Exalogic

Component Full

Rack

Sun Rack II 1242 1 1 1 1

Compute nodes:

•

Oracle Server X6–2

• Previous versions of the hardware: Sun Fire X4170
M2 (X2–2), Sun Server X3-2, Sun Server X4-2, and
Oracle Server X5-2.

Storage Appliance:

•

X6-2: Oracle ZS5–ES storage appliance

•

X2-2 and X3-2: Dual controller Sun ZFS Storage
7320 appliance (60 TB)

•

X4-2 and X5-2: Oracle ZS3-ES storage appliance

Sun Network QDR InfiniBand Gateway Switches
(NM2-GW)

Sun Datacenter InfiniBand Switch 36 (NM2-36P) 1 1 0 0

Cisco Ethernet management switch

•

X2-2: 48-port Cisco Catalyst 4948 switch (part
number: 371-4784-N)

•

X6-2, X5-2, X4-2, and X2-2: 48-port Cisco Catalyst
4948E-F-S switch (part number: 7023685)

30 16 8 4

1 1 1 1

4 2 2 2

1 1 1 1

Half
Rack

Quarter
Rack

Eighth
Rack

Redundant Power Distribution Units (PDU). See PDUs

in Exalogic for the available PDU options.

You can connect up to eight Exalogic machines, or a combination of Exalogic and
Exadata on the same InfiniBand fabric, without the need for any external switches.

1-2 Oracle Exalogic Elastic Cloud Machine Owner's Guide

2 2 2 2

1.2.1 PDUs in Exalogic

Each Exalogic rack contains two redundant PDUs that are available in both high and
low voltage options. The available PDU options can be found in the data sheets

available at the following location:

http://www.oracle.com/technetwork/server-storage/engineered­systems/exalogic/index.html

Exalogic Machine Rack Layout

Note:

If more than eight racks of Exalogic or Exadata are required to be connected
on the same InfiniBand fabric, Oracle offers a choice of several high-capacity
datacenter switches, which allow the creation of Exalogic clouds consisting of
hundreds of racks and tens of thousands of processors.

Note:

When you upgrade to a full rack, you must upgrade to a three-phase 24 kVA
PDU.

1.2.2 Spares Kit for Exalogic

The Exalogic machine includes a spares kit containing additional parts and accessories
(cables, for example) that Oracle Services personnel will use to replace non-working
and broken parts quickly. When Oracle Services personnel visit your site for repairing
and replacing hardware, you should make the spares kit available to them. Note that
any parts used by Oracle Service personnel from the spares kit will be replenished by
Oracle.

1.2.3 Pre-cabling for Exalogic X4-2 and newer Machines

The eighth-, quarter-, and half-rack X4-2 and newer machines are pre-cabled with a
complete set (equivalent in number to a full rack) of InfiniBand (92), Ethernet (42), and
power cables. All the cables are connected to the appropriate switches and routed to
the correct rack-unit location. The unconnected ends of the cables are tied off to lacer
bars. At a later time, if the machine is upgraded to a larger rack, the filler panels and
lacer bars are removed, the X4-2 and newer servers are installed with rack rails and
cable-management arms, and the cables (power, InfiniBand, and Ethernet) are
connected to the newly installed compute nodes.

1.3 Exalogic Machine Rack Layout

The Exalogic machines are available in the following hardware configurations:

• full rack

• half rack

• quarter rack

• eighth rack

The following table displays the location of the hardware components on the 42 rack
units of an Exalogic machine. The table includes the information for all the available

Learn About the Exalogic Machine 1-3

Operational Procedures for Exalogic Machines

rack configurations. The dashes within the rack configuration columns of the table,
represent empty rack units that are covered with solid one-unit fillers. The rack unit 42
is at the top of the Exalogic machine and the rack unit 1 is at the bottom.

See a summary of the hardware components for the different Exalogic machine
configurations in Hardware Components of Exalogic.

Note:

Do not alter the rack layout. Do not use the free space in the rack for anything
other than a rack upgrade kit.

Table 1-2 Layout for all Exalogic machine configurations

Rack Unit Full

Rack

U29 to U42 X - - - Compute Node Compute Node

U27, U28 X X - - Compute Node Compute Node

U26 X - - - Vented one-unit

U25 X X X X Vented one-unit

U24 X - - - Vented one-unit

U23 X X X X Vented one-unit

U21, U22 X X X X Storage Appliance

U17 to U20 X X X X Storage Appliance

U16 X X X X Vented one-unit

Half
Rack

Quarter
Rack

Eighth
Rack

Front View Rear View

NM2-GW InfiniBand

filler

filler

filler

filler

Server Head

Disk Shelf

filler

Switch / Gateway

Cisco Ethernet
Management Switch

NM2-GW InfiniBand
Switch / Gateway

NM2-GW InfiniBand
Switch / Gateway

Storage Appliance
Server Head

Storage Appliance
Disk Shelf

NM2-GW InfiniBand
Switch / Gateway

U10 to U15 X X - - Compute Node Compute Node

U06 to U09 X X X - Compute Node Compute Node

U02 to U05 X X X X Compute Node Compute Node

U01 X X - - Vented one-unit

filler

1.4 Operational Procedures for Exalogic Machines

This section includes the following topics:

• Non-emergency Power Procedure

• Emergency Power-off Considerations

1-4 Oracle Exalogic Elastic Cloud Machine Owner's Guide

NM2-36P InfiniBand
Switch

• Cautions and Warnings

1.4.1 Non-emergency Power Procedure

Compute nodes and controllers in the storage device are powered on by either
pressing the power button on the front of the machine, or by logging in to the ILOM
interface and applying power to the system.

Compute nodes and controllers can also be powered off by using operating system
commands.

For example, you can use the following command on the Oracle Linux operating
system:

shutdown -h -y now

On the Oracle Solaris operating system, you can use the following command:

shutdown -i 5 now

Note:

You can use this command after logging in to the compute nodes.

Operational Procedures for Exalogic Machines

The network switches do not have power switches. They power off when
power is removed, by way of the PDU or at the breaker in the data center.

1.4.1.1 Power On Sequence

The power on sequence is as follows:

1. Rack, including switches.

Ensure that the switches have had power applied for a few minutes to complete
power-on configuration before starting the storage controllers and compute nodes.

2. Storage server heads attached to the chassis of the storage device.

Wait for a few minutes for the storage appliance to boot and start NFS services and
daemons.

3. Compute nodes.

Note:

After power is applied, the LEDs on all compute nodes and storage server
heads will start blinking after a few minutes. From the rear of the rack, you
can see the green LEDs on the PSUs turn on instantly after power is applied.
In addition, from the rear of the rack, you can see the display on the PDUs that
lights up once power is available.

1.4.1.2 Power Off Sequence

The power off sequence is as follows:

Compute nodes

1.

Learn About the Exalogic Machine 1-5

Operational Procedures for Exalogic Machines

Note:

Once the compute nodes are down, you can proceed to shut down the storage
appliance.

2. Storage server heads attached to the chassis of the storage device

3. Rack, including switches

1.4.2 Emergency Power-off Considerations

If there is an emergency, then power to the Exalogic machine should be halted
immediately. The following emergencies may require powering off the Exalogic
machine:

• Natural disasters such as earthquake, flood, hurricane, tornado or cyclone.

• Abnormal noise, smell or smoke coming from the machine.

• Threat to human safety.

1.4.2.1 Emergency Power-off Procedure

To perform an emergency power-off procedure for the Exalogic machine, turn off
power at the circuit breaker or pull the emergency power-off switch in the computer
room. After the emergency, contact Oracle Support Services to restore power to the
machine.

1.4.2.2 Emergency Power-off Switch

Emergency power-off (EPO) switches are required when computer equipment
contains batteries capable of supplying more than 750 volt-amperes for more than five
minutes. Systems that have these batteries include internal EPO hardware for
connection to a site EPO switch or relay. Use of the EPO switch will remove power
from the Exalogic machine.

1.4.3 Cautions and Warnings

The following cautions and warnings apply to Exalogic machines:

• Do not touch the parts of this product that use high-voltage power. Touching
them might result in serious injury.

• Do not power off Exalogic machines unless there is an emergency. In that case,
follow the Emergency Power-off Procedure.

• Keep the front and rear cabinet doors closed. Failure to do so might cause system
failure or result in damage to hardware components.

• Keep the top, front, and back of the cabinets clear to allow proper airflow and
prevent overheating of components.

• Use only the supplied hardware.

1-6 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Site Requirements

This chapter describes the site requirements for the Exalogic machine.

This chapter contains the following topics:

• Environmental Requirements

• Space Requirements

• Flooring Requirements

• Electrical Power Requirements

• Temperature and Humidity Requirements

• Ventilation and Cooling Requirements

See Also:

2

Site Checklists

2.1 Environmental Requirements

The environmental requirements for an Exalogic machine depend on the purchased
hardware configuration. The environmental requirements for an Exalogic rack can be
found in the data sheets at the following location:

http://www.oracle.com/technetwork/server-storage/engineered­systems/exalogic/index.html

2.2 Space Requirements

All Exalogic machines use the same rack, and have the same space requirements. The
space requirements are as follows:

• Height: 1998 mm (78.66 inches)

• Width: 600 mm with side panels (23.62 inches)

• Depth (front door handle to rear door handle): 1200 mm (47.24 inches)

• Depth (doors removed): 1112 mm (43.78 inches)

The minimum ceiling height for the cabinet is 2300 mm (90 inches), measured from the
true floor or raised floor, whichever is higher. An additional 914 mm (36 inches) is for
top clearance. The space above the cabinet and its surroundings must not restrict the
movement of cool air between the air conditioner and the cabinet, or the movement of
hot air coming out of the top of the cabinet.

Site Requirements

2-1

Space Requirements

2.2.1 Receiving and Unpacking Requirements

Before your Exalogic machine arrives, ensure that the receiving area is large enough
for the package. The following are the package dimensions for the Exalogic machine:

• Shipping height: 2159 mm (85 inches)

• Shipping width: 1219 mm (48 inches)

• Shipping depth: 1575 mm (62 inches)

• For the shipping weight, see the data sheets at the following location:

http://www.oracle.com/technetwork/server-storage/engineered­systems/exalogic/index.html

If your loading dock meets the height and ramp requirements for a standard freight
carrier truck, then you can use a pallet jack to unload the rack. If the loading dock does
not meet the requirements, then you must provide a standard forklift or other means
to unload the rack. You can also request that the rack be shipped in a truck with a lift
gate.

When the Exalogic machine arrives, leave the rack in its shipping packaging until it
arrives in its installation site. Use a conditioned space to remove the packaging
material to reduce particles before entering the data center. The entire access route to
the installation site should be free of raised-pattern flooring that can cause vibration.

Allow enough space for unpacking it from its shipping cartons. Ensure that there is
enough clearance and clear pathways for moving the Exalogic machine from the
unpacking location to the installation location. Table 2-1 lists the access route
requirements for the Exalogic machine.

Table 2-1 Access Route Requirements

Access Route Item With Shipping Pallet Without Shipping Pallet

Minimum door height 2184 mm (86 inches) 2040 mm (80.32 inches)

Minimum door width 1220 (48 inches) 600 mm (23.62 inches)

Minimum elevator depth 1575 mm (62 inches) 1200 mm (47.24 inches)

Maximum incline 6 degrees 6 degrees

Minimum elevator, pallet jack,
and floor loading capacity

2.2.2 Maintenance Access Requirements

The maintenance area must be large enough for the Exalogic machine, and have the
required access space. For example, the required space to remove the side panels is

675. 64 mm (26.6 inches). Table 2-2 lists the maintenance access requirements for the

Exalogic machine.

1134 kg (2500 lbs) 1134 kg (2500 lbs)

2-2 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Table 2-2 Maintenance Access Requirements for Exalogic Machine

Location Maintenance Access Requirement

Rear maintenance 914 mm (36 inches)

Front maintenance 914 mm (36 inches)

Top maintenance 914 mm (36 inches)

2.3 Flooring Requirements

Oracle recommends that the Exalogic machine be installed on raised flooring. The site
floor and the raised flooring must be able to support the total weight of the Exalogic
machine as specified in Environmental Requirements.

Table 2-3 lists the floor load requirements.

Table 2-3 Floor Load Requirements for Exalogic Machine

Description Requirement

Flooring Requirements

Maximum allowable weight of installed rack equipment 952.54 kg (2100 lbs)

Maximum allowable weight of installed power distribution units 52.16 kg (115 lbs)

Maximum dynamic load (maximum allowable weight of installed
equipment including PDUs)

Note:

Open tiles are required for electrical access.

2.4 Electrical Power Requirements

Exalogic Machine can operate effectively over a wide range of voltages and
frequencies. However, it must have a reliable power source. Damage may occur if the
ranges are exceeded. Electrical disturbances such as the following may damage
Exalogic Machine:

• Fluctuations caused by brownouts

• Wide and rapid variations in input voltage levels or in input power frequency

• Electrical storms

1004.71 kg (2215 lbs)

• Faults in the distribution system, such as defective wiring

To protect your Exalogic machine from such disturbances, you should have a
dedicated power distribution system, power-conditioning equipment, as well as
lightning arresters or power cables to protect from electrical storms.

Each rack has two pre-installed power distribution units (PDUs). The PDUs accept
different power sources. You must specify the type of PDU that is correct for your data
center.

Site Requirements 2-3

Electrical Power Requirements

Table 2-4 lists the PDU low voltage requirements.

Table 2-4 PDU Requirements for Low Voltage

Specification 15 kVA, 1 ph 15 kVA, 3 ph 22 kVA, 1 ph 24 kVA, 3 ph

Phase 1 ph 3 ph 1 ph 3 ph

Market Part
Number

Manufacturing
Part Number

Voltage 200-240 VAC 1ph 200-240 VAC 3ph 200-240 VAC 1ph 200-240 VAC 3ph

Amps Per PDU 72A (3 × 24A) 69A (3 × 23A) 110.4 (3x36.8A) 120A (6 × 20A)

Outlets 42 C13, 6 C19 42 C13, 6 C19 42 C13, 6 C19 42 C13, 6 C19

Number of
Inputs

Current 24A max. per

Data Center
Receptacle

Number of
Outlets Per Rack

6442A 6440A 7100873 XSR-24K-IEC309-4P

597-0566-01 597-0564-01 7018123 594-5596-01

3x30A, 1 ph 1x60A, 3 ph 3 x50A 1 ph 2x60A, 3 ph

40A max. per phase 36.8A per input 34.6A max. per phase

input

NEMA L6-30R IEC309-3P4W-IP67

(60A, 250V, AC, 3 ph)

IEC309 60A 3ph 4 Wire

Hubbell
HBL460R/C9W or
equivalent.

6 2 6 4

Hubbell CS8265C IEC309-3P4W-IP67

(60A, 250V, AC, 3 ph)

IEC309 60A 3ph 4
Wire

Hubbell
HBL460R/C9W or
equivalent.

Table 2-5 lists the PDU high voltage requirements.

Table 2-5 PDU Requirements for High Voltage

Specification 15 kVA, 3 ph 22 kVA, 1 ph 24 kVA, 3 ph

Phase 3 ph 1 ph 3 ph

Market Part Number 6441A 7100874 XSR-24K-IEC309-5P

Manufacturing Part
Number

Voltage 220/380-240/415 VAC 3ph 200-240 VAC 1ph 220/380-240/415 VAC

Amps Per PDU 62.7 A (3 × 20.9A) 96A (3x32A) 109A (6 × 18.1A)

Outlets 42 C13, 6 C19 42 C13, 6 C19 42 C13, 6 C19

Number of Inputs 1x25A, 3 ph 3 x 32A 1 ph 2x25A, 3 ph

2-4 Oracle Exalogic Elastic Cloud Machine Owner's Guide

597-0565-01 7018124 594-5600-01

3ph

Electrical Power Requirements

Table 2-5 (Cont.) PDU Requirements for High Voltage

Specification 15 kVA, 3 ph 22 kVA, 1 ph 24 kVA, 3 ph

Current 24A max. per input 32 A per input 18 A max. per input

Data Center
Receptacle

Number of Outlets
Per Rack

IEC 309-4P5W-IP44

(32A, 400V, AC, 3ph)

IEC309 32A 3ph 5 Wire
Hubbell HBL532R/C9W or
equivalent.

2 6 4

2.4.1 Facility Power Requirements

Electrical work and installations must comply with applicable local, state, or national
electrical codes. Contact your facilities manager or qualified electrician to determine
what type of power is supplied to the building.

To prevent catastrophic failures, design the input power sources to ensure adequate
power is provided to the PDUs. Use dedicated AC breaker panels for all power
circuits that supply power to the PDU. When planning for power distribution
requirements, balance the power load between available AC supply branch circuits. In
the United States and Canada, ensure that the overall system AC input current load
does not exceed 80 percent of the branch circuit AC current rating.

PDU power cords are 4 m (13.12 feet) long, and 1 to 1.5 m (3.3 to 4.9 feet) of the cord
will be routed within the rack cabinet. The installation site AC power receptacle must
be within 2 m (6.6 feet) of the rack.

IEC 309-2P3W-IP44 (32A,
250V, AC, 3ph)

IEC309 32A 1ph 3 Wire
Hubbell HBL332R/C9W or
equivalent.

IEC 309-4P5W-IP44 (32A,
400V, AC, 3ph)

IEC309 32A 3ph 5 Wire
Hubbell HBL532R/C9W
or equivalent.

2.4.2 Circuit Breaker Requirements

To prevent catastrophic failures, the design of your power system must ensure that
adequate power is provided to all of the compute nodes. Use dedicated AC breaker
panels for all power circuits that supply power to the compute nodes. Electrical work
and installations must comply with applicable local, state, or national electrical codes.
Compute nodes require electrical circuits to be grounded to the Earth.

In addition to circuit breakers, provide a stable power source, such as an
uninterruptible power supply (UPS) to reduce the possibility of component failures. If
computer equipment is subjected to repeated power interruptions and fluctuations,
then it is susceptible to a higher rate of component failure.

Note:

Circuit breakers are supplied by the customer. One circuit breaker is required
for each power cord.

2.4.3 Grounding Guidelines

The cabinets for the Exalogic machine are shipped with grounding-type power cords
(three-wire). Always connect the cords to grounded power outlets. Because different
grounding methods are used, depending on location, check the grounding type, and

Site Requirements 2-5

Temperature and Humidity Requirements

refer to documentation, such as IEC documents, for the correct grounding method.
Ensure that the facility administrator or qualified electrical engineer verifies the
grounding method for the building, and performs the grounding work.

2.5 Temperature and Humidity Requirements

Airflow through Exalogic machines is from front to back. For cooling and airflow
requirements, see Environmental Requirements.

Note:

Studies have shown that temperature increases of 10 degrees Celsius (15
degrees Fahrenheit) above 20 degrees Celsius (70 degrees Fahrenheit) reduce
long-term electronics reliability by 50 percent.

Excessive internal temperatures may result in full or partial shutdown of
Exalogic machines.

Table 2-6 lists the temperature, humidity and altitude requirements for operating and

nonoperating machines.

Table 2-6 Temperature, Humidity, and Altitude Requirements

Condition Operating Requirement Nonoperating

Requirement

Temperature 5 to 32 degrees Celsius (59

to 89.6 degrees Fahrenheit)

Relative humidity 10 to 90 percent relative

humidity, non-condensing

Altitude 3048 meters (10000 feet)

maximum

-40 to 70 degrees Celsius
(-40 to 158 degrees
Fahrenheit).

Up to 93 percent relative
humidity.

12000 meters (40000 feet). Ambient temperature is

Set conditions to the optimal temperature and humidity ranges to minimize the chance
of downtime due to component failure. Operating an Exalogic machine for extended
periods at or near the operating range limits, or installing it in an environment where
it remains at or near non-operating range limits could significantly increase hardware
component failure.

The ambient temperature range of 21 to 23 degrees Celsius (70 to 74 degrees
Fahrenheit) is optimal for server reliability and operator comfort. Most computer
equipment can operate in a wide temperature range, but near 22 degrees Celsius (72
degrees Fahrenheit) is desirable because it is easier to maintain safe humidity levels.
Operating in this temperature range provides a safety buffer in the event that the air
conditioning system goes down for a period of time.

Optimum

For optimal rack cooling,
data center temperatures
from 21 to 23 degrees Celsius
(70 to 47 degrees Fahrenheit)

For optimal data center rack
cooling, 45 to 50 percent,
non-condensing

reduced by 1 degree Celsius
per 300 m above 900 m
altitude above sea level

The ambient relative humidity range of 45 to 50 percent is suitable for safe data
processing operations. Most computer equipment can operate in a wide range (20 to
80 percent), but the range of 45 to 50 percent is recommended for the following
reasons:

2-6 Oracle Exalogic Elastic Cloud Machine Owner's Guide

• Optimal range helps protect computer systems from corrosion problems
associated with high humidity levels.

• Optimal range provides the greatest operating time buffer in the event of air
conditioner control failure.

• This range helps avoid failures or temporary malfunctions caused by intermittent
interference from static discharges that may occur when relative humidity is too
low.

Note:

Electrostatic discharge (ESD) is easily generated, and hard to dissipate in areas
of low relative humidity, such as below 35 percent. ESD becomes critical when
humidity drops below 30 percent. It is not difficult to maintain humidity in a
data center because of the high-efficiency vapor barrier and low rate of air
changes normally present.

2.6 Ventilation and Cooling Requirements

Always provide adequate space in front of and behind the rack to allow for proper
ventilation. Do not obstruct the front or rear of the rack with equipment or objects that
might prevent air from flowing through the rack. Rack-mountable servers and
equipment typically draw cool air in through the front of the rack and let warm air out
the rear of the rack. There is no air flow requirement for the left and right sides due to
front-to-back cooling.

Ventilation and Cooling Requirements

If the rack is not completely filled with components, then cover the empty sections
with filler panels. Gaps between components can adversely affect air flow and cooling
within the rack.

Relative humidity is the percentage of the total water vapor that can exist in the air
without condensing, and is inversely proportional to air temperature. Humidity goes
down when the temperature rises, and goes up when the temperature drops. For
example, air with a relative humidity of 45 percent at a temperature of 24 degrees
Celsius (75 degrees Fahrenheit) has a relative humidity of 65 percent at a temperature
of 18 degrees Celsius (64 degrees Fahrenheit). As the temperature drops, the relative
humidity rises to more than 65 percent, and water droplets are formed.

Air conditioning facilities usually do not precisely monitor or control temperature and
humidity throughout an entire computer room. Generally, monitoring is done at
individual points corresponding to multiple exhaust vents in the main unit, and other
units in the room. Special consideration should be paid to humidity when using
underfloor ventilation. When underfloor ventilation is used, monitoring is done at
each point close to an exhaust vent. Distribution of the temperature and humidity
across the entire room is uneven.

Exalogic machines have been designed to function while mounted in a natural
convection air flow. The following requirements must be followed to meet the
environmental specification:

• Ensure there is adequate air flow through the server.

• Ensure the server has front-to-back cooling. The air inlet is at the front of the
server, and the air is let out the rear.

Site Requirements 2-7

Ventilation and Cooling Requirements

• Allow a minimum clearance of 914 mm (36 inches) at the front of the server, and
914 mm (36 inches) at the rear of the server for ventilation.

Use perforated tiles, approximately 400 CFM/tile, in front of the rack for cold air
intake. The tiles can be arranged in any order in front of the rack, as long as cold air
from the tiles can flow into the rack. Inadequate cold air flow could result in a higher
inlet temperature in the servers due to exhaust air recirculation. The following is the
recommended number of floor tiles:

• Four floor tiles for Exalogic machine full rack.

• Three floor tiles for Exalogic machine half rack.

• One floor tile for Exalogic machine quarter rack and for Exalogic machine eighth
rack.

Figure 2-1 shows a typical installation of the floor tiles for an Exalogic machine full

rack in a typical data center.

Figure 2-1 Typical Data Center Configuration for Perforated Floor Tiles

2-8 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Install Planning and Procedure

This chapter explains how to prepare for the installation of Exalogic machines, to
install an Exalogic machine at the site, and to power on the rack and its components.

It contains the following topics:

• Installation Overview

• Prepare to Install an Exalogic Machine

• Power on the System the First Time

• Connect a Laptop to the Exalogic Machine

• What Next?

3.1 Installation Overview

The following list describes the process of installing an Exalogic machine at the site.
Note that you must commission the Exalogic machine after installing it at the site.

3

1.

Review the safety precautions, guidelines, site checklists, and site requirements.

2.

Ensure that the site is prepared for the installation of the Exalogic Machine.

3.

Unpack the Exalogic machine.

4.

Place the Exalogic machine in its allocated space.

5.

Perform preliminary checks before connecting the power cords.

6.

Perform a visual inspection of the hardware.

7.

Supply rack power and perform the power-on self test device checks.

8.

Switch on the six PDU circuit breakers located on the rear of the PDU A.

Wait three to five minutes for all ILOM service processors to boot.

9.

Verify that the server standby power is on for each compute node.

10.

Verify that the main power is on for each compute node.

11.

Press the soft switches located on the front of the two storage heads of the storage

12.

appliance.

Wait three to five minutes for the storage appliance to start the NFS services,

13.

daemons, and basic services.

Ping the IP address assigned to the storage appliance to verify if the system is up

14.

and running.

Install Planning and Procedure

3-1

Prepare to Install an Exalogic Machine

15.Press the soft switches located on the front of the compute nodes.

16.Verify that power is applied to the Ethernet switch.

17.Verify that power is applied to the NM2-GW InfiniBand Gateway switches.

18.(Only for half and full racks.) Verify that power is supplied to the NM2-36

InfiniBand Switch.

19.Proceed to configure the Exalogic machine.

3.2 Prepare to Install an Exalogic Machine

This section contains the following topics:

• Before You Begin

• Exalogic Installation Safety Guidelines

• Unpack the Exalogic Machine Rack

• Tools for Installation

• Prepare the Installation Site

3.2.1 Before You Begin

Before installing the Exalogic machine, or installing any server or equipment into the
rack, read the Important Safety Information for Sun Hardware Systems (816-7190)
document included with the rack.

Observe all safety notices printed on the packaging and listed in the Sun Rack II Safety

and Compliance Guide (820-4762) and the Sun Rack II Power Distribution Units Users
Guide (820-4760). Go to http://download.oracle.com/docs/cd/E19657-01/

index.html to download these guides.

Exalogic machine cabinets can enclose a variety of rack-mountable Sun servers,
storage products, and other third-party equipment.

3.2.2 Exalogic Installation Safety Guidelines

Before the Exalogic machine arrives, the following safety precautions should be
reviewed to ensure the site is safe, as well as ready for delivery. Failing to observe
these precautions can result in injury, equipment damage, or malfunction.

• Do not block ventilation openings.

• Do not install the Exalogic machine in a location that is exposed to direct sunlight
or near a device that may become hot.

• Do not install the Exalogic machine in a location that is exposed to excessive dust,
corrosive gases, or air with high salt concentrations.

• Do not install the Exalogic machine in a location that is exposed to frequent
vibrations. Install the Exalogic machine on a flat, level surface.

• Use a power outlet that uses proper grounding. When using shared grounding,
the grounding resistance must not be greater than 10 ohms. Ensure that your

3-2 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Prepare to Install an Exalogic Machine

facility administrator or a qualified electrical engineer verifies the grounding
method for the building, and performs the grounding work.

• Be sure that each grounding wire used for the Exalogic machine is used
exclusively for the Exalogic machine. Also be sure to observe the precautions,
warnings, and notes about handling that appear on labels on the equipment.

• Do not place cables under the equipment or stretch the cables too tightly.

• Do not disconnect power cords from the equipment while its power is on.

• If you cannot reach the connector lock when disconnecting LAN cables, then press
the connector lock with a flathead screwdriver to disconnect the cable. You could
damage the system board if you force your fingers into the gap rather than using a
flathead screwdriver.

• Do not place anything on top of the Exalogic machine or perform any work
directly above it.

• Do not let the room temperature rise sharply, especially in winter. Sudden
temperature changes can cause condensation to form inside the Exalogic machine.
Allow for a sufficient warm-up period prior to server operation.

• Do not install the Exalogic machine near a photocopy machine, air conditioner,
welding machine, or any other equipment that generates loud, electronic noises.

• Avoid static electricity at the installation location. Static electricity transferred to
the Exalogic machine can cause malfunctions. Static electricity is often generated
on carpets.

• Confirm that the supply voltage and frequency match the electrical ratings
indicated on the Exalogic machine.

• Do not insert anything into any Exalogic machine opening, unless doing so is part
of a documented procedure. The Exalogic machine contains high-voltage parts. If
a metal object or other electrically-conductive object enters an opening in the
Exalogic machine, then it could cause a short circuit. This could result in personal
injury, fire, electric shock, and equipment damage.

See Also:

• Important Safety Information for Sun Hardware Systems (816-7190) document

that is included with the rack

• All safety notices printed on the packaging and listed in Sun Rack II Safety

and Compliance Guide (820-4762), and Sun Rack II Power Distribution Units
Users Guide (820-4760)

3.2.3 Unpack the Exalogic Machine Rack

Refer to the unpacking instructions included with the packaging when unpacking the
rack from the shipping carton. After unpacking the rack, follow local laws and
guidelines to recycle the packaging properly.

Install Planning and Procedure 3-3

Prepare to Install an Exalogic Machine

Caution:

Carefully unpack the rack from the packaging and shipping pallet. Rocking or
tilting the rack can cause it to fall over and cause serious injury or death. You
should always use professional movers when unpacking and installing this
rack.

Note:

After unpacking the rack from the packaging, save the mounting brackets
used to secure the rack to the shipping pallet. You can use these mounting
brackets to secure the rack permanently to the installation site floor. Do not
dispose of these brackets, as you will not be able to order replacement
brackets.

Figure 3-1 Unpacking Exalogic Machine Rack

3.2.4 Tools for Installation

The following tools are required for installation:

• Screwdriver handle (magnetic)

• T-30 Torx wrench key

• T-25 Torx wrench key

3-4 Oracle Exalogic Elastic Cloud Machine Owner's Guide

• 6-mm hexagon Allen wrench key

• SW 12-mm single-headed wrench

• Side panel removal tool

• Keys to the front door, rear door, and side panel locks

• Cage nut mounting tool

• 32 M6 cage nuts

• 32 M6 screws

• Straight tip

3.2.5 Prepare the Installation Site

The following procedure describes how to prepare the site prior to unpacking and
situating the Exalogic machine:

1.

Thoroughly clean and vacuum the area in preparation for the installation.

2.

Note problems or peculiarities at the site that require special equipment.

Prepare to Install an Exalogic Machine

3.

Verify that the installation site flooring has a strength rating to withstand the
combined weight of the Exalogic machine and any other installed equipment.

Note:

For more information, see Environmental Requirements.

4.

Install all necessary electrical equipment and ensure that sufficient power is
provided.

See Also:

The Sun Rack II Power Distribution Units User's Guide for the Sun Rack II Power
Distribution Unit (PDU) power requirements

5.

Ensure that the installation site provides adequate air conditioning.

6.

Operate the air conditioning system for 48 hours to bring the room temperature to
the appropriate level.

3.2.6 Place the Exalogic Machine in Its Allocated Space

This section contains the following topics:

• Move the Exalogic Machine

• Stabilize the Exalogic Machine

• Attach a Ground Cable (Optional)

3.2.6.1 Move the Exalogic Machine

The following procedure describes how to move an Exalogic machine:

Install Planning and Procedure 3-5

Prepare to Install an Exalogic Machine

1. Ensure the doors are closed and secured.

2. Ensure the leveling and stabilizing feet on the rack are raised and out of the way.

3. Push the Exalogic machine from behind to the installation site.

When moving the Exalogic machine to the installation site, the front casters do not
roll; you must steer the unit by moving the rear casters. You can safely maneuver
the Exalogic machine by carefully pushing it.

It is preferred to use two people to move the rack: one person in front and one
person in back to help guide the rack. When transporting configured racks from
one location to another, take care to move them slowly, 0.65 meters per second
(2.13 feet per second) or slower.

Carefully examine the transportation path. Avoid obstacles such as doorways or
elevator thresholds that can cause abrupt stops or shocks. Go around obstacles by
using ramps or lifts to enable smooth transport.

WARNING:

• Never attempt to move the Exalogic machine by pushing on the side
panels. Pushing on the side panels can tip the rack over. This action can
cause serious personal injury or death as well as damage to the
equipment.

• Never tip or rock the Exalogic machine because the rack can fall over.

3.2.6.2 Stabilize the Exalogic Machine

After moving the Exalogic machine to the installation site, stabilize the rack to ensure
that it does not move or tip over. You can stabilize the rack permanently by extending
the rack leveling feet, using mounting brackets, or both. After installation, use feet and
the brackets to stabilize the Exalogic machine.

3.2.6.3 Stabilize the Exalogic Machine with Leveling Feet

The rack contains four leveling feet that can be lowered to stabilize the rack. The
leveling feet can be used even when the rack is permanently secured to the floor. To
adjust the leveling feet, do the following:

1. Locate the four leveling feet located at the bottom corners of the Exalogic machine.

Figure 3-2 shows the location of the leveling feet on the bottom of the Exalogic

machine.

3-6 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Prepare to Install an Exalogic Machine

Figure 3-2 Location of Leveling Feet on Exalogic Machine

• 1: Distance from the edge of the mounting feet to the side of the rack is 33.75
mm (1.33 inches)

• 2: Width from the outside edges of the leveling feet is 532.5 mm (20.96 inches)

• 3: Width from the inside edges of the leveling feet is 429 mm (16.89 inches)

• 4: Distance from the edge of the feet to the front rack surface is 73.75 m (2.90
inches)

• 5: Depth of the outside edges of the leveling feet is 1058.5 mm (41.67 inches)

• 6: Distance from the edge of the leveling feet to the rear rack surface is 32.5 mm
(1.28 inches)

• 7: Distance from the center of front casters to the side of the rack is 86.7 mm
(3.41 inches)

• 8: Width between the center of the front casters is 426.6 mm (16.80 inches)

• 9: Distance from the center of the rear casters to the rear of the rack is 173.7 mm
(6.83 inches)

• 10: Depth between the front and rear casters is 828.6 mm (32.62 inches)

• 11: Distance between the rear casters and the rear of the rack is 162.4 mm (6.39
inches)

• 12: Distance from the center of rear casters to the side of the rack is 96.4 mm
(3.80 inches)

• 13: Width between the center of the rear casters is 407.2 mm (16.03 inches)

Install Planning and Procedure 3-7

Prepare to Install an Exalogic Machine

2. Lower the leveling feet to the floor as shown in Figure 3-3 using the SW 12 mm

wrench. When lowered correctly, the four leveling feet should support the full
weight of the Exalogic machine.

Figure 3-3 Securing Exalogic Machine Using the Leveling Feet

3.2.6.4 Stabilize the Exalogic Machine with Mounting Brackets

The rack can be permanently mounted to the installation site floor using the same
mounting brackets that secured the rack to the shipping pallet. The rack is secured to
the pallet with four mounting brackets. Use the front and rear brackets to stabilize the
rack to the installation floor. Prepare the installation site by drilling four holes into the
floor. Before permanently stabilizing the Exalogic machine with the mounting
brackets, pre-drill the mounting holes. Figure 3-4 shows the location and dimensions
of the mounting brackets.

3-8 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Figure 3-4 Location of Mounting Brackets on Rack

Prepare to Install an Exalogic Machine

1.

Obtain four bolts and washers to mount the Exalogic machine to the floor. The bolt
holes in the mounting brackets have a 10.0 mm diameter. Oracle does not provide
mounting bolts because different floors require different bolt types and strengths.

2.

Position the Exalogic machine over the pre-drilled holes. Figure 3-5 shows the
bottom view of the Exalogic machine, and the location for the mounting hole and
floor cut dimensions.

Figure 3-5 Bottom View of Exalogic Machine Showing Mounting Hole and Floor
Cutout Dimensions

• 1: Distance from mounting bracket to the edge of the rack is 113 mm (4.45
inches)

Install Planning and Procedure 3-9

Prepare to Install an Exalogic Machine

• 2: Width between the centers of the mounting hole slots is 374 mm (14.72
inches)

• 3: Distance between mounting bracket to the edge of the rack is 113 mm (4.45
inches)

• 4: Distance between the centers of the front and rear mounting hole slots is
1120 mm (44.1 inches)

• 5: Depth of cable-routing floor cutout is 330 mm (13 inches)

• 6: Distance between the floor cutout and the edge of the rack is 160 mm (6.3
inches)

• 7: Width of cable-routing floor cutout is 280 mm (11 inches)

If you plan to route data or PDU power cords down through the bottom of the
rack, then you need to cut a hole in the installation floor site. Cut a rectangular hole
below the rear portion of the rack, between the two rear casters and behind the rear
RETMA (Radio Electronics Television Manufacturers Association) rails. Figure 3-6
shows the base positions of the rack from the bottom.

Figure 3-6 Base Position to Measure

Caution:

Do not create a hole where the rack casters or leveling feet brackets will be
placed.

Open the front and rear Exalogic machine doors.

3.

3-10 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Prepare to Install an Exalogic Machine

4. Install the mounting brackets to the rack as shown in Figure 3-7 using a 6 mm

hexagon Allen wrench key.

Figure 3-7 Securing Exalogic Machine Using Mounting Brackets

5. Using bolts and washers that are appropriate for your installation site, permanently

mount your system to the floor using the four mounting brackets as shown in

Figure 3-7.

Note:

The bolts required for securing the Exalogic machine to the floor vary
depending on the installation location. Select bolts that are appropriate for
your location.

6. Firmly tighten all of the bolts that secure the mounting brackets to the Exalogic

machine and to the floor.

3.2.6.5 Attach a Ground Cable (Optional)

The Exalogic machine power distribution units (PDUs) achieve earth ground through
their power cords. Final chassis ground is achieved by way of the ground prong when
you connect the power cord to a socket. For additional grounding, attach a chassis
earth ground cable to the Exalogic machine. The additional ground point enables
electrical current leakage to dissipate more efficiently.

WARNING:

The PDU power input lead cords and the ground cable must reference a
common earth ground. If they do not, then a difference in ground potential
can be introduced. If you are unsure of your facility's PDU receptacle
grounding, then do not install a ground cable until you confirm that there is a
proper PDU receptacle grounding. If a difference in ground potential is
apparent, then you must take corrective action.

Install Planning and Procedure 3-11

Power on the System the First Time

Note:

A grounding cable is not shipped with the system.

1. Ensure the installation site has properly grounded the power source in the data

center. The facility PDU must have earth ground.

2. Ensure all grounding points, such as raised floors and power receptacles, reference

the facility ground.

3. During manufacturing, the ground cable attachment area might be a painted or

coated surface. Ensure that direct, metal-to-metal contact is made for this
installation.

4.

Attach the ground cable to one of the attachment points located at the bottom rear
of the system frame as shown in Figure 3-8. The attachment point is an adjustable
bolt that is inside the rear of the Exalogic machine cabinet on the right side.

Figure 3-8 Earth Ground Attachment Bolt Location

3.3 Power on the System the First Time

Before powering on the system for the first time, it is necessary to inspect the machine,
and connect the power cords. This section contains the following topics:

• Inspect the Machine After It Is in Place

• Connect the Power Cords

• Power On the Exalogic Machine

3.3.1 Inspect the Machine After It Is in Place

The following procedure describes how to visually examine the Exalogic machine
physical system after it is in place, but before power is supplied:

Check the rack for damage.

1.

3-12 Oracle Exalogic Elastic Cloud Machine Owner's Guide

2. Check the rack for loose or missing screws.

3. Check your Exalogic machine for the ordered configuration. Refer to the

Customer Information Sheet (CIS) on the side of the packaging.

4. Check that all cable connections are secure and firmly in place as follows:
a. Check the power cables. Ensure that the correct connectors have been

supplied for the data center facility power source.

b. Check the network data cables.

5.

Check the site location tile arrangement for cable access and airflow.

6.

Check the data center airflow that leads in to the front of the Exalogic machine.

See Also:

Ventilation and Cooling Requirementsfor more information

3.3.2 Connect the Power Cords

Power on the System the First Time

The following procedure describes how to connect power cords to the Exalogic
machine:

1. Open the rear cabinet door.

2. Ensure that the correct power connectors have been supplied.

3. Unfasten the power cord cable ties. The ties are for shipping only and are no longer

needed.

4. Route the power cords to the facility receptacles either above the rack or below the

flooring, as shown in Figure 3-9 and Figure 3-10.

5. Secure the power cords in bundles, as shown in Figure 3-9.

6. Plug the PDU power cord connectors into the facility receptacles.

Install Planning and Procedure 3-13

Power on the System the First Time

Figure 3-9 Power Cord Routing from the Bottom of the Rack

Figure 3-10 Power Cord Routing Example from the Top of the Rack

3.3.3 Power On the Exalogic Machine

The following procedure describes how to power on the Exalogic machine:

1. Ensure that each of the three main power cords is connected.

2. Switch on the six power distribution unit (PDU) circuit breakers located on the rear

of the main PDU (PDU A) inside the Exalogic machine. The circuit breakers are on
the rear of the Exalogic machine cabinet as shown in Figure 3-11. Press the ON (|)
side of the toggle switch.

Note:

The 24 kVA PDU has 4 plugs, and the 15 kVA PDU has 2 plugs. In either case,
you can use the instructions described in this section to power on your
Exalogic machine.

3-14 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Figure 3-11 PDU Switch Locations

Power on the System the First Time

3. Wait 3 to 5 minutes for all Oracle Integrated Lights Out Manager (ILOM) service

processors to boot.

4. Open the front cabinet door.

5. Verify that server standby power is on for compute nodes, InfiniBand gateway

switches, and storage appliance in the Exalogic machine.

When power is delivered to the receptacles at the rear of the server chassis, standby
power is made available by the power supplies. When standby power is
distributed to the chassis, the service processor (SP) powers on and starts up to
manage the system. The main power is supplied for the remainder of the chassis
and fans when the power button on the front of the server chassis is pressed. The
power button is disabled while the SP is starting. The start-up state is indicated by
a steady one second on, one second off blinking pattern of the Power/OK LED on
the front of the system. After the SP has started, the power button is enabled and
the system is placed in standby power mode.

In standby power mode, the Power/OK LED on the front panel blinks green in a

0.1 second on, 2.9 seconds off pattern, as shown in Figure 3-12.

Install Planning and Procedure 3-15

Power on the System the First Time

Figure 3-12 Exalogic Compute Node LED Lights

6.

Verify that the main power is on for each compute node.

In main power mode, the Power/OK LED on the front panel blinks in a one second
on, one second off pattern while the system BIOS starts. After BIOS initialization
completes and the operating system begins to start, the Power/OK LED illuminates
and remains a steady green.

7.

Press the soft switches located on the front of the two storage heads in the storage
appliance, as shown in Figure 3-13. In addition, see Figure 3-14.

Figure 3-13 Soft Switches on the Server Heads in the Sun ZFS Storage 7320
appliance

Figure 3-14 shows the soft switch and LED lights on each of the server heads in the

storage appliance.

3-16 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Power on the System the First Time

Figure 3-14 Soft Switch and LED Lights on Server Heads

8.

Wait 3-5 minutes for the storage appliance to initiate NFS services, daemons, and
basic services.

Tip:

You can ping the IP address assigned to the storage appliance to verify
whether the system is up and running. For the default NET0 IP addresses, see

Default IP Addresses and Ports.

Alternatively, you can try to launch the administration console for the storage
appliance. Before you can ping the IP address or launch the administration
console, you must connect a laptop to the rack, as described in Connect a

Laptop to the Exalogic Machine.

9. After making sure that the storage appliance is up and running, press the soft

switches located on the front of the compute nodes in your Exalogic machine, as
shown in Figure 3-13. After power-on, the LED indicators turn green, as shown in

Figure 3-14.

Note:

If you are using an Exalogic machine full rack, you must switch on thirty
compute nodes. If you are using an Exalogic machine half rack, you must
switch on sixteen compute nodes. If you are using an Exalogic machine
quarter rack, you must switch on eight compute nodes.

10.Verify that power is applied to the Cisco Ethernet switch.

Note:

The Ethernet switch is inside a vented filler panel in Unit 25 of the rack.

Verify that power is applied to the Sun Network QDR InfiniBand Gateway

11.

Switches.

Install Planning and Procedure 3-17

Connect a Laptop to the Exalogic Machine

Note:

The gateway switches are inside vented filler panels. If you are using an
Exalogic machine full rack, verify that power is supplied to the four gateway
switches included in the Exalogic machine. If you are using an Exalogic
machine half rack, verify that power is supplied to the two gateway switches
included in the Exalogic machine. If you are using an Exalogic machine
quarter rack, verify that power is supplied to the two gateway switches
included in the Exalogic machine.

12.

Optional: Verify that power is supplied to the Sun Datacenter InfiniBand Switch 36.

Note:

The Sun Datacenter InfiniBand Switch 36 is inside a vented filler panel in
Exalogic machine full rack and Exalogic machine half rack. This switch is not
included in Exalogic machine quarter rack. This spine switch is used in
multirack configuration scenarios (an Exalogic machine to another Exalogic
machine, and an Exalogic machine to an Oracle Exadata Database Machine)
only.

3.4 Connect a Laptop to the Exalogic Machine

You can connect a laptop to the Exalogic machine as follows:

1. Ensure that you have a laptop with functional USB and network ports.

2. Ensure that you have a Category 5E patch cable of maximum length 25 feet and a

serial cable of maximum length 15 feet.

3. Open the rear cabinet door of the rack.

4. Connect the network port of your laptop into an unused input port in the Cisco

Ethernet switch. This switch is inside a vented filler panel in Unit 25 of your
Exalogic machine rack. Note that you should not connect to any of the
management or console ports on the switch. The ports are labeled on the switch.

Note:

If you require serial connectivity, you can use a USB-to-Serial adapter to
connect from the USB port of your laptop to the Cisco switch.

A USB-to-Serial adapter is installed in the rack on all of the gateway switches
(Sun Network QDR InfiniBand Gateway Switches).

An extra adapter is included in the shipping kit in the Exalogic machine full
rack and half rack configurations.

If you have not booted the operating system on your laptop, start the operating

5.

system now.

• If you are using the Windows operating system on your laptop, do the
following:

3-18 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Connect a Laptop to the Exalogic Machine

a. Go to Control Panel > Network Connections. Select your wired network

adapter in the list of network connections, right-click and select
Properties. The network properties screen is displayed.

b. Click the General tab, and select Internet Protocol (TCP/IP). Click

Properties. The Internet Protocol (TCP/IP) Properties screen is displayed.

c. Select the Use the following IP address: option, and enter a static IP

address for your laptop. Although a default gateway is not necessary,
enter the same IP address in the Default Gateway field. Click OK to exit
the network connections screen.

Note:

This static IP should be on the same subnet and address range as the network
on which the Cisco Ethernet switch resides. You can use the default NET0 IP
addresses of compute nodes assigned at the time of manufacturing or the
custom IP address that you reconfigured using the Oracle Exalogic
Configuration Utility. For the list of default NET0 IP addresses, see

Default IP Addresses and Ports.

• If you are using a Linux operating system on your laptop, do the following:

a. Log in as a root user.
b. At the command prompt, enter the following command to display the

network devices, such as ETH0, attached to the Exalogic machine:
# ifconfig -a

The list of network devices or adapters attached to the Exalogic machine
is displayed.

c. To set up the desired network interface, run the ifconfig command at

the command prompt, as in the following example:

# ifconfig eth0 192.168.1.150 netmask 255.255.255.0 up
In this example, the ifconfig command assigns the IPv4 address

192.168.1.150, with a network mask of 255.255.255.0, to the eth0

interface.

6. For laptop connectivity, open any telnet or ssh client program, such as PuTTY.

Connect to one of the service processor IP addresses or to the IP address of a
compute node, which is up and running.

Install Planning and Procedure 3-19

What Next?

3.5 What Next?

After powering on the Exalogic machine, including compute nodes and storage
appliance, proceed to configure the Exalogic machine.

Note:

After you cable your laptop to the Cisco Ethernet switch, you can use the
NET0 IP addresses of Exalogic machine components to communicate with
them. For a list of default IP addresses assigned at the time of manufacturing,
see Default IP Addresses and Ports.

If you have not run the Oracle Exalogic Configuration Utility set of
tools and scripts to reconfigure IP addresses for the Exalogic machine, you can
use a set of default IP addresses. If you have already run the Oracle Exalogic
Configuration Utility set of tools and scripts, you can use the network
IP address that you provided as input to the Exalogic Configurator spreadsheet.
For more information about Oracle Exalogic Configuration Utility,
see Configure the Exalogic Machine Using ECU.

Note:

For information about changing passwords of Exalogic machine components,
see MOS document 1594316.1 at:

https://support.oracle.com/epmos/faces/DocumentDisplay?
id=1594316.1

3-20 Oracle Exalogic Elastic Cloud Machine Owner's Guide

4

Default IP Addresses and Ports

This chapter lists the default ILOM, NET0, InfiniBand Bonded IP addresses, and ports
assigned to Exalogic machine components during manufacturing.

This chapter contains the following sections:

• Exalogic Machine Full Rack

• Exalogic Machine Half Rack

• Exalogic Machine Quarter Rack

• Exalogic Machine Eighth Rack

• Default Port Assignments

Tip:

For more information about how these interfaces are used, see Figure 6-1.

4.1 Exalogic Machine Full Rack

Table 4-1 lists the default ILOM, NET0, and InfiniBand Bonded IP addresses assigned

during manufacturing to Exalogic compute nodes and other hardware components in
an Exalogic machine Full Rack.

Table 4-1 Default ILOM, NET0, and IB Bonded IP for Exalogic Full Rack

Unit Component (Front View) ILOM IP

42 Compute Node 192.168.1.132 192.168.1.32 192.168.10.32

41 Compute Node 192.168.1.131 192.168.1.31 192.168.10.31

40 Compute Node 192.168.1.130 192.168.1.30 192.168.10.30

39 Compute Node 192.168.1.129 192.168.1.29 192.168.10.29

38 Compute Node 192.168.1.128 192.168.1.28 192.168.10.28

37 Compute Node 192.168.1.127 192.168.1.27 192.168.10.27

36 Compute Node 192.168.1.126 192.168.1.26 192.168.10.26

35 Compute Node 192.168.1.125 192.168.1.25 192.168.10.25

34 Compute Node 192.168.1.124 192.168.1.24 192.168.10.24

Address

NET0 IP
Address

IB Bonded IP
Address

33 Compute Node 192.168.1.123 192.168.1.23 192.168.10.23

Default IP Addresses and Ports 4-1

Exalogic Machine Full Rack

Table 4-1 (Cont.) Default ILOM, NET0, and IB Bonded IP for Exalogic Full Rack

Unit Component (Front View) ILOM IP

Address

32 Compute Node 192.168.1.122 192.168.1.22 192.168.10.22

31 Compute Node 192.168.1.121 192.168.1.21 192.168.10.21

30 Compute Node 192.168.1.120 192.168.1.20 192.168.10.20

29 Compute Node 192.168.1.119 192.168.1.19 192.168.10.19

28 Compute Node 192.168.1.118 192.168.1.18 192.168.10.18

27 Compute Node 192.168.1.117 192.168.1.17 192.168.10.17

26 Sun Network QDR InfiniBand

Gateway Switch

25 Cisco Management Switch Not

24 Sun Network QDR InfiniBand

Gateway Switch

23 Sun Network QDR InfiniBand

Gateway Switch

22 Server head for the storage appliance 192.168.1.116 192.168.1.16 192.168.10.16

192.168.1.204 Not

applicable

192.168.1.203 Not

192.168.1.202 Not

NET0 IP
Address

applicable

192.168.1.200 Not

applicable

applicable

IB Bonded IP
Address

Not
applicable

applicable

Not
applicable

Not
applicable

21 Server head for the storage appliance 192.168.1.115 192.168.1.15 192.168.10.15

20 Disk storage tray for the storage

appliance

19

18

17

16 Sun Network QDR InfiniBand

Gateway Switch

15 Compute Node 192.168.1.114 192.168.1.14 192.168.10.14

14 Compute Node 192.168.1.113 192.168.1.13 192.168.10.13

13 Compute Node 192.168.1.112 192.168.1.12 192.168.10.12

12 Compute Node 192.168.1.111 192.168.1.11 192.168.10.11

11 Compute Node 192.168.1.110 192.168.1.10 192.168.10.10

10 Compute Node 192.168.1.109 192.168.1.9 192.168.10.9

9 Compute Node 192.168.1.108 192.168.1.8 192.168.10.8

8 Compute Node 192.168.1.107 192.168.1.7 192.168.10.7

Not
applicable

192.168.1.201 Not

Not
applicable

applicable

Not
applicable

Not
applicable

7 Compute Node 192.168.1.106 192.168.1.6 192.168.10.6

4-2 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Exalogic Machine Full Rack

Table 4-1 (Cont.) Default ILOM, NET0, and IB Bonded IP for Exalogic Full Rack

Unit Component (Front View) ILOM IP

Address

6 Compute Node 192.168.1.105 192.168.1.5 192.168.10.5

5 Compute Node 192.168.1.104 192.168.1.4 192.168.10.4

4 Compute Node 192.168.1.103 192.168.1.3 192.168.10.3

3 Compute Node 192.168.1.102 192.168.1.2 192.168.10.2

2 Compute Node 192.168.1.101 192.168.1.1 192.168.10.1

1 Sun Datacenter InfiniBand Switch 36 192.168.1.205 Not

-

PDU-A (left from rear view) 192.168.1.210 Not

-

PDU-B (right from rear view) 192.168.1.211 Not

Note:

NET0 IP
Address

applicable

applicable

applicable

IB Bonded IP
Address

Not
applicable

Not
applicable

Not
applicable

The following table shows the hardware that is included in different Exalogic
versions.

Ex

Compute

alo

Node’s

gic

Server
Ra
ck

X6–2Oracle

Server
X6-2

X5–2Oracle

Server
X5-2

X4–2Sun

Server
X4-2

X3–2Sun

Server
X3-2

X2–2Sun Fire

X4170
M2

Cisco
Management
Switch

Cisco 4948E Oracle ZS5-ES

Cisco 4948E Oracle ZS3-ES

Cisco 4948E­F-S

Cisco 4948E­F-S

Cisco 4948 Sun ZFS 7320

Storage Appliance

Oracle ZS3-ES

Sun ZFS 7320

Default IP Addresses and Ports 4-3

Exalogic Machine Half Rack

4.2 Exalogic Machine Half Rack

Table 4-2 lists the default ILOM, NET0, and InfiniBand Bonded IP addresses assigned

during manufacturing to Exalogic compute nodes and other hardware components in
an Exalogic machine half rack.

Table 4-2 Default ILOM, NET0, and IB Bonded IP for Exalogic Half Rack

Unit Rack Component (Front View) ILOM IP

Address

42 4U Solid Filler Not

applicable

41 Not

applicable

40 Not

applicable

39 Not

applicable

38 4U Solid Filler Not

applicable

37 Not

applicable

36 Not

applicable

35 Not

applicable

34 4U Solid Filler Not

applicable

NET0 IP
Address

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

IB Bonded IP
Address

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

33 Not

32 Not

31 Not

30 2U Solid Filler Not

29 Not

28 Compute Node 192.168.1.118 192.168.1.18 192.168.10.18

27 Compute Node 192.168.1.117 192.168.1.17 192.168.10.17

26 1U Solid Filler Not

4-4 Oracle Exalogic Elastic Cloud Machine Owner's Guide

applicable

applicable

applicable

applicable

applicable

applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Exalogic Machine Half Rack

Table 4-2 (Cont.) Default ILOM, NET0, and IB Bonded IP for Exalogic Half Rack

Unit Rack Component (Front View) ILOM IP

Address

25 Cisco Management Switch Not

applicable

24 1U Solid Filler Not

applicable

23 Sun Network QDR InfiniBand

Gateway Switch

22 Server head for the storage appliance 192.168.1.116 192.168.1.16 192.168.10.16

21 Server head for the storage appliance 192.168.1.115 192.168.1.15 192.168.10.15

20 Disk storage tray for the storage

appliance

19

18

17

16 Sun Network QDR InfiniBand

Gateway Switch

15 Compute Node 192.168.1.114 192.168.1.14 192.168.10.14

192.168.1.202 Not

Not
applicable

192.168.1.201 Not

NET0 IP
Address

192.168.1.200 Not

Not
applicable

applicable

Not
applicable

applicable

IB Bonded IP
Address

applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

14 Compute Node 192.168.1.113 192.168.1.13 192.168.10.13

13 Compute Node 192.168.1.112 192.168.1.12 192.168.10.12

12 Compute Node 192.168.1.111 192.168.1.11 192.168.10.11

11 Compute Node 192.168.1.110 192.168.1.10 192.168.10.10

10 Compute Node 192.168.1.109 192.168.1.9 192.168.10.9

9 Compute Node 192.168.1.108 192.168.1.8 192.168.10.8

8 Compute Node 192.168.1.107 192.168.1.7 192.168.10.7

7 Compute Node 192.168.1.106 192.168.1.6 192.168.10.6

6 Compute Node 192.168.1.105 192.168.1.5 192.168.10.5

5 Compute Node 192.168.1.104 192.168.1.4 192.168.10.4

4 Compute Node 192.168.1.103 192.168.1.3 192.168.10.3

3 Compute Node 192.168.1.102 192.168.1.2 192.168.10.2

2 Compute Node 192.168.1.101 192.168.1.1 192.168.10.1

1 Sun Datacenter InfiniBand Switch 36 192.168.1.205 Not

applicable

Not
applicable

Default IP Addresses and Ports 4-5

Exalogic Machine Quarter Rack

Table 4-2 (Cont.) Default ILOM, NET0, and IB Bonded IP for Exalogic Half Rack

Unit Rack Component (Front View) ILOM IP

Address

-

PDU-A (left from rear view) 192.168.1.210 Not

-

PDU-B (right from rear view) 192.168.1.211 Not

Note:

The following table shows the hardware that is included in different Exalogic
versions.

Ex

Compute

alo

Node’s

gic

Server
Ra
ck

X6–2Oracle

Server
X6-2

X5–2Oracle

Server
X5-2

Cisco
Management
Switch

Cisco 4948E Oracle ZS5-ES

Cisco 4948E Oracle ZS3-ES

Storage Appliance

NET0 IP
Address

applicable

applicable

IB Bonded IP
Address

Not
applicable

Not
applicable

X4–2Sun

Server
X4-2

X3–2Sun

Server
X3-2

X2–2Sun Fire

X4170
M2

Cisco 4948E­F-S

Cisco 4948E­F-S

Cisco 4948 Sun ZFS 7320

4.3 Exalogic Machine Quarter Rack

Table 4-3 lists the default ILOM, NET0, and InfiniBand Bonded IP addresses assigned

during manufacturing to Exalogic compute nodes and other hardware components in
an Exalogic machine quarter rack.

Oracle ZS3-ES

Sun ZFS 7320

4-6 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Exalogic Machine Quarter Rack

Table 4-3 Default ILOM, NET0, and IB Bonded IP for Exalogic Quarter Rack

Unit Rack Component (Front View) ILOM IP

Address

42 4U Solid Filler Not

applicable

41 Not

applicable

40 Not

applicable

39 Not

applicable

38 4U Solid Filler Not

applicable

37 Not

applicable

36 Not

applicable

35 Not

applicable

NET0 IP
Address

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

InfiniBand
Bonded IP
Address

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

34 4U Solid Filler Not

applicable

33 Not

applicable

32 Not

applicable

31 Not

applicable

30 2U Solid Filler Not

applicable

29 Not

applicable

28 2U Solid Filler Not

applicable

27 Not

applicable

26 1U Solid Filler Not

applicable

25 Cisco Management Switch Not

applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

192.168.1.200 Not

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

applicable

Default IP Addresses and Ports 4-7

Exalogic Machine Quarter Rack

Table 4-3 (Cont.) Default ILOM, NET0, and IB Bonded IP for Exalogic Quarter Rack

Unit Rack Component (Front View) ILOM IP

Address

24 1U Solid Filler Not

applicable

23 Sun Network QDR InfiniBand

Gateway Switch

22 Server head for the storage

appliance

21 Server head for the storage

appliance

20 Disk storage tray for the storage

appliance

19

18

17

16 Sun Network QDR InfiniBand

Gateway Switch

15 2U Solid Filler Not

192.168.1.202 Not

192.168.1.116 192.168.1.16 192.168.10.16

192.168.1.115 192.168.1.15 192.168.10.15

Not
applicable

192.168.1.201 Not

applicable

NET0 IP
Address

Not
applicable

applicable

Not
applicable

applicable

Not
applicable

InfiniBand
Bonded IP
Address

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

14 Not

applicable

13 4U Solid Filler Not

applicable

12 Not

applicable

11 Not

applicable

10 Not

applicable

9 Compute Node 192.168.1.108 192.168.1.8 192.168.10.8

8 Compute Node 192.168.1.107 192.168.1.7 192.168.10.7

7 Compute Node 192.168.1.106 192.168.1.6 192.168.10.6

6 Compute Node 192.168.1.105 192.168.1.5 192.168.10.5

5 Compute Node 192.168.1.104 192.168.1.4 192.168.10.4

4 Compute Node 192.168.1.103 192.168.1.3 192.168.10.3

3 Compute Node 192.168.1.102 192.168.1.2 192.168.10.2

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

4-8 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Exalogic Machine Eighth Rack

Table 4-3 (Cont.) Default ILOM, NET0, and IB Bonded IP for Exalogic Quarter Rack

Unit Rack Component (Front View) ILOM IP

Address

2 Compute Node 192.168.1.101 192.168.1.1 192.168.10.1

1 1U Solid Filler Not

applicable

-

-

PDU-A (left from rear view) 192.168.1.210 Not

PDU-B (right from rear view) 192.168.1.211 Not

Note:

NET0 IP
Address

Not
applicable

applicable

applicable

InfiniBand
Bonded IP
Address

Not
applicable

Not
applicable

Not
applicable

The following table shows the hardware that is included in different Exalogic
versions.

Ex
alo
gic
Ra
ck

Compute
Node’s
Server

Cisco
Management
Switch

Storage Appliance

X6–2Oracle

Server
X6-2

X5–2Oracle

Server
X5-2

X4–2Sun

Server
X4-2

X3–2Sun

Server
X3-2

X2–2Sun Fire

X4170
M2

Cisco 4948E Oracle ZS5-ES

Cisco 4948E Oracle ZS3-ES

Cisco 4948E­F-S

Cisco 4948E­F-S

Cisco 4948 Sun ZFS 7320

4.4 Exalogic Machine Eighth Rack

Table 4-4 lists the default ILOM, NET0, and InfiniBand Bonded IP addresses assigned

during manufacturing to Exalogic compute nodes and other hardware components in
an Exalogic machine eighth rack.

Oracle ZS3-ES

Sun ZFS 7320

Default IP Addresses and Ports 4-9

Exalogic Machine Eighth Rack

Table 4-4 Default ILOM, NET0, and IB Bonded IP for Exalogic Eighth Rack

Unit Rack Component (Front View) ILOM IP

Address

42 4U Solid Filler Not

applicable

41 Not

applicable

40 Not

applicable

39 Not

applicable

38 4U Solid Filler Not

applicable

37 Not

applicable

36 Not

applicable

35 Not

applicable

NET0 IP
Address

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

InfiniBand
Bonded IP
Address

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

34 4U Solid Filler Not

applicable

33 Not

applicable

32 Not

applicable

31 Not

applicable

30 2U Solid Filler Not

applicable

29 Not

applicable

28 2U Solid Filler Not

applicable

27 Not

applicable

26 1U Solid Filler Not

applicable

25 Cisco Management Switch Not

applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

192.168.1.200 Not

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

applicable

4-10 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Exalogic Machine Eighth Rack

Table 4-4 (Cont.) Default ILOM, NET0, and IB Bonded IP for Exalogic Eighth Rack

Unit Rack Component (Front View) ILOM IP

Address

24 1U Solid Filler Not

applicable

23 Sun Network QDR InfiniBand

Gateway Switch

22 Server head for the storage appliance 192.168.1.116 192.168.1.16 192.168.10.16

21 Server head for the storage appliance 192.168.1.115 192.168.1.15 192.168.10.15

20 Disk storage tray for storage

appliance

19

18

17

16 Sun Network QDR InfiniBand

Gateway Switch

15 2U Solid Filler Not

192.168.1.202 Not

Not
applicable

192.168.1.201 Not

applicable

NET0 IP
Address

Not
applicable

applicable

Not
applicable

applicable

Not
applicable

InfiniBand
Bonded IP
Address

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

14 Not

applicable

13 4U Solid Filler Not

applicable

12 Not

applicable

11 Not

applicable

10 Not

applicable

9 4U Solid Filler Not

applicable

8 Not

applicable

7 Not

applicable

6 Not

applicable

5 Compute Node 192.168.1.104 192.168.1.4 192.168.10.4

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

Not
applicable

4 Compute Node 192.168.1.103 192.168.1.3 192.168.10.3

Default IP Addresses and Ports 4-11

Default Port Assignments

Table 4-4 (Cont.) Default ILOM, NET0, and IB Bonded IP for Exalogic Eighth Rack

Unit Rack Component (Front View) ILOM IP

Address

3 Compute Node 192.168.1.102 192.168.1.2 192.168.10.2

2 Compute Node 192.168.1.101 192.168.1.1 192.168.10.1

1 1U Solid Filler Not

applicable

-

PDU-A (left from rear view) 192.168.1.210 Not

-

PDU-B (right from rear view) 192.168.1.211 Not

Note:

NET0 IP
Address

Not
applicable

applicable

applicable

InfiniBand
Bonded IP
Address

Not
applicable

Not
applicable

Not
applicable

The following table shows the hardware that is included in different Exalogic
versions.

Ex
alo
gic
Ra
ck

Compute

Node’s

Server

Cisco
Management
Switch

Storage Appliance

X6–2Oracle

Server
X6-2

X5–2Oracle

Server
X5-2

X4–2Sun

Server
X4-2

X3–2Sun

Server
X3-2

X2–2Sun Fire

X4170
M2

4.5 Default Port Assignments

Table 4-5 lists the default ports assigned to Exalogic compute nodes and other

hardware components in an Exalogic machine.

Cisco 4948E Oracle ZS5-ES

Cisco 4948E Oracle ZS3-ES

Cisco 4948E­F-S

Cisco 4948E­F-S

Cisco 4948 Sun ZFS 7320

Oracle ZS3-ES

Sun ZFS 7320

4-12 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Default Port Assignments

Table 4-5 Default Ports

Source Target Protocol Port Application

Any Compute nodes,

storage appliance
heads, and
InfiniBand ILOMs

Any Compute nodes,

storage appliance
heads, and
InfiniBand ILOMs

Any Compute nodes,

storage appliance
heads, and
InfiniBand ILOMs

Any Compute nodes,

storage appliance
heads, and
InfiniBand ILOMs

Any Compute nodes,

storage appliance
heads, and
InfiniBand ILOMs

SSH over TCP 22 SSH

HTTP over TCP 80 Web (user

configurable)

SNMP over UDP 161 SNMP (Simple

Network
Management
Protocol) (user
configurable)

LDAP over
UDP/TCP

HTTPS over TCP 443 Web (user

389 Outgoing LDAP

(Lightweight
Directory Access
Protocol) (user
configurable)

configurable)

Any Compute nodes,

storage appliance
heads, and
InfiniBand ILOMs

Any Compute nodes,

and storage
appliance heads
ILOMs

Any Compute nodes,

and storage
appliance heads
ILOMs

Any Compute nodes,

and storage
appliance heads
ILOMs

Any Compute nodes,

and storage
appliance heads
ILOMs

Any Compute nodes,

and storage
appliance heads
ILOMs

IPMI over UDP 623 IPMI (Intelligent

Platform
Management
Interface)

TCP 5120 ILOM remote

console: CD

TCP 5121 ILOM remote

console: keyboard
and mouse

TCP 5123 ILOM remote

console: diskette

TCP 5555 ILOM remote

console: encryption

TCP 6481 ILOM remote

console: Servicetag
daemon

Default IP Addresses and Ports 4-13

Default Port Assignments

Table 4-5 (Cont.) Default Ports

Source Target Protocol Port Application

Any Compute nodes,

and storage
appliance heads
ILOMs

Any Compute nodes,

and storage
appliance heads
ILOMs

Any Compute nodes,

and storage
appliance heads
ILOMs

ASR Manager Compute nodes,

and storage
appliance heads
ILOMs

Compute nodes,
storage appliance
heads, and
InfiniBand ILOMs

Compute nodes,
storage appliance
heads, and
InfiniBand ILOMs

Any TFTP over UDP 69 Outgoing TFTP

Any NTP over UDP 123 Outgoing NTP

TCP 5556 ILOM remote

console:
authentication

TCP 7578 ILOM remote

console: video

TCP 7579 ILOM remote

console: serial

HTTP 6481 Service tags

listener for asset
activation

(Trivial File
Transfer Protocol)

Compute nodes,
storage appliance
heads, and
InfiniBand ILOMs

Compute nodes,
storage appliance
heads, and
InfiniBand ILOMs

Compute nodes,
storage appliance
heads, and
InfiniBand ILOMs

Compute nodes,
storage appliance
heads, and
InfiniBand ILOMs

Any IPMI over UDP 162 Outgoing IPMI

(Intelligent
Platform
Management
Interface) Platform
Event Trap (PET)

Any Syslog over UDP 514 Outgoing Syslog

Any DHCP over UDP 546 Client DHCP

(Dynamic Host
Configuration
Protocol)

Any RADIUS over UDP 1812 Outgoing RADIUS

(Remote
Authentication
Dial In User
Service) (user
configurable)

4-14 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Default Port Assignments

Table 4-5 (Cont.) Default Ports

Source Target Protocol Port Application

Compute nodes, and
storage appliance
heads ILOMs

Any Storage appliance HTTP over TCP 215 Browser interface

Storage
management

Any PDU HTTP over TCP 80 Browser interface

Any PDU SNMP over UDP 161 SNMP (user

Any PDU HTTPS over TCP 443 Browser interface

PDU Any SNMP over UDP 162 Outgoing SNMPv2

PDU Any Syslog over UDP 514 Outgoing Syslog

PDU Any DHCP over UDP 546 DHCP (Dynamic

ASR Manager SNMP 162 Telemetry

messages sent to
ASR Manager

Any NTP over UDP 123 Outgoing NTP

configurable)

traps

Host
Configuration
Protocol) client

Default IP Addresses and Ports 4-15

Default Port Assignments

4-16 Machine Owner's Guide

Add the Exalogic Machine to Your Network

This chapter discusses the factory configuration and initial network configuration for
the Exalogic machine.

This chapter contains the following topics:

• Default State of the Exalogic Machine Network Configuration

• Verify the Factory Configuration

• Prerequisites for Connecting Exalogic Machine to External Ethernet Network

• Initial Network Configuration of Exalogic Machine

5.1 Default State of the Exalogic Machine Network Configuration

At the time of manufacturing in the factory, an Exalogic machine has the following
network topology:

5

• Compute nodes configured with NET0, ILOM, and BOND0 interfaces

Note:

Exalogic compute nodes are not pre-configured with the BOND1 interface for
the Ethernet over InfiniBand (EoIB) connectivity. You can configure BOND1 for
compute notes during the initial configuration of the Exalogic machine.

• Storage heads configured with NET0, ILOM, and BOND0 interfaces

• Sun Network QDR InfiniBand Gateway Switches, referred to as leaf switches,

configured with the ILOM interface

• Sun Datacenter InfiniBand Switch 36, referred to as the spine switch, not
configured

Note:

This switch is used in multirack configuration scenarios only.

• Cisco Ethernet Management Switch, which is not configured

5.2 Verify the Factory Configuration

You can verify the factory configuration of your Exalogic machine by viewing
the /etc/exalogic.conf file on the compute nodes.

Add the Exalogic Machine to Your Network

5-1

Verify the Factory Configuration

The file provides default configuration information, such as the following:

RACK_TYPE=3
NODE_INDEX=19
RACK_NAME=el01
CNODE_PREFIX=cn
SNODE_PREFIX=sn
DNS_SERVER_LIST=
DOMAIN_SEARCH_ORDER=
DOMAIN_NAME=abc.example.com
eth0_BOOTPROTO=static
eth0_NETMASK=255.255.252.0
eth0_GATEWAY=10.11.12.13
bond0_NETMASK=255.255.255.0
has_bond1=0
SPNET0_NETMASK=
SPNET0_GATEWAY=
cnode1_host_name=el01cn01
cnode1_private_host_name=el01cn01-priv
cnode1_eth0_IPADDR=192.168.1.1
cnode1_bond0_IPADDR=192.168.10.1
cnode1_SPNET0_IPADDR=192.168.1.101
cnode2_host_name=el01cn02
cnode2_private_host_name=el01cn02-priv
cnode2_eth0_IPADDR=192.168.1.2
cnode2_bond0_IPADDR=192.168.10.2
cnode2_SPNET0_IPADDR=192.168.1.102
cnode3_host_name=el01cn03
cnode3_private_host_name=el01cn03-priv
cnode3_eth0_IPADDR=192.168.1.3
cnode3_bond0_IPADDR=192.168.10.3
cnode3_SPNET0_IPADDR=192.168.1.103
cnode4_host_name=el01cn04
cnode4_private_host_name=el01cn04-priv
cnode4_eth0_IPADDR=192.168.1.4
cnode4_bond0_IPADDR=192.168.10.4
cnode4_SPNET0_IPADDR=192.168.1.104
cnode5_host_name=el01cn05
cnode5_private_host_name=el01cn05-priv
cnode5_eth0_IPADDR=192.168.1.5
cnode5_bond0_IPADDR=192.168.10.5
cnode5_SPNET0_IPADDR=192.168.1.105
cnode6_host_name=el01cn06
cnode6_private_host_name=el01cn06-priv
cnode6_eth0_IPADDR=192.168.1.6
cnode6_bond0_IPADDR=192.168.10.6
cnode6_SPNET0_IPADDR=192.168.1.106
cnode7_host_name=el01cn07
cnode7_private_host_name=el01cn07-priv
cnode7_eth0_IPADDR=192.168.1.7
cnode7_bond0_IPADDR=192.168.10.7
cnode7_SPNET0_IPADDR=192.168.1.107
cnode8_host_name=el01cn08
cnode8_private_host_name=el01cn08-priv
cnode8_eth0_IPADDR=192.168.1.8
cnode8_bond0_IPADDR=192.168.10.8
cnode8_SPNET0_IPADDR=192.168.1.108
cnode9_host_name=el01cn09
cnode9_private_host_name=el01cn09-priv
cnode9_eth0_IPADDR=192.168.1.9
cnode9_bond0_IPADDR=192.168.10.9

5-2 Oracle Exalogic Elastic Cloud Machine Owner's Guide

cnode9_SPNET0_IPADDR=192.168.1.109
cnode10_host_name=el01cn10
cnode10_private_host_name=el01cn10-priv
cnode10_eth0_IPADDR=192.168.1.10
cnode10_bond0_IPADDR=192.168.10.10
cnode10_SPNET0_IPADDR=192.168.1.110
cnode11_host_name=el01cn11
cnode11_private_host_name=el01cn11-priv
cnode11_eth0_IPADDR=192.168.1.11
cnode11_bond0_IPADDR=192.168.10.11
cnode11_SPNET0_IPADDR=192.168.1.111
cnode12_host_name=el01cn12
cnode12_private_host_name=el01cn12-priv
cnode12_eth0_IPADDR=192.168.1.12
cnode12_bond0_IPADDR=192.168.10.12
cnode12_SPNET0_IPADDR=192.168.1.112
cnode13_host_name=el01cn13
cnode13_private_host_name=el01cn13-priv
cnode13_eth0_IPADDR=192.168.1.13
cnode13_bond0_IPADDR=192.168.10.13
cnode13_SPNET0_IPADDR=192.168.1.113
cnode14_host_name=el01cn14
cnode14_private_host_name=el01cn14-priv
cnode14_eth0_IPADDR=192.168.1.14
cnode14_bond0_IPADDR=192.168.10.14
cnode14_SPNET0_IPADDR=192.168.1.114
cnode15_host_name=el01cn15
cnode15_private_host_name=el01cn15-priv
cnode15_eth0_IPADDR=192.168.1.17
cnode15_bond0_IPADDR=192.168.10.17
cnode15_SPNET0_IPADDR=192.168.1.117
cnode16_host_name=el01cn16
cnode16_private_host_name=el01cn16-priv
cnode16_eth0_IPADDR=192.168.1.18
cnode16_bond0_IPADDR=192.168.10.18
cnode16_SPNET0_IPADDR=192.168.1.118
cnode17_host_name=el01cn17
cnode17_private_host_name=el01cn17-priv
cnode17_eth0_IPADDR=192.168.1.19
cnode17_bond0_IPADDR=192.168.10.19
cnode17_SPNET0_IPADDR=192.168.1.119
cnode18_host_name=el01cn18
cnode18_private_host_name=el01cn18-priv
cnode18_eth0_IPADDR=192.168.1.20
cnode18_bond0_IPADDR=192.168.10.20
cnode18_SPNET0_IPADDR=192.168.1.120
cnode19_host_name=el01cn19
cnode19_private_host_name=el01cn19-priv
cnode19_eth0_IPADDR=192.168.1.21
cnode19_bond0_IPADDR=192.168.10.21
cnode19_SPNET0_IPADDR=192.168.1.121
cnode20_host_name=el01cn20
cnode20_private_host_name=el01cn20-priv
cnode20_eth0_IPADDR=192.168.1.22
cnode20_bond0_IPADDR=192.168.10.22
cnode20_SPNET0_IPADDR=192.168.1.122
cnode21_host_name=el01cn21
cnode21_private_host_name=el01cn21-priv
cnode21_eth0_IPADDR=192.168.1.23
cnode21_bond0_IPADDR=192.168.10.23
cnode21_SPNET0_IPADDR=192.168.1.123

Verify the Factory Configuration

Add the Exalogic Machine to Your Network 5-3

Verify the Factory Configuration

cnode22_host_name=el01cn22
cnode22_private_host_name=el01cn22-priv
cnode22_eth0_IPADDR=192.168.1.24
cnode22_bond0_IPADDR=192.168.10.24
cnode22_SPNET0_IPADDR=192.168.1.124
cnode23_host_name=el01cn23
cnode23_private_host_name=el01cn23-priv
cnode23_eth0_IPADDR=192.168.1.25
cnode23_bond0_IPADDR=192.168.10.25
cnode23_SPNET0_IPADDR=192.168.1.125
cnode24_host_name=el01cn24
cnode24_private_host_name=el01cn24-priv
cnode24_eth0_IPADDR=192.168.1.26
cnode24_bond0_IPADDR=192.168.10.26
cnode24_SPNET0_IPADDR=192.168.1.126
cnode25_host_name=el01cn25
cnode25_private_host_name=el01cn25-priv
cnode25_eth0_IPADDR=192.168.1.27
cnode25_bond0_IPADDR=192.168.10.27
cnode25_SPNET0_IPADDR=192.168.1.127
cnode26_host_name=el01cn26
cnode26_private_host_name=el01cn26-priv
cnode26_eth0_IPADDR=192.168.1.28
cnode26_bond0_IPADDR=192.168.10.28
cnode26_SPNET0_IPADDR=192.168.1.128
cnode27_host_name=el01cn27
cnode27_private_host_name=el01cn27-priv
cnode27_eth0_IPADDR=192.168.1.29
cnode27_bond0_IPADDR=192.168.10.29
cnode27_SPNET0_IPADDR=192.168.1.129
cnode28_host_name=el01cn28
cnode28_private_host_name=el01cn28-priv
cnode28_eth0_IPADDR=192.168.1.30
cnode28_bond0_IPADDR=192.168.10.30
cnode28_SPNET0_IPADDR=192.168.1.130
cnode29_host_name=el01cn29
cnode29_private_host_name=el01cn29-priv
cnode29_eth0_IPADDR=192.168.1.31
cnode29_bond0_IPADDR=192.168.10.31
cnode29_SPNET0_IPADDR=192.168.1.131
cnode30_host_name=el01cn30
cnode30_private_host_name=el01cn30-priv
cnode30_eth0_IPADDR=192.168.1.32
cnode30_bond0_IPADDR=192.168.10.32
cnode30_SPNET0_IPADDR=192.168.1.132
snode1_host_name=el01sn01
snode1_private_host_name=el01sn01-priv
snode1_eth0_IPADDR=192.168.1.15
snode1_bond0_IPADDR=192.168.10.15
snode1_SPNET0_IPADDR=192.168.1.115
snode2_host_name=el01sn02
snode2_private_host_name=el01sn02-priv
snode2_eth0_IPADDR=192.168.1.16
snode2_bond0_IPADDR=192.168.10.16
snode2_SPNET0_IPADDR=192.168.1.116

5-4 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Prerequisites for Connecting Exalogic Machine to External Ethernet Network

5.3 Prerequisites for Connecting Exalogic Machine to External Ethernet Network

Depending on the type of your Ethernet device, you should use cables and
transceivers to connect an Exalogic machine to your existing network. For more
information, see Connectivity Between Exalogic Machine and External LAN Through

Sun Network QDR InfiniBand Gateway Switch.

5.4 Initial Network Configuration of Exalogic Machine

After you connect your Exalogic machine to the external Ethernet network using
cables and transceivers, you must configure the following Exalogic components to add
them to the network:

1.

Mandatory: Cisco Ethernet Switch

2.

Optional: vNICs on Sun Network QDR InfiniBand Gateway Switches for Ethernet
over InfiniBand (EoIB) connectivity, if necessary

3.

Mandatory: Compute nodes

4. Mandatory: Storage heads

5. Mandatory: Sun Network QDR InfiniBand Gateway Switches

6. Optional: Sun Datacenter InfiniBand Switch 36, if you are connecting your

Exalogic machine to another Exalogic machine rack or to an Oracle Exadata
Database Machine rack

Note:

You can use the Oracle Exalogic Configuration Utility set of tools and scripts
to configure the compute nodes, storage heads, and Sun Network QDR
InfiniBand Gateway Switches. For more information about Exalogic
Configuration Utility, see Configure the Exalogic Machine Using ECU.

You must configure the Cisco Ethernet Switch manually. For more
information, see Configuring the Cisco Ethernet Switch.

For information about configuring VNICs for Ethernet connectivity, see

Configure Ethernet Over InfiniBand.

For information about configuring the Sun Datacenter InfiniBand Switch 36
manually in multirack scenarios, see Use the Sun Datacenter InfiniBand

Switch 36 in Multirack Configurations.

5.4.1 Configuring the Cisco Ethernet Switch

The host name, IP address, DNS and NTP configurations must be configured for the
Cisco Ethernet switch. Before configuring the switch, note the following:

• The Cisco Ethernet switch should not be connected until the running
configuration has been verified, and any necessary changes have been made by
the network administrator.

Add the Exalogic Machine to Your Network 5-5

Initial Network Configuration of Exalogic Machine

• The Cisco Ethernet switch should not be connected to the network until the IP
addresses on all components have been configured in the Exalogic machine. This
is to prevent any duplicate IP address conflicts which are possible due to the
default addresses set in the components when shipped.

The following procedure describes how to configure the Cisco Ethernet switch:

1. Connect a serial cable from the Cisco switch console to a laptop or similar device.

An RJ45 to DB9 serial cable is included in the Cisco documentation package.

2. Ensure that the terminal session is logged on the laptop by scripting the output.

The data can be used as a reference that the switch has been configured correctly.
The default serial port speed is 9600 baud, 8 bits, no parity, 1 stop bit, and no
handshake.

Switch con0 is now available
Press RETURN to get started.

3.

Change to enable mode using the following command. The Cisco switch prompts
for the default password. For the default password, contact Oracle Support.

Switch> enable

4. Configure the network for a single VLAN. The following is an example of the

configuration:

Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# interface vlan 1
Switch(config-if)# ip address 10.7.7.34 255.255.255.0
Switch(config-if)# end
Switch# *Sep 15 14:12:06.309:%SYS-5-CONFIG_I:Configured from console by console
Switch# write memory
Building configuration...
Compressed configuration from 2474 bytes to 1066 bytes [OK ]

5. (Optional) Disable the default IP routing setting, and configure the default gateway

as follows. This step is required if IP routing will not be used on the switch.

Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# no ip routing
Switch(config)# ip default-gateway 10.7.7.1
Switch(config)# end
*Sep 15 14:12:46.309:%SYS-5-CONFIG_I:Configured from console by console
Switch# write memory
Building configuration...
Compressed configuration from 2492 bytes to 1070 bytes [OK ]

5-6 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Initial Network Configuration of Exalogic Machine

Note:

If IP routing is required on the switch, then leave the IP routing setting as the
default, and configure the default gateway as follows:

Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# ip route 0.0.0.0 0.0.0.0 10.7.7.1
Switch(config)# end
*Sep 15 14:13:26.013:%SYS-5-CONFIG_I:Configured from console by console
Switch# write memory
Building configuration...
Compressed configuration from 2502 bytes to 1085 bytes [OK ]

6.

Set the host name of the switch as follows:

Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# hostname corxsw-ip
burxsw-ip(config)# end
burxsw-ip# write memory
Building configuration...
Compressed configuration from 3789 bytes to 1469 bytes [OK ]

The system host name will be used as the prompt name.

7. Set the password as follows:

Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# enable password Your_Password
Switch(config)# enable secret Your_Password
The enable secret you have chosen is thesame as your enable password.
This is not recommended.Re-enter the enable secret.
Switch(config)# end
Switch#write memory
*Sep 15 14:25:05.893:%SYS-5-CONFIG_I:Configured from console by console
Building configuration...
Compressed configuration from 2502 bytes to 1085 bytes [OK ]

8. Set the password for telnet network access. The following is an example:

Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# line vty 0 15
Switch(config-line)# login
%Login disabled on line 1,until 'password'is set
%Login disabled on line 2,until 'password'is set
%Login disabled on line 3,until 'password'is set
...
%Login disabled on line 15,until 'password'is set
%Login disabled on line 16,until 'password'is set
Switch(config-line)# password Your_Password
Switch(config-line)# login
Switch(config-line)# end
Switch#write memory
Building configuration...
Compressed configuration from 3786 bytes to 1468 bytes [OK ]
Switch#

Add the Exalogic Machine to Your Network 5-7

Initial Network Configuration of Exalogic Machine

In the preceding example, the first login output shows the password has not been
set, and telnet access is disabled. If the login command returns nothing, then the
password is set and telnet access is available.

9. Configure up to three DNS servers. The following is an example:

Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# ip domain-name exdm.com
Switch(config)# ip name-server 10.7.7.3
Switch(config)# ip name-server 129.148.5.5
Switch(config)# ip name-server 10.8.160.1
Switch(config)# end
*Sep 15 14:26:37.045:%SYS-5-CONFIG_I:Configured from console by console
Switch#write memory
Building configuration...
Compressed configuration from 2603 bytes to 1158 bytes [OK ]

10.

Set the clock and time zone as follows. The switch keeps internal time in
Coordinated Universal Time (UTC) format.

• To use UTC use the following command:

no clock timezone global configuration

• To use a time zone, use the following command:

clock timezone zone hours-offset [minutes-offset]

In the preceding command, zone is the time zone to display when standard
time in effect, hours-offset is the hours offset from UTC, and minutes-offset is the
minutes offset from UTC.

• To set summer time hours, use the following command:

clock summer-time zone recurring [week day month hh:mm week day month \

hh:mm [offset]]

In the preceding command, zone is the time zone to be displayed when
summer time is in effect, week is the week of the month (1 to 5 or last), day is the
day of the week, month is the month, hh:mm is the time in 24-hour format, and
offset is the number of minutes to add during summer time. The default offset
is 60 minutes.

• To manually set the clock to any time, use the following command:

clock set hh:mm:ss month day year

In the preceding command, hh:mm:ss is the time in 24-hour format, day is the
day of the month, month is the month, and year is the year. The time specified is
relative to the configured time zone.

To set the local time and time zone, ordering is important. The following is an
example of setting local time to US Eastern time:

Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# clock timezone EST -5
Switch(config)# clock summer-time EDT recurring
Switch(config)# end
Switch# clock set 21:00:00 December 09 2009

5-8 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Initial Network Configuration of Exalogic Machine

Switch#write memory
Building configuration...
Compressed configuration from 3784 bytes to 1465 bytes [OK ]
Switch# show clock
21:00:06.643 EST Wed Dec 9 2009

11.Configure up to two NTP servers. The following is an example:

Switch# configure terminal
Enter configuration commands,one per line.End with CNTL/Z.
Switch(config)# ntp server 10.7.7.32 prefer
Switch(config)# ntp server 129.148.9.19
Switch(config)# end
*Sep 15 14:51:08.665:%SYS-5-CONFIG_I:Configured from console by
console
Switch# write memory
Building configuration...
Compressed configuration from 2654 bytes to 1163 bytes [OK ]
Switch# show ntp status
<output will vary per network>
Switch# show clock
20:59:06.643 EST Wed Dec 9 2009

The preceding should show the NTP server synchronized to local time if the Cisco
switch is connected to the network and has access to NTP.

12.Verify the configuration using the following command:

Switch# show running-config

The following is an example of the output:

Building configuration...
Current configuration :2654 bytes
!
version 12.2
no service pad
service timestamps debug datetime msec
service timestamps log datetime msec
no service password-encryption
service compress-config
!
hostname Switch
!
boot-start-marker
boot-end-marker
!
enable secret 5 $1$mS8h$EaJrIECUxavfGH6vLZg1T.
enable password Your_Password
!
no aaa new-model
ip subnet-zero
ip domain-name sodm.com
ip name-server 10.7.7.3
ip name-server 172.16.5.5
ip name-server 10.8.160.1
!
ip vrf mgmtVrf
!
vtp mode transparent
!
power redundancy-mode redundant

Add the Exalogic Machine to Your Network 5-9

Initial Network Configuration of Exalogic Machine

!
!
spanning-tree mode pvst
spanning-tree extend system-id
no spanning-tree vlan 1
!
vlan internal allocation policy ascending
!
!
interface FastEthernet1
ip vrf forwarding mgmtVrf
no ip address
speed auto
duplex auto
!
interface GigabitEthernet1/1
!
interface GigabitEthernet1/2
!
...
!
interface GigabitEthernet1/44
!
interface GigabitEthernet1/45
media-type rj45
!
interface GigabitEthernet1/46
media-type rj45
!
interface GigabitEthernet1/47
media-type rj45
!
interface GigabitEthernet1/48
media-type rj45
!
interface Vlan1
ip address 10.7.7.34 255.255.255.0
!
interface Vlan48
no ip address
shutdown
!
ip default-gateway 10.7.7.1
ip http server
!
!
control-plane
!
!
line con 0
stopbits 1
line vty 0 4
password Your_Password
login
line vty 5 15
password Your_Password
login
!
ntp server 10.7.7.32 prefer
ntp server 172.16.9.1
end

5-10 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Initial Network Configuration of Exalogic Machine

If any setting is incorrect, then repeat the appropriate step. To erase a setting, enter
no in front of the same command. For example, to erase the default gateway, the
following commands would be entered:

no ip default-gateway 10.7.7.1
end
write memory

13.Save the current configuration using the following command:

Switch# copy running-config startup-config

14.Exit from the session using the following command:

Switch# exit

15.

Disconnect the cable from the Cisco console.

Note:

To check the configuration, attach a laptop computer to port 48, and ping the
IP address of the internal management network.

Add the Exalogic Machine to Your Network 5-11

Initial Network Configuration of Exalogic Machine

5-12 Machine Owner's Guide

6

Understand Network Requirements and

Configuration

This chapter describes the network requirements for the Exalogic machine.

It contains the following topics:

• Overview of Network Requirements

• Naming Conventions

• Important Notes for Oracle Solaris Users

• Network Connection and IP Address Requirements

• Default InfiniBand Bonded IP Addresses

• Introduction to Oracle Exalogic Network Configuration

• Prepare to Reconfigure the Networking of Exalogic Machine

• Subnet Manager Requirements for Connecting Exalogic to Exadata

• Network Configuration Worksheets

6.1 Overview of Network Requirements

An Exalogic machine includes compute nodes, storage appliance, and equipment to
connect the compute nodes to your network. The network connections allow the
servers to be administered remotely, enable clients to connect to the compute nodes,
and enable client access to the storage appliance.

The following table describes the network components and interfaces for each
compute node and the storage appliance:

Table 6-1 Available network components and interfaces on the compute nodes and
storage appliance

Compute Node Storage Appliance (two server

Gigabit Ethernet (GbE)
ports:

• Oracle Linux: NET0,

NET1, NET2, and
NET3

• Oracle Solaris: igb0,
igb1, igb2, and
igb3

4 (only NET0 or igb0 is
connected and used)

heads)

4 per server head (1 and 10 GbE ports
available for Exalogic X4 and newer
systems, 1 GbE for earlier systems)

Understand Network Requirements and Configuration 6-1

Overview of Network Requirements

Table 6-1 (Cont.) Available network components and interfaces on the compute
nodes and storage appliance

Compute Node Storage Appliance (two server

heads)

Dual-port QDR
InfiniBand Host Channel
Adapter:

• Oracle Linux: ib0
and ib1

• Oracle Solaris: ibp0
and ibp1

Ethernet Port for ILOM
remote management

Note:

1 (this port is not
connected or used)

1 4 per head (the ETH0 and ETH1

1 per server head

interfaces are used for active and
passive clustering support; the
dedicated ILOM port is not used,
sideband management is used
instead through the igb0 port)

These ports are pre-wired in the Exalogic machine at the time of
manufacturing. Do not touch or modify the ports.

The Cisco Ethernet switch supplied with the Exalogic machine is minimally
configured during installation. The minimal configuration disables IP routing, and sets
the following:

• Host name

• IP address

• Subnet mask

• Default gateway

• Domain name

• Domain Name Server

• NTP server

• Time

• Time zone

Additional configuration, such as defining multiple virtual local area networks
(VLANs) or enabling routing, may be required for the switch to operate properly in
your environment and is beyond the scope of the installation service.

To deploy the Exalogic machine, verify that you meet the minimum network
requirements. There are up to five networks for an Exalogic machine. Each network
must be on a distinct and separate subnet from the others. The network descriptions
are as follows:

6-2 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Overview of Network Requirements

• Management network: This required network connects to your existing
management network, and is used for administrative work for all components of
the Exalogic machine. It connects ILOM, compute nodes, server heads in the
storage appliance, switches connected to the Ethernet switch in the Exalogic
machine rack. This management network is in a single subnet. ILOM connectivity
uses the NET0 (on Oracle Solaris, igb0) sideband interface.

For multirack configurations, you may have any of the following:

– A single subnet per configuration

– A single subnet per rack in the multirack configuration

– Multiple subnets per configuration

Oracle recommends that you configure a single subnet per configuration.
With sideband management, only the NET0 (on Oracle Solaris, igb0) interface of

each compute node is physically connected to the Ethernet switch on the rack. For
the server heads in the storage appliance, NET0 and NET1 interfaces (on Oracle
Solaris, igb0 and igb1) are physically connected to support active-passive
clustering.

Note:

Do not use the management network interface (NET0 on Oracle Linux, and
igb0 on Oracle Solaris) on compute nodes for client or application network

traffic. Cabling or configuration changes to these interfaces on Exalogic
compute nodes is not permitted.

• InfiniBand private network: This required network connects the compute nodes
and the storage appliance through the BOND0 interface to the InfiniBand
switches/gateways on the Exalogic rack. It is the default IP over InfiniBand
(IPoIB) subnet created automatically during the initial configuration of the
Exalogic machine.

Note:

This network is either based on the default InfiniBand partition or based on a
partition allocated for the Exalogic machine. A single default partition is
defined at the rack level. For more information, see Work with the Default

Rack-Level InfiniBand Partition.

• Client access network: This required network connects the compute nodes to
your existing client network through the BOND1 interface and is used for client
access to the compute nodes (this is related primarily to a physical Exalogic
deployment). Each Exalogic compute node has a single default client access (edge
network) to an external 10 Gb Ethernet network through a Sun Network QDR
InfiniBand Gateway Switch.

The logical network interface of each compute node for client access network
connectivity is bonded. Bond1 consists of 2 vNICs (Ethernet over IB vNICs). Each
vNIC is mapped to a separate Sun Network QDR InfiniBand Gateway Switch for
high availability (HA) and each host EoIB vNIC is associated with a different
HCA IB port (On Oracle Linux, vNIC0 -> ib0, vNIC1 -> ib1; on Oracle Solaris,
vNIC0 -> ibp0, vNIC1 -> ibp1).

Understand Network Requirements and Configuration 6-3

Overview of Network Requirements

• Additional networks (optional): Each Sun Network QDR InfiniBand Gateway
Switch has eight 10 Gb Ethernet ports. The number of ports used in Exalogic
deployment depends on your specific bandwidth requirements (how many 10 Gb
ports can be shared per compute node) and on your specific LAN/VLAN
connection requirements. A group of 16 compute nodes connects 2 Sun Network
QDR InfiniBand Gateway Switches in an active-passive bond. Each compute node
is connected to two separate Sun Network QDR InfiniBand Gateway Switches for
HA.

Note that each compute node requires a bond for each external network (physical
network or VLAN).

Figure 6-1 shows the network diagram for the Exalogic machine with Oracle Linux

operating system.

Figure 6-1 Network Diagram for Exalogic Machine

6-4 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Note:

If you are using Oracle Solaris, you can assign the logical names of IPMP
groups to be ipmp0 or BOND0, and ipmp1 or BOND1 and have the name of
the datalink corresponding to the NET0 Ethernet port to be displayed as igp0
or net0 in the Solaris administration commands. For more information, see

IPMP Overview for Oracle Solaris Users.

6.2 Naming Conventions

The Exalogic machine name is used to generate host names for network interfaces for
all systems. For example, an Exalogic machine name of el01 will result in compute
node host names of el01cn01, el01cn02, el01cn03, and so on.

In a multirack configuration, each Exalogic rack name should be unique and identify
the rack. Oracle recommends using el01 for the first Exalogic rack, el02 for the
second, el03 for the third, and so on.

Note:

You can connect up to eight Exalogic machine full racks, or a combination of 4
Exalogic machine full racks and 4 Oracle Exadata Database Machine full racks
together on the same Infiniband fabric, without purchasing additional
hardware. To connect more machines, Oracle offers a choice of several high­capacity datacenter switches which allow the creation of Exalogic clouds
comprising hundreds of racks and tens of thousands of processors

Naming Conventions

6.3 Important Notes for Oracle Solaris Users

If you are using the Oracle Solaris operating system on Exalogic compute nodes, keep
the following points in mind:

• BOND0 and BOND1, two important terms used in this guide, refer to the default

interfaces for IP over InfiniBand (IPoIB) and Ethernet over InfiniBand (EoIB),
respectively, on the Oracle Linux operating system.

• Oracle Solaris uses the IP Multipathing (IPMP) technology to support IPMP
Groups that consist of one or more physical interfaces on the same system that are
configured with the same IPMP group name. This technology provides the same
functionality as Bonded Interfaces on Oracle Linux. You can name the IPMP groups
anything. In this guide, BOND0 and BOND1 are used as example names to keep the
terminology consistent with Oracle Linux.

Note:

For an overview of IPMP, see IPMP Overview for Oracle Solaris Users.

6.4 Network Connection and IP Address Requirements

This section describes the network connections required for multiple networks of
Exalogic machine. The network cables must be run from your network equipment to
the location of the Exalogic machine.

Understand Network Requirements and Configuration 6-5

Network Connection and IP Address Requirements

The requirements to connect the Exalogic machine to your existing Ethernet network
infrastructure are described in the following sections:

• Network Connection Requirements

• IP Address Requirements

6.4.1 Network Connection Requirements

Before installation, network cables must be run from your existing network
infrastructure to the installation site. The requirements to connect the Exalogic
machine to your existing network infrastructure are as follows:

• Management network connection requirements

– At least one Ethernet connection for the Ethernet switch in the rack to the

existing management network. The total number of connections depends on
your HA requirements for the data center.

• Client access network connection requirements

– At least one Ethernet over InfiniBand (EoIB) bond per Exalogic compute node

to the client access network is required. Additional client access network
interface bonds are added for each physical LAN or each virtual LAN
(VLAN) in which the compute node is connected. The minimum
configuration requires (single Bond to single LAN per compute node) the
number of network connections per Exalogic compute node, as outlined in
the subsequent table for Full Rack, Half Rack, and Quarter Rack
configurations.

The following table describes the number of required connections:

Type of Exalogic Machine

Exalogic machine full rack 30

Exalogic machine half rack 16

Exalogic machine quarter rack 8

Exalogic machine eighth rack 4

Bonded Network
Configuration

Up to eight external physical networks can be connected through EoIB using the
Sun Network QDR InfiniBand Gateway Switch. You can create multiple bonded
vNICs on the compute nodes.

• Additional network connection requirements

You must determine the following:

– How many LANs to connect to (typically, 1 or 2, maximum 8 physically

isolated LANs)

– How many 10 Gb ports per LAN are required (your network throughput

requirements for client access network)

At least two 10 Gb Ethernet ports per compute node - one active and another
passive.

6-6 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Network Connection and IP Address Requirements

The following are the connection choices based on the number of Ethernet ports:

– 1 active 10 Gb Ethernet port shared by up to 8 compute nodes

– 2 active 10 Gb Ethernet ports shared by up to 8 compute nodes

* 1 port shared by 4 compute nodes for 1 LAN

* 1 port shared by 8 compute nodes for 2 LANs (1 port per LAN per

compute node)

– 4 active 10 Gb Ethernet ports shared by up to 8 compute nodes

* 1 port shared by 2 compute nodes for 1 LAN (1 port per LAN per

compute node)

* 1 port shared by 4 compute nodes for 2 LANs (1 port per LAN per

compute node)

* 1 port shared by 8 compute nodes for 4 LANs (1 port per LAN per

compute node)

– 8 active 10 Gb Ethernet ports shared by up to 8 compute nodes

* 1 port per 1 compute node for 1 LAN

* 1 port shared by 2 compute nodes for 2 LANs (1 port per LAN per

compute node)

* 1 port shared by 4 compute nodes for 4 LANs (1 port per LAN per

compute node)

* 1 port shared by 8 compute nodes for 8 LANs (1 port per LAN per

compute node)

6.4.2 IP Address Requirements

An Exalogic machine requires a large number of host names and IP addresses during
initial configuration. The number of IP addresses required for a particular network,
such as the management network, depends on the type of system. The network
configuration, such as host names and IP addresses, used during installation is
generated from information you supply to your Oracle technical representative in the
completed configuration worksheet. See Network Configuration Worksheets.

Configure the new IP addresses in your existing networks only after you have
completed the configuration worksheets, and received the installation Template from
your Oracle representative. All IP addresses in the installation Template must be
unassigned at the time of initial configuration. In addition, all IP addresses must be
statically assigned IP addresses, not dynamically assigned (DHCP) addresses.

All InfiniBand physical IP addresses in BOND0 must be in the same subnet, with a
minimum subnet mask of 255.255.240.0 (or /20). The subnet mask chosen should be
wide enough to accommodate possible future expansion of the Exalogic machine and
InfiniBand network. Each device (compute nodes, switches, and storage appliance) in
the Exalogic rack is assigned a separate Local Identifier (LID) by the IB Subnet
Manager. Oracle Exalogic supports a single IP over IB (IPoIB) link over a logical
Exalogic deployment over the IB subnet. Multiple IP subnets can be layered on top of
the default IPoIB link.

Table 6-2 lists the IP address requirements for the Exalogic machine:

Understand Network Requirements and Configuration 6-7

Network Connection and IP Address Requirements

Table 6-2 IP Address Requirements for Exalogic Machine

Type of
Exalogic
Machine

full rack Minimum of 68 IP

Management
Network
Requirements

addresses

• At least 2 IP
addresses per
management
network for
compute nodes:

1 IP address for
ILOM

1 IP address for
ETH0

• 2 IP addresses
per controller/
server heads in
the storage
appliance

• 1 IP address per
Sun Network
QDR InfiniBand
Gateway Switch

Client Access Network
Requirements

Minimum of one IP address per
Bond. Additional IP addresses
per Bond added as per Service or
Protocol requirements.

For example, HTTP may only
expose a floating IP address to an
external Load Balancer and not to
the HTTP Client (only observes
VIP of Load Balancer), while JMS
may expose the virtual IP directly
to the JMS Client.

Typically, an application server
supporting both HTTP and JMS
will have a floating IP address for
JMS (public) and a floating IP
address for HTTP (private to the
Load Balancer).

In addition, T3 typically uses a
minimum of two IP addresses.
One of these IP addresses is
private to the Load Balancer, and
the other floating IP address is
exposed to application server
clients. An application server
client initially accesses the
application server through a well­known virtual IP address, such as
T3://floating_IP:Port. This
request is received by an external
Load Balancer, which forwards
the packet to a private IP address
of the application server. The
application server responds with
a handle that consists of another
floating IP address, such as
W_floatingIP:Port. This
request is forwarded through the
Client. For any new requests,
Client accesses the application
Server through
T3:W_floatingIP:Port.

InfiniBand Private
Network (IPoIB)
Requirements

Minimum of one
IP address per
bond per compute
node.

Exalogic machine
full rack contains
30 compute
nodes.

One compute
node can be a
member of only
one private
network of an
application
domain.

6-8 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Network Connection and IP Address Requirements

Table 6-2 (Cont.) IP Address Requirements for Exalogic Machine

Type of
Exalogic
Machine

half rack Minimum of 38 IP

quarter
rack

Management
Network
Requirements

addresses

• At least 2 IP
addresses per
management
network for
compute nodes:

1 IP address for
ILOM

1 IP address for
ETH0

• 2 IP addresses
per controller/
server heads in
the storage
appliance

• 1 IP address per
Sun Network
QDR InfiniBand
Gateway Switch

Minimum of 22 IP
addresses

• At least 2 IP
addresses per
management
network for
compute nodes:

1 IP address for
ILOM

1 IP address for
ETH0

• 2 IP addresses
for controllers/
server heads in
the storage
appliance

• 1 IP address per
Sun Network
QDR InfiniBand
Gateway Switch

Client Access Network
Requirements

Same as above. Minimum of one

Same as above. Minimum of one

InfiniBand Private
Network (IPoIB)
Requirements

IP address per
bond per compute
node.

Exalogic machine
half rack contains
16 compute
nodes.

One compute
node can be a
member of only
one private
network of an
application
domain.

IP address per
bond per compute
node.

Exalogic machine
quarter rack
contains 8
compute nodes.

One compute
node can be a
member of only
one private
network of an
application
domain.

Understand Network Requirements and Configuration 6-9

Default InfiniBand Bonded IP Addresses

Table 6-2 (Cont.) IP Address Requirements for Exalogic Machine

Type of
Exalogic
Machine

eighth rack Minimum of 20 IP

Management
Network
Requirements

addresses

• At least 2 IP
addresses per
management
network for
compute nodes:

1 IP address for
ILOM

1 IP address for
ETH0

• 2 IP addresses
for controllers/
server heads in
the storage
appliance

• 1 IP address per
Sun Network
QDR InfiniBand
Gateway Switch

Client Access Network
Requirements

Same as above. Minimum of one

InfiniBand Private
Network (IPoIB)
Requirements

IP address per
bond per compute
node.

Exalogic machine
eighth rack
contains 4
compute nodes.

One compute
node can be a
member of only
one private
network of an
application
domain.

6.5 Default InfiniBand Bonded IP Addresses

Default InfiniBand bonded IP addresses are assigned to Exalogic compute nodes at the
time of manufacturing. However, you can reconfigure the IP addresses by using the
Oracle Exalogic Configuration Utility. The Oracle Exalogic
Configuration Utility and its associated scripts reconfigure InfiniBand Bonded
IP addresses based on the input you provide to the Exalogic Configurator spreadsheet.

For a list of default InfiniBand Bonded IP addresses, see Default IP Addresses and

Ports.

6.6 Introduction to Oracle Exalogic Network Configuration

This section introduces the following topics:

• InfiniBand Fabric

• InfiniBand Switches

• Default Bonded Interfaces

• IPMP Overview for Oracle Solaris Users

• Connectivity Between Exalogic Compute Nodes

• Connectivity Between Exalogic Machine and External LAN Through Sun

Network QDR InfiniBand Gateway Switch

• Additional InfiniBand Network Requirements and Specifications

6-10 Oracle Exalogic Elastic Cloud Machine Owner's Guide

6.6.1 InfiniBand Fabric

Exalogic machines use a unified 40 Gb per second InfiniBand quad data rate (QDR)
fabric for internal communication.

Applications running on compute nodes communicate with applications on other
compute nodes using this InfiniBand network. Exalogic machines communicate with
Oracle Exadata Database Machines for database connectivity via IPoIB. Exalogic
machines can be connected to an external network, including a standard database
hosted on a machine outside of the Exalogic machine, via the InfiniBand-to-10 Gb
Ethernet gateways using Ethernet over InfiniBand (EoIB). Each Exalogic machine
configuration includes at least 2 such gateways, which also act as InfiniBand switches
connecting all compute nodes and the storage appliance within the Exalogic machine.

6.6.2 InfiniBand Switches

Sun Network QDR InfiniBand Gateway Switches (part number NM2-GW) are used as
the leaf switches in the Exalogic machine. They connect to the Host Channel Adapters
(HCAs) of Exalogic compute nodes.

These switches (NM2-GW) also act as Ethernet gateways to connect your Exalogic
machine to the external LAN over Ethernet. For more information, see Connectivity

Between Exalogic Machine and External LAN Through Sun Network QDR InfiniBand
Gateway Switch.

Introduction to Oracle Exalogic Network Configuration

Sun Datacenter InfiniBand Switch 36 (part number NM2-36P) is used in multirack
configuration scenarios (an Exalogic machine to another Exalogic machine, and an
Exalogic machine to an Oracle Exadata Database Machine) only. This switch is not
connected or used in an Exalogic machine single rack.

Note:

In the Exalogic machine, InfiniBand switches (both leaf and spine switches)
are automatically configured to separate the IP over InfiniBand (IPoIB) traffic
and the Ethernet over InfiniBand (EoIB) traffic.

6.6.3 Default Bonded Interfaces

After the Sun Network QDR InfiniBand Gateway Switches are connected to Exalogic
compute nodes, the following bonded interfaces are configured:

• IP over InfiniBand (IPoIB) - bond0 link (ib0/ib1 for Oracle Linux, and ibp0/

ibp1 for Oracle Solaris)
ib0 or ibp0 represents the HCA port 0 of compute nodes, and ib1 or ibp1

represents the HCA port 1 of compute nodes.

Note:

Depending on your application deployment and isolation requirements, you
can create additional bonded IP subnet interfaces over this default IPoIB link.

For more information, see the "Application Isolation by Subnetting over IPoIB"
topic in the Oracle Exalogic Enterprise Deployment Guide.

Understand Network Requirements and Configuration 6-11

Introduction to Oracle Exalogic Network Configuration

• Ethernet over InfiniBand (EoIB) - bond1 link, which uses two vNICs, such as
vNIC0 and vNIC1 for ib0 and ib1 (vNIC0 and vNIC1 for ibp0 and ibp1 on
Oracle Solaris), respectively.

Note:

Oracle Solaris uses the IP Multipathing (IPMP) technology to support IPMP
Groups that provide the same functionality as bonded interfaces on Oracle
Linux. If you are using Oracle Solaris on Exalogic compute nodes, you can
name the IPMP groups anything. In this guide, BOND0 and BOND1 are used as
example names to keep the terminology consistent with Oracle Linux.

6.6.4 IPMP Overview for Oracle Solaris Users

On the Oracle Solaris operating system, IP network multipathing (IPMP) provides
physical interface failure detection and transparent network access failover for a
system with multiple interfaces on the same IP link. IPMP also provides load
spreading of packets for systems with multiple interfaces.

This section discusses the following topics:

• IPMP Components

• IPMP Groups

6.6.4.1 IPMP Components

IPMP comprises the following components:

• The in.mpathd daemon

• The /etc/default/mpathd configuration file

• ifconfig options for IPMP configuration

Note:

For information about the in.mpathd daemon and the mpathd configuration
file, see the in.mpathd (1M) man page on the Oracle Solaris operating system
installed on Exalogic compute nodes. For information about ifconfig, see
the ifconfig (1M) man page.

6.6.4.2 IPMP Groups

An IP multipathing group, or IPMP group, consists of one or more physical interfaces
on the same system that are configured with the same IPMP group name. All
interfaces in the IPMP group must be connected to the same IP link. The same (non­null) character string IPMP group name identifies all interfaces in the group. You can
place interfaces from NICs of different speeds within the same IPMP group, as long as
the NICs are of the same type. IPMP groups on Oracle Solaris provide the same
functionality as Bonded Interfaces on Oracle Linux in the Exalogic environment. For
example, the default IPMP group ipmp0 comprises two physical interfaces that are
connected to the default IPoIB link for internal communication in your Exalogic
machine. The other default IPMP group ipmp1 comprises two virtual interfaces that
are connected to the default EoIB link for external data center connectivity.

6-12 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Note:

For information about administering and configuring IPMP groups on the
Oracle Solaris operating system installed on Exalogic compute nodes, see

Oracle Solaris 11.1 documentation.

6.6.5 Connectivity Between Exalogic Compute Nodes

Compute nodes in the Exalogic machine are connected to one another through dual­ported InfiniBand quad data rate (QDR) host channel adapters (HCAs). Each HCA has
an IP address, and active-passive bonding is configured. The active port of the HCA
connects to an Sun Network QDR InfiniBand Gateway Switch, and the passive port of
the HCA connects to another Sun Network QDR InfiniBand Gateway Switch in the
Exalogic machine.

Note:

For more information about network connectivity in different Exalogic
machine configurations, see Cabling Diagrams .

Introduction to Oracle Exalogic Network Configuration

6.6.6 Connectivity Between Exalogic Machine and External LAN Through Sun Network QDR InfiniBand Gateway Switch

The Sun Network QDR InfiniBand Gateway Switches also act as gateways to connect
to Ethernet networks, and they support eight 10 GB Ethernet ports. These ports can be
accessed by Exalogic compute nodes through the InfiniBand network through EoIB.
You can create multiple VLANs per each of these Ethernet ports.

Each Exalogic compute node can access one or more Ethernet ports on two Sun
Network QDR InfiniBand Gateway Switches (NM2-GW), for HA purposes. An
Exalogic machine full rack includes 4 gateway switches. Therefore, a group of 8
compute nodes in the Exalogic machine full rack can access one Ethernet port on both
the primary gateway switch and the secondary gateway switch that the group of
compute nodes is connected to. Each port is represented as an EoIB vNIC at the
compute nodes. Each compute node has two bonded vNICs (active/passive).

Note:

You can configure up to eight compute nodes to use a single 10 GB Ethernet
port.

For information about creating a VNIC for Ethernet connectivity, see

Configure Ethernet Over InfiniBand.

This section discusses the following topics:

• Ethernet Device Requirements

• Network Interface Configuration for Compute Nodes

• Transceiver and Cable Requirements

Understand Network Requirements and Configuration 6-13

Introduction to Oracle Exalogic Network Configuration

6.6.6.1 Ethernet Device Requirements

Before you begin, ensure that you have a 10 Gb Ethernet Switch, Router, or NIC device
that supports any of the following:

• SFP+ 10G-Base-SR Module

• XFP 10G-Base-SR Module

• QSFP Optical Module

For example, here is how a QSFP module on the Exalogic's Sun Network QDR
InfiniBand Gateway Switch (NM2-GW) is connected to the SFP+/XFP modules on the
data center's 10 GbE switch.

Figure 6-2 Connectivity Between NM2-GW and External 10 GB Ethernet Switch

6.6.6.2 Network Interface Configuration for Compute Nodes

By default, each Exalogic compute node is configured with one bonded EoIB interface
(ethX) for one external LAN. It is BOND1 (vnic0/vnic1), which connects to one external
LAN, such as LAN1.

If a vNIC is created at one of the Sun Network QDR InfiniBand Gateway Switches, the
ethX interface is associated with the vNIC automatically.

Note:

You can configure additional EoIB network interfaces for connecting to
additional LANs, as required.

6.6.6.3 Transceiver and Cable Requirements

Table 6-3 lists the transceiver and cable requirements that you must complete to

connect your Exalogic machine to your data center's 10 Gb Ethernet switch.

6-14 Oracle Exalogic Elastic Cloud Machine Owner's Guide

Table 6-3 Transceivers and Cables

Introduction to Oracle Exalogic Network Configuration

Optical Module on
Exalogic's Sun
Network QDR
InfiniBand Gateway
Switch

QSFP module QSFP MTP to 4 LC

QSFP module QSFP – QSFP

Cable Needed Ethernet Switch

A minimum of one
optical cable per
NM2-GW is needed,
but two cables per
NM2-GW are
recommended.

A minimum of one
optical cable per
NM2-GW is needed,
but two cables per
NM2-GW are
recommended.

Vendor

A Sun Oracle switch
or a 10 GbE standard
switch from a third­party vendor

A Sun Oracle switch
or a 10 GbE standard
switch from a third­party vendor

Transceiver Needed

For Sun Oracle
switch: x2129/3 SFP
+/XFP SR module

For third-party
switches: SFP+/XFP
module provided by
the switch vendor

For Sun Oracle
switch: x2124A QSFP
module

For third-party
switches: QSFP
module provided by
the switch vendor

Note: Exalogic ships
with QSFP
transceivers, by
default. Customers
may use them on the
data center switch
side if they use a Sun
Oracle 10GbE switch,
such as the Sun
Network 10 GbE
Switch 72p.

6.6.7 Additional InfiniBand Network Requirements and Specifications

Table 6-4 lists additional InfiniBand specifications and cable requirements.

Table 6-4 HCA, Port Specifications and Cable Requirements

Component/Item Exalogic

Machine
Full Rack

InfiniBand quad data rate (QDR) host
channel adapters (HCAs)

Unused ports in (Sun Network QDR
InfiniBand Gateway Switches (NM2-GW
leaf switches)

Unused ports in Sun Datacenter
InfiniBand Switch (NM2-36P) spine switch

Note: This switch is used in multirack
configurations only.

Understand Network Requirements and Configuration 6-15

30 16 8 60

0 6 16 6

36 0 Not

Exalogic
Machine
Half
Rack

Exalogic
Machine
Quarter
Rack

Two
Exalogic
Machines

4

applicable

Prepare to Reconfigure the Networking of Exalogic Machine

6.7 Prepare to Reconfigure the Networking of Exalogic Machine

You should prepare to reconfigure the networking of your Exalogic machine as
follows:

1. Identify your current management network.

2. Identify your current client access network.

3. Determine if you will connect multiple Exalogic machines or a combination of

Exalogic machines and Oracle Exadata Database Machines. If you plan do to either
of these, then contact your Oracle representative.

4.

Provide input to the Exalogic Configurator spreadsheet, which will be used to
generate configuration scripts required for the initial network configuration.

5.

Review the values you entered in the spreadsheet.

6.

Execute Oracle Exalogic Configuration Utility scripts, as described in Configure the

Exalogic Machine Using ECU.

7. Run the network connections to the planned Exalogic machine location.

8. Inform your Oracle representative when you have completed these steps.

6.8 Subnet Manager Requirements for Connecting Exalogic to Exadata

See Subnet Manager Operation in Different Rack Configurations.

6.9 Network Configuration Worksheets

The following networks are used with the Exalogic machine:

• Management network

• Client access network

• InfiniBand private network (IPoIB)

The InfiniBand private network is a non-routable network fully contained in the
Exalogic machine, and it does not connect to your existing network. This network is
automatically configured during installation.

Note:

All networks must be on distinct and separate subnets from each other.

All IP addresses must be statically assigned IP addresses, not dynamically
assigned (DHCP) addresses.

This section contains the following worksheets:

• General Network Configuration Worksheet (Required)

• Management Network Configuration Worksheet (Required)

6-16 Oracle Exalogic Elastic Cloud Machine Owner's Guide

• Client Access Network Configuration Worksheet (Required)

• Private InfiniBand Network Configuration Worksheet (Required)

6.9.1 General Network Configuration Worksheet (Required)

Table 6-5 is the general network configuration worksheet. Fill out this worksheet and

provide it to the Oracle representative, or use as a reference to complete the initial
configuration of your Exalogic machine. Information entered in this worksheet is used
as input to Oracle Exalogic Configuration Utility. This worksheet includes
fields in the Exalogic Configurator spreadsheet that typically require data.

Table 6-5 General Network Configuration Worksheet

Item Entry Description and Example

Domain name Company network domain

Region Name of the country in

Network Configuration Worksheets

name.

Example: abc.example.com

which the Exalogic machine
resides.

Time Zone Valid time zone.

IP address of the Domain
Name Server

NTP Server IP address of one or more

Search Domains A list of search domains for

Default Gateway IP address of the default

IP address of one or more
network name servers (up to
four servers).

Example: 10.25.45.123,

10.25.45.125

Network Time Protocol
servers (up to four servers).

Example: 10.12.13.14,

10.12.13.15

name lookup (up to four
domains).

Example: example.com,
example.org

gateway in your
organization.

Example: 10.203.72.2

6.9.2 Management Network Configuration Worksheet (Required)

The management network is used for administrative work for all components of the
Exalogic machine. It connects the NET0 (igb0 on Oracle Solaris) network interface on
all compute nodes, Integrated Lights Out Manager (ILOM), server heads of the storage
appliance, and InfiniBand gateways/switches to the Cisco Ethernet switch in the rack.

Understand Network Requirements and Configuration 6-17

Network Configuration Worksheets

The Cisco Ethernet switch supplied with the Exalogic machine is minimally
configured during installation. The minimal configuration disables IP routing, and sets
the following:

• First management IP address, subnet mask, and gateway for NET0 (igb0 for
Oracle Solaris)

• First IP address, subnet mask, and gateway for ILOM

Additional configuration, such as defining multiple virtual local area networks
(VLANs) or enabling routing, may be required for the switch to operate properly in
your environment and is beyond the scope of the installation service. If additional
configuration is needed, then your network administrator must perform the necessary
configuration steps during installation of the Exalogic machine.

Table 6-6 is the management network configuration worksheet. Fill out this worksheet

and provide it to the Oracle representative, or use as a reference to complete the initial
configuration of your Exalogic machine. Information entered in this worksheet is used
as input to Oracle Exalogic Configuration Utility. This worksheet includes
fields in the Exalogic Configurator spreadsheet that typically require data.

Table 6-6 Management Network Configuration Worksheet

Item Entry Description and Example

First Management IP address

or

First ILOM IP address

Subnet mask Subnet mask for the

Gateway IP address Gateway IP address for the

6.9.3 Client Access Network Configuration Worksheet (Required)

The client access network is used for client access to the Exalogic compute nodes.

Table 6-7 is the client access network configuration worksheet. Fill out this worksheet

and provide it to the Oracle representative, or use as a reference to complete the initial
configuration of your Exalogic machine. Information entered in this worksheet is used
as input to Oracle Exalogic Configuration Utility. This worksheet includes
fields in the Exalogic Configurator spreadsheet that typically require data.

First IP address in the
sequential range used for
management/network
interfaces. This network
must be distinct from all
other networks on the
Exalogic machine.

Example: 10.204.74.100

management network.

Example: 255.255.248.0

management network.

Example: 10.204.72.1

6-18 Oracle Exalogic Elastic Cloud Machine Owner's Guide