Dell PowerSwitch S5148F-ON, PowerSwitch S5232F-ON Manual

Dell EMC Networking OS10 Enterprise Edition

Deployment Guide with Cisco ACI

Abstract

This document provides steps for the configuration and deployment of

Dell EMC Networking switches running Dell EMC OS10 Enterprise

Edition, into a Cisco ACI environment.

December 2018

Dell EMC Configuration and Deployment Guide

Revisions

Date Description

December 2018 Initial release

The information in this publication is provided “as is.” Dell Inc. makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose.

Use, copying, and distribution of any software described in this publication requires an applicable software license.

© 2018 Dell Inc. or its subsidiaries. All Rights Reserved. Dell, EMC, Dell EMC and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be trademarks of their respective owners.

Dell believes that the information in this document is accurate as of its publication date. The information is subject to change without notice.

2 Dell EMC Networking OS10 Enterprise Edition Deployment Guide with Cisco ACI

Table of contents

	Revisions		.............................................................................................................................................................................	2
1		Introduction...................................................................................................................................................................		5
		1.1	Typographical conventions .................................................................................................................................	5
		1.2 ........................................................................................................................................................	Attachments	6
2		Hardware .......................................................................................................................................................overview		7
		2.1 .....................................................................................................................	Dell EMC Networking S5248F - ON	7
		2.2 .....................................................................................................................	Dell EMC Networking S4148F - ON	7
		2.3 .......................................................................................................................	Dell EMC Networking S3048 - ON	7
		2.4 ...............................................................................................................................	Cisco Nexus C93180YC - EX	8
		2.5 .....................................................................................................................................	Cisco Nexus C9336 - PQ	8
		2.6 ............................................................................................................................	Supported Dell EMC switches	8
3		Cisco ..............................................................................................................Application Centric Infrastructure (ACI)		9
4		Dell EMC .................................................................................ToR switches with Cisco ACI environment overview		10
		4.1 ......................................................................................................................................	Validated environment	11
5		OOB Management ........................................................................................................................................network		13
6		Cisco ...........................................................................................................................................APIC configuration		15
7		Configure .................................................................................................................................S5248F-ON switches		17
		7.1 ......................................................................................................................	OOB management configuration	17
		7.2 ..............................................................................................................................................	VLT configuration	17
		7.3 ........................................................................................................................................	Configure the VLANs	18
		7.4 ...............................................................................................................................	Server - facing configuration	19
		7.5 ........................................................................................................................	Switch pair uplink configuration	20
8		vCenter ..................................................................................................................................configuration overview		21
9		Verify .....................................................................................................................................................configuration		23
		9.1 ...........................................................................................................................	Validation using OS10EE CLI	23
		9.1.1 ........................................................................................................................	show vlt [domain - id] command	23
		9.1.2 ...................................................................................................	show vlt [domain - id] vlt - port - detail command	24
		9.1.3 .............................................................................................	show interface port channel summary command	24
		9.1.4 .........................................................................................................................	show lldp neighbors command	24
		9.1.5 .................................................................................................................	show spanning - tree brief command	25
		9.1.6 ...................................................................................................................	show uplink state group command	25
		9.2 .........................................................................................................................................	Cisco ACI validation	26
		9.2.1 ...................................................................................................................................	Verify vPC configuration	26
		9.2.2 ..............................................................................................................	Verify physical interface configuration	28
		9.2.3 .......................................................................................................................	Verify ACI is learning endpoints	29
3		Dell EMC Networking OS10 Enterprise Edition Deployment Guide with Cisco ACI

	9.3	Verify connectivity between VMs......................................................................................................................	30
A	Additional information.................................................................................................................................................		31
	A.1	Reset OS10EE switches to factory defaults.....................................................................................................	31
	A.2	Spanning Tree Protocol recommendations ......................................................................................................	31
B	Validated components................................................................................................................................................		32
	B.1	Dell EMC Networking switches.........................................................................................................................	32
	B.2	Cisco ACI components .....................................................................................................................................	32
C	Technical resources ...................................................................................................................................................		33
D	Support and feedback ................................................................................................................................................		34

4 Dell EMC Networking OS10 Enterprise Edition Deployment Guide with Cisco ACI

1 Introduction

Dell EMC Networking is committed to providing customers with modern data center networking technology to be the foundation for digital transformation. Customers can choose from a wide range of industry-standard network applications, operating systems, and hardware platforms to realize cost savings and improvement in service agility.

This document provides an example for the deployment of a pair of top-of-rack (ToR) Dell EMC Networking switches into an existing Cisco Application Centric Infrastructure (ACI) environment. The example details how Layer 2 domains can be extended into and out of an ACI fabric with Dell EMC Networking switches in a way that provides high throughput and failure tolerance. The example shows how devices that are connected to Dell EMC Networking switches can be integrated with the ACI fabric to communicate with and access ACI resources.

Dell EMC Networking S5248F-ON switch

The deployment example includes instructions to configure a pair of Dell EMC S5248F-ON switches. The example demonstrates connectivity to a pair of Cisco Nexus C93180YC-EX switches in ACI mode.

Table 1 outlines what this document is and is not.

Dell EMC Networking OS10EE Deployment Guide with Cisco ACI

	This guide is			This guide is not/does not
	A reference for basic configuration of a top-of-			A guide for all features of OS10EE-based
	rack (ToR) pair of switches using OS10EE			switches
	An example of one way to add ToR switches to			A guide for adding Cisco ACI to a complete leaf-
	an existing Cisco ACI environment			spine deployment

1.1Typographical conventions

The CLI and GUI examples in this document use the following conventions:

Monospace Text	CLI examples
Underlined Monospace Text	CLI examples that wrap the page
Italic Monospace Text	Variables in CLI examples
Bold Monospace Text	Commands entered at the CLI prompt, or to highlight information in CLI
	output
Bold text	UI elements and information that is entered in the GUI

5 Dell EMC Networking OS10 Enterprise Edition Deployment Guide with Cisco ACI

1.2Attachments

This document in .pdf format includes one or more file attachments. To access attachments in Adobe Acrobat Reader, click the icon in the left pane halfway down the page, and then click the icon.

6 Dell EMC Networking OS10 Enterprise Edition Deployment Guide with Cisco ACI

2 Hardware overview

This section briefly describes the hardware that is used to validate the deployment examples in this document. Appendix B contains a complete listing of hardware and software that is validated for this guide.

Note: While the steps in this document were validated using the specified Dell EMC Networking switches and operating systems, they may be used for other Dell EMC Networking switch models using the same networking operating system version or later assuming the switch has the available port numbers, speeds, and types. The two switch models in this section are detailed based on being the most commonly deployed ToR switches in the current portfolio.

2.1Dell EMC Networking S5248F-ON

The Dell EMC Networking S5248F-ON is a 1-Rack Unit (RU) switch with forty-eight 25GbE SFP28 ports, two 2x100GbE QSFP28-DD ports, and four 100GbE QSFP28 ports. The high-performance S5248F-ON switch is an optimal choice for ToR environments requiring connectivity for 10GbE and 25GbE compute and storage.

Dell EMC Networking S5248F-ON switch

2.2Dell EMC Networking S4148F-ON

The Dell EMC Networking S4148F-ON is a 1-RU switch with forty-eight 10GbE SFP+ ports, two 40GbE QSFP+ ports, and four 100GbE QSFP28 ports. The high-performance S4148F-ON switch is an optimal choice for ToR environments requiring connectivity for 10GbE compute and storage.

Dell EMC Networking S4148F-ON switch

2.3Dell EMC Networking S3048-ON

The Dell EMC Networking S3048-ON is a 1-RU switch with forty-eight 1GbE BASE-T ports and four 10GbE SFP+ ports. In this document, one S3048-ON supports out-of-band (OOB) management traffic for all examples.

Dell EMC Networking S3048-ON

7 Dell EMC Networking OS10 Enterprise Edition Deployment Guide with Cisco ACI

2.4Cisco Nexus C93180YC-EX

The Cisco Nexus C93180YC-EX switch is a 1-RU switch with forty-eight 1/10/25GbE ports and six 40/100GbE ports. A pair of Cisco Nexus C93180YC-EX switches are used as Cisco ACI leaf switches in the demonstrated environment in this guide.

2.5Cisco Nexus C9336-PQ

The Cisco Nexus C9336-PQ switch is a 2-RU switch with thirty-six 40GbE QSFP+ ports. One Cisco Nexus C9336-PQ switch is used as a Cisco ACI spine switch in the demonstrated environment in this guide.

2.6Supported Dell EMC switches

The switch models highlighted in blue in Table 2, have been validated in the lab environment that is detailed in section 0. All Dell EMC Networking switches that run the OS10EE operating system can be used in a similar deployment with Cisco ACI. Tested and supported features in the Cisco ACI environment include VLT and Layer 2 operation.

Supported Dell EMC Networking switches

Dell EMC Networking Switch	OS10EE, version 10.4.0R3 and later
S5248F-ON	Supported, validated version 10.4.2
S4148F-ON	Supported
S5048F-ON	Supported
S5148F-ON	Supported
S5296F-ON	Supported
S5232F-ON	Supported
S6010-ON	Supported
S6100-ON	Supported
S4048-ON	Supported
S4048T-ON	Supported
S4112F-ON	Supported, validated version 10.4.2
S4112T-ON	Supported
S4128F-ON	Supported
S4128T-ON	Supported
S4148T-ON	Supported
S4148FE	Supported
S4148U	Supported, validated version 10.4.2
S4248FB-ON	Supported
S4248FBL-ON	Supported

Note: Dell EMC provides this supported list as is, without express or implied warranties of any kind. This list is for informational purposes only and may contain typographical and technical inaccuracies. Dell EMC is not liable for any damages that arise out of or in connection with the use of the information provided in this list.

Table 2 includes only switches that are commonly deployed as ToR switches. All switch models that run OS10EE deployed in a VLT topology in Layer 2 operation can be considered. Some switches contain features, such as Fibre Channel, that have not been validated to work with Cisco API and is out of the scope of this document.

8 Dell EMC Networking OS10 Enterprise Edition Deployment Guide with Cisco ACI

3 Cisco Application Centric Infrastructure (ACI)

Cisco ACI is an application focused, software-defined networking solution utilizing both software and traditional switching hardware. The solution is an overlay on Cisco’s high-performance switches, operating in an ACI mode managed by a controller. The Cisco Application Policy Infrastructure Controller (APIC) is a central management appliance that handles policy, visibility, security, and overall network control for the ACI environment.

Cisco ACI provides the following features within the ACI domain:

•Multi-tenant security

•Microsegmentation

•Application specific policy management

•Network availability and QoS

•Network automation

9 Dell EMC Networking OS10 Enterprise Edition Deployment Guide with Cisco ACI

4 Dell EMC ToR switches with Cisco ACI environment overview

The example that is shown in this paper covers deploying S5248F-ON switches connected to a Cisco ACI environment. By integrating the ToR switch pair into an ACI environment, compute resources within the rack can use ACI gateways and access ACI resources.

The validated Cisco ACI environment includes a pair of Nexus C93180YC-EX switches as leaf switches as shown in Figure 5. The C93180YC-EX leaf switch pair are connected to a single Nexus C9336-PQ spine using 40GbE uplinks (not shown).

Dell EMC Networking switches connected to Cisco ACI leaf switches

Connections from S5248F-ON switches to the C93180YC-EX leaf pair are 100 GbE. These connections are shown in blue in Figure 5.

Note: The wiring diagram in Figure 5 is drawn to show the types of connections in a carefully arranged fashion for clarity. The port numbers and connection locations may differ in the actual deployment.

No physical peer link is used between the Cisco ACI leaf switches. See the Cisco ACI documentation for more information.

10 Dell EMC Networking OS10 Enterprise Edition Deployment Guide with Cisco ACI

4.1Validated environment

In this example, two S5248F-ON switches are joined to an existing Cisco ACI environment. The rack contains two S5248F-ON and four PowerEdge R730xd servers.

The connections between the ACI environment and the S5248F-ON switches consist of double-sided multichassis link aggregation group (MLAG). The double-sided MLAG connection consists of a vPC on the Cisco ACI side and a VLT port channel on the S5248F-ON side.

All of the devices in the validated environment that are covered in this chapter, are connected as shown in Figure 6.

Validated Dell EMC ToR and ACI environment

Note: No physical peer link is used between the Cisco ACI leaf switches. See the Cisco ACI documentation for more information. Cisco recommends a minimum of three Application Policy Infrastructure Controllers (APICs) in a production environment. For this validation effort, a single APIC, named APIC-1, is used.

All Dell EMC PowerEdge R730xd rack servers in this example are running VMware ESXi 6.7.0. VMs named “web,” “app,” and “db” on the ESXi hosts are running Ubuntu Linux guest operating systems.

11 Dell EMC Networking OS10 Enterprise Edition Deployment Guide with Cisco ACI