Dell PowerSwitch S4148U-ON User Manual
Dell EMC Networking Fibre Channel
Deployment with S4148U-ON in F_port Mode
Connecting server Fibre Channel HBAs to Fibre Channel storage using two S4148UON leaf switches running OS10 Enterprise Edition
Dell EMC Networking Infrastructure Solutions
June 2018
A Dell EMC Deployment Guide
Date
Rev.
Description
Authors
June 2018
1.0
Initial release
Jim Slaughter, Andrew Waranowski
Revisions
The information in this publication is provided “as is.” Dell Inc. makes no representations or warranties of any kind with respect to the information in this
publication, and specifically disclaims implied warranties of merchantabili ty or fitness for a particular purpose.
Use, copying, and distribution of any software described in this publication requires an applicable software license.
Copyright © 2018 Dell Inc. or its subsidiari es. All Rights Reserved. Dell, EMC, and other tradem arks are trademarks of Dell Inc. or its subsidi ari es. Other
trademarks may be the property of their respective owners. Published in the USA [6/15/2018] [Deployment Guide]
Dell believes the information in this document is accurate as of its publication date. The information is subject to change without notice.
2 Dell EMC Networking Fibre Channel Deployment with S4148U-ON in F_port Mode | version 1.0
Table of contents
Revisions............................................................................................................................................................................. 2
1 Introduction ................................................................................................................................................................... 5
1.1 Typographical conventions ................................................................................................................................. 6
1.2 Attachments ........................................................................................................................................................ 6
2 Hardware overview ....................................................................................................................................................... 7
2.1 Dell EMC Networking S4148U-ON ..................................................................................................................... 7
2.2 Dell EMC Networking S3048-ON ....................................................................................................................... 7
2.3 Dell EMC PowerEdge R640 server .................................................................................................................... 7
2.4 Dell EMC Unity 500F storage array .................................................................................................................... 8
3 Topology overview ....................................................................................................................................................... 9
3.1 FC SAN topology detail .................................................................................................................................... 10
3.2 OOB management network .............................................................................................................................. 11
4 Preparation ................................................................................................................................................................. 12
4.1 Reset server FC HBAs to factory defaults ........................................................................................................ 12
4.2 Determine FC HBA port WWPNs ..................................................................................................................... 12
4.3 Determine Unity 500F storage array FC WWPNs ............................................................................................ 15
4.4 VMware preparation ......................................................................................................................................... 16
4.4.1 VMware ESXi download and installation .......................................................................................................... 16
4.4.2 Install and configure VMware vCenter Server 6.5 U1 ...................................................................................... 16
4.4.3 Add ESXi hosts to vCenter Server ................................................................................................................... 16
5 S4148U-ON switch configuration ............................................................................................................................... 17
5.1 Prepare switches .............................................................................................................................................. 17
5.1.1 Factory default configuration ............................................................................................................................ 17
5.1.2 Set switch port profile ....................................................................................................................................... 17
5.2 Configure switches ........................................................................................................................................... 18
6 S4148U-ON validation ................................................................................................................................................ 21
6.1 show interface status ........................................................................................................................................ 21
6.2 show fc switch ................................................................................................................................................... 21
6.3 show fc ns switch .............................................................................................................................................. 21
6.4 show fc zoneset active ..................................................................................................................................... 23
6.5 show vfabric ...................................................................................................................................................... 23
7 Configure Unity FC storage ........................................................................................................................................ 25
3 Dell EMC Networking Fibre Channel Deployment with S4148U-ON in F_port Mode | version 1.0
7.1 Create a storage pool ....................................................................................................................................... 25
7.2 Add ESXi hosts ................................................................................................................................................. 26
7.3 Create LUNs and configure host access .......................................................................................................... 26
8 Configure storage on ESXi hosts ............................................................................................................................... 28
8.1 Rescan storage................................................................................................................................................. 28
8.2 Create a datastore ............................................................................................................................................ 29
8.3 Create a virtual disk .......................................................................................................................................... 30
8.4 Configure the virtual disk .................................................................................................................................. 32
A Validated components ................................................................................................................................................ 33
A.1 Switches ........................................................................................................................................................... 33
A.2 PowerEdge R640 servers ................................................................................................................................. 33
A.3 Storage ............................................................................................................................................................. 33
A.4 VMware software .............................................................................................................................................. 34
A.5 VMware licenses............................................................................................................................................... 34
B Technical support and resources ............................................................................................................................... 35
B.1 Dell EMC product manuals and technical guides ............................................................................................. 35
B.2 VMware product manuals and technical guides ............................................................................................... 35
C Support and feedback ................................................................................................................................................ 36
4 Dell EMC Networking Fibre Channel Deployment with S4148U-ON in F_port Mode | version 1.0
1 Introduction
Our vision at Dell EMC is to be the essential infrastructure company in the data center for today’s applications
and for the cloud-native world we are entering. To attain that vision, the Dell EMC portfolio focuses on making
every component of data center infrastructure (servers, storage, and networking) compelling by making the
value of the integrated solution greater than the sum of the parts.
In a leaf-spine data center environment, two Dell EMC Networking S4148U-ON switches running OS10
Enterprise Edition (OS10EE) may be used as a leaf pair with Ethernet ports connected to spine switches for
production TCP/IP traffic. The same leaf pair may also be used in F_port mode for direct connections to
server Fibre Channel (FC) host bus adapters (HBAs) and FC storage.
This guide covers configuration of the FC portion of the network. This includes configuration of two S4148UON switches, PowerEdge server FC HBAs, VMware ESXi hosts, and a Unity 500F storage array. The goal of
this guide is to enable a network administrator or deployment services engineer to deploy a pair of S4148UONs in an FC environment using the hardware and software described.
Note: For servers using converged network adapters (CNAs) instead of FC HBAs, see FCoE-to-Fibre
Channel Deployment with S41 48U-ON in F_port Mode.
5 Dell EMC Networking Fibre Channel Deployment with S4148U-ON in F_port Mode | version 1.0
1.1 Typographical conventions
The CLI and GUI examples in this document use the following conventions:
Monospace Text CLI examples
Underlined Monospace Text CLI examples that wrap the page. This text is entered as a single
command.
Italic Monospace Text Variables in CLI examples
Bold Monospace Text Commands entered at the CLI prompt
Bold text GUI fields and information entered in the GUI
1.2 Attachments
This .pdf includes switch configuration file attachments. To access attachments in Adobe Acrobat Reader,
click the icon in the left pane halfway down the page, then click the icon.
.
6 Dell EMC Networking Fibre Channel Deployment with S4148U-ON in F_port Mode | version 1.0
2 Hardware overv i ew
This section briefly describes the primary hardware used to validate this deployment. A complete listing of
hardware validated for this guide is provided in Appendix A.
2.1 Dell EMC Networking S4148U-ON
The S4148U-ON enables converging LAN and SAN traffic in a single 1-RU, multilayer switch. It includes
twenty-four 10GbE ports, two 40GbE ports, four 10/25/40/50/100GbE or FC8/16/32 ports, and twenty-four
10GbE or FC8/16 ports. Two S4148U-ONs are used as leaf switches in this guide for Fibre Channel
connectivity to the SAN and Ethernet connectivity to the leaf-spine network.
Dell EMC Networking S4148U-ON
2.2 Dell EMC Networking S3048-ON
The S3048-ON is a 1-RU switch with forty-eight 1GbE BASE-T ports and four 10GbE SFP+ ports. In this
guide, one S3048-ON switch is used per rack for out-of-band (OOB) management traffic.
Dell EMC Networking S3048-ON
2.3 Dell EMC PowerEdge R640 server
The PowerEdge R640 is a 1-RU, two-socket server platform with support for up to 56 processor cores, 3TB
memory, and up to twelve SAS/SATA HDD/SSD drives or eight NVMe drives. Two R640 servers are used in
the deployment in this guide.
Dell EMC PowerEdge R640
7 Dell EMC Networking Fibre Channel Deployment with S4148U-ON in F_port Mode | version 1.0
2.4 Dell EMC Unity 500F storage array
The Unity 500F storage platform delivers all-flash storage with up to 8PB raw capacity. It has concurrent
support for NAS, iSCSI, and FC protocols. The Disk Processing Enclosure (DPE) has a 2-RU form factor,
redundant Storage Processors (SPs), and supports up to twenty-five 2.5" drives. Additional 2-RU Disk Array
Enclosures (DAEs) may be added providing twenty-five additional drives each.
Dell EMC Unity 500F front view
Dell EMC Unity 500F rear view
8 Dell EMC Networking Fibre Channel Deployment with S4148U-ON in F_port Mode | version 1.0
Rack 1
S4148U-Leaf1 S4148U-Leaf2
Unity 500F
SP A
SP B
R640-1
FC SAN A (FC ports)
LAN (E t herne t p orts )
LAN (E t herne t p orts )
VLTi (Et hernet port s)
FC SAN B (FC ports)
R640-2
Rack n
Leaf Leaf
Spine2Spine1
3 Topology overview
Each S4148U-ON provides universal ports that may be configured as either FC or Ethernet. The mix of FC
and Ethernet ports allows the switches to simultaneously connect directly to an FC SAN for storage traffic and
act as leafs in a leaf-spine network for production TCP/IP traffic.
Note: FC SAN traffic does not traverse the leaf-spine network, or the VLT interconnect (VLTi). FC traffic is
contained within the rack.
A combined FC SAN and le af -spine topology is shown in the diagram below.
Note: Using a leaf-spine network in the data center is considered a best practice. This document covers
configuration of the FC SAN portion of the topology above. For the leaf-spine Ethernet portion, refer to Dell
EMC Networking Layer 3 Leaf-Spine Deployment and Best Practices with OS10EE.
Combined FC SAN and leaf-spine topology
9 Dell EMC Networking Fibre Channel Deployment with S4148U-ON in F_port Mode | version 1.0
R ack 1
S4148U-Leaf1 S4148U-Leaf2
Unity 500F
1
R640-1
SP B
SP A
0
0
1
1
FC SAN A (16Gb FC)
FC SAN B (16Gb FC)
fc5fc7fc1 fc3
fc5 fc7 fc1fc3
Leaf port numbers shown are
abbreviated, e.g., fc1/1/1 is
abbreviated as fc1.
2
R640-2
1
2
3.1 FC SAN topology detail
Each S4148U-ON switch is placed in F_port mode and acts as an FC switch. This enables direct connections
to N_port devices such as FC storage and server FC HBAs w ithout the nee d for additional dedicated FC
switches.
The FC SAN topology used in this guide is shown in Figure 7.
FC SAN topology
Each PowerEdge R640 server in this deployment contains one QLogic QLE2662 FC HBA with two 16Gb FC
ports. Each HBA port is connected to an FC port on one S4148U-ON as shown.
The Unity 500F storage array contains redundant storage proc ess or s , SP A and SP B. 16Gb FC ports from
the Unity SPs are directly connected to FC ports on the S4148U-ON switches as shown.
10 Dell EMC Networking Fibre Channel Deployment with S4148U-ON in F_port Mode | version 1.0
.
S3048
-ON
R640-2
R640-1
S4148U-
Leaf1
S4148U-
Leaf2
OOB
Management
Network
Rack n
Rack 1
Unity
500F
S3048-ON
Z9100Spine1
Z9100-
Spine2
3.2 OOB management network
The out-of-band (OOB) management network is an isolated network for management traffic only. It is used by
administrators to remotely configure and manage servers, switches, and storage devices. Production traffic
initiated by the network end users does not traverse the management network.
An S3048-ON switch is installed at the top of each rack for OOB management connections as shown.
OOB management network connections
Four 10GbE SFP+ ports are available on each S3048-ON switch for use as uplinks to the OOB management
network core. Downstream connections to servers, switches, and storage devices are 1GbE BASE-T.
11 Dell EMC Networking Fibre Channel Deployment with S4148U-ON in F_port Mode | version 1.0
The dedicated OOB management port of each leaf and spine switch is used for these connections. Each
PowerEdge R640 server has two connections to the S3048-ON: the server’s iDRAC port and a 1GbE NIC
that is used for ESXi host management .
Note: For this deployment example, each server’s ESXi management connection is made using one of the
two QLogic 57800 1GbE BASE-T ports on the rNDC.
The Unity 500F storage array has two dedicated management ports: one for SP A and one for SP B. Both are
connected to the S3048-ON.
Loading...