Dell PowerEdge M IO Aggregator User Manual
Users’ Guide for the Programmable MUX (PMUX)
on the M I/O Aggregator
Dell Networking OS v er sion 9.3(0.0)
Copyright © 2014 Dell Inc. All rights reserved. This product is protected by U.S. and
international copyright and intellectual property laws. Dell and the Dell logo are trademarks
of Dell Inc. in the United States and/or other jurisdictions. All other marks and names
mentioned herein may be trademarks of their respective companies.
Introduction
This document provides configuration instructions and examples for the Programmable MUX
(PMUX mode) for the Dell Networking M I/O Aggregator using Dell Networking OS version
9.3(0.0). This document includes the following Programmable MUX features:
• Programmable MUX (PMUX)
o Multiple uplink link aggregation group (LAGs)
10G member ports
40G member ports
o Uplink failure detection (UFD)
o Virtual local area network (VLAN) configurations on a physical port/port-channel
o Virtual link trunking (VLT)
o Stacking
o N-port identifier virtualization (NPIV)
NOTE: For more information, refer to the M IO Aggregator Command Line Interface for Dell
Networking OS Version 9.2(0.2)/9.2(0.0) and the M IO Aggregator Configuration Guide for Dell
Networking OS Version 9.2(0.2)/9.2(0.0).
I/O Aggregator (IOA) Programmable MUX (PMUX) Mode
IOA PMUX is a mode that provides flexibility of operation with added configurability. This
involves creating multiple LAGs, configuring VLANs on uplinks and the server side, configuring
data center bridging (DCB) parameters, and so forth.
By default, IOA starts up in IOA Standalone mode. You can change to PMUX mode by executing
the following commands and then reloading the IOA. After the IOA reboots, the IOA operates in
PMUX mode. PMUX mode supports both stacking and VLT operations.
Configuring and Changing to PMUX Mode
After the IOA is operational in the default Standalone mode:
1. Connect the terminal to the console port on the IOA to access the CLI and enter the
following commands:
Login: username
Password: *****
Dell> enable
Dell#
Dell#show system stack-unit 0 iom-mode
Unit Boot-Mode Next-Boot
-----------------------------------------------0 standalone standalone
Dell#
2. Change IOA mode to PMUX mode.
Dell(conf)# stack-unit 0 iom-mode programmable-mux
Where stack-unit 0 defines the default stack-unit number.
3. Delete the startup configuration file.
Dell# delete startup-config
4. Reboot the IOA by entering the reload command.
Dell# reload
5. Repeat the above steps for each member of the IOA in PMUX mode.
After system is up, you can see the PMUX mode status:
Dell#sh system stack-unit 0 iom-mode
Unit Boot-Mode Next-Boot
-----------------------------------------------0 programmable-mux programmable-mux
Dell#
The IOA is now ready for PMUX operations.
Configuring the Commands without a Separate User Account
Starting with Dell Networking OS version 9.3(0.0), you can configure the PMUX mode CLI
commands without having to configure a new, separate user profile. The user profile you
defined to access and log in to the switch is sufficient to configure the PMUX mode commands.
The IOA PMUX Mode CLI Commands section lists the PMUX mode CLI commands that you
can now configure without a separate user account.
Multiple Uplink LAGs
Unlike IOA Automated modes (Standalone, VLT, and Stacking Modes), the IOA Programmable
MUX can support multiple uplink LAGs. You can provision multiple uplink LAGs.
Note: In order to avoid loops, only disjoint VLANs are allowed between the uplink ports/uplink
LAGs and uplink-to-uplink switching is disabled.
Multiple Uplink LAGs with 10G Member Ports
The following sample commands configure multiple dynamic uplink LAGs with 10G member
ports based on LACP.
1. Bring up all the ports.
Dell#configure
Dell(conf)#int range tengigabitethernet 0/1 - 56
Dell(conf-if-range-te-0/1-56)#no shutdown
2. Associate the member ports into LAG-10 and 11.
Dell#configure
Dell(conf)#int range tengigabitethernet 0/41 - 42
Dell(conf-if-range-te-0/41-42)#port-channel-protocol lacp
Dell(conf-if-range-te-0/41-42-lacp)#port-channel 10 mode
active
Dell(conf-if-range-te-0/41-42-lacp)#end
Dell#
Dell#configure
Dell(conf)#int tengigabitethernet 0/43
Dell(conf-if-te-0/43)#port-channel-protocol lacp
Dell(conf-if-te-0/43-lacp)#port-channel 11 mode active
Dell(conf-if-te-0/43-lacp)#end
Dell#
3. Show the LAG configurations and operational status.
Dell#show interface port-channel brief
Codes: L - LACP Port-channel
O - OpenFlow Controller Port-channel
LAG Mode Status Uptime Ports
L 10 L3 up 00:01:00 Te 0/41 (Up)
Te 0/42 (Up)
L 11 L3 up 00:00:01 Te 0/43 (Up)
Dell#
4. Configure the port mode, VLAN, and so forth on the port-channel.
Dell#configure
Dell(conf)#int port-channel 10
Dell(conf-if-po-10)#portmode hybrid
Dell(conf-if-po-10)#switchport
Dell(conf-if-po-10)#vlan tagged 1000
Dell(conf-if-po-10)#link-bundle-monitor enable
Dell#configure
Dell(conf)#int port-channel 11
Dell(conf-if-po-11)#portmode hybrid
Dell(conf-if-po-11)#switchport
Dell(conf-if-po-11)#vlan tagged 1000
% Error: Same VLAN cannot be added to more than one uplink
port/LAG.
Dell(conf-if-po-11)#vlan tagged 1001
Dell(conf-if-po-11)#link-bundle-monitor enable
Dell#show vlan
Codes: * - Default VLAN, G - GVRP VLANs, R - Remote Port
Mirroring VLANs, P - Primary, C - Community, I - Isolated
O - Openflow
Q: U - Untagged, T - Tagged
x - Dot1x untagged, X - Dot1x tagged
o - OpenFlow untagged, O - OpenFlow tagged
G - GVRP tagged, M - Vlan-stack, H - VSN tagged
i - Internal untagged, I - Internal tagged, v - VLT
untagged, V - VLT tagged
NUM Status Description Q Ports
* 1 Active U Po10(Te 0/41-42)
U Po11(Te 0/43)
1000 Active T Po10(Te 0/41-42)
1001 Active T Po11(Te 0/43)
Dell#
5. Show LAG member ports utilization.
Dell#show link-bundle-distribution
Link-bundle trigger threshold - 60
LAG bundle - 10 Utilization[In Percent] - 0 Alarm State
- Inactive
Interface Line Protocol Utilization[In Percent]
Te 0/41 Up 0
Te 0/42 Up 0
LAG bundle - 11 Utilization[In Percent] - 0 Alarm State
- Inactive
Interface Line Protocol Utilization[In Percent]
Te 0/43 Up 0
Dell#
Multiple Uplink LAGs with 40G Member Ports
By default in IOA, native 40G QSFP+ optional module ports are used in Quad (4x10G) mode, to
convert Quad mode to Native 40G mode, refer to the sample configuration. Also note,
converting between Quad mode and Native mode, and vice versa, requires that you reload the
system for the configuration changes to take effect.
The following sample commands configure multiple dynamic uplink LAGs with 40G member
ports based on LACP.
1. Convert the quad mode (4x10G) ports to native 40G mode.
Dell#configure
Dell(conf)#no stack-unit 0 port 33 portmode quad
Disabling quad mode on stack-unit 0 port 33 will make interface
configs of Te 0/33 Te 0/34 Te 0/35 Te 0/36 obsolete after a save
and reload.
[confirm yes/no]:yes
Please save and reset unit 0 for the changes to take effect.
Dell(conf)#no stack-unit 0 port 37 portmode quad
Disabling quad mode on stack-unit 0 port 37 will make interface
configs of Te 0/37 Te 0/38 Te 0/39 Te 0/40 obsolete after a save
and reload.
[confirm yes/no]:yes
Please save and reset unit 0 for the changes to take effect.
Dell(conf)#no stack-unit 0 port 49 portmode quad
Disabling quad mode on stack-unit 0 port 49 will make interface
configs of Te 0/49 Te 0/50 Te 0/51 Te 0/52 obsolete after a save
and reload.
[confirm yes/no]:yes
Please save and reset unit 0 for the changes to take effect.
Dell(conf)#no stack-unit 0 port 53 portmode quad
Disabling quad mode on stack-unit 0 port 53 will make interface
configs of Te 0/53 Te 0/54 Te 0/55 Te 0/56 obsolete after a save
and reload.
[confirm yes/no]:yes
Please save and reset unit 0 for the changes to take effect.
Dell(conf)#
2. Save the configuration.
Dell#write memory
!
01:05:48: %STKUNIT0-M:CP %FILEMGR-5-FILESAVED: Copied runningconfig to startup-config in flash by default
Dell#reload
Proceed with reload [confirm yes/no]: yes
3. Configure the port-channel with 40G member ports.
Dell#configure
Dell(conf)#interface range fortygige 0/33, fortygige 0/37
Dell(conf-if-range-fo-0/33,fo-0/37)#no shut
Dell(conf-if-range-fo-0/33,fo-0/37)#port-channel-protocol lacp
Dell(conf-if-range-fo-0/33,fo-0/37-lacp)#port-channel 20 mode
active
Dell(conf)#
Dell(conf)#int fortygige 0/49
Dell(conf-if-fo-0/49)#port-channel-protocol lacp
Dell(conf-if-fo-0/49-lacp)#port-channel 21 mode active
Dell(conf-if-fo-0/49-lacp)#
Dell(conf-if-fo-0/49)#no shut
4. Configure the port mode, VLAN, and so forth on the port-channel.
Dell#configure
Dell(conf)#int port-channel 20
Dell(conf-if-po-20)#portmode hybrid
Dell(conf-if-po-20)#switchport
Dell(conf-if-po-20)#no shut
Dell(conf-if-po-20)#ex
Dell(conf)#int port-channel 21
Dell(conf-if-po-21)#portmode hybrid
Dell(conf-if-po-21)#switchport
Dell(conf-if-po-21)#no shut
Dell(conf-if-po-21)#end
Dell#
5. Show the port channel status.
Dell#sh int port-channel br
Codes: L - LACP Port-channel
O - OpenFlow Controller Port-channel
LAG Mode Status Uptime Ports
L 20 L2 up 00:00:53 Fo 0/33 (Up)
Fo 0/37 (Up)
L 21 L2 up 00:00:02 Fo 0/49 (Up)
Dell#
Dell(conf)#int port-channel 20
Dell(conf-if-po-20)#vlan tagged 1000
Dell(conf-if-po-20)#
Dell(conf-if-po-21)#vlan tagged 1000
% Error: Same VLAN cannot be added to more than one uplink
port/LAG.
Dell(conf-if-po-21)#vlan tagged 1001
Dell(conf-if-po-21)#
6. Show the VLAN status.
Dell#show vlan
Codes: * - Default VLAN, G - GVRP VLANs, R - Remote Port
Mirroring VLANs, P - Primary, C - Community, I - Isolated
O - Openflow
Q: U - Untagged, T - Tagged
x - Dot1x untagged, X - Dot1x tagged
o - OpenFlow untagged, O - OpenFlow tagged
G - GVRP tagged, M - Vlan-stack, H - VSN tagged
i - Internal untagged, I - Internal tagged, v - VLT untagged,
V - VLT tagged
NUM Status Description Q Ports
* 1 Active U Po20(Fo 0/33,37)
U Po21(Fo 0/49)
1000 Active T Po20(Fo 0/33,37)
1001 Active T Po21(Fo 0/49)
Dell#
Uplink Failure Detection (UFD)
UFD provides detection of the upstream connectivity loss and, if used with network interface
controller (NIC) teaming, automatic recovery from a failed link.
1. Create the UFD group and associate the downstream and upstream ports.
Dell#configure
Dell(conf)#uplink-state-group 1
Dell(conf-uplink-state-group-1)#
Dell(conf-uplink-state-group-1)#upstream port-channel 128
Dell(conf-uplink-state-group-1)#downstream
tengigabitethernet 0/1-32
2. Show the running configurations in the UFD-group 1.
Dell(conf-uplink-state-group-1)#show config
!
uplink-state-group 1
downstream TenGigabitEthernet 0/1-32
upstream Port-channel 128
Dell(conf-uplink-state-group-1)#
3. Show the UFD status.
Dell#show uplink-state-group detail
(Up): Interface up (Dwn): Interface down (Dis):
Interface disabled
Uplink State Group : 1 Status: Enabled, Up
Upstream Interfaces : Po 128(Up)
Downstream Interfaces : Te 0/1(Dwn) Te 0/2(Dwn) Te 0/3(Dwn)
Te 0/4(Up) Te 0/5(Up)
Te 0/6(Dwn) Te 0/7(Up) Te 0/8(Dwn)
Te 0/9(Dwn) Te 0/10(Dwn)
Te 0/11(Dwn) Te 0/12(Up) Te
0/13(Up) Te 0/14(Dwn) Te 0/15(Up)
Te 0/16(Dwn) Te 0/17(Dwn) Te
0/18(Dwn) Te 0/19(Dwn) Te 0/20(Dwn)
Te 0/21(Dwn) Te 0/22(Dwn) Te
0/23(Dwn) Te 0/24(Dwn) Te 0/25(Dwn)
Te 0/26(Dwn) Te 0/27(Dwn) Te
0/28(Dwn) Te 0/29(Dwn) Te 0/30(Dwn)
Te 0/31(Dwn) Te 0/32(Dwn)
Dell#
NOTE: In this example, if port-channel 128 goes down, the downstream interfaces are brought
operationally down (set to UFD error-disabled). Similarly, if the upstream port-channel
goes up, the downstream ports are brought up (cleared from UFD error-disabled).
VLAN Configuration on Physical Ports and Port-Channels
Unlike other Dell Networking OS platforms, IOA allows VLAN configurations on port and portchannel levels. This allows you to assign VLANs to a port/port-channel.
Note: In PMUX mode, In order to avoid loops, only disjoint VLANs are allowed between the
uplink ports/uplink LAGs and uplink-to-uplink switching is disabled.
1. Initialize the port with configurations such as admin up, portmode, and switchport.
Dell#configure
Dell(conf)#int tengigabitethernet 0/1
Dell(conf-if-te-0/1)#no shutdown
Dell(conf-if-te-0/1)#portmode hybrid
Dell(conf-if-te-0/1)#switchport
2. Configure the tagged VLANs 10 through 15 and untagged VLAN 20 on this port.
Dell(conf-if-te-0/1)#vlan tagged 10-15
Dell(conf-if-te-0/1)#vlan untagged 20
Dell(conf-if-te-0/1)#
3. Show the running configurations on this port.
Dell(conf-if-te-0/1)#show config
!
interface TenGigabitEthernet 0/1
portmode hybrid
switchport
vlan tagged 10-15
vlan untagged 20
no shutdown
Dell(conf-if-te-0/1)#end
Dell#
4. Initialize the port-channel with configurations such as admin up, portmode, and
switchport.
Dell#configure
Dell(conf)#int port-channel 128
Dell(conf-if-po-128)#portmode hybrid
Dell(conf-if-po-128)#switchport
5. Configure the tagged VLANs 10 through 15 and untagged VLAN 20 on this port-channel.
Dell(conf-if-po-128)#vlan tagged 10-15
Dell(conf-if-po-128)#
Dell(conf-if-po-128)#vlan untagged 20
6. Show the running configurations on this port-channel.
Dell(conf-if-po-128)#show config
!
interface Port-channel 128
portmode hybrid
switchport
vlan tagged 10-15
vlan untagged 20
shutdown
Dell(conf-if-po-128)#end
Dell#
7. Show the VLAN configurations.
Dell#show vlan
Codes: * - Default VLAN, G - GVRP VLANs, R - Remote Port
Mirroring VLANs, P - Primary, C - Community, I - Isolated
O - Openflow
Q: U - Untagged, T - Tagged
x - Dot1x untagged, X - Dot1x tagged
o - OpenFlow untagged, O - OpenFlow tagged
G - GVRP tagged, M - Vlan-stack, H - VSN tagged
i - Internal untagged, I - Internal tagged, v - VLT
untagged, V - VLT tagged
NUM Status Description Q Ports
* 1 Active U Te 0/33
10 Active T Po128(Te 0/41-42)
T Te 0/1
11 Active T Po128(Te 0/41-42)
Loading...