LSI SAS6160 User Manual
LSISAS6160 SAS Switch
User Guide
Revision 1.1
September 2010
Revision History
Version and Date Description of Changes
Revision 1.1, Septembre 2010 First channel release.
LSI and the LSI logo are trademarks or registered trademarks of LSI Corporation or its subsidiaries. All other brand and product names may be trademarks of their respective companies.
LSI Corporation reserves the right to make changes to the product(s) or information disclosed herein at any time without notice. LSI Corporation does not assume any responsibility or liability arising
out of the application or use of any product or service described herein, except as expressly agreed to in writing by LSI Corporation; nor does the purchase, lease, or use of a pr oduct or serv ic e from
LSI Corporation convey a license under any patent rights, copyrights, trademark rights, or any other of the intellectual property rights of LSI Corporation or of third parties.
Corporate Headquarters Email Website
Milpitas, CA globalsupport@lsi.com www.lsi.com
800-372-2447
Document Number: DB15-000636-03
Copyright © 2009 LSI Corpora tion
All Rights Reserved
LSISAS6160 SAS Switch User Guide Table of Contents
Table of Contents
Chapter 1: Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .5
1.1 LSISAS6160 Switch Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .5
1.2 Serial Attached SCSI and the SAS6160 Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6
1.3 SAS Phys, Ports, and Connectors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9
1.4 SAS Connectors and Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11
1.5 SAS Routing and Zoning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
1.5.1 SAS Zoning Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
1.5.2 Creating SAS Zones . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13
1.5.3 Configuring SAS Zones . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15
1.6 Connecting Devices to the SAS6160 Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16
Chapter 2: Installation and Hardware Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
2.1 Unpacking the Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
2.2 Identifying Switch Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
2.2.1 SAS6160 Connectors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .24
2.2.2 SAS6160 LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .24
2.3 Installing the SAS6160 Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .24
2.3.1 Installing the SAS6160 Self . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25
2.4 Connecting to a Host . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27
2.5 Changing the Default Static IP Address . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27
2.5.1 Setting a Static IP Address . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27
2.5.2 Setting a Dynamic IP Address . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28
2.6 Connecting SAS and SATA Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29
2.7 Safety Notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29
2.7.1 FCC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29
2.7.2 Canada Mark . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
2.7.3 VCCI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
2.7.4 BSMI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
2.7.5 CCC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31
Chapter 3: SAS Domain Manager Graphical User Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
3.1 SDM-GUI Accounts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
3.2 Starting SDM-GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
3.3 Summary Tab and Menu Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34
3.4 File, Server, and Help Menu Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35
3.5 Views Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36
3.5.1 View End Device Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36
3.5.2 View Alias Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37
3.5.3 View Zone Groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38
3.5.4 View Zone Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .39
3.6 Domain Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .40
3.6.1 Alias Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .40
3.6.2 Automatically Configure Zone Groups and Zone Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41
3.6.3 Manually Configure Zone Groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44
3.6.4 Manually Configure Zone Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46
LSI Corporation | September 2010 Page 3
LSISAS6160 SAS Switch User GuideTable of Contents
3.7 Devices Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50
3.7.1 Properties Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51
3.7.2 Environmentals Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .52
3.7.3 Attached Devices Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .53
3.7.4 Phys Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54
3.7.5 Zone Group Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55
3.7.6 Operations Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .56
Chapter 4: SAS Domain Manager Command Line Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .59
4.1 Command Usage and Syntax . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .59
4.2 SDM-CLI Commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60
4.2.1 Domain Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60
4.2.2 Help Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60
4.2.3 Passwd Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .61
4.2.4 Quit Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .61
4.2.5 Alias Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .61
4.2.6 Device Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .62
4.2.7 Show Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .63
4.2.8 Zonegroup Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .64
4.2.9 Zoneset Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .65
4.3 Sample Output for Show Command . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .66
4.3.1 show alias . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .66
4.3.2 show alias <alias> . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .66
4.3.3 show device . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .66
4.3.4 show device <alias> . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .67
4.3.5 show domain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .68
4.3.6 show phy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .68
4.3.7 show phy <alias> . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .69
4.3.8 show phy <alias>: <phy> . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .71
4.3.9 show version . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .71
4.3.10 show zonegroup <name> . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .72
4.3.11 show zoneset active . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .72
4.3.12 show zoneset data <name> . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .72
Chapter 5: Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .73
Page 4 LSI Corporation | September 2010
LSISAS6160 SAS Switch User Guide Chapter 1: Overview
Chapter 1
Overview
This document is the primary reference for the LSISAS6160 Serial Attached SCSI (SAS)
switch. It describes the features of the switch and explains how to perform installation
and physical configuration of the switch. The document also explains how to use both
the web-based, and the command-driven SAS Domain Manager (SDM) utility interfaces
to create storage configurations in the SAS domain. It also includes troubleshooting
information.
This document assumes that you have some familiarity with SAS devices and SAS
hardware configuration. The following people are the intended audience of this
document:
| LSISAS6160 Switch Features
1.1 LSISAS6160 Switch Features
Engineers and managers who are evaluating the SAS6160 switch for possible use in
a system
System administrators and end users who are installing and using the SAS6160
switch
The SAS6160 switch has the following features:
A total of 14 external SAS connectors for SAS initiators and targets that use passive
cables
Two external SAS connectors for SAS initiators and targets that use active or passive
cables
Connectors support a SAS link rates of 6.0Gb/s, 3.0Gb/s, or 1.5Gb/s
10/100 Based-T Ethernet for enclosure management
Nonblocking feature provides simultaneous access of any port to any port at full
port bandwidth
LSI Corporation | September 2010 Page 5
| Serial Attached SCSI and the SAS6160 Switch
LSISAS6160 SAS Switch User GuideChapter 1: Overview
1.2 Serial Attached SCSI and the SAS6160 Switch
SAS replaces Ultra320 SCSI as the next phase in the evolution of the SCSI standard. The
SAS interface addresses enterprise data storage and retrieval requirements with
features such as point-to-point topology, 6.0Gb/s transfer rate, minimum arbitration
overhead, native support for both SAS and SATA drives, and smaller cables and
connectors.
In SAS storage environments, the SAS6160 switch allows connection of multiple targets
and initiators through a switched device for manageable scalability. The integrated
SDM application provides a central management point to view the SAS topology,
manage other switches or expanders in the domain, and to configure zoning to provide
exclusive access between endpoints in the domain. The SAS6160 switch allows data
centers to benefit from the improved performance, minimum arbitration overhead,
simplified cabling, and lower system implementation costs of SAS and SATA, while
easing migration from Direct Attached Storage.
Figure 1: The LSISAS6160 Switch
The SAS6160 switch uses two LSISAS2x36 6Gb/s SAS expanders, which are compliant
with the ANSI Serial Attached SCSI specification and support SATA as defined in the
Serial ATA: High Speed Serialized AT Attachment and the Serial ATA II: Port Selector
Specification.
The SAS6160 switch functions as a single expander and offers advanced hardware
management with an external power supply module, and two enclosure fans, and
temperature and power supply voltage sensing/alerts. The switch is housed in a
compact chassis for easy shelf placement in rack mounted server clusters.
NOTE: The two connectors on the upper left of the face plate (port 0 and port 2)
support active cabling for longer cable runs. Passive cables may also be connected to
these ports for normal cable runs.
Page 6 LSI Corporation | September 2010
LSISAS6160 SAS Switch User Guide Chapter 1: Overview
GR000006
Server
Server
JBOD
JBOD
RBOD
JBOD
RBOD
PC for Access to
SDM-GUI or SDM-CLI
LSISAS6160
Switch
The following figure shows how the SAS6160 switch centralizes management of all
application servers and data storage devices in the SAS domain.
| Serial Attached SCSI and the SAS6160 Switch
GR000006
Figure 2: LSISAS6160 Resource Management
In this simplified representation, the servers at the top of the diagram must access data
on the storage devices in the lower part of the diagram. The SAS6160 switch manages
the SAS configuration, allowing both servers to access all storage devices. Or, if zoning
is used, single application servers can access specific storage devices exclusively.
LSI Corporation | September 2010 Page 7
| Serial Attached SCSI and the SAS6160 Switch
SAS2x36
Expander
Master
SAS2x36
Expander
Slave
Dual Port
Memory
32 SAS Lanes 32 SAS Lanes
16 x4 External Mini SAS Connectors
4 SAS Lanes (for failover)
Flash
Memory
Fan Control
RTC
Temp
Sensor
Ethernet
Phy
PBSRAM
Memory
Flash
Memory
Fan Control
PBSRAM
Memory
Temp
Sensor
x4 x4
x2 x2
x2x2
You can connect multiple SAS6160 switches in various topologies to provide failover
support and to increase the number of connected devices in the SAS domain. The
theoretical upper limit of SAS devices in a domain is 16,000. Each SAS6160 switch can
handle 1000 SAS addresses.
The following figure shows a high-level block diagram of the SAS6160 switch.
LSISAS6160 SAS Switch User GuideChapter 1: Overview
Figure 3: Block Diagram of the LSISAS6160 Switch
This diagram contains the following functional blocks:
SAS2X36 Expander – This block includes such management functions as routing,
device discovery, and zoning. It also includes an embedded version of SDM. This
Page 8 LSI Corporation | September 2010
block controls the flow of data through the SAS connectors.
SAS Connectors – The SAS6160 switch has 16 x4 Mini SAS connectors, numbered 0
through 15. It supports connection to SAS devices at link rates of 3.0Gb/s and
6.0Gb/s.
Ethernet Phy – The external 10/100 Ethernet port provides access to the
browser-based SDM management application, which sets up storage
configurations in the SAS domain, monitors the status of the switch, and runs
diagnostic tests. It also provides access to the SDM command line interface (CLI).
Real Time Clock – The battery-powered real-time clock is set at the factory.
Fans – The SAS6160 switch enclosure contains two fans. The fan speed is regulated
based on the temperature inside the enclosure. You can monitor the status of the
fans with the SDM utility.
LSISAS6160 SAS Switch User Guide Chapter 1: Overview
Transmitter
Transmitter
Receiver
Receiver
RX-
RX+
TXTX+
TransceiverTransceiver
PhyPhy
Flash Memory – Each LSISA2x36 expander connects to a parallel flash through the
expander’s external memory interface. This flash is used for firmware storage and
execution, as well as nonvolatile data such as Ethernet MAC address and SAS WWID.
PBSRAM Memory – The PBSRAM is attached to each expander’s external memory
interface, and is used for the capture buffer, run-time stack, and heap, along with
miscellaneous items.
Dual Port Memory – This dual port SRAM provides shared memory space between
the master and slave expanders.
Temperature Sensors – The temperature sensors are inputs that control the speed
of the fans.
| SAS Phys, Ports, and Connectors
1.3 SAS Phys, Ports, and Connectors
Phys and ports are a basic concept of SAS. A phy is the basic physical connection point
for a SAS device. A phy contains a single transmitter and receiver, which communicate
across a SAS link to a single transmitter and receiver in another phy, as the following
figure illustrates.
Figure 4: Link between Two Single SAS Phys
Each single-phy link (also called a narrow port) supports a maximum bandwidth of
600 MB/s (6Gb/s) per direction, with a total bandwidth of 1200 MB/s full duplex in both
directions.
A SAS wide port consists of more than one SAS phy (an 8-phy SAS port is also possible)
that transmit and receive data by using the same SAS address when connected to
another SAS wide port. In other words, the port is created dynamically when the
connection is made. The following figure shows both a narrow port and a wide port.
LSI Corporation | September 2010 Page 9
| SAS Phys, Ports, and Connectors
Phy
Phy
Phy
Phy
RX
TX
Phy
Narrow Port
Phy
Narrow Port
a. Narrow SAS Port with One Phy in Each Port
RX
TX
Phy
Wide Port
b. Wide SAS Port with Four Phys in Each Port
RX
TX
Phy
RX
TX
Phy
RX
TX
Phy
Wide Port
LSISAS6160 SAS Switch User GuideChapter 1: Overview
Figure 5: Narrow and Wide SAS Ports
The SAS6160 switch has 64 phys, numbered 0 through 63. Each of the 16 SAS
connectors on the switch case (numbered 0 through 15 in this document) contains four
phys, making them wide ports.
During normal operation, the SAS connectors on the switch are cabled to SAS
connectors on initiator devices or target devices. This connection creates a wide SAS
port through which data is transmitted and received.
Page 10 LSI Corporation | September 2010
LSISAS6160 SAS Switch User Guide Chapter 1: Overview
| SAS Connectors and Cabling
1.4 SAS Connectors and Cabling
Use a separate crossover cable for each server, JBOD, RAID array, switch, or other device
connected to the SAS6160 switch. Use Mini SAS 4x connectors (also called SFF-8088
connectors) on both ends of the crossover cables to connect the switch to all devices.
The keyed connectors at port 0 and port 2, located at the upper left on the SAS6160
switch, support active cabling. This allows longer cable lengths and requires a special
type of cable. These cables are keyed so that they do not attach to a passive connector.
However, you can attach a passive cable to a connector that supports active cabling.
Chapter2, Installation and Hardware Setup provides information about recommended
cable lengths.
The following figure shows a crossover cable with Mini SAS 4x connectors on both
ends.
Figure 6: Mini SAS 4x Cable
All cables used with the SAS6160 switch must comply with the SAS 2.1 standard.
LSI Corporation | September 2010 Page 11
| SAS Routing and Zoning
LSISAS6160 SAS Switch User GuideChapter 1: Overview
1.5 SAS Routing and Zoning SAS is a connection-oriented, point-to-point technology. When a host (initiator) issues
a request to read or write data, the SAS6160 switch automatically determines how to
route the connection request from the initiator to the correct data storage device
(target). By default, any SAS initiator or target connected to the SAS6160 switch can
access any other connected initiator or target in the SAS domain, without restrictions.
However, because the SAS domain grows to include multiple hosts and multiple
storage volumes, you can segregate one host from another host, or restrict one host
from accessing storage owned by another host.
SAS zoning partitions the SAS topology to isolate selected hosts from each other, or to
allow selected hosts to access only selected storage volumes. The SAS6160 switch
supports the full SAS 2.0 T10 zoning model.
There are several benefits to zoning, which can be configured accordingly:
Security – Zoning prevents users from accessing information that is not available to
them.
Manageability – Zoning reflects operational categories, such as marketing or
engineering. Zoning also can partition hosts that run different operating systems, to
minimize conflicts.
Performance – Zoning enables faster boot time because the host must discover
only the storage within its zone or zones.
1.5.1 SAS Zoning Overview SAS zoning access control is implemented by linked switch/expander devices, with
zoning enabled. These devices define a Zoned Portion of a Service Delivery System
(ZPSDS). No host device intervention is required. Each zoning switch/expander device
maintains an identical zone permission table, so zone access control is maintained
across the entire ZPSDS.
Initiators and targets see only the portions of the ZPSDS to which they are assigned in
the zone permission table. These zoned portions are called zone groups. Zone groups
are activated when they belong to a set. When the set is enabled, the zoning is
enforced. When the set is disabled, the zoning disappears. There can be more than one
set in a ZPSDS, and initiators and targets can belong to more than one set, but only one
set can be active. In addition, there can be more than one ZPSDS in a SAS domain.
A ZPSDS has a zone manager for its configuration and management. The SDM utility
(see Chapter3, SAS Domain Manager Graphical User Interface) is embedded in the
SAS6160 switch to configure the zone manager.
Page 12 LSI Corporation | September 2010
LSISAS6160 SAS Switch User Guide Chapter 1: Overview
The following figure shows a simple example of zoning.
| SAS Routing and Zoning
Figure 7: Simple Zoning Example
1.5.2 Creating SAS Zones You create SAS zones by first creating zone groups that include hosts or storage devices
that share common access privileges, and zone sets that connect the zone groups
together. Use the SDM utility to create zones. The SDM-GUI utility provides zoning
wizards to create zone groups and zone sets automatically. You also can create zone
groups and zone sets manually by using the SDM utility.
The following rules apply to zone groups and zone sets:
Only phys on the edge of the ZPSDS can be grouped into administrator-defined
zone groups. Phys that interconnect zoning expanders are automatically placed
into Zone Group 1.
An administrator defines zone group permissions. This procedure allows end
devices attached to, or downstream of, the zoned phy to communicate with one
another.
Zoning limits a host's access to only the targets downstream of zoned phys in which
its zone phy is granted zoning permission to access. A host may access all logical
unit numbers (LUNs) behind the SAS phy, and it does not restrict access to
individual storage LUNs.
You may create up to 248 zone groups within a single zone set.
SAS phys within a zone group cannot automatically access each other, but you may
grant them access privileges.
You may grant a zone group permission to access multiple zone groups, if required.
A zone group may be a member of more than one zone set.
A phy may be a member of only one zone group per zone set.
LSI Corporation | September 2010 Page 13
| SAS Routing and Zoning
LSISAS6160 SAS Switch User GuideChapter 1: Overview
A zone set must be active for its definitions to be applied to the SAS domain. Zone
sets are activated in the SDM utility.
Only one zone set can be active at one time. When no zone set is active, zoning is
disabled and domain access is unrestricted.
Changes to the active zone set (for example, a change to zone group or zone set
membership, or a change to zone group permissions) do not take effect until the
next zone set activate command.
When the SAS topology changes (for example, when a host or storage attachment
is moved from one switch connection to another) you must manually redefine zone
group permissions within the active zone set. The switch does not do this task
automatically. Changes to the active zone set do not take effect until the zone set is
updated and reactivated.
Zoning is managed throughout the ZPSDS formed around the SAS6160 switch,
used to manage zoning, and any SAS 2.0 zoning expanders that can be linked back
to it without crossing a nonzoning expander. When zoning is enabled, zone group
and permission data are migrated automatically between the SAS6160 switches
and the SAS 2.0 zoning-enabled expanders throughout the ZPSDS. If a storage
configuration includes a legacy expander that is not zoning-enabled, that expander
and its attached devices inherit the zone group and permissions of the zone phy to
which it is connected.
To create a high-availability (failover) configuration, use one SAS6160 switch for
each data path between the host and the shared storage. SAS allows for only a
single path between endpoints. See Figure13 for more information.
Page 14 LSI Corporation | September 2010
LSISAS6160 SAS Switch User Guide Chapter 1: Overview
1.5.3 Configuring SAS Zones The following figure shows a sample configuration with three hosts and five JBODs.
Figure 8: Configuration for Zoning Example
| SAS Routing and Zoning
Host 1 belongs to a local work group and accesses JBOD 1 as its primary resource. But
Host 1 also accesses JBOD 2, JBOD 3, and JBOD 4, as a backup resource.
Host 2 is a backup server, and has JBOD 2, JBOD 3, and JBOD 4 as its primary resource,
but also accesses JBOD 1.
Host 3 is a web server, and has exclusive access to JBOD 5, but also accesses JBOD 2,
JBOD 3, and JBOD 4 for backup.
Because Host 1 and Host 2 have the same JBOD access requirements, you can define
them as a single zone group. You can define JBOD 2, JBOD 3, and JBOD 4 as a zone
group because they are always used together as a backup resource.
LSI Corporation | September 2010 Page 15
| Connecting Devices to the SAS6160 Switch
To create a suitable configuration, run the SDM utility and create the zone groups
shown in the following figure.
LSISAS6160 SAS Switch User GuideChapter 1: Overview
1.6 Connecting Devices to the SAS6160 Switch
Figure 9: Creating Zone Groups
Next, use the SDM utility to assign the following permissions, by creating zone sets:
Zone group 6 accesses zone groups 8 and 9, and vice versa.
Zone group 7 accesses zone groups 9 and 10, and vice versa.
The rules for connecting devices to the 16 SAS connectors on the SAS6160 switch are as
follows:
Any SAS initiator can be connected to any SAS connector on the switch.
Any SAS target can be connected to any SAS connector on the switch. A target can
be a RAID array, a JBOD, or another switch. Individual SAS drives or SATA drives may
not be connected to the switch.
Switches can be cascaded by connecting any SAS connector of the downstream
switch to any SAS connector on the upstream switch.
When SAS zoning is used, and multiple SAS6160 switches are used in the domain,
the switches can be cabled directly to one another.
Two switches can be connected with more than one cable to increase bandwidth
between switches.
All SAS connectors on the switch are Mini SAS, wide port style connectors. In
addition, connector 0 and connector 2 are keyed for active cables (see Section1.4,
SAS Connectors and Cabling).
All connections must be x4. For any other configuration, contact your field
applications engineer.
Maximum connections allowed:
— Six cascaded expanders with each switch counting as one expander
Page 16 LSI Corporation | September 2010
LSISAS6160 SAS Switch User Guide Chapter 1: Overview
— Four cascaded switches
— A total of 64 total expanders in the topology
The following examples show several ways in which you can connect devices to the
SAS6160 switch.
The first example (Figure10) shows four servers (host bus adapters) and five JBODs
connected to the SAS6160 switch.
| Connecting Devices to the SAS6160 Switch
Figure 10: Example 1, Multiple Servers and JBODs
A single rack can contain the switch and all the other devices. The configuration
requires nine SAS cables with a Mini SAS connector on each end. Depending on the
way in which zoning is set up for the devices, all servers could access data on all the
JBODs, or servers could be restricted to accessing a subset of the JBODs.
The second example (Figure11) shows eight servers and one RAID array connected to
the SAS6160 switch.
Figure 11: Example 2, Multiple Servers and One RAID
LSI Corporation | September 2010 Page 17
| Connecting Devices to the SAS6160 Switch
LSISAS6160 SAS Switch User GuideChapter 1: Overview
A separate cable with a Mini SAS connector on each end is used for each connection.
All eight servers can access data on the RAID array. If more storage capacity is required
in the future, the RAID array could be expanded, or a configuration with a second
cascading switch could be created, as shown in the next example.
The third example (Figure12) shows eight servers and one cascading switch connected
to the SAS6160 switch. Several JBODs and RAID arrays connect to the other switch.
NOTE: Example 5 and example 6 also show configurations with cascading switches.
Figure 12: Example 3, Multiple Servers and a Cascading Switch
This example shows how you can cascade two SAS6160 switches to increase the
number of devices in the SAS domain. Like in Example 1, all of the servers can access all
the data storage devices, or you can implement a zoning configuration to restrict the
access.
Page 18 LSI Corporation | September 2010
LSISAS6160 SAS Switch User Guide Chapter 1: Overview
The fourth example (Figure13) shows a server connected through two SAS6160
switches to two input connectors on a JBOD for a high-availability configuration.
| Connecting Devices to the SAS6160 Switch
Figure 13: Example 4, High Availability
This dual porting configuration provides the server a redundant path through the
switches for high availability. If one of the switches or connections fails, the server can
still access the JBOD through the other connection.
LSI Corporation | September 2010 Page 19
| Connecting Devices to the SAS6160 Switch
The fifth example (Figure14) shows a large data storage network that includes two
SAS6160 switches and several expanders.
NOTE: Expanders are either zoning expanders or nonzoning expanders. When SAS
drives are attached to a zoning expander, each drive can be zoned individually and each
drive can be in its own zone group. When SAS drives are attached to a nonzoning
expander, they cannot be zoned individually. All the drives behind a nonzoning
expander must be in the same zone group as the expander.
LSISAS6160 SAS Switch User GuideChapter 1: Overview
Figure 14: Example 5, Large Data Storage Topology
A complex zoning configuration like this one could potentially include hundreds of SAS
initiators and targets. This flexible arrangement can easily be expanded without
extensive cabling changes. The SDM utility detects newly added SAS devices during
device discovery. You can use the SDM utility to modify and expand the storage
configuration.
NOTE: For zoning to function correctly, you must cable SAS6160 switches directly to
one another, or through SAS 2.0 zoning expanders.
Page 20 LSI Corporation | September 2010
LSISAS6160 SAS Switch User Guide Chapter 1: Overview
The sixth example (Figure15) shows a daisy chain, or cascaded, switch configuration,
with four SAS6160 switches. This example assumes that various SAS targets and SAS
initiators are attached to the other connectors on the switches.
| Connecting Devices to the SAS6160 Switch
Figure 15: Example 6, Cascaded Switches
Like in Example 3, the cables in this example can run from any connector of the
downstream switch to any connector in the switch above it. The cascade sequence is
limited to four switches.
LSI Corporation | September 2010 Page 21
| Connecting Devices to the SAS6160 Switch
Example 7 (Figure16) shows a star (tree) configuration of four switches, with switch B,
switch C, and switch D connected directly to switch A. Like in Example 6, this example
assumes that various SAS targets and SAS initiators are attached to the other
connectors on the switches.)
LSISAS6160 SAS Switch User GuideChapter 1: Overview
Figure 16: Example 7, Switches in a Star (Tree) Configuration
NOTE: The cables can run from any connector of switches B, C, and D to any connectors
on the central switch A. You can attach more switches to the other connectors on switch
A. You also can attach additional switches B, C, or D.
Page 22 LSI Corporation | September 2010
LSISAS6160 SAS Switch User Guide Chapter 2: Installation and Hardware Setup
Ethernet Rate
Ethernet Active
Switch Power
SAS Activity
SAS Fault
Active Connectors
Reset
| Unpacking the Switch
Chapter 2
Installation and Hardware Setup
This chapter explains how to unpack the LSISAS6160 SAS switch, install it on an
optional rack shelf, connect power cables and other cables to it, change the default
Static IP address, and connect SAS storage devices to it. This chapter also explains how
to interpret the LEDs on the switch.
2.1 Unpacking the Switch Place the SAS6160 switch shipping carton on a grounded surface before removing the
switch from the carton. Open the shipping carton and carefully unpack its contents.
The carton contains the following items:
2.2 Identifying Switch Components
One SAS6160 SAS switch
One AC power cord with inline power supply
One CD-ROM which contains this documentation
If any of these items are missing or damaged, contact your local reseller for
replacement.
The following figure shows the connectors and LEDs on the SAS6160 switch. There is a
fault status LED and an activity LED for each of the 16 SAS connectors. There is also a
power status LED for the switch, and a rate LED and activity LED for the Ethernet
connector. A reset pinhole allows reloading the factory defaults, which also requires
power cycling the switch (see Chapter5, Troubleshooting).
Figure 1: Switch Components
LSI Corporation | September 2010 Page 23
Loading...