Violin Memory 6000 Series Installation Manual
V
iolin
MEMORY
Violin 6000 Series
Memory Array Installation Guide
For Release V6.0.0
Document Number: 535-0045-00 Rev 02
May 2013
LEGAL NOTICE
Copyright © 2010-2013 Violin Memory, Inc. All rights reserved.
Violin Memory, Violin Technologies, Violin, vSHARE, vCACHE, Flash Forward, and Violin and Design are trademarks,
registered trademarks or service marks of Violin Memory, Inc. (“Violin”) in the United States and other countries.
All other brands, product names, company names, trademarks, and service marks are the properties of their respective
owners.
This document and the associated software product are protected by copyright and international treaties, and are
distributed under license from Violin, including restrictions on their use, copying, redistribution and reverse engineering.
Unless otherwise agreed by Violin in writing, Violin’s standard end user license agreement shall apply, which may be
reviewed at www.violin-memory.com/legal. No part of this document may be reproduced, adapted or translated without
prior written permission of Violin, except as permitted under applicable copyright law. The associated software product may
include, access or otherwise operate, interface or be delivered with third party software or other applications or copyrighted
materials, which are copyrighted and licensed by Violin suppliers. Such third party materials and licenses are identified in
this document and/or at www.violin-memory.com/legal.
Violin assumes no responsibility for any typographical, technical or other error or omission in this document. Violin reserves
the right to periodically change the information contained in this document, but Violin makes no commitment to provide any
such changes, updates, enhancements or other additions in a timely manner or at all.
The only warranties for Violin products and services are set forth in the express warranty statements accompanying such
products and services. Nothing herein should be construed as constituting an additional warranty. THIS DOCUMENT
(INCLUDING ANY EXAMPLES AND OTHER INFORMATION CONTAINED HEREIN) IS MADE AVAILABLE “AS IS”
WITHOUT REPRESENTATION OR WARRANTY OF ANY KIND. VIOLIN MAKES NO REPRESENTATION OR
WARRANTY IN THIS DOCUMENT REGARDING ANY ASSOCIATED SOFTWARE OR ANY OTHER VIOLIN OR THIRD
PARTY HARDWARE, SOFTWARE OR OTHER PRODUCTS OR SERVICES REFERENCED HEREIN. TO THE FULLEST
EXTENT PERMITTED BY LAW, VIOLIN (FOR ITSELF AND ITS LICENSORS AND OTHER THIRD PARTIES IDENTIFIED
HEREIN) HEREBY DISCLAIMS ALL REPRESENTATIONS AND WARRANTIES, WHETHER EXPRESS OR IMPLIED,
ORAL OR WRITTEN, WITH RESPECT TO THE FOREGOING, INCLUDING WITHOUT LIMITATION, ALL IMPLIED
WARRANTIES OF TITLE, NON-INFRINGEMENT, QUIET ENJOYMENT, ACCURACY, INTEGRATION,
MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE.
IN NO EVENT SHALL VIOLIN (OR ITS LICENSORS OR ANY OTHER THIRD PARTY IDENTIFIED HEREIN) BE LIABLE
CONCERNING ANY USE OF THIS DOCUMENT, REGARDLESS OF THE FORM OF ANY CLAIM OR ACTION
(WHETHER IN CONTRACT, NEGLIGENCE, STRICT LIABILITY OR OTHERWISE), FOR ANY DIRECT, INDIRECT,
PUNITIVE, INCIDENTAL, RELIANCE, SPECIAL, EXEMPLARY OR CONSEQUENTIAL DAMAGES, INCLUDING
WITHOUT LIMITATION, ANY LOSS OF DATA, LOSS OR INTERRUPTION OF USE, COST OF PROCURING
SUBSTITUTE TECHNOLOGIES, GOODS OR SERVICES, OR LOSS OF BUSINESS, REVENUES, PROFITS OR
GOODWILL, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
Violin Memory, Inc.
685 Clyde Avenue
Mountain View, CA 94043
USA
ii
Violin 6000 Series Memory Array Installation Guide
535-0045-00 Rev 02
Table of Contents
Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
CHAPTER 1. Memory Array Hardware Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Installation and Configuration Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Unpacking the Memory Array . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Parts and Accessory List. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Installation Tools and Equipment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8
Standard System Configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
SAN-attached Storage Configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9
Direct-attached Storage Configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
Installing the Memory Array . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
Managing Thermal Heat Impact Within the Equipment Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14
Installing the Slide Rails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15
Installing the Cage Nuts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18
Attaching the Rack Ears (Optional). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18
Mounting the Memory Array in the Equipment Rack. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19
Connecting the Cable Management Arm . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19
Grounding the Memory Array . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20
Connecting AC Power Cords to the System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21
Powering up the Memory Array . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .22
Connecting the Memory Array to a Host or Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Connecting PCIe Cables to the Memory Array . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23
Connecting Network Interface Cables to the Memory Array . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .24
Connecting the ACMs for vMOS-6 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
Connecting Management Cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
Connecting the Console Cable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27
Connecting the Ethernet Cable. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28
Securing the Memory Array to the Equipment Rack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
CHAPTER 2. System Setup and Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Completing the Configuration Wizard. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Default System Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .32
Configuration Checklist . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
Completing the Configuration Wizard for a New System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33
System Verification and Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Cluster Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37
Configuring the PCIe Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .39
Verifying ACM PCIe Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41
Verifying the Memory Gateway Network Setup. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42
Verifying the Memory Gateway Power State. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43
Verifying Memory Gateway Addresses and Licenses. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44
Verifying NTB Link (vMOS-6 Only) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45
Initializing the Violin Memory Array. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45
Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
Determining IP Addresses of Internal Memory Gateways (One Known, One Unknown) . . . . . . . . . . . . . . . .47
535-0045-00 Rev 02 Violin 6000 Series Memory Array Installation Guide iii
Determining IP Addresses of Internal Memory Gateways (Both Unknown). . . . . . . . . . . . . . . . . . . . . . . . . . 48
Error Messages When Logging in to Memory Gateways . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
Next Steps. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
APPENDIX A. InfiniBand Client Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Process Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
HCA Drivers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
InfiniBand Client Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
InfiniBand Gateway Setup. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
APPENDIX B. Multipath Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Multipath Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Multipath Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Prerequisites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Setting Up DM Multipath . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
System Specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
Memory Array System Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
Fibre Channel Adapter Card Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
InfiniBand Adapter Card Specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
PCIe Host Adapter Card Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
Ethernet/iSCSI Adapter Card Specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
Compliance Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
FCC Class A Compliance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Regulatory Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Regulatory Model Number . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Installation Conditions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Network Connected Equipment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Electrostatic Discharge (ESD) Precautions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
Lithium Battery Caution. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
Cabinet Safety Precautions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
Disposal of Waste Equipment by Users in Private Households in the European Union. . . . . . . . . . . 70
Perchlorate Material - Special Handling May Apply . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
European Union RFI Statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
USA Radio Frequency Interference FCC Notice. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
Japan Radio Frequency Interference VCCI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
Korea RFI Statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
Canada RFI Statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
CISPR 22 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
Australia C-Tick Label . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
Taiwan BSMI Statement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
Four-in-One Recycling Symbol . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
Product Information for People’s Republic of China . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
iv Violin 6000 Series Memory Array Installation Guide 535-0045-00 Rev 02
Preface
This preface outlines the organization of this book, describes document
conventions, and provides information about additional resources.
• Intended Audience on page 1
• Document Organization on page 2
• Reference Documents on page 2
• Document Conventions on page 3
• Contacting Violin Memory on page 4
Intended Audience
This guide is intended for experienced systems administrators. Violin Memory
assumes that you are experienced in installing and servicing high-performance
storage systems.
Contact Violin Memory Customer Support for any assistance with installing and
servicing this system. See Contacting Violin Memory on page 4 for contact
information.
535-0045-00 Rev 02
Violin 6000 Series Memory Array Installation Guide
1
Document Organization
This guide is organized into the following sections:
• Chapter 1, Memory Array Hardware Installation—Describes how to install the Violin 6000
Series Memory Array.
• Chapter 2, System Setup and Configuration—Describes how to configure the Violin 6000
Series Memory Array for the first time.
• Appendix A, InfiniBand Client Configuration—Describes establishing InfiniBand initiators for
use with the Memory Gateways internal to the Violin 6000 Series Memory Array.
• Appendix B, Multipath Configuration—Provides examples of client-side multipath setup for a
Violin Memory Gateway.
Reference Documents
In addition to this guide, the following Violin Memory documents comprise the documentation suite
that will assist you with setting up, using and servicing the Violin 6000 Series Memory Array. These
guides are available for download from the Violin Memory Support site at http://www.violin-
memory.com/support/
This document... Provides this information...
Release Notes This document describes the new features, resolved
issues, known limitations and software upgrade
instructions for the current release.
Violin 6000 Series Memory Array User’s Guide This guide provides instructions for managing,
monitoring, and maintaining the Violin 6000 Series
Memory Array using the Violin Web interface and
Command Line Interface (CLI).
Violin 6000 Series Memory Array Slide Rail
Installation Guide
Violin 6000 Series Memory Array Cable Management
Installation Guide
Violin 6000 Series Memory Array Service Guide This guide describes how to safely replace the
Reference Documents
This guide provides instructions for installing the
Violin 6000 Series Memory Array slide rails in an
equipment rack.
This guide provides instructions for installing the
cable management arm on a Violin 6000 Series
Memory Array. It is included in the Violin 6000 Series
Memory Array shipping box.
system components in a Violin 6000 Series Memory
Array.
2
Violin 6000 Series Memory Array Installation Guide
535-0045-00 Rev 02
Document Conventions
Safety Icons
The table below summarizes warning, caution, and note icons used in this document and includes
sample text.
Safety Icons
Icon Sample Text
WARNING! WARNING! Only authorized, qualified, and trained
personnel should attempt to work on this equipment.
Caution: Caution: Follow the listed safety precautions when
working on the Violin 6000 Series Memory Array.
Note: Note: Read through this entire chapter and plan your
installation according to your location before installing
the equipment. The following procedures and the order
in which they appear are general installation guidelines
only.
Typographical Conventions
The following typographic conventions are used in this guide:
Format Meaning
Bold
Italic
Courier Command names, examples, and output.
Courier bold Input you must type exactly as shown.
<Courier italic> Information for which you must supply a value.
[] Optional command parameters are enclosed within
| Separates a set of command choices from which only
{} Required command parameters that must be specified
Typographical Conventions
User Interface text.
Provides emphasis and identifies variables and
document titles.
square brackets.
one may be chosen.
are enclosed within curly brackets.
535-0045-00 Rev 02
Violin 6000 Series Memory Array Installation Guide
3
Security
Violin Memory, Inc., cannot be responsible for unauthorized use of equipment and will not make
allowance or credit for unauthorized use or access.
Contacting Violin Memory
To obtain additional information or technical support for Violin Memory products, contact us at:
Phone: 1-855-VIOLIN-5 (1-855-846-5465)
International: +1 650-396-1500 Extension 3
Web site: http://www.violin-memory.com
Email: support@vmem.com
When contacting Violin Memory Customer Support, please have the following information available:
• Model and serial number of the system for which you are requesting support.
• Software version.
• A brief description of the problem.
• Command Line Interface or Web interface access to the affected system.
4
Violin 6000 Series Memory Array Installation Guide
535-0045-00 Rev 02
CHAPTER 1 Memory Array Hardware Installation
This chapter describes the hardware installation of a 6000 Series flash Memory
Array in the following sections:
• Installation and Configuration Overview on page 5
• Unpacking the Memory Array on page 7
• Standard System Configurations on page 9
• Installing the Memory Array on page 14
• Connecting the Memory Array to a Host or Network on page 23
• Connecting the ACMs for vMOS-6 on page 26
• Connecting Management Cables on page 27
• Securing the Memory Array to the Equipment Rack on page 29
See the Violin 6000 Series Memory Array User’s Guide for software installation and
upgrade instructions.
Installation and Configuration Overview
The Memory Array installation and configuration occurs in four distinct phases:
• Phase 1: Hardware Installation and Cabling
• Phase 2: First-time Memory Array Configuration
• Phase 3: Driver Installation and Configuration (if direct-attached connection is
used)
• Phase 4: Create LUNs on the Memory Array
Note: Instructions for installing drivers and configuring the Memory Gateways to
manage block storage are provided in the Violin 6000 Series Memory Array User’s
Guide.
535-0045-00 Rev 02
Violin 6000 Series Memory Array Installation Guide
5
Chapter 1: Memory Array Hardware Installation
This chapter describes the first phase of a Memory Array implementation: the installation of the
Memory Array hardware and network cabling.
Hardware Installation is a five-step process consisting of the following procedures:
• Unpacking the Memory Array: In this step, unpack the Memory Array shipping box, inspect
the Memory Array components, and verify that you have the tools required to install the
Memory Array hardware.
• Rack-mounting the Memory Array Chassis: In this step, mount the Memory Array chassis
in the equipment rack using the slide-out rails and ground the equipment racks.
• Attaching the Cable Management Arm (if used): In this step, attach the cable management
arm to the Memory Array and the equipment rack.
• Connecting Power: In this step, connect the AC power cords to the Memory Array power
supplies and connect to a power source.
• Connecting the Interface Cables: In this step, connect the interface cables (Fibre Channel,
InfiniBand or 10GBe, PCIe) to the Memory Array chassis and to the client network.
The order of the procedures described in this chapter are offered as general guidelines only.
Depending on your installation environment, you may find it easier to perform the procedures in a
different order than they are presented here. For example, it may be easier to connect the network
management cables to the Memory Array chassis before you install the chassis in the equipment
rack.
Read through this entire chapter and plan your installation according to your location before
installing the Memory Array hardware.
This chapter describes only the first phase of a Memory Array implementation. The remaining
phases can be found in the following sections:
Phase Chapter
2: First-time Memory Array
Chapter 2, System Setup and Configuration
Configuration
3: Driver Installation and Configuration Appendix A, InfiniBand Client Configuration
Note: Violin Driver installation is covered in the
Violin 6000 Series Memory Array User’s Guide and is
only necessary if you connect the Memory Array
directly to a host machine using PCIe cables.
Table 1.1 Phase Task Map
6
Violin 6000 Series Memory Array Installation Guide
535-0045-00 Rev 02
Unpacking the Memory Array
1234
5
The first step in the Memory Array hardware installation is to remove the Memory Array from the
shipping box.
Figure 1.1 Unpacking Memory Array
Unpacking the Memory Array
Remove the Memory Array from the shipping packaging and remove all packing materials. Visually
inspect the system for any damage. If any damage is detected, contact Violin Memory Customer
Support. For more information, see Contacting Violin Memory on page 4.
Unpack the supplied kits and confirm that all parts and components have arrived in good order.
WARNING! Only authorized, qualified, and trained personnel should attempt to work on this
equipment.
Caution: Because of the weight of the Violin 6000 Series Memory Array, two people are required to lift
and place the system in an equipment rack.
535-0045-00 Rev 02
Violin 6000 Series Memory Array Installation Guide
7
Chapter 1: Memory Array Hardware Installation
Parts and Accessory List
The table below lists the parts that may be included in the Memory Array shipping package.
Contents vary depending on the system ordered. Some optional accessories are not listed here.
Item
Number
Part Description Quantity
1 Memory Array 1
2 Flash VIMMs (preinstalled in Memory Array) 24, 44 or 64
3 C14-C19 Connector AC power supply cable, 6 ft, in Accessory
2
Box; connects to C20 inlets on the rear of the chassis.
4 DB9 to RJ-45, 6 ft rollover console cable, in Accessory Box 2
5 Rail Mounting Kit, includes two flat head screws, cage nuts and
1
screws
6 Rack ears 2
7 Host Bus Adapter (HBA) blanking panels (installed if direct-
4
attached system)
8 PCIe card (if direct-attached system ordered) 4
9 PCIe cable, 3 m, in Accessory Box (if PCIe cards ordered)
PCIe cable, 3 m (if a vMOS-6 system)
Table 1.2 Parts List
4
1
Installation Tools and Equipment
The table below lists the tools and equipment used during the installation process:
Item
Number
Tool Quantity
1 Phillips head screwdrivers, sizes 1 and 2 1 each
2 Computer system for direct connect configuration 1 or 2
3 CAT 5 Ethernet Cable with RJ-45 connectors, straight-
2
through or cross-over, depending on your installation
Table 1.3 Required Installation Tools
8
Violin 6000 Series Memory Array Installation Guide
535-0045-00 Rev 02
Standard System Configurations
This section shows diagrams of standard configurations supported by Memory Arrays. It includes
the following configurations:
• SAN-attached Storage Configurations on page 9
• Direct-attached Storage Configurations on page 11
See Connecting the Memory Array to a Host or Network on page 23 for specific port-to-port cabling
instructions.
SAN-attached Storage Configurations
In many applications, it is preferable for the Memory Array to be shared by many hosts, many of
which may not be in the same rack as the Memory Array. In these scenarios, a storage area network
(SAN) or local area network (LAN) connection is preferable. The Memory Array can connect to the
SAN via Fibre Channel or InfiniBand, or the LAN via 10GbE iSCSI.
A Memory Gateway is used to provide the SAN/LAN block storage function. The Violin Memory
software application installed on the Memory Gateways manages the network connectivity and
provides storage virtualization services such as LUN provisioning, masking and exporting.
Standard System Configurations
See the Violin 6000 Series Memory Array User’s Guide for information on managing clusters and
configuring the system.
Note: A mix of network interface cards (NICs) in one Memory Array system is not supported.
Fibre Channel and iSCSI ports on the Memory Gateway may be connected either directly to specific
hosts or to switches. The switches may be standalone switches for use within a rack or networked
switches that connect large numbers of hosts across the data center. The latter case is the most
common.
Internal Memory Gateways
The Memory Array includes two internal Memory Gateways. Each internal Memory Gateway
supports two network interface modules (shown in Figure 1.2), each of which can support the
following:
• Four 8 Gbps Fibre Channel ports that auto-negotiate down to 4 Gbps
• Four InfiniBand ports operating at 4X Quad Data Rate (QDR)
• Four 10GbE iSCSI ports
535-0045-00 Rev 02
Violin 6000 Series Memory Array Installation Guide
9
Chapter 1: Memory Array Hardware Installation
Fibre Channel
or InfiniBand Switch
Memory Array
Memory Gateway B
(NIC slots C and D)
Memory Gateway A
(NIC slots A and B)
D C B A
Fibre Channel
or InfiniBand Switch
Figure 1.2 High-availability SAN-attached via Dual Internal Memory Gateways
Figure 1.2 shows the supported cable configuration when setting up a high-availability (HA) system.
This is the only supported HA configuration for the 6000 Series Memory Array. Memory Gateway A
manages connectivity through NIC slots A and B; Memory Gateway B manages connectivity
through NIC slots C and D.
Memory Gateways can use up to eight ports of 8 Gbps FC or 10GbE to connect to network
switches. InfiniBand ports on the Memory Array should be connected to InfiniBand switches in a
high-availability configuration.
Understanding Port Numbering
When connecting the interface cables in a SAN-attached configuration, it is important to know the
ports from which LUNs are exported from the Violin Web interface. Figure 1.3 shows the slot and
port numbers for Fibre Channel cards installed in the system, along with the representative CLI
values for each port. If there are more than two ports per card, the numbers increase from top to
bottom on the card.
10
Violin 6000 Series Memory Array Installation Guide
535-0045-00 Rev 02
Standard System Configurations
Figure 1.3 Memory Gateway NIC Slots and Fibre Channel Port Numbers
Note that the physical port numbers on the network interface cards (NICs) are not aligned with their
corresponding port names in the CLI, as shown in Figure 1.3. For example, in a Fibre Channel
environment, NIC port A1 is shown as “hba-a1” in the CLI, and NIC port C1 is also shown as “hbaa1” in the CLI. This is because the two Memory Gateways, shown with their CLI representations
above (mg-a and mg-b), separately manage two NICs each.
InfiniBand and iSCSI cards are also supported. Their port numbers are represented in the CLI as
follows:
• InfiniBand: hca-a1, hca-a2, etc.
• iSCSI: eth-a1, eth-b1, etc.
Note: To verify the actual port numbering shown in the CLI, log in to the Memory Gateway master
and then run the “show targets” command.
Direct-attached Storage Configurations
PCI Express (PCIe) is the primary interconnect for direct-attached storage configurations. It is also
possible to use Fibre Channel without a SAN or switch, but this is treated as a SAN-attached
storage configuration. See SAN-attached Storage Configurations on page 9.
Note: vMOS-6 requires that the Array Controller Modules (ACMs) be externally connected to
each other to interconnect the internal Memory Gateways. Data Management features available in
vMOS-6, such as snapshots and thin provisioning, are not supported in PCIe direct-attached
configurations. See Connecting the ACMs for vMOS-6 on page 26 for details.
535-0045-00 Rev 02
Violin 6000 Series Memory Array Installation Guide
11
Chapter 1: Memory Array Hardware Installation
Each Array Controller Module (ACM) provides two PCIe x8 Gen2 ports, each of which has a 40
Gbps nominal bit rate. The Memory Array has two ACMs, with all four of the ports available to host
computers.
Multiple direct-attached storage configurations are available depending on the number of hosts and
whether the hosts require shared access to the volumes or LUNs within the Array. Typical
configurations are:
• Single Host: single or dual PCIe x8 connections from the host to the Memory Array.
• Two Hosts: single or dual PCIe x8 connections from each host to the Memory Array. Each
host has access to all volumes and flash on the Memory Array. Data may be shared.
Drivers for Direct-attached Configurations
A driver must be installed on the host machine if the Memory Array is directly attached to a Linux
or Windows host. In a direct-attached configuration, the Violin Memory driver enables the host
machine to access block storage on a Violin Memory Array.
See “Violin Drivers” in the Violin 6000 Series Memory Array User’s Guide for instructions on
installing the Linux driver. When available, a driver for Windows and the installation instructions can
be downloaded from the Violin Memory Customer Support site.
Direct Attached, Single Host
A direct-attached connection to a single host machine via dual PCIe x8 connections is supported.
For a dual configuration, the second PCIe x8 connection is required. This configuration also
increases system availability and bandwidth.
For improved High Availability (HA) protection, all four ports (two on each ACM) can be connected
to a single host for redundancy, as shown in Figure 1.4. The second set of connections present
another disk device with the same addressability as the first disk device. For a Linux system, the
device is shown as /dev/vtmsa.
Figure 1.4 Direct-Attached to Single Host for Redundancy
Connect one PCIe cable to the top PCIe connector on one of the ACMs, and connect the other PCIe
cable to the bottom of the same ACM. Repeat these connections for the other ACM.
12
Violin 6000 Series Memory Array Installation Guide
535-0045-00 Rev 02
Standard System Configurations
Memory Array
Host 1
Host 2
PCIe x8
ACM-A
ACM-B
Connect the other ends of the PCIe cables to the host machine.
Connecting two PCIe cables from one ACM to the host machine is also supported (as shown in
Figure 1.5), however, utilizing both ACMs is recommended to take advantage of redundancy, as
described above.
Figure 1.5 Direct-Attached to Single Host
For a dual PCIe x8 connection to the host machine, connect one PCIe cable to the top PCIe
connector on one of the ACMs, and connect the other PCIe cable to the bottom of the same ACM.
Connect the other end of the PCIe cable to the host machine.
Direct Attached, Two Hosts
A direct-attached connection to two host machines is supported. Each host can be connected via
single or dual PCIe x8 connections. In dual configuration, the second PCIe x8 connection can be
used to increase bandwidth, redundancy and system availability.
535-0045-00 Rev 02
Figure 1.6 Direct-Attached to Two Hosts
Violin 6000 Series Memory Array Installation Guide
13
Chapter 1: Memory Array Hardware Installation
For a dual PCIe x8 connection to two host computers, connect one PCIe cable to the top PCIe
connector on one of the ACMs, and connect the other PCIe cable to the bottom of the same ACM.
Connect the other end of the PCIe cable to the host machine. Connect the second host machine to
the other ACM in the same manner.
Where hosts share the same volume, a mechanism is needed to ensure the two hosts share the
volume productively and do not overwrite each other’s data. This can be done via a clustered file
system (e.g., GPFS, GFS, Veritas) or by partitioning the volume and explicitly assigning partitions
to each host over PCIe.
Installing the Memory Array
Follow the steps in this section to install the Memory Array in an equipment rack and to connect the
system directly to a host machine or to a network.
Managing Thermal Heat Impact Within the
Equipment Rack
Follow these recommendations to minimize the heat impact within an equipment rack when
deploying Memory Arrays in a high-density configuration:
• Equipment racks should be populated with the heaviest and most power-dense equipment at
the bottom. Install the Memory Arrays from the bottom up, for the following reasons:
— Weight: To maintain the lowest center of gravity.
— Cooling: To give best access to cold air inlet coming from the floor.
— Serviceability: To allow ease of access during service, as the system modules are
accessible from the top.
• Check and install thermal barriers, special baffling or direct ducting if possible to prevent hot
aisle air recirculating into the cold aisles, raising inlet temperatures and therefore, raising the
temperature of Memory Arrays.
• To the greatest extent possible, remove airflow obstructions from the intake and exhaust
openings of the Memory Arrays mounted in the rack. Thus, proper cable management
technique is recommended. It is recommended that data and power cables be grouped when
routing and tying.
Tying power cables at the bottom of the cable management arm and tying data cables at the
top of the cable management arm help minimize airflow restriction.
• Chilled air is pulled through the front and exhausted through the rear by the fans in the
Memory Arrays. Recirculation of hot air exiting the back of the rack into the front of the rack
should be eliminated as much as possible.
Install blanking/filler plates to all empty “U” slots in the racks to prevent both cold air from
bypassing server inlets and to avoid exhaust air from recirculating back to the inlets.
• The recommended operating temperature ranges for data centers—according to ASHRAE
(American Society of Heating, Refrigeration and Air-Conditioning)—is 64.4°F (18°C) for lowend and 80.6°F (27°C) for high-end. When deploying multiple Memory Arrays in the same
rack, you should monitor ambient and inlet temperature rise and may wish to adjust AC
settings in the data center to provide appropriate temperature levels. Violin Memory
recommends that the ambient temperature be maintained at around 25°C.
• As an optional but not necessary practice, you could consider racking Memory Arrays with 1U
separation to reduce exhaust airflow restrictions and to enable ease of cable management.
14
Violin 6000 Series Memory Array Installation Guide
535-0045-00 Rev 02
Installing the Memory Array
• To reduce heat build-up inside high-density racks, top exhaust fans or door exhaust fans can
be installed.
Installing the Slide Rails
This section describes attaching the inner slide rails to the Memory Array chassis and mounting the
slide rails and Memory Array chassis to an equipment rack. If you are installing the Memory Array
in a square-hole equipment rack, the slide rails contain front and rear toolless mounting brackets
that click and lock into place.
The slide rail kit should include the following:
• Two slide rails
• Two flat head screws for mounting the rails to the Memory Array chassis
Caution: Improperly mounted rack-mounting brackets and slide rails can cause the product to fall.
Caution: Because of the weight of the Violin 6000 Memory Array, two people are required to lift and place
the system in an equipment rack.
Note: You must be able to access the rear of the Memory Array and the equipment rack during
installation.
To install the slide rails:
1. Locate the left and right slide rails. The left slide rail is labeled “LEFT FRONT” on the outside
front of the rail; the right slide rail is labeled “RIGHT FRONT.”
Figure 1.7 Slide Rails in Equipment Rack
535-0045-00 Rev 02
Violin 6000 Series Memory Array Installation Guide
15
Chapter 1: Memory Array Hardware Installation
Inner Rail
Sections
Locking
Mechanism
Note: The Memory Array is a 3U storage system. When identifying the location of the slide rails,
make sure to allow for enough space above and below the Memory Array to accommodate other
devices in the equipment rack. The bottom of the Memory Array chassis rests .125 inches below
the bottom of the slide rails; the lid is 2 inches above the top of the slide rails.
2. Install the slide rails at the appropriate height in the equipment rack. Orient the slide rails so
they slide out to the front of the equipment rack.
Removing the Inner Slide Rail Sections
Fully extend the slide rails from the equipment rack until the rails click into place.
Figure 1.8 Removing the Inner Slide Rail Sections
3. Press the spring-loaded locking mechanisms on the outside of both inner rail sections and
then pull out and remove the inner slide rail sections from the left and right slide rails.
Note: Keep track of the left and right inner slide rail sections. The left must attach to the left of
the chassis; the right must attach to the right of the chassis.
16
Violin 6000 Series Memory Array Installation Guide
535-0045-00 Rev 02
Installing the Memory Array
Attaching the Inner Slide Rail Sections to the Memory Array
Chassis
1. Locate the four rectangular cutouts on the side of the inner rail section.
Figure 1.9 Attaching the Inner Rail Sections to the Memory Array
Note: Make sure to attach the left and right inner slide rail sections to the correct sides of the
chassis. The inner slide rail sections are marked as follows: “B-L” on the left section and “B-R” on
the right section.
2. Align the four cutouts over the four hooks on the outside of the Memory Array chassis and then
slide the inner rail section toward the rear of the Memory Array chassis until it is securely in
place.
Figure 1.10 Securing the Inner Rail Sections to the Memory Array
3. Using the two flat head screws from the slide rail kit, secure the inner rail sections to the
Memory Array chassis.
535-0045-00 Rev 02
Violin 6000 Series Memory Array Installation Guide
17
Chapter 1: Memory Array Hardware Installation
Installing the Cage Nuts
Cage nuts and screws are included in the accessory kit to secure the Memory Array to the top hole
on the rack ears and the equipment rack. Use either the supplied cage nuts or the screws,
depending on the style of your equipment rack.
Note: If the equipment rack in which the Memory Array will be installed is a square-hole rack, it
is recommended that you install the cage nuts before mounting the Memory Array.
Use the cage nuts for square-holed equipment racks. If the equipment rack has threaded holes, you
can secure the Memory Array to the equipment rack after the Memory Array is installed.
To install the cage nuts:
1. Identify the location in the equipment rack where the cage nut will reside. The cage nut will
align with the top hole on the rack ear, which is two holes above the top clip on the slide rail.
2. Remove the screw from the cage nut and set it aside for later use.
3. Insert the cage nut into the equipment rack at the identified location.
4. Using a flat-blade screwdriver, from the inside of the equipment rack, compress the cage nut
clip until the cage nut locks into place.
5. Repeat step 4 using another cage nut on the other side of the equipment rack.
Attaching the Rack Ears (Optional)
Note: Optional rack ears are included in the Memory Array shipping box if you do not want to
secure the Memory Array chassis to the equipment rack using the front bezel. Securing the Memory
Array to the equipment rack is covered on page 29.
Attach the rack ears to the two front corners of the Memory Array chassis to assist with sliding the
system in an out of the equipment rack.
1. Remove the rack ears and six flathead screws from the accessory kit.
Figure 1.11 Attaching the Left Cable Management Bracket and Routing the Cables
18
Violin 6000 Series Memory Array Installation Guide
535-0045-00 Rev 02
Installing the Memory Array
Spring-loaded Lock
2. Using a #1 Phillips screwdriver, attach the rack ears to both sides of the chassis.
Note: Do not secure the rack ears to the equipment rack until all of the cables are connected to
the Memory Array.
Mounting the Memory Array in the Equipment Rack
1. With another person, lift the Memory Array and then align the left and right inner rail sections
that you mounted on the Memory Array chassis with their original channels located on the
inside of the slide rails.
Figure 1.12 Mounting the Memory Array on the Equipment Rack
2. Carefully push the Memory Array into the slide rails until the inner rail sections lock into place,
making sure that the Memory Array remains level throughout.
3. Press in the spring-loaded locking mechanism on the outside of both inner rail sections and
then push the whole assembly back into the equipment rack.
Connecting the Cable Management Arm
See the Violin 6000 Series Memory Array Cable Management Installation Guide included in the
Memory Array shipping box for instructions on installing the cable management arm.
Skip to Grounding the Memory Array on page 20 if you are not using the Violin cable management
arm.
535-0045-00 Rev 02
Violin 6000 Series Memory Array Installation Guide
19
Chapter 1: Memory Array Hardware Installation
Grounding the Memory Array
This procedure describes the connection of the equipment ground from the equipment rack to the
Memory Array chassis.
Note: Maintain reliable earthing of rack-mounted equipment. Supply extra connections, other
than the direct connections to the branch circuit, such as using power strips.
Figure 1.13 Securing an Equipment Ground Wire
To connect an equipment ground wire to the Memory Array:
1. Cut an appropriate length of wire for the equipment ground wire for your location and strip 1/2”
of insulation from both ends of the wire. Use appropriately sized wire for your equipment
application. Minimum acceptable wire gauge is 8 AWG.
2. Using a size 10-32x1/2” (maximum length) screw (not included), secure the equipment ground
wire to the equipment ground connection on the rear of the chassis.
Note: A UL listed ground lug must be used. Check your local code requirements or contact a
licensed electrician.
3. Secure the other end of the equipment ground wire to the equipment rack using an
appropriately sized screw for the equipment rack. If the equipment rack has a designated
ground location, secure the ground wire to this location.
20
Violin 6000 Series Memory Array Installation Guide
535-0045-00 Rev 02
Loading...