Oracle Sun ZFS, Sun ZFS 7120, Sun ZFS 7320, Sun ZFS 7420 Service Manual

Page 1
Sun ZFS Storage 7x20 Appliance Customer Service Manual
Part No: E26399 December 2011 E26399–02
Page 2
Copyright © 2009, 2011, Oracle and/or its aliates. All rights reserved.
This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited.
The information contained herein is subject to change without notice and is not warranted to be error-free. Ifyou nd any errors, please report them to us in writing.
If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, the following notice is applicable:
U.S. GOVERNMENT RIGHTS
Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are "commercial computer software" or "commercial technical data" pursuant to the applicable Federal Acquisition Regulation and agency-specic supplemental regulations. As such, the use, duplication, disclosure, modication, and adaptation shall be subject to the restrictions and license terms set forth in the applicable Government contract, and, to the extent applicable by the terms of the Government contract, the additional rights set forth in FAR 52.227-19, Commercial Computer Software License (December 2007). Oracle America, Inc., 500 Oracle Parkway,Redwood City, CA 94065.
This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its aliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications.
Oracle and Java are registered trademarks of Oracle and/or its aliates. Other names may be trademarks of their respective owners.
Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered trademark of The Open Group.
This software or hardware and documentation may provide access to or information on content, products, and services from third parties. Oracle Corporation and its aliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services. Oracle Corporation and its aliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services.
Ce logiciel et la documentation qui l’accompagnesont protégés par les lois sur la propriété intellectuelle. Ils sont concédés sous licence et soumis à des restrictions d’utilisation et de divulgation. Sauf disposition de votre contrat de licence ou de la loi, vous ne pouvez pas copier, reproduire, traduire, diuser, modier, breveter, transmettre, distribuer, exposer, exécuter, publier ou acher le logiciel, même partiellement, sous quelque forme et par quelque procédé que ce soit. Par ailleurs, il est interdit de procéder à toute ingénierie inverse du logiciel, de le désassembler ou de le décompiler, excepté à des ns d’interopérabilité avec des logiciels tiers ou tel que prescrit par la loi.
Les informations fournies dans ce document sont susceptibles de modication sans préavis. Par ailleurs, Oracle Corporation ne garantit pas qu’elles soient exemptes d’erreurs et vous invite, le cas échéant, à lui en faire part par écrit.
Si ce logiciel, ou la documentation qui l’accompagne,est concédé sous licence au Gouvernement des Etats-Unis, ou à toute entité qui délivre la licence de ce logiciel ou l’utilise pour le compte du Gouvernement des Etats-Unis, la notice suivante s’applique :
U.S. GOVERNMENT RIGHTS. Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are "commercial computer software" or "commercial technical data" pursuant to the applicable FederalAcquisitionRegulation and agency-specic supplemental regulations. As such, the use, duplication, disclosure, modication, and adaptation shall be subject to the restrictions and license terms set forth in the applicable Government contract, and, to the extent applicable by the terms of the Government contract, the additional rights set forth in FAR 52.227-19, Commercial Computer Software License (December 2007). Oracle America, Inc., 500 Oracle Parkway,Redwood City, CA 94065.
Ce logiciel ou matériel a été développé pour un usage général dans le cadre d’applications de gestion des informations. Ce logiciel ou matériel n’est pas conçu ni n’est destiné à être utilisé dans des applications à risque, notamment dans des applications pouvant causer des dommages corporels. Si vous utilisez ce logiciel ou matériel dans le cadre d’applications dangereuses, il est de votre responsabilité de prendre toutes les mesures de secours, de sauvegarde, de redondance et autres mesures nécessaires à son utilisation dans des conditions optimales de sécurité. Oracle Corporation et ses aliés déclinent toute responsabilité quant aux dommages causés par l’utilisation de ce logiciel ou matériel pour ce type d’applications.
Oracle et Java sont des marques déposées d’OracleCorporation et/ou de ses aliés.Tout autre nom mentionné peut correspondre à des marques appartenant à d’autrespropriétaires qu’Oracle.
AMD, Opteron, le logo AMD et le logo AMD Opteron sont des marques ou des marques déposées d’Advanced Micro Devices. Intel et IntelXeon sont des marques ou des marques déposées d’Intel Corporation.Toutes les marques SPARCsont utilisées sous licence et sont des marques ou des marques déposées de SPARC International, Inc. UNIX est une marque déposée concédé sous license par X/Open Company, Ltd.
111216@25097
Page 3
Contents
Preface .....................................................................................................................................................7
1 Introduction ...........................................................................................................................................9
Overview ..................................................................................................................................................9
Introduction ....................................................................................................................................9
Hardware .............................................................................................................................................. 12
Hardware View ............................................................................................................................. 13
BUI ................................................................................................................................................. 13
CLI ................................................................................................................................................. 19
Tasks .............................................................................................................................................. 21
2 Hardware Maintenance ......................................................................................................................23
Maintenance ........................................................................................................................................ 23
Introduction ................................................................................................................................. 23
7120 ....................................................................................................................................................... 24
7120 Hardware Overview ........................................................................................................... 24
Chassis Overview ......................................................................................................................... 25
Electrical Specications ............................................................................................................... 27
Internal Components .................................................................................................................. 27
Standalone Controller Congurations ...................................................................................... 32
Attached Storage .......................................................................................................................... 34
7320 ....................................................................................................................................................... 34
7320 Hardware Overview ........................................................................................................... 34
Chassis Overview ......................................................................................................................... 34
7320 Replaceable Components .................................................................................................. 40
7320 Single and Cluster Controller Congurations ................................................................ 41
7420 ....................................................................................................................................................... 43
3
Page 4
7420 Hardware Overview ........................................................................................................... 43
Chassis Overview ......................................................................................................................... 44
Internal Boards ............................................................................................................................. 46
Components ................................................................................................................................. 46
7420 Standalone and Cluster Controller Congurations ....................................................... 50
Attached Storage .......................................................................................................................... 52
7x20 ....................................................................................................................................................... 53
7x20 CRU Maintenance Procedures .......................................................................................... 53
Prerequisites ................................................................................................................................. 53
Safety Information ....................................................................................................................... 53
Required Tools and Information ............................................................................................... 54
Chassis Serial Number ................................................................................................................. 54
Controller Replacement Tasks ................................................................................................... 54
SAS2 ...................................................................................................................................................... 80
Sun Disk Shelf Overview ............................................................................................................. 80
Shelf ....................................................................................................................................................... 86
Disk Shelf Maintenance Procedures .......................................................................................... 86
Prerequisites ................................................................................................................................. 86
Safety Information ....................................................................................................................... 86
Electrostatic Discharge Precautions .......................................................................................... 87
Tasks .............................................................................................................................................. 87
Faults ..................................................................................................................................................... 93
Hardware Faults ........................................................................................................................... 93
HBA Expansion pt.1 ............................................................................................................................ 95
Expanding from 2 to 3 HBAs ...................................................................................................... 95
HBA Expansion pt.2 .......................................................................................................................... 100
Expanding from 3 to 4 HBAs .................................................................................................... 100
3 System Maintenance .........................................................................................................................105
System ................................................................................................................................................. 105
Introduction ............................................................................................................................... 105
System Disks ............................................................................................................................... 105
Support Bundles ......................................................................................................................... 106
Initial Setup ................................................................................................................................. 107
Factory Reset ............................................................................................................................... 108
Contents
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–024
Page 5
Updates ............................................................................................................................................... 108
System Updates .......................................................................................................................... 108
Passthrough x ..................................................................................................................................... 125
Passthrough-x Deferred Update .............................................................................................. 125
User Quotas ........................................................................................................................................ 125
User Quotas Deferred Update .................................................................................................. 125
COMSTAR ......................................................................................................................................... 126
COMSTAR Deferred Update ................................................................................................... 126
Triple Parity RAID ............................................................................................................................ 126
Triple-Parity RAID Deferred Update ...................................................................................... 126
Dedup ................................................................................................................................................. 127
Data Deduplication Deferred Update ..................................................................................... 127
Replication ......................................................................................................................................... 127
Replication Deferred Update .................................................................................................... 127
Received Properties ........................................................................................................................... 127
Received Properties Deferred Update ..................................................................................... 127
Slim ZIL .............................................................................................................................................. 128
Introduction ............................................................................................................................... 128
Snapshot Deletion ............................................................................................................................. 128
Snapshot Deletion Deferred Update ....................................................................................... 128
Recursive Snapshots .......................................................................................................................... 128
Recursive Snapshots Deferred Update .................................................................................... 128
Multi Replace ..................................................................................................................................... 129
Multi Replace Deferred Update ................................................................................................ 129
RAIDZ Mirror ................................................................................................................................... 129
RAIDZ/Mirror Deferred Update ............................................................................................. 129
Optional Child Dir ............................................................................................................................ 129
Introduction ............................................................................................................................... 129
CongurationBackup ....................................................................................................................... 130
Conguration Backup ............................................................................................................... 130
Problems ............................................................................................................................................. 135
Problems ..................................................................................................................................... 135
Active problems display ............................................................................................................ 135
Repairing problems ................................................................................................................... 136
Related features .......................................................................................................................... 136
Logs ..................................................................................................................................................... 136
Contents
5
Page 6
Introduction ............................................................................................................................... 136
BUI ............................................................................................................................................... 138
CLI ............................................................................................................................................... 138
Glossary .............................................................................................................................................. 141
Index ................................................................................................................................................... 145
Contents
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–026
Page 7
Preface
The Sun ZFS Storage 7x20 Appliance Customer Service Manual contains hardware overviews and maintenance procedures for Oracle's Sun ZFS Storage 7x20 series of NAS appliances.
This documentation is also available while using the Browser User Interface, accessible via the Help button. The appliance documentation may be updated using the System Upgrade procedure documented in the System Maintenance chapter of this book.
Who Should Use This Book
These notes are for users and system administrators who service and use the Sun ZFS Storage 7x20 Appliances.
Related Documentation
Refer to the following documentation for installation instructions, hardware overviews, service procedures and software update notes.
Installation Guide, Analytics Guide and Administration Guide (http://www.oracle.com/ technetwork/documentation/)
Access to Oracle Support
Oracle customers have access to electronic support through My Oracle Support. For information, visit
http://www.oracle.com/pls/topic/lookup?ctx=acc&id=info or visit
http://www.oracle.com/pls/topic/lookup?ctx=acc&id=trs if you are hearing impaired.
7
Page 8
8
Page 9
Introduction
Overview
Introduction
The Sun ZFS Storage 7000 family of products provide ecient le and block data services to clients over a network, and a rich set of data services that can be applied to the data stored on the system.
Platforms
7120
7320
7420
Legacy platforms are documented in the 7110, 7210, 7310, 7410, J4400/J4500 sections of the Sun Storage 7000 Unied Storage System Service Manual.
Expansion Storage
Sun Disk Shelf
1
CHAPTER 1
9
Page 10
Protocols
Sun ZFS Storage appliances include support for a variety of industry-standard client protocols, including:
SMB
NFS
HTTP and HTTPS
WebDAV
iSCSI
FC
SRP
iSER
FTP
SFTP
Key Features
Sun ZFS Storage systems also include new technologies to deliver the best storage price/performance and unprecedented observability of your workloads in production, including:
Analytics, a system for dynamically observing the behavior of your system in real-time and viewing data graphically
The ZFS Hybrid Storage Pool, composed of optional Flash-memory devices for acceleration of reads and writes, low-power, high-capacity disks, and DRAM memory, all managed transparently as a single data hierarchy
Data Services
To manage the data that you export using these protocols, you can congure your Sun ZFS Storage system using the built-in collection of advanced data services, including:
LICENSE NOTICE: Remote Replication and Cloning may be evaluated free of charge, but each feature requires that an independent license be purchased separately for use in production. After the evaluation period, these features must either be licensed or deactivated. Oracle reserves the right to audit for licensing compliance at any time. For details, refer to the "Oracle Software LicenseAgreement ("SLA") and Entitlement for Hardware Systems with Integrated Software Options."
RAID-Z (RAID-5 and RAID-6), mirrored, and striped disk congurations
Unlimited read-only and read-write snapshots, with snapshot schedules
Data deduplication
Built-in data compression
Remote replication of data for disaster recovery
Active-active clustering for high availability (7310, 7320, 7410, and 7420)
Overview
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0210
Page 11
Thin provisioning of iSCSI LUNs
Virus scanning and quarantine
NDMP backup and restore
Availability
To maximize the availability of your data in production, Sun ZFS Storage appliances include a complete end-to-end architecture for data integrity, including redundancies at every level of the stack. Key features include:
Predictive self-healing and diagnosis of all system hardware failures: CPUs, DRAM, I/O cards, disks, fans, power supplies
ZFS end-to-end data checksums of all data and metadata, protecting data throughout the stack
RAID-6 (double- and triple-parity) and optional RAID-6 across disk shelves
Active-active clustering for high availability (7310, 7320, 7410, and 7420)
Link aggregations and IP multipathing for network failure protection
I/O Multipathing between the controller and disk shelves
Integrated software restart of all system software services
Phone-Home of telemetry for all software and hardware issues
Lights-out Management of each system for remote power control and console access
Browser User Interface (BUI)
The browser user interface
The BUI is the graphical tool for administration of the appliance. The BUI provides an intuitive environment for administration tasks, visualizing concepts, and analyzing performance data.
Overview
Chapter 1 • Introduction 11
Page 12
The management software is designed to be fully featured and functional on a variety of web browsers.
Direct your browser to the system using either the IP address or host name you assigned to the NET-0 port during initial conguration as follows: https://ipaddress:215 or https://hostname:215. The login screen appears.
The online help linked in the top right of the BUI is context-sensitive. For every top-level and second-level screen in the BUI, the associated help page appears when you click the Help button.
Command Line Interface (CLI)
The CLI is designed to mirror the capabilities of the BUI, while also providing a powerful scripting environment for performing repetitive tasks. The following sections describe details of the CLI. When navigating through the CLI, there are two principles to be aware of:
Tab completion is used extensively: if you are not sure what to type in any given context, pressing the Tab key will provide you with possible options. Throughout the documentation, pressing Tab is presented as the word "tab" in bold italics.
Help is always available: the help command provides context-specic help. Help on a particular topic is available by specifying the topic as an argument to help, for example help commands. Available topics are displayed by tab-completing the help command, or by typing help topics.
You can combine these two principles, as follows:
dory:> help tab builtins commands general help properties script
Hardware
Hardware
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0212
Page 13
Locating a disk
HardwareView
The Maintenance > Hardware screen (also known as the "hardware view") provides component status of the appliance and attached disk shelves. This information is available from both the BUI and the CLI.
BUI
The BUI hardware view provides interactive illustrations that enable you to browse through the appliance and attached disk shelf components. The screenshot at the top of this page shows a disk highlighted in a Sun Storage 7110, showing both its physical location and details.
The buttons in the hardware view are:
icon description icon description
Show a more detailed view of this component
Toggle blinking of the locator LED for this component
Leave this detailed view
Reboot the appliance
Hardware
Chapter 1 • Introduction 13
Page 14
icon description icon description
Click for more details
Power o the appliance
Hardware component is ok (green)
Oine disk
Hardware component is not present (grey)
Port active
Hardware component is faulted (amber)
Port inactive
System Overview
The main hardware page lists the system chassis, a summary of its contents, and any attached disk shelves (on supported systems). This provides an overview of the hardware present on the system, as well as controls to reset or power o the system.
System Chassis
The primary system chassis is shown on the top half of the view. At the top left, click the to get more detail about the chassis. The indicator notes if there are any faulted components within the chassis, and the name of the chassis. The chassis name is initially set to the appliance name during installation. To change the chassis name, use the entry eld on the Conguration > Services > System Identity screen.
At the top right of the system chassis is the
control to light the locate LED, reboot the
appliance, and
power o the chassis.
A thumbnail of the controller is presented at left. Clicking on the thumbnail or the "Show Details" link takes you to a detailed view of the chassis, and is identical to clicking on the right pointing arrow at the top left of the view.
The following information is presented in a summary view:
Property Description
Manufacturer Manufacturer of the system
Hardware
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0214
Page 15
Property Description
Model System model name
Serial System chassis hardware
serial number
Processors Count and description of
processors in the system
Memory Total memory in the
system
System Size and number of system
disks used for the system image
Data Size and number of data
disks in the system chassis. This is only valid for standalone systems. If there are no data disks present, "-" will be displayed.
Cache Size and number of cache
disks in the system chassis. This is only valid for expandable systems that support additional disk shelves. If there are no cache disks present, "-" will be displayed.
Log Size and number of log
disks in the system chassis. This is only valid for standalone systems. If there are no log devices present, "-" will be displayed.
Total Total size and count of all
disks in the system.
Disk Shelves
A list of disk shelves, if supported, is displayed at the bottom of the view. The thumbnail to the left represents the front of the currently selected disk shelf. Clicking on the right pointing arrow or double-clicking on a row within the list will provide complete details about the disk shelf. The state indicator will be orange if the chassis contains any faulted components. The following elds are displayed in the list:
Hardware
Chapter 1 • Introduction 15
Page 16
Property Description
Name Name of the disk shelf, used in faults and alerts. This is initially set to the serial
number of the disk shelf, but can be changed by clicking on the name within the list.
Manufacturer Disk Shelf Manufacturer
Model Disk Shelf Model
Data Total size of all data disks within the disk shelf.
Cache Total size of all read-optimized cache devices ("Readzillas") within the drive shelf.
There are currently no supported disk shelves with read cache devices, but this may not always be the case. If there are no cache devices within the shelf, then "-" is displayed.
Log Total size of all write-optimized cache devices ("Logzillas") within the drive shelf. If
there are no log devices within the shelf, then "-" is displayed.
Paths Total number of I/O paths to the disk shelf. The only supported congurations are
those with multiple paths to all disks, so this should read "2" under normal operating
circumstances. Clicking the
icon will bring up a dialog with information about each path. This includes which HBAs are connected to the disk shelf, and the state of any paths. If the disks within the disk shelf are not currently congured as part of a storage pool, complete path information will not be available, though it displays two paths to the chassis.
Locate
Toggle the locate LED for this disk shelf. If the LED is currently on, then this indicator will be ashing.
Chassis Detail
To view the chassis details, click on the icon (or one of the alternative forms described above). This view includes some of the same controls in the upper left (state, name, locate, reset, powero), as well as listings of all the components in the chassis.
At the left is a set of images describing the chassis. If there are multiple views, then you can switch between them by clicking on the name of the view above the image.
For each view, faulted components will be highlighted in red. In addition, the currently selected component will be highlighted in the image. Clicking on a component within the image will select the corresponding component in the list to the right.
A tab is present for each component type in the following list. Each component type has a state icon which will be orange if there is a faulted component of the given type.
Disk
Slot
CPU (controller only)
Memory (controller only)
Fan
Hardware
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0216
Page 17
Power supply (PSU)
Service processor (SP) (controller only)
Clicking on a component type will display a list of all physical locations within the chassis where components may be present. Clicking on a component within the list will highlight it within the
appropriate chassis image. Clicking on the
icon while over a row or double-clicking a row will bring up a dialog with detailed information about the component. The information displayed in the list depends on the component type, but is a subset of the information available in the component detail. Disks and service processors support additional operations described below. Each component can report any or all of the following properties:
Property Description
Label Human-readable identier for this component within the chassis. This is typically,
but not necessarily, equivalent to the label printed on the physical chassis.
FMRI Fault managed resource identier (FMRI) for the component. This is an internal
identier used to identify the component within faults and is intended for service personnel.
Active Problems For a faulted component, links to active problems aecting the component.
Manufacturer Component manufacturer.
Model Component model.
Build Manufacturing build identier. This is used to identify a particular location or batch
where the component was manufactured.
Part Component part number, or core factory part number. The orderable part number
may dier, depending on whether a component is for replacement or expansion, and whether it's part of a larger assembly. Your service provider should be able to refer you to the appropriate orderable part. For components without part numbers, the model number should be used instead.
Serial Component serial number.
Revision Firmware or hardware revision of the component.
Size Total memory or storage, in bytes.
Type Disk type. Can be one of 'system', 'data', 'log', 'cache', or 'spare'. When a spare is active,
it will be displayed as 'spare '.
Speed Processor speed, in gigahertz.
Cores Number of CPU cores.
GUID Hardwareglobal unique identier.
Hardware
Chapter 1 • Introduction 17
Page 18
Disks
Disks support the additional options:
Action Description
Locate
Toggle the locate indicator for the disk. If the LED is currently turned on, this icon will be blinking.
Oine
Oine the disk. This option is only available for disks that are part of a congured storage pool (including the system pool). Oining a disk prevents the system from reading or writing to it. Faulted devices are already avoided, so this option should only be required if a disk is exhibiting performance problems that do not result in pathological failure. It is not possible to oine a disk that would prevent access to data (i.e. oining both halves of a mirror). If the device is an active hot spare, this will also give the option of detaching the hot spare completely. Once a hot spare is detached, it cannot be activated except through another fault or hotplug event.
Online
Online the disk. Reverses the above operation.
Inniband Host Controller Adapters
Inniband Host Controller Adapters (HCA) report additional properties for the list of available ports:
Action Description
State
When "active", the active port icon
is displayed. Other valid port states ("down",
"init", and "arm") are denoted by the inactive port icon
. Mousing over the port
icon will display the current port state in the tip pop-up.
GUID The hardware assigned port GUID.
Speed The current port speed enabled: Single Data Rate (SDR), Dual Data Rate (DDR) or
Quad Data Rate (QDR)
Service Processor
The service processor behaves dierently from other component nodes. Instead of providing a list of components, it presents a set of network properties that can be congured from the storage appliance. The following properties control the behavior of the service processor network management port.
Property Description
MAC Address Hardware MAC address. This is read-only
Hardware
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0218
Page 19
Property Description
IP Address Source
Either 'DHCP' or 'Static'. Controls whether DHCP should be used on the interface.
IP Address IPv4 Address, when using static IP conguration. IPv6 is not supported.
Subnet Dotted decimal subnet, when using static IP conguration.
Default Gateway IPv4 default gateway address.
Changing multiple values in conicting ways (such as changing static IP assignments while in DHCP mode) has undened behavior.
CLI
Hardware status details are available in the CLI under the maintenance hardware section. Use the show command to list the status of all components. The list command will list available chassis, which can be selected and then viewed using show.
tarpon:> maintenance hardware show Chassis:
NAME STATE MANUFACTURER MODEL
chassis-000 0839QCJ01A ok Sun Microsystems, Inc. Sun Storage 7410
cpu-000 CPU 0 ok AMD Quad-Core AMD Op cpu-001 CPU 1 ok AMD Quad-Core AMD Op cpu-002 CPU 2 ok AMD Quad-Core AMD Op cpu-003 CPU 3 ok AMD Quad-Core AMD Op disk-000 HDD 0 ok STEC MACH8 IOPS disk-001 HDD 1 ok STEC MACH8 IOPS disk-002 HDD 2 absent - ­disk-003 HDD 3 absent - ­disk-004 HDD 4 absent - ­disk-005 HDD 5 absent - ­disk-006 HDD 6 ok HITACHI HTE5450SASUN500G disk-007 HDD 7 ok HITACHI HTE5450SASUN500G fan-000 FT 0 ok unknown ASY,FAN,BOARD,H2 fan-001 FT 0 FM 0 ok Sun Microsystems, Inc. 541-2068 fan-002 FT 0 FM 1 ok Sun Microsystems, Inc. 541-2068 fan-003 FT 0 FM 2 ok Sun Microsystems, Inc. 541-2068 fan-004 FT 1 ok unknown ASY,FAN,BOARD,H2 fan-005 FT 1 FM 0 ok Sun Microsystems, Inc. 541-2068 fan-006 FT 1 FM 1 ok Sun Microsystems, Inc. 541-2068 fan-007 FT 1 FM 2 ok Sun Microsystems, Inc. 541-2068 memory-000 DIMM 0/0 ok HYNIX 4096MB DDR-II 66 memory-001 DIMM 0/1 ok HYNIX 4096MB DDR-II 66 ...
A 5th column for serial number ("SERIAL") has been truncated in the above example, as has the length of this list.
Hardware
Chapter 1 • Introduction 19
Page 20
Component Properties
If a particular component is selected, detailed information about its properties are reported. The following properties are supported, with the corresponding BUI property name. For a description of a particular property, see the description above.
CLI Property BUI Property
build Build
cores Cores
device N/A
faulted (status indicator)
label Label
locate (writable) (status indicator)
manufacturer Manufacturer
model Model
oine (writeable)
(status indicator)
part Part
present (status indicator)
revision Revision
serial Serial
size Size
speed Speed
type (combined with
use)
use Type
When viewing a disk that is active as a hot spare, the detach command is also available.
Viewing CPU details
For example, the following shows details for component "CPU 0":
tarpon:maintenance hardware> select chassis-000 tarpon:maintenance chassis-000> select cpu tarpon:maintenance chassis-000 cpu> select cpu-000 tarpon:maintenance chassis-000 cpu-000> show
Hardware
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0220
Page 21
Properties:
label = CPU 0 present = true faulted = false
manufacturer = AMD
model = Quad-Core AMD Opteron(tm) Processor 8356
part = 1002
revision = 03
cores = 4
speed = 2.14G
Tasks
BUI
Locating a failed component
Go to the Maintenance > Hardwarescreen.
Click the
icon on the Storage System or Disk Shelf which has the fault icon.
Locate the faulticon in the lists ofhardware components, and click it. The imageshould be updated to showwhere that componentis physically located.
Optionally,click the
icon for thatcomponent, if the component has it.The LED on the
component will begin to ash.
CLI
To turn on the locate LED using the CLI, run the following commands.
Go to the maintenance hardware context:
hostname:> maintenance hardware
List the appliance components:
hostname:maintenance hardware> list
NAME STATE MODEL SERIAL chassis-000 hostname ok Sun Storage 7410 unknown chassis-001 000000000C faulted J4400 000000000C
Select the chassis and list its components:
hostname:maintenance hardware> select chassis-001 hostname:maintenance chassis-001> list
disk
1
2
3
4
Hardware
Chapter 1 • Introduction 21
Page 22
fan psu
slot
Select the component type and show all available disks:
hostname:maintenance chassis-001> select disk hostname:maintenance chassis-001 disk> show Disks:
LABEL STATE MANUFACTURER MODEL SERIAL disk-000 HDD 0 ok ST3500630NS ST3500630NS 9QG1ACNJ disk-001 HDD 1 faulted ST3500630NS ST3500630NS 9QG1A77R disk-002 HDD 2 ok ST3500630NS ST3500630NS 9QG1AC3Z disk-003 HDD 3 ok ST3500630NS ST3500630NS 9QG1ACKW disk-004 HDD 4 ok ST3500630NS ST3500630NS 9QG1ACKF disk-005 HDD 5 ok ST3500630NS ST3500630NS 9QG1ACPM disk-006 HDD 6 ok ST3500630NS ST3500630NS 9QG1ACRR disk-007 HDD 7 ok ST3500630NS ST3500630NS 9QG1ACGD disk-008 HDD 8 ok ST3500630NS ST3500630NS 9QG1ACG4 disk-009 HDD 9 ok ST3500630NS ST3500630NS 9QG1ABDZ disk-010 HDD 10 ok ST3500630NS ST3500630NS 9QG1A769 disk-011 HDD 11 ok ST3500630NS ST3500630NS 9QG1AC27 disk-012 HDD 12 ok ST3500630NS ST3500630NS 9QG1AC41 disk-013 HDD 13 ok ST3500630NS ST3500630NS 9QG1ACQ5 disk-014 HDD 14 ok ST3500630NS ST3500630NS 9QG1ACKA disk-015 HDD 15 ok ST3500630NS ST3500630NS 9QG1AC5Y disk-016 HDD 16 ok ST3500630NS ST3500630NS 9QG1ACQ2 disk-017 HDD 17 ok ST3500630NS ST3500630NS 9QG1A76S disk-018 HDD 18 ok ST3500630NS ST3500630NS 9QG1ACDY disk-019 HDD 19 ok ST3500630NS ST3500630NS 9QG1AC3Y disk-020 HDD 20 ok ST3500630NS ST3500630NS 9QG1ACG6 disk-021 HDD 21 ok ST3500630NS ST3500630NS 9QG1AC3X disk-022 HDD 22 ok ST3500630NS ST3500630NS 9QG1ACHL disk-023 HDD 23 ok ST3500630NS ST3500630NS 9QG1ABLW
Select the faulted disk and turn on the locate LED:
hostname:maintenance chassis-001 disk> select disk-001 hostname:maintenance chassis-001 disk-001> set locate=true
locate = true (uncommitted)
hostname:maintenance chassis-001 disk-001> commit
Hardware
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0222
Page 23
Hardware Maintenance
Maintenance
Introduction
This section describes concepts and procedural instructions for performing hardware and software maintenance tasks. The graphic above illustrates locating a spare disk within the chassis by highlighting its name in the BUI Hardware Maintenance list. The Maintenance >
Hardware
screen of the BUI provides visual representations of the physical system components,
allowing you to visually identify and locate hardware components and verify their status.
Software Updates can be applied in the System section of the interface, as well as viewing Logs
and current Problems.
Hardware - identify hardware components and verify their status
7120 Overview - view component diagrams and specications
2
CHAPTER 2
23
Page 24
7320 Overview - view component diagrams, specications, and cluster options
7420 Overview - view component diagrams, specications, and cluster options
7120, 7320, 7420 Maintenance Procedures - replace controller or cabinet drives, fans, power
supplies, RAM, cards, risers, and batteries
Disk Shelf Overview - view component diagrams and specications
Disk Shelf Maintenance Procedures - replace disk shelf components
Hardware Faults - Connect to ILOM to diagnose hardware faults
Expanding from 2 to 3 HBAs
Expanding from 3 to 4 HBAs
7110 Overview
7210 Overview
7310 Overview
7410 Overview
7x10 Maintenance Procedures
J4400/J4500 Overview
System - view system disks, manage support bundles
Updates - manage appliance software updates
Conguration Backup - backup and restore appliance conguration
Problems - view current problems
Logs - view appliance logs
Workows - manage and execute workows
7120
7120 Hardware Overview
Use the information in this section as a preparation reference for servicing replaceable components of the 7120 system.
Refer to the following for procedural instructions:
Controller Tasks - replace system controller components
Disk Shelf Tasks - replace disk shelf components
7120
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0224
Page 25
Chassis Overview
The Sun ZFS Storage 7120 is an enterprise-class two-socket rackmount x64 system powered by the Intel Xeon processor. It packs high performance and room for growth with four PCIe slots and 18 DIMM slots into a compact 2U footprint. Refer to the
http://www.oracle.com/us/ products/servers-storage/storage/unied-storage/index.html (http://www.oracle.com/ us/products/servers-storage/storage/unified-storage/index.html)
for the most
recent component specication.
Refer to the Implementing Fibre Channel SAN Boot with Oracle's Sun ZFS Storage Appliance whitepaper at
http://www.oracle.com/technetwork/articles/servers-storage-admin/ fbsanboot-365291.html (http://www.oracle.com/ technetwork/articles/servers-storage-admin/fbsanboot-365291.html)
for details on
FC SAN boot solutions using the Sun ZFS Storage 7120 Appliance.
The 7120 is a standalone controller that consists of an internal SAS-2 HBA providing disk shelf expansion, write ash acceleration, and 11 x 300GB 15K, 600GB 15K, 1TB 7.2K, 2TB 7.2K, or 3TB 7.2K hard drive storage. The SAS-2 storage fabric supports greater number of targets, greater bandwidth, higher reliability and bigger scale.
The 2U chassis form factor dimensions are as follows:
Dimension Measurement Dimension Measurement
Height 87.6 mm/3.45 in Depth 765.25 mm/30.13 in
Width 436.8 mm/17.2 in Weight 29.54 kg/65 lb
Front Panel
The following gure shows the front panel and the table describes the drive locations. The Logzilla 3.5" SSD belongs in slot 3 and is not supported in controllers congured with the internal Sun Aura ash HBA Logzilla.
7120
Chapter 2 • Hardware Maintenance 25
Page 26
Figure Legend
1 Locator LED/button (white)
7 HDD 2 13 HDD 8
2 Service Action Required
LED (amber)
8 HDD or SSD 3 14 HDD 9
3 Power button 9 HDD 4 15 HDD 10
4 Power/OK LED (green) 10 HDD 5 16 HDD 11
5 HDD 0 11 HDD 6 17 Drive map
6 HDD 1 12 HDD 7
Rear Panel
The following gure shows the rear panel. Note that optional Sun Dual Port 40Gb/sec 4x Inniband QDR HCAdapter PCIe cards (375-3606-01) may be located in slots 1, 2, or 3. Note that 375-3606-01 HCA expansion cards are not supported in the 10Gb network congurations.
Figure Legend
1 Power Supply Unit 1 6 PCIe 4 11 Network Management port
2 Power Supply Unit 0 7 Boot HDD 1 12 Gbit Ethernet ports NET 0, 1, 2, 3
3 PCIe 0 8 BootHDD 0 13 USB 2.0 ports (0, 1)
4 PCIe 3 9 Rear Panel System Status LEDs 14 HD15 Video port
5 PCIe 1 10 Serial Management port
The serial management connector (SER MGT) is an RJ-45 port and provides a terminal
connection to the SP console.
7120
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0226
Page 27
The network management connector (NET MGT) is an RJ-45 port and provides an alternate
terminal interface to the SP console.
There are four RJ-45 Gigabit Ethernet ports (NET0, NET1, NET2, NET3) located on the motherboard that operate at 10/100/1000 Mbit/sec. These network interfaces must be congured before use.
Electrical Specications
The following list shows the electrical specications for the 7120. Note that the power dissipation numbers listed are the maximum rated power numbers for the power supply. The numbers are not a rating of the actual power consumption of the appliance.
Connectors
Two C13 connectors which work on 110-220v outlets
Input
Nominal frequencies: 50/60Hz
Nominal voltage range: 100-120/200-240 VAC
Maximum current AC RMS: 13.8A @ 100 VAC
AC operating range: 90-264 VAC
Output
3.3 VDC STBY: 3.0A
+12 VDC: 86.7A
Power dissipation
Max power consumption: 1235.3 W
Max heat output: 4212 BTU/hr
Volt-Ampere rating: 1261 VA @ 240 VAC, 0.98P.F.
Internal Components
The chassis has the following boards installed. Field-replaceable units (FRU) should only be replaced by trained Oracle service technicians.
PCIe Risers - Each riser supports two PCIe cards that are customer-replaceable. There are two risers per system, each attached to the rear of the motherboard.
7120
Chapter 2 • Hardware Maintenance 27
Page 28
Motherboard - The motherboard is a FRU and includes CPU modules, slots for 18 DIMMs, memory control subsystems, and the service processor (SP) subsystem. The SP subsystem controls the host power and monitors host system events (power and environmental). The SP controller draws power from the host's 3.3V standby supply rail, which is available whenever the system is receiving AC input power, even when the system is turned o.
Power Distribution Board - The power distribution board is a FRU and distributes main 12V power from the power supplies to the rest of the storage controller. It is directly connected to the Connector Break Out Board, and to the motherboard through a bus bar and ribbon cable. It also supports a top cover interlock kill switch. The power supplies connect directly to the power distribution board.
Connector Break Out Board - The Connector Break Out Board is FRU and serves as the interconnect between the power distribution board and the fan power boards, storage drive backplane, and I/O board. It also contains the top-cover interlock "kill" switch.
Fan Power Boards - The two fan power boards are FRUs and carry power to the system fan modules. In addition, they contain fan module status LEDs and transfer I2C data for the fan modules.
Storage Drive Backplane - The storage drive backplane is a FRU and includes the connectors for the storage drives, as well as the interconnect for the I/O board, Power and Locator buttons, and system/component status LEDs. The system has a 12-disk backplane. Each drive has an LED indicator for Power/Activity, Fault, and Locate.
7120
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0228
Page 29
I/O Components
The I/O components of the 7120 system are shown in the following gure and described in the
table.
Figure Legend
1 Top Cover 3 Hard Disk Drives
2 Right Control Panel Light Pipe Assembly 4 Left Control Panel Light Pipe Assembly
7120
Chapter 2 • Hardware Maintenance 29
Page 30
Cables
The storage controller's internal cables are shown in the following gure and table. Note that the rear boot drives are not depicted in this illustration.
Cable Connection
1 Storage Drive Data Cable Connection between the HBA PCI-Express Card and the storage drive backplane.
7120
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0230
Page 31
Cable Connection
2 Ribbon cable Connection is between the power distribution board and the motherboard.
CPU and Memory
The 7120 motherboard has 18 slots in two groups that hold industry-standard DDR3 DIMMs. The 7120 CPU and memory should only be replaced by eld service professionals. All sockets must be occupied by either a ller or a DDR3 DIMM. All DDR3 DIMMs must be identical. DIMMs are pre-installed in P0 slots D1, D2, D4, D5, D7, and D8.
Power Distribution, FanModule and Disk Components
The fan modules and LEDs are shown in the following illustration.
7120
Chapter 2 • Hardware Maintenance 31
Page 32
The power distribution and associated components are shown in the following illustration and described in the table.
Figure Legend
1 Fan Board 5 Power Distribution Board
2 SAS Expander Board 6 Connector Board
3 Disk Backplane 7 Power Supply Backplane
4 Front Control Panel Light Pipe Assembly
Standalone Controller Congurations
The following table shows the conguration options for a 7120 controller. All PCIe cards are low-prole, and must be tted with low-prole mounting brackets.
This table describes base congurations for the 7120 with Aura Logzilla.
Mktg Part Number Description Mfg Part Number
TA7120-12TB S7120, 1xCPU, 24GB, 12TB 597-0754-01
TA7120-24TB S7120, 1xCPU, 24GB, 24TB 597-0755-01
This table describes base congurations for the 7120 with Logzilla 3.5" SSD.
7120
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0232
Page 33
Mktg Part Number Description Mfg Part Number
7101282 S7120, 1xCPU, 24GB, 3.3TB 7014523
7101284 S7120, 1xCPU, 24GB, 6.6TB 7014525
NIC/HBA Options
This table describes NIC/HBA options for the 7120.
Mktg Part Number Description Mfg Part Number
SG-XPCIESAS-GEN2-Z 2-port External Sun Thebe SAS (x4) HBA, PCIe 594-5889-01
SG-XPCIE2FC-QF8-Z 2-port FC HBA, 8Gb, PCIe 594-5684-01
X4446A-Z 4-port PCI-E Quad GigE UTP 594-4024-01
X4237A-N 2-port 4X IB HCA PCIe 594-5862-02
X1109A-Z 2-port 10Gig SFP+ NIC, PCIe 594-6039-01
PCIe Options
This table describes the supported PCIe conguration option summary for the 7120.
Slot Type Sun Part Number VendorPartNumber Description Note
0 PCIe 540-7975-03 Sun Aura Internal Flash Base Conguration (OBSOLETE)
0 PCIe 375-3481-01 Intel EXPI9404PT QP Copper NIC Optional Recommended Front-end
0 PCIe 375-3617-01 Intel Niantic DP Optical 10GE NIC Optional Recommended Front-end
0 PCIe 371-4325-01 QLogic 8Gb DP FC HBA Optional FC Target or Initiator (Backup)
0 PCIe 375-3606-01 Mellanox MHJH29-XTC InniBand HCA Optional Recommended Front-end
1 PCIe 375-3617-01 Intel Niantic DP Optical 10GE NIC Optional Recommended Front-end
1 PCIe 375-3606-01 Mellanox MHJH29-XTC InniBand HCA Optional Recommended Front-end
1 PCIe 375-3481-01 Intel EXPI9404PT QP Copper NIC Optional Recommended Front-end
1 PCIe 371-4325-01 QLogic 8Gb DP FC HBA Optional FC Target or Initiator (Backup)
3 PCIe 375-3665-01 Sun Thebe (INT) Internal SAS HBA Base Conguration
4 PCIe 375-3481-01 Intel EXPI9404PT QP Copper NIC Optional Recommended Front-end
4 PCIe 371-4325-01 QLogic 8Gb DP FC HBA Optional FC Target or Initiator (Backup)
4 PCIe 375-3609-03 Sun Thebe (EXT) 8P 6Gb/s SAS HBA Additional Optional Back-end
7120
Chapter 2 • Hardware Maintenance 33
Page 34
Attached Storage
The 7120 standalone congurations allow a single chain of 1 or 2 Sun Disk Shelves. Write-optimized (Logzilla) SSDs are not supported in the expansion storage for the 7120. The disk shelves must be fully populated with 24 HDDs. Half-populated shelf congurations are not supported.
7320
7320 Hardware Overview
Use the information in this section as a preparation and reference for servicing replaceable components of the 7320 system. Refer to the following for procedural instructions:
Controller Tasks - replace storage controller components
Disk Shelf Tasks - replace disk shelf components
Chassis Overview
The Sun ZFS Storage 7320 System consists of either a single storage controller, or two storage controllers in a high availability cluster conguration, and one to four Sun Disk Shelves.
The 7320 controller base conguration includes two CPUs, built-in 4 x 1Gb/s front-end GigE ports, redundant power supplies, NIC options for expanded front-end support, tape backup, Inniband, and dual port SAS HBA for storage expansion.
The CPUs are Intel Xeon 5600 series, 2.40GHz, 80W, 4 core processors. Standard memory conguration is 24GB, 3 x 4GB DDR3-1333 DR DIMMs and may be upgraded to 48GB using 6x4GB DDR3-1333 DR DIMMs per CPU or to 72GB using 9x4GB DDR3 DR DIMMs per CPU. The clustered conguration simply uses two servers and a cluster card in each server for a heartbeat connection between them.
All user-accessible storage is provided by one to four Sun Disk shelves external to the server(s). The RAID function is done by the software. Solid State 18GB SAS-1 drives (7320 SAS-2) which are used for high-performance write cache known as LogZilla or ZFS intent log (ZIL) devices, are in place of one to four of the 24 drives in the Disk Shelf, the remaining 20 drives are available for storage.
Refer to the
http://www.oracle.com/us/products/servers-storage/storage/unied-storage/ index.html (http://www.oracle.com/ us/products/servers-storage/storage/unified-storage/index.html)
for the most
recent component specication.
7320
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0234
Page 35
The 7320 is a next-generation SAS-2 (Serial Attached SCSI 2.0) device that consists of a new HBA, new disk shelf, and new disks (1TB and 2TB SAS-2). The SAS-2 storage fabric supports greater number of targets, greater bandwidth, higher reliability and bigger scale.
Boards
The storage controller chassis has the following boards installed. Field-replaceable units (FRUs) should only be replaced by trained Oracle service technicians.
PCIe Risers - The storage controller contains three PCIe risers that are customer-replaceable units (CRUs) and are attached to the rear of the motherboard. Each riser supports one PCIe card.
Motherboard - The motherboard is a FRU and includes CPU modules, slots for 18 DIMMs, memory control subsystems, and the service processor (SP) subsystem. The SP subsystem controls the host power and monitors host system events (power and environmental). The SP controller draws power from the host's 3.3V standby supply rail, which is available whenever the system is receiving AC input power, even when the system is turned o.
Power Distribution Board - The power distribution board is a FRU and distributes main 12V power from the power supplies to the rest of the storage controller. It is directly connected to the paddle board, and to the motherboard through a bus bar and ribbon cable. It also supports a top cover interlock kill switch.
Paddle board - The paddle board is a FRU and serves as the interconnect between the power distribution board and the fan power boards, hard drive backplane, and I/O board.
Fan Board - This board is FRUs and carries power to the storage controller fan modules. In addition, they contain fan module status LEDs and transfer I2C data for the fan modules.
Disk Backplane - The hard drive backplane is a FRU and includes the connectors for the hard disk drives, as well as the interconnect for the I/O board, Power and Locator buttons, and system/component status LEDs. The storage controller has an eight-disk backplane. Each drive has an LED indicator for Power/Activity, Fault, and OK-to-remove (not supported).
Following is the complete set of replaceable system boards for the 7320 storage controller.
Part Number Description FRU/CRU
F541-2883-01 X8 PCIe Riser Card 1U CRU
F541-2885-01 X16 PCIe Riser Card 1U CRU
F541-4081-01 RoHS Motherboard and Tray FRU
F511-1489-01 DB, Power Distribution Board FRU
F511-1548-01 PCB, 8 Disk 1U Backplane FRU
F541-4275-02 PCBA, Connector Board, 1U FRU
7320
Chapter 2 • Hardware Maintenance 35
Page 36
Cables
Following is the complete set of replaceable cables for the 7320 storage controller.
Part Number Description FRU/CRU
F530-4228-01 Cable, Mini SAS FRU (internal)
F530-3927-01 FRU,CBL,PDB,MB,1U+2U,RIBBON FRU (internal)
F530-4431-01 Cable, Fan data FRU (internal)
F530-4417-01 FRU Cable, Fan paddle FRU (internal)
F530-3880-01 Cable, Assembly, Ethernet, Shielded, RJ45-RJ45, 6m CRU (external)
F530-3883-01 FRU,2M,4X Mini SAS Cable CRU (external)
7320 I/O Components
The I/O components of the storage controller are shown in the following gure and identied
in the table.
7320
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0236
Page 37
Figure Legend
1 Top cover 2 Left Control Panel Light Pipe Assembly
3 Drive Cage 4 Solid State Drives
5 blank/USB Module 6 Right Control Panel Light Pipe Assembly
7320 CPU and Memory Components
Following are the replaceable CPU and memory components of the 7320 system.
Part Number Description FRU/CRU
F371-4898-01 DIMM, 4GB, DDR3, 2RX4, 13 FRU
F371-4885-01 Intel E5620, 2.40G FRU
The storage controller motherboard has 18 slots in two groups that hold industry-standard DDR3 DIMM memory cards. All sockets must be occupied by either a ller or a DDR3 DIMM.
7320 Power Distribution and Fan Module Components
The Power Distribution/Fan Module components of the storage controller are shown in the following gure and identied in the table.
7320
Chapter 2 • Hardware Maintenance 37
Page 38
Figure Legend
1 Fan Modules 4 Power Distribution/Bus BarAssembly
2 Fan Board 5 Power Supplies
3 Paddle Board
Electrical Specications
The following list shows the electrical specications for the 7320. Note that the power dissipation numbers listed are the maximum rated power numbers for the power supply. The numbers are not a rating of the actual power consumption of the appliance.
Connectors
Two C13 connectors which work on 110-220v outlets
Input
Nominal frequencies: 50/60Hz
Nominal voltage range: 100-120/200-240 VAC
Maximum current AC RMS: 9.0 amps Max
AC operating range: 90-264 VAC
Output
3.3 VDC STBY: 3.6A
+12 VDC: 62.3A
7320
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0238
Page 39
Power dissipation
Max power consumption: 873 W
Max heat output: 2977 BTU/hr
Volt-Ampere rating: 891 VA @ 240 VAC, 0.98P.F.
7320 Front Panel
The following graphic illustrates the front panel LEDs.
The table describes the LEDs.
Figure Legend
1 Locate Button/LED
2 Service Required LED (amber)
3 Power/OK LED (green)
4 Power Button
5 Rear Power Supply
6 System Overtemperature LED
7 Top Fan
The following graphic illustrates the 7320 front panel with drive locations described in the table. Two mirrored hard disk drives (HDDs) that store the operating system reside in slots 0 and 1. Up to four solid state drives (ReadZilla SSDs) that store the read cache ll slots 2 through 5, in order. Slots 6 and 7 are empty and must contain drive llers.
7320
Chapter 2 • Hardware Maintenance 39
Page 40
Disk Drive Locations
HDD1 HDD3 HDD5
HDD0 HDD2 HDD4 HDD6 HDD7
7320 Replaceable Components
Following is the complete list of replaceable power distribution, disk, and fan module components of the 7320 system. Note that power supplies, disks, and fan modules are hot-pluggable on the storage controller.
Part Number Description FRU/CRU
F300-2233-02 RoHS 760W Power Supply CRU
F541-2075-04 Buss Bar Power, 1U FRU
F542-0184-01 DR, 3Gb SATA CRU
F542-0330-01 2.5" 512GB ReadZilla SSD CRU
F541-276-01 ASSY,FAN Module CRU
F541-4274-02 Fan Board (1U) FRU
7320 PCIe Cardsand Risers
Following is the complete list of replaceable PCIe cards for the 7320 system.
Part Number Description FRU/CRU
F371-4325-01 8Gb FC HBA (PCIe) CRU
F375-3609-02 PCA, SAS 6GBS 8 Port (PCIe) CRU
F375-3606-03 Dual Port (x4) IB HCA (PCIe) CRU
F375-3696-01 Dual Port CX2 4XQDR (PCIe) CRU
F375-3617-01 2X10GbE SFP+, X8 (PCIe) CRU
F375-3481-01 NIC Card Quad Port 1GigE Cu (PCIe) CRU
F511-1496-04 Sun Fishworks Cluster Controller 200 (PCIe) FRU
7320
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0240
Page 41
7320 Rear Panel
Following is an illustration of the 7320 storage controller rear panel. The Sun 375-3609 belongs in slot 2, cannot be installed in any other slots, and a second is not oered as an option.
Figure Legend
1 Power supplies 4 Network management port
2 SC summary status LEDs 5 Ethernet ports
3 Serial management port 6 PCIe slots
7320 Single and Cluster Controller Congurations
The single controller base conguration is 24GB RAM, 2x2.4GHz Quad-Core processors, one external SAS HBA, and four 10/100/1000 Ethernet ports.
This table describes base congurations for the 7320.
Mktg Part Number Description Mfg Part Number
TA7320-24A S7320, 2xCPU, 24GB, Single 597-1060-01
TA7320-24A-HA S7320, 2xCPU, 24GB, Cluster 597-1061-01
Following are the PCIe conguration options for a single controller. All PCIe cards are low-prole, and must be tted with low-prole mounting brackets.
Slot Type Part Number Vendor Part Description Note
0 PCIe 375-3617-01 Intel Niantic DP Optical 10GE NIC Optional Recommended Front-end
0 PCIe 375-3696-01 Mellanox InniBand HCA Optional Recommended Front-end
0 PCIe 375-3606-03 MHJH29-XTC InniBand HCA Optional Recommended Front-end
0 PCIe 375-3481-01 Intel EXPI9404PT QP Copper NIC Optional Recommended Front-end
7320
Chapter 2 • Hardware Maintenance 41
Page 42
Slot Type Part Number Vendor Part Description Note
0 PCIe 371-4325-01 QLogic 8Gb DP FC HBA Optional FC Target or Initiator (Backup)
1 PCIe 375-3617-01 Intel Niantic DP Optical 10GE NIC Optional Recommended Front-end
1 PCIe 375-3696-01 Mellanox InniBand HCA Optional Recommended Front-end
1 PCIe 375-3606-03 MHJH29-XTC InniBand HCA Optional Recommended Front-end
1 PCIe 375-3481-01 Intel EXPI9404PT QP Copper NIC Optional Recommended Front-end
1 PCIe 371-4325-01 QLogic 8Gb DP FC HBA Optional FC Target or Initiator (Backup)
2 PCIe 375-3609-03 Sun Thebe External SAS HBA Base Conguration
7320 Cluster Congurations
The 7320 cluster base conguration is 24GB RAM, 2x2.4GHz Quad-Core processors, one external SAS HBA, and four 10/100/1000 Ethernet ports, and a Cluster card. The Sun Storage 7420C Cluster Upgrade Kit (XOPT 594-4680-01) contains two cluster cards with cables for converting two 7320 or two 7420 controllers to a cluster.
The following options are available for clustered storage controllers. Note that both storage controllers in a cluster must be congured identically with regard to card congurations and all optional NIC/HBA card congurations chosen for clustered storage controllers must be identical in both chassis.
Slot Type Part Number Vendor Part Description Note
0 PCIe 375-3617-01 Intel Niantic DP Optical 10GE NIC Optional Recommended Front-end
0 PCIe 375-3696-01 Mellanox InniBand HCA Optional Recommended Front-end
0 PCIe 375-3606-03 MHJH29-XTC InniBand HCA Optional Recommended Front-end
0 PCIe 375-3481-01 Intel EXPI9404PT QP Copper NIC Optional Recommended Front-end
0 PCIe 371-4325-01 QLogic 8Gb DP FC HBA Optional FC Target or Initiator (Backup)
1 PCIe 542-0298-01 Sun Fishworks Cluster Card 2 Cluster Base Conguration
2 PCIe 375-3609-03 Sun Thebe External SAS HBA ClusterBase Conguration
7320 Connector Pinouts
The serial management connector (SERIAL MGT) is an RJ-45 connector and a terminal connection to the SP console.
7320
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0242
Page 43
The network management connector (NET MGT) is an RJ-45 connector on the motherboard and provides an alternate terminal interface to the SP console.
There are four RJ-45 Gigabit Ethernet connectors (NET0, NET1, NET2, NET3) located on the motherboard that operate at 10/100/1000 Mbit/sec. These network interfaces must be congured before use.
7320 Storage Disk Shelf
The 7320 single and cluster controller congurations allow a single chain of 1 to 4 Sun Disk
Shelves
. Any combination of disk-only and Logzilla-capable shelves may be combined within the chain in any order. The cabling congurations are unchanged. Half-populated shelf congurations are not supported.
See Also
Disk Shelf Overview
Disk Shelf Details
Controller Details
7420
7420 Hardware Overview
Use the information on this page as a preparation reference for servicing replaceable components of 7420 controllers. Refer to the following for procedural instructions:
Controller Tasks - replace system controller components
Disk Shelf Tasks - replace disk shelf components
7420
Chapter 2 • Hardware Maintenance 43
Page 44
Chassis Overview
The Sun ZFS Storage 7420 Appliance consists of either a single storage controller, or two storage controllers in a high availability cluster conguration, and one to 24 Sun Disk shelves. Refer to the
http://www.oracle.com/us/products/servers-storage/storage/unied-storage/ index.html (http://www.oracle.com/ us/products/servers-storage/storage/unified-storage/index.html)
for the most
recent component specication.
The 3U chassis form factor dimensions are as follows:
Dimension Measurement Dimension Measurement
Height 13.3 cm/5.25 in Depth 70.6 cm/27.8 in
Width 43.7 cm/17.19 in Weight 16.36 kg/96 lbs
Front Panel
Figure Legend
1 Locator LED and button (white) 7 Power Supply (PS) Service Required LED 13 Boot drive 1 (required)
2 Service Required LED (amber) 8 Over Temperature Warning LED 14 Solid state drive 2 (optional)
3 Power/OK LED (green) 9 USB 2.0 Connectors 15 Solid state drive 3 (optional)
4 Power button 10 DB-15 video connector 16 Solid state drive 4 (optional)
5 Service Processor (SP) OK LED (green) 11 SATA DVD drive (optional) 17 Solid state drive 5 (optional)
6 Fan/CPU/Memory Service Required LED 12 Boot drive 0
7420
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0244
Page 45
The 500GB boot drives (HDDs) reside in slots 0 and 1 as a mirrored set, and Sun Storage Readzilla 512GB solid state drives (SSDs), may optionally ll, in order, slots 2 through 5. Each storage controller may have 0, 2, 3, or 4 Readzilla devices.
Figure Legend
1 Locate (white) 2 Service action required (amber) 3 OK/Activity (green)
Rear Panel
The following graphic shows the 7420 rear panel. Base conguration HBAs are not depicted in this illustration.
Figure Legend
1 Power supply unit 0 status LEDs 8 Network (NET) 10/100/1000 ports: NET0-NET3
2 Power supply unit 0 AC inlet
3 Power supply unit 1 status LEDs 10 PCIe slots 5-9
4 Power supply unit 1 AC inlet 11 Network management (NET MGT) port
5 System status LEDs Power: green Attention: amber Locate: white 12 Serial management (SER MGT) port
6 PCIe slots 0-4 13 DB-15 video connector
7420
Chapter 2 • Hardware Maintenance 45
Page 46
Figure Legend
7 Cluster card slot
Internal Boards
The 7420 storage controller chassis has the following boards installed. Field-replaceable units (FRUs) should only be replaced by trained Oracle service technicians.
Motherboard - The motherboard is a FRU and includes CPU modules, slots for eight DIMM risers, memory control subsystems, and the service processor (SP) subsystem. The SP subsystem controls the host power and monitors host system events (power and environmental). The SP controller draws power from the host's 3.3V standby supply rail, which is available whenever the system is receiving AC input power, even when the system is turned o.
Power Distribution Board - The power distribution board is a FRU and distributes main 12V power from the power supplies to the rest of the system. It is directly connected to the Vertical PDB card, and to the motherboard through a bus bar and ribbon cable. It also supports a top cover interlock ("kill") switch. In the storage controller, the power supplies connect to the power supply backplane which connects to the power distribution board.
Vertical PDB Card - The vertical power distribution board, or Paddle Card is a FRU and serves as the interconnect between the power distribution board and the fan power boards, hard drive backplane, and I/O board.
Power Supply Backplane Card - This board connects the power distribution board to power supplies 0 and 1.
Fan Power Boards - The two fan power boards are FRUs and carry power to the storage controller fan modules. In addition, they contain fan module status LEDs and transfer I2C data for the fan modules.
Drive Backplane - The six-drive backplane is a FRU and includes the connectors for the drives, as well as the interconnect for the I/O board, Power and Locator buttons, and system/component status LEDs. Each drive has an LED indicator for Power/Activity, Fault, and Locate.
Components
The components of the storage controller are shown in the following gure and identied in the table.
7420
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0246
Page 47
Figure Legend
1 Motherboard 8 System lithium battery
2 Low-prole PCIe cards 9 CPUs and heatsinks
3 Power supplies 10 Memory Risers
4 Power supply backplane 11 Fan board
5 Filler 12 Fan Modules
7 Drive backplane 14 Boot drives and SSDs
CPU and Memory
The 7420 appliance supports two or four CPUs, with two memory risers required by each CPU. Four or eight 4GB or 8GB DDR3 DIMMs are installed on each riser, accommodating up to 256GB of memory for two CPUs, or up to 512GB for four CPUs. Empty CPU sockets must have memory riser llers installed for proper cooling.
The new 7420 controller has dierent CPU options and memory risers, but is visually identical to the existing 7420 controller (with 1.86GHz or 2.00GHz CPUs). The new 7420 controller supports the following congurations:
7420
Chapter 2 • Hardware Maintenance 47
Page 48
Two, four, or eight 8GB DDR3 DIMMs installed on each riser, accommodating 128GB, 256GB, or 512GB of memory for 2.0Ghz CPUs.
Four or eight 8GB DDR3 DIMMs installed on each riser, accommodating 256GB or 512GB of memory for 2.0GHz and 2.4Ghz CPUs.
Four or eight 16GB DDR3 DIMMs installed on each riser, accommodating 512GB or 1TB of memory for 2.4Ghz CPUs.
Refer to the service label on the cover for DIMM placement information. On every memory riser, slots D0, D2, D4, and D6 must be populated; optionally, slots D1, D3, D5, and D7 may be populated as a group on all installed memory risers. All DIMMs in the system must be identical.
7420
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0248
Page 49
DIMM names in appliance logs and the Maintenance > Hardware view are displayed with the full name, such as /SYS/MB/P0/D7.
Fan Modules
The Fan Modules and Fan Module LEDs of the storage controller are shown in the following gure. The following LEDs are lit when a fan module fault is detected:
Front and rear Service Action Required LEDs
Fan Module Service Action Required (TOP) LED on the front of the server
Fan Fault LED on or adjacent to the faulty fan module
The system Overtemp LED might light if a fan fault causes an increase in system operating temperature.
7420
Chapter 2 • Hardware Maintenance 49
Page 50
PCIe Cards
The Sun Fishworks Cluster Controller 200 belongs in the Cluster slot (C) only. SAS HBAs must all be of the same type, installed in slots 1 and 8, with an optional third SAS HBA in slot 2, and an optional fourth SAS HBA in slot 7. PCIe slots should be populated in the following order: 9 (if used), 0 (if used), 7, 2, 6, 3, 5, 4.
Connectors
The serial management connector (SER MGT) is an RJ-45 connector and provides a terminal
connection to the SP console.
The network management connector (NET MGT) is an RJ-45 connector and provides a LAN
interface to the SP console.
There are four RJ-45 Gigabit Ethernet connectors (NET0, NET1, NET2, NET3) located on the motherboard that operate at 10/100/1000 Mbit/sec. These network interfaces must be congured before use.
7420 Standalone and Cluster Controller Congurations
The following tables show the conguration options for a single standalone 7420 controller or two clustered 7420 controllers. All PCIe cards are low-prole, and must be tted with low-prole mounting brackets.
Standalone Base Options
This table describes 7420 standalone base congurations. Note: both 7100566 and 7100568 include a cluster card and can be congured as a single standalone or two clustered conguration.
Mktg Part Number Description Mfg Part Number
TA7420-26A S7420, no DIMMs, 2x1.86GHz-6C 597-0789-01
TA7420-28A S7420, no DIMMs, 2x2.00GHz-8C 597-0790-01
7100566 S7420, no DIMMs, 4x2GHz-8C 7014572
7100568 S7420, no DIMMs, 4x2.40GHz-10C 7014573
7420
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0250
Page 51
Cluster Base Options
This table describes 7420 cluster base congurations.
Mktg Part Number Description Mfg Part Number
TA7420-26AR00HA S7420, no DIMMs, 2x1.86GHz-6C, Cluster 597-0795-01
TC7420-28AR00HA S7420, no DIMMs, 2x2.00GHz-8C, Cluster 597-0792-01
7100566 S7420, no DIMMs, 4x2GHz-8C, Cluster 7014572
7100568 S7420, no DIMMs, 4x2.40GHz-10C, Cluster 7014573
NIC/HBA Options
This table describes NIC/HBA options for 7420 single and cluster congurations.
Mktg Part Number Description Mfg Part Number
SG-XPCIESAS-GEN2-Z 2-port External Sun Thebe SAS (x4) HBA, PCIe F375-3609-03
SG-XPCIE2FC-QF8-Z 2-port FC HBA, 8Gb, PCIe 594-5684-01
X4446A-Z 4-port PCIe Quad GigE UTP 594-4024-01
X4237A 2-port 4X IB HCA PCIe 594-5862-02
X1109A-Z 2-port 10Gig SFP+ NIC, PCIe 594-6039-01
X2129A XCVRm 850NM, 1/10GPS, Short Reach, SFP 594-6508-01
PCIe Options
This table describes the supported single and clustered PCIe conguration option summary for
7420.
Slot Type
Sun Part Number Description Note
0 PCIe 371-4325-01 8Gb DP FC HBA Optional FC Target or Initiator (Backup)
1 PCIe 375-3609-02 DP SAS-2 HBA Base Conguration
2 PCIe 375-3609-02 DP SAS-2 HBA Additional Optional Back-end
2 PCIe 375-3481-01 QP Copper NIC Optional Recommended Front-end
2 PCIe 371-4325-01 8Gb DP FC HBA Optional FC Target or Initiator (Backup)
2 PCIe 375-3606-01 Inniband HCA Optional Recommended Front-end
7420
Chapter 2 • Hardware Maintenance 51
Page 52
Slot Type
Sun Part Number Description Note
2 PCIe 375-3617-01 DP Optical 10GE NIC Optional Recommended Front-end
3 PCIe 375-3481-01 QP Copper NIC Optional Recommended Front-end
3 PCIe 371-4325-01 8Gb DP FC HBA Optional FC Target or Initiator (Backup)
3 PCIe 375-3606-01 Inniband HCA Optional Recommended Front-end
3 PCIe 375-3617-01 DP Optical 10GE NIC Optional Recommended Front-end
4 PCIe 375-3481-01 QP Copper NIC Optional Recommended Front-end
4 PCIe 375-3606-01 InniBand HCA Optional Recommended Front-end
4 PCIe 375-3617-01 DP Optical 10GE NIC Optional Recommended Front-end
C PCIe 511-1496-04 Cluster Controller
200
Cluster Base Conguration ONLY
5 PCIe 375-3481-01 QP Copper NIC Optional Recommended Front-end
5 PCIe 375-3606-01 InniBand HCA Optional Recommended Front-end
5 PCIe 375-3617-01 DP Optical 10GE NIC Optional Recommended Front-end
6 PCIe 375-3481-01 QP Copper NIC Optional Recommended Front-end
6 PCIe 371-4325-01 8Gb DP FC HBA Optional FC Target or Initiator (Backup)
6 PCIe 375-3606-01 InniBand HCA Optional Recommended Front-end
6 PCIe 375-3617-01 DP Optical 10GE NIC Optional Recommended Front-end
7 PCIe 375-3609-02 DP SAS-2 HBA Additional Optional Back-end
7 PCIe 375-3481-01 QP Copper NIC Optional Recommended Front-end
7 PCIe 371-4325-01 8Gb DP FC HBA Optional FC Target or Initiator (Backup)
7 PCIe 375-3606-01 Inniband HCA Optional Recommended Front-end
7 PCIe 375-3617-01 DP Optical 10GE NIC Optional Recommended Front-end
8 PCIe 375-3609-02 DP SAS-2 HBA Base Conguration
9 PCIe 371-4325-01 8Gb DP FC HBA Optional FC Target or Initiator (Backup)
Attached Storage
The 7420 does not contain primary storage within its chassis, and therefore connects to external storage shelves and cages.
7420
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0252
Page 53
Disk Shelf
The 7420 single and cluster controller congurations allow one to four chains of 1 to 6 Sun Disk
Shelves
. Any combination of disk-only and Logzilla-capable shelves may be combined within the chain in any order. The cabling congurations are unchanged. Half-populated shelf congurations are not supported.
See Disk Shelf Overview for component specications and diagrams.
7x20
7x20 CRU Maintenance Procedures
This section provides instructions on how to replace customer replaceable components (CRUs) in Oracle's Sun ZFS Storage 7120, 7320, and 7420 controllers.
Refer to
Disk Shelf Details for replacing expansion storage shelf components.
Prerequisites
Read the information in the overview section for your model to become familiar with the replaceable parts of the system:
7120 Overview
7320 Overview
7420 Overview
Caution: Read and follow the instructions in the Safety Information and Required Tools and Information sections.
Safety Information
This section contains safety information that you must follow when servicing the storage system. For your protection, observe the following safety precautions when setting up your equipment:
Do not remove the side panels, or run the storage system with the side panels removed. Hazardous voltage is present that could cause injury. The covers and panels must be in place for proper air ow to prevent equipment damage.
Follow all cautions, warnings, and instructions marked on the equipment and described in Important Safety Information for Sun Hardware Systems.
7x20
Chapter 2 • Hardware Maintenance 53
Page 54
Ensure that the voltage and frequency of your power source match the voltage inscribed on the electrical rating label.
Follow the electrostatic discharge safety practices. Electrostatic discharge (ESD) sensitive devices, such as PCI cards, HDDs, SSDs, and memory cards, require special handling. Circuit boards and HDDs contain electronic components that are extremely sensitive to static electricity. Ordinary amounts of static electricity from clothing or the work environment can destroy the components located on these boards. Do not touch the components without using antistatic precautions, especially along the connector edges.
RequiredTools and Information
The following tools are needed to service the CRUs:
Antistatic wrist strap - Wear an antistatic wrist strap and use an antistatic mat when handling components such as HDDs, LCCs, or PCI cards. When servicing or removing storage controller components, attach an antistatic strap to your wrist and then to a metal area on the chassis. Following this practice equalizes the electrical potentials between you and the storage controller.
Antistatic mat - Place static-sensitive components on an antistatic mat.
No. 2 Phillips screwdriver
Nonconducting, No.1 at-blade screwdriver or equivalent
Nonconducting stylus or pencil (to power on the storage controller)
Chassis Serial Number
To obtain support for your storage controller or to order new parts, you need your chassis serial number. You can nd a chassis serial number label on the storage controller front panel on the left side. Another label is on the top of the storage controller. Alternatively, click the Sun logo in the BUI masthead to obtain the serial number or issue the following command:
hostname: maintenance hardware show
Controller Replacement Tasks
7x20 Controller Replacement Tasks
HDD or SSD
1. Identify the failed HDD or SSD by going to the Maintenance > Hardware section of the BUI and clicking the drive details icon
. If you are physically at the system, the amber Service
Required indicator on the HDD or SSD should be illuminated.
7x20
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0254
Page 55
2. If you are not physically at the system, turn on the locator indicator by clicking the locator
icon
.
3. Push the release button on the HDD or SSD to open the latch.
4. Grasp the latch (2), and pull the drive out of the drive slot.
5. After 15 seconds, navigate to the Hardware > Maintenance screen, and click the details icon
on the system controller to verify that the software has detected that the drive is not
present.
6. Slide the replacement drive into the slot until it is fully seated.
7. Close the latch to lock the drive in place.
The Sun ZFS Storage system software automatically detects and congures the new drive. The device appears in the BUI Maintenance > Hardware screen when you view details for the controller, drive shelf or cage.
FanModule
Fan modules are hot-swappable and can be removed and installed while the storage controller is running without aecting other hardware capabilities.
Caution: Operating a controller for an extended period of time with fans removed reduces the eectiveness of the cooling system. For this reason, the replacement fan should be unpacked in advance and ready to insert into the controller chassis as soon as the faulted fan is removed.
7x20
Chapter 2 • Hardware Maintenance 55
Page 56
7120 or 7320: The fan modules and status indicators are hidden under a fan door in the 7120 and 7320 storage controllers. Components may dier slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320.
Leaving the door open for more than 60
seconds while the storage controller is running might cause it to overheat and shut down.
7420: The following illustration shows the fan modules in the 7420 storage controller.
1. To locate the chassis you want to service, click the associated
locate icon on the Maintenance > Hardware screen of the BUI or issue the set /SYS/LOCATE status=on command at the service processor (SP) prompt. The locate LED will ash on the controller chassis.
2. Verify that no cables will be damaged or will interfere when the storage controller is extended from the rack.
3. From the front of the storage controller, release the two slide release latches.
4. While squeezing the slide release latches, slowly pull the storage controller forward until the slide rails latch.
5. 7120 or 7320: To replace the fan module:
Open the fan module door while unlatching the release tabs on the door.
7x20
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0256
Page 57
Identify the faulted fan module by locating the corresponding Service Required status
indicator or by clicking the
locate icon on Maintenance > Hardware screen of the BUI
for the fan you want to replace.
Using thumb and forenger, pull the fan module up and out.
Install the replacement fan module into the storage controller fan slot. Note: The fan must be replaced within one minute to avoid controller shutdown.
Apply rm pressure to fully seat the fan module.
Verify that the Fan OK status indicator is lit, and that the fault status indicator on the replaced fan module is dim.
Close the top cover door immediately after replacing the fan to maintain airow in the storage controller.
6. 7420 To replace the fan module:
Identify the faulted fan module by locating the corresponding Service Required status
indicator or by clicking the
locate icon on Maintenance > Hardware screen of the BUI
for the fan you want to replace.
Lift the latch at the top of the fan module to unlock the fan module.
7x20
Chapter 2 • Hardware Maintenance 57
Page 58
Pull the fan module out.
Unlock and insert the 7420 fan module.
Apply rm pressure to fully seat the fan module.
Verify that the Fan OK status indicator is lit and that the fault status indicator on the replaced fan module is dim.
7. Verify that the Top Fan status indicator, the Service Required status indicators, and the Locator status indicator/Locator button are dim.
8. Push the release tabs on the side of each rail and slowly slide the storage controller into the rack.
PowerSupply
Storage controllers are equipped with redundant hot-swappable power supplies. If a power supply fails and you do not have a replacement, leave the failed power supply installed to ensure proper air ow. A faulted power supply is indicated by an amber colored status LED.
1. Gain access to the rear of the storage controller where the faulted power supply is located.
7x20
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0258
Page 59
2. If a cable management arm (CMA) is installed, press and hold the CMA release tab and
rotate the arm out of the way.
3. Disconnect the power cord from the faulted power supply.
4. Remove the power supply.
7120 or 7320: Release the latch, then remove the power supply. Components may dier slightly between the 7120 and 7320, however service procedures for each are identical. The
illustration shows the 7320.
7420: Grasp the power supply handle and press the release latch to remove the power
supply.
5. Align the replacement power supply with the empty power supply chassis bay.
7x20
Chapter 2 • Hardware Maintenance 59
Page 60
6. Slide the power supply into the bay until it is fully seated. The following gure shows the
7420 power supply.
7. Connect the power cord to the power supply.
8. Verify that the green AC Present status indicator is lit.
9. Close the CMA, inserting the CMA into the rear left rail bracket.
10. Go to the Maintenance > Hardware screen of the BUI. Click
details icon for the
controller and then click power supply to verify that the
status icon is green for the
newly installed power supply.
Memory
To identify a specic memory module that has faulted, you must open the storage controller and use the amber status LEDs on the motherboard. To identify a general memory fault, go to
the Maintenance > Hardware screen of the BUI, and click on the details icon
on the
controller. Then click DIMMs to locate the faulted component, indicated by the warning icon
.
Caution: This procedure requires that you handle components that are sensitive to static discharge, which can cause the component to fail. To avoid damage, wear an antistatic wrist strap and use an antistatic mat when handling components.
You must shut down the appliance before beginning this task. Note that there will be a loss of access to the storage unless the system is in a clustered conguration. Shut down the appliance using one of the following methods:
Log in to the BUI and click the power icon on the left side of the masthead.
SSH into the appliance and issue the maintenance system poweroff command.
SSH or serial console into the service processor (SP) and issue the stop /SYS command.
Use a pen or nonconducting pointed object to press and release the Power button on the front panel.
To initiate emergency shutdown during which all applications and les will be closed abruptly without saving, press and hold the power button for at least four seconds until the Power/OK status indicator on the front panel ashes, indicating that the storage controller is in standby power mode.
7x20
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0260
Page 61
1. Disconnect the AC power cords from the rear panel of the storage controller.
2. Verify that no cables will be damaged or will interfere when the storage controller is extended from the rack.
3. From the front of the storage controller, release the two slide release latches.
4. While squeezing the slide release latches, slowly pull the storage controller forward until the slide rails latch.
5. 7120 or 7320: Components may dier slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320. To remove the top cover:
Unlatch the fan module door, pull the two release tabs back, rotate the fan door to the open position and hold it there.
Press the top cover release button and slide the top cover to the rear about a half-inch (1.3 cm).
Lift up and remove the top cover.
Also remove the air bae by pressing the air bae connectors outward and lifting the air
bae up and out of the server.
6. 7420: To remove the top cover:
7x20
Chapter 2 • Hardware Maintenance 61
Page 62
Simultaneously lift both cover latches in an upward motion.
Lift up and remove the top cover.
7. To locate the DIMM you want to service, press the Fault Remind Button on the storage controller.
The following illustration shows the Fault remind button on the 7120.
7x20
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0262
Page 63
The following illustration shows the Fault remind button on the 7420.
8. 7420: Identify the memory riser that hosts the faulted DIMM by the Service Required status indicator. Lift the memory riser straight up to remove it from the motherboard, and place it
on an antistatic mat.
9. Rotate both DIMM slot ejectors outward as far as they will go and carefully lift the faulted DIMM straight up to remove it from the socket.
7x20
Chapter 2 • Hardware Maintenance 63
Page 64
10. Line up the replacement DIMM with the connector, aligning the notch with the key to ensure that the component is oriented correctly.
11. Push the DIMM into the connector until the ejector tabs lock the component in place.
12. 7120 or 7320: Components may dier slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320. To replace the cover:
Place the top cover on the chassis so that it hangs over the rear of the storage controller by about an inch (2.5 cm).
Slide the top cover forward until it seats.
Close the fan cover and engage the fan cover latches. The cover must be completely closed
for the storage controller to power on.
13. 7420: To replace the cover:
7x20
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0264
Page 65
Push the memory riser module into the associated CPU memory riser slot until the riser
module locks in place.
Place the top cover on the chassis so that it is forward of the rear of the storage controller by about an inch (2.5 cm).
Slide the top cover toward the rear of the chassis until it seats and press down on the cover with both hands until both latches engage.
7x20
Chapter 2 • Hardware Maintenance 65
Page 66
14. Push the release tabs on the side of each rail and slowly push the storage controller into the
rack.
The following image shows the 7420 chassis.
15. Connect the power cords to the power supplies.
16. Verify that standby power is on, indicated by the Power/OK status indicator ashing on the front panel about two minutes after the power cords are plugged in.
17. Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel.
The Power/OK status indicator next to the Power button lights and remains lit. The Maintenance > Hardware screen of the BUI provides status of the replacement on the Details page for DIMMs.
7x20
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0266
Page 67
PCIe Cardsand Risers
Go to the Maintenance > Hardware screen of the BUI and click the details icon on the controller, and then click Slots to locate the faulted component.
Caution: This procedure requires that you handle components that are sensitive to static discharge, which can cause the component to fail. To avoid damage, wear an antistatic wrist strap and use an antistatic mat when handling components.
Note that the 7120 Sun Flash Accelerator F20 card is a FRU and must be replaced by an Oracle service representative.
All HBAs must be of the same type. Ensure that you upgrade your system software before installing a newly-released HBA.
You must shut down the controller before beginning this task. Note that there will be a loss of access to the storage unless the system is in a clustered conguration. Shut down the appliance using one of the following methods:
Log in to the BUI, and click the power icon on the left side of the masthead.
SSH into the storage system and issue the maintenance system poweroff command.
SSH or serial console into the service processor (SP) and issue the stop /SYS command.
Use a pen or non-conducting pointed object to press and release the Power button on the front panel.
To initiate emergency shutdown, wherein all applications and les will be closed abruptly without saving, press and hold the power button for at least four seconds until the Power/OK status indicator on the front panel ashes, indicating that the storage controller is in standby power mode.
1. Disconnect the AC power cords from the rear panel of the storage controller.
2. Verify that no cables will be damaged or will interfere when the storage controller is extended from the rack.
3. From the front of the storage controller, release the two slide release latches.
4. While squeezing the slide release latches, slowly pull the storage controller forward until the slide rails latch.
5. 7120 or 7320: To remove the top cover:
Unlatch the fan module door, pull the two release tabs back, rotate the fan door to the open position and hold it there.
Press the top cover release button and slide the top cover to the rear about a half-inch (1.3 cm).
Lift up and remove the top cover.
6. 7420: To remove the top cover:
7x20
Chapter 2 • Hardware Maintenance 67
Page 68
Simultaneously lift both cover latches in an upward motion.
Lift up and remove the top cover.
7. Locate the PCIe card position in the storage controller, see
Single and Cluster Controller
Congurations
for the 7320, the 7120 Overview,or7420 Overview.
8. 7120 or 7320: To replace the PCIe card:
Disconnect any data cables connected to the cards on the PCIe riser you want to replace. Label the cables for proper connection later.
Loosen the two captive Phillips screws on the end of the rear panel crossbar and lift the
crossbar up and back to remove it.
Loosen the captive retaining screw holding the front end of the riser and the Phillips screw on the end of the riser.
7x20
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0268
Page 69
Lift the riser up to remove it from the storage controller.
Carefully remove the PCIe card from the riser board connector and clean the slot with
ltered, compressed air if necessary.
Seat the replacement PCIe card in the slot of the riser and connect the cables.
Align the riser, together with any attached PCIe cards, with the intended location on the motherboard, and carefully insert it into its slot.
Slide the back of the riser into the motherboard rear panel stiener.
Tighten the screw that secures the riser to the motherboard.
7x20
Chapter 2 • Hardware Maintenance 69
Page 70
Replace the rear panel PCI crossbar by sliding it down over the PCIe risers, ensuring the crossbar is secured with two captive Phillips screws.
9. 7420: To replace the PCIe card:
Disengage the PCIe card slot crossbar from its locked position and rotate the crossbar into
an upright position.
Remove the retaining screw that holds the PCIe card to the chassis.
Carefully remove the PCIe card from the connector and clean the slot with ltered, compressed air if necessary.
Install the replacement PCIe card into the PCIe card slot.
Install the retaining screw to hold the PCIe card to the chassis.
Return the crossbar to its closed and locked position.
7x20
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0270
Page 71
10. 7120 or 7320: Components may dier slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320. To install the top cover:
Place the top cover on the chassis so that it hangs over the rear of the storage controller by about an inch (2.5 cm), then slide the top cover forward until it seats.
Close the fan cover and engage the fan cover latches. The cover must be completely closed
for the storage controller to power on.
11. 7420: To install the top cover:
Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm).
Slide the top cover toward the rear of the chassis (2) until it seats.
Press down on the cover with both hands until both latches engage.
12. Push the release tabs on the side of each rail and slowly push the storage controller into the rack, making sure no cables obstruct the path of the controller.
7x20
Chapter 2 • Hardware Maintenance 71
Page 72
13. Connect the power cords to the power supplies.
14. Verify that standby power is on, indicated by the Power/OK status indicator ashing on the front panel about two minutes after the power cords are plugged in.
15. Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel. The Power/OK status indicator next to the Power button lights and remains lit.
16. Connect data cables to the PCIe card, routing them through the cable management arm.
17. Go to the Maintenance > Hardware screen of the BUI, and click the details icon
on the
controller. Then, click Slots to verify the status of the new component. The status indicator should appear green
.
18. Install the disk shelf and connect the expansion storage.
Battery
You might need to replace the battery if the storage controller fails to maintain the proper time when powered o and disconnected from the network. You will need a small (No.1 at-blade) non-metallic screwdriver or equivalent.
You must shut down the appliance before beginning this task. Note that there will be a loss of access to the storage unless the system is in a clustered conguration. Shut down the appliance using one of the following methods:
Login to the BUI and click the power icon on the left side of the masthead.
SSH into the storage system and issue the maintenance system poweroff command.
SSH or serial console into the service processor and issue the stop /SYS command.
Use a pen or non-conducting pointed object to press and release the Power button on the front panel.
To initiate emergency shutdown, wherein all applications and les will be closed abruptly without saving, press and hold the power button for at least four seconds until the Power/OK status indicator on the front panel ashes, indicating that the storage controller is in standby power mode.
1. Disconnect the AC power cords from the rear panel of the storage controller.
2. Verify that no cables will be damaged or will interfere when the storage controller is extended from the rack.
3. From the front of the storage controller, release the two slide release latches.
4. While squeezing the slide release latches, slowly pull the storage controller forward until the slide rails latch.
5. 7120 or 7320: To remove the top cover:
Unlatch the fan module door, pull the two release tabs back, rotate the fan door to the open position and hold it there.
7x20
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0272
Page 73
Press the top cover release button and slide the top cover to the rear about a half-inch (1.3 cm).
Lift up and remove the top cover.
6. 7420: To remove the top cover:
Simultaneously lift both cover latches in an upward motion.
7. Lift up and remove the top cover.
8. Using a small, non-metallic screwdriver, press the latch and remove the battery from the motherboard. The 7420 battery is shown here.
7x20
Chapter 2 • Hardware Maintenance 73
Page 74
The following gure shows the 7120 battery.
9. Press the replacement battery into the motherboard with the positive side (+) facing upward.
10. 7120 or 7320: Components may dier slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320. To install the top cover:
Place the top cover on the chassis so that it hangs over the rear of the storage controller by about an inch (2.5 cm), then slide the top cover forward until it seats.
Close the fan cover and engage the fan cover latches. The cover must be completely closed
for the storage controller to power on.
11. 7420: To install the top cover:
Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm).
Slide the top cover toward the rear of the chassis (2) until it seats.
7x20
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0274
Page 75
Press down on the cover with both hands until both latches engage.
12. Push the release tabs on the side of each rail and slowly push the storage controller into the rack, making sure no cables obstruct the path of the controller.
13. Connect the power cords to the power supplies.
14. Verify that standby power is on, indicated by the Power/OK status indicator ashing on the front panel about two minutes after the power cords are plugged in.
15. Use a pen, or other pointed object, to press and release the recessed Power button on the storage controller front panel. The Power/OK status indicator next to the Power button lights and remains lit.
16. Connect data cables to the PCIe card, routing them through the cable management arm.
17. When the system has nished booting, log in and set the time using the steps in the BUI Clock task.
HDD or SSD
The installation for an hard disk drive (HDD) or a solid state drive (SSD) is the same.
Note: SSDs are restricted to slots 30 and 31 in each of the 12 drive cages. Slot 30 must be populated before slot 31.
1. Identify the failed HDD or SSD by going to the Maintenance > Hardware section of the BUI,
and clicking the drive details icon
. If you are physically at the system, the amber Service
Required indicator on the HDD or SSD should be illuminated.
7x20
Chapter 2 • Hardware Maintenance 75
Page 76
2. If you are not physically at the system, turn on the locator indicator by clicking the locator
icon
.
3. Push the release button on the HDD or SSD to open the latch.
4. Grasp the latch (2), and pull the drive out of the drive slot.
5. After 15 seconds, navigate to the Hardware > Maintenance screen, and click the details icon on the system controller to verify that the software has detected that the drive is not
present.
6. Slide the replacement drive into the slot until it is fully seated.
7. Close the latch to lock the drive in place.
The Sun ZFS Storage system software automatically detects and congures the new drive. The device appears in the BUI Maintenance > Hardware screen when you view details for the controller, drive shelf or cage.
Fan Tray
Fan trays are hot-swappable and can be removed and installed while the storage controller is running without aecting other hardware capabilities. An amber colored status indicator indicates a faulted fan module.
Caution: Fan trays must not be removed from the cabinet for more than one minute. Removal of a fan tray for more than one minute will result in the cabinet overheating and automatically shutting down. You must unpack and prepare the replacement fan tray in advance so that you can insert it into the cabinet as soon as the faulted fan tray is removed.
1. Identify the faulted fan module by locating the corresponding Service Required status
indicator or by clicking the
icon on the Maintenance > Hardware screen of the BUI for
the fan you want to replace.
2. Squeeze the plastic handle, and pull the fan tray out of the system.
7x20
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0276
Page 77
3. Unpack the new fan tray, and ensure that the metal locking handle is in the out position.
4. Align the fan tray with the slot, and push the fan tray into the slot, ensuring that the fan tray
is fully seated.
5. Squeeze the plastic handle, and rotate the handle into the locked position.
6. Verify that the Fan OK status indicator is lit, and that the Fan Fault status indicator on the replaced fan module is dim.
7. Verify that the Top Fan status indicator, Service Required status indicators, and the Locator status indicator/Locator button are dim.
PowerSupply
Storage controllers are equipped with redundant hot-swappable power supplies. If a power supply fails and you do not have a replacement, leave the failed power supply installed to ensure proper air ow. A faulted power supply is indicated by an amber colored status LED.
The power supplies are at the front of the cabinet as shown in the following illustration.
1. Release the latch, then pull out the handle.
2. Align the replacement power supply with the empty power supply chassis bay.
7x20
Chapter 2 • Hardware Maintenance 77
Page 78
3. Slide the power supply into the bay.
4. Close the handle to fully seat the power supply.
5. Verify that the green AC Present status indicator is lit.
6. Go to the Maintenance > Hardware screen of the BUI. Click
details icon for the
controller and then click power supply to verify that the
status icon is green for the
newly installed power supply.
System Indicator Boards
The system-level indicator boards are located on the front and rear panels under the top disk cage. Both indicator boards can be hot-swapped while the system is running.
Both boards contain the following system-level LEDs:
Locator (white), which helps you locate the storage system within the data center
Fault (amber), which indicates a system-level fault
OK (green), which indicates that the storage system is operating normally
The front-panel indicator board also contains LEDs for components located on the rear panel.
7x20
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0278
Page 79
Front PanelLEDIndicators
1 System-level locator 4 Rear panel fan tray fault
2 System-level fault 5 Rear panel drive set fault
3 System-level OK 6 Rear panel RCC fault
In addition to system-level indicators, the rear panel indicator board also includes LEDs for components on the front panel.
Rear Panel LED Indicators
1 System-level locator 4 Front panel drive set fault
2 System-level fault 5 Front panel power supply fault
3 System-level OK
7x20
Chapter 2 • Hardware Maintenance 79
Page 80
1. Place a #1 Phillips-head screwdriver in the slot at each end of the indicator board.
2. Rotate the screw drivers out until the plastic locks clear the locking mechanism, and pull the indicator board slightly out of the cabinet to expose the interface connector.
3. Disconnect the interface connector, and remove the indicator board from the cabinet.
4. Remove the replacement board from the packaging.
5. Align the board with the slot, and connect the interface connector.
6. Push the board into the slot, and ensure that the board is fully seated in the slot.
7. Verify that the procedure was successful by logging in to the Sun ZFS Storage appliance
software, checking the system status, and clicking the associated
locator icon in the
Cabinets section of the Maintenance > Hardware BUI page.
SAS2
Sun Disk Shelf Overview
The Sun Disk Shelf SAS-2 is a high-availability serial attached SCSI (SAS) device in a 4U, 24-disk chassis.
Refer to
Disk Shelf Tasks for procedural information about replacing disk shelf components.
SAS2
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0280
Page 81
The main components are hot-swappable, including the SAS Interface Module (SIM) boards and drives, and the dual load-sharing power supplies and fans. This provides a fault-tolerant environment with no single point of failure. System faults are indicated by an amber colored light on the front panel.
Following is the list of replaceable components of the Sun Disk Shelf SAS-2. The SAS-2 (Serial Attached SCSI 2.0) storage fabric supports greater number of targets, greater bandwidth, higher reliability and bigger scale. The scale and reliability improvements are achieved with 2 TB SAS disks you can daisy-chain to a total of 12 shelves (288 total disks). In addition,the new, high-performance SAS-2 HBA is designed for the Sun Storage 7000 series with a standard chip set to support a high-density of target devices, capable of attachment to 1024 targets.
With this new fabric, you are encouraged to apply entire shelves to pools, so you can get the benets of No Single Point of Failure (NSPF) congurations and striping across the maximum possible number of devices.
Part Number Description FRU/CRU
F542-0194-01 SAS Interface Module (SIM) Assembly CRU
F300-2276-01 764W AC Input Power Supply and Fan Assembly CRU
F540-7980-01 Z-box with Backplane (J4410 4U chassis) FRU
F542-0274-01 2TB - 7.2K SAS HDD Assembly CRU
F542-0286-01 SAS 100GB SSD Logzilla CRU
SAS2 Sun Disk Shelf Overview
PowerSupply Exterior
Power supplies and fans, SIMs, and disks are hot-pluggable on the storage shelf. The following gure shows the exterior of the power supply. Power supply 0 is on the left and power supply 1 is on the right.
SAS2
Chapter 2 • Hardware Maintenance 81
Page 82
Figure Legend
1 Cooling fan status indicator 5 Power on/o switch
2 AC power status indicator 6 Power cord tie wrap
3 DC power status indicator 7 Universal power input connector
4 Power supply status indicator 8 Right ejection arm and captive screw latch
Drive Locations
The following table shows the shelf drive locations.
Drive Locations
SSD20 SSD21 SSD22 SSD23
HDD16 HDD17 HDD18 HDD19
HDD12 HDD13 HDD14 HDD15
HDD8 HDD9 HDD10 HDD11
SAS2
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0282
Page 83
Drive Locations
HDD4 HDD5 HDD6 HDD7
HDD0 HDD1 HDD2 HDD3
The following gure shows the Sun Disk Shelf front panel.
Figure Legend
1 Locate button and indicator 4 Disk ready to be removed inidicator 7 Over temperature warning indicator
2 System fault indicator 5 Disk fault indicator 8 SIM board fault indicator
3 System power indicator 6 Disk activity indicator 9 Power supply fault indicator
Sun Disk Shelf Logzilla SSD Locations
Up to four Logzilla SSDs are supported per disk shelf.
Logzilla SSDs should be populated in order of slots 20, 21, 22, and 23.
Drive Assembly Exterior
The following gure shows the drive assembly exterior for the Sun Disk Shelf.
SAS2
Chapter 2 • Hardware Maintenance 83
Page 84
Figure Legend
1 Locate (blue) 2 Fault indicator (amber) 3 Activity indicator (green)
SIM Board Exterior
The following gure shows the SIM board exterior of the Sun Disk Shelf SAS-2 and is described in the Legend. SIMs are hot-pluggable on the shelf.
Figure Legend
1 SIM board 1 3 SIM board 0 5 Network management port
2 Host or SIM Link In 4 SIM link out 6 For Sun service only
The following gure shows the SIM board and Power Supply exterior indicator LEDs. SIM 0 is on the left, and SIM 1 is on the right.
SAS2
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0284
Page 85
Figure Legend
1 AC power indicator 6 Power switch
2 DC power indicator 7 Port fault indicator
3 Fan fault indicator 8 Port OK indicator
4 Power supply fault indicator 9 SIM board OK indicator
5 Universal power connector 10 SIM locator indicator
Disk Shelf Congurations
The following tables describe and provide part numbers for the supported expansion storage shelves.
Sun Disk Shelf
Mktg Part Number Description Mfg Part Number
DS2-0BASE Sun Disk Shelf 24x3.5" SAS-2 597-0764-02
DS2-HD1T Sun Disk Shelf 1TB 7.2Krpm, SAS-2, 3.5" 597-0823-01
DS2-HD2T Sun Disk Shelf 2TB 7.2Krpm, SAS-2, 3.5" 597-0625-01
DS2-LOGZ Sun Disk Shelf 18GB Logzilla SSD 597-0626-01
DS2-LOGFILLER Sun Disk Shelf 24x3.5", Filler for Logzilla SSD 597-0835-01
DS2-4URK-19U Sun Disk Shelf Rail Kit 597-1083-01
SAS2
Chapter 2 • Hardware Maintenance 85
Page 86
Mktg Part Number Description Mfg Part Number
DS2X-LOGZ Sun Disk Shelf 18GB Logzilla SSD 594-6629-01
DS2X-4URK-19U Sun Disk Shelf Rail Kit 594-6462-01
Shelf
Disk Shelf Maintenance Procedures
This section provides procedural details for customer replaceable units (CRUs) of any disk shelf in the Sun ZFS Storage 7000 family of products. Refer to
Disk Shelf Overview for component
specications and diagrams.
Prerequisites
Read the information in the overview section for your controller and become familiar with the replaceable parts of the system:
7120 Overview
7420 Overview
Follow the instructions in the Electrostatic Discharge Precautions section.
Legacy platform overviews are provided in the following sections:
7110
7210
7310
7410
J4400/J4500 Disk Shelf
Safety Information
Follow all Sun cautions, warnings, and instructions marked on the equipment and described in Important Safety Information for Sun Hardware Systems located at
http://download.oracle.com/ docs/cd/E19446-01/en/821-1590-10/821-1590-10.pdf. (http://download.oracle.com/docs/ cd/E19446-01/en/821-1590-10/821-1590-10.pdf.)
Shelf
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0286
Page 87
Electrostatic Discharge Precautions
Remove all plastic, vinyl, and foam material from the work area.
Wear an antistatic wrist strap at all times when handling any CRU.
Before handling any CRU, discharge any static electricity by touching a grounded surface.
Do not remove a CRU from its antistatic protective bag until you are ready to install it.
After removing a CRU from the chassis, immediately place it in an antistatic bag or antistatic packaging.
Handle any card that is part of a CRU by its edges only and avoid touching the components or circuitry.
Do not slide a CRU over any surface.
Limit body movement (which builds up static electricity) during the removal and replacement of a CRU.
Tasks
Shelf Tasks
Replacing a Drive
The shelf drives are hot-swappable and may be replaced without removing power from the shelf. The replacement drive must be of the same capacity and type as the drive to be replaced. To avoid possible data loss when removing non-faulted drives, label each drive with the number of the slot from which it was removed and reinstall each drive into the same slot.
Faulted drives are indicated by an amber LED. Go to the Maintenance > Hardware section of
the BUI and double click the shelf thumbnail to view Details for HDDs or
to turn on the
locator LED.
Locate the faileddisk drive at the front of the chassis.
Press the releasebutton in and to the right to release the ejectionlever.
1
2
Shelf
Chapter 2 • Hardware Maintenance 87
Page 88
Pull the ejection lever fullyopen to unlock and partially eject the drive from the chassis.
Grasp the middle of thedrive body and pull it toward you to removeit from thechassis.
Ensure the new drive ejectionlever is in the fully extended position.
Align the new drive with the open slot and slide the drive into the diskchassis.
3
4
5
6
Shelf
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0288
Page 89
Push the driveinto the chassis slot until the ejectionlever engages the chassis connectorsand begins to swing closed.
Press the ejection lever closed until it locks in placeto seat the drive and lock it intothe chassis. The Activity LED with be steady green to indicate a ready state.
Go to the Maintenance > Hardware screen of the BUI. Click
for the controllerand then click
HDD to verify that the
icon is green for the newly installed disk.
Replacing a Power Supply
The power supplies are hot-swappable and can be replaced without removing power from the system. The power supplies can produce high energy hazard and should only be replaced by instructed individuals with authorized access to the equipment. Failed power supplies are indicated by an amber LED on the rear panel, see the Shelf Rear Panel illustration. Go to the Maintenance > Hardware screen of the BUI. Double click the shelf and then click PSU to view
details or
to turn on the locator LED.
Locate the chassis and failed powersupply.
Ensure the powersupply on/o switch is in the "O" o position.
Disconnect the power cord tie strap from the power cord and unplug the power cordfrom the power supply.
Using your thumband forenger, unscrew both ejection arm captive screws until loose and swing the ejection arms out until they are fully open.
7
8
9
1
2
3
4
Shelf
Chapter 2 • Hardware Maintenance 89
Page 90
Pull the powersupply out of the chassis,being careful not to damage the circuit board connector extending from the back of the power supply.
With the ejection arms fully open, slide the new powersupply into the chassis slot until it contacts the chassis backplane and the ejection arms begin to swing closed.
5
6
Shelf
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0290
Page 91
Push the ejection arms closed fully and secure both captivescrews to seatand secure the power supply in the chassis.
Ensure the powersupply on/o switch is in the "O" o position.
Plug the power cord into the new power supply and attachthe power cordtie strap tothe power cord.
Place the powersupply on/o switch to the "I" on position.The Power status LED should be a steady green and the Power status LED and Fan LED should be o.
Go to the Maintenance > Hardware screen of the BUI. Click
for the controllerand then click
PSU to verify that the
icon is green for the newly installed powersupply.
Replacing a SIM Board
The SIM boards are hot-swappable so you can replace them without removing power to the system. The SIM boards are multi-pathed, so you can remove one of the SIM boards at any time, regardless of the state of the blue SIM OK indicator. A faulted SIM board is indicated by an amber LED.
Locate the failed SIM at the back of the disk tray.
Label and disconnect the trayinterface cables.
Use two hands to disconnect the SAS cable. Grasp the metal body of the connectorwith one hand and rmly grasp andpull the tab gently towardthe connector body with the other,then pull the connector body outwardto extract it from the bulkhead. Do not twist or pull the tab in any direction other than parallelwith the connector body or it may break. If the tab breaks, use a small sharp object (such as a ne-tipped screwdriver) to lift the metal spring at the top of the connector shell to unlatch it.
Loosen the two extraction armcaptive screws using your thumb and forenger. If the captive screws are tootight to loosen by hand, use a No.2Phillips screwdriver to loosen each screw.
7
8
9
10
11
1
2
3
4
Shelf
Chapter 2 • Hardware Maintenance 91
Page 92
Pull each ejector tab outwardand push to the sidesto release and partially eject the SIM from
the chassis.
Grasp the middle of theSIM board and slide itout of the slot.
5
6
Shelf
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0292
Page 93
With the ejector arms in the full open position, align the new SIM board with the open slot and slide it into the trayuntil the ejector arms contact the trayconnectors and begin to swing
closed.
Swing both ejector arms in until they are ush with the SIM board panel toseat the board.
Tighten both captivescrews to secure the board.
Reconnect the SAS interface cables to their original locations.
Wait approximately 60 seconds for the SIMboard to completeits boot process,at which time the Power LED should be solid green and the SIM locateLED should be o.
Faults
Hardware Faults
This section describes connecting to the controller Service Processor (SP) and conguration considerations for maximum serviceability. In rare cases, faults associated with uncorrectable CPU errors are not diagnosable or displayed in the controller. These faults will be preserved by and observable on the ILOM. The following sections describe how to connect to and manage faults for these cases.
7
8
9
10
11
Faults
Chapter 2 • Hardware Maintenance 93
Page 94
Connect to ILOM
Connect to the server ILOM (Service Processor) on the server platform to diagnose hardware faults that do not appear in the BUI.
In a cluster environment, an ILOM connection should be made to each controller.
The server ILOM provides options for (i) network and (ii) serial port connectivity. Network connection is the preferred choice, as the ILOM serial port does not always allow adequate means of platform data collection.
WARNING : Failure to congure ILOM connectivity may lead to longer than necessary hardware fault diagnosis and resolution times.
Management Port Conguration
All standalone controllers should have at least one NIC port congured as a management interface. Select the Allow Admin option in the BUI to enable BUI connections on port 215 and CLI connections on ssh port 22.
All cluster installations should have at least one NIC port on each controller congured as a management interface as described above. In addition, the NIC instance number must be unique on each controller. For example, nodeA uses nge0 and nodeB uses nge1, so that neither may be used as a cluster data interface. In addition, these interfaces must be locked to the controller using the Conguration -> Cluster option in the BUI. In some cases, this may require installation of an additional network interface card on each controller in a cluster conguration.
If access to the appliance data interfaces is impossible for any reason, the management network interface will maintain BUI and CLI access. During a cluster takeover, interfaces are taken down on the failed controller. So, locked interface conguration is required to gather diagnostic information from a failed controller.
WARNING : Failure to congure locked management interfaces on a cluster may lead to longer than necessary fault diagnosis and resolution times.
Observing and Clearing CPU faults from ILOM
Log in to the server as root using the ILOM CLI. To view server faults, type the following command to list all known faults on the system:
-> show /SP/faultmgmt
The server lists all known faults, for example:
SP/faultmgmt
Targets:
0 (/SYS/MB/P0)
Properties:
Faults
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0294
Page 95
Commands:
cd show
To clear the CPU fault, type the following command:
-> set /SYS/MB/Pn clear_fault_action=true
For example, to clear a fault on CP0:
-> set /SYS/MB/P0 clear_fault_action=true Are you sure you want to clear /SYS/MB/P0 (y/n)? y
See Also
Cluster Conguration
HBA Expansion pt.1
Expanding from 2 to 3 HBAs
The gures below show steps to migrate a cluster from two to three HBAs.
NOTE: Diagrams below are not representative of proper slot location for HBAs.
Cabling Diagrams
fig.1 Cluster with two HBAs and chains of disk shelves
HBA Expansion pt.1
Chapter 2 • Hardware Maintenance 95
Page 96
fig.2 Power down and remove all cabling from the rst controller. Add and cable together the new chain of disk shelves, then power on shelves.
HBA Expansion pt.1
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0296
Page 97
fig.3 Install new HBA according to the instructions on installing PCI cards, and connect the controller to the second and third chain as shown.
fig.4 Reconnect the two original HBAs as before to the rst two chains. Power on the controller and wait for it to regain control of connected storage.
HBA Expansion pt.1
Chapter 2 • Hardware Maintenance 97
Page 98
fig.5 Power down and remove all cabling from the second controller.
fig.6 Install new HBA according to the instructions on installing PCI cards, and connect the
controller to the second and third chain as shown.
HBA Expansion pt.1
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–0298
Page 99
fig.7 Reconnect the two original HBAs as before to the rst two chains. Power on the controller and wait for it to regain control of connected storage.
fig.8 Cluster with three HBAs
HBA Expansion pt.1
Chapter 2 • Hardware Maintenance 99
Page 100
HBA Expansion pt.2
Expanding from 3 to 4 HBAs
The gures below show steps to migrate a cluster from three to four HBAs.
NOTE: Diagrams below are not representative of proper slot location for HBAs.
Cabling Diagrams
fig.1 Cluster with three HBAs and chains of disk shelves
HBA Expansion pt.2
Sun ZFS Storage 7x20 Appliance CustomerService Manual • December 2011 E26399–02100
Loading...