This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except
as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform,
publish, or display any part, in any form, or by any means. Reverse engineering, disassembly, or decompilation of this software, unless required by law for interoperability, is
prohibited.
The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us in writing.
If this is software or related documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, the following notice is applicable:
U.S. GOVERNMENT END USERS. Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, delivered
to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As
such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the hardware, and/or
documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S. Government.
This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any inherently dangerous
applications, including applications that may create a risk of personal injury. If you use this software or hardware in dangerous applications, then you shall be responsible to take all
appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this
software or hardware in dangerous applications.
Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.
Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of
SPARC International, Inc. AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. UNIX is a registered
trademark of The Open Group.
This software or hardware and documentation may provide access to or information on content, products, and services from third parties. Oracle Corporation and its affiliates are not
responsible or and expressly disclaim all warranties of any kind with respect to third-party content, products, and services. Oracle Corporation and its affiliates will not be responsible
for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services.
Ce logiciel et la documentation qui l’accompagne sont protégés par les lois sur la propriété intellectuelle. Ils sont concédés sous licence et soumis à des restrictions d’utilisation et
de divulgation. Sauf disposition de votre contrat de licence ou de la loi, vous ne pouvez pas copier, reproduire, traduire, diffuser, modifier, breveter, transmettre, distribuer, exposer,
exécuter, publier ou afficher le logiciel, même partiellement, sous quelque forme et par quelque procédé que ce soit. Par ailleurs, il est interdit de procéder à toute ingénierie inverse
du logiciel, de le désassembler ou de le décompiler, excepté à des fins d’interopérabilité avec des logiciels tiers ou tel que prescrit par la loi.
Les informations fournies dans ce document sont susceptibles de modification sans préavis. Par ailleurs, Oracle Corporation ne garantit pas qu’elles soient exemptes d’erreurs et vous
invite, le cas échéant, à lui en faire part par écrit.
Si ce logiciel, ou la documentation qui l’accompagne, est concédé sous licence au Gouvernement des Etats-Unis, ou à toute entité qui délivre la licence de ce logiciel ou l’utilise pour
le compte du Gouvernement des Etats-Unis, la notice suivante s’applique:
U.S. GOVERNMENT END USERS. Oracle programs, including any operating system, integrated software, any programs installed on the hardware, and/or documentation, delivered
to U.S. Government end users are "commercial computer software" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As
such, use, duplication, disclosure, modification, and adaptation of the programs, including any operating system, integrated software, any programs installed on the hardware, and/or
documentation, shall be subject to license terms and license restrictions applicable to the programs. No other rights are granted to the U.S.Government.
Ce logiciel ou matériel a été développé pour un usage général dans le cadre d’applications de gestion des informations. Ce logiciel ou matériel n’est pas conçu ni n’est destiné
à être utilisé dans des applications à risque, notamment dans des applications pouvant causer des dommages corporels. Si vous utilisez ce logiciel ou matériel dans le cadre
d’applications dangereuses, il est de votre responsabilité de prendre toutes les mesures de secours, de sauvegarde, de redondance et autres mesures nécessaires à son utilisation dans
des conditions optimales de sécurité. Oracle Corporation et ses affiliés déclinent toute responsabilité quant aux dommages causés par l’utilisation de ce logiciel ou matériel pour ce
type d’applications.
Oracle et Java sont des marques déposées d’Oracle Corporation et/ou de ses affiliés. Tout autre nom mentionné peut correspondre à des marques appartenant à d’autres propriétaires
qu’Oracle.
Intel et Intel Xeon sont des marques ou des marques déposées d’Intel Corporation. Toutes les marques SPARC sont utilisées sous licence et sont des marques ou des marques
déposées de SPARC International, Inc. AMD, Opteron, le logo AMD et le logo AMD Opteron sont des marques ou des marques déposées d’Advanced Micro Devices. UNIX est une
marque déposée d’The Open Group.
Ce logiciel ou matériel et la documentation qui l’accompagne peuvent fournir des informations ou des liens donnant accès à des contenus, des produits et des services émanant
de tiers. Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers. En aucun cas, Oracle
Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l’accès à des contenus, produits ou services
tiers, ou à leur utilisation.
Page 5
Contents
Using This Documentation ................................... .............................................. 7
Index ................................... ..................................................................... .......... 43
6Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 7
Using This Documentation
■
Overview – This user guide provides detailed procedures that describe installation,
configuration, and service of Oracle's 1.6TB NVMe SSD.
■
Audience – This guide is intended for trained technicians and authorized service personnel
who have been instructed on the hazards within the equipment and qualified to remove and
replace hardware.
■
Required knowledge – Advanced experience troubleshooting and replacing hardware.
This preface contains the following sections:
■
“Product Documentation Library” on page 7
■
“Feedback” on page 8
■
“Change History” on page 8
Product Documentation Library
Late-breaking information and known issues for this product are included in the product notes.
Refer to the Oracle 1.6TB NVMe SSD Documentation Library:
http://www.oracle.com/goto/oracleflashf160/docs
Note - For specific installation instructions, refer to your server documentation. For information
about restrictions and use of the Oracle 1.6TB NVMe SSD on your server, see the most recent
version of the server product notes.
DocumentationLink
All Oracle products (Including servers.)
Oracle 1.6TB NVMe SSD Documentation Library
Oracle System AssistantRefer to the server's administration guide.
Provide feedback about this documentation at: http://www.oracle.com/goto/docfeedback
Change History
The following lists the release history of this documentation set:
■
December 2014. Initial publication.
■
July 2015. New server introduction.
http://www.oracle.com/goto/OHMP/docs
https://support.oracle.com
8Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 9
Product Overview
These topics describes the specifications and capabilities of the Oracle 1.6TB NVMe SSD (nonvolatile memory express, solid-state drive).
Review the following product information sections before you install or service your Oracle 1.6
TB NVMe storage drive:
DescriptionLinks
Learn about Oracle 1.6TB NVMe SSD features and
functions.
Review specifications and capabilities.“Specifications” on page 15
Oracle 1.6TB NVMe SSD Overview
These topics provide an overview of Oracle 1.6TB NVMe SSD features and functions:
■
“About the Oracle 1.6TB NVMe SSD” on page 9
■
“Key Features” on page 10
■
“Characteristics” on page 11
■
“Status Indicators” on page 12
■
“About Oracle PCIe NVMe Switch Cards and 1.6TB NVMe SSDs” on page 14
“Oracle 1.6TB NVMe SSD Overview” on page 9
About the Oracle 1.6TB NVMe SSD
Oracle's 1.6TB NVMe SSD offers high-performance with low latency and a low CPU burden.
The 1.6TB NVMe SSD is a PCIe Gen3 storage drive that is architected with the new high
performance controller interface – NVMe (Non-Volatile Memory express), delivering leading
performance, low latency and high quality of service.
The Oracle 1.6TB NVMe SSD is designed with advanced enterprise multi-level cell NAND
(eMLC) technology for high-level performance and write durability. With PCIe Gen3 support
and NVMe queuing interface, the 1.6TB NVMe SSD delivers excellent sequential read
Product Overview9
Page 10
Oracle 1.6TB NVMe SSD Overview
performance of up to 2.5GB/sec and sequential write speeds of up to 1500MB/sec. Oracle
1.6TB NVMe SSD delivers very high random read IOPS of 260K and random write IOPS of
42K for 8KB operations and random read IOPS of 440K and random write IOPS of 70K for
4KB operations. Taking advantage of the direct path from the storage to the CPU by means
of NVMe, Oracle 1.6TB NVMe SSD exhibits low latency of less than 20 μsec for sequential
access to the storage drive.
The Oracle 1.6TB NVMe SSD is a block storage device, with block sizing optimization
capabilities. You can use the NVMe SSD for either nonpersistent or persistent data.
The following illustration shows an Oracle 1.6TB NVMe SSD:
Related Information
■
“Specifications” on page 15
■
“Product Overview”
Key Features
Oracle 1.6TB NVMe SSD has the following key features:
10Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 11
Oracle 1.6TB NVMe SSD Overview
Key FeatureDescription
Consistently high IOPS and throughput■ Sequential read speeds of up to 2.5GB/sec.
■ Sequential write speeds of up to 1500MB/sec.
■ Delivers random read IOPS of 440K and random write IOPS of 70K
for 4KB operations.
Sustained low latency■ Offers high-performance with low latency and a low CPU burden.
■ Less than 20 μsec for sequential access to the SSD.
High Endurance Technology (HET)■ Includes High Endurance Technology (HET) NAND silicon
End-to-end data-path protectionIncludes multiple levels of data-path protection.
Enhanced power-loss data protectionEnergy storage components complete buffered writes to the persistent
Power loss protection capacitor self-test Supports testing of the power loss capacitor. Power is monitored using
Out-of-band managementManaged through the SMBUS.
Thermal throttling and monitoringProvides continuous full bandwidth performance with flash memory
enhancements.
■ Includes SSD NAND management techniques to extend SSD write
endurance up to 5 drive writes per day for five years.
flash storage in case of a sudden power loss.
SMART attribute critical warning.
module temperatures up to 73° C.
Related Information
■
“Specifications” on page 15
■
“Product Overview”
Characteristics
The Oracle 1.6TB NVMe SSD has the following hardware and software characteristics:
CharacteristicValue
Device name■ 1.6TB eMLC Flash NVMe SFF
SSDPE2ME016T4S
Manufacturing name■ 1.6TB eMLC Flash NVMe SFF
SSDPE2ME016T4S
StyleSmall form factor (SFF) SSD
2.5-inch Form Factor, 15mm Z- height, SFF-8639-compatible connector
Capacity1.6 TB
NANDAdvanced enterprise multi-level cell NAND (eMLC) technology for high-level
Life monitoring capability■ Provides alerts for proactive replacement of the drive before the endurance
Status indicators■ Blue, amber, and green LEDs on drive bracket indicate status
Related Information
■
“Specifications” on page 15
■
“Product Overview”
■
“Servicing the NVMe Drive Using Oracle Hardware Management Pack” on page 40
■ Oracle Solaris 11.2 (SRU 5)
■ Oracle Linux 6.5, based on UEK3 (Unbreakable Linux Kernel Release 3)
■ Oracle System Assistant
Refer to the server documentation.
Refer to the “Oracle 1.6TB NVMe SSD Product Notes” in “Oracle Flash
Accelerator F160 PCIe Card and 1.6TB NVMe SSD Product Notes”.
is depleted
■ Provides endurance remaining in NVMe SMART logs
■ See “Status Indicators” on page 12.
Status Indicators
Use the Oracle 1.6TB NVMe SSD status indicators to determine the status of each drive and
perform service actions as required. Three status indicator LEDs are located on the drive
bracket to indicate status and diagnose NVMe storage drive issues.
The following illustration shows status indicator LEDs for Oracle 1.6TB NVMe SSD.
12Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 13
Oracle 1.6TB NVMe SSD Overview
Indicator ColorStatus
(1)
Ready
to
Remove
(2)
Service
Action
Required
(3)
Power/
OK/
Activity
Blue■ OFF – The drive has not been prepared for removal. Normal operation.
■ STEADY ON – The drive is in standby power state. The drive can be removed safely
during a hot-plug operation. A lit Ready to Remove indicator indicates that service
action is allowed on the drive.
Amber■ OFF – Normal operation.
■ STEADY ON – Service action is required. The system has detected a fault with the
drive.
Green■ STEADY ON (does not blink) – Drive is engaged and is receiving full power. Normal
operation.
■ RANDOM BLINKING – There is drive activity. Status indicator blinks on and off to
indicate activity.
■ OFF – Power is off, or installed drive is not recognized by the system.
Related Information
■
“Product Overview”
■
“NVMe Drive Service Overview” on page 33
Product Overview13
Page 14
Oracle 1.6TB NVMe SSD Overview
About Oracle PCIe NVMe Switch Cards and 1.6TB
NVMe SSDs
1.6TB NVMe SSD drives on some servers require a PCIe low-profile form factor NVMe switch
controller card to facilitate connections between the host root port and the NVMe devices.
This Oracle PCIe NVMe Switch Card provides high bandwidth and low latency for up to four
NVMe drives. The Oracle PCIe NVMe Switch Card plugs into a low profile x8 PCIe Gen 3
card slot and uses sixteen lanes to support four NVMe storage drive devices.
The following illustration shows four Oracle 1.6TB NVMe SSDs connected to one Oracle PCIe
NVMe Switch Card in an x86 server configuration.
Legend
1. Oracle PCIe NVMe Switch Card
2. Server NVMe Connecting Cable
3. Server NVMe Disk Backplane
4. Oracle 1.6TB NVMe SSD storage drives in NVMe bays
Related Information
■
“Specifications” on page 15
■
“Product Overview”
14Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 15
Specifications
The following sections describe the specifications and capabilities of the Oracle 1.6TB NVMe
SSD:
■
“Product Specification” on page 15
■
“Environmental Specifications” on page 17
■
“Electrical Specifications” on page 17
■
“Reliability Specifications” on page 18
■
“Physical Dimensions” on page 19
Note - For server specifications, see the most recent version of the server product notes.
Product Specification
Specifications
Oracle 1.6TB NVMe SSD general specifications are shown in the following table:
SpecificationValue
CapacityUsable capacity 1.6 TB
Unformatted capacity (total user addressable sectors in LBA mode) 3,125,627,
568
Endurance rating■ Up to 14 PBW (petabytes written)
■ 5 Drive Writes/day (JESD219 workload)
Altitude (simulated)■ Operating: -1,000 to 10,000 ft
■ Non-Operating: -1,000 to 40,000 ft
Temperature■ Operating:
■ 0 to 35° C ambient, 0 to 70° C case with specified airflow
■ Temperature monitoring (In-band and by way of SMBUS)
■ Thermal throttling
■ Non-Operating: -55 to 95° C
AirflowMore than 450 LFM (linear feet/minute, at 25/35° C, airflow towards the
connector)
WeightUp to 125 gm
Shock1,000 G/0.5 msec
Vibration■ Operating: 2.17 GRMS (5-700Hz)
■ Non-Operating: 3.13 GRMS (5-800Hz)
Product ecological complianceRoHS
†
Performance values vary by capacity and form factor.
‡
Performance specifications apply to both compressible and incompressible data.
Related Information
■
“Product Overview”
■
“NVMe Drive Service Overview” on page 33
16Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 17
Specifications
Environmental Specifications
The Oracle 1.6TB NVMe SSD operates and is stored in an environment defined by the
parameters and specifications that are shown in the following table:
SpecificationValue
Operating temperature■ 0 to 35° C ambient, 0 to 70° C case with specified airflow
■ Operational environment: 5° C to 35° C (dry bulb)
Non-operating
temperature
Temperature
monitoring
Dry bulb temperatureMaximum dry bulb temperature shall be derated by 3.3° C per 1000 m above 500 m
Altitude (Simulated)■ Operating: -1,000 to 10,000 ft
Relative humidity
range
Thermal sensors■ Thermal sensors on the storage drives monitor flash memory modules.
Airflow requirement■ More than 450 LFM (linear feet/minute, at 25/35° C, airflow towards the connector)
Storage and transit environment: –55° C to 95° C (dry bulb)
■ Temperature monitoring in-band and by way of SMBUS.
■ See “Troubleshooting NVMe Drive Cooling” on page 39 for more information on
thermal throttling.
■ Non-Operating: -1,000 to 40,000 ft
■ Operational environment: 8% to 80% noncondensing
■ Storage and transit environment: 5% to 95% noncondensing
■ Non-operating: -20° C to 75° C noncondensing
■ Thermal sensor temperature cannot exceed 73° C
■ See illustration in “Troubleshooting NVMe Drive Cooling” on page 39 for thermal
sensor locations.
Note - For specific site planning guidelines and best practices, refer to the server documentation
and product notes for your server. Refer to the system site planning guide, if available.
Related Information
■
“Product Overview”
■
“NVMe Drive Service Overview” on page 33
Electrical Specifications
Oracle 1.6TB NVMe SSD electrical specifications are shown in the following table:
SpecificationValue
Power feeds■ 3.3V and 12V Supply Rail
Product Overview17
Page 18
Specifications
SpecificationValue
■ 3.3Vaux for SMBUS
Enhanced power-loss data protectionActive/Idle: Up to 25W/4W (typical)
Power consumption■ Active Write - Average = 22W
■ Active Read - Average = 10W
■ Idle = 4W
The Oracle 1.6TB NVMe SSD receives electrical power from the PCI Express +12 VDC and
+3.3 VDC power rails as shown in the following table:
Specification12 V Operating Characteristics3.3 Vaux Operating Characteristics
Operating voltage range12 V (+10%/-20%)3.3 V (+-9%)
Rise time (Max/Min)50ms/1ms50ms/1ms
Fall time (Max/Min)5s/1ms5s/1ms
Noise level1000 mV pp at 10Hz – 100KHz
300 mV pp at 10Hz – 100KHz
100 mV pp at 100KHz – 20 MHz
Min off time200 ms200 ms
Inrush current (typical peak)1.5 A1.5 A
Max average current2.45 A1 mA
50 mV pp at 100KHz – 20 MHz
Related Information
■
“Product Overview”
■
“NVMe Drive Service Overview” on page 33
Reliability Specifications
The Oracle 1.6TB NVMe SSD reliability specifications are shown in the following table:
SpecificationValue
Uncorrectable Bit Error
Rate (UBER)
Mean Time Between
Failures (MTBF)
Uncorrectable bit error rate will not exceed one sector in the specified number of bits read.
In the unlikely event of a non-recoverable read error, the storage drive will report it as a
read failure to the host; the sector in error is considered corrupt and is not returned to the
host.
< 1 sector per 1017 bits read
2 million hours
Mean Time Between Failures is estimated based on Telcordia methodology and
demonstrated through Reliability Demonstration Test (RDT).
18Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 19
Specifications
SpecificationValue
Data RetentionThe time period for retaining data in the NAND at maximum rated endurance. 3 months
Endurance Rating■ Up to 14 PBW (petabytes written)
Temperature SensorInternal temperature sensor with an accuracy of +/-2° C over a range of -10° C to +85° C
Out of Band
Management
(SMBUS)
Hot Plug SupportSupports PCIe presence detect and link-up detect.
power-off retention once storage drive reaches rated write endurance at 40° C.
Endurance rating verification is defined to establish UBER <1E-16 at 60% upper
confidence limit.
■ 5 Drive Writes/day (JESD219 workload)
The number of drive writes such that the storage drive meets the requirements
according to the JESD219 standard.
which can be monitored using NVMe Health Log.
The sensor has an accuracy of +/- 3° C over a range of -20° C to 125° C. SMBUS
temperature sensor is not reported in NVMe Health Log.
Drive provides out-of-band access to temperature by means of SMBUS.
Provides out-of-band management by means of SMBUS interface. This requires 3.3V
auxiliary voltage.
SMBUS access includes the VPD page and temperature sensor.
Device advanced power loss protection provides robust data integrity. During IOs, the
SSD's integrated monitoring enables the integrity of already committed data on the media
and commits acknowledged writes to the media.
See “Servicing the NVMe Storage Drive”.
Related Information
■
“Product Overview”
■
“Servicing the NVMe Storage Drive”
Physical Dimensions
The following diagram shows Oracle 1.6TB NVMe SSD physical dimensions:
Product Overview19
Page 20
Specifications
SpecificationDimension
(1) Length100.45 mm maximum (3.955 in.)
(2) Width69.85 +/- 0.25 mm (2.75 in.)
(3) Height15.0 +0/-0.5 mm (0.59 in.)
Weight125 g maximum (4.4 oz)
Related Information
■
“Product Overview”
20Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 21
Preparing the NVMe Storage Drive for
Installation
These topics provide information about preparing an Oracle 1.6TB NVMe SSD for installation:
DescriptionLinks
Review Prepare for Installation procedure.“Prepare for Installation” on page 21
Gather the required tools.“Required Tools” on page 22
Unpack the shipping kit.“Ship Kit Contents” on page 22
Review safety information.“Observing Safety Precautions” on page 23
Update your system to the latest software release.“Update Your System to the Latest Software
Note - For specific installation instructions, see your system installation guide. For information
about installation and use of the SSD on your server, see the most recent version of the server
product notes.
Guidelines” on page 25
Release” on page 27
Note - NVMe storage drives are supported only on servers that are running Oracle Solaris or
Oracle Linux operating systems. Servers that are running Oracle VM, Windows Server, Red
Hat Enterprise Linux, SUSE Linux Enterprise Server, or VMware ESXi do not support NVMe
drives.
Prepare for Installation
1.
Gather the required tools.
See “Required Tools” on page 22.
2.
Unpack the shipping kit that includes the SSD.
Preparing the NVMe Storage Drive for Installation21
Page 22
Required Tools
a.
Unpack the SSD in a static free environment.
See “Ship Kit Contents” on page 22.
b.
Remove the SSD drive from its packaging, and place the drive on an
antistatic mat, using good antistatic grounding procedures.
See “ESD Safety Measures” on page 24.
3.
Carefully inspect the SSD drive for damage.
a.
Inspect the drive for shipment damage. If any damage is detected, contact
your supplier.
b.
If you notice any damage, contact Oracle support, or your reseller support
representative. Go to: https://support.oracle.com.
Required Tools
You will need the following tools for most service operations:
■
Antistatic wrist strap
■
Antistatic mat
Related Information
■
“Preparing the NVMe Storage Drive for Installation”
■
“ESD Safety Measures” on page 24
Ship Kit Contents
The Oracle 1.6TB NVMe SSD ship kit contains the components shown in the following
illustration:
22Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 23
Observing Safety Precautions
1. Documentation
2. Foam
3. Antistatic bag
4. Oracle 1.6TB NVMe SSD
5. Packaging
Related Information
■
“Preparing the NVMe Storage Drive for Installation”
■
“Product Overview”
Observing Safety Precautions
This section contains safety information about safeguarding the equipment and personnel from
damage:
■
“General Safety Information” on page 24
Preparing the NVMe Storage Drive for Installation23
Page 24
Observing Safety Precautions
■
“Safety Symbols” on page 24
■
“ESD Safety Measures” on page 24
■
“Perform ESD Prevention Measures” on page 25
General Safety Information
For your protection, observe the following safety precautions when setting up your equipment:
■
Follow all cautions and instructions marked on the equipment.
■
Follow all cautions and instructions described in the documentation shipped with your
system and described in the server's safety information.
■
Follow the electrostatic discharge safety practices as described in this section.
Safety Symbols
Note the meanings of the following symbols that might appear in this document:
Caution - There is a risk of personal injury or equipment damage. To avoid personal injury and
equipment damage, follow the instructions.
Caution - Hot surface. Avoid contact. Surfaces are hot and might cause personal injury if
touched.
Caution - Hazardous voltages are present. To reduce the risk of electric shock and danger to
personal health, follow the instructions.
ESD Safety Measures
Circuit boards and drives contain electronic components that are extremely sensitive to static
electricity. Ordinary amounts of static electricity from clothing or the work environment
can destroy the components located on these boards. Electrostatic discharge (ESD) sensitive
devices, such as the drives, require special handling.
■
Place ESD-sensitive components and other PCBs on an antistatic mat (not provided).
24Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 25
Perform ESD Prevention Measures
■
Wear an antistatic wrist strap when handling ESD-sensitive components.
Caution - Possible component damage. Do not touch components along connector edges.
Related Information
■
“Perform ESD Prevention Measures” on page 25
■
“NVMe Drive Service Overview” on page 33
Perform ESD Prevention Measures
1.
Prepare an antistatic surface to set parts on during the removal, installation, or
replacement process.
Place ESD-sensitive components such as the printed circuit boards on an antistatic mat. The
following items can be used as an antistatic mat:
■
Antistatic bag used to wrap a replacement part
■
ESD mat
■
A disposable ESD mat (shipped with some replacement parts or optional
system components)
2.
Attach an antistatic wrist strap.
When servicing or removing server components, attach an antistatic strap to your wrist and then
to a metal area on the chassis.
Related Information
■
“ESD Safety Measures” on page 24
■
“NVMe Drive Service Overview” on page 33
Oracle 1.6TB NVMe SSD Optimization Guidelines
To optimize preformance, observe the following guidelines when setting up Oracle 1.6TB
NVMe SSDs in a server.
Preparing the NVMe Storage Drive for Installation25
Page 26
Drive Volume Management
■
Block size can be configured through a server operating system or file system and is set to a
default size with Oracle databases.
■
The Oracle 1.6TB NVMe SSDs is designed to provide best performance for data transfers
that are multiples of 4k size and using addresses that are 4k aligned. Partitions should be
aligned to start on 4k boundaries.
■
The ZFS file system might require manual alignment. The Oracle 1.6TB NVMe SSD has a
maximum transfer size of 128k. IO requests for larger transfer sizes are broken into transfer
sizes of size 128k or smaller. For optimal performance, transfer sizes should be limited to
128k to avoid additional overhead associated with breaking into smaller transfer sizes.
■
The Oracle 1.6TB NVMe SSD should be formatted using a label of type EFI (format -e
command).
Ensure that when the EFI label is created by ZFS, the default start sector is 256, which
aligns S1 with 128k (if the block size is 512). The vtoc label default cylinder size is 50176
(224*224) blocks. If the block size is 512, the default Oracle Solaris Operating System
partition aligns with 512k. For example: 50176*512 = 49*512*1024.
Specify and ensure 4k alignment: The default start sector of 34 for EFI labels is not a 4k
aligned value. Use the partition subcommand of the Solaris format command to change the
start sector to 256, or any other 128k aligned value. Note that there are 512B per sector.
■
The ZFS file system automatically aligns partitions to start on 8k boundaries when a full
disk is allocated to ZFS (recommended). If you allocate individual EFI partitions to a ZFS
pool, ensure the partition is 4k-aligned as discussed above. For optimal performance of ZFS
with the 1.6TB NVMe SSD, refer to the ZFS Best Practices Guide and the ZFS Evil TuningGuide.
■
For highest performance, make sure that the system meets the physical, environmental, and
electrical specifications listed in “Specifications” on page 15.
Related Information
■
“Preparing the NVMe Storage Drive for Installation”
Tuning ZFS When Using Flash Storage http://docs.oracle.com/cd/E26502_01/html/
E29022/chapterzfs-flash.html
Drive Volume Management
A volume manager can present multiple SSD devices as one larger volume. Use the Automatic
Storage Management (ASM) volume manager or other volume manager to concatenate multiple
flash memory domains. For example, a volume manager can be used to concatenate four 1.6 TB
domains into a single 6.4 TB volume.
26Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 27
Update Your System to the Latest Software Release
Refer to the documentation for more information at http://docs.oracle.com/cd/B28359_01/
server.111/b31107/asmcon.htm.
Update Your System to the Latest Software Release
It is highly recommended that you update your system to the latest software release before
you use the system. Software releases often include bug fixes, and updating ensures that your
server software is compatible with the latest server firmware and other component firmware and
software.
Note - The Oracle 1.6TB NVMe SSD firmware update procedure is described in the server
documentation.
1.
Check the Oracle 1.6TB NVMe SSD Product Notes for the latest firmware
requirements, available at the Oracle 1.6TB NVMe SSD Documentation Library.
Go to:
http://www.oracle.com/goto/oracleflashf160/docs.
2.
Download and install any firmware updates required to support the SSD, host
bus adapter (HBA), drive backplane, system BIOS, or OBP/system (SPARC)
firmware.
■
You can get the latest available system BIOS, Oracle Integrated Lights Out
Manager (ILOM), firmware, and drivers from Oracle by performing the GetUpdates task in Oracle System Assistant.
An Internet connection is required. For instructions on how to use the Get Updates task,
see the servers administration guide.
■
You also can download the latest firmware and software updates from My
Oracle Support at https://support.oracle.com.
For information about downloading firmware and software from My Oracle Support, see
“Getting Server Firmware and Software Updates” in the server documentation.
Related Information
■
“Downloading the SSD Software Package” in “Oracle Flash Accelerator F160 PCIe Card
and 1.6TB NVMe SSD Product Notes”
■
“Update the NVMe Storage Drive Firmware” in “Oracle Flash Accelerator F160 PCIe Card
and 1.6TB NVMe SSD Product Notes”
■
“Verify Oracle 1.6TB NVMe SSD Operation” in “Oracle Flash Accelerator F160 PCIe Card
and 1.6TB NVMe SSD Product Notes”
Preparing the NVMe Storage Drive for Installation27
Page 28
Accessing Software Updates and Firmware Downloads
■
“Product Overview”
■
“NVMe Drive Service Overview” on page 33
Accessing Software Updates and Firmware Downloads
Product patches, updates and firmware are available on My Oracle Support at https://
support.oracle.com. from the Patches and Updates tab. Information on accessing and using
My Oracle Support can be found at the My Oracle Support Welcome Center for Oracle Sun
Customers and Partners.
See “Downloading the Drive Software Package” on page 28.
Downloading the Drive Software Package
To find the drive software package, access My Oracle Support and download the latest software
package for the Oracle 1.6TB NVMe SSD.
1.
Sign in to My Oracle Support at https://support.oracle.com.
2.
Click the "Patches & Updates" tab.
3.
In the "Patch Search" box on the right side, select "Product or Family (Advanced
Search)"
4.
Enter a partial product name for "Product is".
A list of matches displays.
5.
Select the product of interest.
Select one or more "releases" in the "Release is" drop down list.
Close the pop-up window.
6.
Click Search.
A list of product downloads (listed as patches) displays.
7.
Select the download of interest.
The Download Information Page displays.
If, on the Download Information Page, you get the message "You do not have permissions
to download this Patch...", see How Patches and Updates Entitlement Works at https://
support.oracle.com to help you determine the reason.
28Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 29
Installing the NVMe Storage Drive
These topics provide information about installing the Oracle 1.6TB NVMe SSD into a server.
DescriptionLinks
Review installation tasks and performance tuning
information before installing SSD.
Install a new SSD into a server.“Install a New NVMe Storage Drive
Installation Overview
Read this overview information section before installing the Oracle 1.6TB NVMe SSD into a
server.
■
“NVMe Storage Drive Installation Overview” on page 29
■
“Oracle 1.6TB NVMe SSD Optimization Guidelines” on page 25
“Installation Overview” on page 29
(CRU)” on page 30
For information on how to install your NVMe drive, refer to your system or drive enclosure
documentation.
The drive bracket assembly should not be disassembled for any reason by the user.
NVMe Storage Drive Installation Overview
To install your 1.6TB NVMe SSD into a system, refer to the following table:
StepsTaskSee
1.Prepare the SSD for installation. Carefully unpack
the SSD. Inspect the SSD for damage. Follow ESD
precautions.
“Preparing the NVMe Storage Drive for
Installation”
Installing the NVMe Storage Drive29
Page 30
Install a New NVMe Storage Drive (CRU)
StepsTaskSee
2.Insert the SSD in an available drive slot.“Install a New NVMe Storage Drive
Refer to the server's service manual for additional information.
Related Information
■
“Product Overview”
■
“NVMe Drive Service Overview” on page 33
Install a New NVMe Storage Drive (CRU)
To install a new Oracle 1.6TB NVMe SSD (2.5 Inch small form factor) into a server:
1.
Back up your data, as required, before changing your server configuration.
(CRU)” on page 30
2.
Identify a supported and available slot in the server.
Refer to the server's service manual for drive locations on the server.
Refer to “Supported Servers and Operating Systems” in “Oracle Flash Accelerator F160 PCIe
Card and 1.6TB NVMe SSD Product Notes ” at:
http://www.oracle.com/goto/oracleflashf160/docs
Note - While using a Oracle 1.6TB NVMe SSD 2.5-inch small form factor drive, locate a server
slot on the server's front panel labeled NVMe (with SFF-8639 disk backplane and connector)
that is capable of supporting the Oracle 1.6TB NVMe SSD. Your server chassis must contain
NVMe equipment, including Oracle NVMe Switch Controller Cards and cables. Refer to the
server's service manual for NVMe SSD installation instructions.
3.
Locate the storage drive filler panel in the server.
If the optional NVMe storage drives are installed in the server's front panel, they are labeled
NVMe0, NVMe1, NVMe2, NVMe3 and so on. However, the server operating systems assign
these storage drives different names. For the corresponding names assigned by the operating
systems, refer to the server's service manual.
4.
Prepare the SSD for installation.
See “Preparing the NVMe Storage Drive for Installation”.
5.
Record the serial number of the NVMe SSD and NVMe slot number where the
SSD will be installed.
30Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 31
Install a New NVMe Storage Drive (CRU)
This drive serial number (WWN) and server slot information can be used at a later time for
identifying drives from the console.
Refer to the server's service manual.
6.
If necessary, remove the drive filler panel.
Remove the blank storage drive filler panel on the server chassis that aligns with the empty
NVMe drive slot.
For instructions on how to remove drive filler panels, refer to the server's service manual.
7.
Slide the Oracle 1.6TB NVMe SSD into the supported NVMe slot until the drive is
fully seated.
The following figure shows how to insert the SSD in a server NVMe slot:
8.
Close the drive latch to lock the drive in place.
9.
Configure the server for the new SSD.
a.
If applicable, perform any required commands for your system to install the
device driver for the new SSD.
b.
If applicable, perform any required commands for your system to recognize
the new SSD.
c.
Verify successful installation of the SSD through your system's OS.
Upon completed installation, the Oracle 1.6TB NVMe SSD is visible to your server
operating system.
d.
Configure the system to maximize flash technology.
Refer to the server's administration guide.
Installing the NVMe Storage Drive31
Page 32
Install a New NVMe Storage Drive (CRU)
Related Information
■
“Product Overview”
■
“NVMe Drive Service Overview” on page 33
32Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 33
Servicing the NVMe Storage Drive
These topics provide service information for the Oracle 1.6TB NVMe SSD.
DescriptionLinks
Review service task and troubleshooting information.“NVMe Drive Service Overview” on page 33
Use Oracle Hardware Management Pack utilities
command line interface (CLI) tools to service the
NVMe drive.
NVMe Drive Service Overview
“Component Serviceability” on page 34
(CRU)” on page 35
“Servicing the NVMe Drive Using Oracle Hardware
Management Pack” on page 40
For service, the Oracle 1.6TB NVMe SSD contains updatable flash ROM for storing the
BIOS and firmware, as well as NVRAM for storing nonvolatile configuration data. Use
Oracle Hardware Management Pack to monitor and service the SSD. You can also use Oracle
Hardware Management Pack for troubleshooting. See “Servicing the NVMe Drive Using
Oracle Hardware Management Pack” on page 40.
In addition, you can monitor Oracle 1.6TB NVMe SSD health and flash media drive life
through SSD bracket status indicators (LEDs). The SSD has three status indicators on the drive
bracket to indicate activity, drive life, and status. See “Status Indicators” on page 12.
The Oracle 1.6TB NVMe SSD requires no periodic maintenance. For data protection, the
Oracle 1.6TB NVMe SSD is designed with energy storage components to complete buffered
writes to the persistent flash storage in case of a sudden power loss. These energy storage
components are designed for the life of the Oracle 1.6TB NVMe SSD and do not require
periodic maintenance.
Servicing the NVMe Storage Drive33
Page 34
NVMe Drive Service Overview
Note - Refer to the server documentation for additional NVMe Storage Drive service and
firmware download information. Refer to the server's service manual for SSD detailed removal
and replacement instructions.
Component Serviceability
The following service actions can be performed on a 1.6TB NVMe SSD.
■
Unmount an NVMe Storage Drive
■
Remove an NVMe Storage Drive From the Server
■
Verify Removal of an NVMe Storage Drive
■
Install an NVMe Storage Drive in the Server
■
Power On an NVMe Storage Drive and Attach a Device Driver
Components are either hot serviceable or cold serviceable. Hot service capability allows you
to safely remove this component while the server is running. Cold service capability requires a
powered off state, so you need to remove power from the server.
Components are designated either CRU (customer-replaceable unit) or FRU (field-replaceable
unit). CRU service capability allows trained technicians and authorized field service personnel
to service this component. FRU service capability allows only authorized service personnel to
service this component.
Refer to the server documentation for additional service information.
The following table lists the serviceability of NVMe components and directs you to
replacement instructions.
ComponentServiceabilityReplacement Instructions
Oracle 1.6TB NVMe SSD (and
fillers)
Oracle PCIe NVMe Switch CardCold
NVMe cablesCold
Hot
CRU
FRU
FRU
“Installing the NVMe Storage Drive”
“Replace An Existing NVMe Storage Drive
(CRU)” on page 35
For instructions on safe installation and removal
of SSDs, refer to the server's service manual.
For instructions on safe installation and removal
of cards, refer to the server's service manual.
For instructions on safe installation and removal
of cables and connected drive backplane, refer to
the server's service manual.
See Also:
34Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 35
Replace An Existing NVMe Storage Drive (CRU)
■
“Product Overview”
■
“Technical Support” on page 38
Replace An Existing NVMe Storage Drive (CRU)
Replace an Oracle 1.6TB NVMe SSD if the drive fails or the usable drive life has been
exceeded.
Caution - Possible component damage. Different server platforms place NVMe-capable
bays in different locations. To identify a server’s NVMe-capable bay, observe that the orange
silk screen on the server is labeled NVMe# before inserting an NVMe storage drive into a
server NVMe-capable slot. Your server chassis must contain an NVMe capable configuration
including Oracle NVMe Switch Controller Cards and cables.
Caution - Possible component damage. Circuit boards and drives contain electronic
components that are extremely sensitive to static electricity. Ordinary amounts of static
electricity from clothing or the work environment can destroy the components located on these
boards. Do not touch the components along their connector edges. These procedures require
that you handle components that are sensitive to electrostatic discharge. This sensitivity can
cause the components to fail. To avoid damage, ensure that you follow anti-static practices as
described in “ESD Safety Measures” on page 24.
The following task describes an example procedure. Follow the server's service manual
instructions.
1.
Prepare the server operating system, as required, before you remove drives.
Follow the server's service manual instructions for orderly shutdown during NVMe storage
drive insertion and removal service actions.
Unmount the NVMe storage drives.
2.
Identify the physical location of the NVMe drive that you want to remove.
Caution - Possible component damage. While using a 2.5-inch form factor drive, locate a server
slot on the server's front panel labeled NVMe (with SFF-8639 disk backplane and connector)
that is capable of supporting the Oracle 1.6TB NVMe SSD that is labeled as shown in the
following figure. Never insert an NVMe storage drive into a non-NVMe capable slot that
supports HDD only (labeled HDD).
Servicing the NVMe Storage Drive35
Page 36
Replace An Existing NVMe Storage Drive (CRU)
3.
Observe the status indicators on the front panel of the drive to verify which drive
in the server requires replacement.
■
Verify that the Blue OK to Remove status indicator (LED) on the NVMe storage drive is lit.
■
Green (operational), Amber (faulty disk ), Blue (SSD has been prepared for removal)
■
See “Status Indicators” on page 12.
4.
Remove the NVMe storage drive from the server.
a.
On the drive you plan to remove, push the latch release button to open the
drive latch.
Press the release lever button on the drive front panel and then tilt the lever into a fully
opened position.
b.
Grasp the opened release lever and gently slide the drive toward you.
c.
If you are not immediately replacing the drive, insert a filler panel into the
empty drive slot on the server.
If you are not replacing the drive, install a filler panel in the empty drive slot to maintain
proper airflow and perform administrative tasks to configure the server to operate without
the drive.
36Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 37
Replace An Existing NVMe Storage Drive (CRU)
5.
Verify removal of the NVMe storage drive.
Follow the server's service manual instructions for NVMe storage drive identification.
6.
Install (or replace) the NVMe storage drive.
The drive is physically addressed according to the slot in which it is installed. It is important to
install a replacement drive in the same slot as the drive that was removed.
Refer to “Supported Servers and Operating Systems” in “Oracle Flash Accelerator F160 PCIe
Card and 1.6TB NVMe SSD Product Notes ”.
a.
Slide the drive into the vacant slot by pressing the middle of the drive
faceplate with your thumb or finger.
Slide the drive into the slot until the drive is fully seated.
b.
Close the drive latch to lock the drive in place.
Using your thumb or finger, press on the middle of the drive faceplate until the release
lever engages with the chassis. Close the release lever until it clicks into place and is flush
with the front of the server.
Servicing the NVMe Storage Drive37
Page 38
Contacting Technical Support
Caution - Possible component damage. While using a 2.5-inch form factor drive, locate a server
slot on the server's front panel labeled NVMe (with SFF-8639 disk backplane and connector)
that is capable of supporting the Oracle 1.6TB NVMe SSD. Never insert an NVMe storage
drive into a non-NVMe capable slot (HDD).
7.
For hot plug service actions, configure the NVMe storage drive and verify drive
availability.
■
Follow the server's service manual instructions for NVMe storage drive configuration and
identification.
■
Use appropriate software commands to return the system to an operational state:
■
■
■
■
Related Information
■
“Servicing the NVMe Drive Using Oracle Hardware Management Pack” on page 40
■
“Product Overview”
Power on the NVMe storage drive as required.
Attach a device driver as required.
Re-activate mirror if manual intervention is required.
Re-sync mirror if manual intervention is required.
Before You Begin
Technical Support
For assistance installing, configuring, or running the Oracle 1.6TB NVMe SSD, contact My
Oracle Support (MOS).
Related Information
■
“Contacting Technical Support” on page 38
■
“Product Overview”
Contacting Technical Support
For assistance installing, configuring, or running the Oracle 1.6TB NVMe SSD, contact My
Oracle Support (MOS).
Please have your CSI Customer Support ID ready.
Go to My Oracle Support:
38Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 39
Contacting Technical Support
■
Go to: https://support.oracle.com
Sign in to My Oracle Support to open a service request.
■
Call Oracle support, using the appropriate number from the Oracle Global
Customer Support Contacts Directory:
Maintaining the proper internal operating temperature of the server is crucial to a the health of
the server. To prevent server shutdown and damage to components, address over temperature
and hardware-related issues as soon as they occur.
The SSD is designed to provide continuous full bandwidth performance with temperatures up to
73° C. Qualified host platforms with required software updates operate with sufficient margin to
the maximum temperature under worst case environments.
Use the status indicators to determine the status of the Oracle 1.6TB NVMe SSD. The LEDs
provide key status indicators to diagnose SSD issues. See “Status Indicators” on page 12.
Should the system maximum operating temperature be exceeded or a system fault occur which
causes internal temperatures of the flash memory modules to rise above this limit, the SSD
responds as follows:
■
73° C - Drive write throttling is engaged to reduce SSD power.
■
SSD status indicator amber, Service Action Required.
■
Temperature warning displays in utility output.
■
78° C - Additional drive write throttling is engaged.
■
SSD status indicator amber, Service Action Required.
■
Critical temperature status displays in utility output.
Caution - Sustained critical temperatures might cause data loss.
Refer to the server documentation for additional service information.
Servicing the NVMe Storage Drive39
Page 40
Servicing the NVMe Drive Using Oracle Hardware Management Pack
The following image shows the SSD temperature sensor locations:
(1): SSD temperature sensor location (PCB both sides underneath ASIC)
Related Information
■
“Status Indicators” on page 12
■
“Product Overview”
■
“Technical Support” on page 38
Servicing the NVMe Drive Using Oracle Hardware
Management Pack
The Oracle Hardware Management Pack utilities support command line interface (CLI) tools
to service the Oracle 1.6TB NVMe SSD. Oracle Hardware Management Pack tools provide
commands and agents that operate at the operating system level and can be used across multiple
systems. You can monitor hardware through the operating system, either remotely using SNMP
or locally using CLI tools.
This section includes the following sections:
■
“Oracle Hardware Management Pack Documentation” on page 41
40Oracle 1.6TB NVMe SSD User Guide • July 2015
Page 41
Access Command Line Interface (CLI) in Oracle Hardware Management Pack Utility
■
“Access Command Line Interface (CLI) in Oracle Hardware Management Pack
Utility” on page 41
Oracle Hardware Management Pack
Documentation
Documentation for Oracle Hardware Management Pack can be found on the web at:
http://www.oracle.com/goto/OHMP/docs
The following table lists the Oracle Hardware Management Pack documentation.
E52097Overview of Hardware Management Pack components
and instructions on installing Hardware Management
Pack.
E52099Instructions on how to use the Oracle Hardware
Management Pack CLI tools. Includes information on
NMVe controller administration.
E52098Details about installing and configuring the Oracle
Server Management Agents, which enable you to
manage servers at the operating system level.
Related Information
■
“Access Command Line Interface (CLI) in Oracle Hardware Management Pack
Utility” on page 41
■
“Servicing the NVMe Drive Using Oracle Hardware Management Pack” on page 40
■
“Product Overview”
Access Command Line Interface (CLI) in Oracle Hardware
Management Pack Utility
To access the Oracle Hardware Management Pack CLI:
1.
Obtain Oracle Hardware Management Pack.
■
Download the Oracle Hardware Management Pack at:
http://support.oracle.com
Servicing the NVMe Storage Drive41
Page 42
Access Command Line Interface (CLI) in Oracle Hardware Management Pack Utility
■
Get the Add-on software pack from Oracle System Assistant.
Refer to “Oracle 1.6TB NVMe SSD Product Notes” in “Oracle Flash Accelerator F160 PCIe
Card and 1.6TB NVMe SSD Product Notes” for additional download information at:
http://www.oracle.com/goto/oracleflashf160/docs
2.
Access host server console devices remotely or locally.
Ensure that a KVM console is remotely or locally connected to the server.
Refer to the server's service manual.
■
Connect an Ethernet cable to the Gigabit Ethernet (NET) connectors as needed for OS
support.
■
Connect to the service processor's Oracle ILOM over the network and connect an Ethernet
cable to the Ethernet port labeled NET MGT.
■
Access the Oracle ILOM command-line interface (CLI) locally using the management port
and connect a serial null modem cable to the RJ-45 serial port labeled SER MGT.
■
To interact with the system console locally, connect a mouse and keyboard to the USB
connectors and a monitor to the DB-15 video connector.
3.
Open a CLI terminal.
4.
Type a command.
See “Oracle Hardware Management Pack Documentation” on page 41.
Refer to the server documentation.
Related Information
■
“Oracle Hardware Management Pack Documentation” on page 41
■
“Servicing the NVMe Drive Using Oracle Hardware Management Pack” on page 40