How it Works
Quantum
Loading...
STORNEXT PFR
User Manual
44 pgs1.28 Mb0
User Manual
6 pgs130.3 Kb0
Table of contents
Loading...

Quantum STORNEXT PFR User Manual

6-66957-01 Rev A
StorNext
User’s Guide User’s Guide User’s Guide User’s Guide
Quantum Partial File Retrieval
Quantum Partial File Retrieval
Document Title, 6-66957-01 Rev A, June 2010, Product of USA.
COPYRIGHT STATEMENT
© 2010 Quantum Corporation. All rights reserved.
Your right to copy this manual is limited by copyright law. Making copies or adaptations without prior written authorization of Quantum Corporation is prohibited by law and constitutes a punishable violation of the law.
TRADEMARK STATEMENT
Quantum, the Quantum logo, DLT, DLTtape, the DLTtape logo, Scalar, and StorNext are registered trademarks of Quantum Corporation, registered in the U.S. and other countries.
Backup. Recovery. Archive. It’s What We Do., the DLT logo, DLTSage, DXi, DXi-Series, Dynamic Powerdown, FastSense, FlexLink, GoVault, MediaShield, Optyon, Pocket-sized. Well-armored, SDLT, SiteCare, SmartVerify, StorageCare, Super DLTtape, SuperLoader, and Vision are trademarks of Quantum.
LTO and Ultrium are trademarks of HP, IBM, and Quantum in the U.S. and other countries. All other trademarks are the property of their respective companies.
Specifications are subject to change without notice.
ii Quantum StorNext Partial File Retrieval User’s Guide

Contents

Chapter 1 Introduction to Quantum Partial File Retrieval 1
Chapter 2 How Quantum Partial File Retrieval Works 3
Partial File Retrieval Indexer. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Partial File Retrieval Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
Folder Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
Issuing a Request . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Monitoring Requests. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Chapter 3 Installation 7
Installation Components and Install Options. . . . . . . . . . . . . . . . . . . . . 7
Prerequisites . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Operating Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
StorNext . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
VMWare . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Bonjour. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
User Accounts. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
.NET . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
Sharing the StorNext File System . . . . . . . . . . . . . . . . . . . . . . 12
Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
StorNext Timecode-Based Partial File Retrieval User’s Guide iii
Contents
Chapter 4 Configuration 15
SNAPI / PFR Linux Component Configuration . . . . . . . . . . . . . . . . . . . 15
Ensuring that the VM is running. . . . . . . . . . . . . . . . . . . . . . . 15
Showing the VM and its GUI. . . . . . . . . . . . . . . . . . . . . . . . . . 18
Setting the Location of StorNext Storage Manager. . . . . . . . . 19
Network Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
Primary Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Welcome. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Archive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
Job Results Folder . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
Work Folders. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
Transfer Engines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
Indexer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
Complete . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
Indexer Configuration and Monitoring . . . . . . . . . . . . . . . . . . . . . . . . 31
Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Chapter 5 Using the Status GUI Application 35
Anatomy of Status GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
Manipulating the Retrievals. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Chapter 6 Request EDL Format 37
Sample . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Notes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
iv StorNext Timecode-Based Partial File Retrieval User’s Guide

Figures

Figure 1 Server Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
Figure 2 Add Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
Figure 3 Install .NET Framework . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
Figure 4 PFR Installer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
Figure 5 VMWare Login . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
Figure 6 Virtual Machine Settings. . . . . . . . . . . . . . . . . . . . . . . . . . 17
Figure 7 Virtual Machine Inventory . . . . . . . . . . . . . . . . . . . . . . . . 18
Figure 8 Console Tab . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
Figure 9 PFR GUI. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
Figure 10 Edit SNAPI Configuration File . . . . . . . . . . . . . . . . . . . . . . 20
Figure 11 Network Settings Screen. . . . . . . . . . . . . . . . . . . . . . . . . . 21
Figure 12 Edit Network Settings. . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Figure 13 Edit Network Settings. . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Figure 14 Welcome Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
Figure 15 Archive Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
Figure 16 Job Results Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
Figure 17 Work Folders Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
Figure 18 Transfer Engines Screen. . . . . . . . . . . . . . . . . . . . . . . . . . 28
Figure 19 PFR Indexer Screen. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
Figure 20 Summary Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
Figure 21 Complete Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Figure 22 PFR Index Configuration . . . . . . . . . . . . . . . . . . . . . . . . . 32
StorNext Timecode-Based Partial File Retrieval User’s Guide v
Figures
Figure 23 Indexer Log Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Figure 24 Status GUI Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
vi StorNext Timecode-Based Partial File Retrieval User’s Guide
Chapter 1
Introduction to Quantum
Partial File Retrieval
Quantum Partial File Retrieval allows you to quickly retrieve and utilize segments of large media files—rather than the entire file— based on timecode parameters.
Segments of large media files that have been archived to tape using Quantum StorNext Storage Manager can be requested using a simple XML request file. Quantum Partial File Retrieval instructs StorNext to retrieve only the necessary portion from tape, and then presents that segment as a complete MXF or QuickTime file.
If the file has not yet been truncated by StorNext Storage Manager, the result will still be the same. However, in this case the Partial File will be generated directly from the complete media file on disk.
The Quantum Partial File Retrieval feature requires a dedicated Windows-based server on which to run. For larger scale installations, the Quantum Partial File Retrieval functionality can be distributed across multiple Windows server machines.
StorNext Timecode-Based Partial File Retrieval User’s Guide 1
Chapter 1: Introduction to Quantum Partial File Retrieval
2 StorNext Timecode-Based Partial File Retrieval User’s Guide
How Quantum Partial File
Quantum Partial File Retrieval consists of two primary components: an indexer which indexes media files before they are archived to tape and truncated, and a Partial File Retrieval service that performs the requested retrievals.

Partial File Retrieval Indexer

Chapter 2
Retrieval Works
The Partial File Retrieval Indexer looks for new media to appear in StorNext Storage Manager. When it finds a new media file it generates an index for it, in effect mapping timecode values in the original media file to byte offsets. This allows subsequent timecode- based requests to retrieve only the necessary portions of a large media file from tape.
The index files, which are written as QuickTime reference files, are generated in a parallel folder structure on the managed storage. The two file locations below represent a MXF based media file and its associated index file.
//StorNext/snfs1/Media/Project/Movie.mxf //StorNext/snfs1/PFR-INDEX/Media/Project/Movie.mov
StorNext Timecode-Based Partial File Retrieval User’s Guide 3
Chapter 2: How Quantum Partial File Retrieval Works Partial File Retrieval Service
Note: The index files do not contain any content themselves, and are
therefore very small in comparison with the files they index.
It is important that the indexed files themselves are never truncated.
The Indexer does not attempt to index files that it thinks might be currently in-record. Therefore, the first time the indexer encounters the file, there may be some delay before a particular file is indexed while the indexer is trying to establish if the file is currently being written to.

Partial File Retrieval Service

Folder Structure Within the Quantum Partial File Retrieval Configuration Tool, it is

possible to set up multiple sets of folders for different request types. For example, a set of folders for news requests might look like this:
//StorNext/snfs1/Requests/News //StorNext/snfs1/Requests/News/PFR-REQUEST //StorNext/snfs1/Requests/News/success //StorNext/snfs1/Requests/News/fail
The configuration tool creates these folders for you and allows you to set an output format: QuickTime Movie or MXF.
The four folders shown in the example are used in the following manner:
1 The parent folder (in this case
extract will be placed once retrieved and created;
2 The
3 Once the request has been completed, the XML request file will be
4 StorNext Timecode-Based Partial File Retrieval User’s Guide
PFR-REQUEST
request file;
moved to the
folder is the location to place the XML-formatted
success
folder;
News
) is where the resultant file
Chapter 2: How Quantum Partial File Retrieval Works
Partial File Retrieval Service
4 If an error occurred in retrieving the partial file, the XML request file
will be moved to the
fail
folder.

Issuing a Request A Partial File Retrieval request is issued in the form of a small XML file,

the format of which can be seen in the example later in this User Guide. The XML file simply describes a movie (via a full UNC path) with an in and out timecode value.
Quantum PFR will handle a number of the requests simultaneously with the overall retrieval performance dependant upon the quantity of tape drives available.
The number of tape drives limits how many requests can be processed simultaneously. Once all tape drives are busy, additional requests will be queued until a tape drive becomes available.

Monitoring Requests Requests will be processed automatically once the request file is

detected. The Partial File Retrieval service automatically detects the XML request file, appends the processed request to the queue of pending requests, and processes them in the order received. XML request files are moved to the status of the request.
success
or
fail
folder as appropriate based on the
Use the PFR status GUI to monitor requests, cancel pending or active requests or change the priority of the pending requests.
StorNext Timecode-Based Partial File Retrieval User’s Guide 5
Chapter 2: How Quantum Partial File Retrieval Works Partial File Retrieval Service
6 StorNext Timecode-Based Partial File Retrieval User’s Guide

Installation

Installation Components and Install Options

Quantum Partial File Retrieval consists of the following software components:
• PFR Control Server and Configuration GUI: This is the core of the
system and the tool that configures it
• PFR Transfer Engine: This is the engine that retrieves and creates
the partial file
• PFR Status GUI: This is the user application which allows
monitoring and modifying the queue of pending and in-progress retrievals
Chapter 3
• Index Engine and Configuration / Status GUI: This is the service
that indexes media files before they are truncated
• Virtual Machine (VM) with SNAPI and PFR Linux Component:
This is the interface to the StorNext API (SNAPI)
A typical installation of Quantum Partial File Retrieval installs all of the above components on a single Windows-based server machine. This is fine for most installations, but for larger installations the components can be distributed as follows:
• PFR Server: Includes "PFR Control Server and Configuration GUI" and
"VM w/ SNAPI and PFR Linux Component"
StorNext Timecode-Based Partial File Retrieval User’s Guide 7
Chapter 3: Installation Prerequisites
• PFR Client (aka Status GUI): Allows the PFR queues to be remotely
managed
• PFR Indexer: Includes "Index Engine and Configuration / Status
GUI". Would most likely be installed on its own on a separate machine when additional performance is required.
• PFR Transfer Engine: Again, would most likely be installed on its
own on a separate machine when additional performance is required.

Prerequisites

Operating Systems • When installing on a single machine or for any of the individual

components: Windows Server 2003 or Windows Server 2008, 32-bit or 64-bit.
• When installing the PFR Client (Status GUI) alone, this could also be installed on Windows XP or Windows Vista

StorNext The StorNext metadata controller must have Storage Manager and

StorNext API (SNAPI) installed.

VMWare The "VM w/ SNAPI and PFR Linux Component" is actually a small piece of

Linux software that provides the communications link between the PFR Server and the StorNext API. This is hosted in VMWare Server on the PFR Server machine.
VMWare Server should be installed and running prior to installing the Quantum PFR Components. You can find VMWare Server here:
http://www.vmware.com/products/server/
Note: When installing separate components on separate machines
for performance reasons, VMWare Server is required only on the Server machine onto which the PFR Server is installed.
8 StorNext Timecode-Based Partial File Retrieval User’s Guide
Loading...
+ 30 hidden pages
Buy Points How it Works FAQ Contact Us Questions and Suggestions Privacy Policy Cookie Policy Terms of Use