Business Objects products in this release may contain redistributions of software
licensed from third-party contributors. Some of these individual components may
also be available under alternative licenses. A partial listing of third-party
contributors that have requested or permitted acknowledgments, as well as required
notices, can be found at: http://www.businessobjects.com/thirdparty
2008-11-28
Contents
Introduction7Chapter 1
Welcome to Data Services..........................................................................8
Introduction to Metadata Reports..............................................................14
Data Services XI Release 3 provides data integration and data quality
processes in one runtime environment, delivering enterprise performance
and scalability.
The data integration processes of Data Services allow organizations to easily
explore, extract, transform, and deliver any type of data anywhere across
the enterprise.
The data quality processes of Data Services allow organizations to easily
standardize, cleanse, and consolidate data anywhere, ensuring that end-users
are always working with information that's readily available, accurate, and
trusted.
Documentation set for Data Services
You should become familiar with all the pieces of documentation that relate
to your Data Services product.
Information about available Data Services books,
languages, and locations
Highlights of key features in this Data Services release
Important information you need before installing and
deploying this version of Data Services
An introduction to Data Services
Information about and procedures for installing Data
Services in a Windows environment.
Introduction
Welcome to Data Services
What this document providesDocument
1
Installation Guide for UNIX
Advanced Development Guide
Designer Guide
Integrator's Guide
Management Console: Administrator
Guide
Management Console: Metadata Reports Guide
Migration Considerations Guide
Information about and procedures for installing Data
Services in a UNIX environment.
Guidelines and options for migrating applications including information on multi-user functionality and
the use of the central repository for version control
Information about how to use Data Services Designer
Information for third-party developers to access Data
Services functionality. Also provides information about
how to install, configure, and use the Data Services
Adapter for JMS.
Information about how to use Data Services Administrator
Information about how to use Data Services Metadata
Reports
Information about:
•Release-specific product behavior changes from
earlier versions of Data Services to the latest release
•How to migrate from Data Quality to Data Services
Performance Optimization Guide
Reference Guide
Data Services Management Console: Metadata Reports Guide9
Information about how to improve the performance
of Data Services
Detailed reference material for Data Services Designer
Introduction
1
Welcome to Data Services
Technical Manuals
What this document providesDocument
A compiled “master” PDF of core Data Services books
containing a searchable master table of contents and
index:
•
Getting Started Guide
•
Installation Guide for Windows
•
Installation Guide for UNIX
•
Designer Guide
•
Reference Guide
•
Management Console: Metadata Reports Guide
•
Management Console: Administrator Guide
•
Performance Optimization Guide
•
Advanced Development Guide
•
Supplement for J.D. Edwards
•
Supplement for Oracle Applications
•
Supplement for PeopleSoft
•
Supplement for Siebel
•
Supplement for SAP
Tutorial
A step-by-step introduction to using Data Services
In addition, you may need to refer to several Adapter Guides and
Supplemental Guides.
Information about how to install, configure, and use the Data
Services Salesforce.com Adapter Interface
Information about license-controlled interfaces between Data
Services and J.D. Edwards World and J.D. Edwards OneWorld
Information about the license-controlled interface between Data
Services and Oracle Applications
Information about license-controlled interfaces between Data
Services and PeopleSoft
Introduction
Welcome to Data Services
What this document providesDocument
1
Supplement for SAP
Supplement for Siebel
Information about license-controlled interfaces between Data
Services, SAP ERP, and SAP BI/BW
Information about the license-controlled interface between Data
Services and Siebel
Accessing documentation
You can access the complete documentation set for Data Services in several
places.
Accessing documentation on Windows
After you install Data Services, you can access the documentation from the
Start menu.
1. Choose Start > Programs > BusinessObjects XI 3.1 >
BusinessObjects Data Services > Data Services Documentation.
Note:
Only a subset of the documentation is available from the Start menu. The
documentation set for this release is available in LINK_DIR\Doc\Books\en.
2. Click the appropriate shortcut for the document that you want to view.
Accessing documentation on UNIX
After you install Data Services, you can access the online documentation by
going to the directory where the printable PDF files were installed.
1. Go to LINK_DIR/doc/book/en/.
2. Using Adobe Reader, open the PDF file of the document that you want
to view.
Data Services Management Console: Metadata Reports Guide11
Introduction
1
Welcome to Data Services
Accessing documentation from the Web
You can access the complete documentation set for Data Services from the
Business Objects Customer Support site.
1.
Go to http://help.sap.com.
2. Cick Business Objects at the top of the page.
You can view the PDFs online or save them to your computer.
Business Objects information resources
A global network of Business Objects technology experts provides customer
support, education, and consulting to ensure maximum business intelligence
benefit to your business.
Information about Customer Support programs,
as well as links to technical articles, downloads,
and online forums. Consulting services can
provide you with information about how Business Objects can help maximize your business
intelligence investment. Education services can
provide information about training options and
modules. From traditional classroom learning
to targeted e-learning seminars, Business Objects can offer a training package to suit your
learning needs and preferred learning style.
Get online and timely information about Data
Services, including tips and tricks, additional
downloads, samples, and much more. All content is to and from the community, so feel free
to join in and contact us if you have a submission.
Search the Business Objects forums on the
SAP Community Network to learn from other
Data Services users and start posting questions
or share your knowledge with the community.
Blueprints for you to download and modify to fit
your needs. Each blueprint contains the necessary Data Services project, jobs, data flows, file
formats, sample data, template tables, and
custom functions to run the data flows in your
environment with only a few modifications.
Data Services Management Console: Metadata Reports Guide13
Introduction
1
Introduction to Metadata Reports
http://help.sap.com/
ContentAddress
Business Objects product documentation.Product documentation
Documentation mailbox
documentation@businessobjects.com
Supported platforms documentation
https://service.sap.com/bosap-support
Send us feedback or questions about your
Business Objects documentation. Do you have
a suggestion on how we can improve our documentation? Is there something that you particularly like or have found useful? Let us know,
and we will do our best to ensure that your
suggestion is considered for the next release
of our documentation.
Note:
If your issue concerns a Business Objects
product and not the documentation, please
contact our Customer Support experts.
Get information about supported platforms for
Data Services.
In the left panel of the window, navigate to
Documentation > Supported Platforms >
BusinessObjects XI 3.1. Click the BusinessObjects Data Services link in the main window.
Introduction to Metadata Reports
This guide describes how to use the Data Services Web-based metadata
reporting tools. You can easily browse, analyze, and produce reports on the
metadata in your repositories.
Metadata Reports provides five applications for exploring your metadata.
•Impact and Lineage Analysis Reports—Allows you to easily browse,
analyze, and produce reports on the metadata for your Data Services
jobs as well as for other Business Objects applications associated with
Data Services
•Operational Dashboard Reports—Provides several standard graphical
dashboards that allow you to evaluate your job execution performance
at a glance
•Data Validation Dashboard Reports—Provide feedback that allows
business users to quickly review, assess, and identify potential
inconsistencies or errors in source data.
•Auto Documentation Reports—Offers a convenient way to create printed
documentation for the objects you create in Data Services by capturing
critical information so you can see an overview of the entire ETL process.
•Data Quality Reports—Allows you to view and export Crystal reports for
batch and real-time jobs that include statistics-generating transforms.
Report types include job summaries, transform-specific reports, and
transform group reports.
1
Data Services Management Console: Metadata Reports Guide15
This section describes the overall requirements for enabling and viewing
metadata reports including software and configuration requirements,
configuring the Metadata Integrator, and logging in to the Management
Console.
Requirements
Use the Data Services Administrator to configure repositories for metadata
reporting applications to access.
To make metadata reports available for Data Services objects, the metadata
reporting applications require:
•The Web Server service (which uses the Tomcat servlet engine)
•JDBC drivers to connect to a repository
•Configured Data Services repositories
•Installation and configuration of Metadata Integrator for impact and lineage
analysis on BusinessObjects Enterprise objects such as Universes and
Crystal Reports
To view impact and lineage analysis and auto documentation reports for the
following objects, you must install, configure, and run the Metadata Integrator:
•Business Views
•Crystal Reports
•Universes
•Desktop Intelligence documents
•Web Intelligence documents
Metadata Integrator scans definitions on your Business Objects Central
Management Server (CMS) to find the tables and columns used by the
reports, views, and documents. Metadata Integrator stores the collected
metadata in your Data Services repository for use by the impact and lineage
analysis and auto documentation applications.
2
Related Topics
•Impact and Lineage Analysis Reports on page 25
Repository reporting tables and views
The Data Services repository is a database that stores your application
components and the built-in Data Services design components and their
properties. The open architecture of the repository allows for metadata sharing
with other enterprise tools.
Within your repository, Data Services populates a special set of reporting
tables with metadata describing the objects in your repository. When you
query these tables, you can perform analyses on your Data Services
applications.
Data Services metadata reporting tables and views are listed in the following
table:
Data Services Management Console: Metadata Reports Guide19
Getting Started
2
Repository reporting tables and views
ContainsName
Attribute information about native objectsAL_ATTR
Audit information about each data flow executionAL_AUDIT
Information about audit statisticsAL_AUDIT_INFO
Components of a Business ViewAL_CMS_BV
AL_CMS_BV_FIELDS
AL_CMS_REPORTS
AL_CMS_REPORT
SUSAGE
AL_CMS_FOLDER
AL_CMS_UNV_OBJ
Business Fields within Business Elements in a Business
View
Information that uniquely identifies Crystal Reports,
Desktop Intelligence document, or Web Intelligence
documents
Tables, columns, Business Views, or Universes that a
Crystal Report, Desktop Intelligence Document, or Web
Intelligence Document uses
Folder names in which a Crystal Report, Desktop Intelligence Document, or Web Intelligence Document resides
Information that uniquely identifies UniversesAL_CMS_UNV
Universe classes and the child objects, with the source
column and table
Execution statistics about jobs and data flowsAL_HISTORY
Index information about imported tablesAL_INDEX
Information about native (.atl) Data Services objectsAL_LANG
Information about objects represented in XML formatAL_LANGXMLTEXT
Column information about imported table partitionsAL_PCOLUMN
Primary key information about imported tablesAL_PKEY
Rule name if it cannot fit it into AL_QD_VRULE (if there
is an overflow)
Runtime validation rule statisticsAL_QD_STATS
Sample row data for which the validation rules have
failed
All the column information for the failed validation rulesAL_QD_COLINFO
All ancestor-descendant relationships between Data
Services objects
Attribute information about imported columns
Information about imported column
Primary-foreign key relationships among imported tablesALVW_FKREL
Execution statistics about individual transforms within
data flows
Information about both native functions and functions
imported from external systems
Mapping and lineage information for target tablesALVW_MAPPING
ALVW_PAR
ENT_CHILD
Note:
Direct parent-child relationships between Data Services
objects
Option settings for all objectsAL_SETOPTIONS
Attribute information about imported (external) tablesALVW_TABLEATTR
Information about imported tablesALVW_TABLEINFO
This is not the complete list because some repository tables and views are
for internal use.
Data Services Management Console: Metadata Reports Guide21
Getting Started
2
About the Management Console
Data Services automatically creates reporting tables for each new or
upgraded repository. Except for AL_USAGE, Data Services automatically
updates all reporting tables.
The Metadata Integrator collects metadata for Crystal Reports, Business
Views, Universes, Desktop Intelligence document, and Web Intelligence
documents from the Central Management Server (CMS) and stores the
metadata in the Data Services reporting tables that start with AL_CMS.
Related Topics
•Adding Metadata Integrator on page 18
About the Management Console
The Management Console is a collection of Web-based applications for
administering Data Services jobs and services, viewing object relationships,
evaluating job execution performance and data validity, and generating data
quality reports.
•Administrator—Use to manage your production environment including
batch job execution, real-time services, Web services, adapter instances,
server groups, central and profiler repositories, and more. This applicaiton
is documented in the Data Services Management Console—AdministratorGuide.
The remaining Management Console applications are documented in the
Data Services Management Console—Metadata Reports Guide.
•Impact and Lineage Analysis—Use to analyze the end-to-end impact
and lineage for Data Services tables and columns and BusinessObjects
Enterprise objects such as universes, business views, and reports.
•Operational Dashboards—Use to view dashboards of Data Services
job execution statistics to see at a glance the status and performance of
your job executions for one or more repositories over a given time period.
•Data Validation Dashboards—Use to evaluate the reliability of your
target data based on the validation rules you created in your Data Services
batch jobs to quickly review, assess, and identify potential inconsistencies
or errors in source data.
•Auto Documentation—Use to view, analyze, and print graphical
representations of all objects as depicted in Data Services Designer
including their relationships, properties, and more.
•Data Quality Reports—Use to view and export reports for batch and
Logging in
To access the metadata reporting applications, first log in to the Data Services
Management Console. The first time you log in to the Management Console,
use the default user name and password (admin/admin). Business Objects
recommends that you change the defaults thereafter by updating user roles
in the Data Services Administrator.
1. The first step depends on your operating system.
Getting Started
About the Management Console
real-time jobs such as job summaries and data quality transform-specific
reports.
•On Windows, click the Start menu and select Programs >
BusinessObjects XI 3.1 > BusinessObjects Data Services > Data
Services Management Console.
If you encounter an error, check to see whether the Data Services
Web Server service is installed and running. If the Web Server service
is running but you cannot log in, see the Troubleshooting section of
the Data Services Administrator Guide.
2
•On UNIX or Windows, open a browser, enter the following
case-sensitive URL, then press Enter:
http://hostname:28080/DataServices/
2. Enter the default user name (admin) and password (admin) and click Log
in.
The Management Console home page opens.
3. To launch one of the metadata reporting applications, click its icon (or
name).
If you are logged in to the Designer, you can also access the Management
Console home page as follows:
•From the Start page, click Data Services Management Console.
•From the Tools menu, click Data Services Management Console.
•Click the Data Services Management Console tool bar icon.
Data Services Management Console: Metadata Reports Guide23
Getting Started
2
About the Management Console
Management Console navigation
After you log in to the Management Console and launch one of the
applications, the application name appears under the Management Console
banner.
The upper-right side of the main window includes the following links:
•Home—Click to return to the Management Console home page (for
example to select another application).
•Settings—Use the Settings control panel for changing a variety of options
depending on the application.
•Logout—Click to exit the application and the Management Console and
return to the login page.
•
Help icon—Click to open the Data Services Management Console:
Administrator Guide or the Data Services Management Console: Metadata
Reports Guide, depending on which application you have open.
As you navigate around the applications, notice the top of the right-hand
pane often displays a "bread crumb" path to indicate where you are in the
application. Depending on the page displayed, sometimes you can click on
the bread crumbs to navigate to a different part of the application.
The Administrator, Impact and Lineage Analysis, and Auto Documentation
applications also use a navigation tree in the left-hand pane.
Data Services Management Console sessions time out after 120 minutes (2
hours) of inactivity.
The Impact and Lineage Analysis application provides a simple, graphical,
and intuitive way to view and navigate through various dependencies between
objects.
Impact and lineage analysis allows you to identify which objects will be
affected if you change or remove other connected objects.
For example for impact analysis, a typical question might be, “If I drop the
source column Region from this table, which targets will be affected?”
For lineage analysis, the question might be, “Where does the data come
from that populates the Customer_ID column in this target?”
In addition to the objects in your Data Services datastores, impact and lineage
analysis allows you to view the connections to other objects including
Universes, classes and objects, Business Views, Business Elements and
Fields, and reports (Crystal Reports, Desktop Intelligence documents, and
Web Intelligence documents).
Navigation
From the Management Console home page, view impact and lineage
information by clicking the Impact and Lineage Analysis link.
The Impact and Lineage Analysis page contains two primary panes:
•The left pane contains a hierarchy (tree) of objects. The top of the tree is
the default repository. This pane also includes a search tool.
•The right pane displays object content and context based on how you
navigate in both panes.
In general, expand the tree in the left pane by clicking plus signs (+) next to
object nodes. Select an object in the tree to learn more about it. Details
associated with an object appear in the right pane on one or more tabs. Tabs
vary depending on the object you select.
The top level of the navigation tree displays the current repository. (You can
change this repository in the Settings control panel; for details, see Impact
and Lineage Analysis Settings control panel on page 36.)
Objects in a repository include:
•Datastores—Contain Data Services tables and columns
CMS server(s)—After you configure the Metadata Integrator (see Adding
Metadata Integrator on page 18), this node contains folders as defined
in the Business Objects Central Management Console, Universes, and
Business Views.
The Universe node displays classes, and each class contains objects.
Business Views contain Business Elements, and each Business Element
has Business Fields. Any object can contain one or more reports.
To narrow the view of objects to display in the navigation tree or to quickly
find specific objects in the repository, use the Objects to analyze search
feature. You can do one or both of the following:
1. Select a category in the Select an object type drop-down list:
•Table and column
•Universe
•Class and object
•Business view
•Element and field
3
•Report
AND/OR
2. Search for a specific object by typing all or part of the object name in the
search field. The search field is not case sensitive, spaces are allowed,
and you can use the percent symbol (%) as a wildcard.
3. Click the search icon (binoculars).
Metadata Reports highlights with a red border each object that meets your
search criteria.
•To repopulate the CMS navigation tree with any objects that might have
been changed (added, deleted, renamed, and so on) in the CMS repository
after you display an impact and lineage report, log out and log back in to
the Management Console to display the changes.
•If you receive an error such as the following:
This image is scaled to 50% of the original image. You could
avoid scaling the image by allocating more memory to the
current java process.
Data Services Management Console: Metadata Reports Guide27
Impact and Lineage Analysis Reports
3
Navigation
it means the java process (JVM) does not have enough memory to process
the current task. Circumvent this error by allocating more heap memory
to the Java process associated with the Data Services Web server.
To increase the java heap memory in Windows
1. In the Windows Services control panel, stop the Data Services Web
Server.
2. In the Data Services installation directory, navigate to \ext\WebServer\conf.
3. Using a text editor, open the wrapper.properties file.
4. To allocate a minimum of 256 MB and a maximum of 512 MB to the java
process, add the following parameters to wrapper.cmd_ line:
The following table lists the types of objects that can appear in the navigation
tree and provides a summary of what information appears in the right pane
when you select that object type.
To view or hide a pane in the display such as an attributes pane, click the
up/down arrow in its header bar.
Moving the cursor over an object displays a pop-up window with more
information about that object; for example:
•Table—Data flow (if applicable), datastore, and owner
•Business Objects report—Depending on the report type, the pop-up
window displays the CMS server name, the Business View name, or the
Universe name, for example.
•Universe objects—CMS server, universe, and class
The following table lists the objects in the navigation tree, the corresponding
tabs, and the content of each.
Impact and Lineage Analysis Reports
Analysis options
3
Associated contentTabObject
OverviewRepository
Data Services Management Console: Metadata Reports Guide29
Repository name
Repository type—The database type
Repository version—The repository version
number
Impact and Lineage Analysis Reports
3
Analysis options
Associated contentTabObject
OverviewDatastore
OverviewTable
Overview information varies depending on the
datastore type. The following entries apply to a
datastore on Microsoft SQL Server.
Application type—Database
Database type—Microsoft_SQL_Server
User—Database user name
Case sensitive—Whether or not the database is
case sensitive
Configuration—The configuration select-
ed in the datastore editor
SQL_Server version—Microsoft SQL Server
2000
Database name—Database name
Server name—The host computer name
Table name—Table name
Datastore—Datastore to which this table belongs
Owner name—The table owner name in the
database.
Business name—Business-use name of the table
if defined