Business objects DATA INTEGRATOR 11.0.1 User Manual

Data Integrator Getting Started Guide

Data Integrator 11.0.1

for Windows and UNIX

If you find any problems with this documentation, please report them to Business Objects S.A. in writing at documentation@businessobjects.com.

Trademarks

Patents

Business Objects, the Business Objects logo, Crystal Reports, and Crystal Enterprise are trademarks or registered trademarks of Business Objects SA or its affiliated companies in the United States and other countries. All other names mentioned herein may be trademarks of their respective owners.

Business Objects owns the following U.S. patents, which may cover products that are offered and sold by Business Objects: 5,555,403, 6,247,008 B1, 6,578,027 B2, 6,490,593 and 6,289,352.

2 Data Integrator Getting Started Guide

Chapter 1 Welcome 9

Audience and assumptions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

Data Integrator product documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

Suggested reading path . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

Chapter 2 Introducing the Data Integration Platform 15

Business Objects Data Integration Platform . . . . . . . . . . . . . . . . . . . . . . . 16

Data Integrator product benefits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

Single point of integration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

High availability and performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

Packaged data access through Rapid Marts . . . . . . . . . . . . . . . . . . . . 18

Data Integrator interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

Data Integrator functional summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

Loading data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

Applying transactions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

Chapter 3 Data Integrator Architecture 23

Standard Data Integrator components . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24

Data Integrator Job Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25

Data Integrator engine . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25

Data Integrator Designer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25

Data Integrator repository . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

Data Integrator Access Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

Data Integrator Administrator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27

Data Integrator Metadata Reporting tool . . . . . . . . . . . . . . . . . . . . . . . 27

Data Integrator Web Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28

Data Integrator Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28

Data Integrator SNMP Agent . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29

Data Integrator Adapter SDK . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29

Data Integrator Getting Started Guide 3

Contents

Optional Data Integrator components . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29

Data Integrator Multi-user . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29

Data Integrator management tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30

License Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30

Repository Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30

Server Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30

Data Integrator operating system platforms . . . . . . . . . . . . . . . . . . . . . . . . 31

Data Integrator distributed architecture . . . . . . . . . . . . . . . . . . . . . . . . . . . .31

Resource distribution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .32

Network security options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33

Data warehouse with external Web server in DMZ . . . . . . . . . . . . . . . .33

Firewall between data warehouse and external Web server . . . . . . . .34

Application server behind a firewall . . . . . . . . . . . . . . . . . . . . . . . . . . . .35

Access validation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36

Host names and port numbers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37

Chapter 4 Preparing to Install Data Integrator 39

System installation overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40

System requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43

Data Integrator repository requirements . . . . . . . . . . . . . . . . . . . . . . . .44

Database requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45

Data Integrator Designer requirements . . . . . . . . . . . . . . . . . . . . . . . . .47

Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47

Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47

Data Integrator Job Server requirements . . . . . . . . . . . . . . . . . . . . . . . 47

Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47

Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48

Data Integrator Access Server requirements . . . . . . . . . . . . . . . . . . . .48

Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48

Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48

Data Integrator Administrator requirements . . . . . . . . . . . . . . . . . . . . .49

Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49

Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49

4 Data Integrator Getting Started Guide

Contents

Web applications communicating with Data Integrator . . . . . . . . . . . . 49

Pre-installation tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49

Determine component distribution . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50

Obtain license keys . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52

Check port assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52

Create a database for each repository . . . . . . . . . . . . . . . . . . . . . . . . . 54

Check network connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55

Data Integrator licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55

License types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55

Unrestricted . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56

Restricted . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56

Evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56

Emergency . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56

Permanent . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57

Optional license-controlled features . . . . . . . . . . . . . . . . . . . . . . . . . . . 57

Managing your licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58

Obtaining your license files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58

Viewing current license information . . . . . . . . . . . . . . . . . . . . . . . . . . . 60

Viewing previously-generated license files . . . . . . . . . . . . . . . . . . . . . 60

Repository database information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60

For DB2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61

For Informix . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61

For Microsoft SQL Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62

For Oracle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62

For Sybase ASE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63

Chapter 5 Upgrading Data Integrator 65

Upgrade paths . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66

Data Integrator component upgrades . . . . . . . . . . . . . . . . . . . . . . . . . 66

Repository upgrades . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66

Upgrading to a multi-user development environment . . . . . . . . . . . . . 67

Upgrading your Data Integrator system . . . . . . . . . . . . . . . . . . . . . . . . . . . 67

Using configurations from a previous version . . . . . . . . . . . . . . . . . . . 68

Data Integrator Getting Started Guide 5

Contents

Uninstall existing product version(s) . . . . . . . . . . . . . . . . . . . . . . . . . . .69

Install a new version . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .70

Upgrading repositories . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72

After upgrading Data Integrator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73

Unsuccessful upgrade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .73

Successful upgrade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .73

Chapter 6 Installing Data Integrator on Windows Systems 75

Running the installation program . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .76

Installing Designer, Job Servers, and Access Servers . . . . . . . . . . . . .76

Verifying that Job and Access Servers are running . . . . . . . . . . . . . . . 85

Installing and Configuring the Metadata Integrator . . . . . . . . . . . . . . . . 85

Installing Metadata Integrator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85

Installation tips and troubleshooting . . . . . . . . . . . . . . . . . . . . . . . .86

Configuring the Metadata Integrator . . . . . . . . . . . . . . . . . . . . . . . .87

Starting Data Integrator services automatically . . . . . . . . . . . . . . . . . . .89

Logging in to the Administrator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .90

Configuring repositories after installation . . . . . . . . . . . . . . . . . . . . . . . . . . 90

Creating or upgrading repositories in batch mode . . . . . . . . . . . . . . . . 90

Configuring Job Servers or Access Servers after installation . . . . . . . . . . .91

Recovering from installation errors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92

Repository problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92

Administrator problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92

Verifying connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .93

Distributing the test files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .93

Testing a job . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .94

Testing the path from client to service . . . . . . . . . . . . . . . . . . . . . . . . .96

Configuring the Access Server . . . . . . . . . . . . . . . . . . . . . . . . . . . .96

Web client to Access Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . .98

Further connectivity tests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99

Updating licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .100

Installing Message Client libraries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .100

Using the Message Client library . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101

6 Data Integrator Getting Started Guide

Contents

Interface components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101

Creating the connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102

Sending messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102

Closing the connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103

Pseudo code example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103

C++ language interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104

Java language interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104

COM interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105

Connect . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106

Invoke . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107

Disconnect . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108

ReturnValue . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109

ErrorMessage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110

ErrorStatus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111

Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112

Chapter 7 Installing Data Integrator on UNIX Systems 113

Additional system requirements for UNIX . . . . . . . . . . . . . . . . . . . . . . . . 114

Hardware requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114

Software requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114

Cron service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115

User IDs and permissions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115

High-availability support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116

About HACMP software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116

Using Data Integrator with HACMP software . . . . . . . . . . . . . . . 117

Kernel parameters and user resource limits . . . . . . . . . . . . . . . . . . . . . . 120

HP-UX for PA-RISC 32 bit kernel configuration . . . . . . . . . . . . . . . . . 120

HP-UX for Itanium 64 bit kernel configuration . . . . . . . . . . . . . . . . . . 121

AIX user resource limits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122

Solaris user resource limits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122

Linux user resource limits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 123

Installing Job Servers and Access Servers . . . . . . . . . . . . . . . . . . . . . . . 123

Locales . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128

Data Integrator Getting Started Guide 7

Contents

Setting Data Integrator environment variables . . . . . . . . . . . . . . . . . .128

Configuring the Data Integrator Web Server . . . . . . . . . . . . . . . . . . . .129

Configuring Job Servers and Access Servers . . . . . . . . . . . . . . . . . . . 130

Starting AL_JobService at restart . . . . . . . . . . . . . . . . . . . . . . . . .137

Verifying that Job Servers, Access Servers, and the SNMP agent are

running . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 138

Updating licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .138

Uninstalling Data Integrator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .139

Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .139

Designer-Job Server connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . .140

Server Manager problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .140

Administrator connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .141

Memory issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .141

Threading issues . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .142

Appendix A Citrix Support 143

Definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .144

Installing Data Integrator on a MetaFrame Server . . . . . . . . . . . . . . . . . .145

Initial Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .145

Rebooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .145

Running Data Integrator components in multi-user mode . . . . . . . . . . . . .146

Serial access to the License, Server, and Repository Managers . . . . 146

Parallel access to the Administrator and Designer . . . . . . . . . . . . . . .146

Using a shell script to access the Designer . . . . . . . . . . . . . . . . . . . .146

Sample batch file: Example 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . 147

Sample batch files: Example 2 . . . . . . . . . . . . . . . . . . . . . . . . . . .149

Directory structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .151

Publishing Data Integrator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .152

Connection management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .154

Client setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 154

Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 154

Index 157

8 Data Integrator Getting Started Guide

Data Integrator Getting Started Guide

Welcome

chapter

Welcome

Audience and assumptions

This guide provides an overview of the BusinessObjects™ Data Integrator Platform and architecture. It also describes how to upgrade and install Data Integrator.

With Data Integrator you can:

• Easily build and execute batch processing applications that create and

update a data warehouse.

• Combine batch capabilities with request-response processing logic and

message handling to support e-commerce and its data integration requirements.

This chapter covers the following topics:

• Audience and assumptions

• Data Integrator product documentation

Audience and assumptions

This and other Data Integrator product documentation assumes that:

• You are an application developer, consultant, or database administrator

working on data extraction, data warehousing, or data integration.

• You understand your source data systems, RDBMS, business

intelligence, and e-business messaging concepts.

• You understand your organization’s data needs.

• You are familiar with SQL (Structured Query Language).

• You are familiar enough with Microsoft Windows or UNIX platforms to

effectively install Data Integrator.

Data Integrator product documentation

Data Integrator documentation is provided in PDF format on the Data Integrator CD. You can read the PDF files with the latest version of Adobe Acrobat Reader (download instructions at the Adobe website).

If you install the Data Integrator documentation (recommended), you can open it in two ways:

• Select Start > Programs > BusinessObjects Dat a Integra tor version>

Data Integrator Documentation.

• Go to the Help menu in the Data Integrator Designer or Administrator.

Using either method, you can open any of the following:

10 Data Integrator Getting Started Guide

Welcome

Data Integrator product documentation

• Release Notes

• Release Summary

• Technical Manuals

The following technical documentation is currently available:

• Data Integrator Release Summary and Data Integrator Release Note s —

Provide the latest information about the product including information that was not available when the other documents were published.

• Data Integrator Technical Manuals include:

• Data Integrator Getting S tarted Guide — Introduces the features and

benefits of using Data Integrator. This guide explains Data Integrator architecture and how to install the product including system requirements and pre-installation preparation that will help you understand dependencies between Data Integrator and your computing environment.

• Data Integrator Designer Guide — Provides conceptual and

procedural information for designing, developing, and implementing applications using the Data Integrator Designer.

• Data Integrator Administrator Guide — Provides conceptual and

procedural information for scheduling and monitoring batch jobs as well as configuring and administering real-time jobs. Explains the Data Integrator Administrator features.

• Data Integrator Reference Guide — Provides detailed information

about Data Integrator Designer objects, data types and expressions, transforms, functions, and user exits.

• Data Integrator Advanced Development and Migration Guide —

Discusses how to migrate Data Integrator applications through development phases and includes multi-user development concepts and procedures.

• Data Integrator Performance Optimization Guide — Provides

information about improving the performance of your Data Integrator environment and the Designer options you can use to reduce job run-times by measuring and tuning performance. Includes documentation on bulk loading and parallel execution.

• Data Integrator Supplement for J.D. Edwards — Provides

information about using Data Integrator to extract data from J.D. Edwards World and J.D. Edwards OneWorld.

• Data Integrator Supplement for Oracle Applications — Provides

information about using Data Integrator to extract data from Oracle Applications.

Data Integrator Getting Started Guide 11

Welcome

Introducing the Data Integration Platform

chapter

Introducing the Data Integration Platform

Business Objects Data Integration Platform

This chapter introduces the benefits and functionality of the Business Objects Data Integration Platform. Topics include:

• Business Objects Data Integration Platform

• Data Integrator product benefits

• Data Integrator interfaces

• Data Integrator functional summary

Business Objects Data Integration Platform

True data integration requires intelligent data caching that blends batch extraction, transformation, and loading (ETL) technology with real-time bidirectional data flow across multiple applications for the extended enterprise. By building a relational data store and intelligently blending direct real-time and batch data-access methods for accessing data from enterprise resource planning (ERP) systems, Business Objects has created a powerful, highperformance data integration platform that allows businesses to fully leverage their ERP and enterprise application infrastructure for multiple uses.

Business Objects provides the industry’s first and only real-time data integration platform to drive today’s new generation of real-time analytic, supply-chain management and sell-side e-business applications. With Business Objects’ highly scalable data platform, enterprises can maintain a real-time, on-line dialogue with customers, suppliers, employees, and partners, providing them with the critical information they need for transactions and business analysis.

The Data Integration Platform consists of BusinessObjects™ Data Integrator, an award-winning data movement-and-management server, and BusinessObjects™ Rapid Marts, a suite of packaged applications that speed the delivery and integration of back-office data in the areas of sales and marketing, finance and operations, inventory and purchasing, as well as manufacturing and distribution.

16 Data Integrator Getting Started Guide

Introducing the Data Integration Platform

Data Integrator product benefits

The Business Objects Data Integration Platform enables you to develop enterprise data integration for batch and real-time uses.

• Create a single infrastructure for batch and real-time data movement to

enable faster and lower cost implementation.

• Your enterprise can manage data as a corporate asset independent of

any single system. Integrate data across many systems and reuse that data for many purposes.

• Use pre-packaged data solutions for fast deployment and quick ROI.

These solutions extract historical and daily data from operational systems and cache this data in open relational databases.

Data Integrator and Rapid Marts combine to create a data integration platform for traditional data warehouse applications and for integrating across a variety of enterprise applications. Data Integrator customizes and manages data access and uniquely combines industry-leading, patent-pending technologies to deliver data to analytic, supply-chain management, customer relationship management, and Web applications. Rapid Marts provide pre-packaged data

Data Integrator Getting Started Guide 17

Introducing the Data Integration Platform

Data Integrator product benefits

content, balancing batch and real-time data movement to deliver the highperformance, scalable information flow required across the extended enterprise.

Single point of integration

Data Integrator combines both batch and real-time data movement and management with intelligent caching to provide a single data integration platform for information management from any information source, for any information use.

This unique combination allows you to:

• Stage data in an operational data store, data warehouse, or data mart.

• Update staged data in batch or real-time modes.

• Direct XML-based requests (queries or updates) to the staged data or

directly to back-office systems. User-specified rules control request routing.

• Create a single graphical development environment for developing,

testing, and deploying the entire data integration platform.

• Manage a single metadata repository to capture the relationships

between different extraction and access methods and provide integrated lineage and impact analysis.

High availability and performance

Data Integrator’s high-performance engine and proven data movement and management capabilities provide:

• A high-performance, scalable, multi-instance data-movement engine for

fast execution

• 24x7 data availability to ensure the data loads do not affect the

performance and correctness of the active data warehouse

Packaged data access through Rapid Marts

Business Objects’ expertise in providing critical data to information users has resulted in the creation of pre-packaged data applications with functional content (data and business logic) for many specific areas within an enterprise, enabling:

• Flexible access to historical data and real-time information

• Packaged data staging for internal and external users

18 Data Integrator Getting Started Guide

• Quick deployment and implementation for fast ROI

• Easy customization for specific business or information requirements

Data Integrator interfaces

Data Integrator provides many interfaces. These interfaces are:

• Data-level read/write interfaces using SQL:

Oracle DB2/UDB DB2/UDB via DB2Connect to MVS DB2/UDB via DB2Connect to AS/400 MS SQL Server Informix IDS ODBC to generic databases Sybase ASE Sybase IQ Teradata

• Data-level read/write interfaces using Business Objects mainframe bulk

interface:

ADABAS Datacom DB2/UDB IDMS IMS Sequential files VSAM

Introducing the Data Integration Platform

Data Integrator interfaces

Data Integrator Getting Started Guide 19

Introducing the Data Integration Platform

Data Integrator functional summary

• Application-level interfaces (read/write and batch/real-time unless

otherwise specified):

• Technology read/write real-time interfaces:

You can use the Data Integrator Interface Development Kit to develop adapters that read from and/or write to other applications.

In addition to the interfaces listed above, the Data Integrator Nested Relational Data Model (NRDM) allows you to apply the full power of SQL transforms to manipulate, process, and enrich hierarchical business documents. For more information, see Chapter 9: Nested Data, in the Data Integrator Designer Book.

SAP R/3 ABAP (batch, read only) SAP R/3 IDoc SAP R/3 RFC/BAPI SAP BW (batch) J.D. Edwards One World or World (batch) PeopleSoft interface (batch) Siebel Application (batch) Oracle Application (batch)

HTTP/HTTPS IBM MQSeries Java Message Service (JMS) SNMP Trilium Web Services

Data Integrator functional summary

Data Integrator performs three key functions that can be combined to create a scalable, high-performance data platform:

• Loading data — Populate ERP or enterprise application data into an

operational data store (ODS) or analytical data warehouse, and update in batch and/or real-time.

• Applying transactions — Apply transactions against ERP systems.

20 Data Integrator Getting Started Guide

Loading data

Data mappings and transformations can be specified using the Data Integrator Designer graphical user interface. Data Integrator automatically generates the appropriate interface calls to access the data in the source system.

For most ERP applications, Data Integrator generates SQL optimized for the specific target database (Oracle, DB2, SQL Server, Informix, and so on). To perform batch data extraction against SAP R/3, Data Integrator generates optimized ABAP, eliminating the need to develop and maintain customized ABAP code.

Automatically generated optimized code reduces the cost of maintaining data warehouses and enables you to build data solutions quickly, meeting user requirements faster than other methods (for example custom-coding, directconnect calls, or PL/SQL).

Introducing the Data Integration Platform

Data Integrator functional summary

Data Integrator can process a variety of real-time data interactions: XML messages, XML files, EAI messages, flat files, SQL updates, HTTP, and SAP real-time interfaces (for example outbound IDocs). These data formats can be used to update a target data warehouse and a variety of source systems in sequence. These transactions can be enriched with other source system data as specified in a real-time job design.

Having a single data integration platform that can manage the breadth of systems found in today’s heterogeneous IT environments enables IT departments to easily manage corporate data as an enterprise-wide asset.

Data Integrator Getting Started Guide 21

Introducing the Data Integration Platform

Data Integrator functional summary

The automatic code generation reduces ongoing maintenance costs and resource requirements, allowing these resources to be deployed against other critical IT projects.

Applying transactions

Data Integrator can apply data changes in a variety of data formats (see “Data

Integrator interfaces” on page 19) and any custom format using a Data

Integrator adapter. Enterprise customers can apply data changes against multiple back-office systems singularly or in sequence. By generating calls native to the system in question, Data Integrator makes it unnecessary to develop and maintain customized code to manage the process. You can design access intelligence into each transaction by adding flow logic that checks values in a data warehouse or in the transaction itself before running a transaction directly against the target ERP system.

22 Data Integrator Getting Started Guide

Data Integrator Getting Started Guide

Data Integrator Architecture

chapter

Data Integrator Architecture

Standard Data Integrator components

This chapter describes Data Integrator components and their distribution on your network.

This chapter contains the following topics:

• Standard Data Integrator components

• Optional Data Integrator components

• Data Integrator management tools

• Data Integrator operating system platforms

• Data Integrator distributed architecture

• Network security options

The Data Integrator architecture is layered to allow data integration to occur over a variety of open, industry-standard APIs for optimal data and metadata management.

Standard Data Integrator components

Data Integrator includes the following standard components:

• Data Integrator Job Server

• Data Integrator engine

• Data Integrator Designer

• Data Integrator repository

• Data Integrator Access Server

• Data Integrator Administrator

• Data Integrator Metadata Reporting tool

• Data Integrator Web Server

• Data Integrator Service

• Data Integrator SNMP Agent

• Data Integrator Adapter SDK

The following diagram summarizes the relationships between these components.

24 Data Integrator Getting Started Guide

Data Integrator Job Server

The Data Integrator Job Server starts the data movement engine that integrates data from multiple heterogeneous sources, performs complex data transformations, and manages extractions and transactions from ERP systems. The Data Integrator Job Server can move data in either batch or real-time mode and uses distributed query optimization, multi-threading, inmemory caching, in-memory data transformations, and parallel pipelining to deliver high data throughput and scalability.

Data Integrator Architecture

Standard Data Integrator components

Data Integrator engine

When Data Integrator jobs are executed, the Job Server starts Dat a Integrator engine processes to perform data extraction, transformation, and movement. Data Integrator engine processes use parallel pipelining and in-memory data transformations to deliver high data throughput and scalability.

Data Integrator Designer

The Designer is a development tool with a unique graphical user interface. It enables developers to define data management applications that consist of data mappings, transformations, and control logic

Data Integrator Getting Started Guide 25

Data Integrator Architecture

Standard Data Integrator components

Use the Designer to create applications containing work flows (job execution definitions) and data flows (data transformation definitions).

To use the Designer, create objects, then drag, drop, and configure them by selecting icons in flow diagrams, table layouts, and nested workspace pages. The objects in the Designer represent metadata. The Designer interface allows you to manage metadata stored in a Data Integrator repository. From the Designer, you can also trigger the Job Server to run your jobs for initial application testing.

Data Integrator repository

The Data Integrator repository is a set of tables that hold user-created and predefined system objects, source and target metadata, and transformation rules. It is set up on an open client/server platform to facilitate sharing metadata with other enterprise tools. Each repository is stored on an existing RDBMS.

Each repository is associated with one or more Data Integrator Job Servers. Job Servers run jobs. When you are designing a job, you can run it from the Designer. The Designer tells the Job Server to run the job. The Job Server gets the job from its associated repository and then starts an engine to process the job. During production, the Job Server runs jobs triggered by a scheduler or by a real-time service managed by an Access Server. In production environments, you can balance job loads by creating a Job Server Group (multiple Job Servers) which executes jobs according to overall system load.

There are two types of repositories:

• A local repository is used by an application designer to store definitions of

Data Integrator objects (like projects, jobs, work flows, and data flows) and source/target metadata.

• A central repository is an optional component that can be used to support

multi-user development. The central repository provides a shared object library allowing developers to check objects in and out of their local repositories.

Data Integrator Access Server

The Access Server is a real-time, request-reply message broker that collects message requests, routes them to a real-time service, and delivers a message reply within a user-specified time frame. The Access Server queues messages and sends them to the next available real-time service across any number of computing resources. This approach provides automatic scalability

26 Data Integrator Getting Started Guide

because the Access Server can initiate additional real-time services on additional computing resources if traffic for a given real-time service is high. You can configure multiple Access Servers.

Data Integrator Administrator

The Administrator provides browser-based administration of Data Integrator resources including:

• Scheduling, monitoring, and executing batch jobs

• Configuring, starting, and stopping real-time services

• Configuring Job Server, Access Server, and repository usage

• Configuring and managing adapters

• Managing users

• Publishing batch jobs and real-time services via Web services

Data Integrator Metadata Reporting tool

This powerful tool provides browser-based reports on Enterprise metadata stored in the Data Integrator repository. Reports include:

• Repository summary — View reports on all projects, jobs, work flows,

data flows, datastores, custom transforms, file formats, and custom functions in your repository

• Datastore analysis — For each datastore connection, view overview,

table, function, and hierarchy reports. Data Integrator users can determine:

• What data sources populate their tables

• What target tables their tables populate

• Which of the following Business Intelligence reports use data from

their tables:

• Business Views

• Crystal Reports

• Universes

• Web Intelligence documents used by Crystal Reports

• Operational statistics — Investigate job and dataflow execution

statistics. Includes graphical reports.

Data Integrator Architecture

Standard Data Integrator components

Data Integrator Getting Started Guide 27

Data Integrator Architecture

Standard Data Integrator components

• Business Views Analysis — View the data sources for Business Views

in the Central Management Server (CMS). You can view business element and business field lineage reports for each Business View. Crystal Business View users can determine what data sources populate their Business Views and what reports use their views.

• Business Objects Universe Analysis — View Universe, class, and

object lineage. Universe users can determine what data sources populate their Universes and what reports use their Universes.

• Report Analysis — View data sources for reports in the Central

Management Server (CMS). You can view table and column lineage reports for each Crystal Report and Web Intelligence Document managed by CMS. Report writers can determine what data sources populate their reports.

• Dependency Analysis — Search for specific objects in your repository

and understand how those objects impact or are impacted by other Data Integrator or Business Objects Universe objects and reports. Metadata search results provide links back into associated reports.

Use Metadata Reporting Tools to configure your Business Objects connections as well as refresh repository information by calculating dependencies and column mappings.

In addition, the Metadata Integrator allows Data Integrator to seamlessly share metadata with Business Objects Intelligence products.

Note: Y ou must run the Met adat a Integrator to collect metadat a into the Data

Integrator repository for Business Views, Crystal Reports, Universes, and Web Intelligence documents used by Crystal Reports and Web Intelligence documents.

Data Integrator Web Server

The Data Integrator Web Server supports browser access to the Administrator and the Metadata Reporting tool. The Windows service name for this server is Data Integrator Web Server. The UNIX equivalent is the AL_JobService. Both use a Tomcat servlet engine to support browser access.

Data Integrator Service

The Data Integrator Service is installed when Data Integrator Job and Access Servers are installed. The Data Integrator Service starts Job Servers and Access Servers when you restart your system. The Windows service name is Data Integrator Service. The UNIX equivalent is a daemon named AL_JobService.

28 Data Integrator Getting Started Guide

Data Integrator SNMP Agent

Data Integrator error events can be communicated using SNMP-supported applications for better error monitoring. Install a Data Integrator SNMP (simple network management protocol) agent on any computer running a Job Server. The Data Integrator SNMP agent monitors and records information about the Job Servers and jobs running on the computer where the agent is installed. You can configure NMS (network management software) applications to communicate with the Data Integrator SNMP agent. Thus, you can use your NMS application to monitor the status of Data Integrator jobs.

Data Integrator Adapter SDK

The Data Integrator Adapter SDK provides a Java platform for rapid development of adapters to other applications and middleware products such as EAI systems. The adapters use industry-standard XML and Java technology to eliminate the learning curve. The adapters provide all necessary styles of interaction including:

• reading, writing, and request-reply from Data Integrator to the other

systems.

• request-reply from the other systems to Data Integrator.

For detailed information, see the Data Integrator Adapter SDK User’s Guide in your Data Integrator installation directory/Adapters/SDK/Doc.

Data Integrator Architecture

Optional Data Integrator components

Optional extra components include:

• Data Integrator Multi-user

Data Integrator Multi-user

Data Integrator Multi-user is an advanced optional component that enables your development team to work together on interdependent parts of an application through all phases of development. While each user works on applications in a unique local repository, the team uses a central repository to store the master copy of the entire project. The central repository preserves all versions of an application’s objects, so you can revert to a previous version if needed.

Data Integrator Getting Started Guide 29

Data Integrator Architecture

Data Integrator management tools

Multi-user development includes other advanced features such as labeling and filtering to provide you with more flexibility and control in managing application objects.

See the Data Integrator Advanced Development and Migration Guide for more details.

Data Integrator management tools

Data Integrator has several management tools that assist in managing your Data Integrator components.

License Manager

The License Manager displays the Data Integrator components for which you currently have a license.

Repository Manager

The Repository Manager allows you to create, upgrade, and check the versions of local and central repositories.

Server Manager

The Server Manager allows you to add, delete, or edit the properties of Job Servers and Access Servers. It is automatically installed on each computer on which you install a Job Server or Access Server.

Use the Server Manager to define links between Job Servers and repositories. You can link multiple Job Servers on different machines to a single repository (for load balancing) or each Job Server to multiple repositories (with one default) to support individual repositories (separating test from production, for example).

You can also specify a Job Server as SNMP-enabled. For more information see “SNMP support” on page 549 of the Data Integrator Designer Guide.

The Server Manager is also where you specify SMTP server settings for the smtp_to email function. For details, see “To define and enable the smtp_to

function” on page 527 of the Data Integrator Reference Guide.

30 Data Integrator Getting Started Guide

Data Integrator Architecture

Data Integrator operating system platforms

Data Integrator Designer runs on the following Windows platforms:

• 2000 Professional

• 2000 Server

• 2000 Advanced Server

• 2000 Datacenter Server

• XP

• 2003

All other Data Integrator components run on the above Windows platforms and the following UNIX platforms:

• Solaris 2.8, and 2.9 (Sun OS releases 5.7, 5.8, and 5.9)

• HP-UX version 11.00 (PA_RISC 2.0), and 11.1

• HP-UX Itanium 64-bit 11.23

• IBM AIX 5.1, 5.2, and 5.3

• Red Hat Enterprise Linux AS 3.0

Refer to your Data Integrator Release Notes for additional versions supported in this release. If you have a login to the Business Objects Customer Support Web site (go to Business Objects Customer Support Online to register), you can log in to http://www.techsupport.businessobjects.com and view the latest Product Availability Report for all currently supported versions.

Data Integrator distributed architecture

Data Integrator has a distributed architecture. An Access Server can serve multiple Job Servers and repositories. The multi-user licensed extension allows multiple Designers to work from a central repository. The following diagram illustrates both of these features.

Data Integrator Getting Started Guide 31

Data Integrator Architecture

Data Integrator distributed architecture

You can distribute Data Integrator components across multiple computers, subject to the following rules:

• Engine processes run on the same computer as the Job Server that

spawns them

• Adapters require a local Job Server

Distribute Data Integrator components across a number of computers to best support the traffic and connectivity requirements of your network. You can create a minimally distributed system, designed for developing and testing or a highly distributed system designed to scale with the demands of a production environment.

Resource distribution

A production implementation distributes some of the high-load applications to dedicated computers:

Example: Production distribution model Computer Supported system components

Back-office application server

Back-office database server

32 Data Integrator Getting Started Guide

Back-office application

Database underlying back-office application

Data Integrator Architecture

Network security options

Example: Production distribution model Computer Supported system components

Database server Data warehouse database Data Integrator server #1 Designer

Repository Job Server Access Server

Data Integrator server #2 Administrator

Data Integrator Web Server

Data Integrator server #3 Repository

Job Server

Data Integrator server #4 Repository

Job Server

Web application server Application server (Cold Fusion, for

example) Access Server

Web server Web server application (IIS, Personal Web

Server) Message Client library

In the preceding example, server #1 might be set up to support design, server #2 would support system administration, and servers #3 and #4 might be supporting only real-time messaging. Repositories on all three servers might be needed to support Oracle applications.

Network security options

Y ou can distribute Dat a Integrator applications in a variety of locations on your network based on the access each component provides and the security systems your network employs. The following sections describe some network architecture configurations to help you determine where your data warehouse can reside.

Data warehouse with external Web server in DMZ

One configuration of network architecture places data accessed by a Web application on the same network as the Web application but isolated by a firewall from a company intranet. The intermediate network, referred to as a demilitarized zone (DMZ), is protected from public access by its own firewall.

Data Integrator Getting Started Guide 33

Data Integrator Architecture

Network security options

Security allows traffic only from the intranet out to the DMZ. If a computer hacker manages to infiltrate the DMZ, only the data in the data warehouse itself is at risk.

Placing the data warehouse in the DMZ works if the Web application only reads data from the data warehouse.

Firewall between data warehouse and external Web server

Another network configuration separates a data warehouse from the Web server using a firewall. There are several ways to provide access across the firewall:

• Configure communication to include IP address verification when

receiving and sending messages

• Implement a proxy server to handle communication across the firewall

Assess your network security to determine if this configuration provides appropriate protection.

With proper security, placing the data warehouse behind a firewall separated from the DMZ works for both read-only and read/write applications.

34 Data Integrator Getting Started Guide

Data Integrator Architecture

Network security options

Application server behind a firewall

Another configuration places an application server between the external Web server and a data warehouse. Typically, e-commerce applications designed for higher volume and both read and write transactions include an application server separate from the Web server. The application server generally manages resources, security across a firewall to the Web server, and connectivity between databases and the Web server.

The data warehouse resides on the intranet with the application server.

Data Integrator Getting Started Guide 35

Data Integrator Architecture

Network security options

Access validation

One typical goal of Data Integrator applications is to provide the best data available, by request, from one application (such as an ERP system or data warehouse) to another (such as a Web server or real-time processing environment). With this in mind, there are many handshakes between applications to produce a complete data path. Actual connections vary among implementations.

Connection Format Security

Infrastructure

Web application to data warehouse SQL Direct calls (both in

DMZ) IP address validation Proxy server

Web application to Data Integrator Access Server

Application server to Data Integrator Access Server

Data Integrator Access Server to real-time services (via Job Server)

36 Data Integrator Getting Started Guide

XML IP address validation Application calls

XML IP address validation Data Integrator

Configuration

Application calls

(COM, C++, Java)

Administrator

Data Integrator Architecture

Network security options

Connection Format Security

Infrastructure

Real-time services to Data Integrator Access Server

Real-time services to data warehouse

Real-time services to ERP system SQL

XML IP address validation Data Integrator

SQL Database login Designer metadata

Security profiles, function calls

application login

Host names and port numbers

Communication between a Web application, the Data Integrator Access Server, the Data Integrator Job Server, and real-time services occurs through TCP/IP connections specified by IP addresses (or host names) and port numbers.

If your network does not use static addresses, use the name of the computer as the host name. If connecting to a computer that uses a static IP address, use that number as the host name for Access Server and Job Server configurations.

To allow for a highly scalable system, each component maintains its own list of connections. You define these connections through the Server Manager, the Data Integrator Administrator, Repository Manager, and the Message Client library calls (from Web client).

Configuration

Administrator

Designer metadata

Data Integrator Getting Started Guide 37

Data Integrator Architecture

Network security options

38 Data Integrator Getting Started Guide

Data Integrator Getting Started Guide

Preparing to Install Data Integrator

chapter

Preparing to Install Data Integrator

System installation overview

This chapter discusses information to consider before installing Data Integrator including:

• System installation overview

• System requirements

• Pre-installation tasks

• Data Integrator licenses

• Repository database information

System installation overview

There are several installation process stages. The following flowchart outlines steps and associated chapters in this manual:

40 Data Integrator Getting Started Guide

Chapter 4

Pre-installation tasks

Component distribution, license information/keys, ports, repositories, network...

Preparing to Install Data Integrator

System installation overview

Is a previous version of Data Integrator already installed?

Chapter 6

Installing Data Integrator on Windows Systems

Installing components on UNIX platforms?

Yes

Chapter 5

Upgrading Data

Chapter 7

Installing Data Integrator on UNIX Systems



To prepare for Data Integrator installation

1. Review the Release Notes.

Data Integrator Getting Started Guide 41

Preparing to Install Data Integrator

System installation overview

2. Decide which Data Integrator components you need to upgrade or install.

Component Role

Designer Use to develop and test batch, SAP R/3, and real-time

Job Server Processes jobs and real-time messages Administrator Use to monitor jobs, Access Servers, and adapters Access Server Provides real-time access to Data Integrator server

3. Determine the computers on which to upgrade or install these

4. Determine the locale for each Job Server installation.

5. Update or install the Data Integrator Designer, Administrator, Job Server,

jobs

components

components. You may choose to upgrade or install components on one or more

computers based on available resources and amount of system traffic. You must install the Designer on a supported Windows platform. Install

the Administrator, Job Server , and Access on Windows or UNIX platforms (see “Data Integrator operating system platforms” on page 31).

Locales support the processing of data stored in different human languages such as rules for capitalization, time and date formats, and basic character sets.

The Data Integrator installation program prompts you to specify a locale in terms of language, territory, and code page for each Job Server installation. Data Integrator obtains the default information from the host computer’s operating system. When you install the Job Server, you are also installing Data Integrator’s engine; the processing that occurs within Data Integrator will use this locale.

Data Integrator supports both single and multi-byte code pages. Many Asian scripts require multi-byte code pages. Data Integrator also supports the world’s languages.

In a production environment, carefully selecting code pages is especially important. Data Integrator supports and will transcode unique code pa ges when data passes from sources, through the engine, to t argets. However for best performance, avoid transcoding by using the same code pages or the

For more information, see the Data Integrator Reference Guide.

and Access Server.

UTF-8, a unicode, multi-byte code page that includes most of

UTF8 unicode for objects in a job.

42 Data Integrator Getting Started Guide

Preparing to Install Data Integrator

System requirements

See detailed installation steps for updating or installing Data Integrator in the remaining chapters of this guide.

6. Test connectivity: a. If you are using BusinessObjects Rapid Marts, install your Rapid

Mart and run the initial extraction job to test connectivity.

Note: Install pre-packaged BusinessObjects Rapid Marts or

adapters from separate product CDs. For those products, follow the installation documentation included with the product CD.

b. If you are not using a Rapid Mart, populate a data warehouse by

creating and testing a batch job in Data Integrator.

c. If you are updating or installing Data Integrator and you are not

installing a Rapid Mart, see “Verifying connectivity” on page 93 for step-by-step instructions and the location of sample files for testing your Data Integrator installation.

7. Connect to source or target applications through either of these methods:

• The Message Client library. See “Installing Message Client libraries”

on page 100 and “Using the Message Client library” on page 101.

• A Data Integrator adapter. Find installation and configuration

instructions for individual adapters and the Adapter SDK in the Adapters subdirectory of the Data Integrator package you install.

8. Implement and test data flows to support analytic or Web application

needs.

• For analytic applications, schedule batch jobs using the Data

Integrator Administrator as described in the Data Integrator Administrator Guide.

• For Web applications, configure real-time jobs as services in the

Data Integrator Administrator as described in the Data Integrator Administrator Guide.

System requirements

Before installing Data Integrator, ensure that your system has compatible hardware and software. This section discusses:

• Data Integrator repository requirements

• Database requirements

• Data Integrator Designer requirements

• Data Integrator Job Server requirements

Data Integrator Getting Started Guide 43

Preparing to Install Data Integrator

System requirements

• Data Integrator Access Server requirements

• Data Integrator Administrator requirements

• Web applications communicating with Data Integrator

Data Integrator repository requirements

Data Integrator stores your design metadata for source and target tables as well as database functions and definitions of built-in Data Integrator object s in database tables. This set of database tables is called the Data Integrator repository. You must create space for local and/or central repositories on an existing database before you run the Data Integrator installation program. The Data Integrator installation program connects to the repository and populates it.

To open the Data Integrator Designer, launch the Designer application from the computer on which it is installed and log in to the repository. When you execute Data Integrator jobs from the Designer, the Data Integrator Job Server connects to this local repository to read application information.

A Data Integrator repository requires a minimum of 20 MB of free disk space on the database server. Built-in Data Integrator objects require less space. However, user-defined or purchased Rapid Mart applications might require more space. Sizing requirements depend on the scale of your planned operations.

44 Data Integrator Getting Started Guide

Database requirements

Data Integrator supports several database connections for repositories, data sources, and data targets. Database client and server software versions must be compatible. For the latest listing of supported databases (with version and O/S platform requirements, see the Product Availability Report (PAR). Some supported databases include.

Preparing to Install Data Integrator

System requirements

O/S platforms

Windows and UNIX

Database connection

Oracle DB2/UDB ODBC

Sybase ASE Sybase IQ

Teradata 2.5 No Yes Yes Informix 7.3.1 Yes Yes Yes

Windows Microsoft SQL

Server

NOTES:

1. Plus higher OS binary application compatible versions supported by the vendor. Refer to release. If you have a login to the Busines s Objects Customer Support Online you can also view the Product Availability Report for all current ly supported versions.

To access this Web site, you must have a valid user name an d password. To obtain your user name and password, go to

Online

2. When using an Oracle 64-bit client, the 3 2-bit client libraries must be i nstalled. The default installation of the Oracl e 64-bit client includes instal lation of the 32-bit client. For non-standard installations, these libraries must be specified as part of the installation. After installation, the libraries shou ld be in the $ORACLE_HOME\lib32 directory.

If these 32-bit libraries are not present, you will receive an error message stating that Data Integrator cannot load the client library. Examples of error messages:

Data Integrator Release Notes for additional versions supp orted in this

and register.

Minimum version

Repository Source Target

8.1.7 Yes Yes Yes

8.1 Yes Yes Yes No Yes Yes

12.5 Yes Yes Yes

12.5 No Yes Yes

7.0 Yes Yes Yes

Business Objects Customer Support

Data Integrator Getting Started Guide 45

Preparing to Install Data Integrator

System requirements

3. Data Integrator supports a native DB2 interface. You can connect to MVS or AS/

• (5.2) 02-05-02 14:55:23 (E) (26797:0001 ) CON-120103: System

call <dlopen> to load and initialize functions failed for <libclntsh.a>. Make sure the SHARED LIBRARY is insta lled and resides in the correct location.

• (5.2) 02-05-02 14:55:23 (E) (26797:0001) REP-100108: Cannot

perform operation on Repository<Default Repository> because a connection to the repository was never opened. A connection must be opened to the repository before performing any operation.

400 through DB2 Connect with the DB2 Client Enterprise Edition. If you pl an to use template tables on DB2 on MVS, ensure that the database “create schema implicitly” setting is on. However, you cannot create a template table with a primary key. You can use the Attunity Connector or IBM Connector datastores as alternatives to access through IBM iSeries Access Driver (native) or IBM DB2 Connect (via ODBC). However, Attunity Connector connections are read-only

Client Driver (connection)

IBM iSeries Access

DB2 Connect ODBC DB2 Any OS/400, MVS IBM

Connector

Attunity Connector

4. You can connect to any ODBC-compliant database through an ODBC driver using Data Integrator’s built-in driver manager (see "UNIX ODBC driver manager configuration file" on page 80 of the Data Integrator Reference Guide). You can load DataDirect Technologies’ 32 bit ODBC drivers using either Data Integrator's built-in driver manager or Data Direct's ODBC driver manager (for supported versions, see the Product Availability Report at

Support Online

5. If you are using both Sybase ASE and SQL Server on a Windows platform, ensure that the Sybase path precedes the SQL Server path in the environment variables %PATH% statement.

Datastore Editor option

DB2 DB2 Windows

IBM Connector

Attunity Connector

.).

Data Source

DB2 NT, AIX,

Client Operating System

only

HPUX, Solaris

Business Objects Customer

Source Operating System

OS/400

OS/400, MVS (tested)

46 Data Integrator Getting Started Guide

Data Integrator Designer requirements

The Data Integrator Designer requires specific Windows software and hardware.

Software

• Operating systems: see “Data Integrator operating system platforms” on

page 31.

• Desktop Development Kit (DDK) option for extraction from SAP R/3

sources

• Database client library software for the database serving as your Data

Integrator repository

Hardware

• Pentium processor with at least 128 MB RAM and 100 MB free disk

space (memory-intensive jobs require more free disk space)

• Screen resolution of 1024 x 768 pixels with 16-bit or 65536 colors

recommended (minimum 256 colors).

• Paging file with a minimum setting of 256 MB and a maximum setting of

512 MB

Preparing to Install Data Integrator

System requirements

Data Integrator Job Server requirements

You can install the Data Integrator Job Server on the same computer as the Data Integrator Designer or on a different computer. If you choose to install the Designer and Job Server on the same computer, you must add the RAM and free disk space for the second component to the requirements of the first.

See also: “Additional system requirements for UNIX” on page 114.

Software

• Operating systems: see “Data Integrator operating system platforms” on

page 31.

• If you plan to run scheduled jobs in a Windows environment, enable the

Windows Task Scheduler on the Job Server computer.

• Install database connectivity software for the database(s) serving as your

repository, sources, and targets.

Note:

Data Integrator Getting Started Guide 47

Preparing to Install Data Integrator

System requirements

Hardware

• Pentium processor with at least 256 MB RAM and 100 MB free disk

• 1 GB virtual memory

• Recommended for best performance: dual processors (minimum 500

• For Oracle bulk loading, install the Oracle bulk loading utility sqlldr

on the Job Server computer.

• For DB2 bulk loading, Data Integrator installs a proprietary

executable, db2bulkload, in the Business Objects/Data Integrator/bin directory. To use DB2 bulk loading utility, the DB2 user specified in the datastore for the job must have system privileges. DB2 database or DB2 client application enabler software installations create a default user called db2user. Before you install a Job Server, you must know the password for db2user. The Job Server requires path information for the client application enabler software included in the alias for this user. For more information, see your DB2 database documentation.

space

Mhz) with at least 512 MB physical memory

Data Integrator Access Server requirements

You can install the Access Server independently of other Data Integrator components.

You can configure a single Access Server to serve one or more Web applications, regardless of the load-balancing configuration. However, if request processing requires more resources, you can configure multiple Access Servers.

Software

• Operating systems: see “Data Integrator operating system platforms” on

page 31

Hardware

• Pentium processor with at least 256 MB RAM and 100 MB free disk

space

• 512 MB virtual memory

• Recommended for best performance: dual processors (minimum 500

Mhz) with at least 512 MB physical memory

48 Data Integrator Getting Started Guide

Preparing to Install Data Integrator

• See also: “Additional system requirements for UNIX” on page 114.

Data Integrator Administrator requirements

You can install the Administrator independently of other Data Integrator components. You install the Web Server when you install the Administrator. The Web Server supports web browser capabilities for both the Administra tor and the Metadata Reporting tool.

You can configure a single Administrator to serve one or more Access Servers, repositories and the Job Servers connected to them. You can also configure multiple Administrators.

See also: “Additional system requirements for UNIX” on page 114.

Software

• Operating systems: see “Data Integrator operating system platforms” on

page 31

• Microsoft Internet Explorer

Hardware

Pre-installation tasks

• Pentium processor with at least 128 MB RAM and 100 MB free disk

space

• Screen resolution of 1024 x 768 pixels with 16-bit or 65536 colors

recommended (minimum 256 colors).

Web applications communicating with Data Integrator

To send messages to the Access Server for processing, a Web application must:

• Be able to generate XML-formatted strings

• Connect to the Access Server using Message Client library calls in C++,

Java, or COM

Pre-installation tasks

Before installing Data Integrator components you must:

• Determine component distribution

• Obtain license keys

Data Integrator Getting Started Guide 49

Preparing to Install Data Integrator

Pre-installation tasks

• Check port assignments

• Create a database for each repository

• Check network connections

Determine component distribution

The installation program can install multiple Data Integrator components:

Component Function Number installed per

computer

Designer Develop and test data

flows

Job Server Process batch jobs and

real-time messages

Administrator Monitor: jobs, Access

Servers, and adapters

Access Server Provide network access

to Data Integrator server components

Note: You can configure several Job Server and Access Server instances

from one Job Server or Access Server installation. Configure Job Server and Access Server instances using the Server Manager.

You can install Data Integrator components on one or more computers based on available resources and the amount of traffic the system processes. Before installing Data Integrator components, consider the following restrictions:

One (Windows only)

One (Windows or UNIX)

• If you plan to use Data Integrator in a multi-user development

environment, the computers containing the local repositories for each user must be able to connect to the computer containing the central repository.

• A local Data Integrator repository connects a Data Integrator Designer

with a Data Integrator Job Server. You can install a Job Server on the same computer as the repository, on a stand-alone computer (with repository database client software), or on the same computer as a Data Integrator Designer.

Always installed with the following components

Repository Manager and the License Manager tools

Server Manager tool, Data Integrator Service, HTTP adapter, SNMP Agent and Web Services adapter

Data Integrator Web Server and Data Integrator Web Server service

Server Manager Tool and Data Integrator Service

50 Data Integrator Getting Started Guide

Preparing to Install Data Integrator

Pre-installation tasks

• Any Data Integrator Designer can access any local repository and Data

Integrator Job Server. Business Objects does not recommend that multiple Data Integrator Designers simultaneously access the same local repository and Job Server. Using simultaneous access risks metadata corruption in the repository. Also, you cannot link Data Integrator Designer to more than one local repository at any given time.

• Install database client software on the computer containing the Job

Server to support the repository associated with that Job Server. For example, if the repository associated with a Job Server named “oradev” is an Oracle database, then Oracle client software must be installed on the computer containing the “oradev” Job Server.

The following diagram depicts a simple distribution of Data Integrator components among computers in a network. Note that you can install each Data Integrator on one or more computers. Also note that there are many possible connections between Data Integrator components. Each of the boxes in the diagram represents a different computer.

Data Integrator Getting Started Guide 51

Preparing to Install Data Integrator

Pre-installation tasks

You can install the Administrator on any computer with or without other Data Integrator components. No license is required. It is Java-based. You also install the Data Integrator Web Server and Data Integrator Web Server service when you install the Administrator. The Data Integrator Web Server starts automatically on restart. See also the discussion under “Data Integrator

distributed architecture” on page 31.

Obtain license keys

You must obtain the appropriate license key for each Data Integrator component. To do this, send your host ID information and a list of components to licensing@businessobjects.com. Business Objects will generate a license file and contact you when it is available for access at

webkey.businessobjects.com. For more information on licenses, see “Data Integrator licenses” on page 55.

Check port assignments

Verify that default ports for Data Integrator components are available and not in use by other programs on each computer.

For a development system, you can install many components on the same computer. This simplifies many connections between components (the host name is always the same), but you must still define connections based on TCP/IP protocol. The following example configuration diagram shows default port numbers.

52 Data Integrator Getting Started Guide

This table details Data Integrator default ports:

Preparing to Install Data Integrator

Pre-installation tasks

Component

Port Description Default To set

Job Server

Job Server port or TCP/IP port

Adapter and SNMP communication port

Data Integrator Web Server

Receives commands from Designer, Access Server, and schedulers

Receives commands and sends data to adapters

Data Integrator Getting Started Guide 53

3500 Use Server Manager

4001 Use Server Manager

Preparing to Install Data Integrator

Pre-installation tasks

Component

Port Description Default To set

HTTP port Supports communication

Shutdown port Connects to Data Integrator Web

Access Server

Communication port

Designer

Interactive Debugger port

between Access Servers, the Administrator, and the Metadata Reporting tool

Server service. The Web Server service uses this port to start and shutdown the Web Server which supports the Administrator and the Metadata Reporting tool.

Communicates with the Administrator and the Metadata Reporting tool. Receives and sends messages from clients and services

Supports communication for the debugging feature

28080 In UNIX, use Server

Manager In Windows, edit

configuration files manually (see “To reset

the ports for the Data Integrator Web server” on

page 84)

22828 In UNIX, use Server

Manager In Windows, edit

configuration files manually (see “To reset

the ports for the Data Integrator Web server” on

page 84)

4000 Use Server Manager

5001 Contact Business

Objects Technical Support

Create a database for each repository

There are two types of repositories: local and central. Local repositories are working repositories where users create and modify applications. Central repositories serve as historical libraries, storing version-controlled master copies of applications you create and modify in local repositories.

You associate each local repository with one or more Data Integrator Job Servers. If you choose to install Job Servers on more than one computer, you must create a local repository to support each Job Server. There is no relationship between central repositories and Job Servers.

Create local repositories before installing each Job Server. For more information, see “Repository database information” on page 60.

54 Data Integrator Getting Started Guide

• To set up a single-user development environment, create a database for

the local repository.

• To set up a multi-user development environment, create databases for

each local repository (one per user) and a database for the central repository. See Chapter 5, “Multi-user development,” in the Data Integrator Advanced Development and Migration Guide for more information about using the multi-user development features.

Check network connections

Before installing Data Integrator components, prepare the computers involved and verify network connections by executing the computer.

For example, if the Designer will be on a Windows computer and your Job Server will be on a UNIX computer, from the Windows computer open the DOS prompt and enter:

C:\> ping hostname

where

hostname is the host name of the UNIX computer.

Then from the UNIX computer, log in as root and from the prompt, enter:

$ ping hostname

where hostname is the host name of the Windows computer.

Preparing to Install Data Integrator

Data Integrator licenses

Ping command on each

Data Integrator licenses

This section explains:

• License types

• Optional license-controlled features

• Managing your licenses

• Obtaining your license files

• Viewing previously-generated license files

License types

Data Integrator licenses can be:

• Unrestricted or restricted

• Evaluation, emergency, or permanent

Data Integrator Getting Started Guide 55

Preparing to Install Data Integrator

Data Integrator licenses

Unrestricted

Business Objects generates unrestricted licenses for components not tied to a specific computer. Data Integrator verifies that the appropriate license exists each time a licensed component starts. The Data Integrator Designer component has an unrestricted license.

Restricted

Business Objects generates and uses restricted licenses for components tied to a specific computer. Restricted licenses use the ethernet/MAC address from the computer on which you installed the component. This value appears in the Data Integrator installation as “Host ID.”

When a Data Integrator component starts, it searches for the license and validates it against the Host ID.

Note: Data Integrator components using a restricted license require a new

license file if:

• You transfer the installation to another computer, or

• You install a new network card on the computer

In either case, contact licensing@businessobjects.com to submit your old and new host ID information along with a list of affected components. Business Objects will generate a new file and contact you when it is available for you to access at webkey.businessobjects.com.

Note: You cannot reset your license key to a NULL value.

Evaluation

An evaluation license allows you to run Data Integrator for a specific period of time. You can use this license on any computer until the license expires. An evaluation license is unrestricted for all Data Integrator components.

Emergency

Similar to evaluation licenses, the emergency license allows you to run Data Integrator for a limited period of time. Emergency licenses differ from evaluation licenses only in that the limited period of use is significantly shorter. Contact Business Objects Customer Support Online should you require an emergency license.

56 Data Integrator Getting Started Guide

Permanent

Preparing to Install Data Integrator

Data Integrator licenses

A permanent license allows you to run Data Integrator components indefinitely . You purchase unrestricted permanent licenses for Data Integrator Designers and restricted permanent licenses for Data Integrator Job Servers. No license is required for the remaining core Data Integrator components.

Data Integrator component licenses:

Data Integrator component

Designer Unrestricted Unrestricted Unrestricted Job Server Restricted Restricted Restricted

Business Objects may bundle several features with Data Integrator depending on what you purchase. These features include:

Multi-user capability

SNMP agent Supports SNMP protocol to communicate between (network

Supports multiple users for secure collaboration on ETL projects.

management software) applications and Data Integrator Job Servers. With SNMP, you use your NMS application to monitor the status of Data Integrator jobs. Included with Job Server installation.

Evaluation license

Emergency license

Permanent license

Optional license-controlled features

Extend Data Integrator functionality with the following licensed-controlled components. The license for each component is tied to your Data Integrator Designer license. Purchase this additional functionality through your Business Objects Sales Representative.

Table 4-1 :Optional license-controlled features

Name License Extension to Data Integrator that:

JD Edwards Supports a batch interface to JD Edwards World and OneWorld sources and

targets.

Oracle Applications

PeopleSoft Supports an interface to PeopleSoft ERP and HRMS software. Siebel Supports an interface between Data Integrator and a third-party database

SAP BW Supports an interface between Data Integrator and SAP Business

Supports an interface to Oracle Applications eBusiness Suite software for batch data integration.

running Siebel Applications. MS SQL Server is supported.

Information Warehouse by using SAP BW’s Staging BAPIs.

Data Integrator Getting Started Guide 57

Preparing to Install Data Integrator

Data Integrator licenses

Name License Extension to Data Integrator that:

SAP R/3 ABAP Supports R/3 data flow and data transport objects which allow Data

Integrator to process batch data warehouse updates from SAP R/3.

SAP R/3 BAPI

SAP R/3 IDoc Supports translation of IDoc messages sent from SAP R/3 to Data

Supports BAPI function calls from Data Integrator to SAP R/3 transactions and queries. Includes BAPIs with table parameters.

Integrator.

Managing your licenses

Easily manage your Data Integrator licenses using local license control. Simply obtain licenses from the licensing Web site and save them to the local host where you will install your licensed components.

Obtaining your license files

The Business Objects licensing Web site at webkey.businessobjects.com generates your license files and displays your license information.

T o obtain your license file(s) prior to installatio n



1. Decide which Data Integrator components you will install on which

computers.

2. Create a list of all involved host IDs. To obtain a host ID, insert the Data

Integrator CD into a computer and click the Get Host ID button.

lmhostid program is included on your CD. You can also run it from

The the DOS or UNIX command line to determine the host ID that Business Objects licensing will use.

3. From your browser window, go to the licensing Web site at

webkey.businessobjects.com, enter the code provided in your License

Authorization Code e-mail letter, then click Submit.

4. At the first License Fulfillment page, confirm the line items of your Data

Integrator order.

Note: That page does not specify quantities.

5. Click to select a line item for which you want to generate a license file,

then click Generate License.

6. At the second License Fulfillment page, enter the host ID for the

computer on which you will be installing the Data Integrator component(s) associated with your chosen line item(s). Click Generate License.

Note: You can select multiple items for the same host ID.

for

58 Data Integrator Getting Started Guide

Preparing to Install Data Integrator

Data Integrator licenses

Business Objects generates a License Certificate page. This page contains product component name(s), effective date, license type, license key information, and host ID information. When saved, this page becomes a license file.

7. Save the License Certificate page.

• Method 1:

a. Click the Save button on the license file page. b. Browse to the location where you want to save this file.

Business Objects recommends you save all license files to your Data Integrator/License directory; however, you can initially save license files anywhere you choose. During installation, Data Integrator automatically copies license files to the Data Integrator/License directory . The copied files become the official license keys for your product components.

c. Enter a unique, descriptive name for this license file with “.lic” as

the file extension. (Example: JScomputer1.lic)

• Method 2:

a. In the browser window’s menu, click File > Save As. A warning

message may appear that says, “This Web page may not save correctly, save it anyway?” Click OK to get to the Save Web Page window.

b. Browse to the location where you want to save this file.

c. From the Save as type list, choose any file extension. d. Later, you must manually change this extension to “.lic” for Data

Integrator to recognize the file.

e. In the File name text box, enter a unique, descriptive name for

this license file.

8. Generate a license file for each host ID by repeating steps 4 through 7. Note: When saving license files on an AIX platform using either method, you

must name the file al_license.lic.

Data Integrator Getting Started Guide 59

Preparing to Install Data Integrator

Repository database information

You can generate license files at your convenience. For example, your Data Integrator product may be associated with five license files. However, you may generate only two of these licenses now and return to the Web site later to view your earlier licenses or generate more.

Viewing current license information

On Windows, go to Start > Programs > Data Integrator > License

Manager

and licensed extensions.

to view license information for your Data Integrator components

Viewing previously-generated license files

View previously-generated license files to find key information needed for new licenses such as host IDs.

T o view p rev io u sly gen e rate d lic en se files



1. From your browser window , go to Business Objects’ licensing W eb site at

webkey.businessobjects.com, reenter your License Authorization code,

and click Submit.

2. At the first License Fulfillment page, confirm the line items of your Data

Integrator order.

Note: Quantities are not specified here.

3. Click View License.

The Select Fulfillment Record page appears, showing all previouslygenerated licenses against the order(s) you placed. Previouslygenerated licenses are shown in a table associated with product number, option information, the number of days the license is valid, host ID number, and effective date.

4. At the Select Fulfillment Record page, click to select a license, and click

View License.

The License Certificate page appears, containing product component name(s), effective date, license type, license key information, and host ID information.

Repository database information

This section describes information necessary for you to create either local or central repositories in various types of databases.

60 Data Integrator Getting Started Guide

For DB2

A local or central Data Integrator repository requires that you create a dedicated database and define a user with the right to:

• Create a table

• Start a session

• Create a sequence

Required Data

Install the DB2 application enabler software and use DB2 Control Center and DB2 Script Center to verify the connection between the Designer computer and the Data Integrator repository computer.

For Informix

A local or central Data Integrator repository requires that you create a dedicated database and define a user with the right to:

• Create a table

• Start a session

• Create a sequence

• Unlimited tablespace

Preparing to Install Data Integrator

Repository database information

DB2 data source:___________________________________ User name/password:_______________________________

Required Data

Informix data source:_______________________________ User name/password:______________________________

Install the Informix client software and verify the connection between the Designer computer and the Data Integrator repository database.

Data Integrator Getting Started Guide 61

Preparing to Install Data Integrator

Repository database information

For Microsoft SQL Server

When creating a repository on Microsoft SQL Server, choose between Windows authentication (by selecting the check box) or Microsoft SQL Server authentication (by completing the Microsoft SQL Server user name and password fields):

• Windows authentication — Microsoft SQL Server validates the login

account name and password using information from the Windows operating system

• Microsoft SQL Server authentication — Microsoft SQL Server

authenticates the existing Microsoft SQL Server login account name and password

Required Data

Database server name:_________________________________ Database name:______________________________________ Windows authentication or User name/password:_____________

Install Microsoft SQL Server client software and use MicrosoftSQL Server’s SQL Query Tool to verify the connection between the Designer computer and the Data Integrator repository computer.

For Oracle

A local or central Data Integrator repository requires that you create a dedicated database and define a user with the right to:

• Create a table

• Start a session

• Create a sequence

Grant the user the connect and resource roles.

Required Data

Database connection name:______________________________ User name/password:___________________________________

Install the Oracle client software and use SQL*Plus to verify the connection between the Designer computer and the Data Integrator repository.

62 Data Integrator Getting Started Guide

For Sybase ASE

A local or central Data Integrator repository requires that you create a dedicated database and define a user.

Required Data

Database server name:_________________________________ Database name:______________________________________ User name/password:__________________________________

Install Sybase ASE and verify the connection between the Designer computer and the Data Integrator repository computer.

Preparing to Install Data Integrator

Repository database information

Data Integrator Getting Started Guide 63

Preparing to Install Data Integrator

Repository database information

64 Data Integrator Getting Started Guide

Data Integrator Getting Started Guide

Upgrading Data Integrator

chapter

Upgrading Data Integrator

Upgrade paths

This chapter provides information required to upgrade from previous product versions. This chapter includes:

• Upgrade paths

• Upgrading your Data Integrator system

• Before upgrading repositories with the Repository Manager:

• After upgrading Data Integrator

Upgrade paths

You upgrade Data Integrator by installing the new Data Integrator components then upgrading your repositories. This section discusses:

• Data Integrator component upgrades

• Repository upgrades

• Upgrading to a multi-user development environment

Data Integrator component upgrades

In addition to upgrading repositories, you must upgrade all Data Integrator components to the same version.

Business Objects recommends that after you back up existing repositories (using your database’s backup utility) and read the release notes, you upgrade components in the following order:

1. Data Integrator Designer

2. Data Integrator repository

3. Data Integrator Job Server

4. Data Integrator Access Server

5. Data Integrator Message Client and Connector libraries

6. If you are using the SAP R/3 ABAP interface, re-install the Data

Integrator functions for SAP R/3. For more information, see “Installing

Data Integrator functions on SAP R/3” on page 24 of the Data Integrator

Supplement for SAP.

Repository upgrades

Minor releases do not require a repository upgrade. For example, if 6.0 is a major release and 6.1 is a minor release, then when upgrading from 6.0 to

6.1, it would not be necessary to upgrade your repository. However, product

66 Data Integrator Getting Started Guide

Upgrading Data Integrator

Upgrading your Data Integrator system

features introduced in the latest product version might not be available without the repository upgrade. To see whether you need to upgrade your repository for a particular release, see the Release Summary document.

Using database backup utilities, always make a copy of your existing repository before upgrading. Note that you will upgrade using the original repository (not your backup copy).

The following repository upgrade paths are available:

To upgrade from Procedure

Version 3.1, 4.x, 5.x, or 6.0

Install this release using one of the following methods:

• Upgrade your repository during the

installation process

• Upgrade your repository after installing the

Designer by running the Repository Manager utility and choosing the Upgrade option. See “Before upgrading repositories

with the Repository Manager:” on page 72 if

you choose this second option.

Upgrading to a multi-user development environment

To use Data Integrator for controlling changes in a multi-user environment, you must create a central repository in addition to local repositories for each Data Integrator Designer user. However, you do not need to create or link these repositories during the installation process. You can create and link central and local repositories at any time using the Repository Manager and Data Integrator Designer.

For more information on central repository connection restrictions, see

“Determine component distribution” on page 50. For information about the

multi-user development environment and how local and central repositories are used, see Chapter 5, “Multi-user development,” in the Data Integrator Advanced Development and Migration Guide.

Upgrading your Data Integrator system

When moving to a new product version, upgrade your test or development environment before upgrading your production environment.

Data Integrator Getting Started Guide 67

Upgrading Data Integrator

Upgrading your Data Integrator system

To install a new product version on a computer hosting an existing version, first uninstall the old version. Note that uninstalling does not remove your custom files (configuration files, job logs, and job launch files), so after you install the new version, you have two options for handling the old directory and custom files:

• To create new configurations in your new version, manually delete the old

directory and its files

• To use old configurations in the new version, transfer specific files from

the old directory to your new Data Integrator directory See “Using configurations from a previous version” on page 68 for

details.

Note: The procedure in the following section directs you to follow instructions

in “Running the installation program” on page 76. These instructions explain how to use the Data Integrator installation program (Setup.exe).

Business Objects recommends that while upgrading Data Integrator you do not use the installation program to reconfigure an Access Server. Instead, after installing the Designer and required repositories, Job Servers, and Access Servers, return to this chapter and continue. Use the explicit instructions in this chapter as your guide for upgrading Data Integrator.

Using configurations from a previous version

If you want to use custom configurations from a prior version of the product:

1. Move the DSConfig.txt file, from the

created “dummy” installation directory structure before installing the new version.

Example “dummy” directory structure: D:/Program Files/Business Objects/Data Integrator 6.1/bin/DSConfig.txt During the installation process, Data Integrator will overwrite the

“dummy” directory structure with the new installation structure, merging custom settings (such as repository and Access Server connections added to the Administrator) from your old DSConfig.txt file into the new DSConfig.txt file.

2. Also, before installing the new version, manually move the following

subdirectories out of your installation directory.

• Conf - Contains Administrator settings

• Log - Contains old logs

68 Data Integrator Getting Started Guide

bin subdirectory, into a newly

3. If your current installation includes support for real-time message

handling, then when you configured an Access Server (using the Data Integrator Server Manager) you specified a location for each Access Server configuration directory. If those directories are in the Data Integrator installation directory make a copy of each Access Server configuration directory.

ave your current copy until after you test the upgrade and confirm that your new system is working as expected. When you merge the old DSConfig.txt file with the new one, Data Integrator should find the Access Server configuration directories. If not, use the Server Manager to point to the backup Access Server directories.

4. Uninstall the existing product.

• In Windows, use the Add/Remove Programs utility.

• In UNIX see “Uninstalling Data Integrator” on page 139.

5. Install the new product then move the content of the old

subdirectories into the new subdirectories.

Uninstall existing product version(s)

Before installing Data Integrator on a system, make sure to remove all previously installed versions of the product from that computer . If this is a new installation, skip this section and go to “Install a new version” on page 70.

Upgrading Data Integrator

Upgrading your Data Integrator system

Conf and Log

Before installing a new version



1. Review Release Notes for the version of Data Integrator you will be

installing.

2. Use your database backup utilities program to back up all existing

repositories.

3. Open the Server Manager tool.

4. Make note of the port number used by each existing Access Server and

Job Server.

Data Integrator Getting Started Guide 69

Upgrading Data Integrator

Upgrading your Data Integrator system

Because these port numbers are part of the server configuration, use the same port numbers to configure Job Servers and Access Servers after the upgrade. If running more than one Job Server or Access Server on a single machine, assign different port numbers to each. each installed component must be unique.

Server instance Default communication port Example configuration

Access Server #14000 4000

Access Server #24000 4001

Administrator 28080 28080 Job Server #1 3500 3500 Job Server #2 3500 3501 Job Server #3 3500 3502

5. Close the Server Manager tool.

6. Open your Windows Services panel and stop all Data Integrator Services

(Data Integrator Service and the Data Integrator Web Server). You can use the Task Manager to verify that no Data Integrator

processes (processes beginning with “al_”) are running.

7. Uninstall the existing version of the product.

To uninstall Data Integrator from a Windows operating system, go to

Start > Settings > Control Panel > Add/Remove Programs (or Change/Remove Programs), select the product application, and click Remove.

8. Log off of your computer then log back on to refresh the environmental

variable.

9. Follow the instructions in the next section, “Install a new version”.

Port numbers for

-related

Install a new version

Log off of your computer then log back on (or rest art the computer) to refresh the environmental variable before installing this product.

To install a new version of Data Integrator



1. Review Release Notes for the version of Data Integrator you will be

installing.

70 Data Integrator Getting Started Guide

Upgrading Data Integrator

Upgrading your Data Integrator system

2. Use the Data Integrator installation program to install the new Data

Integrator version, but do not configure an Access Server at this time. Follow the instructions in “Installing Designer, Job Servers, and Access

Servers” on page 76. When finished, return to this page and proceed with

step 3.

3. Restart the computer when prompted by the installation program.

4. Configure Access Servers. a. From the Start menu, select Programs > BusinessObjects Data

Integrator version> Server Manager.

b. In the Data Integrator Server Manager Utility window, click Edit

Access Server Config.

c. In the Access Server d. In the Access Server Properties window, enter the name of the

Access Server directory from step 5; refer to the port numbers

mentioned in step 4. No parameters are required. Click OK.

e. To configure more than one Access Server on this computer, repeat

the previous step. When you are finished adding Access Servers,

click OK.

f. In the Data Integrator Server Manager Utility window, click Restart.

5. Verify that Data Integrator processes are running.

In the Windows Task Manager, click the Processes tab, and look for:

Configuration Editor window, click Add.

• al_jobserver.ex

• al_jobservice.e

• AL_AccessServer

6. Install the new version of Business Objects Client libraries on the

computers where they are used. See “Installing Message Client libraries” on page 100. If you are upgrading your Message Client library , you must stop your Web

application, install the Message Client library files, then restart your Web application computer.

7. Upgrade or create a repository in the Repository Manager.

Go to Start > Programs > Business Objects Data Integrator 6.0 > Repository Manager.

See “Upgrading repositories” on page 72 for details.

Data Integrator Getting Started Guide 71

Upgrading Data Integrator

Upgrading repositories

After installing a new version of Data Integrator, you can create new repositories or upgrade existing repositories. To associate an existing repository with your new installation of Data Integrator, you must upgrade that repository.

Before upgrading repositories with the Repository Manager:

• Back up each repository that you intend to upgrade using an external

database backup utility. For more information, see your database documentation.

• Install the new version of Data Integrator Designer



T o upgrade a repository

1. From the Start menu on the computer where you installed the Designer,

select Programs > BusinessObjects Data Integrator version > Repository Manager.

2. Enter the repository connection information for your original repository in

the Repository Manager window.

Note: Do not attempt to upgrade the backup copy of your repository or

you will experience upgrade errors.

3. Click Get Version.

The Repository Manager displays the version number recorded in the repository.

4. Click Upgrade.

The Repository Manager converts the pre-existing repository to the format required by the new version of Data Integrator and adds metadata for new and changed objects.

5. Repeat steps 2 through 4 for each repository you want to upgrade. Note: Corresponding local and central repositories must have the same

Data Integrator version.

6. Click Close.

Note:

• If you are upgrading from version 5.0 or earlier, after upgrading your

repositories, reimport all source and target database tables through the Designer to ensure good data in the repository’s primary/foreign key table.

72 Data Integrator Getting Started Guide

• If you need to create or upgrade multiple repositories, use the

RepoManBatch.exe utility. For more information, see “Creating or

upgrading repositories in batch mode” on page 90.

After upgrading Data Integrator

Upgrading requires you to re-establish the overflow directory for your bulk loader options. Overflow directories may have been specified as target table options or as part of the datastore definitions.

In addition, run tests of your production jobs to ensure that your existing designs continue to run as expected in the new version of Data Integrator. When you are confident that the new version of Data Integrator performs as well as or better than the previous version, consider upgrading your production environment.

For tips, tricks, and solutions to any recent upgrade issues, go Business Objects Customer Support Online, and see the Data Integrator Migration Guide.

Unsuccessful upgrade

Upgrading Data Integrator

After upgrading Data Integrator

Errors that prevent installation progress (for example an incorrect server name, user name, or password) yield immediate error messages.

For more information about troubleshooting installation problems, see

“Recovering from installation errors” on page 92.

Successful upgrade

A “successful completion” message verifies successful Data Integrator installation.

The

LINK_DIR system variable is defined during the Data Integrator

installation. Its value is set to the location of the directory in which you installed Data Integrator.

Data Integrator Getting Started Guide 73

Upgrading Data Integrator

After upgrading Data Integrator

74 Data Integrator Getting Started Guide

Data Integrator Getting Started Guide

Installing Data Integrator on Windows Systems

chapter

Installing Data Integrator on Windo ws Systems

Running the installation program

The Windows installation program:

• Copies the files from the installation CD to their designated locations

• Installs Data Integrator Service as a Windows service

• Prompts you to configure repositories, Job Servers, and Access Servers

(although these can also be configured after installation)

This chapter contains the following topics:

• Running the installation program

• Configuring repositories after installation

• Configuring Job Servers or Access Servers after installation

• Recovering from installation errors

• Verifying connectivity

• Updating licenses

• Installing Message Client libraries

• Using the Message Client library

Running the installation program

You can install the following components on Windows systems:

• Data Integrator Designer

• Data Integrator Job Server

• Data Integrator Access Server

• Data Integrator Administrator

Run the installation program to install all components or a subset. What you choose to install will depend on how you distribute the components across computers. See “Determine component distribution” on page 50. Y ou can run the program for Installing Designer, Job Servers, and Access Servers.

Errors that prevent installation progress (for example, an incorrect server name, user name, or password) yield immediate error messages. For information about solving installation problems, see “Recovering from

installation errors” on page 92.

Installing Designer, Job Servers, and Access Servers

Before installing Data Integrator components:

• Review the Release Notes.

76 Data Integrator Getting Started Guide

Installing Data Integrator on Windo ws Systems

Running the installation program

• If using local license management, save your license file to an

appropriate directory.

• On Job Server hosts, ensure you can connect from an RDBMS SQL tool

(such as Oracle SQL*Plus or DB2 Script Center) to the repositories that the Job Servers on that host will access.

• On Access Server hosts, identify a free port number for the Access

Server Administrator browser interface. By default, the installation program uses port number 28080.

To select installation options and copy files



1. Log on to your computer using an account with local Windows

administrator privileges and access to your network.

2. Insert the Data Integrator Installation CD into your CD-ROM drive (if the

installer does not automatically open, open Autorun.exe from the top level of the CD contents), or if you downloaded Data Integrator from Electronic Software Delivery, open the Setup.exe file.

The main installation window appears with several options.

3. Click Install Data Integrator.

If a previous version of the product exists on your computer, a message appears reminding you to stop all Data Integrator components and stop the Data Integrator services (from the Windows Services dialog box) before continuing.

4. If existing Data Integrator components and/or services are running, stop

them and click Yes to continue the installation. The User Information window appears showing your computer’s host ID.

You may want to note your host ID.

5. Enter your information in the Name and Company boxes. Click Next.

6. In the License Agreement window, read the software license agreement.

7. Click Yes if you agree to the terms. You can also Print the document for

your records.

8. In the Data Integrator Location window, indicate a directory into which

Data Integrator will be installed. The default is C:\Program Files\Business Objects\Data Integrator. Accept

the default or browse to choose a different directory. Click Next.

Note: This documentation assumes the Data Integrator Directory is

C:\Program Files\Business Objects\Data Integrator.

Data Integrator Getting Started Guide 77

Installing Data Integrator on Windo ws Systems

Running the installation program

9. In the Data Integrator License Information window, enter or Browse to

select the folder that contains your Data Integrator license file. (See “Data

Integrator licenses” on page 55 for information on obtaining your Data

Integrator license file.) Click Next.

10. In the Select Components window, select one or more of the following

Data Integrator components to install on your computer:

• Designer (includes the license extensions that you purchased)

• Job Server (includes the adapter options that you purchased)

• Access Server

• Administrator (includes metadata reporting tool and Web server)

• Data Integrator Multi-byte (only selectable if you have selected one

of the above components)

• Technical Manuals (includes the Release Summary, Release Notes,

and Tutorial)

Click Next.

11. In the Select Program Folder window, accept or edit the program

directory, and click Next.

12. In the Start Copying Files window, review your configuration settings and

if correct, click Next. The Setup Status window displa ys progress in copying files. The installer

creates a system variable, LINK_DIR, that defines the path used by the Data Integrator components.

13. In the Data Integrator Repository Manager window, decide if you want to

create or upgrade a repository now or later.

• To defer creating or upgrading repositories, click the second option to

continue.

• Otherwise click the first option and proceed to “Creating or upgrading

repositories in batch mode” on page 90.

14. If Central Management Server (CMS) exists on the same computer that

you are installing Data Integrator, the Metadata Integrator window appears. This window asks if you want to configure the Metadata Integrator now or later. Note that you can configure the Metadata Integratorlater with the

• To keep the default option that skips configuring the Metadata

Integrator, click Next and proceed to “To enter locale information” on page 79.

78 Data Integrator Getting Started Guide

cmsConfig command.

Installing Data Integrator on Windo ws Systems

Running the installation program

• To configure Metadata Integrator now, select Configure Metadata

Integrator, click Configure, and proceed to “Configuring the

Metadata Integrator” on page 87.

To enter locale informati o n



1. In the Locale window, accept the default language, territory, and code

page settings (same as the host’s computer) or select others and click

OK.

Note: Here the locale (language, territory, and code page) determines

how the Data Integrator Job Server and engine process data. Data Integrator uses international standards for language and territory codes. A code page specifies the encoding for a particular character set. Asian scripts require multi-byte code pages (typically two-byte characters). For more information, see Chapter 9, “Locales and Multi-Byte Functionality,”

in the Data Integrator Reference Guide.

2. The installation program displays the Data Integrator Server Manager

Utility window:

• If you did not select Data Integrator Job Server in the Product

Components window or do not want to configure Job Servers now, skip to “To configure Access Servers” on page 82.

• If you selected Data Integrator Job Server in the Product

Components window and want to configure Job Servers now, proceed to the next section, “To configure Job Servers”.

To configure Job Servers



1. In the Data Integrator Server Manager window, click Edit Job Server

Config.

2. In the Job Server Configuration Editor window, click Add to add a Job

Server.

Data Integrator Getting Started Guide 79

Installing Data Integrator on Windo ws Systems

Running the installation program

3. In the Job Server Properties window, enter information about the Job

Server.

Property Description

Job Server name Enter a name that uniquely identifies the Job

Job Server port Enter the TCP/IP port that the Job Server uses

Support Adapter and SNMP communication

Communication port

Enable SNMP Enables this Job Server to send events to the

Server. The Job Server name cannot be changed.

to receive commands from the Designer and the Access Server. If a computer host s multiple Jobs Servers, each Job Server must have a unique port number. Choose a port number for a server that is not used by another process on the computer. If you are unsure of which port number to use, use the default port number and increment it for each additional Job Server you configure.

Select this check box if the Job Server manages adapters or if this Job Server will be the one to communicate with an SNMP agent. Each computer that hosts adapters and an SNMP agent must have exactly one Job Server designated to manage them.

Enter the port number that the Job Server uses for communicating with adapters or an SNMP agent. The default is 4001.

SNMP agent. For more information, see “SNMP

support” on page 549 of the Data Integrator

Designer Guide.

4. Under Associated Repositories, enter the repositories associated with

this Job Server. Every Job Server must be associated with at least one local repository.

a. Click Add to associate a new local repository with this Job Server. b. Under Repository Information, enter the required connection

information for the repository.

c. Do not enter a blank or invalid password; this may prohibit you from

logging on to Data Integrator.

d. Select the Default repository check box if this is the default

repository for this Job Server. You must specify exactly one default repository.

80 Data Integrator Getting Started Guide

Installing Data Integrator on Windo ws Systems

Running the installation program

e. Click Revert to undo these entries. f. Click Apply to save your entries and associate the repository with

the Job Server.

g. The associated repository updates with the Job Server’s computer

name and port number.

h. Repeat these steps until you are done adding all associated

repositories.

5. Edit and delete associated repositories as necessary. a. Select a repository and click Edit to change the repository’s default

setting.

• Under Repository Information, enter the password.

• Select or clear the Default repository check box, indicating

whether this is the default repository for the Job Server.

• Click Apply to save the change, or click Revert to make no

changes.

b. Select a repository and click Delete to remove an associated

repository.

• Under Repository Information, enter the password.

• Click Apply to remove this associated repository, or click Revert

to make no changes.

6. When you are finished adding all associated repositories, including one

default, click OK.

7. From the Job Server Configuration Editor window, complete any other

necessary steps. You can:

• Add another Job Server

a. Click Add. b. Repeat steps 3 through 6.

• Change a Job Server’s configuration

a. Select the Job Server. b. Click Edit. c. Repeat steps 3 through 6.

• Remove a Job Server

a. Select the Job Server. b. Click Delete.

Data Integrator Getting Started Guide 81

Installing Data Integrator on Windo ws Systems

Running the installation program

Note: If the Job Server has associated repositories, you must first

delete those and then click OK before you can delete the Job Server.

• Resynchronize your Job Server configuration with a repository

a. Select the Job Server. b. Click Resync with Repository. c. In the Job Server Properties window, select an associated

repository.

d. Click Resync. e. Under Repository Information, enter the repository password. f. Click Apply.

Cases when you must resynchronize the Job Server and repository include:

• You have uninstalled Data Integrator and are reinstalling the

same Data Integrator version without creating a new repository.

• You created a new repository using the Repository Manager

after installing Data Integrator.

If you resynchronize your Job Server configuration with a repository, you must reassociate this repository with the Administrator and the metadata reporting tool. See the Data Integrator Administrator Guide.

8. When you have configured all the Job Servers you want, click OK.

9. You return to the Data Integrator Server Manager window:

• If you did not select Data Integrator Administrator in the Select

Components window or do not want to configure Access Servers now, skip to “To restart servers” on page 83.

• If you selected Data Integrator Administrator in the Select

Components window and want to configure Access Servers now, proceed to the next section “To configure Access Servers”.

To configure Access Servers



When you configure the location for an Access Server installation, Data Integrator creates space for the Access Server log files.

1. In the Data Integrator Server Manager window , click Edit Access Server

Config.

2. In the Access Server Configuration Editor window, click Add.

82 Data Integrator Getting Started Guide

Installing Data Integrator on Windo ws Systems

Running the installation program

3. In the Access Server Properties window, enter the Access Server

configuration information.

Field Description

Directory The location of the log files for this instance of

the Access Server. Do not change this value after the initial configuration.

Communication Port

Parameters You can leave this box blank. Access Server

Enable Access Server

Click OK. You return to the Access Server Configuration Editor window:

4. Optionally, perform further actions:

The port on this computer that the Access Server uses to communicate with the Administrator.

Make sure that this port number is unused and is unique for each Access Server.

parameters are described in “Configuring

Access Server output” on page 90 of the Data

Integrator Administrator Guide. An option to control the automatic start of the

Access Server when the Data Integrator Service starts.

• To change an Access Server’s configuration:

In the Access Server Configuration Editor window, highlight the Access Server, click Edit, and repeat step 3.

• To remove an Access Server:

In the Access Server Configuration Editor window, highlight the Access Server and click Delete.

5. After you configure your Access Servers, click OK to return to the Data

Integrator Server Manager window. Continue with the next section, “To restart servers”.



To restart servers

1. In the Data Integrator Server Manager window, identify the account

information that the Data Integrator Service uses to access system services. Click Restart. The Data Integrator Service starts.

Note: You must specify a Windows user account and password to start

the Data Integrator Service and access other Data Integrator-related applications on your network. The installation process automatically uses the current Windows user account to install the service. However,

Data Integrator Getting Started Guide 83

Installing Data Integrator on Windo ws Systems

Running the installation program

Business Objects recommends that you not use your personal Windows user account to run the Data Integrator Service. You must configure this account with the right to “log on as a service.”

2. In the Information window, click OK.

The Data Integrator Web Server starts. When the Installation window informs you that installation is complete, click OK.

3. If the Data Integrator CD is still in the CD-ROM drive, remove it.

4. In the InstallShield Wizard Complete window, click Yes to restart your

computer, or click No to restart your computer later. Click Finish.

Note: To ensure that items like Web Services and adapter instances work

properly with Data Integrator, Business Objects recommends that you restart your computer as soon as possible after completing the installation process.

To configure SMTP e-mail



The Server Manager is also where you specify SMTP server settings for the smtp_to e-mail function. For details, see “To define and enable the

smtp_to function” on page 527 of the Data Integrator Reference Guide.

To reset the ports for the Data Integrator Web server



Note: The Data Integrator Web Server uses a Tomcat server as a servlet

engine. When you install the Administrator, you also automatically install the Data Integrator Web Server and its service. The Web Server service uses port 22828 to communicate with the Web Server. The Web Server uses port 28080 as its HTTP port. If either port is used by another application, you must change them.

1. Go to the Data Integrator Directory\ext\WebServer\conf directory and

open the server-di.xml file.

2. Locate the tag:

Change the value of this port.

3. Locate the tag:

<Connector className="org.apache.catalina

connector.http.Http.service.Connector" port ="28080"/>

Change the value of this port.

4. Restart the Data Integrator Service and Data Integrator Web Server.

84 Data Integrator Getting Started Guide

Installing Data Integrator on Windo ws Systems

Running the installation program

Verifying that Job and Access Servers are running

To verify that Job Servers are running, check in the Windows Task Manager Processes tab for:

• al_jobservice.e (represents the Data Integrator service)

• al_jobserver.ex (one per Job Server)

• aL_AccessServer (one per Access Server)

If you do not see all the processes expected, check for error messages in these log files:

• Job Server logs are in

Data Integrator Directory\log\ JobServerName\server_eventlog.txt

• Access Server logs are in

AccessServerPathName\error_mm_dd_yyyy.log

To perform a connectivity test for the Access Server, see “Verifying

connectivity” on page 93.

Installing and Configuring the Metadata Integrator

The Metadata Integrator reads through Crystal Reports, Business View, Universe, and Web Intelligence document definitions on a Central Management Server (CMS) to find the tables and columns used by the reports, views, and documents. The Metadata Integrator stores the information in Data Integrator repository for impact analysis and lineage analysis. You can install the Metadata Integrator on multiple CMS systems and store the report information in one Data Integrator repository.

This section describes the following topics:

• Installing Metadata Integrator

• Installation tips and troubleshooting

• Configuring the Metadata Integrator

Installing Metadata Integrator

You can install the Metadata Integrator on multiple CMS systems and store the report information in one Data Integrator repository.

Installing on the same computer as Data Integrator

If Central Management Server (CMS) exists on a the same computer as Data Integrator, the Data Integrator installation wizard installs the Metadata Integrator automatically.

Data Integrator Getting Started Guide 85

Installing Data Integrator on Windo ws Systems

Running the installation program

You have the option to configure the Metadata Integrator during Data Integrator installation, or you can defer configuration. For configuration details, see “To configure the Metadata Integrator” on page 88.

Installing on a different computer than Data Integrator

In many cases, your Central Management Server resides on a separate computer than Data Integrator. Use the following procedure to run the standalone installation of the Metadata Integrator.

T o install Metadata Integrator on a different computer than Data



Integrator

1. Insert the Data Integrator Installation CD into your CD-ROM drive (or

download from the Business Objects web site). The main installation window appears with several options.

2. Click Install Metadata Integrator.

3. In the Location window, indicate a directory into which Metadata

Integrator will be installed. The default is

c:\Program Files\Business Objects\Metadata Integrator

Accept the default or browse to choose a different directory. Click

4. In the Metadata Integrator Manager window, decide if you want to

configure the Metadata Integrator now or later.

Next.

• The default option is to skip configuring the Metadat a Integrator. You

can configure the Metadata Integrator later with the command. If you want to keep the default option, click Next.

• Otherwise, select the first option, click Configure, and proceed to

“To configure the Metadata Integrator” on page 88.

Installation tips and troubleshooting

Below are several Metadata Integrator installation tips and problems that you can troubleshoot:

Configuration fails during install

If configuration fails during installation, check the cmsConfig_err.log file in linkdir/ext/cmsCollector. If you see the following error, the Crystal SDK is not installed.

java.lang.NoClassDefFoundError: com/crystaldecisions/sdk/exception/SDKException at com.acta.crystalrepo.config.crConfigFrame.setupWizardPage

s(crConfigFrame.java:84)

at com.acta.crystalrepo.config.crConfigFrame.run(crConfigFra

me.java:73)

86 Data Integrator Getting Started Guide

cmsConfig

Installing Data Integrator on Windo ws Systems

Running the installation program

at com.acta.crystalrepo.config.crConfigLaunch.main(crConfigL

aunch.java:68)Exception in thread "main"

To install the Crystal SDK, rerun the configuration utility:

linkdir/ext/cmsCollector/cmsConfig.cmd

Changing Data Integrator repository connection information

To change the Data Integrator repository connection information supplied during configuration, run the configuration utility:

linkdir/ext/cmsCollector/cmsConfig.cmd

Metadata Collector fails to start with java version error

If the Metadata collector indicates the run has failed, click the run instance to view the error log. If the error indicates the java runtime environment cannot be found or is the wrong version, you must define the JAVA_HOME environment variable.

To define the JAVA_HOME environment variable, add the environment variable and reboot your machine for it to take effect. Java 1.3.1 or higher is required. JAVA_HOME must be set to the java runtime root directory. For example:

JAVA_HOME=C:\Program Files\Java\j2re1.4.2_03

Metadata Collector fails to start

If the Metadata collector indicates the run has failed, click the run instance to view the error log. The error indicates you do not have the permission to run the program.

Press the Process tab and select Logon to determine the user name and password used to run the collector. To check the permissions, press the Rights tab to see what permissions are set. If you do not have permission to run programs, check with your Crystal Administrator to get the correct permission.

Metadata Integrator runs but report information is missing

From the Crystal Administrator console, click the run instance for the Metadata Integrator even though it says the run was successful. The collector will only be in a failed state if Crystal is unable to start the program. There is no mechanism to get runtime errors listed as a failed run. The work around is to look at successful runs to see if any errors are reported.

Configuring the Metadata Integrator

Invoke the Metadata Integration Configuration window with one of the following actions:

Data Integrator Getting Started Guide 87

Installing Data Integrator on Windo ws Systems

Running the installation program

• During Data Integrator installation on the computer where CMS resides,

click Configure on the Metadata Integrator Manager window.

• During standalone installation for the Metadata Integrator when CMS is

installed on a different computer than Data Integrator, click Configure on the Metadata Integrator Manager window.

• If you deferred the configuration or you want to modify the configuration,

enter the following command in a CMD window on the computer where CMS exists:

cmsConfig

If Data Integrator exists on the same computer as CMS, this command is in the directory LINK_DIR/ext/cmsCollector.

If Data Integrator does not exist on the same computer as CMS, this command exists is the directory that you chose to install the Metadata Integrator. For more information, see “To install Metadata Integrator on a

different computer than Data Integrator” on page 86.

T o configure the Metadata Integrator



1. When the Metadata Integration Configuration window displays, enter the

following information to connect to the Data Integrator repository . Consult your database administrator if you need assistance with these values.

Option Description

Database type The database type of the Data Integrator

Computer Name Host name on which the Data Integrator repository

Database Port Port number that the Central Management Server

Service Name/SID, Database name, Server name, or Data source

88 Data Integrator Getting Started Guide

repository.

The available database types are:

• DB2

• Informix

• Microsoft SQL Server

• Oracle

• Sybase ASE

resides.

(CMS) uses to connect to the Data Integrator repository.

This field requires additional information based on the Database Type you select.

Installing Data Integrator on Windo ws Systems

Running the installation program

Option Description

User name The login name to connect to the Data Integrator

repository.

Password The login password to connect to the repository.

2. Click Next.

The Business Objects Enterprise window displays.

3. Enter the following CMS connection information on the Business Objects

Enterprise window. Consult your Business Objects administrator if you need assistance with these values.

Option Description

Central Management Server Name

CMS User Name The user name to connect to the CMS server to

CMS Password The password to connect to the CMS server to

CMS Authentication Mode

CMS Folder Name The folder in which the CMS system adds the

Host name of the CMS server.

register and execute the Metadata Integrator . If you want a different user to execute the Metadata Integrator, use the Central Management Console to change the rights for the user. See the Business Objects Administrator’s Guide for details.

Objects Administrator’s Guide for available modes.

Metadata Integrator as a program object. This folder is only visible in the Business Objects Central Management Console. The default value is

Data Integrator (the wizard creates this folder if

it does not exist).

4. Click Next.

The status window for Metadata Integrator Configuration displays.

5. Click Finish.

Starting Data Integrator services automatically

The Data Integrator Service and Data Integrator Web Server service start automatically when the computer restarts. The Data Integrator Service, in turn, starts Job Servers and Access Servers on the restarted computer.

You can change service startup to Manual in the Windows Services window.

Data Integrator Getting Started Guide 89

Installing Data Integrator on Windo ws Systems

Configuring repositories after installation

Logging in to the Administrator

After an Access Server is running, you can configure it using the Data Integrator Administrator. From the St art menu, select Programs > BusinessObjects Data Integrator version > Web Administrator.

admin). See the Data Integrator Administrator Guide for more

Configuring repositories after installation

To check the version, to upgrade, or to create a repository after installation:

1. From the Start > Programs > D ata Integrator menu, choose

Repository Manager.

2. To check the version of an existing repository, select Get version.

3. To create or upgrade repositories, follow the procedure in “Creating or

upgrading repositories in batch mode” on page 90.

Creating or upgrading repositories in batch mode

admin) and

You can use the executable called RepoManBatch.exe (stored in the Data Integrator installation/bin directory) to create or update repositories in batch mode. Specify parameters using a command prompt.

For example:

RepoManBatch -Usa -P -NMicroSoft_SQL_Server -SServer -QJake

-c -tcentral -d

RepoManBatch -UJake -PJake -NOracle -Sdbsvr -v

90 Data Integrator Getting Started Guide

Installing Data Integrator on Windo ws Systems

Configuring Job Servers or Access Servers after installation

Usage:

Flag Description

-U Repository login user

-P Repository login password

-S Repository server name:

• Microsoft SQL Server: database server name

• Oracle: database connection name

• DB2: data source

• Sybase ASE: server

• Informix: data source

-N Repository database type:

• Microsoft_SQL_Server

• DB2

• Oracle

• Informix

• Sybase

-Q Repository database

• Microsoft SQL Server: database name

• Sybase ASE: database name

-t Repository Type: local, central

-c Repository create

-u Repository upgrade

-v Repository version

-d Show Details

Configuring Job Servers or Access Servers after installation

To create, edit, or delete Job Servers and Access Servers after installation:

1. From the Start > Program > Data Integrator menu, choose Server

Manager.

Data Integrator Getting Started Guide 91

Installing Data Integrator on Windo ws Systems

Recovering from installation errors

2. The Data Integrator Server Manager Utility window opens. This window

shows the Job Servers and Access Servers currently configured to run on your computer.Follow the procedures in “To configure Job Servers” on page 79 and/or “To configure Access Servers” on page 82.

3. Follow the procedure in “To restart servers” on page 83.

To configure the Metadata Integrator after installation, see “Configuring the

Metadata Integrator” on page 87.

Recovering from installation errors

Errors that prevent installation progress (for example an incorrect server name, user name, or password) result in an immediate error message describing the problem.

For help with Metadata Integrator installation issues, see “Inst allation tips and

troubleshooting” on page 86.

Repository problems

Common installation errors include:

• The DBMS connection was lost while building the repository t ables. If this

happens, run the installation program again.

• There is not enough space available in the database for the repository

tables. If this happens, use your DBMS administration tools to allocate more space for the repository and run the installation program again.

If you experience problems when upgrading or creating a repository, you can select the Show Details check box before you click Update or Create again. This option allows you to view the SQL code that Data Integrator uses to perform these operations. The Show Details option can help you diagnose problems.

Administrator problems

If you cannot log in to the Administrator using the default user name and password, change the Web Server startup properties to a user account instead of a local system account or verify that the local system account has sufficient privileges to run executable files. Then stop and restart the Web Server’s service and try again.

92 Data Integrator Getting Started Guide



To locate service startup properties for the Web Server

On Windows 2000 or XP, go to Start > Settings > Administrative Tools > Services, double-click Data Integrator Web Server, and select the Log On

tab.

Verifying connectivity

This section describes specific steps that you can follow to test Data Integrator’s real-time features after installation. These step-by-step procedures use sample files available in the Data Integrator installation.

Distributing the test files

The Data Integrator installation and the installation CD include test files to exercise connectivity between each component of the Data Integrator system. To perform the connectivity test, place test files in the appropriate locations on the various computers used in your application.

In this list, the Data Integrator directory represents the location where you installed Data Integrator.

Installing Data Integrator on Windo ws Systems

Verifying connectivity

Test file Copy from Copy to

ClientTest.exe Data Integrator\Bin Web client computer, C:\temp mny2412d.dll Data Integrator\Bin Web client computer, C:\temp functor2312d.dll Data Integrator\Bin Web client computer, C:\temp functor_list2312d.dll Data Integrator\Bin Web client computer, C:\temp itc2312d.dll Data Integrator\Bin Web client computer, C:\temp network1712d.dll Data Integrator\Bin Web client computer, C:\temp pointer2312d.dl Data Integrator\Bin Web client computer, C:\temp sync2312d.dll Data Integrator\Bin Web client computer, C:\temp thread2312d.dll Data Integrator\Bin Web client computer, C:\temp threxcept2312d.dll Data Integrator\Bin Web client computer, C:\temp tls7712d.dll Data Integrator\Bin Web client computer, C:\temp ClientTest.txt Data Integrator\ConnectivityTest Web client computer, C:\temp TestIn.xml Data Integrator\ConnectivityTest Web client computer, C:\temp TestIn.xml Data Integrator\ConnectivityTest Designer computer, C:\temp

Data Integrator Getting Started Guide 93

Installing Data Integrator on Windo ws Systems

Verifying connectivity

Test file Copy from Copy to

TestIn.dtd Data Integrator\ConnectivityTest Designer computer, C:\temp TestOut.dtd Data Integrator\ConnectivityTest Designer computer, C:\temp

Note: You must keep the DLL files specified in the preceding table with

ClientTest.exe. To move ClientTest.exe, re-run the Message Client

Setup and point it to the directory you want. For more information, see

“Installing Message Client libraries” on page 100.

You need not move the Designer computer.

TestConnectivity.atl file from its location on the

Testing a job

When you execute a real-time job from the Designer, it always executes in “test mode” using a file as input and producing a file as output.

The test files include a sample job and data flow that you can use to verify that a real-time job can successfully execute from the Designer. Test files include the XML test input for the flow (the string corresponding DTD for flow input and output.

This procedure describes how to import, display, execute, and show output for the test flow.

Hello World) and the

To test a job



1. Start Data Integrator and log into your repository.

From the Start menu, choose Programs > BusinessObjects Data Integrator version > Data Integrator Designer from the program group

created by the Data Integrator installation. The Designer prompts you for login information associated with your repository database.

2. From the Tools menu, select Import from File.

3. Navigate in the Data Integrator install directory to \ConnectivityTest.

4. Select the test ATL file

5. In the Project menu, select New > Project.

6. Name the project

7. In the Jobs tab of the object library, expand the Real-time Jobs

category; then click, drag, and drop TestConnectivity folder in the Project area.

8. In the workspace, click the name of the data flow.

94 Data Integrator Getting Started Guide

TestConnectivity.atl and click Open.

TestConnectivity and click Create.

Job_TestConnectivity over the

roject

Flow

Installing Data Integrator on Windo ws Systems

Verifying connectivity

9. In the project area, right-click Job_TestConnectivity and select Execute.

10. In the Execution Properties window, click OK.

Data Integrator reads the sample file order of the two words in the string, and writes the output to the

C:\Temp\TestOut.XML file.

11. Read the information in the Job Log window to verify if the

file is correct. Use the job log information to troubleshoot problems.

12. If the job was successful, navigate to the C:\Temp\ directory on the

Designer’s computer and open

C:\Temp\TestIn.XML, inverts the

TestOut.XML

TestOut.xml.

Data Integrator Getting Started Guide 95

Installing Data Integrator on Windo ws Systems

Verifying connectivity

You can display the file in a browser or text editor.

Testing the path from client to service

When your real-time job runs in a normal production environment, you can use it to process a service request from a Web client. In production, Web clients send messages and real-time services receive and process those messages, triggering real-time jobs. Use the Administrator to set up real-time services.

T o process a service request from a Web client



1. Add and start the service in the Administrator.

The Access Server starts service providers which are instances of jobs associated with the listed services.

2. Send a request from your Web client to the Access Server.

The Access Server sends a request to the appropriate service provider, then the service provider sends a response to the Access Server. The Access Server returns the response to the Web client.

The following procedures briefly describe how to connect a repository to the Administrator, start an Access Server, configure interfaces among components, and use the provided test Web client to verify that your configuration works.

For more detailed information about working with the Administrator, see the Data Integrator Administrator Guide.

Configuring the Access Server

The Administrator allows you to view the status of services controlled by the Access Server and to change their configuration.

96 Data Integrator Getting Started Guide

Installing Data Integrator on Windo ws Systems

Verifying connectivity

After you install the Access Server, the Data Integrator service automatically launches the Access Server when your computer restarts or when you stop and start the service.

To start the Administrator



1. Go to Start > Programs > Business Objects Data Integrator 6.1 >

Data Integrator Web Administrator.

The Administrator Web browser opens. If it does not appear:

• Check that the port number is not being used by another application.

• Use a static IP address instead of the host name to locate the

Administrator computer.

2. Log in to the Administrator using the default name (admin) and password

(admin).

To add your repository for Administrator access



1. In the Administrator, select Management > Repositories > Add.

2. Enter your repository connection information and click Apply.

To configure the Access Server to listen for responses from services



1. In the Administrator, add a connection to an installed Access Server by

selecting Management > Access Servers > Add.

2. Enter your Access Server’s machine name and communication port,

select Ping to test the connection, then click Apply.

To add a service



1. In the Administrator’s navigation tree, select Real-time > “Access

Server Machine Name: Port”> Real-time Services > Configuration.

2. Click Add.

The Access Server adds a service to the list ( the configuration boxes for the new service.

3. Enter the following sample information in the Configuration section for

the service. Accept the default values for the service parameters.

Field Test Values Description

Service Name TestConnectivity The message type included in the

Job Name Job_TestConnectivity Browse jobs.

Data Integrator Getting Started Guide 97

NewService1) and displays

call from the client.

Installing Data Integrator on Windo ws Systems

Verifying connectivity

4. Click Apply.

The Administrator prompts you to assign a Job Server to the Service.

5. Under Job Servers for Service, click Add.

6. If you have one Job Server, the Administrator automatically selects it for

you. Click Apply. Otherwise, select a Job Server from the list and click Apply.

7. Click the Status tab.

The Administrator adds the new service (named after the job) and a service provider to the list for this service. In the status row for each service provider, find the computer name and Job Server port where the service provider is running. The process ID for the service provider is related to this invocation of the Job Server.

8. Verify host name and port number for the new service provider.

In the list of service providers, verify that the host name and port for the new service provider correctly indicate the computer where the Job Server is installed and the port that the Job Server is configured to use.

You specified the Job Server port number when you configured the Job Server at installation.

9. In the navigation tree, click Real-Time Services to return to the first

Real-Time Service Status page. The name of the Service should be next to a green icon which indicates

that the Service started successfully. When a service starts, the Administrator triggers the Access Server

which triggers the Job Server to get job information from the repository. The job registers as a service with the Access Server. The Administrator displays the service status (

If the service did not start, you can start it manually from the current page. If the service still will not start, See “Resolving connectivity problems” on page 177 of the Data Integrator Administrator Guide for help determining the possible cause of the failure.

started).

Web client to Access Server

A Web client opens a connection to the Access Server using a call in the Message Client library. The call includes the host and port information required to make the connection.

The

ClientTest executable file provided in the Data Integrator installation

incorporates the library calls so you can easily test the connection between the Web client computer and the Access Server.

98 Data Integrator Getting Started Guide

Installing Data Integrator on Windo ws Systems

Verifying connectivity



To process a test request

1. On the computer where your Web client application is installed, send a

request for Data Integrator to process. Copy the command,

command prompt:

ClientTest -AHost -pPort -Uuser -Ppassword

-STestConnectivity -XC:\Temp\TestIn.XML

where

Host Identifies the Access Server host computer by name or IP

Port Identifies the port on which Access Server listens for Web

user Indicates the user name you specified in the Security

password Indicates the password you specified in the Security

TestConnectivity Specifies the name of the service that you want to invoke.

C:\Temp\ClientTest.txt and enter it in a

address.

client requests.

section of the Access Server configuration file. The test configuration does not specify a user, but the Client Test utility expects some value. Enter any character.

section of the Access Server configuration file. The test configuration does not specify a password, but the Client Test utility expects some value. Enter any character.

C:\Temp\TestIn.XML

Indicates the location of the sample XML request that will be sent to the Access Server for processing.

2. Look for the response in the command prompt.

If the correct response displays, your system is configured properly. If an error occurs, see “Monitoring clients” on page 86 of the Data Integrator Administrator Guide for assistance debugging the problem.

3. When you are ready to configure the Access Server to run your own

services, first stop the Access Server, then restart it.

Further connectivity tests

There are more tests you can run to define that all the connections you will need. For example, you can use the existing Access Server configuration and make changes to the data flow and input files in the sample real-time job. In particular, consider making simple additions to the data flow in the real-time job to check the following connections:

• From job to Rapid Mart

Data Integrator Getting Started Guide 99

Installing Data Integrator on Windo ws Systems

Updating licenses

To test this connection, add a Rapid Mart table as a source in a data flow in the real-time job and extract a single value to return as a response to the client.

• From job to ERP system

To test this connection, add a source from the ERP system in a dat a flow of the real-time job and extract a single value to return as a response to the client.

Updating licenses

You can manage Data Integrator licenses on Windows platforms using local licenses.

T o update a license under local license management



You might need to update a license or upgrade a license from evaluation to permanent.

1. Replace the old license file (in the Data Integrator install directory’s

\license subdirectory) with the new license file.

2. If you are adding additional Data Integrator components, reinstall Data

Integrator.

3. If you are not adding additional Data Integrator components, simply stop

and restart the Data Integrator service.

Installing Message Client libraries

The Message Client libraries support C++, Java, and COM connections between the Data Integrator Web Server and the Access Server.

If you are updating your Message Client library, you must stop your Web application, install the Message Client library files, then restart your Web application computer.

Note: The Java client library is a single library (rather than .class files); find it

in LINK_DIR\lib\acta_broker_client.jar.

To install a Message Client library



1. On the computer running the Web application, insert the Data Integrator

installation CD. The main Data Integrator installation program starts automatically. When

it does, click Exit.

100 Data Integrator Getting Started Guide

Business objects DATA INTEGRATOR 11.0.1 User Manual

Specifications and Main Features

Frequently Asked Questions

User Manual

Contents

Welcome

Audience and assumptions

Data Integrator product documentation

Suggested reading path

Introducing the Data Integration Platform

Business Objects Data Integration Platform

Data Integrator product benefits

Single point of integration

High availability and performance

Packaged data access through Rapid Marts

Data Integrator interfaces

Data Integrator functional summary

Loading data

Applying transactions

Data Integrator Architecture

Standard Data Integrator components

Data Integrator Job Server

Data Integrator engine

Data Integrator Designer

Data Integrator repository

Data Integrator Access Server

Data Integrator Administrator

Data Integrator Metadata Reporting tool

Data Integrator Web Server

Data Integrator Service

Data Integrator SNMP Agent

Data Integrator Adapter SDK

Optional Data Integrator components

Data Integrator Multi-user

Data Integrator management tools

License Manager

Repository Manager

Server Manager

Data Integrator operating system platforms

Data Integrator distributed architecture

Resource distribution

Network security options

Data warehouse with external Web server in DMZ

Firewall between data warehouse and external Web server

Application server behind a firewall

Access validation

Host names and port numbers

Preparing to Install Data Integrator

System installation overview

System requirements

Data Integrator repository requirements

Database requirements

Data Integrator Designer requirements

Software

Hardware

Data Integrator Job Server requirements

Software

Hardware

Data Integrator Access Server requirements

Software

Hardware

Data Integrator Administrator requirements

Software

Hardware

Pre-installation tasks

Web applications communicating with Data Integrator

Determine component distribution

Obtain license keys

Check port assignments

Create a database for each repository

Check network connections

Data Integrator licenses

License types

Unrestricted

Restricted

Evaluation

Emergency

Permanent

Optional license-controlled features

Managing your licenses