SAP Business objects DATA SERVICES Migration Considerations Guide
Data Services Migration
Considerations Guide
BusinessObjects Data Services XI 3.1 (12.1.1)
Copyright
© 2008 Business Objects, an SAP company. All rights reserved. Business Objects
owns the following U.S. patents, which may cover products that are offered and
licensed by Business Objects: 5,295,243; 5,339,390; 5,555,403; 5,590,250;
5,619,632; 5,632,009; 5,857,205; 5,880,742; 5,883,635; 6,085,202; 6,108,698;
6,247,008; 6,289,352; 6,300,957; 6,377,259; 6,490,593; 6,578,027; 6,581,068;
6,628,312; 6,654,761; 6,768,986; 6,772,409; 6,831,668; 6,882,998; 6,892,189;
6,901,555; 7,089,238; 7,107,266; 7,139,766; 7,178,099; 7,181,435; 7,181,440;
7,194,465; 7,222,130; 7,299,419; 7,320,122 and 7,356,779. Business Objects and
its logos, BusinessObjects, Business Objects Crystal Vision, Business Process
On Demand, BusinessQuery, Cartesis, Crystal Analysis, Crystal Applications,
Crystal Decisions, Crystal Enterprise, Crystal Insider, Crystal Reports, Crystal
Vision, Desktop Intelligence, Inxight and its logos , LinguistX, Star Tree, Table
Lens, ThingFinder, Timewall, Let There Be Light, Metify, NSite, Rapid Marts,
RapidMarts, the Spectrum Design, Web Intelligence, Workmail and Xcelsius are
trademarks or registered trademarks in the United States and/or other countries
of Business Objects and/or affiliated companies. SAP is the trademark or registered
trademark of SAP AG in Germany and in several other countries. All other names
mentioned herein may be trademarks of their respective owners.
Third-party
Contributors
Business Objects products in this release may contain redistributions of software
licensed from third-party contributors. Some of these individual components may
also be available under alternative licenses. A partial listing of third-party
contributors that have requested or permitted acknowledgments, as well as required
notices, can be found at: http://www.businessobjects.com/thirdparty
2008-11-28
Contents
Introduction 9Chapter 1
Welcome to Data Services........................................................................10
Data Services Migration Considerations 17Chapter 2
Behavior changes in version 12.1.1..........................................................18
Behavior changes in version 12.1.0..........................................................20
Behavior changes in version 12.0.0..........................................................26
Welcome..............................................................................................10
Documentation set for Data Services...................................................10
Accessing documentation....................................................................13
Business Objects information resources..............................................14
Blob data type enhancements..............................................................19
Neoview bulk loading...........................................................................20
Cleansing package changes................................................................21
DTD-to-XSD conversion.......................................................................21
Minimum requirements for international addressing directories...........22
Try/catch exception groups..................................................................22
Upgrading from version 12.0.0 to version 12.1.0.................................25
Case transform enhancement..............................................................26
Data Quality projects in Data Integrator jobs ......................................27
Data Services web address..................................................................27
Large object data type enhancements.................................................28
License keycodes.................................................................................31
Locale selection....................................................................................31
ODBC bigint data type..........................................................................33
Persistent and pageable cache enhancements...................................33
Data Services Migration Considerations Guide 3
Contents
Row delimiter for flat files.....................................................................33
Behavior changes in version 11.7.3...........................................................34
Data flow cache type............................................................................35
Job Server enhancement.....................................................................35
Logs in the Designer............................................................................35
Pageable cache for memory-intensive data flows................................35
Adapter SDK........................................................................................36
PeopleSoft 8.........................................................................................36
Behavior changes in version 11.7.2...........................................................36
Embedded data flows...........................................................................37
Oracle Repository upgrade..................................................................37
Solaris and AIX platforms.....................................................................39
Behavior changes in version 11.7.0...........................................................39
Data Quality..........................................................................................40
Distributed data flows...........................................................................42
JMS Adapter interface..........................................................................43
XML Schema enhancement.................................................................43
Password management........................................................................43
Repository size.....................................................................................44
Web applications..................................................................................44
Web services........................................................................................44
Behavior changes in version 11.6.0...........................................................45
Netezza bulk loading............................................................................45
Conversion between different data types.............................................46
Behavior changes in version 11.5.1.5........................................................46
Behavior changes in version 11.5.1...........................................................46
Behavior changes in version 11.5.0.0........................................................47
Web Services Adapter..........................................................................47
Varchar behavior..................................................................................47
Central Repository................................................................................48
Behavior changes in version 11.0.2.5........................................................48
4 Data Services Migration Considerations Guide
Contents
Teradata named pipe support...............................................................48
Behavior changes in version 11.0.2...........................................................48
Behavior changes in version 11.0.1.1........................................................49
Statistics repository tables....................................................................49
Behavior changes in version 11.0.1...........................................................49
Crystal Enterprise adapters..................................................................50
Behavior changes in version 11.0.0...........................................................50
Changes to code page names.............................................................51
Data Cleansing.....................................................................................52
License files and remote access software...........................................53
Behavior changes in version 6.5.1............................................................53
Behavior changes in version 6.5.0.1.........................................................54
Web services support...........................................................................54
Sybase bulk loader library on UNIX.....................................................55
Behavior changes in version 6.5.0.0.........................................................55
Browsers must support applets and have Java enabled......................55
Execution of to_date and to_char functions.........................................56
Changes to Designer licensing............................................................57
License files and remote access software...........................................57
Administrator Repository Login............................................................58
Administrator Users..............................................................................59
Data Quality to Data Services Migration 61Chapter 3
Overview of migration................................................................................62
Who should migrate?...........................................................................62
Why migrate?.......................................................................................62
Introduction to the interface..................................................................64
Downloading blueprints and other content objects..............................66
Introduction to the migration utility........................................................67
Terminology in Data Quality and Data Services...................................67
Naming conventions.............................................................................69
Data Services Migration Considerations Guide 5
Contents
Deprecated objects..............................................................................70
Premigration checklist..........................................................................72
Using the migration tool.............................................................................73
Overview of the migration utility...........................................................73
Migration checklist................................................................................74
Connection information........................................................................75
Running the dqmigration utility ............................................................76
dqmigration utility syntax and options..................................................79
Migration report ...................................................................................83
How Data Quality repository contents migrate..........................................85
How projects and folders migrate.........................................................85
How connections migrate.....................................................................91
How substitution files and variables migrate........................................97
How data types migrate......................................................................102
How Data Quality attributes migrate..................................................103
How transforms migrate...........................................................................103
Overview of migrated transforms.......................................................103
Address cleansing transforms............................................................111
Reader and Writer transforms............................................................121
How Data Quality integrated batch Readers and Writers migrate.....159
How Data Quality transactional Readers and Writers migrate...........165
Matching transforms...........................................................................169
UDT-based transforms.......................................................................178
Other transforms................................................................................188
Suggestion Lists options....................................................................202
Post-migration tasks................................................................................203
Further cleanup .................................................................................203
Improving performance .....................................................................210
Troubleshooting..................................................................................215
6 Data Services Migration Considerations Guide
Contents
Index 223
Data Services Migration Considerations Guide 7
Contents
8 Data Services Migration Considerations Guide
Introduction
1
Introduction
1
Welcome to Data Services
This document contains the following migration topics:
• Migration considerations for behavior changes associated with each
version of the Data Integrator and Data Services products.
• Migration of your Data Quality Projects into Data Services.
Welcome to Data Services
Welcome
Data Services XI Release 3 provides data integration and data quality
processes in one runtime environment, delivering enterprise performance
and scalability.
The data integration processes of Data Services allow organizations to easily
explore, extract, transform, and deliver any type of data anywhere across
the enterprise.
The data quality processes of Data Services allow organizations to easily
standardize, cleanse, and consolidate data anywhere, ensuring that end-users
are always working with information that's readily available, accurate, and
trusted.
Documentation set for Data Services
You should become familiar with all the pieces of documentation that relate
to your Data Services product.
What this document providesDocument
Documentation Map
Release Summary
Release Notes
10 Data Services Migration Considerations Guide
Information about available Data Services books,
languages, and locations
Highlights of key features in this Data Services release
Important information you need before installing and
deploying this version of Data Services
Introduction
Welcome to Data Services
What this document providesDocument
1
Getting Started Guide
Installation Guide for Windows
Installation Guide for UNIX
Advanced Development Guide
Designer Guide
Integrator's Guide
Management Console: Administrator
Guide
Management Console: Metadata Reports Guide
Migration Considerations Guide
An introduction to Data Services
Information about and procedures for installing Data
Services in a Windows environment.
Information about and procedures for installing Data
Services in a UNIX environment.
Guidelines and options for migrating applications including information on multi-user functionality and
the use of the central repository for version control
Information about how to use Data Services Designer
Information for third-party developers to access Data
Services functionality. Also provides information about
how to install, configure, and use the Data Services
Adapter for JMS.
Information about how to use Data Services Administrator
Information about how to use Data Services Metadata
Reports
Information about:
• Release-specific product behavior changes from
earlier versions of Data Services to the latest release
• How to migrate from Data Quality to Data Services
Performance Optimization Guide
Reference Guide
Information about how to improve the performance
of Data Services
Detailed reference material for Data Services Designer
Data Services Migration Considerations Guide 11
Introduction
1
Welcome to Data Services
Technical Manuals
What this document providesDocument
A compiled “master” PDF of core Data Services books
containing a searchable master table of contents and
index:
•
Getting Started Guide
•
Installation Guide for Windows
•
Installation Guide for UNIX
•
Designer Guide
•
Reference Guide
•
Management Console: Metadata Reports Guide
•
Management Console: Administrator Guide
•
Performance Optimization Guide
•
Advanced Development Guide
•
Supplement for J.D. Edwards
•
Supplement for Oracle Applications
•
Supplement for PeopleSoft
•
Supplement for Siebel
•
Supplement for SAP
Tutorial
A step-by-step introduction to using Data Services
In addition, you may need to refer to several Adapter Guides and
Supplemental Guides.
What this document providesDocument
Salesforce.com Adapter
Interface
Supplement for J.D. Edwards
Supplement for Oracle Applications
Supplement for PeopleSoft
12 Data Services Migration Considerations Guide
Information about how to install, configure, and use the Data
Services Salesforce.com Adapter Interface
Information about license-controlled interfaces between Data
Services and J.D. Edwards World and J.D. Edwards OneWorld
Information about the license-controlled interface between Data
Services and Oracle Applications
Information about license-controlled interfaces between Data
Services and PeopleSoft
Introduction
Welcome to Data Services
What this document providesDocument
1
Supplement for SAP
Supplement for Siebel
Information about license-controlled interfaces between Data
Services, SAP ERP, and SAP BI/BW
Information about the license-controlled interface between Data
Services and Siebel
Accessing documentation
You can access the complete documentation set for Data Services in several
places.
Accessing documentation on Windows
After you install Data Services, you can access the documentation from the
Start menu.
1. Choose Start > Programs > BusinessObjects XI 3.1 >
BusinessObjects Data Services > Data Services Documentation.
Note:
Only a subset of the documentation is available from the Start menu. The
documentation set for this release is available in LINK_DIR\Doc\Books\en.
2. Click the appropriate shortcut for the document that you want to view.
Accessing documentation on UNIX
After you install Data Services, you can access the online documentation by
going to the directory where the printable PDF files were installed.
1. Go to LINK_DIR/doc/book/en/.
2. Using Adobe Reader, open the PDF file of the document that you want
to view.
Data Services Migration Considerations Guide 13
Introduction
1
Welcome to Data Services
Accessing documentation from the Web
You can access the complete documentation set for Data Services from the
Business Objects Customer Support site.
1.
Go to http://help.sap.com.
2. Cick Business Objects at the top of the page.
You can view the PDFs online or save them to your computer.
Business Objects information resources
A global network of Business Objects technology experts provides customer
support, education, and consulting to ensure maximum business intelligence
benefit to your business.
Useful addresses at a glance:
ContentAddress
14 Data Services Migration Considerations Guide
Introduction
Welcome to Data Services
ContentAddress
1
Customer Support, Consulting, and Education
services
http://service.sap.com/
Data Services Community
https://www.sdn.sap.com/irj/sdn/businessob
jects-ds
Forums on SCN (SAP Community Network)
https://www.sdn.sap.com/irj/sdn/businessob
jects-forums
Blueprints
http://www.sdn.sap.com/irj/boc/blueprints
Information about Customer Support programs,
as well as links to technical articles, downloads,
and online forums. Consulting services can
provide you with information about how Business Objects can help maximize your business
intelligence investment. Education services can
provide information about training options and
modules. From traditional classroom learning
to targeted e-learning seminars, Business Objects can offer a training package to suit your
learning needs and preferred learning style.
Get online and timely information about Data
Services, including tips and tricks, additional
downloads, samples, and much more. All content is to and from the community, so feel free
to join in and contact us if you have a submission.
Search the Business Objects forums on the
SAP Community Network to learn from other
Data Services users and start posting questions
or share your knowledge with the community.
Blueprints for you to download and modify to fit
your needs. Each blueprint contains the necessary Data Services project, jobs, data flows, file
formats, sample data, template tables, and
custom functions to run the data flows in your
environment with only a few modifications.
Data Services Migration Considerations Guide 15
Introduction
1
Welcome to Data Services
http://help.sap.com/
ContentAddress
Business Objects product documentation.Product documentation
Documentation mailbox
documentation@businessobjects.com
Supported platforms documentation
https://service.sap.com/bosap-support
Send us feedback or questions about your
Business Objects documentation. Do you have
a suggestion on how we can improve our documentation? Is there something that you particularly like or have found useful? Let us know,
and we will do our best to ensure that your
suggestion is considered for the next release
of our documentation.
Note:
If your issue concerns a Business Objects
product and not the documentation, please
contact our Customer Support experts.
Get information about supported platforms for
Data Services.
In the left panel of the window, navigate to
Documentation > Supported Platforms >
BusinessObjects XI 3.1. Click the BusinessObjects Data Services link in the main window.
16 Data Services Migration Considerations Guide
Data Services Migration Considerations
2
Data Services Migration Considerations
2
Behavior changes in version 12.1.1
This chapter describes behavior changes associated with the Data Integrator
product since version 6.5 and in Data Services since 12.0.0 including Data
Quality functionality. Each behavior change is listed under the version number
in which the behavior originated.
For information about how to migrate your Data Quality Projects into Data
Services, see Data Quality to Data Services Migration on page 61.
For the latest Data Services technical documentation, consult the Data
Services Technical Manuals included with your product.
This Migration Considerations document contains the following sections:
•
Behavior changes in version 12.1.1 on page 18
•
Behavior changes in version 12.1.0 on page 20
•
Behavior changes in version 12.0.0 on page 26
•
Behavior changes in version 11.7.3 on page 34
•
Behavior changes in version 11.7.2 on page 36
•
Behavior changes in version 11.7.0 on page 39
•
Behavior changes in version 11.6.0 on page 45
•
Behavior changes in version 11.5.1 on page 46
•
Behavior changes in version 11.5.0.0 on page 47
•
Behavior changes in version 11.0.2.5 on page 48
•
Behavior changes in version 11.0.2 on page 48
•
Behavior changes in version 11.0.1.1 on page 49
•
Behavior changes in version 11.0.1 on page 49
•
Behavior changes in version 11.0.0 on page 50
•
Behavior changes in version 6.5.1 on page 53
•
Behavior changes in version 6.5.0.1 on page 54
•
Behavior changes in version 6.5.0.0 on page 55
To read or download Data Integrator and Data Services documentation for
previous releases (including Release Summaries and Release Notes), see
the SAP Business Objects Help Portal at http://help.sap.com/.
Behavior changes in version 12.1.1
The following sections describe changes in the behavior of Data Services
12.1.1 from previous releases of Data Services and Data Integrator. In most
cases, the new version avoids changes that would cause existing applications
18 Data Services Migration Considerations Guide
to modify their results. However, under some circumstances a change has
been deemed worthwhile or unavoidable.
If you are migrating from Data Quality to Data Services, see Data Quality to
Data Services Migration on page 61.
This section includes migration-specific information associated with the
following features:
•
Blob data type enhancements on page 19
•
Neoview bulk loading on page 20
Blob data type enhancements
Data Services 12.1.1 provides the following enhancements for binary large
object (blob) data types:
• You can now define blob data type columns in a fixed-width file format,
and you can read from and load to blob columns in fixed-width files
• The dqmigration utility now migrates Data Quality binary data types in
fixed-width flat files to Data Services blob (instead of varchar) data types
in fixed-width file formats. You no longer need to change the data type
from varchar to blob after migration.
Data Services Migration Considerations
Behavior changes in version 12.1.1
2
In a fixed-width file, the blob data is always inline with the rest of the data in
the file. The term "inline" means the data itself appears at the location where
a specific column is expected.
The 12.1.0 release of Data Services introduced support for blob data types
in a delimited file. In a delimited file, the blob data always references an
external file at the location where the column is expected. Data Services
automatically generates the file name.
The following table summarizes the capabilities that each release provides
for blob data types:
<<Filename>>Inline
File Type
12.1.112.1.012.1.112.1.0
YesYesNoNoblob in delimited file
NoNoYesNoblob in fixed-width file
Data Services Migration Considerations Guide 19
Data Services Migration Considerations
2
Behavior changes in version 12.1.0
These capabilities help customers migrate their existing Data Quality projects
that handle binary data in flat files to Data Services fixed-width file formats.
The Data Services blob data type now supports blob data types from Data
Quality XI R2 and legacy Firstlogic products.
Related Topics
• Reference Guide: Data Types, blobs
Neoview bulk loading
If you plan to bulk load data to a Neoview database, we recommend that
you set Timeout to 1000 in your Neoview target table.
• If you create a new repository in version 12.1.1, you do not need to set
Timeout because its default value is 1000.
• If you use a 12.1.0 repository when you install version 12.1.1, the default
value for Timeout is 60. Therefore, increase Timeout to 1000 for new
data flows that bulk load into a Neoview database.
Related Topics
• Reference Guide: Data Services Objects, HP Neoview target table options
Behavior changes in version 12.1.0
The following sections describe changes in the behavior of Data Services
12.1.0 from previous releases of Data Services and Data Integrator. In most
cases, the new version avoids changes that would cause existing applications
to modify their results. However, under some circumstances a change has
been deemed worthwhile or unavoidable.
If you are migrating from Data Quality to Data Services, see the Data Quality
to Data Services Migration Guide.
This section includes migration-specific information associated with the
following features:
•
Cleansing package changes on page 21
•
DTD-to-XSD conversion on page 21
•
Minimum requirements for international addressing directories on page 22
•
Try/catch exception groups on page 22
20 Data Services Migration Considerations Guide
•
Upgrading from version 12.0.0 to version 12.1.0 on page 25
Cleansing package changes
Global Parsing Options have been renamed cleansing packages.
You can no longer use the Global Parsing Options installer to install cleansing
packages directly into the repository. You must now use a combination of
the cleansing package installer and the Repository Manager instead.
If you have made any changes to your existing cleansing package
dictionaries, you must do the following:
1. Export the changes using Export Dictionary Changes in the Dictionary
menu of the Data Services Designer.
2. Install the latest cleansing package.
3. Use the Repository Manager to load the cleansing package into the data
cleanse repository.
4. Import the changes into the new cleansing package using Bulk Load in
the Dictionary menu in the Designer.
Data Services Migration Considerations
Behavior changes in version 12.1.0
2
Related Topics
• Designer Guide: Data Quality, To export dictionary changes
• Installation Guide for Windows: To create or upgrade repositories
• Designer Guide: Data Quality, To import dictionary changes
DTD-to-XSD conversion
Data Services no longer supports publishing a DTD-based real-time job as
a Web service if the job uses a DTD to define the input and output messages.
If you migrate from Data Services 12.0.0 to version 12.1.0, you do not need
to do anything unless you change the DTD. If you change the DTD, reimport
it to the repository and publish the Web service as in the following procedure.
If you migrate from Data Integrator 11.7 or earlier versions to Data Services
12.1.0 and publish a DTD-based real-time job as a Web service, you must
reimport the Web service adapter function because the Web address changed
for the Management Console in version 12.0.0. Therefore, you must do the
following after you upgrade your repository to version 12.1.0:
Data Services Migration Considerations Guide 21
Data Services Migration Considerations
2
Behavior changes in version 12.1.0
1. Use any DTD-to-XSD conversion tool to convert the DTD to XSD.
2. Use the Designer to import the XSD to the Data Services repository.
3. Open the original data flow that is using the DTD and replace it with XSD.
4. Publish the real-time job as Web service.
5. Reimport the service as a function in the Web Service datastore.
Related Topics
• Data Services web address on page 27
Minimum requirements for international addressing directories
Due to additional country support and modified database structures (for
performance tuning), the minimum disk space requirement for the international
addressing directories (All World) has increased as follows:
• For the Global Address Cleanse transform (ga_country.dir,
ga_loc12_gen.dir, ga_loc12_gen_nogit.dir, ga_loc34_gen.dir,
ga_region_gen.dir), the minimum requirement has increased from 647
MB to 2.71 GB.
• If you purchase all countries, the the disk space requirement has increased
from 6.1 GB to 9.34 GB.
Try/catch exception groups
This version of Data Services provides better defined exception groups of
errors, new exception groups, and an enhanced catch editor that allows you
to select multiple exception groups in one catch to consolidate actions.
After you upgrade your repository to version 12.1, your try/catch blocks
created in prior versions contain the 12.1 exception group names and
numbers. Be aware of the following situations and additional actions that
you might need to take after you upgrade to version 12.1:
• The repository upgrade will map Parser errors (1) and Resolve errors (2)
to Execution errors (1000) and will map email errors(16) to System
Resource errors (1008). You need to re-evaluate all the actions that are
already defined in all the catch blocks and modify them as appropriate,
22 Data Services Migration Considerations Guide
Data Services Migration Considerations
Behavior changes in version 12.1.0
based on the new catch exception group definitions. See the tables below
for the mapping of exception groups from version 12.0 to version 12.1
and for the definitions of new exception groups.
• All recoverable jobs in a pre-12.1 system lose their recoverable state
when you upgrade. After you upgrade to version 12.1, you need to run
the job from the beginning.
• If you upgrade a central repository, only the latest version of a work flow,
data flow audit script, and user function contain the 12.1 exception group
names. Older versions of these objects contain the pre-12.1 exception
group names.
• In version 12.1, if you have a sequence of catch blocks in a workflow and
one catch block catches an exception, the subsequent catch blocks will
not be executed. For example, if your work flow has the following
sequence and Catch1 catches an exception, then Catch2 and CatchAll
will not execute. In prior versions, both Catch1 and CatchAll will execute.
Try > DataFlow1 > Catch1 > Catch2 > CatchAll
Note:
If you import pre-12.1 ATL files, any catch objects will not contain the new
exception group names and numbers. Only a repository upgrade converts
the pre-12.1 exception groups to the 12.1 exception group names and
numbers.
2
The following table shows how the exception groups in version 12.0 map to
the exception groups in version 12.1:
12.0 Exception
group (group
number)
Catch All Exceptions
Parser Errors (1)
12.0 Description
Errors encountered while
parsing the language
Data Services Migration Considerations Guide 23
12.1 Exception
group (group
number)
Pre-execution errors (1000)
12.1 Description
All errorsAll exceptionsAll errors
Parser errors are not
caught because parsing
occurs prior to execution.
Data Services Migration Considerations
2
Behavior changes in version 12.1.0
12.0 Exception
group (group
number)
Resolver Errors (2)
Execution Errors
(5)
Database Access
Errors (7)
File Access Errors
(8)
12.0 Description
Errors encountered while
validating the semantics
of Data Services objects
which have recommended resolutions
Internal errors that occur
during the execution of a
data movement specification
Generic Database Access
Errors
Errors accessing files
through file formats
12.1 Exception
group (group
number)
Pre-execution errors (1000)
Execution errors
(1001)
Database Access
Errors (1002)
Flat file processing
errors (1004)
File Access Errors
(1005)
12.1 Description
Resolver errors are not
caught because parsing
occurs prior to execution.
Errors from the Data Services job server or transforms
Errors from the database
server while reading data,
writing data, or bulk loading to tables
Errors processing flat files
Errors accessing local
and FTP files
Repository Access
Errors (10)
Connection and
bulk loader errors
(12)
Predefined Transforms Errors (13)
ABAP Generation
Errors (14)
R/3 Execution Errors (15)
24 Data Services Migration Considerations Guide
Errors accessing the Data
Services repository
Errors connecting to
database servers and
bulk loading to tables on
them
Predefined transform errors
ABAP generation errors
R/3 execution errors
Repository access
errors (1006)
Database Connection errors (1003)
R/3 system errors
(1007)
Errors accessing the Data
Services repository
Errors connecting to
database servers
Errors while generating
ABAP programs, during
ABAP generated user
transforms, or while accessing R/3 system using
its API
Data Services Migration Considerations
Behavior changes in version 12.1.0
2
12.0 Exception
group (group
number)
System Exception
Errors (17)
Engine Abort Errors (20)
The following table shows the new exception groups in version 12.1:
New 12.1 Exception group (group
number)
XML processing errors (1010)
COBOL copybook errors (1011)
12.0 Description
Email errorsEmail Errors (16)
System exception errors
Engine abort errors
12.1 Exception
group (group
number)
System Resource
errors (1008)
Execution errors
(1001)
Description
Errors from the SAP BW system.SAP BW execution errors (1009)
Errors processing XML files and
messages
Errors processing COBOL copybook
files
12.1 Description
Errors while accessing or
using operating system
resources, or while sending emails
Errors from the Data Services job server or transforms
Errors processing Excel booksExcel book errors (1012)
Data Quality transform errors (1013)
Errors processing Data Quality
transforms
Upgrading from version 12.0.0 to version 12.1.0
If you are installing version 12.1.0 and the installer detects a previous
installation of version 12.0, you will be prompted to first uninstall version
12.0. The installer will maintain your configuration settings if you install in
the same directory.
Data Services Migration Considerations Guide 25
Data Services Migration Considerations
2
Behavior changes in version 12.0.0
If you are installing version 12.1.0 on top of version 11.x, you do not need
to uninstall the previous version.
Behavior changes in version 12.0.0
The following sections describe changes in the behavior of Data Services
12.0.0 from previous releases of Data Integrator. In most cases, the new
version avoids changes that would cause existing applications to modify their
results. However, under some circumstances a change has been deemed
worthwhile or unavoidable.
If you are migrating from Data Quality to Data Services, see the Data Quality
to Data Services Migration Guide.
This section includes migration-specific information associated with the
following features:
•
Case transform enhancement on page 26
•
Data Quality projects in Data Integrator jobs on page 27
•
Data Services web address on page 27
•
Large object data type enhancements on page 28
•
License keycodes on page 31
•
Locale selection on page 31
•
ODBC bigint data type on page 33
•
Persistent and pageable cache enhancements on page 33
•
Row delimiter for flat files on page 33
Case transform enhancement
In this version, you can choose the order of Case expression processing to
improve performance by processing the less CPU-intensive expressions
first. When the Preserve case expression order option is not selected in
the Case transform, Data Services determines the order to process the case
expressions. The Preserve case expression order option is available only
when the Row can be TRUE for one case only option is selected.
By default, the Row can be TRUE for one case only option is selected and
the Preserve case expression order option is not selected. Therefore,
when you migrate to this version, Data Services will choose the order to
process your Case expressions by default.
26 Data Services Migration Considerations Guide
Data Services Migration Considerations
Behavior changes in version 12.0.0
However, the reordering of expressions can change your results because
there is no way to guarantee which expression will evaluate to TRUE first.
If your results changed in this version and you want to obtain the same results
as prior versions, select the Preserve case expression order option.
Data Quality projects in Data Integrator jobs
To do data cleansing in version Data Integrator 11.7, you created a Data
Qualilty datastore and imported integrated batch projects as Data Quality
transforms. When these imported Data Quality transforms were used in an
11.7 job, the data was passed to Data Quality for cleansing, and then passed
back to the Data Integrator job.
In Data Services 12, the Data Quality transforms are built in. Therefore, if
you used imported Data Quality transforms in Data Integrator 11.7, you must
replace them in Data Services with the new built-in Data Quality transforms.
Related Topics
• Modifying Data Integrator 11.7 Data Quality projects on page 161
• Migrating Data Quality integrated batch projects on page 159
• How integrated batch projects migrate on page 89
2
Data Services web address
In this release, Data Integrator has become part of Data Services. Therefore,
the Web address has changed for the Management Console. In previous
releases, the Web address used "diAdmin" as the following format shows:
http://computername:port/diAdmin
In Data Services, the Web address uses DataServices:
http://computername:port/DataServices
Therefore, when you migrate to Data Services you must make changes in
the following situations:
Data Services Migration Considerations Guide 27
Data Services Migration Considerations
2
Behavior changes in version 12.0.0
• If you created a bookmark that points to the Management Console in a
previous release, you must update the bookmark to the changed Web
address.
• If you generated a Web Service Definition Language (WSDL) file in a
previous version of Data Integrator, you must regenerate it to use the
changed Web address of the Administrator.
Large object data type enhancements
Data Services 12.0 extends the support of large objects as follows:
• Adds support for binary large object (blob) data types from the currently
supported database systems (Oracle, DB2, Microsoft SQL Server, and
so on).
• Extends support for character large object (clob) and national character
object (nclob) data types to other databases.
Prior versions treat the clob and nclob data types as long data types, and
this version continues to treat them as long data types.
The following table shows the large data types that version 11.7 supports
as long data types and the additional large data types that version 12 now
supports. If your pre-version 12 jobs have sources that contain these
previously unsupported large data types and you now want to use them in
version 12, you must re-import the source tables and modify your existing
jobs to select these newly supported data types.
28 Data Services Migration Considerations Guide
Data Services Migration Considerations
Table 2-4: Database large object data types supported
Behavior changes in version 12.0.0
2
Database
DB2
Informix
Database data type
LONG VARCHAR
LONG VARGRAPHIC
LVARCHAR
Category
VAR
CHAR
Version
11.7 supports
Version
12.0 supports
Version
12.0 data
type
LONGYesYesCLOB
LONGYesYesCLOBCLOB
LONGYesNoNCLOB
LONGYesNoNCLOBDBCLOB
BLOBYesNoBLOBBLOB
VARCHARYesYes
LONGYesYesCLOBTEXT
BLOBYesNoBLOBBYTE
LONGYesYesCLOBCLOB
BLOBYesNoBLOBBLOB
Microsoft
SQL Server
VARCHAR
(max)
NVARCHAR
(max)
VARBINA
RY(max)
LONGYesYesCLOBTEXT
LONGYesNoNCLOBNTEXT
LONGYesNoCLOB
LONGYesNoNCLOB
BLOBYesNoBLOBIMAGE
BLOBYesNoBLOB
Data Services Migration Considerations Guide 29
Data Services Migration Considerations
2
Behavior changes in version 12.0.0
Database
MySQL
ODBC LONGYesNoNCLOB
Oracle
Database data type
SQL_LONG
VARCHAR
SQL_WLONG
VARCHAR
SQL_LONG
VARBINARY
Category
Version
11.7 supports
Version
12.0 supports
Version
12.0 data
type
LONGYesYesCLOBTEXT
BLOBYesNoBLOBBLOB
LONGYesYesCLOB
BLOBYesNoBLOB
LONGYesYesCLOBLONG
BLOBYesNoBLOBLONGRAW
LONGYesYesCLOBCLOB
LONGYesYesNCLOBNCLOB
BLOBYesNoBLOBBLOB
Sybase ASE
LONG VAR-
Sybase IQ
12.6 or later
Teradata
30 Data Services Migration Considerations Guide
CHAR
LONG BINARY
LONG VARCHAR
LONGYesNoCLOBTEXT
BLOBYesNoBLOBIMAGE
LONGYesYesCLOB
BLOBYesNoBLOB
LONGYesYesCLOB
LONGYesYesCLOBCLOB
BLOBYesNoBLOBBLOB
Loading...