Mathworks SYSTEMTEST RELEASE NOTES

SystemTest™ Release Notes

How to Contact The MathWorks

www.mathworks. comp.soft-sys.matlab Newsgroup www.mathworks.com/contact_TS.html Technical Support

suggest@mathworks.com Product enhancement suggestions

bugs@mathwo doc@mathworks.com Documentation error reports service@mathworks.com Order status, license renewals, passcodes

info@mathwo

com

rks.com

Web

Bug reports

Sales, prici

ng, and general information

508-647-7000 (Phone)

508-647-7001 (Fax)

The MathWorks, Inc. 3 Apple Hill Drive Natick, MA 01760-2098

For contact information about worldwide offices, see the MathWorks Web site.

SystemTest™ Release Notes

The software described in this document is furnished under a license agreement. The software may be used or copied only under the terms of the license agreement. No part of this manual may be photocopied or reproduced in any form without prior written consent from The MathW orks, Inc.

FEDERAL ACQUISITION: This provision applies to all acquisitions of the Program and Documentation by, for, or through the federal government of the United States. By accepting delivery of the Program or Documentation, the government hereby agrees that this software or documentation qualifies as commercial computer software or commercial computer software documentation as such terms are used or defined in FAR 12.212, DFARS Part 227.72, and DFARS 252.227-7014. Accordingly, the terms and conditions of this Agreement and only those rights specified in this Agreement, shall pertain to and govern theuse,modification,reproduction,release,performance,display,anddisclosureoftheProgramand Documentation by the federal government (or other entity acquiring for or through the federal government) and shall supersede any conflicting contractual terms or conditions. If this License fails to meet the government’s needs or is inconsistent in any respect with federal procurement law, the government agrees to return the Program and Docu mentation, unused, to The MathWorks, Inc.

Trademarks

MATLAB and Simulink are registered trademarks of The MathWorks, Inc. See

www.mathworks.com/trademarks for a list of additional trademarks. Other product or brand

names may be trademarks or registered trademarks of their respective holders.

Patents

The MathWorks products are protected by one or more U.S. patents. Please see

www.mathworks.com/patents for more information.

Summary by Version ............................... 1

Contents

Version 2.5 (R2010a) SystemTest Software

Version 2.4 (R2009b) SystemTest Software

Version 2.3 (R2009a) SystemTest Software

Version 2.2 (R2008b) SystemTest Software

Version 2.1 (R2008a) SystemTest Software

Version 2.0 (R2007b) SystemTest Software

Version 1.1 (R2007a) SystemTest Software

Version 1.0.1 (R2006b) SystemTest Software

Version 1.0 (R2006a+) SystemTest Software

Compatibility Sum mary for SystemTest Software

........... 4

........... 7

........... 10

........... 13

........... 16

........... 24

........... 27

.......... 29

.......... 30

.... 31

iii

iv Contents

SummarybyVersion

This table provides quick access to what’s new in each version. For clarification, see “Using Release Notes” on page 1 .

SystemTest™ Release Notes

Version (Release)

Latest Versi V2.5 (R2010a

V2.4 (R2009b)

V2.3 (R2009a)

V2.2 (R2

V2.1 (R2008a)

V2.0 (R2007b)

R2007a)

V1.1 (

V1.0.1 (R2006b)

)

008b)

New Features and Changes

Yes Details

Yes

Detai

Yes Details

No No Yes

Version Compatibilit Consideratio

Yes Summary

No Bug Reports

Yes Summary

Yes Summa

Yes Summary

Fixed Bugs and Known Problems

Bug Reports Includes fix

Bug Reports Includes fixes

Bug Repor Includes

Includes fixes

Bug Reports Includes fixes

Bug Re Inclu

Bug Reports Includes fixes

Details

fixes

ports

des fixes

Related Documentation at Web Site

Printable R elease Notes: PDF

Current product documentation

V1.0 (R2006a+)

Yes Det

ails

No No No

Using Release Notes

Use release notes when upgrading to a newer version to learn about:

• New features

SystemTest™ Release Notes

• Changes

• Potential impact on your existing files and practices

Review the release notes for other MathWorks™ products required for this product (for example, MATLAB

or Simulink®). Determine if enhancements,

bugs, or compatibility considerations in other products impact you.

If you are upgrading from a software version other than the m ost recent one, review the current release notes and all interim versions. For example, when you upg rade from V1.0 to V1.2, review the release notes for V1.1 and V1.2.

What Is in the Release Notes

New Features and Changes

• New functionality

• Changes to existing functionality

Version Compatibility Con si derations

When a new feature or change introduces a reported incompatibility between versions, the Compatibility Considerations subsection explains the impact.

Compatibility issues reported after the product release appear under Bug Reports at The MathWorks™ Web site. Bug fixes can sometimes result in incompatibilities, so review the fixed bugs in Bug Reports for any compatibility impact.

Fixed Bugs and Known Problems

The MathWorks offers a user-searchable Bug Reports database so you can view Bug Reports. The development team updates this database at release time and as more information becomes available. Bug Reports include provisions for any known workarounds or file replacem ents. Information is available for bugs existing in or fixed in Release 14SP2 or later. Information is not avail able for all bugs in earlier releases.

Access Bug Reports using y our MathWorks Account.

SummarybyVersion

SystemTest™ Release Notes

Version 2.5 (R2010a) SystemTest Software

This table summarizes what’s new in Version 2.5 (R2010a):

New Features and Changes

Yes Details below

Version Compatibility Considerations

Yes Summary

New features and changes introduced in this version are:

• “Test Case Editor and Signal Authoring” on page 4

• “Support for Requirements Linking” on page 5

• “Test Property Enhancements” on page 5

• “Plot Element Transition, Conversion Utility” on page 5

Fixed Bugs an d Known Problems

Bug Reports Includes fixes

Related Documentation at Web Site

Printable Release Notes: PDF

Current product documentation

Test Case Editor and Signal Authoring

You can create signals in the SystemTest™ software and use them to test a Simulink model. The Test Case Editor provides a graphical way of creating, editing, and visualizing signal data in SystemTest.

The tool provides the ability to create signals based on commonly used patterns and to specify values for attributes of those signal segments. You can easily create the following types of signals: constant, step, ramp, pulse, square, sine, and custom.

The tool also allows you to view and manage signals, and to organize them into test cases. You can manage a large number of test cases and signals. The Test Case Editor is accessed through the Test Case Data test vector in the SystemTest software.

For information on using the Test Case Editor, see “Authoring Signals in theTestCaseEditor”.

Version 2.5 (R2010a) SystemTest™ Software

Support for Requirements Linking

You can link test cases created in the new Test Case Editor to requirements that are in Telelogic DOORS intheTestCaseEditor. TheintegrationallowsyoutoeasilylinkanyDOORS requirements to any test cases by selecting them by their object headings.

. ThisisdonethroughtheRequirements tab

For more information on linking requirements to test cases, see “Linking to Requirements in Telelogic

DOORS®”

Test Property Enhancements

Further enhancements were added to saving of results files in the Test Properties pane. New output folder options for the test results and the Test

Report allow you to select between several relative lo catio n s, which makes moving or sharing files easier, or to assign an absolute location.

The options for r esu lts files are now on a new tab, Output Files,onthe Test Properties pane.

For more information see “Saving Test Results” and “Generating a Test Report”, or the Desktop Help for the Output Files tab.

Plot Element Transition, Conversion Utility

The Vector Plot and Scalar Plot elements have been replaced by the General Plot element that was introduced in R2008b. The General Plot element supports all MATLAB plot types. You can plot any type of data, using any MATLAB plot types or Simulink data.

The General Plot element has special support for the many time-based data formats produced from a Simulink model. The supported data types include an array, a structure, a structure with time, or a time series. You can also plot Simulink data provided by test vectors, such as the Sig nal Builder Block test vector, the Simulink Design Verifier Data File test vector, or the Spreadsheet Data test vector.

Note You can no longer create new Scalar Plot or Vector Plot elements. They no longer appear in the Insert menu or the New Element button.

SystemTest™ Release Notes

Conversion Utility

Tests containing Scalar Plot or Vector Plot elements will not automatically load with those elements. You will be prompted to convert them to General Plot elements.

For information on performing the conversion, and conversion details about the Scalar Plot and Vector P lot elements, see “Deprecated Elements”.

Compatibility Considerations

The following outline describes the timing of the transition process:

• R2009a and R2009b — You should no longer create new Vector Plot or

Scalar Plot elements. Tests containing the old elements continued to work, but we recommended that you do not create any new ones, and instead use the General Plot element.

• R2010a (current version) — You can no longer create new Vector Plot

or Scalar Plot elements. They no longer appear in the Insert menu or the New Element button. A warning will appear if you load a test containing the old elements. T ests containing th e old elements will continue to work, but you cannot create any new ones.

You will not lose the use of the old elements in existing tests. Previously created Vector Plot and Scalar Plot elements will be converted to the General Plot element. See the previous section.

• A future release — You can no longer load tests containing Vector Plot

or Scalar Plot elements. If you try to load one, you will get an error, and will have to convert the element to the General Plot element. Previously created Vector Plot and Scalar Plot elements will be converted to the General Plot element.

Version 2.4 (R2009b) SystemTest™ Software

Version 2.4 (R2009b) SystemTest Software

This table summarizes what’s new in Version 2.4 (R2009b):

New Features and Changes

Yes Details below

Version Compatibility Considerations

Yes Summary

New features and changes introduced in this version are:

• “Test Vector Data Viewer” on page 7

• “Test Property Enhancements” on page 7

• “Minor Enhancements to Simulink Element” on page 8

• “Plot Element Transition” on page 8

Fixed Bugs an d Known Problems

Bug Reports Includes fixes

Related Documentation at Web Site

Test Vector Data Viewer

You can now view the test vector data while configuring a Probability Distribution test vector. The viewer will display non-time-based data for this type of test v ector, allowing you to view your data before running a test.

Probability Distribution test vector data is displayed in a histogram. To access the data viewer, click the View Data button in the Insert Test Vector dialog box.

For m ore information see “Viewing Data While Configuring the Test Vector”.

Test Property Enhancements

Enhancements were added to saving of results files in the Test Properties pane. New output folder options for the test results and the Test Report allow you to select between several relative locations, which makes moving or sharing files easier, or to assign an abs olute location.

For more information see “Saving Test Results” and “Generating a Test Report”.

SystemTest™ Release Notes

Minor Enhanceme

Minor enhanceme an easier way to e importing all s

nts have been done in the Simulink element, including xtract time data and changing the model end time when

ignals.

Plot Element T

The Vector Plo Plot element supports all MATLAB plot t

The General formats pro an array, a plot Simul Block test Spreadsh

t and Scalar Plot elements are being replaced by the General

that was introduced in R2008b. The General Plot element

MATLABplottypes. Youcanplotanytypeofdata,usingany

ypes or Simulink data.

Plot element has special support for the many time-based data

duced from a Simulink model. The supported data types include

structure, a structure with time, or a time series. You can also ink data provided by test vectors, such as the Signal Builder vector, the Simulink Design Verifier Data File test vector, or the

eet Data test vector.

nts to Simulink Element

ransition

Compatibility Considerations

The foll

• R2009a a

owing outline describes the timing of the transition process:

nd R2009b — You should no longer create new Vector Plot or Scalar to work recomm

Plot elements. Tests containing the old elements will continue

, but we recommend that you do not create any new ones. We

end using the General Plot element.

• Afutu

Plot e eleme cann

You w crea Gene

• Afu

or S wil

re release — You can no longer create new Vector Plot or Scalar

lements. A warning will appear if you load a test containing the old

nts. Tests containing the old elements will continue to work, but you

ot create any new ones.

ill not lose the use of the old elements in existing tests. Previously

ted Vector Plot and Scalar Plot elements will be converted to the

ral Plot element.

ture release — You can no longer load tests containing Vector Plot

calar Plot elements. If you try to load one, you will get an error, and

l have to convert the element to the General Plot element. Previously

Version 2.4 (R2009b) SystemTest™ Software

created Vector Plot and Scalar Plot elements will be converted to the General Plot element.

SystemTest™ Release Notes

Version 2.3 (R2009a) SystemTest Software

This table summarizes what’s new in Version 2.3 (R2009a):

New Features and Changes

Yes Details below

Version Compatibility Considerations

Yes Summary

New features and changes introduced in this version are:

• “MAT-File Test Vector” on page 10

• “Automatic Naming of Test Vectors and Test Variables” on page 10

• “Enhanced Inport Support for the Simulink Element” on page 11

• “Additional Editing Capability for Test Vectors” on page 11

• “Plot Element Transition” on page 11

Fixed Bugs an d Known Problems

Bug Reports Includes fixes

Related Documentation at Web Site

MAT-File Test Vector

A new MAT-file test vector has been added. It reads data from individual MAT-files into the SystemTest environment. For more information on this feature, see “Creating MAT-File Test Vectors”.

Automatic Naming of Test Vectors and Test Variables

A new feature has been added to the Simulink element to make creating or mapping test vectors and test variables easier. You now have the option of automatically naming test vectors and test variables from the names used in the model inports and outports. Thisisparticularlyusefulfortesting Simulink models with large numbers of inports or outports.

This feature is accessed by clicking the Mappings Assistant buttoninthe Simulink element. For more information about this feature, see the Desktop Help for the S imulink element (in the Desktop Help pane when the Simulink element is selected), the subtopics called Using the Inport Block Mappings Assistant,andUsing the Model Output Mappings Assistant.

Version 2.3 (R2009a) SystemTest™ Software

Enhanced Inport Support for the Simulink Element

Enhanced support has been added in the Simulink element for logged signals, including time series and bus signals.

You can feed data logg ed from a Simulink model to Inport blocks of another model using the Simulink element a nd a MAT-File test vector that contains the logged signal data.

A common usage scenario is to log the signals while running a model and store them in a MAT-File. Then acquire them from the Mat-File using a MAT-File test vector and map that to Inport blocks in the Simulink element. For more information on this feature, see “Mapping Logged Signals from a Model to Inport Blocks”.

Additional Editing Capability for Test Vectors

You can now edit test vectors from within elements. In prior versions of the SystemTest software, you could only edit test v ectors from the Test Vectors pane. Now you can edit them there, as well as from within individual elements.

Plot Element Transition

The Vector Plot and Scalar Plot elements are being replaced by the new General Plot element that was introduced in R2008b. The General Plot element supports all MATLAB plot types. You can plot any type of data, using any MATLAB plot types or Simulink data.

Compatibility Considerations

The following outline describes the timing of the transition process:

SystemTest™ Release Notes

• Version R2009a — Customers should no longer create new Vector Plot

or Scalar Plot elements. Tests containing the old elements will continue to work, but we recommend that you do not create any new ones. We recommend using the General Plot element.

• Version R2009a + 1 — Customers can no longer create new Vector Plot or

Scalar Plot elements. There will be a warning if you load a test containing the old elements. T ests containing th e old elements will continue to work, but you cannot create any new ones.

You will not lose the use of the old elements in existing tests. Previously created Vector Plot and Scalar Plot elements will be converted to the General Plot element.

• Version R2009a + 2 — Customers can no longer load tests containing

Vector Plot or Scalar Plot elements. If you try to load one, you will get an error, and will have to convert the element to the General Plo t element. Previously created Vector Plot and Scalar Plot elements will be converted to the G eneral Plot element.

Version 2.2 (R2008b) SystemTest™ Software

Version 2.2 (R2008b) SystemTest Software

This table summarizes what’s new in Version 2.2 (R2008b):

New Features and Changes

Yes Details below

Version Compatibility Considerations

No Bug Reports

New features and changes introduced in this version are:

• “Signal Builder Block Test Vector” on page 13

• “Multiple Test VectorGroups”onpage13

• “New Plot Element” on page 14

• “Simulink Design Verifier Data File Test Vector” on page 14

• “Model Coverage Support for Reference Blocks” on page 15

• “Run Status Hyperlink Change” on page 15

Fixed Bugs an d Known Problems

Includes fixes

Related Documentation at Web Site

Signal Builder Block Test Vector

If you have created a Simulink model test harness using a Signal Builder block, you can automate the running of all your test cases by integrating them into a SystemTest test. This also offers the ability to collect cumulative model coverage metrics for all your Signal Builder test cases.

For more informatio n on this feature, see “Creating Signal Builder Block Test Vectors”.

Multiple Test Vector Groups

The ability to create multiple test vector groups has been added to the SystemTest software. A test vector group is a collection of test vectors of the same length whose values are indexed sequentially with the other vectors in the group. Groups are commonly used for Monte Carlo and Design of Experiments (DOE) based testing, or when multiple vectors have

SystemTest™ Release Notes

a relationship (e.g. the mass and damping values of different throttle body types). Until R2008b, you could only create one test vector group.

For e xample , you could have a model of an automobile motor with two blocks – one block for the fuel system and one for the oxygen flow. Each block has a number of inports that are mapped to SystemTest vectors. In previous release you could not create a test that checks how the model behaves when performing a Monte Carlo test on both the fuel system and oxygen flow at the same time. With multiple test vector group support, you can now perform a Monte Carlo style test on both blocks, saving time in the test run.

For m ore information on this feature, see “Creating Grouped Te st Vectors”.

New Plot Element

The new General Plot element offers support of all MATLAB plot types. You can plot any type of data, using any MATLAB plot types, or Simulink data.

The General Plot element allow s you to plot data produced from a Simulink model. The supported data types include an array, a structure, a structure with time, or a time series. Note that the element creates a line for each signal in the Simulink data. If time is not present, the signals are plotted against their indices.

You can also plot Simulink data provided by test vectors, such as the Signal Builder Block test vector, th e Simulink Design Verifier Data File test vector, or the Spreadsheet Data test vector.

For more information on this feature, see Working with the Basic Elements > Basic Elements > General Plot Element in the SystemTest help.

Simulink Design Verifier Data File Test Vector

The Simulink Design Verifier Data File test vector can read test cases created by the Simulink you need a Simulink Design Verifier data file with test cases.

To use this feature, you first run Simulink Design Verifier with the appropriate configuration. Then you can do one of two things:

Design Verifier™ software. In o rde r to u se this test vector,

Version 2.2 (R2008b) SystemTest™ Software

• Generate a SystemTest harness for the model from Simulink. When it

completes, a new test opens automatically in SystemTest and a Simulink Design Verifier Data File test vector is automatically created. T his workflow is described in “Automatically Creating a SystemTest Test Harness from Simulink Design Verifier”.

• If you already have a data file from Simulink Design Verifier, you can

create a test vector in SystemTest that uses the data, and configure overrides in a Simulink element. This workflow is described in “Creating a Simulink Design Verifier Data File Test Vector”.

Model Coverage Support for Reference Blocks

The S ys te mTes t software now supports Model Coverage for Reference blocks. The Simulink element will allow model coverage to be gathered for referenced models.

For more information on this feature, see “Using Simulink Model Coverage”.

Run Status Hyperlink Change

Prior to R2008b, after a test ran, the Run Status pane contained a link “Open Te st Results in Viewer.” This is no longer available. However, you can still open the results in the Test Results Viewer by selecting the Tools >

Test Results Viewer menu or setting the automatic launch option on the General tab in the Test Properties pane.

The hyperlink in Run Status has been replaced by a link that opens the test results object in MATLAB.

SystemTest™ Release Notes

Version 2.1 (R2008a) SystemTest Software

This table summarizes what’s new in Version 2.1 (R2008a):

New Features and Changes

Yes Details below

Version Compatibility Considerations

Yes Summary

New features and changes introduced in this version are:

• “Overriding Individual Simulink Inport Blocks” on page 17

• “Improvements in the Simulink Element” on page 17

• “M API to Access Test Results in MATLA B” on page 18

• “Test Vector Types” on page 19

• “Option to Reuse Test Vector Values” on page 19

• “Reading Microsoft Excel Data into Test Vectors” on page 19

• “Test Vectors User Interface Change” on page 21

• “Test File Format Change” on page 21

• “General UI Changes” on page 22

• “Default Setting Changes” on page 23

• “Test Results Viewer Notes” on page 23

Fixed Bugs an d Known Problems

Bug Reports Includes fixes

Related Documentation at Web Site

Version 2.1 (R2008a) SystemTest™ Software

Overriding Indi

You can now overr Simulink elemen

In the element, using the new O section on the

For informat in the System

you can map test signals to individual Simulink Inport blocks

Mappings tab.

ion on using this feature, see Overriding Inport Block Signals

Test documentation.

vidual Simulink Inport Blocks

ide individual Simulink Inport block signals via the

verride Inport Block Signals with SystemTest Data

Limitations and Restrictions

When you sel Inport blo expressio

Individua to a vecto

Improve

The Simu

nt m apping options, offering better usability within the element. Any

differe mappin pane. T

ect Inherit from m odel as the mapping for an individual

ck, it will not support models that defined their

ns of

t, time series, Simulink Time Series, or TSArray.

l Inport mappings restrict the dimension of the mapping variable r(dimension=1).

ExternalInput as

ments in the Simulink Element

link element h as been updated to use co llap sible panes for the

gs from previous TEST-files are l oaded into the appropriate collapsible

he four collapsible panes consist of:

• Inport

• Block

• To Wor

• Outp

In pr wit loa dur

Block S i gn a ls (new feature – Importing Simulink Inports)

Parameters

kspace Variables

orts

evious releases, when loading TEST-files, Simulink models associated

h a Simulink element were not automatically loaded into memory during

d time. In Release 2008a, the Simu l in k element will now load its model

ing load time, which is indicated by the load progress bar.

SystemTest™ Release Notes

In previous releases, the Simulink element would not recognize To Workspace blocks stored within locked ma sk s or block parameter fields for sample time, datatype,andscaling.Theseoptionsarenowaccessiblethroughtheelement.

M API to Access Test Results in MATLAB

After you run a test that includes results you saved using the Saved Results in the Test Browser, you can view the results in MATLAB using a test results object. This feature is usefu l for comparing the results of separate test runs and for postprocessing of test results.

After running a test, a MATLAB variable named available, allowing you to access the test results object and work with the data in MATLAB. One o f the main advantages to accessing test results in the command line is that all of the MATLAB plotting tools are available to use on the results data. You can plot the data using any of the plot types MATLAB offers.

Another major use of the test results object is to quickly access and view your results i n the form of a dataset object. The dataset object offers a convenient form for managing and displaying a large amount of data.

For information on using the new test results obje ct, see Accessing Test Results from the MATLAB Command Line in the SystemTest documentation.

In previous releases, test results were not accessible during test execution. In Release 2008a, the most current test results can be accessed at any time in the test by using the

systest.testresults.getCurrent function.

stresults is made

Compatibility Considerations

In previous releases, test results were managed in an undocumented MATLAB structure accessible as a variable named test results MAT-file. For Release 2008a, the test results are now managed as a documented test results object. Any dependencies on the previous undocumented test results format will need to be updated to use the new test results object.

stresults or from the

For information on using the new test results obje ct, see Accessing Test Results from the MATLAB Command Line in the SystemTest documentation.

Version 2.1 (R2008a) SystemTest™ Software

Test Vector Types

In this release, three test vector types are now available, described as MATLAB Expression, Spreadsheet Data, and Probability D istribution. Test vector data for TEST-files from prior releases will be loaded as a M ATL AB Expression test vector type .

Other Test Vector Changes

The Probability Distribution support nowrecallstheconfiguration values used to generate the distribution, avoiding the need to reenter the configuration values when a distribution needs to be edited.

The Probability Distribution test vector now uses default values for its fields. Previous versions configured the fields blank. You can replace the defaults with the values you want to use.

Option to Reuse Test Vector Values

You can now choose to reuse test vector values each time a test is run. This is useful for Monte Carlo testing when used in conjunction with the new Probability Distribution test vector type. To reuse test vector values, do not select the option called Evaluate T est Vector each time the test is run when configuring a Test Vector.

NoteAboutThisFeature

In previous releases, test vector values were always reevaluated upon loading and running the test. To maintain this behavior, in Release 2008a, any existing TEST-files will be loaded with their test vectors configured to Evaluate T est Vector each time the test is run,whichisthenew configuration option for test vectors. Any new test vectors created though will, by default, not be configured to reevaluate each time the test is run.

Reading Microsoft Excel Data into Test Vectors

A ne w test v ector type, Spreadsheet Data, is now available to read data from Microsoft from multiple files, and can read whole sheets or a subset of a sheet.

Excel®files into the SystemTest software. You can import data

SystemTest™ Release Notes

For information about using this feature, see Creating Spreadsheet Data Test Vectors in the SystemTest documentation.

Notes About This Feature

If a file has been added to a Spreadsheet Data test vector, any changes within the file (i.e., sheets being renamed, added, or removed) will not be automatically reflected within the SystemTest software. To have the SystemTest software reflect the change, remove the file from the test vector and then add it back.

Specific rows/columns from a Spreadsheet Data test vector can be selected using a new mapping option provided in the Simulink element’s Override Inport Block Signals with SystemTest Data option on the Mappings tab. This selection option is not currently supported for other Simulink mapping types or other test elements.

The Spreadsheet Data test vector is officially supported on Windows

platforms and can read all Microsoft®Excel®spreadsheet files. This also includes CSV files. On platforms other than Windows, the SystemTest software only supports reading XLS files and does not support CSV files.

The following undo/redo a ctions are not currently supported for the Spreadsheet Data test vector:

• Adding, removing, moving up, moving d own, selecting, or unselecting of

files/spreadsheets

• Any edits made on the String Mappings tab

The Spreadsheet Data test vector stores the absolute path to any files added. If the file changes location, even if the file is still on the MATLAB path, it will not be found. You should remove and ad d the file again if the location or name changes.

The other two test vector types (MATLA B Expression and Probability Distribution) clear their values and set their length to 0 whenever a n "Evaluate" fails. For the SpreadsheetDatatestvector,ifan"Evaluate" fails, then the last known values, headers, and string replacements remain and w ill only be updated when an "Evaluate" is successful. This can lead to

Version 2.1 (R2008a) SystemTest™ Software

discrepancies between the actual values used and the way the Spreadsheet Data test vector user interface is configured.

• For example, if the test vector successfully reads Column A, the values are

stored, etc. If the test vector is configured to read Columns B to C, and that leads to an error somewhere, the text fields will still show Columns B to C, even though the values that would be used are from Column A.

• In this same example, a failed evaluat ion would put the test vector in error.

However, if you save and then reload the test vector, the error state is removed. Therefore, you could have saved this test vector reading from bad data in Columns B to C, and then reload and the red error borders are gone. When it runs (if you do not reevaluate each time the test is run, or manually, before pressing the Run button) it will use old values from column A, even though the information in the Test Vectors pane says Columns B to C.

Test Vectors User Interface Change

The overall UI for test vectors and test variables has been redesigned into a table and embedded edit area, offering easier management and interaction. By default, the test vectors and test variables are no longer docked in the bottom left of the desktop. Instead, they are docked in the middle pane along with the Properties pane. A listing of test vectors and variables are also provided in the Test Browser.

ThelistoftestvectorsintheTest Browser will always reflect an alphabetized order, regardless of their order in the Test Vectors edit pane. The test variables tree is not currently alphabetized and will reflect the order from the edit pane.

Multiple test vectors can be selected in the edit pane to allow for multiple test vector evaluation or deletion. Multiple test vector editing, though, is not currently supported.

Test File Format Change

Thefollowingchangeshavebeenmade.

SystemTest™ Release Notes

Compatibility Considerations

TEST-files are being saved in a new internal binary format as of Release 2008a. Files from previous releases are compatible with Release 2008a and can be loaded without any problems. TEST-files saved in Release 2008a will not be loadable in previous SystemTest releases.

The results MAT-file generated by the SystemTest software, or those saved by the Test Results Viewer, stores data in the form of a new test results object for Release 2008a. These result MAT-files are not loadable by previous SystemTest releases.

General UI Changes

The des kto p toolbar has been updated to offer a more concise set of options.

• The Run and Stop buttons have been relocated toward the right end of

the toolbar.

• The buttons that launch the Test Results Viewer, Test Report, and

Simulink have been removed. These options continue to be available from the menu bar.

• The Current Directory chooser at the top of the desktop has been removed.

The current directory can still be changed by using the MATLAB desktop Current Directory chooser.

A progress bar has been introduced providing status wh en TEST-files are loaded.

The Run Status progress bar has been updated to an indeterminate bar, suggesting ongoing testing when working in distributed mode. The new progress bar no longer displays the percentage complete. Information on current progress is still provided via the status text above the progress bar.

The New button in the Test Browser pane, originally used to add elements, can n ow be used to add elements, test vectors, and test variables.

Version 2.1 (R2008a) SystemTest™ Software

Compatibility Considerations

Three reserved names have been introduced, restricting the names that can be used for Test Vectors, Variables, Saved Results, or Derived Results (created in the Test Results Viewer). These reserved names are:

• ObsNames

• Properties

• VarNames

Any existing TEST-files that use these names will be loaded with a warning indicating what alternate name is being used in place of the restricted name.

Default Setting Changes

With the addition of a new test results object for exploring and analyzing test results, by default, the Visualize and plot saved results by launching the Test Results Viewer option is turned off when new TEST-files are created. The option is still available in the Test Properties pane.

The default desktop layout no longer displays the Elements pane by default. It is still available via the Desktop menu.

Test Results Viewer Notes

The Test Results Viewer currently supports viewing scalar, vector, time series, and image data. It is not currently compatible with any other data formats. Attempting to load other data formats will produce an error. In particular, using the new Spreadsheet Data test vector to read in multiple columns/rows of data, producing a matrix of values for each test iteration, will likely not be loadable by the Test Results Viewer. It is recommended the new test results object, which is compatible with all data formats, be used instead to view and analyze test results.

When configured to launch, the Test Results Viewer would always launch at the end of a test, even when the test was unable to run to completion or if there were no test results to view. In Release 2008a, the viewer w ill only launch if the test runs to completion and if test results are being saved. Otherwise the request is ignored.

SystemTest™ Release Notes

Version 2.0 (R2007b) SystemTest Software

This table summarizes what’s new in Version 2.0 (R2007b):

New Features and Changes

Yes Details below

Version Compatibility Considerations

Yes Summary

New features and changes introduced in this version are:

• “Distributed Testing” on page 24

• “Randomized Test Vectors” on page 24

• “Grouped Test Vector Support in the Test Results Viewer” on page 25

• “Run SystemTest Tests from the MATLAB Command Line” on page 25

• “Platforms No Longer Supported” on page 25

• “Invalid Characters in Elemen t Names” on page 25

Fixed Bugs an d Known Problems

Bug Reports Includes fixes

Related Documentation at Web Site

Distributed Testing

You can now distribute the System Test software tests across multiple computers or processors for faster performance. You must have a license for the Parallel Computing Toolbox™ software to use this feature.

You can set up a test and then distribute the test iterations as tasks, w hich are performed by different workers. No changes to the test setup are required. This can speed up the total time the test takes to execute.

Randomized Test Vectors

The SystemTest software now prov ides an easy way to generate randomized test vector values for your test. Probability distribution functions can be used to set up test vectors, which is useful for performing Monte Carlo analyses.

If you have the Statistics Toolbox™ software, the SystemTest software integrates with it to provide use of some of its probability distribution

Version 2.0 (R2007b) SystemTest™ Software

functions, such as Exponential, Gamma, Lognormal, T,andWeibull.Ifyou don’t have the Statistics Toolbox software, you have access to MATLAB probability distribution functions such as

Normal (Gaussian) and Uniform.

Grouped Test Vector Support in the Test Results Viewer

The Test Results Viewer now lets you us e grouped test vectors in plot configurations.

You can also show grouped test vectors as dependent variables in scatter plots. If a dependent variable is a grouped test vector, you can now explore the relationship it has with the other vectors in the group.

Run SystemTest Tests from the MATLAB Command Line

You can now run tests that you set up in the SystemTest software from the MATLAB command line. This is useful for running multiple tests as a batch or calling a test file as part of a MATLAB file.

Platforms No Longer Supported

The follow i ng platforms a re no longer supported for use w ith the SystemTest software:

• Solaris™ 64

• PowerPC

Note that since these platforms are not supported, you cannot have any worker machines in a distributed testing cluster that use these platforms.

Mac

Invalid C haracters in Element Names

The following characters are now considered invalid to include within element names:

• ’

SystemTest™ Release Notes

• <

• >

You cannot use these three characters in element names. If you create a new test element with one or more of these characters in the element name, then the SystemTest software throws an error dialog and the element name is reset to the default value, which is the name of the element type.

Compatibility Considerations

If you try to load an existing test with an invalid element name (containing oneormoreofthethreecharacterslistedabove),theSystemTestsoftware displays an error dialog indicating that the element name is invalid. The test will load successfully, but the element with an invalid name is reset to use the default name for the element.

If this occurs, simply rename the element to a name that does not contain any of the invalid characters. You rename an element by double-clicking its name in the Test Browser.

Version 1.1 (R2007a) SystemTest™ Software

Version 1.1 (R2007a) SystemTest Software

This table summarizes what’s new in Version 1.1 (R2007a):

New Features and Changes

Yes Details below

Version Compatibility Considerations

Yes Summary

New features and changes introduced in this version are:

• “Enhanced Limit and Tolerance Checking” on page 27

• “Undo/Redo Support” on page 27

• “Flexible Test Iteration Definition Using Grouped Test Vectors” on page 28

• “Enhanced Reporting of Test Execution” on page 28

• “Test Results Viewer Save and Load Capabilities” on page 28

• “Remove Test Vectors from the Limit Check Element” on page 28

Fixed Bugs an d Known Problems

Bug Reports Includes fixes

Related Documentation at Web Site

Enhanced Limit and Tolerance Checking

The Limit Check element has new functionality that creates many more options for defining the pass/fail criteria for a test. In addition to scalar versus scalar comparisons, other comparison types are now supported: scalar versus vector, vecto r versus vecto r, and matrix versus matrix. You can now perform tolerance checkin g as well. This feature allows you to check absolute tolerance or relative tolerance of variables used throughout the SystemTest software.

Undo/Redo Support

Undo/redo support is now available in the SystemTest desktop.

SystemTest™ Release Notes

Flexible Test Iteration Definition Using Grouped Test Vectors

Test vectors can now be grouped, in order to affect the way iterations are run. By grouping test vectors, they will be combined sequentially with the other grouped vectors, and then permuted with all the ungrouped test vectors. This gives you more control over the flow of your tests and is useful for Monte Carlo or Design of E xperiments (DOE) based testing as well as defining signal groups, similar to those defined in the Simulink Signal Bui lder block.

Enhanced Reporting of Test Execution

Reports generated for the test execution now contain more information. For example, the new report includes test description text, snapshots of the plots generated by Plot elements, and snapshots of the models used in Simulink elements.

Test Results Viewer Save and Load Capabilities

Users can now save the plotting and an a lys is work done in the Test Results Viewer. Data, constraints, and plots created in the Test Results Viewer can be saved and then reloaded in order to continue working on or viewing the data, or to share it with others.

Remove Test Vectors from the Limit Check Element

Test vectors are no longer available in the Test Variable column of the Limit Check element since there is no rationale for that use case. The “Test Vector” choice has been removed from the drop down in the Limit Check table.

Compatibility Considerations

Any existing tests using Test Vectors will have their Limit Check tables now launch in an error state. Tests cannot have Test Vectors in the Test Variable column. To correct the problem, choose an available variable for the limit check or create a new variable.

Version 1.0.1 (R2006b) SystemTest™ Software

Version 1.0.1 (R2006b) SystemTest Software

This table summarizes what’s new in Version 1.0.1 (R2006b):

New Features and Changes

No No Yes

Version Compatibility Considerations

The SystemTest software w as introduced in R2006a+. See “Version 1.0 (R2006a+) SystemTest Software” on page 30 for details about this product.

This release includes bug fixes or enhancements, which are listed below.

Fixed Bugs an d Known Problems

Details

Bug Fixes or Enhancements

The following enhancements were made in Version 1.0.1:

• The Stop ele ment can now be used in Pre Test. In Version 1.0, it could be

used only in Main Test. It is now available in both Main Test and Pre Test.

• The Stop element now generates a hyperlink in the Run Status pane that

gives the name of the Stop element that terminated the test and shows the element in the SystemTest desktop.

Related Documentation at Web Site

SystemTest™ Release Notes

Version 1.0 (R2006a+) SystemTest Software

This table summarizes what’s new in Version 1.0 (R2006a+):

New Features and Changes

Yes Details below

Version Compatibility Considerations

No No No

Version 1.0 was released in Web-downloadable form after R2006a, and includes the features listed below.

The SystemTest product provides a software framework for developing tests that exercise MATLAB algorithms and Simulink models. It includes predefined test elements that let you build and maintain standard test routines. You can save and share tests throughout a development project, ensuring standard and repeatable test verification from research and development through preproduction. You can map test variables into a result set for analysis.

SystemTest is integrated with MATLAB, enabling you to use the MATLAB scripting language and analysis tools to explore large data sets and gain further insight into the behavior of the system. Key features include:

• Develops, manages, and edits test structures

• Uses predefined te st elements to test MATLAB algorithms and Simulin k

models

Fixed Bugs an d Known Problems

Related Documentation at Web Site

• Incorporates MATLAB scripts directly into a test

• Maps MATLAB and Simulink workspace variables to test variables

• Offers reusability, so that after you designatest,youcansaveitforlater

use by you or others

• Visualizes and analyzes multidimensional test results

Compatibility Summary for SystemTest™ Software

Compatibility Summary for SystemTest Software

This table summarizes new features and changes that might cause incompatibilities when you upgrade from an earlier version, or wh en you use files on multiple versions. Details are provided in the description of the new feature or change.

Version (Release) New Features and Changes with

Version Compatib ility Impact

Latest Version V2.5 (R2010a)

V2.4 (R2009b) See the Compatibility

V2.3 (R2009a) See the Compatibility

V2.2 (R2008b)

V2.1 (R2008a) See the Compatibility

See the Compatibil ity Considerations subheading for this change:

• Plot Element Transition

Considerations subheading for this change:

• Plot Element Transition

Considerations subheading for this change:

• Plot Element Transition

None

Considerations subheading for these ch a n ges:

• M API to Access Test Results in

MATLAB

• Test File Format Change

• General UI Changes

SystemTest™ Release Notes

Version (Release) New Features and Changes with

Version Compatib ility Impact

V2.0 (R2007b) See the Compatibility

Considerations subheading

for this change:

• Invalid Characters in Element

Names

V1.1 (R2007a) See the Compatibility

Considerations subheading for this change:

• “Remove Test Vectors from the

Limit Check Element” on page 28

V1.0.1 (R2006b)

V1.0 (R2006a+)

None

Mathworks SYSTEMTEST RELEASE NOTES

Specifications and Main Features

Frequently Asked Questions

User Manual