DO Qualification Kit 1
User’s Guide
How to Contact The MathWorks
www.mathworks.
comp.soft-sys.matlab Newsgroup
www.mathworks.com/contact_TS.html Technical Support
suggest@mathworks.com Product enhancement suggestions
bugs@mathwo
doc@mathworks.com Documentation error reports
service@mathworks.com Order status, license renewals, passcodes
info@mathwo
com
rks.com
rks.com
Web
Bug reports
Sales, prici
ng, and general information
508-647-7000 (Phone)
508-647-7001 (Fax)
The MathWorks, Inc.
3 Apple Hill Drive
Natick, MA 01760-2098
For contact information about worldwide offices, see the MathWorks Web site.
DO Qualification Kit User’s Guide
© COPYRIGHT 2009–20 10 by The MathWorks, Inc.
The software described in this document is furnished under a license agreement. The software may be used
or copied only under the terms of the license agreement. No part of this manual may be photocopied or
reproduced in any form without prior written consent from The MathW orks, Inc.
FEDERAL ACQUISITION: This provision applies to all acquisitions of the Program and Documentation
by, for, or through the federal government of the United States. By accepting delivery of the Program
or Documentation, the government hereby agrees that this software or documentation qualifies as
commercial computer software or commercial computer software documentation as such terms are used
or defined in FAR 12.212, DFARS Part 227.72, and DFARS 252.227-7014. Accordingly, the terms and
conditions of this Agreement and only those rights specified in this Agreement, shall pertain to and govern
theuse,modification,reproduction,release,performance,display,anddisclosureoftheProgramand
Documentation by the federal government (or other entity acquiring for or through the federal government)
and shall supersede any conflicting contractual terms or conditions. If this License fails to meet the
government’s needs or is inconsistent in any respect with federal procurement law, the government agrees
to return the Program and Docu mentation, unused, to The MathWorks, Inc.
Trademarks
MATLAB and Simulink are registered trademarks of The MathWorks, Inc. See
www.mathworks.com/trademarks for a list of additional trademarks. Other product or brand
names may be trademarks or registered trademarks of their respective holders.
Patents
The MathWorks products are protected by one or more U.S. patents. Please see
www.mathworks.com/patents for more information.
Revision History
March 2009 Online only New for Version 1.0 (Applies to Releases 2008b, 2009a)
September 2009 Online only Revised for Version 1.1 (Applies to Release 2009b)
March 2010 Online only Revised for Version 1.2 (Applies to Release 2010a)
Getting Started
1
DO Qualification Kit Product Overview ............. 1-2
What is the D O Qualification Kit Product?
What is a Software Verification Tool?
What is Software Verification Tool Qualification for
DO-178B?
Can the DO Qualification Kit Product Be Applied to
DO-254?
DO Qualification Kit Components
What Certification Credit Can be Achieved By Qualifying
MathWorks Verification Tools?
Required K nowledge
..................................... 1-2
....................................... 1-3
.................... 1-3
.................... 1-7
............................... 1-7
............. 1-2
................. 1-2
Contents
Qualification Process Summary
..................... 1-9
Qualifying Tools for DO-178B Certification
2
Proposing Tool Qualification Plan to Certification
Authorities
Document Tool Operational Requirements
Verifying That the Tool Satisfies Tool Operational
Requirements
Provide Certification Authorities with Tool
Qualification Results
..................................... 2-2
................................... 2-5
............................ 2-7
........... 2-4
iii
iv Contents
Getting Started
• “DO Qualification Kit Product Overview” on page 1-2
• “Qualification ProcessSummary”onpage1-9
1
1 Getting Sta rted
DO Qualification Kit Product Overview
In this section...
“What is the DO Qualification Ki t Product?” on page 1-2
“What is a Software Verification Tool?” on page 1-2
“What is Software Verification Tool Qualification for DO-178B?” on page 1-2
“Can the DO Qualification Kit Product Be Applied to DO-254?” on page 1-3
“DO Qualification Kit Components” on page 1-3
“What Certification Credit Can be Achieved By Qualifying MathWorks
Verification Tools?” on page 1-7
“Required Knowledge” on page 1-7
What is the DO Qualification Kit Product?
The DO Qualification Kit product is a package of document templates, test
cases, and test procedures that you can use to qualify MathWorks™ software
verification tools for DO-178B certification. Using the product, you can achieve
and benefit from schedule, cost, and product quality process improvements.
1-2
What is a Softw are Verification Tool?
Software verification tools automate verification, validation, and testing
activities to achieve efficiency and detect certain errors. According to the
DO-178B standard, Section 12.2, a software verification tool does not
introduce errors, but might fail to detect errors that already exist in a product.
What is Software Verification Tool Q ualificatio n for
DO-178B?
Software that is included in avionic systems must be certified by meeting
objectives of the DO-178B standard. To achieve credit for the use of a tool in
the certification of an avionic system, you m ust qualify that tool if the output
of the tool is not verified. The DO Qualification Kit product provides resources
for qualifying MathWorks software verification tools. The tool user (not the
tool vendor) is responsible for the qualification.
DO Qualification Kit Product Overview
For guidance on how to use the DO Qualification Kit product to qualify
MathWorks software verifica tion t oo ls , see “Qualification Process Summary”
on page 1-9.
For information on criteria used to determine whe the r a tool needs to
be qualified, see the “Requirement forQualification”section of the Tool
Qualification Plan for the relevant MathWorks verification tool.
Can the DO Qualification Kit Product Be Applied to
DO-254?
You can use the DO Qualification Kit product to qualify verification tools for
projects that follow the DO-254 standard. The process for tool qualification is
described in Section 11.4 of the DO-254 standard. The Simulink
and Validation™ and SystemTest™ verification tools are applicable to
DO-254 projects. How eve r, PolySpace
to DO-254 projects. To take credit for DO-254, modify the Tool Qualification
Plan provided in the DO Qualification Kit product for the applicable
verification tool.
®
verification tools are not applicable
®
Verification
DO Qualification Kit Components
Supported MathWorks Software Verification Tools
The DO Qualification Kit product includes document templates, test cases,
and test procedures that you need to qualify the following MathWorks
software verification tools:
• Simulink Verification and Validation (DO-178B checks; model coverage)
• SystemTest (Limit Check ele ment)
• PolySpace
®
Client™ for C/C++; PolySpace®Server™ for C/C++
1-3
1 Getting Sta rted
Note By qualifying the model coverage capability of the Simulink Verification
and Validation product, you can claim credit for demonstrating co m pletenes s
and correctness of the test cases generated by Simulink
®
Design Verifier™.
Use the model coverage capability instead of reviewing the Simulink Design
Verifier report. You can demonstrate completeness and correctness by
running the generated test cases against the model, measuring the model
coverage, and reviewing the model coverage report. You can run the test cases
ontheexecutableobjectcodeandcomparetheactualresultstothesimulation
results. The model coverage capability does not assess the correctness of the
simulation results, only the test case coverage of the model. Therefore, you
must verify that the expected results from the model are correct.
In addition to this documentation, the DOQualificationKit product consists
of the qualification documents described in the following sections. The
qualification documents are located in your MATLAB
at
matlabroot\toolbox\qualkits\do. Although the kit contains the
®
installation directory
documents and tests that you need to qualify the supported tools, you must
determine how to apply the documents and tests to your specific project or
application.
1-4
Refer to the
PDF version of a qualif ication document to become familiar
with the qualification process and the required content. To customize the
qualification documents for your specific project or application, modify the
RTF versions.
Simulink Verification and Validation Product
The DO Qualification Kit product supports qualifying the following versions
and features of the Simulink Verification and Val idation verification tool:
• Version 2.7 (R2010a): DO-178B checks
• Version 2.7 (R2010a): Model coverage
Document templates, test cases, and test p rocedures are in the following
folder:
matlabroot\toolbox\qualkits\do\slvnv\r2010a\
DO Qualification Kit Product Overview
The following table lists qualification documents, and the primary files
associated with the qualification documents.
Qualification Documents
Tool Qualification Plan (TQP)
Tool Operational Requirements
(TOR) and supporting documentation
Test Cases, Procedures, and
Results (TCPR), and supporting
documentation
SystemTest Product
The DO Qualification Kit product supports qualifying t he following version
and feature of the SystemTest verification tool:
Version 2.5 (R2010a): Limit Check element
Document templates, test cases, and test p rocedures are in the following
folder:
Files
qualkitdo_slvnv_tqp.pdf
qualkitdo_slvnv_tqp.rtf
qualkitdo_slvnv_tor.pdf
qualkitdo_slvnv_tor.rtf
qualkitdo_slvnv_ma_ui.pdf
qualkitdo_slvnv_mc_ui.pdf
qualkitdo_slvnv_tcpr.pdf
qualkitdo_slvnv_tcpr.rtf
qualkitdo_slvnv_tcpr*.rpt
qualkitdo_slvnv_tcpr*.xls
tests\*.mdl
outputs\
qualkitdo_slvnv_qualificationreport*.html
matlabroot\toolbox\qualkits\do\systemtest\r2010a\
The following table lists qualification documents, and the primary files
associated with the qualification documents.
1-5
1 Getting Sta rted
Qualification Documents
Tool Qualification Plan (TQP)
Tool Operational Requirements
(TOR) and supporting documentation
Test Cases, Procedures, and
Results (TCPR), and supporting
documentation
PolySpace Products for C/C++
The DO Qualification Kit product supports qualifying t he following version
and feature of PolySpace code verification tools:
Version 7.2 (R2010a): PolySpace Client for C/C++; PolySpace Server for
C/C++
Document templates, test cases, and test p rocedures are in the following
folder:
matlabroot\toolbox\qualkits\do\polyspace\r2010a\
Files
qualkitdo_systemtest_tqp.pdf
qualkitdo_systemtest_tqp.rtf
qualkitdo_systemtest_tor.pdf
qualkitdo_systemtest_tor.rtf
qualkitdo_systemtest_lc_ui.pdf
qualkitdo_systemtest_tcpr.pdf
qualkitdo_systemtest_tcpr.rtf
qualkitdo_systemtest_tcpr.test
outputs\qualkitdo_systemtest_tcpr_report\
qualkitdo_systemtest_qualificationreport.html
Qualification Documents
Theoretical Foundation (TF)
Tool Qualification Plan (TQP)
1-6
The following table lists qualification documents, and the primary files
associated with the qualification documents.
Files
qualkitdo_polyspace_tf.pdf
qualkitdo_polyspace_tf.rtf
qualkitdo_polyspace_tqp.pdf
qualkitdo_polyspace_tqp.rtf
DO Qualification Kit Product Overview
Qualification Documents
Tool Operational Requirements
(TOR)
Tests Cases, Procedures, and
Results (TCPR), and supporting
documentation
What Certification Credit Can be Achieved By
Qualifying MathWorks Verification Tools?
For a list of areas of the DO-178B standard for which some certification
credit (meet or replace DO-178B objectives) can be achieved by qualifying
MathWorks verification tools, see the “Certification Credit” section of the
Tool Qualification Plan for the relevant tool. The amount of credit that can
be achieved is dependent upon the development processes used and how
verification tools are applied within the processes.
Files
qualkitdo_polyspace_tor.pdf
qualkitdo_polyspace_tor.rtf
qualkitdo_polyspace_tcpr.pdf
qualkitdo_polyspace_tcpr.rtf
Matrix_*.txt
tests\qualkitdo_polyspace_tcpr.*
tests\tor-checks\tor-checks.txt
tests\*\*_rules.txt
tests\*\*.c
tests\*\*.cpp
outputs\
qualkitdo_polyspace_qualificationreport_*.txt
Required Knowledge
Before using the DO Qualification Kit product, make sure that you have:
• Knowledge about developing safety-critical software.
• Knowledge of DO-178B, Software Considerations in Airborne Systems
and Equipment Certification.
• Experience using features of MathWorks verification tools that you want to
qualify (and related required software, such as MATLAB and Simulink
®
):
- Simulin k Verification and Validation (DO-178B ch e ck s, model c ov erage)
- SystemTest (Limit Check element)
- PolySp ace Client for C/C++, PolySpace Server for C/C++
1-7
1 Getting Sta rted
Also, get familiar with the following information:
• Technical Solution 1-1ZLDDE on the MathWorks Web site, which offers
recommendations on how to apply Simulink, Real-Time Workshop
®
,and
third-party products for Model-Based Design to DO-178B measures and
techniques.
• If you have a Real-Time Workshop
®
Embedded Coder™ license, “Developing
Models and Code That Comply with the DO-178B Standard” in the
Real-Time Workshop Embedded Coder documentation.
1-8
Qualification Process Summary
1 Provide certification au thorities with a tool qualification plan.
2 Document tool operational requirements.
3 Verify that the tool satisfies tool operational requirements and define
limitations and restrictions of the tool.
4 Provide certification authorities with tool qualification results, including
limitations and res trictions.
Start
Propose tool qualification to
certification authorities.
Qualification Process Summary
Document tool operational
requirements.
Tool satisfies operational
requirements?
Yes
Provide certification authorities
with tool qualification results.
Done
No
Verify that correct versions of
all required software is
installed correctly and is being
used.
Check whether known bug
reports related to this product
exist on www.mathworks.com.
Contact MathWorks Support
for assistance.
Document a limitation of tool
usage in your Tool
Accomplishments Summary.
1-9
1 Getting Sta rted
Note The rights.txt file, located at matlabroot\toolbox\qualk its\do,
describes allowed us es of The MathWorks™ DO Qualification Kit product.
1-10
Qualifying Tools for
DO-178B Certification
• “Proposing Tool Qualification Plan to Certification Authorities” on page 2-2
• “Document Tool Operational Requirements” on page 2-4
• “Verifying That the Tool Satisfies Tool Operational Requirements” on
page 2-5
• “Provide Certification Authorities with Tool Qualification Results” on
page 2-7
2
2 Qualifying Tools for DO-178B Certification
Proposing Tool Qualification Plan to Certification
Authorities
The first step of the qualification process is to propose a Tool Qualification
Plan to the DO-178B certification authorities. To propose a Tool Qualification
Plan, complete the fo llow ing steps fo r each tool that you plan to qualify:
1 Identify a MathWorks software verification tool that you plan to qualify.
2 Locate the PDF version of the Tool Qualification Pl an document provided
for the tool in the DO Qualification Kit product. Review the document for
applicability to your project.
3 Locate and make a copy of the .rtf Tool Qualif ication Plan temp late file
for that tool.
The Tool Qualification Plan provides the following information:
• Introduction
2-2
• Title and version of the Tool Operational Requirements (TOR)
• Certification considerations — basis for qu a lifying the tool and objective s
for which you are seeking certification credit
• Tool development lifecycle — planning, requirement documents and
activity, verification documents and activity
• Tool lifecycle data — mapping of application documents to the DO-178B
process lifecycle
• Qualification schedule
4 Edit the template, as necessary, for your application and make the
document available for review. This typically includes adding the following
information:
• In the table located in “Tool Lifecycle Data”, where indicated, references
to the documents:
– P lan for Software Aspects of Certification (PSAC)
– Software Accomplishment Summary (SAS)
– Tool Qualification Accomplishment Summary (TQAS)
Proposing Tool Qualification Plan to Certification Authorities
• Tool qualification schedule located in a section titled “Schedule”
5 Add a reference to the tool that you are qualifying and justification why
the tool requires qualification to the application PSAC, indicating your
intent to use the verification tool.
6 Submit the PSAC to the certification authorities. If you want, you can
also submit the Tool Qualification Plan with the PSAC. These documents
inform the certification authorities of your intent to use a tool and initiates
a dialog regardi ng your plans for certification .
After you complete this procedure, document the Tool Operational
Requirements, as described in “Document Tool Operational Requirements”
on page 2-4.
2-3
2 Qualifying Tools for DO-178B Certification
Document Tool Operational Requirements
After you propose a Tool Qualification Plan to certification authorities,
develop a Tool Operational Requirements document. To do this, complete the
following steps for each tool that you plan to qualify:
1 Locate the PDF version of the Tool Operational Requirements document
provided for the tool in the DO Qualification Kit product, and review the
document for applicability to your project.
The Tool Operational Requirements document provides the following
information:
• Introduction
• Operational requirements — description of the functionality of the tool
and how it is used
• Installation information
• Operational environment
2-4
2 Install a
managem
documen
3 Locate and make a copy of the .rtf Tool Operational Requirements
document template file for the tool.
4 Edit the template, as necessary for your application, and make the
document available for review by certification authorities.
After you complete this procedure, verify that the tool satisfies Tool
Operational Requirements, as described in “Verifying That the Tool Satisfies
Tool Operational Requirements” on page 2-5.
nd configure the required software in your project configuration
ent system, as cited in the Tool Operational R equirements
t.
Verifying That the Tool Satisfies Tool Operational Requirements
Verifying That the Tool Satisfies Tool Operational
Requirements
After you document the Tool Operational Requirements, verify that the
tool satisfies the Tool Operational Requirements. To do this, complete the
following steps for each tool that you plan to qualify:
1 Locate the PDF version of the Test Cases, Procedures, and Results (TCPR)
document provided for the tool in theDOQualification Kit product,
and review the test cases and procedures described in the document for
applicability to your project.
The Test Cases, Procedures, and Results document provides the followi n g
information:
• Introduction
• Description of test cases and procedures
• Traceability matrix between operational requirem en ts and test cases
and procedures
• Procedure for ex ecuting the test cases and procedures
• Test results
2 Locate and make a copy of the .rtf Test Cases, Procedures, and Results
document template file for the tool.
3 Edit the test cases and procedures sections of the template, as necessary
for your application, and finalize the document. For example, you might
need to modify content in the Expected Result column of the table in the
traceability matrix.
4 Locate and configure the test cases and p rocedures in your project
configuration management system.
5 Execute the test cases and procedures in the installed and configured
environment. For more information, see “Executing the Test Cases and
Procedures” in the Test Cases, Procedures, and Results document for the
verification tool you are qualifying.
6 Review the test results. If the results are not correct:
2-5
2 Qualifying Tools for DO-178B Certification
• Verify that correct vers ions of all required MathWorks software are
installed correctly and being used.
• Check whether known bug reports related to this product exist on The
MathWorks Web site (
• Contact MathWorks support for assistance.
• Document a limitation of the tool usage in your Tool Accomplishments
Summary if you cannot resolve the test failure.
7 Configure the test results in your project configuration management
system.
After you complete this procedure, document and provide the results to
certification authorities, as described in“ProvideCertification Authorities
with Tool Qualification Results” on page 2-7.
www.mathworks.com).
2-6
Provide Certification Authorities with Tool Qualification Results
Provide Certification Authorities with Tool Qualification
Results
After you verify whether the tool satisfies tool operational requirements,
complete the following steps for each tool that you are qualifying.
1 Document the test results in a Tool Accomplishment Summary.
2 Add an entry that summarizes the results of the tool qualification to the
Software Accomplishment Summary (SAS). You can also submit the Tool
Accomplishment Summary with the SAS.
3 Submit the SAS to the certification authorities so that they can approve the
results. The data can provide a record of the qualification status of the tool.
2-7
Loading...