Definition General Info Policies Guides Communities Training Related
DEFINITION
The TRR is a multi-disciplined technical review to ensure that the subsystem or system under review is ready to proceed into formal test.
GENERAL INFORMATION/NARRATIVE
Test and evaluation is an integral part of the systems engineering processes of Verification and Validation. Test and evaluation should permeate the entire life cycle of an acquisition program.
Test and evaluation is also an important tool to identify and control risk.
This discussion principally addresses the TRR to support the readiness for a system to proceed into system-level Developmental Test. However, the program manager could utilize the TRR process to support all tests in all phases of an acquisition program, including testing within a system of systems context. A robust test program should enhance the program manager's ability to identify and manage risk. The program managers and Test and Evaluation Working-level Integrated Product Team should tailor any TRR to the specific acquisition phase, the specific planned tests, and the identified level of risk within the program. The scope of the review is directly related to the risk level associated with performing the planned tests and the importance of the test results to overall program success. The program manager should address the scope of the TRR(s) in the Systems Engineering Plan.
The level of specific risk and risk level will vary as a system proceeds from component level, to system level, to systems of systems level testing. Early component level test may not require the same level of review as the final system level tests. Sound judgment should dictate the scope of a specific test or series of tests.
Readiness to convene a TRR is predicated on the program manager's and Test and Evaluation Working-level Integrated Product Team's determination that preliminary testing, functional testing, and pre-qualification testing results form a satisfactory basis for proceeding with a TRR and subsequent initiation of formal, system-level Developmental Test.As a practical matter, the program manager should carefully plan and properly resource test events.Regardless of stage of development or the level of the testing (component, subsystem, or system), the basic tenets of this discussion about the TRR should apply.
The TRR should answer the following questions:
(1) Why are we testing? What is the purpose of the planned test? Does the planned test verify a requirement that is directly traceable back to a system specification or other program requirement?
(2) What are we testing (subsystem, system, system of systems, other)? Is the configuration of the system under test sufficiently mature, defined, and representative to accomplish planned test objectives and or support defined program objectives?
(3) Are we ready to begin testing? Have all planned preliminary, informal, functional, unit level, subsystem, system, and qualification tests been conducted, and are the results satisfactory?
(4) What is the expected result and how can/do the test results affect the program?
(5) Is the planned test properly resourced (people, test article or articles, facilities, data systems, support equipment, logistics, etc.)?
(6) What are the risks associated with the tests and how are they being mitigated?
(7) What is the fall-back plan should a technical issue or potential showstopper arise during testing?
Typical TRR success criteria include:
(1) Completed and approved test plans for the system under test;
(2) Completed identification and coordination of required test resources;
(3) The judgment that previous component, subsystem, and system test results form a satisfactory basis for proceeding into planned tests; and
(4) Identified risk level acceptable to the program leadership.
Test and evaluation is critical to evaluating the system. The TRR ensures that the testing to be conducted properly evaluates the system and that the system is ready to be tested
POLICIES, DIRECTIVES, REGULATIONS, LAWS
BEST PRACTICES, LESSONS LEARNED, STORIES, GUIDES, HANDBOOKS, TEMPLATES, EXAMPLES, TOOLS
COMMUNITIES OF PRACTICE
TRAINING RESOURCES
RELATED ARTICLES
Definition General Info Policies Guides Communities Training Related