System of Systems Test Optimization via Parameter Characterization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing system of systems testing techniques fail to optimize test efforts, neglect interactions between constituent systems, and do not effectively reuse historical test knowledge, leading to inefficient and costly validation processes, especially in complex and heterogeneous environments.

Innovation Solution

A method and system that utilize intelligent test characterization by retrieving historical test knowledge, categorizing test parameters, and selecting optimal test cases for execution, reducing repetitive testing efforts and costs through efficient characterization and execution of test cases.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If comprehensive testing of all constituent systems and interactions is performed, then validation completeness is improved, but test effort and cost increase significantly

Engineering Contradiction:

Improvevalidation completenessVSAvoidtest effort

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The patent performs preliminary characterization of test parameters and constituent systems before actual testing. By analyzing and categorizing test parameters in advance, the system identifies which tests are necessary and can be executed efficiently, reducing overall test effort while maintaining validation completeness.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent transforms test parameters into characterized forms that enable efficient comparison and selection. By changing the state of test data from raw to characterized, the system can quickly identify relevant tests and execute only those necessary for validation, optimizing the balance between completeness and effort.

Inventive Principle:

Principle #35Parameter changes

2Productivity

If historical test knowledge is reused across different constituent systems, then test efficiency is improved, but accuracy of test selection deteriorates due to heterogeneity

Engineering Contradiction:

Improvetest efficiencyVSAvoidtest selection accuracy

Core Design Contradiction:

ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies local quality by characterizing test parameters specific to each constituent system while maintaining a framework for knowledge reuse. Each system's unique characteristics are captured through parameter characterization, allowing historical knowledge to be adapted locally rather than applied uniformly, thus maintaining accuracy while improving efficiency.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

Inventive Principle:

Principle #35Parameter changes

3Measurement precision

If test cases are customized for each new constituent system, then test accuracy is improved, but development time increases

Engineering Contradiction:

Improvetest accuracyVSAvoidtest development time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

Inventive Principle:

Principle #3Local quality

4Reliability

If interactions between multiple constituent systems are validated, then system integration reliability is improved, but complexity of testing increases

Engineering Contradiction:

Improveintegration reliabilityVSAvoidtesting complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the complex validation task into manageable parts by characterizing test parameters for each constituent system independently. This segmentation allows interactions to be validated systematically through characterized parameters without being overwhelmed by the overall system complexity.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS9208046B2Method and system for optimizing testing efforts in system of systems testing

Publication Date: 2015.12.08 INFOSYS LTD

AI summary

A method and system for optimizing the testing efforts in system of systems testing includes receiving test parameters for a new constituent system in a system of systems. Based on the received test parameters, retrieving, historical test knowledge related to the system of systems. Based on the retrieved historical test knowledge, characterizing unique parameters from the received test parameters. The unique test parameters are combined in sequence or in parallel to identify executable test parameters and one or more test cases are selected corresponding to the identified executable test parameters for execution.