Composite Test Objectives for Model Verification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current model verification tools lack the ability to comprehensively test for complex failure scenarios, as they are limited to basic test objectives and fail to evaluate pathways that are not exercised by standard test objectives.

Innovation Solution

The system and method introduce composite test objectives, which combine multiple basic test objectives logically to create new failure scenarios, allowing for extended model coverage analysis by automatically generating test cases and counterexamples.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If basic test objectives are used for model verification, then the verification process is simple and fast, but the model coverage is insufficient and complex failure scenarios are not detected

Engineering Contradiction:
Improvemodel verification thoroughnessVSAvoidtest objective complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines multiple basic test objectives into composite test objectives that represent complex failure scenarios. By merging several simple test objectives into a unified composite objective, the system achieves more thorough model verification while managing complexity through systematic combination rather than ad hoc complex testing.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an intermediary layer of composite test objectives that bridge basic test objectives and complex failure scenario detection. These composite objectives act as mediators that translate simple test cases into comprehensive verification coverage, enabling detection of complex failures without directly implementing complex test logic.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If composite test objectives are introduced to test complex failure scenarios, then model coverage is enhanced, but the verification system complexity increases

Engineering Contradiction:
Improvefailure scenario detectionVSAvoidverification system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments complex failure scenario verification into composite test objectives built from basic test objectives. By dividing the verification task into hierarchical levels (basic objectives → composite objectives), the system manages complexity through structured decomposition while maintaining comprehensive coverage capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates composite test objectives that serve multiple functions: they combine basic test objectives, represent complex failure scenarios, and provide unified verification coverage. This multi-functionality reduces the need for separate specialized testing mechanisms, thereby managing system complexity while enhancing detection capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If standard test objectives are used, then the verification process is efficient, but pathways not exercised by standard objectives remain unexamined

Engineering Contradiction:
Improveverification efficiencyVSAvoidpathway coverage
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent performs preliminary analysis to identify complex failure scenarios and constructs composite test objectives before execution. By pre-defining composite objectives that target unexamined pathways, the system ensures comprehensive pathway coverage while maintaining verification efficiency through purposeful test design rather than exhaustive testing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent adds a new dimension to test objective design by introducing composite objectives that operate at a higher level of abstraction than basic objectives. This dimensional addition enables coverage of previously unexamined pathways without sacrificing the efficiency of basic objective execution, as composite objectives coordinate multiple basic objectives systematically.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10387585B2System and method for performing model verification
Publication Date: 2019.08.20 MATHWORKS INC
  • US10387585B2 patent drawing
  • US10387585B2 patent drawing
  • US10387585B2 patent drawing

AI summary

A system and method extends model verification through the creation of composite test objectives. A composite objective includes two or more logically or temporally combined standard or basic test objectives. The basic test objectives selected to form a composite test may be automatically generated by the system or method, or they may be custom defined. A composite test objective represents a new coverage objective that extends model coverage analysis beyond the coverage that is available with the basic test objectives. The system and method also automatically generates one or more test cases for achieving the composite objective. The test cases include input data values for the model, and may cause the specified logical or temporal combination of basic test objectives to evaluate to true at least once during simulation of the model or according to the temporal combination.