System Testing With Partial Inputs and Impact-Based Output Validation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for computing intermediate and output values in system testing require all input values to be defined or assume default values, leading to complex and time-consuming processes that make it difficult to determine which system outputs are impacted by specific inputs and whether they are desired for operation.
Innovation Solution
A method and system that determine system intermediate values and output values unambiguously from defined system inputs, without assuming or using default values for undefined inputs, and generate coverage reports to validate the system outputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If all input values are defined or default values are assumed for testing, then system execution can proceed, but testing complexity and time consumption increase significantly
Solution Approach 1:
The patent applies partial action by computing intermediate and output values only for the subset of system functions that are actually impacted by the defined input values, rather than computing all possible values. This is achieved through impact analysis that identifies which outputs depend on which inputs, allowing the testing process to focus only on relevant computations and avoid unnecessary work on unrelated system behaviors.
Solution Approach 2:
The patent segments the system into input values, functions, and output values, and further segments the computation process by identifying impacted versus non-impacted outputs. This segmentation allows the testing methodology to handle large systems with hundreds of inputs and outputs by breaking down the analysis into manageable portions that can be processed independently based on input-output dependency relationships.
2Loss of information
If all output values are computed regardless of input definition status, then complete system behavior is captured, but it becomes difficult to determine which outputs are impacted by specific inputs
Solution Approach 1:
The patent implements feedback through impact analysis that traces the relationship between input values and output values. By analyzing which outputs are impacted by which inputs, the system provides feedback information that enables testers to understand the causal relationships in the system. This feedback mechanism allows verification that only intended outputs are affected by specific inputs, improving both information retention and analysis clarity.
3Ease of operation
If default values are assumed for undefined inputs, then testing can proceed without complete input definition, but validation of system outputs becomes unreliable
Solution Approach 1:
The patent extracts and removes the problematic assumption of default values for undefined inputs. Instead of assuming default values that could lead to unreliable validation, the methodology explicitly identifies which input values are defined and which are undefined, and only computes output values that can be reliably determined from the defined inputs. This extraction of the default value assumption eliminates the source of validation unreliability while maintaining ease of operation by allowing testing to proceed with partially defined inputs.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
In one example, a method includes receiving one or more test scenarios based on requirements for a system under test having one or more inputs, wherein a value for at least one input of the one or more inputs is undefined for at least one test scenario of the one or more test scenarios. The method further includes determining system intermediate values and system output values that are unambiguously derivable from defined system inputs for the one or more test scenarios. The defined system inputs are defined in the one or more test scenarios and not assumed or default input values. The method further includes determining coverage of one or more functional characteristics of each function of the system under test executed based on the defined system inputs. The method further includes validating the determined system output values that are unambiguously derivable from the defined system inputs.