Covering Array Generation for Non-Rectangular Design Spaces

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods face challenges in uniformly distributing design points across non-rectangular design spaces, particularly when categorical factors are involved, as it is difficult to ensure uniform distribution of levels across these spaces.

Innovation Solution

A computer-program product that generates a covering array of strength t for multiple factors, allowing for the creation of a test suite with test cases that cover all combinations of candidate inputs, thereby validating responses and indicating deviations from specified results in a design space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If space-filling design is used to distribute design points uniformly across the design space, then the coverage of continuous factors is improved, but the uniform distribution of categorical factor levels becomes difficult to achieve

Engineering Contradiction:
Improveuniform distribution of design pointsVSAvoiddistribution of categorical factor levels
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent segments the design space into rectangular regions by sorting design points based on continuous factor values and assigning categorical factor levels to these segmented regions. This allows independent optimization of continuous factor distribution (via space-filling design) and categorical factor distribution (via level assignment to segments), resolving the contradiction between uniform spatial coverage and categorical level distribution.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If all combinations of candidate inputs are tested to ensure comprehensive coverage, then the validation accuracy is improved, but the testing time and computational resources increase significantly

Engineering Contradiction:
Improvevalidation accuracyVSAvoidtesting time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts and validates only the critical combinations of factors by generating covering arrays that ensure every combination of t factors appears together in at least one test case. This extracts the essential validation coverage needed for accuracy while eliminating redundant test cases, thereby reducing testing time and computational resources while maintaining validation precision.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11074483B2Tool for hyperparameter validation
Publication Date: 2021.07.27 JMP STATISTICAL DISCOVERY LLC
  • US11074483B2 patent drawing
  • US11074483B2 patent drawing
  • US11074483B2 patent drawing

AI summary

A computing system receives a request to validate, according to a validation specification, a response of a system of operation. The validation specification relates to determining deviation from a specified result in response to testing one or more candidate inputs. The initial design space defines design points for the system of operation according to the respective candidate inputs for each factor. The computing system, responsive to the request to validate the response of the system of operation, generates data representing a covering array for design points defined by the initial design space or a subset design space. The computing system generates, based on the data, a test suite for testing the system of operation. The computing system obtains the response of the system of operation and generates an output indicating the deviation from the specified result.