Active Optimization for Design Space Exploration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Design optimization in complex multi-variable spaces requires significant computational resources due to the need for extensive simulation iterations, making it inefficient to determine the proper range of design parameters effectively.

Innovation Solution

The ActivO method employs a multi-phase machine learning approach with adaptive surrogate-assisted optimization, using weak and strong learner models to focus evaluations on regions likely to contain the global optimum, reducing the number of expensive design function evaluations by targeting parameter searches.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional simulation iterations are used to evaluate design parameters, then optimization accuracy is improved, but computational resources and time consumption increase significantly

Engineering Contradiction:
Improveoptimization accuracyVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent creates surrogate models (copies) of the expensive simulation function to replace actual simulation iterations. These surrogate models are trained on a subset of simulation data and then used to evaluate design parameters, providing approximate results much faster than full simulations while maintaining acceptable accuracy for optimization purposes.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces an intermediary optimization framework that sits between the design parameters and the expensive simulation function. This framework uses surrogate models and active learning strategies to select which design points to evaluate, mediating between exploration needs and computational cost constraints.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If extensive simulation iterations are performed to explore the design space, then optimization accuracy is improved, but computational resources required increase

Engineering Contradiction:
Improveoptimization accuracyVSAvoidcomputational resources
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

Surrogate models serve as computationally inexpensive copies of the expensive simulation function, allowing extensive design space exploration without proportionally increasing computational resource usage. The surrogate models capture the essential input-output relationships of the simulation at a fraction of the computational cost.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent performs partial action by evaluating only the most promising design points identified by the surrogate model and active learning strategy, rather than exhaustively evaluating all possible design points. This selective evaluation achieves satisfactory optimization results with reduced computational resources.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If the number of design function evaluations is reduced, then computational efficiency is improved, but optimization accuracy may deteriorate

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidoptimization accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent implements feedback through active learning, where the surrogate model's predictions and uncertainty estimates guide the selection of new design points for evaluation. The results from these evaluations feed back into training the surrogate model, improving its accuracy iteratively and ensuring that limited evaluations are used most effectively.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The optimization framework is dynamic, adapting the surrogate model and evaluation strategy based on progress made and uncertainty remaining. As optimization progresses, the system dynamically adjusts which regions of the design space to explore and how many evaluations to allocate, balancing efficiency and accuracy throughout the optimization process.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12190222B2Active optimization approach for rapid and efficient design space exploration using ensemble machine learning
Publication Date: 2025.01.07 UCHICAGO ARGONNE LLC
  • US12190222B2 patent drawing
  • US12190222B2 patent drawing
  • US12190222B2 patent drawing

AI summary

A design optimization method based on active learning, which involves dynamic exploration and exploitation of the design space of interest using an ensemble of machine learning algorithms. In this approach, a hybrid methodology incorporating an explorative weak learner which fits high-level information about the response surface, and an exploitative strong learner (based on committee machine) that fits finer details around promising regions identified by the weak learner, is employed. For each design iteration, an aristocratic approach is used to select a set of nominees, where points that meet a threshold merit value as predicted by the weak learner are selected to be evaluated using function evaluation. In addition to these points, the global optimum as predicted by the strong learner is also evaluated to enable rapid convergence to the actual global optimum once the most promising region has been identified by the optimizer.