Generative Optimization Models Using Diffusion for Constraint-Aware Design

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current generative models for engineering design, such as structural topology optimization, face challenges in efficiently generating designs that meet performance metrics and adhere to constraints like manufacturability, compliance, and volume fraction, due to their reliance on data-driven approaches that lack physical information and require expensive preprocessing.

Innovation Solution

The proposed solution is a diffusion optimization model (DOM) that integrates data-driven and optimization-based methods. It employs trajectory alignment to align the sampling trajectory with the optimization trajectory, uses dense kernel relaxation for efficient conditioning, and incorporates few-steps direct optimization to enhance manufacturability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If data-driven generative models are used for engineering design, then design diversity and creativity are improved, but constraint satisfaction and precision deteriorate

Engineering Contradiction:
Improvedesign diversityVSAvoidconstraint satisfaction
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent merges data-driven generative models with physics-based optimization methods into a hybrid framework. The generative model provides design diversity while the optimization component ensures constraint satisfaction, resolving the contradiction between creativity and precision in engineering design.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements feedback mechanisms where optimization results are fed back into the generative model to refine subsequent designs. This iterative feedback loop ensures that constraint satisfaction is maintained while preserving design diversity through continuous improvement.

Inventive Principle:
Principle #23Feedback

2Productivity

If conventional generative models are used, then generation speed is improved, but computational costs for preprocessing deteriorate

Engineering Contradiction:
Improvegeneration speedVSAvoidcomputational costs
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The patent performs preliminary actions by pre-computing and storing optimization results and design patterns during training. This allows the model to leverage pre-processed information during inference, reducing real-time computational costs while maintaining fast generation speeds.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by learning from and replicating successful design patterns from training data. Instead of performing expensive optimization computations during generation, the model copies effective design solutions from its training set, significantly reducing computational costs while maintaining quality.

Inventive Principle:
Principle #26Copying

3Ease of operation

If data-driven approaches are used, then ease of operation is improved, but reliability under constraints deteriorates

Engineering Contradiction:
Improveease of useVSAvoidconstraint satisfaction
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent introduces an intermediary optimization module between the user input and the generative model output. This intermediary layer translates user requirements into optimized designs that satisfy constraints, maintaining ease of operation while ensuring reliability through the mediating optimization process.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20250292092A1Generative optimization models for machine learning
Publication Date: 2025.09.18 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US20250292092A1 patent drawing
  • US20250292092A1 patent drawing
  • US20250292092A1 patent drawing

AI summary

A sample batch is accessed and a conditioning is computed based on given constraints. A dense relaxation is computed based on the computed conditioning and the sample batch to generate kernels for conditioning a diffusion optimization model. A sample is selected from the sample batch based on a randomly sampled timestep and random noise is sampled from a Gaussian distribution. A noisy representation of the selected sample is sampled based on the randomly sampled timestep and the sampled random noise. The diffusion optimization model is run in a forward direction using the noisy representation of the selected sample to generate a prediction. An error loss is computed to minimize an error between the prediction and a target; the target is the sampled random noise. A diffusion optimization loss is computed based on the error loss and the diffusion optimization model is updated based on the diffusion optimization loss using backpropagation.