Diffusion Model Updating for Constraint-Guided Image Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Diffusion models generate low-quality or unsafe images due to insufficient training data and lack of feature screening capability, leading to uncontrollable image generation.

Innovation Solution

Update the diffusion model by acquiring sample text and noisy images that do not meet a preset constraint, using a second model to process these samples, and adjusting the model based on noise distributions to ensure the updated model generates images that meet the constraint while maintaining original generation capability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If diffusion model is trained with conventional training data, then model training is simple, but generated images are low-quality or unsafe

Engineering Contradiction:
Improveimage qualityVSAvoidmodel update complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-screening training data before model training to ensure only high-quality and safe images are used. The system evaluates candidate images against preset constraints (such as image quality metrics and safety criteria) before incorporating them into the training set, thereby preventing low-quality or unsafe images from compromising model performance.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback mechanisms where the model's generated images are evaluated against preset constraints, and this evaluation information is fed back to adjust the training process. The system uses feedback from image quality assessment and safety verification to iteratively improve the training data selection and model updates, ensuring continuous improvement in image generation quality.

Inventive Principle:
Principle #23Feedback

2Reliability

If feature screening capability is added to diffusion model, then image generation quality improves, but model complexity increases

Engineering Contradiction:
Improveconstraint satisfactionVSAvoidmodel structure complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by separating the feature screening function from the core image generation function. The system uses independent screening modules that evaluate images against preset constraints before they enter the training pipeline, rather than embedding complex screening capabilities within the diffusion model itself. This modular approach maintains model simplicity while ensuring constraint satisfaction.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediary screening components that act as mediators between data input and model training. These intermediaries (such as image quality assessors and safety filters) evaluate and filter training data before it reaches the diffusion model, thereby ensuring high-quality and safe images are used without increasing the core model's complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If training data is filtered to meet preset constraint, then generated images meet constraint, but training time increases

Engineering Contradiction:
Improveimage safety and qualityVSAvoidtraining time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by performing data screening and filtering before the actual model training begins. The system pre-evaluates candidate images against preset constraints (quality metrics, safety criteria) and selects only compliant images for training, thereby ensuring data quality without requiring time-consuming filters during the training process itself.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses partial action by applying screening filters selectively rather than exhaustively. Instead of evaluating every possible image parameter in depth, the system uses targeted preset constraints that capture the essential requirements for safe and high-quality images, achieving effective filtering with minimal computational overhead.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20260004471A1Model update method, image generation method, device, and medium
Publication Date: 2026.01.01 BEIJING ZITIAO NETWORK TECH CO LTD
  • US20260004471A1 patent drawing
  • US20260004471A1 patent drawing
  • US20260004471A1 patent drawing

AI summary

A model update method, an image generation method, a device and a medium are provided. The method includes: acquiring sample text, a noisy image and a first noise distribution; using a second model to process the sample text and the noisy image to obtain a second noise distribution, where an initial value of the second model is determined based on the first model; and updating the second model based on the second noise distribution, the first noise distribution, and the target noise distribution, such that a difference between the target noise distribution and a third noise distribution predicted by the updated second model is greater than a difference between the second noise distribution and the target noise distribution, and a difference between the third noise distribution and the first noise distribution does not exceed a difference between the target noise distribution and the first noise distribution.