Generative Model Training Across Varying Observation Conditions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

GANs struggle to generate natural images under varying observation conditions without requiring significant modifications to the network architecture, particularly in medical imaging where different observation conditions can result in unnatural images.

Innovation Solution

A learning apparatus that trains a generative model by deriving multiple types of conversion training images and virtual images with different observation conditions, using a discriminator to evaluate and refine the model, without inputting categorical information directly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If GANs are used to generate images under varying observation conditions, then image generation capability is improved, but image naturalness deteriorates when observation conditions vary

Engineering Contradiction:
Improveimage generation capabilityVSAvoidimage naturalness
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by pre-processing training images to include multiple observation conditions during the training phase. The generator is trained on images that have been transformed to represent different observation conditions (e.g., different window levels and widths in medical imaging), enabling the model to learn and generate natural images across varying conditions without requiring post-processing adjustments.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If categorical information is input to the generator to adjust for observation conditions, then image naturalness under varying conditions is improved, but device complexity increases

Engineering Contradiction:
Improveimage naturalness under varying conditionsVSAvoidnetwork architecture complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by transforming images to embed observation condition information directly into the image data itself, rather than requiring separate categorical inputs. By converting observation conditions (such as window level and width parameters in medical imaging) into actual pixel value transformations, the generator learns to handle varying conditions through image parameter changes alone, eliminating the need for additional categorical input channels or complex conditional processing modules.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If multiple types of conversion training images with different observation conditions are used for training, then image quality consistency across observation conditions is improved, but training complexity increases

Engineering Contradiction:
Improveimage quality consistencyVSAvoidtraining process complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies merging by combining multiple observation conditions into a unified training dataset. Instead of training separate models for each observation condition or using complex multi-stage training procedures, the method merges images under different observation conditions into a single training set, allowing the generator to learn all conditions simultaneously through a unified training process that improves image quality consistency across conditions.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12493799B2Learning apparatus, method, and program, image generation apparatus, method, and program, trained model, virtual image, and recording medium
Publication Date: 2025.12.09 FUJIFILM CORP
  • US12493799B2 patent drawing
  • US12493799B2 patent drawing
  • US12493799B2 patent drawing

AI summary

A processor inputs a first training image having a first feature to a generator, which is a generative model and generates a training virtual image having a second feature. The processor derives a plurality of types of conversion training images with different observation conditions by performing a plurality of types of observation condition conversion processing on a second training image. The processor derives a plurality of types of conversion training virtual images with the different observation conditions by performing the plurality of types of observation condition conversion processing on the training virtual image. The processor trains the generative model using evaluation results regarding the plurality of types of conversion training images and the plurality of types of conversion training virtual images.