Evaluation Device for Context-Aware Image Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing technologies fail to generate appropriate content that reflects the context of news articles, often resulting in inappropriate content generation due to a lack of context reflection in processed images.

Innovation Solution

An evaluation device and method that includes an acquisition unit for generating modified content based on a modification policy and an evaluation unit using an evaluation model to assess whether the generated content matches the intended context, with reinforcement learning to improve content generation accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional image processing technology is used to generate processed images from images and text information, then image processing can be performed, but the context of news articles cannot be reflected in the processed images resulting in inappropriate content generation

Engineering Contradiction:
Improvecontent appropriatenessVSAvoidcontext information
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent segments the content generation process into multiple independent modules: a generation model that creates modified content based on input images and text, and a separate evaluation model that assesses whether the generated content appropriately reflects the source context. This segmentation allows each model to specialize in its function and enables independent optimization of content generation and quality assessment.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a feedback mechanism where the evaluation model provides assessment results back to the content generation process. The evaluation model determines whether generated modified content appropriately reflects the source news article context, and this evaluation feedback is used to improve the generation model's ability to produce contextually appropriate content in subsequent iterations.

Inventive Principle:
Principle #23Feedback

2Productivity

If a generation model is used to create modified content based on modification policy, then content generation efficiency is improved, but accuracy in matching the intended context may be insufficient

Engineering Contradiction:
Improvecontent generation efficiencyVSAvoidcontext matching accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent performs preliminary action by using the evaluation model to assess generated content before it is finalized or deployed. This preliminary evaluation ensures that content matching accuracy is verified early in the process, allowing for corrections or re-generation of content that does not adequately reflect the source context, thereby maintaining high accuracy without sacrificing generation efficiency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The evaluation model serves as an intermediary between the generation model and the final output. It mediates the content generation process by providing objective assessment of whether the generated modified content appropriately reflects the source news article, acting as a quality gate that ensures context matching accuracy while allowing the generation model to operate efficiently.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20220019917A1Evaluation device, evaluation method, and non-transitory computer readable storage medium
Publication Date: 2022.01.20 YAHOO JAPAN CORP
  • US20220019917A1 patent drawing
  • US20220019917A1 patent drawing
  • US20220019917A1 patent drawing

AI summary

An evaluation device according to the present application includes: an acquisition unit which acquires modified content generated by a generation model which generates modified content in which a part of content is modified in a modifying manner based on a modification policy and the modification policy used upon generating the modified content; and an evaluation unit which evaluates whether the modified content acquired by the acquisition unit is content in which modification matching the modification policy acquired by the acquisition unit is made, by using an evaluation model which evaluates whether inputted content is content in which modification matching an inputted modification policy is made.