Image-Text Mismatch Detection for Metadata Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users often mistakenly modify text associated with images, leading to mismatches between image information and text data, making it difficult to determine the accuracy of the text.

Innovation Solution

An information-processing apparatus and method that acquires image information and compares it with text data, detecting mismatches and generating notifications to alert users of discrepancies, thereby facilitating the correction of text to match the image information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If text is automatically generated using meta information, then user burden for text input is reduced, but text accuracy and matching with image information deteriorates

Engineering Contradiction:
Improveuser burden for text inputVSAvoidtext accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system extracts objects from images using image recognition, automatically generates text based on these objects, and then performs verification by comparing the generated text with image metadata. This feedback loop ensures text accuracy while maintaining automatic generation, resolving the contradiction between ease of operation and reliability.

Inventive Principle:
Principle #23Feedback

2Reliability

If users manually edit generated text, then text accuracy can be improved, but time consumption and user burden increase

Engineering Contradiction:
Improvetext accuracyVSAvoidtime for text editing
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary verification by comparing automatically generated text with image metadata before user review. This preliminary action filters out obvious mismatches, reducing the time users need to spend on editing while maintaining text accuracy through automated pre-checking.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If text matching verification is performed, then text accuracy is ensured, but processing time and system complexity increase

Engineering Contradiction:
Improvetext matching accuracyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs self-verification by automatically comparing generated text with image metadata using image recognition and data extraction. This self-service approach ensures text matching accuracy without requiring complex manual verification processes, maintaining reliability while controlling system complexity.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10909413B2Information-processing apparatus, control method, and non-transitory computer readable medium
Publication Date: 2021.02.02 CANON KK
  • US10909413B2 patent drawing
  • US10909413B2 patent drawing
  • US10909413B2 patent drawing

AI summary

An information-processing apparatus includes: an image acquisition unit configured to acquire information on a predetermined item as image information from an image file; a comparison unit configured to compare the image information with text data relating to the image file; and a notification unit configured to perform a notification in a case where a result of the comparison indicates a mismatch between the image information and the text data.