Image Content Verification Using Visual and Textual Signatures
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image recognition methods for verifying the content of stacked products in containers require extensive training with millions of labeled images, are limited to specific applications, and are inefficient for a variety of objects and domains.
Innovation Solution
A method that combines image processing with textual information to verify declared content, using neural networks to generate visual and textual signatures, which are compared to reference signatures in a database, reducing the need for extensive training and enhancing versatility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional image processing techniques with neural networks are used to recognize products in images, then object recognition capability is improved, but training time and computing resources increase tremendously
Solution Approach 1:
The patent introduces textual information as an intermediary element that bridges the gap between image content and product identification. Instead of relying solely on visual features that require extensive training, the system uses text descriptions (product names, categories, attributes) as additional cues to improve recognition accuracy while reducing the burden of training data requirements
Solution Approach 2:
The system processes both image data and textual data through unified neural network architectures that can handle multiple types of input. This multi-functional approach allows the same system to work across different product categories and domains without requiring separate specialized models for each, thereby reducing overall training time and resource requirements
2Measurement precision
If traditional image processing techniques are used to recognize stacked products in containers, then recognition capability is improved for limited pre-defined products, but adaptability to a variety of objects and domains deteriorates
Solution Approach 1:
The patent creates a universal system that can recognize and verify products across multiple domains by integrating textual information processing. The neural networks are designed to handle general product categories and attributes, allowing the system to adapt to new product types and domains without requiring complete retraining, thus achieving both accuracy and versatility
Solution Approach 2:
The system automatically extracts and processes textual information from various sources (product labels, descriptions, databases) to enhance recognition capability. This self-service approach allows the system to adapt to new domains by automatically incorporating available textual data without requiring manual configuration or extensive retraining for each new application area
3Measurement precision
If extensive training with millions of labeled images is conducted to improve recognition accuracy, then measurement precision is improved, but computing resources and time requirements increase
Solution Approach 1:
The patent merges image processing and text processing into a unified verification system. By combining visual features with textual information (product names, descriptions, attributes), the system achieves high verification accuracy without requiring millions of labeled images for training, as the textual information provides additional constraints and cues that reduce the search space and training requirements
Data Source
Figure 1
Figure 2~3
AI summary
The invention relates to a method (100) for automated verification of a declared content of an image (102), comprising the following steps: - generating (108) a first numerical data (MVS), called measured visual signature, relating to a content of said image (102), by analyzing at least one part of said image (102), -generating (110) a second numerical data (MTS), called measured textual signature, by analyzing at least one part of a textual message (104) indicating said declared content of said image (102), -verification (112,114) of a correspondence between said declared content and the content of said image (102) based on: ▪ said measured visual signature (MVS), ▪ said reference visual signature (MTS°, and ▪ at least one pair of signatures comprising a reference visual signature and a reference textual signatures, stored in a database (RDB), called reference database.