Image Processing Apparatus Weighted Query Heat Map for Object Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing techniques, such as weakly supervised visual grounding, struggle to accurately detect the main object in an image due to the equal treatment of all words in the query, leading to incorrect detection of sub-objects.
Innovation Solution
The proposed image processing apparatus analyzes word dependencies to distinguish between words corresponding to the main object and sub-objects, assigns different weights to these words, and recalculates the query heat map as a weighted sum of word heat maps to emphasize the main object, thereby improving detection accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If all words in the query are treated equally in the heat map calculation, then the processing is simple, but the detection accuracy of the main object deteriorates
Solution Approach 1:
The patent applies local quality by assigning different weights to different words in the query based on their importance. Specifically, it distinguishes between main object words and sub-object words, giving higher weights to main object words (e.g., 1.0) and lower weights to sub-object words (e.g., 0.5). This differential weighting in the heat map calculation ensures that the main object detection is prioritized while maintaining manageable processing complexity.
2Measurement precision
If word dependencies are analyzed and different weights are assigned to distinguish main objects from sub-objects, then detection accuracy of the main object is improved, but the processing complexity increases
Solution Approach 1:
The patent applies preliminary action by performing word dependency analysis and weight assignment before the heat map calculation. The system pre-processes the query to identify main object words and sub-object words, assigns appropriate weights to each word, and then uses these pre-determined weights in the heat map computation. This preliminary preparation improves main object detection accuracy while keeping the overall processing structured and manageable.
Data Source
AI summary
An image processing apparatus according to an embodiment includes a hardware processor. The processor receives input of an image and receives input of a query including one or more words. The processor calculates a word heat map for each of the words. The word heat map indicates a degree of relation between the word and each of subregions included in the image. The processor calculates weight of each of the words. The processor calculates, on the basis of the word heat maps and the weights, a query heat map indicating a degree of relation between the query and each of the subregions included in the image. The processor detects an image region from the image on the basis of the query heat map and outputs the image region. The image region corresponds to an object related to the query.