Electronic Device Image Queries for Occluded Object Search
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image query systems for object search in augmented reality devices struggle with inaccurate results due to the arrangement of objects in images, particularly when one object is partially obscured by others.
Innovation Solution
An electronic device with a camera, communication circuit, and processor that extracts a primary object and associated secondary objects from an image, generates an image query including both, and transmits it to a server for enhanced search accuracy, utilizing deep learning algorithms and position information to refine the search.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If only the primary object is extracted and transmitted for search, then the search process is simple and fast, but the search accuracy decreases when the primary object is covered by other objects
Solution Approach 1:
The patent segments the image into multiple object regions, identifying both the primary object and secondary objects (objects covering or near the primary object). This segmentation allows the system to transmit comprehensive object information to the server for more accurate search results, resolving the contradiction between search simplicity and accuracy.
Solution Approach 2:
The patent adds a new dimension to image search by incorporating spatial relationship information between objects. Instead of transmitting only the primary object, the system includes positional and relational data of secondary objects, enabling the server to perform more accurate searches while maintaining reasonable query complexity.
2Measurement precision
If the entire image is transmitted for search, then the search accuracy is maintained, but the data transmission volume increases and search efficiency decreases
Solution Approach 1:
The patent extracts only the necessary object information from the entire image, specifically identifying and transmitting regions of interest including primary and secondary objects. This extraction approach maintains search accuracy by providing relevant object data while reducing the overall data transmission volume and improving search efficiency.
Solution Approach 2:
The patent applies partial action by transmitting only the essential object regions and their spatial relationships rather than the complete image. This partial transmission strategy provides sufficient information for accurate search while avoiding the inefficiency of transmitting the entire image data.
3Ease of operation
If objects are separated and transmitted individually, then the search can focus on specific objects, but the search results become inaccurate when objects are covered or occluded
Solution Approach 1:
The patent merges the primary object with its spatial relationship information and secondary objects into a unified query structure. This combination allows the server to understand the contextual relationships between objects, improving search accuracy for occluded or covered objects while maintaining simple search operations through a structured query format.
Data Source
AI summary
An electronic device is provided. The electronic device includes a camera, a communication circuit, memory storing one or more computer programs, and one or more processors communicatively coupled to the camera, the communication circuit, and the memory, wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to extract, from an image obtained from the camera, a portion of the image including objects, determine a primary object to be searched for from among the objects in the image, determine an object associated with the primary object as a secondary object, from among other objects in the image, generate an image query including a portion of the image including at least one of the primary object or the secondary object, and including a request for information related to the primary object, and transmit the image query to a server through the communication circuit.