Gaze-Assisted Object Recognition Reducing Processing Load
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional electronic devices face challenges in efficiently recognizing objects, particularly in reducing processing time and power consumption, especially in scenarios where users need to analyze multiple objects or objects are not easily accessible.
Innovation Solution
The system determines the user's gaze direction to minimize the search space when analyzing images, allowing for efficient object recognition by correlating gaze direction with objects in the field of view, thereby reducing unnecessary processing and power usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the system analyzes all objects in an image, then object recognition completeness is improved, but processing time and power consumption increase significantly
Solution Approach 1:
The patent segments the image analysis task by dividing the field of view into multiple regions based on gaze direction. Instead of analyzing the entire image, the system identifies the region corresponding to where the user is looking and analyzes only that segment, thereby reducing processing requirements while maintaining recognition completeness for the target object.
Solution Approach 2:
The patent extracts only the relevant portion of the image based on gaze direction. By determining where the user is looking and extracting only that region for analysis, the system eliminates unnecessary processing of other areas, directly reducing power consumption while maintaining accurate object recognition.
2Measurement precision
If the system requires manual selection of objects, then object recognition accuracy is improved, but ease of operation deteriorates
Solution Approach 1:
The patent implements self-service by using gaze direction to automatically determine which object the user wants to analyze. The system interprets the user's natural gaze as a selection mechanism, eliminating the need for manual interaction such as tapping or clicking, thereby maintaining accuracy while significantly improving ease of operation.
Solution Approach 2:
The patent introduces gaze direction as an intermediary between the user and the object selection process. Instead of requiring direct manual selection, the system uses gaze direction as a mediator to infer user intent and automatically identify the target object, combining the accuracy of manual selection with the ease of automatic operation.
3Measurement precision
If the user focuses the camera on the object, then object recognition accuracy is improved, but ease of operation worsens due to significant user effort
Solution Approach 1:
The patent enables the system to perform the focusing function automatically by interpreting gaze direction as an indicator of the user's attention. Instead of requiring the user to manually focus the camera, the system uses gaze tracking to automatically identify and focus on the object of interest, maintaining accuracy while eliminating the effortful manual focusing process.
Data Source
AI summary
An electronic device can attempt to determine a gaze direction of a user, which can be used to determine an object of interest to the user. Determining the gaze direction helps to reduce the search space and reduce processing requirements for identifying the object. Image information can be captured that includes the object of interest, which then can be analyzed to recognize the type of object. Upon recognizing the object, the user can be provided with information about the object, which in some cases can depend at least in part upon a current context or location of the object. If the object is a networked device, the user can potentially be provided with input options for controlling the device.