Electronic Apparatus with Gaze-Aware GUI Control for Object Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
When a Graphical User Interface (GUI) image is displayed in an area other than the desired area by the user, the user's line of vision tends to be directed to the GUI image, making it difficult to maintain focus on the intended area, leading to potential misalignment between the detected object position and the actual object position.
Innovation Solution
An electronic apparatus that utilizes line-of-vision detection to adjust the GUI display based on the user's gaze, employing infrared light sources to detect corneal reflex and pupil edges, and adjusts the GUI visibility and position based on line-of-vision detection to ensure alignment with the user's intended focus.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If GUI image is displayed in an area other than the desired area, then the user interface is more visible, but the user's line of vision is diverted from the intended area causing detection inaccuracy
Solution Approach 1:
The GUI image display position and visibility are made dynamic rather than static. The system continuously adjusts the GUI display based on real-time line-of-vision detection results, moving the GUI to positions that do not interfere with the user's intended focus area, thus resolving the contradiction between GUI visibility and detection accuracy
Solution Approach 2:
The system implements a feedback loop where line-of-vision detection results are used to control GUI display behavior. The detection unit monitors where the user is looking, and this information feeds back to the control unit which adjusts GUI positioning and visibility accordingly, ensuring the GUI does not divert attention from the intended area
2Ease of operation
If GUI image is displayed prominently, then the user can easily access controls, but it becomes difficult to maintain focus on the intended拍摄 area
Solution Approach 1:
The GUI display characteristics (position, size, transparency) are dynamically adjusted based on the user's line of vision. When the user's gaze is detected to be on the intended拍摄 area, the GUI is positioned or dimmed to minimize distraction. When the user needs to interact with controls, the GUI becomes more prominent, thus maintaining both accessibility and focus reliability
Solution Approach 2:
The system takes preliminary action by detecting the user's line of vision before the user actually shifts focus away from the intended area. By anticipating potential distraction and proactively adjusting GUI visibility or position, the system prevents focus maintenance issues before they occur
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances the accuracy of directing the user's line of vision to the desired area, improving focus detection and reducing user discomfort by minimizing the visibility of GUI elements when they deviate from the user's intended focus.
Implementation Method 1
employing infrared light sources to detect corneal reflex and pupil edges
Implementation Method 2
detect corneal reflex and pupil edges
Data Source
Figure 1
Figure 2
Figure 3(A)~3(C)
AI summary
An electronic apparatus includes a display control unit configured to display an input image and a first GUI image at a display unit, a first detecting unit configured to detect a viewpoint of a user in the input image, and a second detecting unit configured to detect a position of a predetermined object in the input image, and when the position of the predetermined object is detected on the basis of the viewpoint, the display control unit makes the first GUI image less noticeable than when the position of the predetermined object is detected not on the basis of the viewpoint.