GUI Display Control for Accurate Gaze-Guided Object Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing camera systems struggle with accurately directing the user's line of vision to the desired area due to discrepancies between detected object positions and actual object positions, especially when graphical user interface (GUI) images are displayed outside the user's intended viewing area, leading to potential misalignment and discomfort.

Innovation Solution

An electronic apparatus with a display control unit that adjusts the position and visibility of GUI images based on detected user viewpoints and object positions, using a first and second detecting unit to ensure alignment and minimize overlap, and employs threshold values to manage visibility and tracking reliability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If GUI images are displayed in areas other than the user's desired viewing area, then information display capability is improved, but line of vision detection accuracy deteriorates

Engineering Contradiction:
Improveinformation display capabilityVSAvoidline of vision detection accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The patent dynamically adjusts the display position and visibility of GUI images based on detected line of vision position. When the line of vision is directed toward a desired area, the GUI image is displayed in a position corresponding to that area. When the line of vision shifts, the GUI image position is adjusted or visibility is reduced, ensuring continuous alignment with the user's actual viewing focus and maintaining detection accuracy.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies different display strategies to different regions of the display device. The display control unit determines whether to display the GUI image in the first area (desired viewing area) or second area (other area) based on line of vision detection results. This localized adaptation ensures that GUI information is displayed optimally in the region where the user is actually looking, rather than using a fixed display position.

Inventive Principle:
Principle #3Local quality

2Extent of automation

If line of vision information is used for object detection, then automation is improved, but detection accuracy deteriorates due to GUI interference

Engineering Contradiction:
ImproveautomationVSAvoiddetection accuracy
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The patent implements a feedback loop where the display control unit continuously monitors line of vision detection results and adjusts GUI image display accordingly. The system detects the user's line of vision position, determines the desired viewing area, and feeds this information back to adjust the GUI image position and visibility. This closed-loop control ensures that automation continues while minimizing GUI interference with detection accuracy.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically adjusts the GUI image display state based on real-time line of vision detection. When detection accuracy is compromised by GUI presence, the system automatically adjusts the GUI position or reduces its visibility, allowing automated object detection to proceed with high accuracy while maintaining user information access when appropriate.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12568300B2Electronic apparatus, method for controlling electronic apparatus, and non-transitory computer-readable storage medium for GUI control on a display
Publication Date: 2026.03.03 CANON KK
  • US12568300B2 patent drawing
  • US12568300B2 patent drawing
  • US12568300B2 patent drawing

AI summary

An electronic apparatus includes: a display control unit configured to display an input image, a first GUI image, and a second GUI image at a display; a first detecting unit configured to detect a position of a predetermined object in the input image; and a second detecting unit configured to detect a viewpoint of a user in the input image, wherein the display control unit displays the first GUI image in a position corresponding to the position of the predetermined object detected by the first detecting unit and the second GUI image in a position corresponding to the viewpoint detected by the second detecting unit, and in a case where the first GUI image and the second GUI image overlap, the display control unit makes the second GUI image less noticeable than in a case where the first GUI image and the second GUI image do not overlap.