Eye-Tracked AR Display Layout for Real-Object Overlap Avoidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional electronic devices, such as AR or VR HMDs, struggle with users' difficulty in recognizing objects within their field of view when content is displayed, particularly when a terminal device is in the same straight line.
Innovation Solution
The electronic device adjusts content output based on the area occupied by an object in the user's field of view and the duration of gaze, reducing content size or repositioning it to avoid overlap with real objects, ensuring user convenience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If content is displayed on a display in the user's field of view, then information delivery is improved, but object recognition becomes difficult
Solution Approach 1:
The patent applies dynamics by making the content display adaptive and changeable based on real-time user gaze detection. The content's position, size, or visibility is dynamically adjusted according to whether the user is looking at the display or at objects in the real environment, resolving the contradiction between maintaining content visibility and enabling object recognition.
Solution Approach 2:
The patent uses eye tracking technology to provide feedback about user gaze direction. This feedback mechanism allows the system to detect when the user is looking at the display versus looking at real objects, and automatically adjusts content display parameters accordingly, thereby resolving the contradiction between information delivery and object recognition.
2Area of stationary object
If content is displayed in the same straight line as a terminal device in the user's field of view, then space utilization is improved, but user convenience deteriorates
Solution Approach 1:
The patent makes content positioning dynamic rather than fixed. When the user gaze is directed toward real objects, the content is automatically repositioned to avoid overlapping with those objects, even if this means changing from the optimal straight-line position. This dynamic adjustment prioritizes user convenience while maintaining reasonable space utilization.
3Difficulty of detecting and measuring
If content size is reduced to avoid overlap with real objects, then object recognition is improved, but content visibility deteriorates
Solution Approach 1:
The patent applies dynamics by making content size adjustable based on user gaze. When the user is looking at real objects, the content size is reduced to avoid overlap and facilitate object recognition. When the user returns gaze to the display, the content size is restored to its original magnitude, thus dynamically resolving the contradiction between object recognition and content visibility.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
An electronic device according to various embodiments may include a body part, a glass member supported by the body part, a display disposed at the glass member, a support part rotatably connected to the body part, a sensor module including an eye tracking camera and a front camera configured to capture an image of a front side of a user, and a processor operatively connected to the display and the sensor module, wherein the processor is configured to output at least one content via the display, recognize at least one object by controlling the front camera, obtain the user's gaze dwell time for the object from the eye tracking camera, when the gaze dwell time is greater than or equal to a reference time, calculate an area occupied by the object in a field of view (FOV) of the front camera, based on the area, output the at least one content on a region having no overlap with the object, or reduce a size of the at least one content and output the at least one content on one side of the display, and when the user's gaze dwell time for the object is smaller than the reference time, output the at least one content in a type identical to an initial output type. Various other embodiments are possible.