Mirror Display Gaze Tracking for Context-Aware GUI Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices with mirror displays lack the ability to seamlessly integrate user gaze information and object recognition to provide context-aware and interactive display functions.
Innovation Solution
An electronic apparatus equipped with a mirror display, a sensor, and a processor that identifies user commands, acquires user gaze information, recognizes objects in a predetermined space, and controls the display to show relevant GUIs based on user input and object information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a mirror display is used to provide both mirror and display functions, then the device versatility is improved, but the ease of operation deteriorates because users cannot intuitively interact with displayed content
Solution Approach 1:
The system acquires user gaze information through sensors and uses this feedback to automatically identify which reflected object the user is viewing, then displays relevant GUIs without requiring manual selection. This creates a closed-loop system where the display adapts to user attention, making interaction intuitive and effortless.
Solution Approach 2:
The mirror display system automatically performs object identification and GUI selection based on user gaze, eliminating the need for users to manually navigate menus or select objects. The system serves itself by autonomously determining what information to display based on real-time gaze detection.
2Device complexity
If manual selection of display area is required, then the device complexity is reduced, but the productivity deteriorates because users spend time selecting areas instead of directly interacting with objects
Solution Approach 1:
The system performs preliminary action by pre-identifying all objects in the reflected space and preparing their corresponding GUIs in advance. When user gaze is detected, the system can immediately display the relevant GUI without requiring users to search or select from menus, thus eliminating selection time and improving interaction efficiency.
3Ease of operation
If gaze information processing and object recognition are added to the mirror display, then the ease of operation is improved, but the device complexity worsens due to additional sensors and processing requirements
Solution Approach 1:
The processor is designed to perform multiple functions: it controls the mirror display, processes gaze information from the sensor, identifies objects in the reflected space, and manages GUI generation and positioning. By making the processor universal and multi-functional, the system avoids adding separate dedicated hardware for each function, thus limiting the increase in device complexity.
4Device complexity
If GUI position is fixed on the mirror display, then the device complexity is reduced, but the ease of operation deteriorates because users must move their gaze to different fixed positions for different objects
Solution Approach 1:
The GUI position on the mirror display is made dynamic rather than fixed. The system calculates and adjusts the optimal position for each GUI based on the user's current gaze position and the spatial relationship between the user, mirror, and objects. This dynamic positioning allows GUIs to appear naturally near their corresponding reflected objects, reducing the need for users to move their gaze across the display surface.
Data Source
AI summary
An electronic apparatus including a mirror display; a sensor; and at least one processor configured to identify a user command for selecting an area of the mirror display, acquire user gaze information through the sensor, identify an object in a predetermined space and reflected in the selected area of the mirror display based on the acquired user gaze information, identify a graphic user interface (GUI) to be displayed on the mirror display based on information on the identified object, identify a position on the mirror display to display the identified GUI based on the user gaze information, and control the mirror display to display the identified GUI on the identified position.