Wearable Gaze Interface for Real-Time Target Object Identification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable devices struggle to effectively identify and enhance visual objects in real-time based on user gaze, limiting the immersive experience of augmented and virtual reality applications.
Innovation Solution
A wearable device equipped with cameras, processors, and display capabilities that analyze user gaze to identify target objects, adjust displayed images, and provide interactive elements for enhanced object identification and interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the wearable device displays multiple images based on user gaze, then the information provision capability is improved, but the device complexity increases
Solution Approach 1:
The display content is segmented into multiple distinct images (first image, second image, third image) that can be independently controlled and displayed. Each image serves a specific function: the first image displays the visual object, the second image provides affordance information, and the third image shows additional context. This segmentation allows the system to manage complex information provision by dividing it into manageable, function-specific display layers.
Solution Approach 2:
The system transitions from traditional single-plane display to multi-plane or layered display architecture. By stacking multiple images in different visual layers (with varying transparency, positioning, and interaction properties), the system provides comprehensive information without increasing the physical complexity of the display hardware. The dimensionality change occurs in the visual presentation space rather than physical structure.
2Loss of information
If the wearable device provides detailed information about target objects, then the user experience is improved, but the ease of operation deteriorates
Solution Approach 1:
Different regions of the display are assigned different functional qualities and interaction modes. The first image region responds to gaze-based selection, the second image region provides contextual information with specific interaction affordances, and the third image region offers additional details. Each region has optimized properties for its specific purpose, allowing users to access detailed information without overwhelming the entire interface. This local quality differentiation maintains ease of operation by making interaction predictable and region-specific.
Solution Approach 2:
The second image acts as an intermediary layer between the user's gaze input and the detailed information in the third image. It provides affordance information that mediates the interaction, guiding users on how to access and interact with the detailed target object information. This intermediary layer simplifies operation by providing clear interaction cues before users engage with complex information.
3Measurement precision
If the wearable device changes images to emphasize visual objects, then the measurement precision is improved, but the productivity decreases
Solution Approach 1:
The image switching and emphasis changes occur in periodic cycles triggered by user gaze duration and interaction patterns. Rather than continuous switching, the system uses periodic updates where images are changed at specific intervals or when certain gaze conditions are met. This periodic action maintains measurement precision by ensuring timely updates while improving productivity by avoiding unnecessary frequent switches.
Solution Approach 2:
The display system dynamically adjusts image emphasis and switching based on real-time user gaze data and interaction state. The first image dynamically emphasizes the visual object when selected, the second image dynamically appears to provide affordance information, and the third image dynamically updates with detailed information. This dynamic adaptation optimizes the balance between identification precision and interaction efficiency by adjusting display behavior to user needs rather than following a fixed switching schedule.
Data Source
AI summary
A wearable device includes a display, one or more cameras, and at least one processor configured to identify information on a target object and a visual object related to an external object corresponding to the target object in at least one image. The at least one processor is configured to identify whether a first image including the visual object is displayed through the display. The at least one processor is configured to change the first image to emphasize the visual object, based on identifying that the first image including the visual object is displayed through the display. The at least one processor is configured to display an affordance for changing the gaze of the user to display the first image by overlapping the second image, based on identifying that a second image, which is distinct from the first image including the visual object, is displayed through the display.