Near Eye Display Object Positioning via Optical Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current user interaction methods in augmented reality systems are not intuitive and do not fully exploit the technical capabilities of these systems, lacking optimal solutions for interacting with the local environment beyond physical means.
Innovation Solution
A near-eye display (NED) system that includes an optical assembly with an electronic display and an imaging device, which captures images of the local area, determines object positions, and updates display instructions to show supplemental information about objects, such as user profiles, in an augmented reality environment, using eye tracking and gesture recognition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If physical interaction methods are used to interact with devices in augmented reality, then the interaction is simple and direct, but the user experience is limited and not intuitive for augmented reality capabilities
Solution Approach 1:
The patent replaces physical mechanical interaction with optical-based eye tracking and gesture recognition systems. The eye tracking device captures eye movement data to determine gaze position, while imaging devices capture hand gestures, substituting direct physical contact with non-contact optical measurement systems that are more intuitive for augmented reality
Solution Approach 2:
The patent introduces an intermediary processing system that translates eye gaze positions and hand gestures into device control commands. This intermediary layer processes the optical data and maps it to meaningful interactions, enabling intuitive control without direct physical contact with the device
2Loss of information
If augmented reality systems display supplemental information about objects, then information accessibility is improved, but the display complexity and processing requirements increase
Solution Approach 1:
The system performs preliminary actions by pre-processing images captured by imaging devices to identify objects and their positions before displaying supplemental information. User profile information and object data are prepared in advance, reducing real-time processing complexity when information needs to be displayed
Solution Approach 2:
The patent applies local quality by displaying supplemental information selectively at specific locations in the augmented reality field of view corresponding to the gaze position. Only relevant information about objects in the user's line of sight is displayed, rather than overwhelming the user with all available data
Data Source
AI summary
A system includes a near eye display (NED) comprising a substantially transparent electronic display that is configured to display images in accordance with display instructions, and an imaging device configured to capture one or more images of a portions of a local area surrounding the NED. The system further includes a controller configured to determine a position of an object within the local area using the captured one or more images and location information associated with the object. The controller accesses supplemental information regarding the object, and updates the display instructions to cause the substantially transparent electronic display to display at least a portion of the supplemental information about the object. The display of the at least a portion of the supplemental information is positioned within a threshold distance of the determined position of the object in an augmented reality environment as presented via the substantially transparent electronic display.