AR Word Flow Annotation for Rare-Word Speech Support
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR, AR, and MR technologies struggle to provide a comfortable and natural presentation of virtual image elements amidst real-world imagery, often causing eye strain and discomfort due to accommodation conflicts.
Innovation Solution
A wearable system with a stacked waveguide assembly and depth plane imaging technology that simulates three-dimensional imagery by matching accommodative and vergence cues, combined with an augmented reality display that provides real-time visual and audio annotations for unfamiliar words and objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If virtual image elements are presented among real-world imagery in VR/AR/MR systems, then information delivery is enhanced, but user comfort deteriorates due to accommodation conflicts and eye strain
Solution Approach 1:
The system segments the visual field into multiple depth planes, with virtual image elements presented on specific planes rather than mixed indiscriminately with real-world imagery. This segmentation allows the visual system to process different depth information separately, reducing accommodation conflicts while maintaining information delivery.
Solution Approach 2:
The system adds the depth plane dimension to the presentation of virtual image elements, organizing them along the Z-axis (depth) rather than only in the 2D visual field. This dimensional organization creates distinct focal surfaces that reduce visual conflict and eye strain while preserving information delivery.
2Loss of information
If multiple virtual image elements are presented simultaneously in VR/AR/MR systems, then information delivery is enhanced, but visual complexity increases causing discomfort
Solution Approach 1:
The system segments multiple virtual image elements across different depth planes, organizing them vertically along the Z-axis. This segmentation reduces visual complexity by creating distinct focal surfaces, allowing the visual system to process elements hierarchically rather than simultaneously at the same depth level.
Solution Approach 2:
The system utilizes the depth dimension (Z-axis) to organize multiple virtual image elements, transforming a 2D visual field problem into a 3D spatial arrangement. This dimensional change distributes visual complexity across depth planes, reducing the cognitive and visual load on the user.
3Loss of information
If virtual content is overlaid on real-world imagery in AR systems, then auxiliary information is provided, but distraction to the user increases
Solution Approach 1:
The system segments auxiliary information onto separate depth planes rather than overlaying it directly on the real-world imagery. This segmentation creates visual separation between the real environment and virtual annotations, reducing distraction while maintaining information provision.
Solution Approach 2:
The system introduces depth planes as an intermediary layer between the real-world imagery and virtual auxiliary information. This intermediary structure organizes the visual hierarchy, allowing the visual system to prioritize real-world elements while accessing auxiliary information on separate focal surfaces, thereby reducing distraction.
Data Source
AI summary
An augmented reality (AR) device can be configured to monitor ambient audio data. The AR device can detect speech in the ambient audio data, convert the detected speech into text, or detect keywords such as rare words in the speech. When a rare word is detected, the AR device can retrieve auxiliary information (e.g., a definition) related to the rare word from a public or private source. The AR device can display the auxiliary information for a user to help the user better understand the speech. The AR device may perform translation of foreign speech, may display text (or the translation) of a speaker's speech to the user, or display statistical or other information associated with the speech.