Extended Reality Presentation Annotation System
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Extended reality presentations often exclude users with deficits in visual, auditory, or haptic modalities, as they rely heavily on these senses for content delivery, making experiences incomplete or incomprehensible for individuals with vision, hearing, or sensory/muscular impairments.
Innovation Solution
Adaptive techniques generate and present annotation modalities that describe events in extended reality presentations, allowing users with deficits to access content through alternative sensory channels, such as audio or haptic descriptions, concurrent with or substituting for the original modality, thereby enhancing accessibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If extended reality presentations use visual, auditory, or haptic modalities for content delivery, then the immersion and experience quality are improved, but users with deficits in these modalities are excluded or experience incomplete content
Solution Approach 1:
The patent introduces an intermediary system that translates events from the source modality (visual, auditory, or haptic) into annotations in an alternative modality. This mediator enables users with deficits to access content through a different sensory channel, resolving the contradiction by preserving information completeness while adapting to user capabilities.
Solution Approach 2:
The system dynamically changes the modality parameter of content delivery based on user capabilities. By detecting which modality the user cannot perceive and translating content to an alternative modality, the system maintains information accessibility while adapting to individual user parameters.
2Loss of information
If annotation modalities are generated and presented concurrently with source content, then user comprehension is improved, but system complexity and processing requirements increase
Solution Approach 1:
The system performs preliminary analysis of the source channel to identify events that need annotation before presenting them to the user. By pre-processing the content to detect and tag events, the system reduces real-time processing complexity while ensuring comprehensive annotation coverage.
Solution Approach 2:
The system generates annotations selectively for identified events rather than translating all content. This partial action approach focuses processing resources on meaningful events only, reducing overall system complexity while maintaining comprehension of critical content.
Data Source
AI summary
Extended reality presentations (e.g., augmented reality, augmented virtuality, and virtual reality) are often presented as multimodal experiences involving a combination of visual, audio, and haptic input and output channels. Users who have a deficit in one modality may consume other channels of the extended reality presentation, but the absence of the deficit modality may render the extended reality presentation incomplete or incomprehensible. Instead, for users with a deficit in a source modality, a modality may be identified as an annotation modality in which the user does not have a deficit. An annotation set of annotations in the annotation modality may be generated that respectively describe an event arising in a source channel in the source modality. The annotation set may be presented to the user (either supplementing the source channel or in lieu of the source channel), thereby adapting the extended reality presentation to the physiological capabilities of the user.