Mixed Reality Display Modifying AR Content for Interaction Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In augmented reality systems, users operating in exclusive environments may inadvertently ignore attempts to communicate due to their augmented reality content obstructing their view of approaching individuals, leading to misunderstandings and poor user experiences, especially in scenarios where faces are detected unintentionally or when relying on gaze direction changes.
Innovation Solution
A computer-implemented method that detects interactions between users and individuals, determines the urgency of these interactions, and applies transition effects such as modifying the positioning or transparency of augmented reality content to ensure clear visibility of the person, prioritizing visibility over content legibility when urgency is high.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If augmented reality content is displayed in exclusive environment, then user immersion and content privacy are improved, but user's ability to perceive real-world people and interactions deteriorates
Solution Approach 1:
The system dynamically adjusts the display characteristics of augmented reality content based on detected interactions. When an interaction is detected (such as someone approaching or making eye contact), the system modifies the AR content display to improve visibility of the interaction, thereby resolving the contradiction between maintaining immersion and perceiving real-world people.
Solution Approach 2:
The system uses sensors to detect real-world interactions and provides feedback by modifying the AR content display accordingly. This closed-loop feedback mechanism allows the system to respond to real-world events, ensuring that AR content does not obstruct important interpersonal interactions while maintaining immersion during normal operation.
2Productivity
If augmented reality content is repositioned to avoid obscuring interactions, then communication efficiency is improved, but content legibility and user experience deteriorate
Solution Approach 1:
The system dynamically modifies AR content display only when interactions are detected, rather than continuously repositioning content. This selective dynamic adjustment maintains content legibility during normal operation while improving communication efficiency when needed, resolving the contradiction between these two parameters.
Solution Approach 2:
The system applies local modifications to specific portions of AR content that obstruct interactions, rather than moving all content globally. This allows the system to maintain overall content legibility while locally adjusting only the necessary portions to improve communication efficiency.
3Object-affected harmful factors
If face detection is used to modify AR content display, then interpersonal interaction visibility is improved, but false positives in crowded environments increase
Solution Approach 1:
The system performs preliminary detection of interactions using multiple sensors before modifying AR content display. By detecting interactions in advance and verifying them through multiple detection methods, the system reduces false positives in crowded environments while maintaining visibility of genuine interpersonal interactions.
Solution Approach 2:
The system uses multiple sensors and detection methods (beyond just face detection) to identify interpersonal interactions. This multi-functional approach improves detection reliability by cross-verifying interactions through different modalities, reducing false positives while maintaining visibility of real interactions.
4Object-affected harmful factors
If transparency mode is changed based on gaze direction, then user awareness of surroundings is improved, but legibility of augmented content deteriorates
Solution Approach 1:
The system dynamically adjusts transparency and display modes based on detected interactions rather than solely on gaze direction. This interaction-based dynamic adjustment maintains content legibility by only modifying display when necessary for communication, while still improving user awareness of surroundings when interactions occur.
Data Source
AI summary
A system and head-mounted device modify display of augmented reality content during an interaction between a person and a user of a mixed reality system. The method comprises detecting an interaction between a person and a user of a mixed reality system, the mixed reality system displaying the augmented reality content to the user, the interaction being detectable by the mixed reality system when a gaze interaction of the person is detected as directed towards the user and accordingly a sensor of the mixed reality system; determining an urgency of the interaction according to further interaction between the person and the user; determining that an element of the display of the augmented reality content is obscuring the interaction; selecting a transition effect for modifying display of the element from a plurality of transition effects according to the determined urgency of the interaction, and modifying the display of the element according to the selected transition effect.