Wearable Display Masking Control for Mixed-Reality Sharing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mixed reality (MR) technologies face challenges in providing a seamless user experience due to issues with transparent masking of computer graphics (CG) images, which can make real objects invisible or disrupt the intended content when shared across different users or environments, leading to obstacles in communication and immersion.
Innovation Solution
An information processing apparatus and method that controls the display of virtual objects by acquiring and processing virtual object information, adjusting the masking of CG images based on user context and environment, ensuring that real objects remain visible and the intended content is communicated effectively.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If masking CG is used to mask real objects in MR space, then the anteroposterior relationship between real and virtual objects is reproduced, but the real objects become invisible to remote users and users in VR mode
Solution Approach 1:
The patent applies dynamics by making the masking CG transparency state changeable based on user context. The system dynamically adjusts whether masking CG is transparent or opaque depending on whether the user is in MR mode or VR mode, and whether real objects are detected in the environment. This resolves the contradiction by allowing the system to switch between states that prioritize depth accuracy and real object visibility as needed.
Solution Approach 2:
The patent changes the transparency parameter of masking CG from a fixed state to a variable state. By controlling the transparency parameter based on operation mode (MR/VR) and environmental conditions (presence of real objects), the system achieves both accurate depth representation and real object visibility when needed. The parameter change allows the same masking CG to serve different functions in different contexts.
2Adaptability or versatility
If masking CG is shared across different users, then collaborative MR experience is enabled, but communication effectiveness deteriorates when real objects are not present
Solution Approach 1:
The system dynamically adjusts masking CG transparency based on whether collaborators are present in the same physical space. When users are co-located, masking CG remains transparent to show real objects. When users are remote, the system detects the absence of real objects and makes masking CG opaque to maintain communication effectiveness. This dynamic adaptation enables versatile sharing while preserving communication quality.
Solution Approach 2:
The system uses feedback from environmental sensors and user context to automatically adjust masking CG transparency. By detecting whether real objects are present and whether users are in the same location, the system receives feedback that triggers appropriate transparency adjustments, ensuring masking CG serves the collaborative communication needs of each specific situation.
3Device complexity
If masking CG transparency is fixed, then simple display processing is achieved, but user experience deteriorates in different operation modes and environments
Solution Approach 1:
The patent implements dynamic transparency control that adapts to different operation modes (MR/VR) and environmental conditions. Instead of fixed transparency, the system automatically adjusts masking CG transparency based on real-time context, ensuring consistent and reliable user experience across varying conditions while maintaining manageable processing complexity through rule-based adjustments.
Data Source
AI summary
An information processing apparatus for controlling a display operation of a display device which a user wears includes an acquisition unit configured to acquire virtual object information which is information about a virtual object which the information processing apparatus causes the display device to display, and a control unit configured to control displaying of an image of the virtual object based on the virtual object information acquired by the acquisition unit, wherein, in a case where a masking flag which indicates superimposing a transparent mask image on a real object in a display screen of a different display device which a different user wears is included in the virtual object information, the control unit performs control to cause the first-mentioned display device to display an image different from the transparent mask image.