Mixed Reality Collision Visualization via Dynamic Transparency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing Mixed Reality (MR) systems fail to effectively visualize collisions between physical objects and virtual objects, making it difficult for users to recognize collisions between these entities in a combined physical and virtual space.
Innovation Solution
An information processing apparatus that captures physical space images, detects physical objects, creates virtual objects, and detects collisions between them, determining the display state of these objects to create a mixed reality image that combines physical and virtual space elements for visualization on a display device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If collision visualization is implemented in MR systems, then collision detection capability is improved, but the physical object becomes unrecognizable to the user
Solution Approach 1:
The patent applies local quality by making different parts of the virtual object have different transparency characteristics. The collision portion of the virtual object is rendered with higher transparency to reveal the physical object behind it, while non-collision portions maintain normal opacity. This allows collision detection visualization while preserving physical object recognizability in the regions where it matters most.
Solution Approach 2:
The patent utilizes color changes to indicate collision states. When a virtual object collides with a physical object, the collision portion of the virtual object changes its display characteristics (such as becoming more transparent or changing color intensity) to visually signal the collision event. This provides clear collision feedback without obscuring the underlying physical object.
2Loss of information
If collision trace is left for virtual objects, then collision indication is improved, but the technique does not apply to physical-virtual collision detection
Solution Approach 1:
The patent implements a universal collision detection and visualization system that works for both virtual-virtual and physical-virtual collisions. The same technical approach of modifying virtual object transparency based on collision detection is applied consistently across different collision types, making the system versatile and adaptable to various MR scenarios without requiring separate solutions.
3Loss of information
If virtual object transparency is increased at collision portion, then physical object visibility is improved, but virtual object presence may be reduced
Solution Approach 1:
The patent dynamically changes the transparency parameter of the virtual object based on collision detection results. When collision is detected, the transparency of the collision portion is increased to reveal the physical object. When no collision occurs, the virtual object maintains its normal transparency. This dynamic parameter adjustment ensures both physical object visibility during collisions and virtual object presence perception during normal operation.
Data Source
AI summary
An information processing apparatus creates a first virtual object expressing a physical object that is detected from physical object information obtained from a physical object information acquisition unit. The information processing apparatus determines a display state of the first virtual object in accordance with a result of detecting collision between the first virtual object and a second virtual object. The information processing apparatus creates, on the basis of a virtual space including the first virtual object and the second virtual object, position-orientation of an HMD, the determined display state, and a physical space image obtained from the HMD, a mixed reality image in combination of an image of the virtual space and the physical space image, and displays the created mixed reality image on the HMD.