VR Obstacle Highlighting via 3D Occupancy and Surface Shape Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users engaging with VR content through head-mounted displays (HMDs) often become immersed and fail to notice their surroundings, leading to a high risk of collisions with real objects.
Innovation Solution
An information processing apparatus that acquires three-dimensional information about occupancy probabilities and surface shapes of objects in real space, classifies objects based on this information, and highlights their surfaces to notify the user of potential obstacles.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a user wears an HMD to enjoy VR content, then the user can be immersed in the virtual environment and enjoy the content, but the user cannot see the surrounding environment and is at high risk of collision with real objects
Solution Approach 1:
The patent introduces an intermediary system consisting of cameras and processing units that detect real-world obstacles and transmit this information to the HMD display. This intermediary layer bridges the user's virtual immersion with real-world safety by translating physical obstacles into visual warnings within the VR environment, allowing the user to maintain immersion while being alerted to potential collisions
Solution Approach 2:
The patent utilizes color changes in the HMD display to communicate obstacle information to the user. By changing the color of virtual elements or adding colored overlays when obstacles are detected, the system provides intuitive visual feedback that stands out against the VR content, enabling users to quickly perceive danger without breaking their immersion
2Difficulty of detecting and measuring
If obstacle detection is performed using feature point extraction from captured images, then the system can identify objects in the environment, but the detection accuracy and reliability are insufficient for safe VR usage
Solution Approach 1:
The patent merges multiple detection approaches by combining feature point extraction with depth information from stereo cameras and spatial reasoning. This integration allows the system to cross-validate obstacle positions using multiple data sources, significantly improving detection reliability and reducing false positives while maintaining accuracy in complex environments
Solution Approach 2:
The patent transitions from two-dimensional image processing to three-dimensional spatial understanding by incorporating depth information and volumetric occupancy models. This dimensional enhancement allows the system to detect obstacles more reliably by considering their spatial extent and relationship with the user's movement space, rather than relying solely on 2D image features
Data Source
AI summary
An information processing apparatus (100) includes a control unit (130). The control unit (130) acquires first three-dimensional information related to an occupancy probability of an object in a real space and second three-dimensional information related to an estimation result of a surface shape of the object. The control unit (130) classifies the object based on the first three-dimensional information and floor surface information related to a floor surface in the real space. The control unit (130) highlights the surface of the object classified based on the second three-dimensional information.