AR Object Detection for Obscured Real-World Hazards
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented and mixed reality systems fail to effectively detect and present obscured real-world objects, leading to potential hazards such as walking into obstacles or missing important signs due to virtual content overlay.
Innovation Solution
A method and system that utilize an object of interest computer program to detect physical objects obscured by virtual or augmented reality content, generate a representation of these objects, and provide it to a VR/AR program for display over the obstructing virtual content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual or augmented reality content is displayed to provide immersive experience, then user engagement and entertainment are improved, but real-world objects and hazards become obscured leading to safety risks
Solution Approach 1:
The system performs preliminary detection of real-world objects and hazards before displaying virtual content that could obscure them. By pre-identifying objects of interest (hazards, navigation aids, landmarks) and determining their spatial relationships with virtual content, the system can proactively prevent obscuration issues before they affect user safety or experience
Solution Approach 2:
The system introduces an intermediary layer that mediates between virtual content and the real-world environment. This intermediary mechanism detects real-world objects, determines if they would be obscured by virtual content, and adjusts the rendering accordingly - allowing both virtual content display and real-world awareness to coexist
2Ease of operation
If virtual content is displayed to provide navigation and wayfinding information, then user guidance is improved, but physical signs and obstacles become hidden creating hazardous situations
Solution Approach 1:
The system applies local quality by treating different spatial regions differently - virtual content is rendered in areas where it provides value, while regions containing important real-world objects (stop signs, crosswalks, hazards) are excluded from virtual content rendering. This allows navigation guidance to be provided where safe, while preserving visibility of critical physical information
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution ensures that critical real-world objects are not obscured by virtual content, enhancing user safety and awareness by dynamically highlighting or overlaying obscured objects within the virtual environment.
Implementation Method 1
The location may be determined by LiDAR
Data Source
AI summary
A method for dynamic detection and presentation of obscured real-world objects in augmented or mixed reality virtual content may include an object of interest computer program executed by an electronic device: (1) receiving data for a virtual or augmented reality object to display on an image of a physical environment on a display of the electronic device; (2) receiving data for a physical object in the physical environment; (3) determining that the physical object is obscured by the virtual or augmented reality object; (4) generating a representation of the physical object; and (5) providing the representation of the physical object to a virtual reality or augmented reality computer program executed by the electronic device, wherein the virtual reality or augmented reality computer program is configured to display the physical object over the virtual or augmented reality object.