AR Display Apparatus Using Multi-Sensor Fusion for Occlusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality technologies face challenges in providing a user-friendly and visually appealing experience by accurately superimposing virtual objects onto real spaces, particularly in varying display modes based on distance and material recognition, and ensuring privacy through appropriate object occlusion.
Innovation Solution
An image processing apparatus that acquires both image sensing data and distance or material sensing data to dynamically adjust the display of virtual objects in an augmented reality space, switching between operation modes based on user interaction and object recognition, and performing occlusion processes to maintain privacy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If virtual objects are superimposed on real objects using only image sensing data, then the display can be achieved, but the accuracy of distance recognition and material identification is insufficient
Solution Approach 1:
The patent combines multiple sensing data types (image sensing data, distance sensing data, and material sensing data) into a unified processing system. The image processing apparatus integrates these different data sources to achieve accurate distance recognition and material identification, resolving the contradiction by merging sensing functions rather than adding separate complex systems.
Solution Approach 2:
The image processing apparatus is designed to handle multiple types of sensing data through a universal processing framework. The same apparatus processes image data, distance data, and material data using consistent algorithms, achieving multi-functional capability without proportionally increasing device complexity.
2Ease of operation
If the display mode of virtual objects is varied based on distance information, then user experience is improved, but the processing complexity increases
Solution Approach 1:
The patent implements dynamic display mode adjustment based on real-time distance information. Virtual objects automatically change their display characteristics (such as size, transparency, or detail level) according to the user's distance from them, creating an adaptive user experience without requiring complex manual controls.
Solution Approach 2:
The system changes display parameters (size, transparency, resolution) of virtual objects based on distance parameters extracted from sensing data. This parameter-based control approach simplifies the complexity by using straightforward parameter mappings rather than complex display control logic.
3Object-affected harmful factors
If occlusion process is performed to protect privacy by hiding real objects, then privacy protection is achieved, but the visibility of important information may be reduced
Solution Approach 1:
The patent applies occlusion selectively to specific regions or objects based on their privacy sensitivity. Not all real objects are obscured - only those identified as requiring privacy protection. This local application of occlusion maintains visibility of important information while protecting private data.
Solution Approach 2:
The system uses virtual objects as intermediaries to protect real objects. Instead of directly obscuring real objects, virtual objects are positioned to naturally occlude them, providing privacy protection while maintaining a coherent augmented reality scene that doesn't lose important information.
4Manufacturing precision
If multiple sensing data types are acquired and processed, then the accuracy of virtual object superimposition is improved, but the data processing time increases
Solution Approach 1:
The patent performs preliminary processing of sensing data to extract key features (distance, material properties) before the main superimposition process. By pre-processing and pre-extracting relevant information from multiple sensing data types, the system reduces the computational burden during real-time rendering, maintaining accuracy while reducing processing time.
Data Source
AI summary
An image processing apparatus includes a data acquisition unit that acquires first sensing data that is image sensing data and second sensing data that is sensing data of a type different from the first sensing data and a display processing unit that performs a display process for displaying an augmented reality space formed by augmenting a real space with use of the first sensing data and the second sensing data. The display processing unit performs, by using the second sensing data, a display process for superimposing a virtual object on a real object recognized as an object present in the real space.