AR Display Positioning via Plane Detection and Occlusion Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality (AR) technologies fail to provide a satisfactory control effect for virtual objects in physical environments, as existing methods do not adequately consider user needs and occlusion relationships, leading to suboptimal display positions that hinder user interaction and experience.
Innovation Solution
A display control method and device that perform plane detection within the AR device's field of view, determine a first object in the environment, and calculate a display position for a second object based on the first object and the AR device's field of view, including display height and distance, to ensure the second object is displayed in a position that is convenient for user operation and minimizes occlusion with the first object.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If virtual objects are displayed in AR environment, then user interaction capability is improved, but display position control effectiveness deteriorates due to inadequate consideration of user needs and occlusion relationships
Solution Approach 1:
The system performs preliminary plane detection and occlusion analysis before displaying virtual objects. By detecting physical planes and determining occlusion relationships in advance, the system pre-calculates optimal display positions that satisfy both user interaction needs and occlusion avoidance requirements, thereby improving display position control effectiveness while maintaining user interaction capability
Solution Approach 2:
The system dynamically adjusts display position parameters (display height and display distance) based on detected occlusion relationships and user field of view. By changing these parameters adaptively according to the virtual object's position relative to physical objects and user viewing angle, the system resolves the contradiction between ease of operation and display position control effectiveness
2Device complexity
If display position is fixed, then device complexity is reduced, but user operation comfort deteriorates due to inability to adapt to different viewing angles and distances
Solution Approach 1:
The system transitions from fixed display positions to dynamic display positions that adapt to user viewing conditions. By calculating display positions based on real-time detection of physical planes, occlusion relationships, and user field of view, the system achieves adaptive display without requiring complex manual control mechanisms, thus maintaining low device complexity while improving user operation comfort
Solution Approach 2:
The system automatically determines optimal display positions without requiring user intervention. By self-adjusting display height and distance based on detected environmental parameters and occlusion relationships, the system provides comfortable user experience while keeping the control mechanism simple and automatic
3Ease of operation
If virtual objects are placed close to physical objects, then interaction intuitiveness is improved, but occlusion by physical objects increases reducing visibility
Solution Approach 1:
The system applies different display strategies based on local occlusion conditions. By detecting which parts of virtual objects are occluded by physical objects and adjusting display parameters locally (display height and distance) for each virtual object, the system maintains interaction intuitiveness while minimizing occlusion impact on visibility
Solution Approach 2:
The system resolves occlusion issues by adjusting virtual object positions along the depth dimension (display distance) and vertical dimension (display height). By moving virtual objects to different spatial dimensions when occlusion is detected, the system maintains both interaction intuitiveness and visibility, effectively navigating around physical obstacles in three-dimensional space
Data Source
AI summary
A display control method includes performing plane detection on a physical environment within a front field of view (FOV) of an augmented reality (AR) device, determining a first object in the physical environment, determining a display position of a second object based at least on the first object and a current FOV of the AR device, and displaying the second object at the display position. The display position includes a display height and a display distance.