XR Display Rendering With Point Cloud Occlusion Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing Extended Reality (XR) devices struggle to accurately determine and display the relative position relation between real and virtual objects, leading to issues such as occlusion and inaccurate integration of virtual objects into real environments.
Innovation Solution
The method involves acquiring virtual and environment information, converting point cloud information into a consistent coordinate system, determining depth distances, and rendering virtual objects based on position, illumination, and environmental information to create a more accurate rendered image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If virtual objects are integrated into real environments using existing XR devices, then users can view both real and virtual objects, but the relative position relation between real and virtual objects cannot be accurately determined, leading to occlusion and inaccurate integration
Solution Approach 1:
The patent introduces coordinate system conversion as an intermediary mechanism to bridge the virtual and real worlds. By converting point cloud information from the real world into the virtual coordinate system, the system enables accurate position relation determination between real and virtual objects, resolving the occlusion and integration inaccuracies
Solution Approach 2:
The patent replaces traditional mechanical or manual positioning methods with computational geometry and coordinate transformation algorithms. By using mathematical models to convert and align coordinate systems, the system achieves precise positioning and integration of virtual objects with real-world references
2Loss of information
If point cloud information is used to represent real objects, then environmental data can be captured, but the coordinate system inconsistency prevents accurate integration with virtual objects
Solution Approach 1:
The patent uses coordinate system conversion as an intermediary to reconcile the mismatch between point cloud coordinate systems and virtual object coordinate systems. This transformation process preserves all environmental information while aligning the coordinate frameworks, enabling both complete information retention and precise alignment
Data Source
AI summary
The present disclosure provides a display method and apparatus and an electronic device. The method includes: acquiring a virtual image, configuration information of the virtual image, and environment information of a current environment; wherein the virtual image comprises at least one virtual object and virtual feature point information of the at least one virtual object in an extended reality space coordinate system, and the environment information comprises point cloud information of at least one real object; determining a position relation between the real object and the virtual object, based on the virtual feature point information of the virtual object in the extended reality space coordinate system and the point cloud information; rendering the virtual object in accordance with one or more of the position relation, the configuration information, and the environment information, to determine a rendered image; and displaying the rendered image.