AR Server Pose Adjustment for 3D Video in Immersive Conferencing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality (AR) environments lack online conferencing capabilities, which hinder the immersive experience of remote participants in AR environments by not allowing them to be visually integrated with real-world physical objects viewed through see-through displays.
Innovation Solution
An AR computing server that receives a 3D video stream from user devices, identifies and adjusts the pose of video objects based on AR context information from AR display devices, ensuring the video objects are correctly positioned and scaled relative to physical objects in the real world, allowing for an immersive presence of remote participants in AR environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If video objects are displayed in AR environments without pose adjustment, then the system is simpler to implement, but the immersive presence and natural integration with real-world objects is compromised
Solution Approach 1:
The system obtains AR context information from the AR display device as feedback about the user's view of physical objects, and uses this feedback to dynamically adjust the pose of video objects. This closed-loop feedback mechanism ensures video objects are naturally integrated with the real-world environment without requiring complex manual configuration.
Solution Approach 2:
The AR computing server acts as an intermediary between the 3D video stream and the see-through display. It receives video objects, adjusts their pose based on AR context information, and outputs corrected video objects to the display device, thereby mediating the integration of virtual and real worlds.
2Manufacturing precision
If video objects are not positioned relative to physical objects, then the system requires less processing, but the natural integration and immersion in AR environment is reduced
Solution Approach 1:
The system performs preliminary pose determination on video objects before they are displayed. By pre-adjusting the pose of video objects based on AR context information obtained from the AR display device, the system ensures accurate positioning relative to physical objects without requiring real-time heavy processing during display.
3Adaptability or versatility
If remote participants are not visually integrated with real-world objects, then the AR conferencing system is easier to implement, but the immersive experience and natural interaction are hindered
Solution Approach 1:
The AR computing server performs multiple functions: receiving 3D video streams, determining poses of video objects, obtaining AR context information, adjusting video object poses, and outputting corrected video objects. This multi-functional approach enables AR conferencing capabilities without requiring separate specialized systems for each function.
Data Source
AI summary
An augmented reality. AR, computing server (200) includes a network interface (202), a processor (204), and a memory (206) storing instructions executable by the processor to perform operations. The network interface is configured to receive through a network a three-dimensional (3D) video stream from a user device during a conference session. The operations identify a video object captured in the 3D video stream, and determine a pose of the video object captured in the 3D video stream. The operations obtain AR context information from an AR display device indicating how the video object is to be posed relative to a physical object viewable through a see-through display of the AR display device, and adjust pose of the video object captured in the 3D video stream based on the AR context information. The operations output the video object to the see-through display for display. Related methods and computer program products are disclosed.