Spatially Faithful Telepresence With Dynamic Geometry for Mobile Users
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing telepresence systems often require fixed geometries and restrict the number of participants per meeting site, lack support for user mobility, and struggle to maintain spatial faithfulness with multiple users and sites, leading to limited natural interaction and high bandwidth requirements.
Innovation Solution
A method and apparatus that utilize 3D local environment scans, aligning and orienting them in a shared virtual geometry, enabling flexible geometric relationships and supporting user mobility through tessellated spaces, reducing bandwidth by transmitting 2D perspective videos and audio signals, and managing dynamic unified geometries.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If fixed geometry is used to maintain spatial faithfulness, then spatial relationships are preserved, but user mobility is restricted and the number of participants is limited
Solution Approach 1:
The patent implements dynamic geometry management where the virtual geometry structure can be reconfigured in real-time based on user movement and new participant joining. The system transitions from static fixed geometry to dynamic adaptive geometry that maintains spatial faithfulness while accommodating mobility and varying participant numbers through continuous geometry updates and remapping operations.
2Reliability
If multiple local environment scans are merged into a unified geometry, then spatial faithfulness with multiple users is achieved, but bandwidth requirements increase
Solution Approach 1:
The patent extracts and transmits only the essential geometry data and transformation parameters needed to reconstruct the unified virtual geometry at the receiving end, rather than transmitting complete high-resolution environment scans. This selective data extraction reduces bandwidth consumption while maintaining the ability to create spatially faithful representations of multiple user environments.
Solution Approach 2:
The patent creates lightweight virtual copies or representations of local environment scans that can be efficiently transmitted and reconstructed in the shared virtual geometry. Instead of transmitting full-resolution scans, the system uses compressed or parameterized copies that preserve spatial relationships while minimizing data transmission requirements.
3Manufacturing precision
If complete 3D environment scans are transmitted, then photorealistic quality is achieved, but bandwidth requirements become prohibitively high
Solution Approach 1:
The patent applies local quality by transmitting and processing high-detail 3D scan data only for regions currently in view or relevant to the user's perspective, while using lower-detail representations for distant or non-visible areas. This selective quality distribution maintains photorealistic appearance where needed while reducing overall bandwidth consumption through progressive or adaptive detail transmission.
Data Source
Figure 1~2
Figure 3~4
Figure 5A~5B
AI summary
Systems and methods described herein are provided for managing user positions in a shared virtual geometry, capturing 360° views of a local user environment in a spatially faithful system, and computing a perspective view of a first user from the eye-point of a second user. Users may move around the shared virtual geometry, and perspective views of users may be updated. Some embodiments use a co-centric geometry for group conferencing with other users. Some embodiments may use a grid-based geometry for exploration with other users. Some embodiments may reduce transferred bitrates to enable systems and methods to be implemented in data-limited environments. Some embodiments support users moving and navigating a shared virtual geometry.