Gaze-Based Avatar Streaming for Bandwidth-Limited Copresence
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Transmitting avatar data in extended reality environments is computationally expensive, especially in multi-user scenarios, leading to high bandwidth and power consumption.
Innovation Solution
Determine a region of interest based on a user's gaze direction and adjust the quality of avatar data transmission accordingly, with higher quality for avatars within the region of interest and lower quality for those outside it, using a central server to manage data streams.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high quality avatar data is transmitted for all users in the XR environment, then the visual fidelity and interaction quality are improved, but the bandwidth consumption and power requirements increase significantly
Solution Approach 1:
The patent applies local quality by transmitting high-quality avatar data only for users within the region of interest (determined by gaze direction), while transmitting lower-quality data for users outside this region. This resolves the contradiction by making data quality spatially variable rather than uniform, maintaining visual fidelity where needed while reducing overall bandwidth and power consumption.
Solution Approach 2:
The system dynamically adjusts the quality of avatar data transmission based on real-time gaze direction and region of interest calculations. The quality parameter is not static but changes continuously as the user's attention moves, allowing the system to adapt to changing viewing conditions and optimize the balance between quality and energy consumption.
2Manufacturing precision
If high quality avatar data is transmitted for all users in the XR environment, then the visual fidelity and interaction quality are improved, but the bandwidth usage increases significantly
Solution Approach 1:
The patent implements local quality by transmitting high-resolution avatar data selectively only for users within the gaze-based region of interest, while using lower resolution data for users outside this region. This approach maintains high visual fidelity for attended users while significantly reducing the total quantity of data transmitted across the network.
Solution Approach 2:
The system applies partial action by transmitting full-quality data only partially - specifically for users within the region of interest - rather than for all users. This selective transmission reduces overall bandwidth consumption while maintaining sufficient quality for the subset of users who actually need high-fidelity rendering based on current attention focus.
3Ease of operation
If comprehensive avatar data is transmitted for all users, then the interaction quality in multi-user scenarios is improved, but the processing resources at the receiving device increase
Solution Approach 1:
The patent reduces processing resources by receiving and processing high-quality avatar data only for users within the region of interest, while receiving lower-quality data for users outside this region. This selective processing approach maintains ease of operation for attended users while significantly reducing the computational burden on the receiving device.
4Ease of operation
If full quality data streams are requested for all remote users, then the copresence experience is improved, but the data transmission time and network load increase
Solution Approach 1:
The system optimizes data transmission time by requesting full-quality data streams only for users within the region of interest, while requesting lower-quality streams for users outside this region. This selective quality approach maintains a good copresence experience for attended users while reducing the total time required for data transmission and lowering network load.
Data Source
AI summary
A technique for transmitting data in a copresence environment includes initiating a virtual communication session between a local device and remote devices in a shared copresence environment, where each of the plurality of sending devices are transmitting a sending quality data stream in the virtual communication session. A region of interest for the local device is determined that includes a portion of the copresence environment. The local device subscribes to a first quality data stream for the remote devices represented in the region of interest, and a second quality data stream for the remote devices not represented in the region of interest.