Progressive Subsampled Image Transmission for AR Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud rendering for augmented and virtual reality experiences on mobile devices introduces significant latency due to the need for compressing, transmitting, and decompressing high-resolution image data, which can exceed available bandwidth limits, leading to user dizziness and reduced interactivity.
Innovation Solution
The Progressive Subsampled Transmission (PST) method renders an initial low-resolution image in the Cloud and progressively sends additional low-resolution versions to the client device, allowing the client to reconstruct and improve the image quality over time, leveraging common video encoding/decoding hardware for efficient image transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If high-resolution image data is transmitted to ensure image quality, then image quality is improved, but transmission time increases causing latency
Solution Approach 1:
The patent segments the high-resolution image data into multiple progressively refined versions (initial low-resolution frame followed by successive higher-resolution frames). This allows the image transmission to be divided into stages, where each stage transmits only the necessary detail level for that moment, reducing overall transmission time while maintaining final image quality.
Solution Approach 2:
The patent performs preliminary action by transmitting an initial low-resolution version of the image data before the complete high-resolution data is ready. This preliminary frame can be displayed immediately, reducing perceived latency, while subsequent frames progressively refine the image quality to the final high-resolution state.
2Speed
If bandwidth is increased to transmit high-resolution data faster, then transmission speed is improved, but device complexity and cost increase
Solution Approach 1:
The patent changes the resolution parameter of the transmitted image data over time. Instead of maintaining a constant high-resolution transmission requirement, the system dynamically adjusts the data detail level from low to high across successive frames, allowing standard bandwidth channels to achieve high effective transmission speed without increasing physical bandwidth capacity.
3Productivity
If compression is applied to reduce data size, then transmission efficiency is improved, but image quality deteriorates
Solution Approach 1:
The patent applies partial compression action selectively across different frames. The initial low-resolution frame undergoes more aggressive compression since it contains less detail, while successive frames that add incremental detail use progressively less compression. This partial application of compression maintains overall transmission efficiency while preserving the quality of the final high-resolution reconstruction.
Data Source
AI summary
In one embodiment, the disclosure provides a computer-implemented method for Progressive Subsampled Transmission of image data. In one embodiment, a source computer may: generate a first down-sampled frame by sampling an input image according to a first sampling pattern; generate a first encoded down-sampled frame; transmit the first encoded down-sampled frame to a recipient device to cause the recipient device to display/use a first output frame generated by decoding and up-sampling the first encoded down-sampled frame; generate a second down-sampled frame by sampling the input image according to a second sampling pattern; generate a second encoded down-sampled frame; and transmit the second encoded down-sampled frame to the recipient device to cause the recipient device to display/use a second output frame generated based on the first encoded down-sampled frame and the second encoded down-sampled frame and in accordance with the first sampling pattern and the second sampling pattern.