Adaptive CG Compression for Wireless MR Delay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In wireless Mixed Reality (MR) systems, transmission delays between Head-Mounted Displays (HMDs) and PCs cause a mismatch between actual operations and displayed MR images, leading to an unnatural user experience due to varying wireless communication rates and rendering processing times, which conventional techniques fail to adequately address.
Innovation Solution
A communication apparatus that wirelessly receives and decompresses captured images, generates and compresses Computer Graphics (CG) images, and adjusts compression ratios based on derived delay times to minimize transmission delays, incorporating units for image capture, feature point detection, compression, decompression, composition, and transmission time measurement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If the compression ratio of CG images is increased to reduce transmission data amount, then wireless transmission delay is reduced, but image quality deteriorates
Solution Approach 1:
The patent applies dynamics by making the compression ratio adjustable and adaptive rather than fixed. The compression ratio is dynamically changed based on the calculated delay time, allowing the system to optimize between transmission speed and image quality in real-time according to actual wireless communication conditions
Solution Approach 2:
The patent changes the compression ratio parameter based on delay time measurements. By adjusting this key parameter according to actual transmission conditions, the system can reduce transmission delay when needed while maintaining image quality when conditions permit
2Manufacturing precision
If the resolution of CG images is increased to improve image quality, then rendering quality is improved, but rendering processing time increases
Solution Approach 1:
The patent applies dynamics by making the rendering resolution adjustable based on actual delay conditions. The resolution is dynamically changed according to the calculated delay time, allowing the system to balance rendering quality and processing speed in real-time
Solution Approach 2:
The patent changes the rendering resolution parameter based on delay time measurements. By adjusting this parameter according to actual transmission and processing conditions, the system optimizes the balance between image quality and processing time
3Speed
If wireless transmission rate is increased to reduce transmission delay, then data transmission speed is improved, but system complexity increases due to adaptive control requirements
Solution Approach 1:
The patent applies feedback by measuring the actual delay time in the wireless MR system and using this measurement to adjust the compression ratio and rendering resolution. This closed-loop feedback mechanism enables adaptive optimization without requiring complex predictive models
Solution Approach 2:
The patent applies self-service by enabling the system to automatically adjust its own parameters (compression ratio, resolution) based on measured delay conditions. The system self-optimizes without requiring external intervention or complex centralized control
Data Source
AI summary
To provide a technique capable of reducing the transmission delay of an image, a communication apparatus wirelessly communicable with another communication apparatus, receives a compressed captured image from the other communication apparatus; decompresses the compressed captured image to obtain a decompressed captured image; generates, based on the decompressed captured image, a CG image to be superimposed and displayed on the captured image; and compresses the CG image to generate a compressed CG image; transmits the compressed CG image to the other communication apparatus. Then, the communication apparatus derives a delay time based on a transmission time of the compressed captured image in the other communication apparatus and a generation completion time of the CG image; and changes a compression ratio of the CG image based on whether the delay time is longer than a predetermined threshold.