Wearable Video Rendering via Spatial Tracking and Focus Region Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Wearable devices face challenges in delivering seamless video experiences due to high bandwidth requirements and significant time lag in rendering high-quality images, especially in scenarios with multiple users, leading to perceivable delays and deterioration in viewer experience.
Innovation Solution
The solution involves tracking the spatial positions and directions of wearable devices in real-time, selecting a limited set of single-view images from a multi-view image, and using image interpolation to generate display images, while transmitting image data with varying quality levels to minimize bandwidth and latency, focusing on the focus region with high quality and other regions with lower quality data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If large amounts of video data are transmitted to support high visual acuity in different viewing directions, then image quality is improved, but network bandwidth requirements increase significantly
Solution Approach 1:
The patent segments the video data transmission by dividing the field of view into a focus region (high priority) and non-focus regions (low priority). Only images related to the focus region are transmitted at high quality, while other regions use lower quality or are omitted, significantly reducing the quantity of video data transmitted while maintaining visual acuity where the viewer actually looks.
Solution Approach 2:
The patent applies local quality by transmitting high-quality video data only for the focus region (where the viewer's attention is directed) and lower-quality or compressed data for non-focus regions. This selective quality distribution reduces overall data transmission requirements while preserving visual acuity in the important focal area.
2Measurement precision
If high quality image content is rendered in accordance with new viewing direction, then image quality is improved, but time lag increases significantly
Solution Approach 1:
The patent uses eye tracking or head tracking to predict the viewer's focus region in advance. By pre-processing and preparing images for the anticipated focus region before the viewer actually looks there, the system reduces the time lag between viewing direction change and high-quality image rendering, while maintaining image quality in the predicted focus area.
3Quantity of substance
If video data is compressed to reduce bandwidth requirements, then network bandwidth usage is reduced, but image quality deteriorates
Solution Approach 1:
The patent applies differential compression by transmitting uncompressed or minimally compressed images for the focus region while applying higher compression ratios to non-focus regions. This selective compression approach reduces overall network bandwidth requirements while preserving image quality in the visually important focus area where the viewer's attention is directed.
4Adaptability or versatility
If multiple wearable devices are supported simultaneously, then viewer capacity is increased, but network bandwidth requirements increase significantly
Solution Approach 1:
The patent segments the data transmission for each wearable device based on individual focus regions detected through eye or head tracking. By identifying and transmitting only the relevant focus region images for each viewer rather than complete 360-degree video data, the system supports multiple simultaneous viewers while significantly reducing the total video data amount required for each device.
Data Source
AI summary
A spatial direction of a wearable device that represents an actual viewing direction of the wearable device is determined. The spatial direction of the wearable device is used to select, from a multi-view image comprising single-view images, a set of single-view images. A display image is caused to be rendered on a device display of the wearable device. The display image represents a single-view image as viewed from the actual viewing direction of the wearable device. The display image is constructed based on the spatial direction of the wearable device and the set of single-view images.