Prioritized 3D Video Compression via Depth-Based Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 3D video transmission technologies face significant data loss and distortion due to bandwidth limitations during wireless transmission, leading to compromised image quality.

Innovation Solution

A method and system employing prioritized compression for 3D video wireless display, which involves abstracting scene depth, estimating foreground and background in each image, and applying different compression ratios to minimize data loss and maintain image quality, using techniques like high profile stereo coding for foreground and base profile mono coding for background.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If uniform compression is applied to all video data, then transmission bandwidth is reduced, but image quality deteriorates due to data loss

Engineering Contradiction:
Improvetransmission bandwidthVSAvoidimage quality
Core Design Contradiction:
Loss of energyVSManufacturing precision

Solution Approach 1:

The patent applies different compression ratios to different spatial regions of the video frame based on depth information. Foreground regions (closer objects) are compressed at lower ratios to preserve quality, while background regions are compressed at higher ratios. This local differentiation resolves the contradiction by optimizing both bandwidth usage and perceived image quality according to human visual importance.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The video frame is segmented into multiple depth layers using depth buffer information. Each layer is independently compressed with appropriate compression parameters. This segmentation allows selective compression strategies for different depth regions, reducing overall bandwidth while maintaining critical visual quality in foreground areas.

Inventive Principle:
Principle #1Segmentation

2Productivity

If high compression ratio is used to reduce data size, then transmission efficiency improves, but video distortion increases

Engineering Contradiction:
Improvetransmission efficiencyVSAvoidvideo distortion
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The patent dynamically changes compression parameters (compression ratio, coding mode) based on depth information. Objects at different depths are assigned different compression parameters, allowing high compression for background elements while maintaining lower compression for foreground elements, thus improving overall transmission efficiency while minimizing perceptible distortion.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

Depth buffer information is extracted and processed before the compression stage to identify foreground and background regions. This preliminary depth analysis enables the compression algorithm to pre-determine appropriate compression ratios for different regions, avoiding post-processing quality degradation and ensuring efficient transmission from the start.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If depth-based prioritized compression is implemented, then image quality is preserved, but processing complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent implements depth-based compression selectively rather than uniformly across all video data. By focusing detailed processing only on foreground regions and applying simplified compression to background regions, the system achieves high image quality where it matters most while limiting the overall processing complexity increase to manageable levels.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10536709B2Prioritized compression for video
Publication Date: 2020.01.14 NVIDIA CORP
  • US10536709B2 patent drawing
  • US10536709B2 patent drawing
  • US10536709B2 patent drawing

AI summary

In one embodiment, a method of prioritized compression for 3D video wireless display, the method comprising: inputting video data; abstracting scene depth of the video data; estimating foreground and background for each image of the video data; performing different kinds of compressions to the foreground and background in each image; and outputting the processed video data. Thus, the image quality is not affected by the data loss during the wireless transmission.