3D Video Motion Estimation Using Color-Depth Vector Referencing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies face challenges in compressing and transmitting stereoscopic images due to the large amount of data required, making it difficult to efficiently compress and transmit three-dimensional (3D) videos across network infrastructure.

Innovation Solution

A 3D video motion estimating apparatus and method that allows the motion vector of a color image and a depth image to refer to each other, using a color/depth motion estimating unit and a depth/color motion estimating unit to estimate motion and select the optimal estimation result, thereby increasing compression efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If images taken from different viewpoints are compressed and transmitted separately, then each image can be processed independently, but the total data amount becomes too large for efficient network transmission

Engineering Contradiction:
Improvedata amountVSAvoidcompression efficiency
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent merges the compression processes of color and depth images by performing joint motion estimation. The color/depth motion estimating unit uses motion vectors from color images to estimate motion in depth images, while the depth/color motion estimating unit does the reverse. This combined approach exploits the correlation between color and depth data to achieve better compression efficiency than separate processing would allow.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The motion estimation system performs multiple functions simultaneously: it estimates motion for both color and depth images using shared motion compensation techniques. The color/depth motion estimating unit and depth/color motion estimating unit enable bidirectional motion estimation, where each image type serves as a reference for the other, making the system more versatile and efficient.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Device complexity

If color and depth images are compressed individually, then each compression process is simple, but the overall compression rate is insufficient

Engineering Contradiction:
Improvecompression process complexityVSAvoidcompression rate
Core Design Contradiction:
Device complexityVSQuantity of substance

Solution Approach 1:

The patent combines the compression processes of color and depth images into a unified system. The color/depth motion estimating unit performs motion estimation for depth images using color image motion vectors, and the depth/color motion estimating unit does the opposite. This merging of processes increases compression rate while managing complexity through systematic integration.

Inventive Principle:
Principle #5Merging (Combining)

3Ease of operation

If motion vectors of color and depth images are estimated independently, then each estimation is straightforward, but compression efficiency is reduced

Engineering Contradiction:
Improvemotion estimation simplicityVSAvoidcompression efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent merges the motion estimation processes by having color and depth motion vectors reference each other. The color/depth motion estimating unit uses color motion vectors to estimate depth motion, while the depth/color motion estimating unit uses depth motion vectors to estimate color motion. This bidirectional referencing improves compression efficiency while maintaining operational clarity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system implements feedback between color and depth motion estimation processes. Motion vectors estimated from one image type are used to improve the estimation of the other image type, creating a feedback loop that enhances overall compression efficiency. The motion estimation selecting unit chooses the optimal estimation result based on this feedback mechanism.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10798416B2Apparatus and method for motion estimation of three dimension video
Publication Date: 2020.10.06 SAMSUNG ELECTRONICS CO LTD
  • US10798416B2 patent drawing
  • US10798416B2 patent drawing
  • US10798416B2 patent drawing

AI summary

Disclosed is a 3D video motion estimating apparatus and method. The 3D video motion estimating apparatus may enable a motion vector of a color image and a motion vector of a depth image refer to each other, thereby increasing a compression rate.