Dynamic 2D to 3D Video Coding Switching for Artifact Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Asymmetric 3D video coding introduces artifacts such as blocking and smoothing, leading to discomfort in human viewers due to diminished image quality, especially when switching between 2D and 3D coding modes within a video sequence.

Innovation Solution

A system that dynamically switches between 2D and 3D video coding based on scene changes, using a depth map to determine the appropriate encoding mode and minimize eye strain by adjusting the coding mode according to the depth range and elapsed time since the last mode switch.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If asymmetric 3D video coding is used to reduce bitrate, then coding efficiency is improved, but image quality deteriorates due to blocking and smoothing artifacts

Engineering Contradiction:
ImprovebitrateVSAvoidimage quality
Core Design Contradiction:
Loss of energyVSManufacturing precision

Solution Approach 1:

The patent dynamically switches between 2D and 3D coding modes based on scene depth characteristics. When the scene has small depth range (suitable for 2D), the system switches to 2D coding to avoid artifacts; when the scene has large depth range (requiring 3D), it uses 3D coding. This dynamic adaptation resolves the contradiction by selecting the appropriate coding mode for each scene segment.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the coding mode parameter (2D vs 3D) based on depth map analysis. By evaluating scene depth characteristics and switching coding modes accordingly, the system optimizes both bitrate efficiency and image quality, avoiding the fixed limitations of asymmetric 3D coding.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If 3D video coding is used to provide stereoscopic effect, then viewing experience is improved, but viewer comfort deteriorates due to eye strain and headaches

Engineering Contradiction:
Improvestereoscopic effectVSAvoidviewer discomfort
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system dynamically adjusts the coding mode between 2D and 3D based on scene analysis. When scenes are determined to be unsuitable for 3D (small depth range), the system switches to 2D coding, thereby reducing viewer discomfort while maintaining stereoscopic effect for appropriate scenes.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent uses depth map analysis as feedback to determine the appropriate coding mode. By continuously evaluating scene depth characteristics and adjusting coding mode accordingly, the system optimizes viewer comfort while preserving 3D effect where beneficial.

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If encoding mode is switched between 2D and 3D within a video sequence, then overall quality is improved by adapting to scene characteristics, but complexity of encoding process increases

Engineering Contradiction:
Improveencoding qualityVSAvoidencoding process complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the video sequence into different coding segments based on depth map analysis and scene change detection. By dividing the video into segments with similar depth characteristics, the system can apply appropriate coding modes to each segment, improving overall quality while managing complexity through structured segmentation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary depth map analysis and scene change detection before encoding to determine optimal coding mode switches. This preliminary action allows the encoder to prepare and switch modes at appropriate boundaries, avoiding the need for complex real-time mode switching during encoding.

Inventive Principle:
Principle #10Preliminary action

4Loss of energy

If asymmetric 3D coding is used with one view at lower resolution, then bitrate is reduced, but sharpness of the decoded image deteriorates

Engineering Contradiction:
ImprovebitrateVSAvoidimage sharpness
Core Design Contradiction:
Loss of energyVSMeasurement precision

Solution Approach 1:

The patent dynamically selects between 2D and 3D coding modes based on scene depth characteristics. When scenes are determined to be suitable for 2D (small depth range), the system switches to 2D coding, thereby maintaining image sharpness while achieving bitrate reduction for appropriate scenes.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS8879826B2Method, system and computer program product for switching between 2D and 3D coding of a video sequence of images
Publication Date: 2014.11.04 TEXAS INSTRUMENTS INC
  • US8879826B2 patent drawing
  • US8879826B2 patent drawing
  • US8879826B2 patent drawing

AI summary

A video sequence of images includes at least first and second images. In response to at least first and second conditions being satisfied, an encoding mode is switched between two-dimensional video coding and three-dimensional video coding. The first condition is that the second image represents a scene change in comparison to the first image. The second image is encoded according to the switched encoding mode.