Non-linear Video Sampling for 3D Depth Conversion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video aspect ratio conversion techniques fail to utilize three-dimensional information, leading to object shape distortion and an unsatisfactory viewing experience for display devices capable of rendering three-dimensional video.

Innovation Solution

A method and system for converting two-dimensional video to three-dimensional video by non-linear sampling and depth information processing, which adjusts sampling density based on saliency regions and depth information to reduce distortion and enhance the viewing experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional linear sampling techniques are used for aspect ratio conversion, then the conversion process is simple and fast, but object shape distortion occurs and 3D viewing experience is not enhanced

Engineering Contradiction:
Improveobject shape accuracyVSAvoidsampling process complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies different sampling densities to different regions of the video frame based on saliency detection. High-saliency regions (containing important objects) use higher sampling density to preserve shape accuracy, while low-saliency regions use lower sampling density to reduce computational complexity. This local differentiation resolves the contradiction by optimizing precision where needed without uniformly increasing complexity throughout the entire image.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The sampling density is dynamically adjusted based on detected saliency regions and depth information. The system adapts the sampling strategy in real-time during video conversion, switching between high and low sampling density regions dynamically. This dynamic adaptation allows the system to maintain object shape accuracy while controlling overall processing complexity through intelligent resource allocation.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If uniform sampling density is applied across the entire video frame, then the processing is straightforward, but 3D information is not effectively utilized and viewing experience is not enhanced

Engineering Contradiction:
Improveutilization of 3D informationVSAvoidconversion processing efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The system identifies saliency regions and applies higher sampling density specifically to those areas where 3D information is most relevant for enhancing viewing experience. Background or less important regions use lower sampling density, maintaining processing efficiency. This localized approach enables effective 3D information utilization without uniformly sacrificing productivity across the entire frame.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The video frame is segmented into multiple regions based on saliency detection, with each region processed using appropriate sampling density. This segmentation allows the system to efficiently convert only the most important regions with high sampling density while processing less important regions with lower density, thus maintaining overall productivity while enhancing 3D viewing experience.

Inventive Principle:
Principle #1Segmentation

3Manufacturing precision

If high sampling density is applied throughout the video, then object shape distortion is minimized, but processing time and computational resources increase

Engineering Contradiction:
Improveobject shape accuracyVSAvoidconversion processing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

High sampling density is applied locally only to saliency regions containing important objects, while low-saliency regions use reduced sampling density. This selective high-precision sampling minimizes object shape distortion in critical areas without the computational overhead of uniformly high-density sampling across the entire frame, thus reducing overall processing time.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

Instead of applying maximum sampling density to the entire frame (excessive action), the system applies high sampling density only partially to regions where it is most needed (saliency regions). This partial action approach achieves sufficient object shape accuracy in important areas while avoiding unnecessary computational resources and time consumption in less critical regions.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS8786673B2Systems and methods for performing video conversion based on non-linear stretch information
Publication Date: 2014.07.22 CYBERLINK
  • US8786673B2 patent drawing
  • US8786673B2 patent drawing
  • US8786673B2 patent drawing

AI summary

A method implemented in a computing system for converting two-dimensional (2D) video to three-dimensional (3D) format comprises sampling the 2D video, wherein the sampling is performed non-linearly in one or more directions. The method further comprises determining depth information of one or more objects within the 2D video based on sampling information and transforming the 2D video to a 3D-compatible format according to the sampling and the depth information.