Depth Map Synchronization for Image Special Effects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional electronic devices equipped with camera modules fail to maintain synchronized depth information when applying special effects to images, leading to erroneous processing results and limitations in further modifications.

Innovation Solution

A method for selectively modifying depth maps in electronic devices, allowing for synchronization with 2D image modifications, enabling the saving of modified depth maps within image files, and allowing for further special effects application.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If depth information is not modified when applying special effects to a picture, then processing is simpler and faster, but the depth information does not match the resultant picture leading to erroneous processing results

Engineering Contradiction:
Improveaccuracy of depth informationVSAvoidcomplexity of depth information management
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic depth information management where the depth map is selectively modified based on the type of special effect applied to the picture. When special effects that alter depth relationships are detected, the depth map is automatically updated to match. This dynamic adaptation ensures accuracy without requiring manual intervention or overly complex predetermined rules for every possible image modification scenario.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the state of depth information from static to conditional-dynamic by introducing parameters that track whether the picture has been modified. The system monitors modification parameters and adjusts the depth map accordingly, changing depth parameters only when necessary to maintain consistency with the modified picture, thus balancing accuracy with processing efficiency.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If depth information is discarded after special effect application, then storage space is saved and processing is simpler, but further special effects cannot be applied to the resultant picture

Engineering Contradiction:
Improvecapability to apply multiple special effectsVSAvoidstorage of depth information
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent applies local quality by selectively preserving or modifying depth information based on the specific processing needs. Rather than universally discarding or maintaining all depth data, the system intelligently determines which portions of the depth map should be retained or updated after each special effect application, optimizing storage usage while maintaining capability for subsequent processing.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent performs preliminary actions by proactively managing depth information throughout the special effect processing pipeline. Instead of waiting until depth information is needed for future effects, the system continuously maintains and updates depth maps in anticipation of subsequent processing steps, enabling seamless multi-stage image manipulation.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If depth information is selectively modified based on picture modification, then depth information remains synchronized with the picture, but additional processing steps are required

Engineering Contradiction:
Improvesynchronization between depth map and pictureVSAvoidprocessing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements feedback mechanisms where the processing system continuously monitors picture modifications and uses this information to determine whether and how to update the depth map. This closed-loop feedback ensures synchronization between the picture and depth information while avoiding unnecessary processing steps by only triggering depth map updates when actual modifications occur that affect depth relationships.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary analysis of the intended special effect to determine whether depth map modification is necessary before executing the full processing pipeline. By evaluating the nature of the upcoming modification in advance, the system can prepare appropriate depth map updates efficiently, reducing redundant processing steps while ensuring synchronization is maintained.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9948912B2Method for performing depth information management in an electronic device, and associated apparatus and associated computer program product
Publication Date: 2018.04.17 MEDIATEK INC
  • US9948912B2 patent drawing
  • US9948912B2 patent drawing
  • US9948912B2 patent drawing

AI summary

A method for performing depth information management in an electronic device, an associated apparatus, and an associated computer program product are provided, where the method includes the steps of: modifying a two dimensional (2D) image, and selectively modifying a depth map of the 2D image based on modification of the 2D image before, when, or after the 2D image is modified, wherein the 2D image is retrieved from a storage module, wherein, for example, the storage module may be positioned within or outside the electronic device; and saving the modified depth map into an image file of the modified 2D image. For example, the modified depth map and the modified 2D image may correspond to each other.