Automated Visual Effect Rendering Using Depth Map Scene Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image post-processing techniques require manual expertise and knowledge to apply visual effects, making the process disjointed and challenging for users to achieve desired effects such as blur or bokeh without proper analysis and filter application.

Innovation Solution

A method and apparatus that processes user specifications for visual effects by accessing scene analysis information, using depth map data to accentuate pixels, and generating an output image with desired effects, automating the enhancement and application of effects like aperture simulation, blur, and relighting.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual image post-processing techniques are used to apply visual effects, then image quality enhancement is achieved, but user expertise and manual configuration are required making the process complex and disjointed

Engineering Contradiction:
Improveimage quality enhancementVSAvoidmanual configuration complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system performs automatic scene analysis and effect application without requiring manual user configuration. The processor automatically analyzes the captured image to identify objects, determine depth information, and apply appropriate visual effects based on the selected effect type, making the system self-sufficient and eliminating the need for user expertise in image processing tools

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs scene analysis and depth map generation in advance before applying visual effects. By pre-processing the image to extract depth information and object boundaries, the system prepares all necessary data structures and parameters beforehand, enabling automatic effect application without requiring users to manually configure each parameter

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If manual filter application is used to achieve desired visual effects, then specific effects can be applied, but the process requires knowledge of filters and proper scene analysis making it challenging for users

Engineering Contradiction:
Improvevisual effect applicationVSAvoiduser operation simplicity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system automatically selects and applies appropriate filters based on the type of visual effect selected by the user. The processor analyzes the scene and autonomously determines which filters and parameters to use, eliminating the need for users to have knowledge of image processing filters while still providing versatile effect options

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system provides a unified interface that handles multiple types of visual effects (depth of field, bokeh, spotlight, relighting) through a single automated process. The same scene analysis and effect application framework supports all effect types, making the system both versatile in capabilities and simple in operation

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If automated visual effect rendering is implemented, then ease of use is improved, but processing complexity increases requiring depth map generation and scene analysis

Engineering Contradiction:
Improveautomated effect applicationVSAvoidprocessing system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system generates depth maps and performs scene analysis as preliminary steps before applying visual effects. By computing depth information from multiple images and preparing depth maps in advance, the system handles the complex processing tasks beforehand, enabling simple automated effect application without requiring users to understand the underlying complexity

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8824821B2Method and apparatus for performing user inspired visual effects rendering on an image
Publication Date: 2014.09.02 SONY GROUP CORP
  • US8824821B2 patent drawing
  • US8824821B2 patent drawing
  • US8824821B2 patent drawing

AI summary

Method and apparatus for performing visual effects rendering on an image are described. User specifications are processed for at least one visual effect for the image. Scene analysis information associated with the image may be accessed, wherein the scene analysis information is based on the user specifications and indicates at least one pixel of the image for coupling with the at least one visual effect. The at least one pixel is accentuated using depth map information, wherein dimensions for the at least one pixel are determined in response to corresponding depth values of the at least one pixel. An output image is generated having at least one visual effect.