Mobile Terminal Out-of-Focus Image Generation Using Depth Maps

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mobile terminal image processing methods for generating an out-of-focus effect require significant storage space and processing time, especially when using image processing techniques that involve combining two photos, which is inefficient compared to generating depth maps for achieving the same effect.

Innovation Solution

A method for generating an out-of-focus image using a depth map and a preview image in a mobile terminal, where a depth map is created in real-time by selecting an object and adjusting its convergence regions, allowing for efficient blurring of the background while maintaining focus on the foreground, using a combination of camera activation, image processing, and display adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image processing techniques are used to generate out-of-focus effect by combining two photos, then the out-of-focus effect can be achieved, but storage space and processing time increase significantly

Engineering Contradiction:
Improveout-of-focus effect qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent generates the depth map in real-time during the preview phase before the actual photo capture. This preliminary action allows the out-of-focus effect to be applied instantly during capture without requiring subsequent complex image processing or combination of multiple photos, thereby reducing processing time while maintaining effect quality

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts depth information from the preview image to create a depth map, separating the depth calculation process from the final image processing. This extraction allows the system to use only the necessary depth data for effect generation, reducing storage requirements and processing complexity compared to storing and processing multiple complete photos

Inventive Principle:
Principle #2Taking out (Extraction)

2Reliability

If image processing techniques are used to generate out-of-focus effect by combining two photos, then the out-of-focus effect can be achieved, but storage space and processing time increase significantly

Engineering Contradiction:
Improveout-of-focus effect qualityVSAvoidstorage space
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential depth information from the preview image to create a compressed depth map, storing merely the necessary data for out-of-focus effect generation rather than storing complete multiple photos. This significantly reduces storage space requirements while preserving the ability to generate high-quality out-of-focus effects

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a simplified depth map representation (copy) of the scene's depth structure rather than storing the actual multiple photos. This copy contains only the essential depth information needed for effect generation, reducing storage requirements from storing full images to storing compact depth data

Inventive Principle:
Principle #26Copying

3Productivity

If depth maps are generated in real-time with object selection and convergence adjustment, then processing efficiency improves, but device complexity increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system automatically performs depth map generation, object selection, and convergence region adjustment based on user input without requiring manual intervention for each parameter. The processor autonomously calculates depth information and applies appropriate blurring effects, reducing the complexity of user interaction while maintaining high processing efficiency

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The depth map generation system serves multiple functions: it enables real-time out-of-focus effect generation, supports object selection and convergence adjustment, and provides the basis for various focusing modes. This multi-functionality consolidates what would otherwise require separate systems into a single integrated solution, managing complexity while enhancing productivity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP2579572B1A mobile terminal and method for generating an out-of-focus image
Publication Date: 2020.01.08 LG ELECTRONICS INC
  • EP2579572B1 patent drawingFigure 1
  • EP2579572B1 patent drawingFigure 2
  • EP2579572B1 patent drawingFigure 3

AI summary

Provided are a mobile terminal and a method for generating an out-of-focus image, whereby a preview image and a depth map are displayed when an out-of-focus function of the mobile terminal is selected by a user, the displayed depth map is adjusted based on a specific object that is selected from the displayed preview image, an image is captured via a camera of the mobile terminal, and an out-of-focus image is generated by blurring the captured image according to the adjusted depth map.