Object Composition Using Depth Map Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing electronic devices struggle to effectively compose objects using depth maps, as they lack efficient methods for accurately determining and adjusting the depth values of objects within images, leading to overlapping or hidden objects in user interfaces.

Innovation Solution

An electronic device with a camera module and image signal processor that acquires color images and depth maps, separates image areas based on depth value ranges, and adjusts the depth values of objects to prevent overlap, allowing for precise placement and display of objects in 3D spaces within user interfaces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If depth values of objects are not adjusted, then the composition process is simple, but objects may overlap or be hidden in the user interface

Engineering Contradiction:
Improveobject composition accuracyVSAvoiddepth value adjustment mechanism
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system automatically determines depth values for objects by analyzing the depth map and comparing depth values between the object and background/foreground subjects, eliminating the need for manual depth adjustment by the user. The processor autonomously performs depth value assignment to ensure proper object composition and display hierarchy.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system modifies the depth value parameter of objects based on the depth map analysis. By changing the depth value parameter, the system controls the display hierarchy and spatial relationship between objects and background/foreground subjects, resolving overlapping issues without complex mechanical adjustments.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If depth values are precisely controlled, then object composition accuracy is improved, but the operation complexity increases

Engineering Contradiction:
Improvedepth value determination accuracyVSAvoiduser interface operation simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The processor automatically performs depth value determination by comparing depth values from the depth map, eliminating the need for users to manually adjust depth parameters. The system self-services the complex depth analysis and assignment tasks, providing precise depth control without requiring user expertise in depth parameter management.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The depth map serves as an intermediary data structure that bridges the gap between raw image data and object composition requirements. The processor uses the depth map to automatically determine appropriate depth values for objects, simplifying the user interface while maintaining precise depth control through automated intermediate processing.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If objects are displayed without depth separation, then the display process is simple, but foreground and background subjects cannot be properly distinguished

Engineering Contradiction:
Improvedepth layer composition accuracyVSAvoiddepth layer management system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system segments the image into different depth layers by analyzing the depth map and separating objects from background and foreground subjects based on their depth values. This segmentation enables proper spatial composition and visual hierarchy, allowing users to perceive three-dimensional depth relationships in the displayed image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces a depth dimension (Z-axis) to the traditional two-dimensional display by utilizing depth values from the depth map. Objects are positioned and composed in three-dimensional space, allowing proper distinction between foreground, background, and intermediate subjects through depth-based layering and occlusion relationships.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentEP3444805B1Apparatus for composing objects using depth map and method for the same
Publication Date: 2023.05.24 SAMSUNG ELECTRONICS CO LTD
  • EP3444805B1 patent drawingFigure 1
  • EP3444805B1 patent drawingFigure 2
  • EP3444805B1 patent drawingFigure 3

AI summary

An electronic device is provided that includes a display, a memory, and a processor. The processor is configured to control to display an image by using the display, to control to display an object on a first area of the image, at least based on a first user input, to determine a depth value of the object, at least based on a second user input, to control to display at least a portion of the object on the image, based on the determined depth value of the object and depth information of the first area, and to control to store, in the memory, depth data and color data of the image to which the object is added.