Image Processing Device Layer Segmentation for Live-Action Display Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies do not easily allow for the change of display modes of objects in live-action content, unlike in computer graphics, where such changes can be readily implemented.

Innovation Solution

An image processing device that changes the display mode of objects in live-action content by using segment information indicating the position of objects within layer images generated from captured images, classified based on distances from a predetermined visual point, allowing for easy manipulation of display settings such as visibility, movement, and rotation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional image processing methods are used for live-action content, then the processing follows traditional workflows, but the display mode of each object cannot be easily changed

Engineering Contradiction:
Improveease of changing display modeVSAvoidprocessing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The captured image is divided into multiple layer images based on distance from the visual point, with each layer containing objects at specific depth ranges. This segmentation enables independent control of display modes for objects in different layers, achieving easy modification of object display without complex reprocessing of the entire image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a depth dimension by creating multiple layer images arranged in the depth direction, allowing objects to be selectively displayed or hidden by controlling which layers are rendered. This dimensional approach transforms the traditional 2D image processing into a 3D-like structure, enabling easy display mode changes through layer selection rather than complex object manipulation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If layer images are generated and classified by distance, then object display modes become easily controllable, but the processing steps and system complexity increase

Engineering Contradiction:
Improvedisplay mode flexibilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The captured image is pre-processed into multiple layer images classified by distance from the visual point before the actual display mode changes are needed. This preliminary segmentation creates a structured foundation where objects are already organized by depth, allowing rapid and flexible display mode adjustments without requiring complex real-time processing when changes are requested.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10898804B2Image processing device and image processing method
Publication Date: 2021.01.26 SONY GROUP CORP
  • US10898804B2 patent drawing
  • US10898804B2 patent drawing
  • US10898804B2 patent drawing

AI summary

The present disclosure relates to an image processing device and an image processing method for achieving an easy change of a display mode of each object in live-action content. The image processing device includes an image generation section that changes a display mode of each of objects within a display image on the basis of segment information that indicates a position of a segment in which each of the objects is present, the position of the segment being a position in each of a plurality of layer images that are images generated on the basis of a plurality of captured images and are images classified into a plurality of layers in accordance with distances of the images from a predetermined visual point. For example, the present disclosure is applicable to a display device or the like.