Image Processing Apparatus Layer Separation Motion Sequence

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing motion sequence image generation methods struggle to balance the expansion of the motion range while maintaining sufficient representation, often resulting in partial subject disappearance or reduced motion smoothness.

Innovation Solution

An image processing apparatus that separates input frame images into a moving subject layer and a background layer, prioritizing the moving subject layer in the combining process to generate a combined image that covers the entire motion range without losing detail, using a layer-image combining process for partial areas and prioritizing pixels accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the extracted image width is increased to cover the entire motion range, then the subject disappearance is prevented, but the number of key frames that can be arranged in one image is decreased

Engineering Contradiction:
Improveextracted image widthVSAvoidnumber of key frames
Core Design Contradiction:
Area of stationary objectVSQuantity of substance

Solution Approach 1:

The patent divides the single composite image into multiple sub-images arranged in a grid pattern. Each sub-image contains a portion of the motion sequence, allowing the system to maintain both wide coverage and high frame density. The segmentation is applied by dividing the display area into multiple regions, with each region displaying extracted images at appropriate sizes without overlapping.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from a single-dimension linear arrangement of key frames to a multi-dimensional grid arrangement. This dimensional change allows simultaneous display of multiple key frames across different spatial positions, effectively increasing the capacity to display more frames while maintaining individual frame quality and coverage.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Quantity of substance

If the extracted image width is decreased to increase the number of key frames, then the motion sequence visualization is improved, but part of the subject image may disappear

Engineering Contradiction:
Improvenumber of key framesVSAvoidextracted image width
Core Design Contradiction:
Quantity of substanceVSArea of stationary object

Solution Approach 1:

The patent segments the motion sequence display into multiple sub-images distributed across a grid. This segmentation allows each sub-image to display key frames at optimal widths for sequence visualization while the collective grid coverage ensures complete subject representation across all sub-images.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

By arranging multiple sub-images in a two-dimensional grid rather than a single linear sequence, the system can display more key frames simultaneously without reducing individual frame width below the threshold needed to prevent subject disappearance.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Device complexity

If a single composite image is generated using multiple key frames, then the arrangement simplicity is maintained, but the motion range coverage is insufficient

Engineering Contradiction:
Improveimage arrangement complexityVSAvoidmotion range coverage
Core Design Contradiction:
Device complexityVSArea of stationary object

Solution Approach 1:

The patent automatically divides the composite image into multiple sub-images in a grid arrangement. This segmentation is performed through automated processing that extracts images from key frames and distributes them across sub-images, maintaining simplicity while achieving complete motion range coverage through the collective display area of all sub-images.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from a single large composite image to a multi-dimensional grid of sub-images. This dimensional expansion provides sufficient total coverage area for complete motion range representation while the automated grid layout process maintains operational simplicity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS9955038B2Image processing apparatus, image processing method, and program
Publication Date: 2018.04.24 SONY GROUP CORP
  • US9955038B2 patent drawing
  • US9955038B2 patent drawing
  • US9955038B2 patent drawing

AI summary

An image processing apparatus includes a layer separating unit configured to separate an input frame image data item into a moving subject layer and a background layer and a combining processing unit configured to generate a combined image data item by performing an image combining process using the input frame image data item. In the image combining process, top priority is given to a moving subject layer of the latest input frame image data item, a second priority is given to a moving subject layer of a frame image data item associated with a previously performed combining process, and a layer-image combining process is performed for a partial area of an existing combined image data item.