Image Processing Apparatus Motion Reliability Compositing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems fail to effectively increase user interest in viewing multiple moving pictures by not providing a comprehensive understanding of the imaging context, including surrounding atmosphere and scene details, leading to decreased engagement.

Innovation Solution

An image processing apparatus and method that calculates motion information between images in a moving picture, selects compositing target images based on reliability, and determines attributes to create a composited image, enhancing user engagement by overlaying relevant images with motion information and attributes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If thumbnail images of still images representing scenes are displayed in playback point-in-time order, then the overall content of multiple moving pictures can be understood, but the imaging range corresponding to each thumbnail image is limited and surrounding atmosphere and scene details are not displayed

Engineering Contradiction:
Improveimaging context informationVSAvoidimage processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the moving picture into multiple scenes, each represented by a thumbnail image. It then processes each scene separately to extract motion information and identify compositing target images, which are then composited to create an enhanced representation of the overall content while maintaining manageable processing complexity through scene-by-scene analysis

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from displaying static thumbnail images to creating dynamic composited images by overlaying multiple images based on motion information. This adds a temporal and spatial dimension to the static thumbnails, enabling representation of imaging context, surrounding atmosphere, and scene details without requiring complex processing of the entire moving picture at once

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If multiple moving pictures taken at multiple tourist locations are played to understand overall content, then viewing time is prolonged and interest in viewing decreases

Engineering Contradiction:
Improvecomprehensive content understandingVSAvoidviewing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent extracts key motion information and identifies compositing target images from each moving picture scene. By selecting and compositing only the most relevant images based on motion reliability and scene attributes, it creates a condensed representation that conveys comprehensive content understanding while significantly reducing the time required to view multiple moving pictures

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent merges multiple moving pictures into a single composited image by overlaying compositing target images from different scenes. This consolidation allows users to understand the overall content of multiple moving pictures simultaneously rather than viewing them sequentially, eliminating time loss while maintaining comprehensive content understanding

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9153289B2Image processing apparatus, image processing method, and program
Publication Date: 2015.10.06 SONY GROUP CORP
  • US9153289B2 patent drawing
  • US9153289B2 patent drawing
  • US9153289B2 patent drawing

AI summary

An image processing apparatus includes: a calculating unit configured to calculate motion information relating to between two images that make up an imaged moving picture; and a selecting unit configured to select compositing target images serving as compositing targets from a plurality of images that make up the imaged moving picture based on reliability that indicates the likelihood of the calculated motion information.