Auxiliary Image Composition Position Prediction for Moving Subjects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The delay in displaying auxiliary images composited with preview images in imaging devices can lead to incorrect subject recognition and missed imaging timing, especially when dealing with moving subjects, due to inappropriate positioning and processing time delays.

Innovation Solution

An information processing device with a composition position determiner that predicts the subject's position in future frames based on its current position and motion, allowing the auxiliary image to be composited at the correct position in the subsequent captured image, thereby eliminating display deviations and timing delays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the auxiliary image is composited with the preview image after processing to ensure accurate subject recognition, then the positioning accuracy of the auxiliary image is improved, but the display delay of the preview image increases

Engineering Contradiction:
Improvepositioning accuracy of auxiliary imageVSAvoiddisplay delay of preview image
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by predicting the subject's future position in the second captured image based on motion information from the first captured image. This allows the auxiliary image to be positioned in advance at the predicted location, eliminating the need to wait for actual subject detection in the delayed second image, thus resolving the contradiction between positioning accuracy and display delay

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces motion information as an intermediary element that bridges the temporal gap between the first and second captured images. By using motion vectors or trajectory data from the first image, the system can interpolate the subject's position in the second image without actually processing the second image, thereby maintaining both accuracy and real-time performance

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the processing time for identifying subject position is reduced to maintain real-time display, then the display delay is reduced, but the positioning accuracy of the auxiliary image deteriorates

Engineering Contradiction:
Improveprocessing speed of subject identificationVSAvoidpositioning accuracy of auxiliary image
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent uses motion information from the first captured image as a copy or proxy for the actual subject position in the second image. Instead of performing complex subject identification processing on the second image, the system copies the motion pattern and extrapolates the position, significantly reducing processing time while maintaining accuracy through the use of reliable motion data

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20240406544A1Information processing device and program
Publication Date: 2024.12.05 SONY GROUP CORP
  • US20240406544A1 patent drawing
  • US20240406544A1 patent drawing
  • US20240406544A1 patent drawing

AI summary

An information processing device includes a composition position determiner that determines a composition position of an auxiliary image in a second captured image captured after a first captured image in accordance with a position and a motion of a subject in the first captured image, and a composition processing unit that composites the auxiliary image with the composition position in the second captured image.