Real-Time Shift Correction Preview for Image Composition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image processing methods, such as shift correction, require capturing and storing images before applying corrections, which can lead to unintended cropping and are inefficient for moving images, especially in film-making, where re-shooting is costly or impossible.

Innovation Solution

An image processing device that generates a preview image with applied shift correction in real-time, allowing users to preview effects before capturing, using a smaller-sized representation of the image for processing efficiency and applying the effect to the full-size image later, with options for automatic or manual control and remote processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If shift correction is applied to full-resolution images after capture, then correction quality is maintained, but the risk of inadvertent cropping increases and re-shooting becomes necessary

Engineering Contradiction:
Improvecorrection qualityVSAvoidrisk of cropping
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent applies shift correction to a lower-resolution preview image before the final image is captured. This preliminary action allows the composition to be adjusted in advance, ensuring that the final full-resolution image will not be cropped, thereby maintaining both correction quality and preventing cropping risks.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a lower-resolution copy or representation of the scene for preview and correction purposes. This copy allows shift correction to be applied and evaluated without affecting the final high-resolution image capture, enabling verification of proper composition before the actual shot.

Inventive Principle:
Principle #26Copying

2Reliability

If shift correction is applied to moving images in real-time, then cropping risks are reduced, but processing complexity increases

Engineering Contradiction:
Improvecropping preventionVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies shift correction selectively to a lower-resolution preview portion of the moving image rather than processing the entire full-resolution video stream. This local application reduces processing complexity while still providing the necessary correction preview to prevent cropping issues.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent creates a simplified representation or copy of the moving image at lower resolution for real-time shift correction processing. This copy enables complex corrections to be computed and visualized in real-time without the computational burden of processing full-resolution video frames.

Inventive Principle:
Principle #26Copying

3Manufacturing precision

If shift correction is applied to full-resolution images, then final image quality is maintained, but processing time increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs shift correction on a lower-resolution preview image before the final image capture. This preliminary correction allows composition adjustments to be made in advance, eliminating the need for time-consuming post-processing of full-resolution images and preventing the need for re-shooting.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses a lower-resolution copy of the image for shift correction processing. This copy allows the correction parameters to be computed quickly, and then these same parameters are applied to the full-resolution final image, significantly reducing processing time while maintaining image quality.

Inventive Principle:
Principle #26Copying

Data Source

PatentEP3017590B1A method, apparatus and system for image processing
Publication Date: 2021.03.31 SONY GROUP CORP
  • EP3017590B1 patent drawingFigure 1
  • EP3017590B1 patent drawingFigure 2
  • EP3017590B1 patent drawingFigure 3

AI summary

An image processing device, comprising an image receiver operable to receive a first image; an image converter operable to convert the first image to a second image, the second image being a smaller-sized representation of the first image; an image pre-processor operable to perform an imaging effect on the second image to form a third image, the imaging effect being defined by an imaging effect parameter; a first output device operable to output the third image for display; and a second output device operable to output the first image and the imaging effect parameter.