Image Processing Device Distortion and Blur Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulties in accurately correcting distortion and blur in moving images captured using a fisheye lens, as it is challenging to determine the necessary corrections for proper display and editing of wide-angle images obtained through non-central projection methods.

Innovation Solution

An information processing apparatus with distortion correction and blur correction processing units that allow users to control and apply distortion correction and blur correction independently, using posture data from the imaging apparatus to ensure accurate image representation, and the ability to record and reproduce these corrections.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If distortion correction processing is applied to convert wide-angle image data into central projection image data, then the image data becomes suitable for standard display and editing, but the processing complexity and time required increase

Engineering Contradiction:
Improvecompatibility with standard display devicesVSAvoidcorrection processing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent applies distortion correction processing in advance during the image recording stage, converting wide-angle image data into central projection image data before storage. This preliminary correction eliminates the need for time-consuming processing during reproduction, as the corrected image data is already in the standard format required for display and editing operations.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If blur correction processing is applied using posture data, then image clarity is improved, but the device complexity and processing requirements increase

Engineering Contradiction:
Improveimage clarityVSAvoidcorrection processing system
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The imaging device performs blur correction using its own posture data (acceleration and angular velocity information) that it automatically records during image capture. The device serves itself by utilizing its built-in sensors and processing capabilities to correct blur without requiring external correction systems or additional complex equipment.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent employs feedback mechanisms where the imaging device uses its recorded posture data (acceleration and angular velocity) to determine the appropriate blur correction amount. This feedback loop allows the system to automatically adjust correction parameters based on the actual shooting conditions, improving image clarity while maintaining manageable system complexity.

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If both distortion correction and blur correction are applied, then image quality is significantly improved, but the processing time and computational load increase substantially

Engineering Contradiction:
Improveimage qualityVSAvoidtotal correction processing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent combines distortion correction and blur correction processing into a unified correction system that operates simultaneously during the image recording phase. By merging these correction operations and executing them in advance, the system achieves high image quality without imposing significant time delays during reproduction, as both corrections are already applied to the stored image data.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentEP3637757B1Image processing device, image processing method, and program
Publication Date: 2022.12.07 SONY GROUP CORP
  • EP3637757B1 patent drawingFigure 1
  • EP3637757B1 patent drawingFigure 2
  • EP3637757B1 patent drawingFigure 3

AI summary

It is possible to easily reproduce and edit image data that is a moving image obtained by capturing an image of a non-central projection method, in which distortion correction and blur correction are reflected. For this purpose, an information processing apparatus includes: a distortion correction processing unit that performs distortion correction processing for converting image data as a moving image acquired by capturing an image of a non-central projection method into an image of a central projection method; and a blur correction processing unit that performs blur correction processing of reducing the image blur generated in the image data using posture data of an imaging apparatus for image data that has been subjected to the distortion correction processing. In other words, the blur correction is performed after the distortion correction.