Image Processing Device Rolling Shutter Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing devices face challenges in accurately calculating camera motion components and designing correction filters for camera shake, particularly when considering motion according to six degrees of freedom, and are limited by the need for specific component separation expressions and accurate global motion vectors.
Innovation Solution
An image processing device that decomposes motion data into rolling shutter distortion, parallel translation, and rotation components, allowing for independent calculation and correction using a projection matrix, with an auxiliary matrix handling motion not intended by the user, enabling robust processing across various motion data formats.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If motion correction is made according to six degrees of freedom to accurately calculate camera motion component, then measurement precision of camera motion is improved, but device complexity increases due to complicated correction filter design
Solution Approach 1:
The patent segments the correction process into two distinct parts: a first correction filter that applies correction according to six degrees of freedom for high precision camera motion compensation, and a second correction filter that applies correction according to four degrees of freedom to remove residual distortion. This segmentation allows each filter to specialize in specific correction tasks, improving overall measurement precision while managing complexity through functional division.
Solution Approach 2:
The patent introduces an intermediate processing step where the output of the first correction filter serves as input to the second correction filter. This intermediary approach allows the system to first apply comprehensive six-degree-of-freedom correction, then refine the result with four-degree-of-freedom correction, achieving high accuracy without requiring a single overly complex filter design.
2Manufacturing precision
If component separation expression is specifically designed for affine transformation, then manufacturing precision of motion component separation is improved, but adaptability decreases when motion vector is expressed by perspective projection
Solution Approach 1:
The patent creates a universal correction system that can handle both affine transformation and perspective projection formats. The first correction filter is designed to work with six degrees of freedom motion data regardless of whether it represents affine or perspective transformation, while the second correction filter adapts to refine the correction. This multi-functional design allows the same correction filter structure to serve multiple motion data formats without requiring separate specialized filters for each format.
3Measurement precision
If accurate global motion vector is used in component separation expression, then measurement precision of motion components is improved, but reliability decreases when inaccurate motion data is input
Solution Approach 1:
The patent applies beforehand cushioning by introducing a second correction filter that performs four degrees of freedom correction as a safety mechanism. When the input motion data contains inaccuracies, the first correction filter may produce suboptimal results, but the second correction filter provides a fallback correction approach that ensures the output remains acceptable. This prior cushioning protects the system against unreliable input data while maintaining measurement precision when accurate data is provided.
Data Source
AI summary
A device comprises an input unit, a motion acquisition unit, a matrix operation unit, and a drawing unit. The input unit implements sequential input of a first frame image and a second frame image. The motion acquisition unit acquires motion data between the first frame image and the second frame image. The matrix operation unit calculates a projection matrix to project the output frame image to the second frame image, from a first matrix including a rolling shutter distortion component, a second matrix including at least one of a parallel translation component in directions perpendicular to an image-shooting direction and a rotation component with respect to the image-shooting direction, and an auxiliary matrix including a motion component not included in the first matrix and the second matrix. The drawing unit generates the output frame image from the second frame image by using the projection matrix.