Optical Flow Decomposition for Vibration Blur Correction in Vanishing Point Calculation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image processing devices cannot calculate the position of a vanishing point or correct vibration blur in images when optical flows do not spread radially from the vanishing point, due to vehicle vibrations.
Innovation Solution
An image processing device that calculates optical flows between successive images, decomposes these flows into vanishing point direction vectors and orthogonal vectors, calculates vibration blur amounts, and corrects optical flows based on these amounts to determine the vanishing point and correct image blur.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional image processing assumes radial optical flows from a vanishing point, then image correction for vehicle bounding along road surface is achieved, but vibration blur caused by road bumps cannot be corrected
Solution Approach 1:
The optical flow vector is decomposed into two independent components: a vanishing point direction vector (parallel component) and an orthogonal vector (perpendicular component). This segmentation allows the system to separately analyze radial motion patterns for vanishing point detection while accounting for non-radial components caused by vibration, thereby resolving the contradiction between assuming radial flows and handling vibration blur.
Solution Approach 2:
The patent introduces a new dimension of analysis by decomposing optical flows into directional components (parallel and orthogonal to the vanishing point direction). This dimensional decomposition enables the system to handle both radial motion (for vanishing point calculation) and non-radial motion (for vibration blur correction) simultaneously, improving adaptability without sacrificing reliability.
2Measurement precision
If optical flows are decomposed into vanishing point direction vectors and orthogonal vectors, then vibration blur amount can be calculated, but calculation complexity increases
Solution Approach 1:
The orthogonal vector component, which represents vibration-induced non-radial motion, is extracted from the optical flow decomposition. By isolating this specific component, the system can calculate vibration blur amount using only the orthogonal components' aggregate values, achieving precise vibration measurement without requiring complete redesign of the entire optical flow processing system.
Solution Approach 2:
The orthogonal vector serves as an intermediary that bridges the gap between raw optical flow data and vibration blur correction. It translates complex non-radial motion patterns into quantifiable components that can be aggregated to determine vibration blur amount, simplifying the overall measurement process while maintaining precision.
3Measurement precision
If optical flow correction is applied based on vibration blur amount, then vanishing point calculation accuracy is improved, but processing time increases
Solution Approach 1:
The system performs preliminary decomposition of optical flows into parallel and orthogonal components, and preliminary calculation of vibration blur amount using orthogonal components before final vanishing point calculation. This preliminary action separates the correction computation from the main processing loop, allowing for more efficient sequential execution and reducing overall processing time while maintaining high accuracy.
Solution Approach 2:
The patent dynamically adjusts processing parameters based on the calculated vibration blur amount. When vibration blur is detected, the system applies correction using the orthogonal vector aggregates; when minimal, it skips correction steps. This parameter-based conditional processing optimizes the balance between accuracy and processing time.
Data Source
AI summary
An image processing device is provided with an optical flow calculation circuit (101) for calculating a plurality of optical flows between a first image and a second image captured before the first image, a vector decomposition circuit (102) for decomposing each of the optical flows into a vanishing point direction vector and an orthogonal vector, a vibration blur amount calculation circuit (103) for calculating the aggregate values of horizontal and vertical components of the orthogonal vector and calculating the amount of vibration blur of the first image based on the aggregate values, an optical flow starting point correction circuit (104) for correcting the calculated optical flows by the amount of vibration blur, and a vanishing point calculation circuit (105) for calculating a vanishing point of the first image based on the corrected optical flows.