Image Stabilization via Computational Blur Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies fail to effectively correct blurs caused by both the object being imaged and the movement of the imaging device, such as robots or drones, which complicates stable image formation.
Innovation Solution
An image processing apparatus and method that includes a reception unit for image signals, a calculation unit to determine movement amounts of the image sensor, and a correction processing unit to stabilize images by accounting for both intentional user operations and device movements, using a combination of RGB camera and Event Driven Sensor data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If an imaging device is mounted on a moving platform (robot, drone), then the imaging device can capture images from moving positions, but image blurs are produced due to device movement
Solution Approach 1:
The patent replaces mechanical stabilization systems (gyro sensors, gimbals) with an information processing approach. The calculation unit computes movement amounts from operation inputs and image data, then the correction processing unit applies digital corrections to stabilize images, substituting mechanical stabilization with computational methods
Solution Approach 2:
The patent introduces a calculation unit as an intermediary between the operation input unit and the correction processing unit. This intermediary calculates movement amounts based on operation inputs and image signals, serving as a bridge that translates operational data into correction parameters for image stabilization
2Manufacturing precision
If gyro sensors or gimbal mechanisms are used to correct image blurs, then image stability is improved, but system cost and complexity increase
Solution Approach 1:
The patent substitutes mechanical stabilization components (gyro sensors, gimbals) with an information processing system consisting of a calculation unit and correction processing unit. This replaces complex mechanical systems with software-based computational methods, reducing hardware complexity and cost while maintaining image stabilization functionality
Solution Approach 2:
The patent creates a computational model of device movement by calculating movement amounts from operation inputs. Instead of directly measuring physical movement with sensors, the system copies the movement information through calculation based on operational data, then applies this copied information for image correction
3Device complexity
If conventional blur correction is applied without considering device movement, then processing is simple, but image blurs caused by device movement remain uncorrected
Solution Approach 1:
The patent performs preliminary calculation of movement amounts based on operation inputs before image correction is applied. The calculation unit computes movement information in advance, which is then used by the correction processing unit to stabilize images, ensuring that device movement is accounted for in the correction process
Data Source
AI summary
An image processing apparatus includes a reception unit that receives an image signal acquired by an image sensor, an acceptance unit that accepts operation input made by a user for driving a device carrying the image sensor, a calculation unit that calculates a movement amount of the image sensor in an entire angle of view according to the image signal and the operation input, and a correction processing unit that performs a correction process for an image constructed from the image signal, according to the movement amount.