Real-Time Super-Resolution Image Stabilization via Displacement Vectors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies face challenges in achieving high visual clarity and resolution, particularly in handheld cameras and surveillance systems, where camera shake and vibration lead to blurry images, and mechanical stabilization increases cost and weight without enhancing resolution.
Innovation Solution
A real-time image processing method that captures multiple images, enhances their resolution, calculates displacement vectors, and generates a super-resolution image by superimposing and compensating these images, effectively stabilizing and enhancing image quality without additional hardware costs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Length of moving object
If digital zoom is used to magnify images, then magnifying ratio is improved, but image clarity deteriorates due to artificial pixel generation
Solution Approach 1:
The patent transitions from 2D image plane manipulation to 3D spatial-temporal processing by capturing multiple images at different time points and depths. By stacking images along the time dimension and processing them in 3D space, the system achieves super-resolution without artificial pixel generation, resolving the contradiction between magnification and clarity.
Solution Approach 2:
The patent performs preliminary actions by capturing multiple images before final processing. The image capturing unit acquires a plurality of images at different time points in advance, and the processor prepares displacement vectors and performs alignment operations before generating the final super-resolution image, thereby avoiding post-hoc pixel interpolation.
2Stability of the object's composition
If mechanical stabilizers are installed on the lens to counter shake, then image stability is improved, but device weight and cost increase
Solution Approach 1:
The patent replaces mechanical stabilizers with a computational approach. Instead of using physical mechanisms to counteract camera shake, the system uses image processing algorithms that calculate displacement vectors and perform digital stabilization, eliminating the need for additional mechanical components and reducing weight.
Solution Approach 2:
The patent introduces displacement vectors as an intermediary element between the captured images and the final stabilized output. These vectors serve as a mathematical mediator that captures the relative motion between frames, enabling stabilization without physical intervention.
3Stability of the object's composition
If mechanical stabilizers are installed to reduce vibration effects, then image stability is improved, but device complexity increases
Solution Approach 1:
The patent replaces complex mechanical stabilization systems with a software-based processing pipeline. The image processing unit performs a series of computational steps including displacement vector calculation, image alignment, and super-resolution synthesis, simplifying the overall device architecture while achieving stabilization.
Solution Approach 2:
The patent makes the image processing unit multi-functional by combining stabilization, super-resolution, and image enhancement operations into a single processing pipeline. This universal approach eliminates the need for separate mechanical stabilization subsystems and reduces device complexity.
Data Source
AI summary
Disclosed herein are a method and a device of real-time image processing. The method comprises capturing three images, enhancing a resolution of the images to obtain for each image a high-resolution image (HRI), obtaining two displacement vectors using the HRIs, obtaining a superimposed HRI based on the HRIs and the displacement vectors, obtaining a compensatory vector based on the displacement vectors, and generating a super-resolution image based on the superimposed HRI and the compensatory vector.