Image Stabilization Readout Area Control for Load Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional electronic image stabilization methods require higher pixel count sensors to improve image stabilization, leading to increased data readout loads and associated costs and power consumption, without changing the output image resolution.
Innovation Solution
An image processing device and method that sets a readout area based on motion prediction information to reduce the amount of data read from the image sensor, using a readout area setting unit and a cutout area setting unit to extract a partial image from the readout area, thereby minimizing the load on the system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a sensor with larger pixel count is used to improve image stabilization correction performance, then image stabilization performance is improved, but data readout amount and system load increase
Solution Approach 1:
The imaging area is divided into a readout area and a non-readout area. Only the readout area, which is sufficient for the cutout image stabilization, is read out from the sensor. This segmentation allows using a high-pixel-count sensor without reading out all the data, thus improving stabilization performance while controlling data readout volume.
Solution Approach 2:
A cutout area is extracted from the readout area to generate the final stabilized image. By extracting only the necessary portion for stabilization and output, the system achieves effective image stabilization without processing or reading out the entire sensor data, thereby reducing the data readout amount and system load.
2Reliability
If a sensor with larger pixel count is used to improve image stabilization correction performance, then image stabilization performance is improved, but system load increases
Solution Approach 1:
The imaging area is divided into a readout area and a non-readout area. Only the readout area, which is sufficient for the cutout image stabilization, is read out from the sensor. This segmentation allows using a high-pixel-count sensor without reading out all the data, thus improving stabilization performance while controlling data readout volume.
Solution Approach 2:
A cutout area is extracted from the readout area to generate the final stabilized image. By extracting only the necessary portion for stabilization and output, the system achieves effective image stabilization without processing or reading out the entire sensor data, thereby reducing the data readout amount and system load.
3Quantity of substance
If motion prediction information for future frames is used to set readout area, then data readout is reduced, but processing complexity increases
Solution Approach 1:
Motion prediction information for a predetermined future frame is used in advance to determine the readout area for the current frame. This preliminary action allows the system to proactively configure the readout area based on anticipated motion, reducing data readout while the complexity is managed through efficient prediction algorithms.
Data Source
AI summary
The present disclosure relates to an image processing device and method, and an image processing system that can suppress an increase in load due to image stabilization. A readout area, which is an area from which an image is read out, in an imaging area formed by a plurality of pixels is set on the basis of motion prediction information for a predetermined frame after a frame to be processed, and a cutout area to cut out a partial image from a readout image read out from the set readout area of the frame to be processed is set. The present disclosure can be applied to, for example, an image processing device, an imaging device, or an image processing system, or the like.