Rolling Shutter Distortion Reduction via Dynamic Line Thinning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Rolling shutter distortion occurs in images captured by devices with a rolling shutter operation, especially when the positional relation between the image capturing device and the subject changes over time, leading to significant distortion even with increased frame rates.
Innovation Solution
An information processing device that includes a motion detecting section to identify changes in the relative position between the image capturing device and the subject, and a thinning-out setting section that adjusts the thinning-out amount and reading-out order of the image capturing operation based on these changes, minimizing distortion by uniformly increasing the thinning-out amount and adjusting the reading-out direction accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the frame rate is increased to improve visibility, then the visibility of the target region is improved, but rolling shutter distortion becomes significant when the positional relation changes greatly
Solution Approach 1:
The patent applies dynamics by making the thinning-out amount variable based on detected motion. The image capturing section adjusts the thinning-out rate dynamically according to the relative position change between the image capturing device and subject, allowing the system to adapt to different motion conditions and reduce distortion while maintaining visibility.
Solution Approach 2:
The patent changes the parameter of thinning-out amount based on motion detection. By adjusting this parameter according to the relative position change, the system optimizes the balance between frame rate (visibility) and image quality (distortion reduction), resolving the technical contradiction between these two requirements.
2Productivity
If line thinning-out operation is performed to reduce data amount, then processing efficiency is improved, but image quality deteriorates due to information loss
Solution Approach 1:
The thinning-out rate is made dynamic rather than fixed. The system adjusts the thinning-out amount based on the detected relative position change, applying more aggressive thinning when motion is small (maintaining quality) and allowing more thinning when motion is large (prioritizing distortion reduction), thus optimizing both processing efficiency and image quality adaptively.
Solution Approach 2:
The patent applies different thinning-out strategies to different regions or conditions. By adjusting the thinning-out amount based on local motion characteristics (relative position change), the system preserves image quality in regions with small motion while allowing greater data reduction in regions with large motion, achieving local optimization of both quality and efficiency.
3Speed
If rolling shutter operation is performed to capture moving objects, then motion capture capability is improved, but distortion occurs in subject images
Solution Approach 1:
The system performs preliminary action by detecting the relative position change before completing the image capture process. Based on this detection, it pre-adjusts the thinning-out amount to counteract the expected distortion, thereby preventing rather than merely correcting the rolling shutter distortion effect.
Solution Approach 2:
The patent converts the harmful effect of rolling shutter distortion into a beneficial outcome by using the thinning-out operation strategically. By adjusting the thinning-out amount based on motion detection, the system transforms what would be pure distortion into a controlled sampling process that actually reduces distortion while maintaining the ability to capture motion.
Data Source
AI summary
A motion detecting section detects a change in relative position relation between a subject and an image capturing section performing a rolling shutter operation. A thinning-out setting section sets a thinning-out amount of a line thinning-out operation of the image capturing section according to the detection result obtained by the motion detecting section. A recognition processing section performs subject recognition in an image obtained by the image capturing section, by using a recognizer corresponding to the thinning-out amount set by the thinning-out setting section. The change in relative position relation is detected based on motion of a moving body on which the image capturing section is mounted, an image capturing scene, an image obtained by the image capturing section, and the like. Line thinning-out is performed during the rolling shutter operation, and the thinning-out amount is set according to the detection result obtained by the motion detecting section.