Rolling Shutter Image Sensor Scan Direction for Motion Distortion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Rolling shutter sensors in automotive and robotic applications suffer from geometrical distortions and shearing, which complicate digital image processing and can lead to inadequate object detection by computer vision algorithms.
Innovation Solution
A method to operate rolling shutter image sensors by determining the expected main direction of movement in the image content and setting the recording direction accordingly to minimize geometrical distortions, using techniques such as optical flow and object tracking, particularly for CMOS sensors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If rolling shutter sensors are used for recording image content, then manufacturing cost is reduced and automotive certification is available, but geometrical distortions and shearing occur in the recorded images
Solution Approach 1:
The patent changes the recording direction parameter of the rolling shutter sensor to align with the expected main direction of movement. By adjusting this parameter dynamically based on movement detection, the system reduces geometrical distortions while maintaining the cost-effective rolling shutter technology.
Solution Approach 2:
The system dynamically adapts the recording direction by detecting the main direction of movement and adjusting the rolling shutter's scan direction accordingly. This dynamic adjustment allows the system to optimize image quality in real-time while using rolling shutter sensors.
2Device complexity
If rolling shutter sensors record image content row-wise or column-wise, then device complexity is reduced, but computer vision algorithms face challenges due to non-uniform geometric shapes
Solution Approach 1:
The system performs preliminary detection of the main direction of movement before recording begins. By determining the movement direction in advance and configuring the recording direction accordingly, the system prevents geometrical distortions that would otherwise complicate object detection and require more complex computer vision algorithms.
3Device complexity
If the recording direction is fixed in rolling shutter sensors, then device complexity is reduced, but shearing effects occur during camera movement
Solution Approach 1:
The system transitions from a fixed recording direction to a dynamic one by continuously detecting the main direction of movement and adjusting the rolling shutter's scan direction. This dynamic adaptation eliminates shearing effects during camera movement while maintaining relatively simple device architecture.
Data Source
AI summary
A method of operating at least one image sensor that records an image content with a recording direction. The method includes the following steps: a) determining at least one piece of information about an expected main direction of movement of an expected movement in at least a portion of an image content to be recorded relative to the image sensor, b) setting the recording direction taking into account the expected main direction of movement, c) recording at least a portion of the image content with the recording direction.