Imaging Apparatus Region-Based Frame Rate Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing amount of data from imaging apparatuses in automated vehicles poses a challenge for the capacity and transfer rate required for image transfer, necessitating a reduction in image data transmission.
Innovation Solution
The solution involves setting transfer regions within captured images based on objects or feature points, with each region having a specific frame rate, and transmitting region images at those rates, allowing for optimized data transfer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the resolution and frame rate of imaging apparatuses are improved to recognize surrounding situation accurately, then the measurement precision and productivity are improved, but the amount of image data increases, causing the bus capacity and transfer rate requirements to increase
Solution Approach 1:
The imaging apparatus divides the captured image into multiple regions of interest (ROIs) based on detected objects or feature points. Each ROI is then processed and transmitted separately at optimized frame rates, rather than transmitting the entire high-resolution image at high frame rate. This segmentation allows selective transmission of only necessary image portions.
Solution Approach 2:
Different frame rates are assigned to different regions of interest within the captured image. Regions containing important objects or feature points are transmitted at higher frame rates, while other regions are transmitted at lower frame rates. This local differentiation optimizes data transmission by allocating bandwidth according to regional importance rather than uniformly across the entire image.
2Measurement precision
If the amount of image data is increased to improve surrounding situation recognition, then the measurement precision is improved, but the device complexity and transfer requirements increase
Solution Approach 1:
The system dynamically adjusts the frame rate for each region of interest based on real-time detection results. When objects or feature points are detected in certain regions, those regions are assigned higher frame rates for continued monitoring. This dynamic adaptation allows the system to concentrate processing and transmission resources on areas requiring detailed observation, reducing overall data transmission requirements.
Solution Approach 2:
The patent changes the parameter of frame rate from a uniform global setting to a variable regional setting. By allowing different frame rates in different regions based on object presence and importance, the system optimizes the balance between detection accuracy and data transmission requirements, reducing the burden on bus capacity while maintaining necessary observation quality.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present technology relates to an imaging apparatus, an image processing apparatus, and an image processing method that can reduce an amount of transfer of images. The imaging apparatus includes: an imaging unit that performs imaging to obtain a captured image; and a transmission control unit that performs transmission control to transmit a region image within a plurality of transfer regions, which corresponds to an entire or partial region of the captured image, at a frame rate set for each of the transfer regions. The present technology can be applied to, for example, a camera that images the surroundings of a mobile body such as a camera that images the surroundings of a vehicle that performs automated driving.