Stereo Matching Resolution Selection for Bandwidth Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current information processing apparatuses face challenges in enhancing functionality while maintaining picture quality and reducing bandwidth and processing time, as improving camera performance compresses image data transmission bandwidth and increases analysis time.
Innovation Solution
An information processing apparatus that performs stereo matching using stereo moving images from different viewpoints, selecting an appropriate resolution for processing based on the size of the target region, and producing depth images to output position information efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the performance of an image pickup element is enhanced to improve picture quality, then the bandwidth for image data transmission is compressed and processing time increases
Solution Approach 1:
The image processing is segmented by dividing the image into multiple regions of interest (ROIs) based on detected objects or areas requiring attention. Only these specific regions undergo high-resolution processing, while other areas use lower resolution, thereby reducing overall processing time and bandwidth requirements while maintaining picture quality for important regions.
Solution Approach 2:
Different resolution levels are applied to different regions of the image based on their importance. High-resolution processing is concentrated on regions containing objects of interest, while less important regions use lower resolution. This local quality approach maintains measurement precision for critical areas without increasing overall processing time.
2Measurement precision
If the performance of an image pickup element is enhanced to improve picture quality, then the bandwidth for image data transmission is compressed
Solution Approach 1:
The patent extracts only the essential high-frequency components or detailed information from the image data, rather than transmitting or processing the entire high-resolution image. By separating and processing only the necessary detailed components in regions of interest, the bandwidth requirement is reduced while maintaining picture quality where it matters most.
Solution Approach 2:
The image data is segmented into different resolution levels for different regions. Only regions requiring high picture quality are processed and transmitted at high resolution, while other regions use compressed lower-resolution data, thereby reducing overall bandwidth consumption while preserving measurement precision for important areas.
3Measurement precision
If full-resolution stereo matching is performed to maintain accuracy, then processing time and computational load increase
Solution Approach 1:
The stereo matching process is segmented by first performing matching on low-resolution images to identify candidate corresponding points, then refining the matching only in regions containing objects of interest using high-resolution images. This segmented approach maintains stereo matching accuracy for relevant objects while significantly reducing overall processing time.
Solution Approach 2:
Preliminary stereo matching is performed on downsampled or low-resolution images to pre-identify regions containing objects and to establish initial correspondence relationships. This preliminary action guides subsequent high-precision matching, ensuring accuracy is maintained only where necessary, thereby reducing total processing time.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An image pickup apparatus 12 includes a first camera 22 and a second camera 24. The cameras pick up an image of a target at the same timing and at the same frame rate from left and right positions spaced by a known distance from each other. Picked up frame images are converted into image data of a predetermined plurality of resolutions. An input information acquisition section 26 of an information processing apparatus 14 acquires an instruction input from a user. A position information production section 28 approximately estimates a region of the target or a region which involves some movement on an image of a low resolution and a wide range from within stereo image data as a target region and carries out stereo matching only in regard to the region on an image of a high resolution to specify a three-dimensional position of the target. An output information production section 32 carries out a necessary process based on the position of the target to produce output information. A communication section 30 carries out request for and acquisition of image data to and from the image pickup apparatus 12.