Multi-Camera Image Processing Using Independent and Dependent Signal Processors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Image processing systems with multiple cameras face high costs and power consumption due to the need for high-quality image signal processors (ISPs) across all cameras, and differences in resolution occur when using ISPs with reduced quality specifications, leading to inefficiencies in image signal processing.
Innovation Solution
An image processing apparatus and system that utilize a pre-processor to generate image position information, an independent image signal processor (IISP) to process Bayer image signals from one camera, and a dependent image signal processor (DISP) to process signals from other cameras using the generated information, reducing the need for redundant calculations and power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If high-quality ISPs are used for all cameras, then image processing quality is maintained, but system cost and power consumption increase
Solution Approach 1:
The patent divides the image processing system into two distinct processor types: independent ISPs that perform full processing for reference images, and dependent ISPs that perform simplified processing for target images using data from independent ISPs. This segmentation allows the system to maintain high processing quality where needed while reducing overall power consumption and cost.
Solution Approach 2:
Dependent ISPs perform only the necessary portion of image processing by leveraging pre-processed data from independent ISPs. Instead of performing complete independent processing, dependent ISPs execute partial processing operations, reducing computational load and power consumption while maintaining adequate image quality for the specific application.
2Use of energy by moving object
If reduced-quality ISPs are used for some cameras, then power consumption decreases, but resolution differences occur among image signals
Solution Approach 1:
Independent ISPs act as intermediaries that perform comprehensive processing of reference images. The processed data from these independent ISPs is then used by dependent ISPs to process target images, ensuring that even though dependent ISPs have reduced capabilities, the final output maintains consistent resolution and quality through the mediating role of independent ISPs.
Solution Approach 2:
The system changes processing parameters dynamically by adjusting the level of processing performed by dependent ISPs based on the availability and quality of reference data from independent ISPs. This allows the system to maintain consistent output quality across different cameras with varying processor capabilities.
3Reliability
If all cameras use identical high-quality ISPs, then processing consistency is achieved, but system cost increases
Solution Approach 1:
The patent applies different processing qualities to different parts of the system: independent ISPs perform full-quality processing for reference images where consistency is critical, while dependent ISPs perform simplified processing for target images where cost reduction is prioritized. This local differentiation of processing quality allows the system to achieve necessary consistency in critical paths while reducing overall system cost.
Solution Approach 2:
The system segments ISPs into independent and dependent types with different functional capabilities and cost structures. This segmentation allows the system to achieve processing consistency through the coordinated operation of different processor types rather than requiring all cameras to use identical high-cost processors.
4Adaptability or versatility
If independent processing is performed for each camera, then processing autonomy is maintained, but power consumption and complexity increase
Solution Approach 1:
The system segments processing autonomy between independent ISPs that maintain full processing capabilities for reference images and dependent ISPs that rely on data from independent processors. This segmentation allows the system to maintain necessary processing autonomy in critical paths while reducing overall power consumption through the coordinated, hierarchical processing architecture.
Data Source
AI summary
An image processing apparatus includes a pre-processor configured to generate information relating to image positions based on Bayer image signals obtained by cameras. The image processing apparatus further includes an independent image signal processor (IISP) configured to perform a first image signal processing operation for generating first image data of an RGB format from a first one of the Bayer image signals obtained by a first one of the cameras. The IISP is further configured to generate image processing information calculated during the first image signal processing operation. The image processing apparatus further includes a dependent image signal processor configured to perform a second image signal processing operation for generating second image data of the RGB format from a second one of the Bayer image signals obtained by a second one of the cameras using the image processing information and the information relating to the image positions.