Smartphone Camera Module Signal Bypass for AP Load Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current smartphone camera modules with high-end APs face challenges in processing high-resolution images efficiently due to resource constraints, and low-cost APs in mid-to-low-end phones lack the capability to handle multiple camera inputs effectively, limiting the application of advanced image processing techniques like multi-camera fusion for improved image quality.
Innovation Solution
An image processing apparatus and method that includes a receiver for multiple images, a processor for generating high-resolution images using convolutional neural networks, and a switch for bypassing signals to reduce the resource load on the AP, allowing for simultaneous processing and transmission of images from multiple cameras.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high-end APs with deep learning capabilities are used, then image processing quality is improved, but device cost and power consumption increase
Solution Approach 1:
The patent divides the image processing system into two segments: a dedicated camera module with its own processor for preprocessing, and the main AP for final processing. This segmentation allows the camera module to handle deep learning tasks independently, reducing the power consumption and resource load on the main AP while maintaining high image processing quality.
Solution Approach 2:
The camera module acts as an intermediary between the image sensor and the main AP. It performs preprocessing functions including deep learning-based image processing, then transmits the processed images to the AP. This intermediary role reduces the computational burden on the AP and lowers overall power consumption while preserving image quality.
2Adaptability or versatility
If multiple MIPI channels are provided for multi-camera use, then multi-camera fusion capability is improved, but device cost increases
Solution Approach 1:
The camera module is designed with universal functionality to handle multiple camera inputs through a single MIPI interface. The module can process images from multiple cameras sequentially or simultaneously, providing multi-camera fusion capability without requiring separate MIPI channels for each camera, thus reducing device complexity and cost.
Solution Approach 2:
The system dynamically switches between different camera inputs and processing modes within the camera module. The processor can adaptively handle different camera configurations and image processing tasks, providing versatile multi-camera functionality through a single interface rather than requiring static multiple channels.
3Ease of operation
If a Mux structure with switching function is used, then single camera selection is enabled, but simultaneous multi-camera image transmission is restricted
Solution Approach 1:
The system uses dynamic switching within the camera module to handle multiple camera inputs. Instead of a static Mux structure that selects only one camera, the processor can dynamically process and transmit images from multiple cameras in sequence or simultaneously, maintaining ease of operation while enabling versatile multi-camera transmission.
Solution Approach 2:
The camera module maintains continuous processing capability for multiple camera inputs without interruption. The processor can handle images from different cameras in a continuous stream, ensuring that useful action (image processing and transmission) continues without the restrictions of a static switching structure.
Data Source
AI summary
An image processing apparatus, according to one embodiment of the present invention, comprises: a receiver for receiving a first image and a second image; a first processor for outputting a third image by using at least one of the first image and the second image; a signal line bypassing at least one of the first image and the second image; a switch for connecting a signal output from the receiver to the first processor or the signal line; and a transmitter for transmitting at least two of the first to third images.