Multiplexing MIPI Multispectral Cameras for UAVs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems for unmanned aerial vehicles (UAVs) equipped with multiple digital cameras face challenges in minimizing the number of image processors required to capture near-simultaneous images across multiple spectral ranges, while also reducing power consumption and circuit board size due to limitations in battery technology.
Innovation Solution
The implementation of a method and system that uses a single image processing unit to coordinate the operation of multiple digital cameras through multiplexed communication links and trigger signals, allowing for near-simultaneous image capture by overlapping trigger signals and communication control signals across cameras.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If multiple separate image processing units are used to operate multiple digital cameras, then each camera can be controlled independently with minimal delay, but the overall system weight and power consumption increase significantly
Solution Approach 1:
The patent combines multiple camera control functions into a single image processing unit. The processor sequentially multiplexes between multiple cameras, sharing the processing unit across all cameras rather than dedicating one processor per camera. This merging approach reduces the total number of processors needed, thereby reducing power consumption and system weight while maintaining coordinated control of all cameras through time-multiplexed operation.
Solution Approach 2:
The system implements periodic sequential operation of the single image processing unit across multiple cameras. The processor alternates between cameras in a predetermined sequence, periodically switching between them to capture images at different wavelengths. This periodic action allows one processor to effectively control multiple cameras by dividing its attention in time, reducing power consumption while maintaining near-simultaneous capture capability.
2Ease of operation
If multiple separate image processing units are used to operate multiple digital cameras, then each camera can be controlled independently, but the circuit board size and system complexity increase
Solution Approach 1:
The patent merges multiple camera control functions into a single image processing unit that sequentially manages all cameras. Instead of having separate processors for each camera, one processor is shared across all cameras through time-multiplexed operation. This reduces the number of processors from N (one per camera) to 1, simplifying the circuit board design and reducing system complexity while maintaining the ability to independently control each camera's capture timing.
Solution Approach 2:
The single image processing unit is designed to be universal, capable of controlling multiple different cameras with different spectral sensitivities. The processor can selectively communicate with and control any camera in the system by switching between them, making one processor perform the function of multiple specialized processors. This multi-functionality reduces component count and system complexity.
3Use of energy by moving object
If a single image processing unit is used to control multiple cameras sequentially, then power consumption and weight are reduced, but the delay between trigger signals increases
Solution Approach 1:
The system implements preliminary action by having the single image processing unit pre-coordinate the trigger signals for each camera in a predetermined sequential order. Before actual image capture, the processor prepares and issues trigger signals to each camera in sequence, ensuring that even though only one processor is used, the timing is optimized to minimize delays. This preliminary coordination allows the system to achieve near-simultaneous capture across all cameras despite using a single shared processor.
4Adaptability or versatility
If multiple digital cameras are mounted on a UAV to capture simultaneous images across different spectral ranges, then imaging capability is improved, but the electronic components weight and power consumption increase
Solution Approach 1:
The patent merges the image processing functions for multiple spectral cameras into a single shared processor. Instead of having separate processing units for each camera sensor (e.g., one for visible light, one for infrared), a single processor handles all cameras by sequentially communicating with each one. This merging of processing functions significantly reduces the weight of electronic components on the UAV while maintaining full multispectral imaging capability across all cameras.
Data Source
AI summary
It is contemplated that the present invention can provide methods and systems for the near-simultaneous frame acquisition from multiple cameras. This can be achieved in two different ways. If the cameras are set to work in triggering mode, the triggering of a first camera and a subsequent camera are adjusted by overlapping the trigger signals and image communication control signals of each camera in order to capture near-simultaneous images from each of the cameras. If the cameras are in video mode, they will be kept synchronous by using a common clock and starting them at the same time. As each camera generates frames, individual, corresponding frames are sampled from each camera in a sequential manner upon receiving a triggering signal. In this way, near simultaneous images can be sampled and saved from multiple cameras in video mode.