Bionic Vision Sensor ROI Imaging for UAV Bandwidth Limits
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image sensors for UAVs face challenges in real-time transmission of high-resolution images, leading to high bandwidth and power consumption, while low-resolution images compromise navigation accuracy.
Innovation Solution
A bionic vision sensor with a two-dimensional pixel array, ROI module, image segmentation, and regional imaging control module that adjusts resolution based on detected regions of interest, using neural networks to prioritize high resolution for central regions and reduce it for peripheries.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If full-resolution high-definition images are transmitted in real-time, then image quality is improved, but bandwidth and power consumption increase extremely
Solution Approach 1:
The image sensor divides the field of view into multiple regions of interest (ROIs) and transmits only the image data from these segmented regions at high resolution, rather than transmitting the entire high-resolution image. This segmentation approach maintains critical navigation image quality while significantly reducing the total data transmission volume, thereby lowering bandwidth requirements and power consumption.
Solution Approach 2:
The system applies different image quality levels to different spatial regions: high resolution is applied locally to identified regions of interest that require precise navigation information, while peripheral regions are transmitted at lower resolution. This local quality differentiation ensures that power consumption and bandwidth are optimized by allocating high-quality transmission only where necessary for safe operation.
2Use of energy by moving object
If low-resolution images are transmitted to reduce bandwidth, then power consumption is reduced, but navigation accuracy deteriorates
Solution Approach 1:
The system segments the image into multiple regions of interest and transmits high-resolution data only for these specific segments rather than uniformly reducing resolution across the entire image. This ensures that navigation-critical regions maintain sufficient detail for accurate operation while non-critical regions use lower resolution to conserve power and bandwidth.
Solution Approach 2:
Different resolution qualities are applied locally to different regions based on their importance for navigation. Regions containing critical navigation information (such as obstacles, terrain features, or targets) are transmitted at high resolution to preserve navigation accuracy, while other regions use lower resolution to reduce power consumption.
3Productivity
If high-frame-rate high-quality images are acquired, then real-time monitoring capability is improved, but data transmission volume and bandwidth requirements increase
Solution Approach 1:
The image sensor identifies and segments only the critical regions of interest within each frame, transmitting high-quality data only for these segmented portions. This allows the system to maintain high frame rates for real-time monitoring while significantly reducing the total data transmission volume compared to transmitting complete high-resolution frames at the same frame rate.
Solution Approach 2:
The system applies high image quality locally to regions of interest that require real-time monitoring, while using lower quality for peripheral regions. This local quality optimization enables high frame-rate transmission of critical information without the excessive bandwidth requirements that would result from transmitting entire high-quality frames.
Data Source
AI summary
A bionic vision sensor includes: a two-dimensional pixel array comprising a plurality of sensor pixels; a ROI module, wherein the ROI module is configured to obtain position information of at least one region of interest based on the two-dimensional pixel array; an image segmentation module, wherein the image segmentation module is configure to obtain at least one first region of the two-dimensional pixel array and at least one second region outside the first region according to the position information of region of interest; and a regional imaging control module, wherein the regional imaging control module is configured to generate a real-time image based on image data respectively obtained in the first region and the second region, and a pixel sampling rate of the first region is greater than a pixel sampling rate of the second region.