Wireless Camera Streaming With Template Matching for Low Bandwidth
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In-vehicle Wi-Fi bandwidth is limited, and increasing demands from streaming applications like video conferencing strain the available bandwidth, necessitating a method to maintain high-quality video streaming while minimizing consumption.
Innovation Solution
A method involving template matching of input and template images to identify unmatched grid areas, caching and transmitting only those areas with errors above a threshold, and using a hardware encoder to minimize bandwidth consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If template matching and selective transmission of unmatched grid areas is implemented, then bandwidth consumption is minimized, but system complexity increases due to template matching processing
Solution Approach 1:
The video frame is divided into multiple grid areas, and template matching is performed on each grid area independently. Only unmatched grid areas are transmitted, segmenting the transmission task into smaller units that can be selectively processed and sent based on their matching error thresholds.
Solution Approach 2:
The patent extracts and transmits only the unmatched grid areas that exceed the error threshold, leaving out the matched areas that can be reconstructed from the template image. This extraction approach minimizes transmitted data while preserving essential visual information.
2Loss of energy
If only unmatched grid areas are transmitted, then bandwidth consumption is reduced, but video quality may deteriorate due to potential loss of important visual information
Solution Approach 1:
The patent uses matching error threshold as a parameter to determine which grid areas to transmit. By adjusting the threshold, the system can balance between bandwidth savings and video quality, ensuring that only areas with significant changes are transmitted while maintaining visual fidelity.
Solution Approach 2:
The template matching process provides feedback on which grid areas have changed significantly, allowing the system to make informed decisions about what to transmit. This feedback mechanism ensures that important visual information is preserved while minimizing redundant data transmission.
3Loss of information
If template matching is performed on all grid areas, then comprehensive video information is captured, but processing time and computational resources increase
Solution Approach 1:
The video processing is segmented into multiple independent grid area evaluations. By processing each grid area separately and independently, the system can efficiently identify and transmit only the necessary portions, reducing overall processing time while maintaining information completeness.
Solution Approach 2:
The patent performs partial template matching only on grid areas where changes are detected, rather than uniformly processing all areas with the same computational intensity. This partial action approach reduces processing time while ensuring that all important visual information is captured.
Data Source
AI summary
A method for video streaming includes receiving an input image from a camera. The input image includes a plurality of input grid areas. The method further includes receiving a template image. The method further includes comparing the matching error with a template-matching error threshold to determine whether the matching error is equal to or greater than the template-matching error threshold in order to identify unmatched grid areas of the input image. The plurality of input grid areas includes the unmatched grid areas and matched grid areas. The matching error of the matched grid areas is not equal to or greater than the template-matching error threshold. The method further includes transmitting the unmatched grid areas of the input image and identification information of the matched grid areas to the vehicle, thereby minimizing bandwidth consumption used during video streaming.