Simulated Multi-View Traffic Video via Pre-Captured Image Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional traffic cameras provide limited information due to their low resolution and single-directional view, making it difficult to visualize traffic conditions accurately, especially for cars farther away or traveling in opposite directions.
Innovation Solution
A system that enhances video resolution and creates multiple viewpoints by fusing low-resolution, single-direction camera feeds with pre-captured images and temporally shifted video, allowing for simulated high-frame rate, high-resolution, multi-view video images, which includes borrowing pixels from nearby frames to clarify distant vehicles and using databases for missing views.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If low-resolution, single-direction traffic cameras are used, then device complexity and cost are reduced, but video resolution and viewing angles are limited
Solution Approach 1:
The system pre-captures images of vehicles from multiple angles and stores them in a database before they appear in the traffic camera footage. When processing the video feed, these pre-captured images are retrieved and fused with the actual footage to enhance resolution and provide multiple viewpoints, eliminating the need for multiple physical cameras while preserving detailed traffic information
Solution Approach 2:
The system creates high-resolution copies of vehicles by retrieving pre-captured images from the database and fusing them with the low-resolution traffic camera footage. This copying approach allows the system to present detailed vehicle information and multiple viewpoints without requiring additional high-resolution cameras, thus reducing device complexity while maintaining information quality
2Loss of information
If multiple cameras are deployed to capture all traffic directions and distances, then video resolution and coverage are improved, but device complexity and cost increase
Solution Approach 1:
The system extracts only the essential information (vehicle images from multiple angles) and stores them in a database for later use. Instead of deploying multiple cameras to capture all possible views simultaneously, the system extracts pre-captured images and fuses them selectively with the single camera feed, reducing device complexity while maintaining comprehensive traffic information
Solution Approach 2:
The single traffic camera system is enhanced to perform multiple functions by fusing its feed with pre-captured images from the database. This allows one camera to provide the functionality of multiple cameras, including capturing vehicles from different angles and distances, thereby reducing device complexity while maintaining information quality
3Measurement precision
If high-resolution cameras are used, then video resolution is improved, but cost and device complexity increase
Solution Approach 1:
The system pre-captures high-resolution images of vehicles and stores them in a database before they appear in the traffic camera footage. When processing the video feed, these pre-captured high-resolution images are retrieved and fused with the actual footage, providing high measurement precision without requiring expensive high-resolution cameras
Solution Approach 2:
The system creates high-resolution copies of vehicles by retrieving pre-captured images from the database and fusing them with the low-resolution traffic camera footage. This copying approach allows the system to present detailed vehicle information without requiring additional high-resolution cameras, thus reducing device complexity while maintaining video resolution quality
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Simulated high resolution, multi-view video based on video input from low resolution, single-direction cameras is provided. Video received from traffic cameras, security cameras, monitoring cameras, and comparable ones is fused with patches from a database of pre-captured images and/or temporally shifted video to create higher quality video, as well as multiple viewpoints for the same camera.