Super-Resolution Video Mesh Generation from Low-Res Streams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Aerial images and videos captured by image sensors on vehicles often have low resolution and framerate, leading to poor quality depth information and 3D representations, which are undesirable for applications like mixed-reality experiences.
Innovation Solution
A system that combines low-resolution image frames from multiple video streams captured by synchronized image sensors to generate high-resolution composite images and animated surface meshes using super-resolution imaging techniques, enabling the creation of high-quality depth information and 3D models.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If low-resolution image sensors are used on aerial vehicles, then the device complexity and data transmission requirements are reduced, but the quality of depth information and 3D representations deteriorates
Solution Approach 1:
The patent combines multiple low-resolution image frames from different aerial vehicles into a single high-resolution composite image through super-resolution imaging techniques. By merging the information from multiple sources, the system achieves high-resolution output without requiring each individual sensor to be high-resolution, thus resolving the contradiction between device complexity and measurement precision.
Solution Approach 2:
The patent transitions from processing individual low-resolution images to processing a composite high-resolution image that integrates information from multiple dimensions (multiple images, multiple vehicles). This dimensional transformation allows the system to achieve high measurement precision while maintaining simple individual sensors.
2Use of energy by moving object
If low-framerate image capture is used, then the energy consumption and data processing load are reduced, but the quality of video and animated surface meshes deteriorates
Solution Approach 1:
The patent merges multiple low-framerate image frames into a high-resolution composite image that captures temporal information. By combining the temporal dimension from multiple frames, the system achieves high video quality without requiring high-framerate capture, thus resolving the contradiction between energy consumption and video quality.
3Measurement precision
If high-resolution images are used to generate depth information, then the quality of 3D representations is improved, but the data storage and transmission requirements increase
Solution Approach 1:
The patent creates a composite high-resolution image that copies and integrates information from multiple low-resolution images. This composite image serves as an efficient representation that enables high-quality 3D reconstruction without requiring storage and transmission of all individual low-resolution images, thus reducing data volume while maintaining measurement precision.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enhances the quality of depth information and 3D representations, allowing for improved mixed-reality experiences and efficient data storage and transmission by generating high-resolution images from low-resolution inputs.
Implementation Method 1
generate a composite video stream comprising a plurality of composite image frames. Each composite image frame of the composite video stream is generated using super-resolution imaging techniques and using a respective image frame of the first video stream and a temporally synchronized corresponding image frame of the second video stream as input
Data Source
AI summary
A system for generating high-resolution video from low-resolution images is configured to access a first video stream and a second video stream capturing an environment. The first video stream is captured by a first video capture device. The second video stream is captured by a second video capture device. Image frames of the first video stream are temporally synchronized with corresponding image frames of the second video stream. The system is also configured to generate a composite video stream with a higher resolution than the first or second video streams. Each composite image frame of the composite video stream is generated using a respective image frame of the first video stream and a temporally synchronized corresponding image frame of the second video stream as input.