Video Preview Streaming via Complexity-Based Upload Prioritization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge is to reduce bandwidth consumption and latency in uploading video data from electronic devices to remote servers for processing, as uploading entire video captures consumes significant bandwidth and time, leading to delays in editing and processing.
Innovation Solution
The system identifies and uploads selected portions of video data, including audio and annotation data, at a lower frame rate, allowing for preview processing, which determines the order and priority of uploading sections based on complexity metrics, enabling efficient bandwidth use and reduced latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If entire video data is uploaded to remote servers, then complete video processing can be performed, but bandwidth consumption increases and upload time is extended
Solution Approach 1:
The patent divides the entire video data into multiple sections or segments. Instead of uploading all video data at once, the system identifies and uploads only specific sections that require processing. This segmentation allows selective transmission of video portions, reducing overall bandwidth consumption while maintaining the ability to process complete videos through iterative section-by-section handling.
2Reliability
If entire video data is uploaded to remote servers, then complete video processing can be performed, but upload time is extended leading to increased latency
Solution Approach 1:
The system performs preliminary identification of video sections that need processing before initiating the upload. By pre-analyzing the video data locally to determine which sections require remote processing, the system avoids uploading unnecessary portions. This preliminary action enables faster, more targeted uploads and reduces overall latency while ensuring complete processing of required video sections.
3Loss of energy
If video data is compressed to reduce bandwidth consumption, then upload efficiency improves, but video quality may be degraded
Solution Approach 1:
The patent applies different quality levels to different video sections based on their processing requirements. Critical sections that need high-quality analysis are uploaded at higher resolutions and frame rates, while less critical sections use lower quality settings. This local quality differentiation reduces overall bandwidth consumption while maintaining sufficient video quality for sections requiring detailed processing.
4Measurement precision
If video data is uploaded at high frame rate, then processing accuracy is maintained, but bandwidth consumption and upload time increase
Solution Approach 1:
The system dynamically adjusts video parameters such as frame rate and resolution based on the specific processing requirements of different video sections. Sections requiring high processing accuracy are uploaded at higher frame rates, while other sections use reduced frame rates. This parameter adaptation maintains necessary processing accuracy while significantly reducing overall bandwidth consumption and upload time.
Data Source
AI summary
A system and method for generating preview data from video data and using the preview data to select portions of the video data or determine an order with which to upload the video data. The system may sample video data to generate sampled video data and may identify portions of the sampled video data having complexity metrics exceeding a threshold. The system may upload a first portion of the video data corresponding to the identified portions while omitting a second portion of the video data. The system may determine an order with which to upload portions of the video data based on a complexity of the video data. Therefore, portions of the video data that may require additional processing after being uploaded may be prioritized and uploaded first. As a result, a latency between the video data being uploaded and a video summarization being received is reduced.