Streaming Video Preprocessing via Region of Interest Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current practices in streaming video data processing relay the entire frame of view, which is time and resource consuming due to the need to transfer large, high-resolution video data, especially when only a subset of the data is of interest to the consumer.
Innovation Solution
A system and method for selecting and preprocessing video data that focuses on a region of interest within the field of view, using a runtime configuration file to define preprocessing parameters such as formatting, cropping, and image processing operations, which can be edited and applied in real-time to optimize video data for specific use cases.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the entire frame of view is relayed to the consumer, then complete video data is available, but time and resource consumption increase due to transferring large high-resolution video data
Solution Approach 1:
The patent divides the video frame into multiple regions of interest (ROIs) based on semantic segmentation. Instead of transmitting the entire frame, only the segmented ROIs containing relevant information are extracted and transmitted to the consumer, reducing data volume while preserving essential information.
Solution Approach 2:
The patent extracts only the necessary portions of video data (regions of interest) from the complete frame. By identifying and extracting only relevant regions rather than transmitting the entire frame, the system reduces data transfer requirements while maintaining the necessary information for consumer use.
2Loss of information
If the entire frame of view is relayed to the consumer, then complete video data is available, but resource consumption increases due to processing large video data
Solution Approach 1:
The system performs semantic segmentation to divide the video frame into meaningful regions. This segmentation enables the system to process only the relevant regions rather than the entire frame, significantly reducing computational resource consumption while maintaining information completeness for the consumer's specific needs.
Solution Approach 2:
The patent extracts and processes only the necessary regions of interest from the video data. By extracting only relevant portions for further processing and analysis, the system reduces the computational burden on processing resources while ensuring that complete and accurate data is available for the consumer's intended purposes.
3Ease of operation
If preprocessing parameters are fixed, then system operation is simple, but adaptability to different use cases is limited
Solution Approach 1:
The patent implements dynamic preprocessing parameters that can be adjusted based on different use cases and consumer requirements. The system allows runtime modification of preprocessing parameters such as region selection criteria, resolution levels, and processing algorithms, enabling adaptability to various applications while maintaining ease of operation through automated parameter adjustment.
Data Source
AI summary
A method of improving a main output of a main processing application for processing first video data can include preprocessing incoming video data according to first preprocessing parameters, wherein the preprocessing includes formatting the incoming video data to create the first video data, and processing the first video data by the main processing application to determine the main output. The method can further include identifying first test preprocessing parameters, preprocessing the incoming video data according to the first test preprocessing parameters to create first test video data, processing the first test video data by a test processing application to determine a first test output, comparing the first test output to a baseline criterion, and, in response to the first test output satisfying the baseline criterion, altering the first preprocessing parameters to be at least substantially similar to the first test preprocessing parameters.