Real-Time Video Quality Evaluation Using Uncompressed Frame Comparison
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video quality evaluation methods for live video captured by portable devices are limited by hardware and software constraints, making real-time full-reference video quality estimation impossible due to insufficient memory and processing power, which prevents immediate feedback on video quality and requires separate devices for analysis.
Innovation Solution
A computing device with an image sensor, data processing components, and a reference image data quality comparator that temporarily stores image data for comparison with processed data, enabling real-time evaluation of video quality using scenario-specific heuristic sets and timing metrics, allowing for instantaneous feedback on video quality during capture.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If video quality evaluation is performed on portable devices with constrained memory and processing power, then real-time feedback is achieved, but hardware limitations prevent full-reference comparison
Solution Approach 1:
The patent segments the video evaluation process into two distinct phases: (1) capturing and storing reference frames in uncompressed format during video recording, and (2) performing full-reference quality comparison after video playback. This segmentation allows the computationally intensive full-reference analysis to be performed separately from the resource-constrained capture phase, enabling real-time feedback without overwhelming portable device hardware.
Solution Approach 2:
The patent performs preliminary action by capturing and storing reference video frames in uncompressed format during the video recording process. These reference frames are prepared in advance and stored in the device's memory, so that when quality evaluation is needed, the comparison can be performed immediately without requiring additional processing power or memory resources at the moment of evaluation.
2Measurement precision
If full-reference video quality evaluation is performed, then accurate quality assessment is achieved, but original uncompressed frames are required which consume excessive memory
Solution Approach 1:
The patent applies local quality by storing reference frames in uncompressed format only at specific critical points during video playback (when quality evaluation is triggered), rather than maintaining all video data in uncompressed form. This localized approach to preserving uncompressed reference data enables accurate full-reference comparison while minimizing overall memory consumption on portable devices.
3Power
If video quality evaluation is performed on a separate device, then sufficient processing power is available, but original uncompressed frames are not available for comparison
Solution Approach 1:
The patent introduces an intermediary solution by storing uncompressed reference frames locally in the portable device's memory during the capture phase. These reference frames act as an intermediary between the resource-constrained portable capture device and the resource-rich analysis device, enabling full-reference quality evaluation to be performed accurately without requiring the original uncompressed frames to be transferred or reconstructed.
Data Source
AI summary
Devices and methods for determining image quality using full-reference and non-reference techniques. Full reference image quality may be determined prior to output of an image or video frame from an image sensor processor by temporarily retaining image data from the image sensor and comparing processed image data of the image to the retained, non-processed image data of the same image. Full reference image quality determination may be assisted by a heuristic-based fault indicator. Image quality may also be determined by a non-reference technique of matching the image to one of various scenarios that are associated with sets of heuristics and applying the heuristics of the particular scenario to the image. Instead of relying on a nominal frame rate, video timing quality may be determined by comparing the capture time interval between successive video frames to the presentation time interval of the same video frames.