Video Frame Processing with Dynamic Resolution Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High-resolution image processing in data storage devices requires significant power consumption and time, particularly in compute surveillance systems, due to the large amount of data involved.
Innovation Solution
The data storage device generates a lower-quality version of image frames for initial processing, performing computations on this version until high-resolution processing is determined necessary, thereby optimizing power and resource usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If high-resolution image processing is performed, then processing quality and detail are improved, but power consumption and processing time increase significantly
Solution Approach 1:
The processing pipeline is segmented into two distinct stages: a first-stage processor that handles initial processing at lower resolution, and a second-stage processor that performs additional processing only on selected frames at high resolution. This segmentation allows the system to process most frames efficiently at lower resolution while reserving high-resolution processing for only those frames that require it, thereby reducing overall power consumption while maintaining processing quality when needed.
2Measurement precision
If high-resolution image processing is performed, then processing quality and detail are improved, but processing time increases
Solution Approach 1:
The processing pipeline is segmented into two distinct stages: a first-stage processor that handles initial processing at lower resolution, and a second-stage processor that performs additional processing only on selected frames at high resolution. This segmentation allows the system to process most frames efficiently at lower resolution while reserving high-resolution processing for only those frames that require it, thereby reducing overall processing time while maintaining processing quality when needed.
3Measurement precision
If high-resolution image processing is performed, then processing quality and detail are improved, but computational resource usage increases
Solution Approach 1:
The processing pipeline is segmented into two distinct stages: a first-stage processor that handles initial processing at lower resolution, and a second-stage processor that performs additional processing only on selected frames at high resolution. This segmentation allows the system to process most frames efficiently at lower resolution while reserving high-resolution processing for only those frames that require it, thereby reducing overall computational resource usage while maintaining processing quality when needed.
4Use of energy by moving object
If lower-resolution image processing is performed, then power consumption and processing time are reduced, but processing quality and detail are degraded
Solution Approach 1:
The system dynamically adjusts the processing resolution based on the characteristics of each video frame. The controller determines whether a frame requires high-resolution processing or can be adequately handled at lower resolution. This dynamic adaptation allows the system to optimize the trade-off between processing quality and power consumption on a per-frame basis, ensuring that high quality is maintained when necessary while minimizing power usage for frames that do not require it.
Data Source
AI summary
A data storage device and method are disclosed for resource optimization in video processing. In one embodiment, a data storage device is provided comprising a memory and one or more processors. The one or more processors, individually or in combination, are configured to: determine whether an image frame requires processing; in response to determining that the image frame requires processing: generate a lower-quality version of the image frame; and perform processing on the lower-quality version of the image frame; determine whether additional processing is needed; and in response to determining that additional processing is needed, perform the additional processing on the image frame instead of the lower-quality version of the image frame. Other embodiments are provided.