Video Processing With Metadata-Based Offline Quality Enhancement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video recording devices face a trade-off between real-time performance and video quality, often sacrificing video quality to meet real-time requirements, resulting in low-quality video output.
Innovation Solution
A video processing method that involves real-time processing by an ISP during recording and subsequent offline processing by a gallery application using metadata to enhance video quality after recording, allowing for higher-quality video output while meeting real-time constraints.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If real-time processing is performed by ISP during video recording, then real-time performance is maintained, but video quality is reduced
Solution Approach 1:
The video processing is divided into two distinct phases: real-time processing during recording and offline processing after recording. The real-time phase uses ISP to process raw image data and generate first video data, while the offline phase uses a video algorithm to process the first video data and generate the final high-quality second video file. This segmentation allows each phase to have optimized processing characteristics.
Solution Approach 2:
During the real-time video recording process, the system performs preliminary processing by the ISP to generate first video data and stores it along with metadata. This preliminary action ensures real-time performance while preparing the data for subsequent offline enhancement processing that will improve video quality.
2Manufacturing precision
If complex video algorithms are applied to improve video quality, then video quality increases, but device power consumption and overheating increase
Solution Approach 1:
The complex video algorithms are not applied continuously but periodically - specifically during offline processing after video recording ends. The system switches between real-time ISP processing during recording and offline video algorithm processing after recording, allowing the device to manage power consumption by executing intensive algorithms only when needed and when the device is not under real-time performance constraints.
3Manufacturing precision
If complex video algorithms are applied to improve video quality, then video quality increases, but device freezing occurs
Solution Approach 1:
The processing is segmented into real-time and offline phases. During real-time recording, only lightweight ISP processing is performed to ensure device stability. The complex video algorithms are reserved for offline processing of the first video data, preventing device freezing during active recording while still enabling quality enhancement.
Solution Approach 2:
The system performs preliminary real-time processing during recording to capture video data, then applies complex algorithms afterward during offline processing. This preliminary action during recording ensures device stability by avoiding heavy computational loads, while the subsequent offline processing achieves the desired video quality enhancement.
Data Source
Figure 1A-1
Figure 1A-2
Figure 1A-3
AI summary
Embodiments of this application disclose a video processing method, an electronic device, and a computer-readable storage medium. The method includes: In a video recording process, an electronic device obtains raw image data and metadata, and processes the raw image data by using an image signal processor, to obtain first video data; and when exiting video recording, obtains a first video file, and stores the first video file and the metadata, where the first video file is a video file generated by encoding the first video data. A gallery application invokes required metadata based on a video algorithm that needs to be performed, and processes the first video file to obtain a second video file, where video quality of the second video file is higher than video quality of the first video file. In this way, when the video recording ends, a basic-quality video is obtained, and a real-time requirement is met. The gallery application further processes the basic-quality video, so that a user obtains a video with higher quality on the premise that the real-time requirement is met.