Live Video Frame Editing via Selective Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current live video editing methods are inflexible, allowing only all-or-nothing editing of video frames, which limits user control and efficiency in live streaming applications.
Innovation Solution
A video processing method that allows users to select and edit specific video frames during recording, applying editing effects to chosen frames and their associated frames, with efficient data transmission and processing by replacing edited frames with null frames and sequencing them for real-time stream generation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If video editing functions are provided for live streaming, then live streaming quality is improved, but video editing flexibility remains poor
Solution Approach 1:
The video stream is segmented into individual video frames, allowing users to select and edit specific frames independently. The system divides the continuous video stream into discrete units (frames) that can be individually manipulated, with each frame being a selectable editing target. This segmentation enables frame-by-frame editing while maintaining the overall video stream structure.
Solution Approach 2:
The editing system transitions from static all-or-nothing editing to dynamic frame-by-frame editing. Users can dynamically select specific frames for editing based on content requirements, and the system dynamically processes only the selected frames rather than the entire video stream. This dynamic approach allows flexible editing while maintaining real-time transmission capabilities.
2Adaptability or versatility
If frame-by-frame editing is enabled, then video editing flexibility is improved, but processing complexity increases
Solution Approach 1:
The system extracts only the selected video frames that require editing, separating them from the rest of the video stream. By taking out only the necessary frames for processing, the system reduces the overall processing complexity compared to editing the entire video stream. The extracted frames are processed independently while the unselected frames pass through unchanged.
Solution Approach 2:
Different processing quality and complexity are applied to different parts of the video stream. Selected frames receive full editing processing with high complexity operations, while unselected frames maintain original quality with minimal processing. This local quality approach optimizes processing complexity by applying intensive operations only where necessary.
3Stability of the object's composition
If editing effects are applied to multiple frames, then editing consistency is improved, but data transmission volume increases
Solution Approach 1:
When an editing effect is applied to a selected frame, the system creates copies of this edited frame for association frames (related video frames) to maintain editing consistency. Instead of re-processing each association frame independently, the system copies the edited frame data, reducing processing complexity while maintaining consistency across multiple frames.
Solution Approach 2:
The system performs preliminary identification of association frames based on the selected video frame, determining which frames require editing consistency before actual editing occurs. By pre-identifying the scope of frames that need consistent editing, the system optimizes data transmission by only processing and transmitting necessary frames rather than the entire video stream.
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
This application relates to the field of video processing technologies, and provides a video processing method and apparatus and a terminal device. The method includes: when detecting in a video recording process that a user enables a video editing function, presenting a recorded original video stream in a form of a video frame; determining a to-be-edited video frame based on a video frame selection operation that is performed by the user on the video frame; performing video editing on the to-be-edited video frame based on a video frame editing operation input by the user, to generate an edited video stream; and generating a target video stream based on the edited video stream and the original video stream. Technical solutions provided in this application can improve live video editing flexibility.