Video Processing Background Segmentation and Replacement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional green screen technology requires a solid-color background and professional editing skills, making it difficult for users to shoot and edit videos in daily life.
Innovation Solution
A video processing method and apparatus that allows users to combine an image frame of a target object with an initial background in a shooting interface, enabling easy selection and replacement of backgrounds, including image and video backgrounds, and automatic splicing of video segments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional green screen technology is used, then background replacement is achieved, but the threshold for users to shoot videos is significantly raised due to requiring solid-color backgrounds and professional editing skills
Solution Approach 1:
The system performs automatic background segmentation and replacement without requiring user intervention in the editing process. The algorithm automatically identifies the target object, segments it from the background, and composites it with the desired background, making the system self-sufficient and eliminating the need for professional editing skills
Solution Approach 2:
The patent replaces manual editing operations with automated image processing algorithms. Instead of requiring users to manually select and edit frames, the system uses computer vision algorithms to automatically segment objects and composite backgrounds, substituting mechanical manual operations with automated computational processes
2Adaptability or versatility
If professional editing software is used for green screen effects, then background replacement capability is achieved, but the learning curve and operational complexity increase significantly
Solution Approach 1:
The system automatically performs all editing operations including object segmentation, background selection, and video composition without requiring user knowledge of editing software. The algorithm self-manages the entire background replacement process, making advanced capabilities accessible to ordinary users through a simple interface
Solution Approach 2:
The patent combines multiple complex functions (object detection, image segmentation, background compositing, video processing) into a single integrated system. This merging of functions allows the system to provide professional-grade background replacement capability while maintaining simplicity for end users
3Extent of automation
If automatic object segmentation is performed, then background separation is achieved, but processing time and computational resources increase
Solution Approach 1:
The system performs object segmentation and background separation in real-time during video capture rather than as a post-processing step. By executing the segmentation algorithm concurrently with video recording, the system prepares the processed video frames in advance, eliminating the need for time-consuming post-editing and reducing overall processing time
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present disclosure provides a video processing method and apparatus, an electronic device, and a non-transitory computer readable storage medium. The method includes: displaying, when a predetermined application program enters a shooting mode, a predetermined shooting interface in a current interface of the application program, the shooting interface having a predetermined initial background; obtaining an image frame of a target object and the initial background; combining the image frame as a foreground with the initial background for displaying in the shooting interface; starting, in response to receiving a first shooting start instruction, generation of video data based on the image frame and the initial background; and stopping, in response to receiving a first shooting stop instruction, generation of video data to obtain first video data as generated.