A method, system and storage medium based on improving the accuracy of portrait segmentation
A technology of segmentation accuracy and portrait, applied in the field of video processing, can solve the problem of declining viewing experience, and achieve the effect of improving the viewing experience.
Active Publication Date: 2021-09-03
G NET INTEGRATED SERVICE
View PDF7 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0007] Due to the limitations of the CNN network itself, it is impossible to achieve 100% accuracy. Therefore, the portrait segmentation network often recognizes some objects that look like people's clothes and outlines in unmanned videos as portraits, such as sofas, high-back chairs, and hangers. The coats on the screen, etc., will be recognized as portraits by the portrait segmentation network and displayed on the viewing end, resulting in a sharp drop in viewing experience
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0066] In order to understand the above-mentioned purpose, features and advantages of the present invention more clearly, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that, in the case of no conflict, the embodiments of the present application and the features in the embodiments can be combined with each other.
[0067] In the following description, many specific details are set forth in order to fully understand the present invention. However, the present invention can also be implemented in other ways different from those described here. Therefore, the protection scope of the present invention is not limited by the specific details disclosed below. EXAMPLE LIMITATIONS.
[0068] figure 1 A flow chart of a method based on improving the accuracy of portrait segmentation in the present invention is shown.
[0069] Such as figure 1 As shown, the first aspect of the pre...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present invention provides a method, system and storage medium based on improving the accuracy of portrait segmentation. The method includes: receiving a video stream related to a video cloud conference and reading a frame of source image from it; Face detection is performed on the image, and the number of suspected faces in the source image is detected; if the number of suspected faces detected is not zero, the ratio relationship between the resolution of the source image and each suspected face coordinate area is respectively Judging whether each suspected human face is a real human face; according to the judgment result, if there is a real human face, then mark the real human face coordinate area; perform portrait segmentation processing on the source image based on the real human face coordinate area, and obtain the corresponding two Valued grayscale image; fuse the binary grayscale image with the source image and the preset background image to obtain a fused image, and display it on the interface on the viewing side of the video cloud conference. The invention can improve the portrait segmentation accuracy of the video cloud viewing terminal.
Description
technical field [0001] The present invention relates to the technical field of video processing, in particular to a method for improving the accuracy of segmentation based on portraits. Background technique [0002] The virtual background in video cloud conferencing is mainly used when the user needs to replace the background information with an existing image or video due to personal privacy or sensitive location, referred to as virtualization. The function of the virtual background in the cloud conference is mainly to generate a binary gray-scale image Alpha based on Image Matting (portrait segmentation) for each frame in the video (generally, the portrait area is 255, the background area is 0, and the intersection edge of the portrait and the background is 0-255), fuse the current frame with the background image to be replaced, and finally get the desired result image or video. [0003] Image Matting technology refers to the use of traditional image processing or deep le...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/40G06T7/11G06T7/194H04N7/15
CPCH04N7/15G06T7/11G06T7/194G06V40/161G06V40/45G06V10/30
Inventor 程鹏宇
Owner G NET INTEGRATED SERVICE