Scene segmentation based video figure decorating method, device and computing device

Abstract

The invention discloses a scene segmentation based video figure decorating method, device, computing device and computer storage medium. The method includes acquiring a current frame image containinga specific object in a video in real time; inputting the current frame image into a scene segmentation network and acquiring a scene segmentation result corresponding to the current frame image; according to the scene segmentation result corresponding to the current frame image, determining the outline information of a face area of the specific object and/or the outline information of a five-sense-organ area of the specific object; according to the outline information of the face area and/or the outline information of the five-sense-organ area, adding a beautifying effect and acquiring a frametreatment image; covering the current frame image with the frame treatment image and acquiring video data subjected to treatment; displaying the video data subjected to treatment. By adopting the technical scheme provided by the invention, a scene segmentation result corresponding to the frame image can be acquired accurately in real time and the beautifying effect can be added for the figure inthe frame image in a more accurate way based on the scene segmentation result.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a method, device, computing device and computer storage medium for dressing up video characters based on scene segmentation. Background technique [0002] In the existing technology, image scene segmentation processing methods are mainly based on fully convolutional neural networks in deep learning. These processing methods use the idea of ​​transfer learning to migrate the network obtained through pre-training on large-scale classification data sets to image processing methods. The segmentation network is trained on the segmentation data set to obtain the segmentation network for scene segmentation, and then the segmentation network is used to segment the scene of the image. [0003] The network architecture used in the segmentation network obtained in the prior art directly uses the image classification network, and the size of the convolution block in the conv...

AI Technical Summary

Problems solved by technology

However, for image scene segmentation, the scene often contains objects of different sizes. Using a segmentation network with a fixed-size receptive field often causes problems when dealing with too large and too small objects. For example, for smaller objects, the receptive field It will capture too much background around the target, thereby confusing the target with the background, causing the target to be missed and misjudged as the background; for larger targets...

Images