Video prediction method and device based on face segmentation, medium and electronic equipment

A prediction method and video technology, applied in the field of image processing, can solve problems such as unstable video prediction results, and achieve the effect of improving stability and speed of adjustment

Active Publication Date: 2019-11-08
NETEASE (HANGZHOU) NETWORK CO LTD
View PDF7 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The object of the present invention is to provide a video prediction method based on face segmentation, a video prediction device based on face segmentation, a computer-readable s

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video prediction method and device based on face segmentation, medium and electronic equipment
  • Video prediction method and device based on face segmentation, medium and electronic equipment
  • Video prediction method and device based on face segmentation, medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the invention. However, those skilled in the art will appreciate that the technical solutions of the present invention may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other instances, well-known technical solutions have not been shown or desc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention relates to a video prediction method and a device based on face segmentation, a medium and electronic equipment, and relates to the technical field of image processing,and the method comprises the steps: carrying out prediction of a face video data set through a face segmentation model, and obtaining the true and false face segmentation label of each frame of imagein the face video data set; constructing an input data set according to every two adjacent frames of images in the face video data set and the true and false face segmentation tags corresponding to the two adjacent frames of images; adjusting the face segmentation model by using a first loss function and the input data set to obtain a target segmentation model; and segmenting a to-be-predicted face image by using the target segmentation model to obtain segmentation results, and combining the multiple segmentation results to obtain a face prediction video. According to the video prediction method, the stability of the face prediction video is improved.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of image processing, and in particular, relate to a face segmentation-based video prediction method, a face segmentation-based video prediction device, a computer-readable storage medium, and electronic equipment. Background technique [0002] Video stabilization is an important issue in computer vision. Video stabilization can reduce the overall displacement and bring a good experience to video perception. When the shooting source is not fixed, it is easy to cause the video to shake, and the shaking video gives a very bad experience. Among them, the most prominent feature of video jitter is the overall displacement between frames. At present, some video shake detection methods include block matching method, feature point matching method, grayscale projection method, and the method of predicting optical flow by using deep learning, etc. [0003] Specifically, for the method of predict...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06N3/04G06N3/08G06T7/11G06T7/136
CPCG06N3/08G06T7/11G06T7/136G06V40/168G06V20/40G06N3/045Y02T10/40
Inventor 宋新慧袁燚
Owner NETEASE (HANGZHOU) NETWORK CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products