Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image processing method and device, electronic equipment and storage medium

An image processing and image technology, applied in three-dimensional object recognition, acquisition/recognition of facial features, instruments, etc., can solve the problems of blurred pictures, distortion of characters, large differences in expressions and postures, etc.

Active Publication Date: 2021-08-27
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF7 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, since the expression and posture of the characters in the source image and the driving video may be quite different, the above two-dimensional transformation method may cause distortion and blurring of the characters in the target video, and the driving effect of the face is not good.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image processing method and device, electronic equipment and storage medium
  • Image processing method and device, electronic equipment and storage medium
  • Image processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0141] As an implementation manner of the embodiment of the present invention, the above-mentioned feature extraction module 740 may include:

[0142] The transformation unit is configured to determine the product of the image feature of the source image and the transformation matrix corresponding to each frame of target image as the transformed image feature corresponding to the frame of target image.

[0143] As an implementation manner of the embodiment of the present invention, the above-mentioned optical flow information determination module 730 may include:

[0144] The first extraction unit is used to extract the face key points of the source person in the source image as the first face key points;

[0145] The second extraction unit is used to extract the face key points of the target person in each frame of the target image as the second face key points;

[0146] An optical flow information determination unit, configured to determine based on the mapping relationship...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides an image processing method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining first three-dimensional face information of a source person in a source image and second three-dimensional face information of a target person in each frame of target image of a drive video, based on identity information included in the first three-dimensional face information and expression information and posture information included in second three-dimensional face information corresponding to each frame of target image, performing rendering processing to obtain an initial face image, and determining target optical flow information based on face key points of the source person and face key points of the target person, and extracting image features of each frame of initial face image and the source image, transforming the image features of the source image according to the target optical flow information to obtain transformed image features, and jointly determining a target video based on the transformed image features and the image features of each frame of initial face image. The transformed image features and the image features of each frame of initial face image complement each other, and the face driving effect is improved.

Description

technical field [0001] The present invention relates to the technical field of multimedia data processing, in particular to an image processing method, device, electronic equipment and storage medium. Background technique [0002] Face-driven technology is based on a given source image and a driving video of a target person to generate a target video in which the person is the person in the source image, and the expression and posture are the same as those of the target person in the driving video. It can be applied to various scenarios such as social entertainment, video compression, and online meetings. [0003] The current face driving method is to estimate the optical flow information based on the key points of each image included in the source image A and the driving video B, and then perform a two-dimensional transformation on the source image A according to the estimated optical flow information to obtain the person as the source The target video of person a in image...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/36G06K9/46
CPCG06V20/64G06V40/174G06V40/168G06V40/20G06V10/20G06V10/462
Inventor 范音
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com