Real person video generation method and device, readable storage medium and equipment

A video and real person technology, applied in the field of live video generation, can solve problems such as difficult to achieve "real" level, and achieve the effect of improving realism

Active Publication Date: 2021-04-06
BEIJING CENTURY TAL EDUCATION TECH CO LTD
View PDF11 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Many details in the video, such as clothing patterns, background

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real person video generation method and device, readable storage medium and equipment
  • Real person video generation method and device, readable storage medium and equipment
  • Real person video generation method and device, readable storage medium and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It can be understood that the specific implementation manners described here are only used to explain relevant content, rather than to limit the present invention. In addition, it should be noted that, for the convenience of description, only the parts related to the present invention are shown in the drawings.

[0055] It should be noted that, in the case of no conflict, the embodiments and features in the embodiments of the present invention can be combined with each other. The present invention will be described in detail below with reference to the drawings and in combination with embodiments.

[0056] It should be noted that the numbering of the steps in the text is only for the convenience of explanation of the specific embodiments, and does not serve as a function of limiting the execution order of the steps.

[0057] The method provide...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a real person video generation method and device, a readable storage medium and equipment. The real person video generation method comprises the steps of: obtaining a first video used for generating a target role; searching multiple frames of first reference images corresponding to the multiple frames of images of the first video from a preset reference frame pool; training an image generation model according to the multiple frames of images of the first video and multiple frames of first reference images corresponding to the multiple frames of images of the first video; obtaining a second video used for generating a target action; searching a plurality of frames of second reference images respectively corresponding to the plurality of frames of images of the second video from a reference frame pool; and according to the multiple frames of images of the second video, the multiple frames of second reference images corresponding to the multiple frames of images of the second video, and the image generation model, generating a video in which the target role performs the target action. According to the real person video generation method and device, the readable storage medium and the equipment of the invention, the trueness of the generated video can be improved.

Description

technical field [0001] The present invention relates to the technical field of video generation, in particular to a live-action video generation method, device, readable storage medium and equipment. Background technique [0002] With the popularization of electronic devices, video-based information transmission and communication are becoming more and more important in people's life and work, especially online teaching is gradually rising. In the current online teaching, there are non-live AI courses, which are video courses generated by AI technology, not real video courses recorded by the instructor. AI courses need to use real-life video generation technology. Most of the current video generation methods are based on single-frame reference images. This type of generation method has limitations. Many details in the video, such as clothing patterns, background images and body details, are difficult to reach the "real" level. Therefore, there is a need for a video generati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62G06T7/269G06T7/579G06T13/40G06N3/08
CPCG06T7/269G06T7/579G06T13/40G06N3/08G06T2207/10016G06T2207/20081G06T2207/20084G06T2207/30196G06V40/20G06F18/22
Inventor 王骁高原刘霄
Owner BEIJING CENTURY TAL EDUCATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap