Video-based processing method and device, and readable medium

A processing method and video technology, applied in the computer field, can solve the problems of mechanical movement and stiffness, and achieve the effect of natural movement

Active Publication Date: 2021-12-21
ALIBABA DAMO (HANGZHOU) TECH CO LTD
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, there are avatars of some 3D characters that can perform singing and dancing performances. However, these avatars can only perform a few fixed actions, and the actions are relatively mechanical and rigid. Therefore, a technical problem that those skilled in the art need to solve is: how to Drive the avatar to perform actions more accurately and naturally

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video-based processing method and device, and readable medium
  • Video-based processing method and device, and readable medium
  • Video-based processing method and device, and readable medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In order to make the above objects, features and advantages of the present application more obvious and understandable, the present application will be further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0038]The embodiments of the present application can be applied to scenarios where avatars generate videos, such as scenarios in which avatars serve as anchors, customer service, hosts, etc. In videos where avatars perform actions, avatars can be driven to perform corresponding actions based on demand, such as merchandise Introduce moves, customer service moves, host moves, dance moves, etc. The avatar can perform actions by simulating a real person, thereby being able to drive the body movements of the avatar, so that the avatar can perform various actions. Among them, taking dancing, live broadcasting and other scenes as examples, the avatar can be driven to perform corresponding actions based on inter...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a video-based processing method and device, and a readable medium, so as to more accurately and naturally drive a virtual image to execute an action. The method comprises the following steps: acquiring a skeleton action segment, and dividing the skeleton action segment into skeleton action sub-segments; determining nodes by adopting the skeleton action sub-fragments, determining edges according to motion information among the skeleton action sub-fragments, and constructing a skeleton action connection graph; obtaining target information; according to the target information and skeleton action sub-fragments in a skeleton action connection graph, matching target sub-fragments and associated sub-fragments thereof; splicing the target sub-fragment and the associated sub-fragment, and combining the target information to form video data; and outputting the video data. The video with smooth transition of the action can be spliced, so that the action of the virtual user in the video data is natural and smooth, and the video of the virtual image execution action can be accurately and naturally generated.

Description

technical field [0001] The present application relates to the field of computer technology, and in particular to a video-based processing method, a live broadcast processing method, a video generation method, a terminal device, and a machine-readable medium. Background technique [0002] Animation usually generates a corresponding animated video by drawing a picture of each frame. The animation picture is drawn based on the fixed plot of the animation. Correspondingly, the objects in the animation, such as characters and animals, are usually just a few fixed actions, which can form a dynamic effect. [0003] At present, there are avatars of some 3D characters that can perform singing and dancing performances. However, these avatars can only perform a few fixed actions, and the actions are relatively mechanical and rigid. Therefore, a technical problem that those skilled in the art need to solve is: how to Drive the avatar to perform actions more accurately and naturally. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T13/40G06T13/20G06K9/00H04N21/2187
CPCG06T13/40G06T13/205H04N21/2187H04N21/41407H04N21/854H04N21/8456H04N21/8146H04N21/23418H04N7/157H04N21/4394H04N21/44008G06V40/23G11B27/031G11B27/11
Inventor 庄文林张鹏张邦胡立李嘉辉
Owner ALIBABA DAMO (HANGZHOU) TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products