A kind of portrait video processing method
A video processing and portrait technology, applied in the field of portrait video processing, can solve the problem of inability to take into account accurate facial details and gestures, and achieve the effect of natural look, accurate facial details, and strong realism.
Active Publication Date: 2022-07-26
GUANGDONG UNIV OF TECH
View PDF7 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] In order to overcome the defect that the above-mentioned existing portrait video generation technology cannot take into account accurate facial details and gesture actions, the present invention provides a portrait video processing method, which can generate a portrait video with realistic facial details, natural gesture actions, and synchronous picture and sound. Strong sense of reality, natural look and feel
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment
[0070] This embodiment provides a portrait video processing method, such as figure 1 shown, including:
[0071] S1: Obtain the original video clip of the first person and the original video clip of the second person;
[0072] S2: extract the facial parameters, posture parameters and audio data of the original video clip of the first person from the original video clip of the first person; extract facial control information and motion control information from the original video clip of the second person;
[0073] Before extracting the facial parameters, posture parameters of each frame of images and audio data of the original video clip of the first person from the original video clip of the first person, it is also necessary to preprocess the original video clip of the first person, including:
[0074] Delete blurred images, use human body recognition technology to delete blurred and unrecognizable images;
[0075] Extract image frames, and use FFmpeg video codec tools to ex...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a portrait video processing method, comprising: acquiring an original video segment of a first person, extracting facial parameters, body parameters and audio data therefrom; acquiring an original video segment of a second person, extracting face control information and action control information from the original video segment ; Carry out facial expression migration according to the facial parameters of the first character, audio data and the facial control information of the second character, and obtain the fitting new face map of the first character; According to the body parameters of the first character and the motion control of the second character The information is transferred to the posture and action to obtain the fitted new posture diagram of the first person; the face in the fitted new posture diagram is replaced by the fitted new face diagram to generate a new full-body diagram of the first person; all the new full-body diagrams of the first person are synthesized Video, load audio data, get a new video clip of the first character. The new video clips of characters generated by the invention have realistic facial details, natural gestures and movements, and character videos with synchronized picture and sound, and have a strong sense of reality and a natural look and feel.
Description
technical field [0001] The present invention relates to the technical field of portrait video processing, and more particularly, to a portrait video processing method. Background technique [0002] With the continuous development of science and technology and the Internet economy, video images have gradually become an indispensable part of people's lives. With the popularity of short videos, more and more people realize that such intuitive, convenient and low-threshold video images are accepted by the public. In recent years, many industries have opened the Internet+ model, which is presented to people as a new model of online video, such as online education, online live sales, news anchors, etc. The economic benefits brought by the new model are very huge. However, the shortcomings of the existing video imaging technology are gradually exposed. Taking online education as an example, the recording mode is the most common method in the field of online education. The online e...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06V40/16G06V10/82G06N3/04G06N3/08
CPCG06N3/08G06V40/161G06V40/174G06V40/171G06N3/045
Inventor 杨志景徐永宗温瑞冕李为杰李凯凌永权
Owner GUANGDONG UNIV OF TECH