Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A human mouth shape video reconstruction system and reconstruction method

A technology for reconstructing systems and mouth shapes, applied in image data processing, instruments, computing, etc., can solve the problems of limited application scope, poor portability, and high complexity

Active Publication Date: 2016-11-02
ZHEJIANG UNIV
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although such technical means can more accurately transform the human mouth shape in videos and images, its limitations are also obvious.
On the one hand, its implementation relies on a huge mouth-shapes database built in advance, requiring huge data samples and poor portability; on the other hand, the implementation of the algorithm involves a large amount of calculation and analysis, which is very complex and limit its scope of application

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A human mouth shape video reconstruction system and reconstruction method
  • A human mouth shape video reconstruction system and reconstruction method
  • A human mouth shape video reconstruction system and reconstruction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0060] Such as Figure 6 As shown, take B as the synchronization object, use the correlation inversion method to reconstruct a video of A reading a speech from a photo of the target object A as an example, and specifically illustrate the mouth shape reconstruction method of the present invention. Here, a desktop computer equipped with a camera is used as the reconstruction system, in which: the USB interface is used as the input and output port of the system, the processor is used as the processing module of the system, the camera is used as the real-time acquisition module of the system, and the monitor is used as the display module of the system.

[0061] (1) Information read-in: the system reads in the photo of A from the USB interface as the human body information to be processed, and reads in the speech document as the mouth shape information to be processed.

[0062] (2) Preprocessing: the processor recognizes the export information as a text format, and taking into acco...

Embodiment 2

[0071] Such as Figure 7 As shown, the following uses the logic correction method to correct the mouth shape of a certain segment in the video of announcer C as an example to specifically illustrate the mouth shape reconstruction method of the present invention. In this embodiment, C is the target object. Here, a smart phone is used as the reconstruction system, in which: the WIFI interface is used as the input and output ports of the system, the mobile phone processor is used as the processing module of the system, the display screen of the mobile phone is used as the display module of the system, and the storage unit of the mobile phone is used as the mouth shape base of the system. meta-module.

[0072] (1) Information reading: the system reads the video of announcer C from the WIFI interface, clips out the part to be corrected as the human body information to be processed, and reads in the voice correction content as the mouth shape information to be processed.

[0073] (...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a human body mouth shape video reconfiguration system and a corresponding method based on the annular resilient space dynamic time evolution. The method comprises the steps of information reading, preprocessing, mouth shape reconfiguration and video output and adopts a correlation inversion method and a logic correction method. By adopting the reconfiguration method and the reconfiguration system, not only can the inversion of the read mouth shape be realized on a single-frame image to generate a reconfigured human body mouth shape video, but also the correction of the read mouth shape information can be realized on the video consisting of a multiple frame images to generate a configured human body mouth shape video. Compared with the traditional mouth shape reconfiguration method and system, the method and system are accurate and high efficient, no data base is needed, and the flexibility for changing the mouth shapes can be enhanced while the space is saved. Preferably, all units of the system are integrated onto one intelligent terminal, and the intelligent terminal can be different intelligent mobile phones, flat computers (such as iPad), handheld computers, intelligent handheld game machines and the like.

Description

technical field [0001] The invention relates to the field of video image processing, in particular to a human mouth shape video reconstruction system and reconstruction method based on annular elastic space dynamics time evolution. Background technique [0002] With the development and improvement of computer technology, the modeling and animation of human face as a unique branch of computer graphics has attracted more and more attention. application. In many occasions, it is necessary to reconstruct the mouth shapes of people in existing videos or images, that is, to generate a series of mouth movements from a still image, or to correct the mouth shapes in existing videos. In order to achieve such a purpose, existing technical methods generally analyze and process a large amount of existing video image information to establish a lip-shape database, and then call relevant information from the lip-shape database for specific problems. Although such technical means can more ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/00
Inventor 孟濬黄吉羊刘琼
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com