Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Real-time mask video display method based on expression recognition

An expression recognition and masking technology, applied in the acquisition/recognition of facial features, character and pattern recognition, instruments, etc., can solve the problem of limited effect of face changing, and achieve the effect of improving efficiency, reducing network bandwidth requirements, and improving efficiency.

Inactive Publication Date: 2017-05-31
康一梅
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Video chatting and live video broadcasting based on smart devices have become very common. Recently, picture chat software that adds various interesting decorations to human faces is popular among young people because of its fun. Face-changing effects are limited

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time mask video display method based on expression recognition
  • Real-time mask video display method based on expression recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The present invention will be further described through specific embodiments below in conjunction with the accompanying drawings. The specific embodiments are only used to illustrate the present invention and are not intended to limit the scope of protection of the present invention.

[0025] Expression feature library E={E 1 ,E 2 ,...,E n}, there are n kinds of expression features.

[0026] There are m mask images in the mask library, and each mask image has n kinds of expressions, so there are m×n masks in total.

[0027]

[0028] Among them, ij is M ij , i=1, 2,..., m, j=1, 2,..., n.

[0029] refer to figure 1 , in step S1, at the end S, the video sender chooses the mask M he wants to use i , initialize the S-side mask M s = M i ;

[0030] In step S2, at the S terminal, the M s The identification ID (M s )=i is sent to the receiving end R;

[0031] In step S3, at the S terminal, obtain the current frame f current , detected face f=face(f current ); ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a real-time mask video display method based on expression recognition, comprising an expression feature library, a mask library, a video sender S, and a video receiver R and also includes the steps of recognizing a facial expression in a video sent by the video sender based on the expression feature library, acquiring facial expression features of a current frame, sending the facial expression features to the video receiver, and selecting, by the video receiver, a mask meeting the facial expression features from the mask library for the purpose of displaying. Intelligent equipment with a video acquisition device is used herein to chat in real time, make live shows and make expression-drive-based animations by using masks based on users' real expressions, so that users may chat and make live shows with different masks, with video interaction interestingness improved, or may make expression-drive-based automated animations, so that animation making efficiency is improved greatly.

Description

technical field [0001] The present invention relates to using an intelligent device with a video acquisition device to perform real-time video chatting, live video broadcasting, and expression-driven animation production based on the user's real expression with a mask, so that the user can use different masks for chatting and live broadcasting. Improve the fun of video interaction; or perform expression-driven animation production, which greatly improves the efficiency of animation production. Background technique [0002] Video chatting and live video broadcasting based on smart devices have become very common. Recently, picture chat software that adds various interesting decorations to human faces is popular among young people because of its fun. Face-changing effects are limited. The present invention can replace the image of a real person with various fake faces, and synchronize the facial expressions of the real person in real time, so as to realize the social interact...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00H04N7/14
CPCH04N7/14G06V40/174
Inventor 不公告发明人
Owner 康一梅
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com