Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Expression recognition method, device and equipment for character in video and storage medium

A technology in expression recognition and video, applied in character and pattern recognition, acquisition/recognition of facial features, instruments, etc., can solve problems such as inability to stream media data tagging

Active Publication Date: 2020-10-30
HUAQIAO UNIVERSITY
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The present invention provides a method, device, equipment and storage medium for facial expression recognition of characters in a video, so as to improve the problem in the related art that the streaming media data cannot be marked efficiently

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Expression recognition method, device and equipment for character in video and storage medium
  • Expression recognition method, device and equipment for character in video and storage medium
  • Expression recognition method, device and equipment for character in video and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0118] see figure 1 , an embodiment of the present invention provides a method for recognizing facial expressions of characters in a video, which can be executed by a device for recognizing facial expressions of characters in a video (hereinafter referred to as an facial expression recognition device), in particular, executed by at least one processor in the facial expression recognition device , to at least implement the following steps:

[0119] S101. Acquire multiple first images from a video to be processed.

[0120] In this embodiment, the video to be processed is a video with a character image, which may be a video recorded with a real person, or an animation streaming media with a character image, which is not specifically limited in the present invention. Among them, the expressions of characters in animation streaming media are often more exaggerated than those of real people, so they are easier to be recognized.

[0121] The first image is a specific frame on the v...

Embodiment 2

[0210] see figure 2 , the second embodiment of the present invention provides an expression recognition device for characters in a video, which includes:

[0211] The first image acquisition module 201 is configured to acquire a plurality of first images from the video to be processed;

[0212] a grayscale module 202, configured to grayscale the first image to obtain a second image;

[0213] The face detection module 203 is used to obtain the face area on the second image through the face detection model;

[0214] A frontal face screening module 204, configured to filter out a third image containing a frontal face from a plurality of second images according to the face area;

[0215] The face recognition module 205 is used to obtain the character information corresponding to the face area of ​​the third image through the face recognition module 205;

[0216] The expression recognition module 206 is configured to acquire expression information corresponding to the person in...

Embodiment 3

[0258] The third embodiment of the present invention provides a device for facial expression recognition of characters in a video, including a processor, a memory, and a computer program stored in the memory, and the computer program can be executed by the processor to implement the above-mentioned embodiment The facial expression recognition method of the characters in the video.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides an expression recognition method, device and equipment for characters in a video and a storage medium, and relates to the technical field of video content analysis. The method comprises the steps: obtaining a plurality of first images from a to-be-processed video; graying the first image to obtain a second image; obtaining a face area on the second image through a face detection model; screening out a third image containing a front face from a plurality of second images according to the face area; obtaining figure information corresponding to a face area of the third image through a face recognition model; and obtaining expression information corresponding to the figure information of the third image through an expression recognition model. The method greatly improves the efficiency of video analysis and video marking in the prior art, is stable and reliable, is not affected by human factors, and has good practical significance.

Description

technical field [0001] The present invention relates to the technical field of video content analysis, in particular to a method, device, device and storage medium for facial expression recognition of characters in a video. Background technique [0002] With the advent of the era of great Internet development, the total amount of video streaming media data continues to expand, and the streaming media market is developing in the direction of integrating resources and optimizing output effects with high quality. Streaming media contains a lot of important information, but the current level of data mining of video streams is only the tip of the iceberg. [0003] Among them, the changes in the expressions of the characters can reflect the overall plot trend of the video. If the video streaming information is fully excavated and effectively marked, it will help the development of video streaming industries such as movies and self-media and bring broad market prospects. In partic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/32G06K9/46
CPCG06V40/176G06V40/161G06V40/174G06V20/40G06V10/25G06V10/56Y02D10/00
Inventor 贺惠新范帅迪崔子栋
Owner HUAQIAO UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com