Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A system and method for automatically playing music based on target facial expression collection

A technology of facial expression and automatic playback, which is applied in the field of daily entertainment, can solve problems such as not being able to automatically play music, and achieve the effect of simple requirements and high portability

Active Publication Date: 2020-07-28
ZHEJIANG UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Today's music players can only recommend music based on the user's historical records, but cannot automatically play music based on the user's real-time psychological changes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A system and method for automatically playing music based on target facial expression collection
  • A system and method for automatically playing music based on target facial expression collection
  • A system and method for automatically playing music based on target facial expression collection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0093] The following uses a system consisting of a movable camera and a notebook computer to collect the facial emotions of a student who uses listening to music to relieve tension as an example to illustrate the method of collecting facial emotions and the automatic music playback system.

[0094] (1) Video acquisition: the acquisition unit obtains the continuous and complete video information of the user’s observed part under the control of the processing unit, and then transmits it to the processing unit; specifically, when the student is within the range of camera acquisition, the laptop computer passes The image recognition algorithm locks on the student's face and controls the camera to start video collection. During the collection process, the face may be out of the collection range of the camera. At this time, the laptop sends an instruction to control the movable camera to move synchronously with the student to keep the student's face within the collection range. Afte...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a system and method for automatically playing music based on the collection of target facial expressions. The system includes a collection unit, a processing unit and a music playback unit; the collection unit is used to obtain video information of user facial emotions, and It is passed to the processing unit; the processing unit is used to control the video acquisition of the user by the acquisition unit, integrate and process the collected video information to generate a video signal, and then extract the user's emotional signal from the integrated video signal, and Pass it to the music playing unit; the music playing unit realizes the automatic playing of music according to the change of the facial expression of the user. The system and method of the invention can accurately detect the facial emotion and heart rate of the target, and intelligently play music according to the real-time psychological changes of the user, so as to give the user the best experience.

Description

technical field [0001] The invention relates to the field of daily entertainment, in particular to an automatic music playing system and method based on facial expression collection. Background technique [0002] Emotion is an important part of people's daily communication, and a person's expression reflects the person's emotion to a large extent, and these emotional information will have many practical applications. Facial expression recognition based on a series of separated static images is extremely prone to misjudgment. [0003] Paul Ekman proposed that facial expressions are common across cultures, and he found that the expressions of certain basic emotions (happiness, sadness, anger, disgust, surprise, and fear) were similar in both cultures. Therefore, he and his research partners did an in-depth study on the movement of facial muscles and their control on expressions earlier, and developed the Facial Action Coding System (FACS). [0004] Current music players ofte...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/16G06F3/01G06K9/00
CPCG06F3/011G06F3/165G06V40/174
Inventor 王思琪李东升张乾孟濬
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com