Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Automatic music playing system and method based on target facial expression acquisition

A facial expression and automatic playback technology, which is applied in the field of daily entertainment, can solve the problems of not being able to automatically play music, etc., and achieve the effect of simple requirements and high portability

Active Publication Date: 2017-09-08
ZHEJIANG UNIV
View PDF8 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Today's music players can only recommend music based on the user's historical records, but cannot automatically play music based on the user's real-time psychological changes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic music playing system and method based on target facial expression acquisition
  • Automatic music playing system and method based on target facial expression acquisition
  • Automatic music playing system and method based on target facial expression acquisition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0093] The following uses a system consisting of a movable camera and a notebook computer to collect the facial emotions of a student who uses listening to music to relieve tension as an example to illustrate the method of collecting facial emotions and the automatic music playback system.

[0094] (1) Video acquisition: the acquisition unit obtains the continuous and complete video information of the user’s observed part under the control of the processing unit, and then transmits it to the processing unit; specifically, when the student is within the range of camera acquisition, the laptop computer passes The image recognition algorithm locks on the student's face and controls the camera to start video collection. During the collection process, the face may be out of the collection range of the camera. At this time, the laptop sends an instruction to control the movable camera to move synchronously with the student to keep the student's face within the collection range. Afte...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses an automatic music playing system and method based on target facial expression acquisition. The system comprises an acquisition unit, a processing unit and a music playing unit. The acquisition unit is used for acquiring video information of facial emotion of a user, and transferring the video information to the processing unit. The processing unit is used for controlling the acquisition unit to acquire a video of the user, integrating the acquired video information to generate a video signal, and extracting an emotion signal of the user from the video signal after integration, and transferring the emotion signal to the music playing unit. The music playing unit implements automatic playing of music according to a change of facial expression of the user. According to the system and method provided by the present invention, the facial emotion and heart rate of a target can be accurately detected, and music can be played intelligently according to a real-time psychological change of the user, so as to provide the best experience for the user.

Description

technical field [0001] The invention relates to the field of daily entertainment, in particular to an automatic music playing system and method based on facial expression collection. Background technique [0002] Emotion is an important part of people's daily communication, and a person's expression reflects the person's emotion to a large extent, and these emotional information will have many practical applications. Facial expression recognition based on a series of separated static images is extremely prone to misjudgment. [0003] Paul Ekman proposed that facial expressions are common across cultures, and he found that the expressions of certain basic emotions (happiness, sadness, anger, disgust, surprise, and fear) were similar in both cultures. Therefore, he and his research partners did an in-depth study on the movement of facial muscles and their control on expressions earlier, and developed the Facial Action Coding System (FACS). [0004] Current music players ofte...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/16G06F3/01G06K9/00
CPCG06F3/011G06F3/165G06V40/174
Inventor 王思琪李东升张乾孟濬
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com