Head action identifying system based on myoelectricity and motion sensor

A motion sensor and motion recognition technology, applied in the field of human-computer interaction, can solve the problem of many auxiliary devices, and achieve the effect of convenient use and user-friendly experience.

Inactive Publication Date: 2017-04-19
SHANGHAI JIAO TONG UNIV +1
View PDF10 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, image processing is greatly affected by light and background conditions, and there are many related auxiliary equipment, which has great limitations in practical applications.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Head action identifying system based on myoelectricity and motion sensor
  • Head action identifying system based on myoelectricity and motion sensor
  • Head action identifying system based on myoelectricity and motion sensor

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] figure 1 A schematic diagram of a wearable device for a head-mounted human-computer interaction system in a preferred embodiment of the present invention, including an elastic frame 101 worn on the head. The elastic frame 101 uses memory materials and can be adjusted according to the size of the user's head . Inside the elastic frame 101 , there are four-channel differential EMG signal sensors 102 , 103 , 104 , 105 , a multi-axis motion sensor 106 , a heart rate sensor 107 and a communication module 108 .

[0033] When the user is in use, the wearable device of the head-mounted human-computer interaction system is worn on the head, so that the four-channel myoelectric signal sensors 102, 103, 104, and 105 are respectively placed on the right temporal muscle, right occipitofrontal muscle, and left occipitofrontal muscle. , On the four muscles of the left temporalis muscle.

[0034] like figure 2 Shown is the data processing process of the head-mounted human-computer ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a head-mounted human-machine interaction system. A head muscle surface electromyogram signal can be collected via a multi-channel surface myoelectricity sensor of a wearable device and mounted on the head; a facial action can be identified via an amplitude determination method; a head motion track can be integral-calculated via a multi-axis motion sensor of the wearable device; heart rate can be monitored via a heart rate sensor of the wearable device; and at last, a facial action identification result, the head motion track and the heart rate can be sent to an upper machine via a communication module and human-machine interaction can be realized. By the use of the system, a user can interact with external devices via natural ways, such as the facial action and the head movements; a way of interacting with the outer world is provided for paraplegia patients; besides, normal people can freely interact with the outer world without the use of hands; a user training process is unnecessary, and the user can wear the system on the head and only needs to do corresponding facial actions or head movements; and friendly user experience and convenient use can be provided.

Description

technical field [0001] The present invention relates to the field of human-computer interaction, in particular to a head movement recognition system based on myoelectricity and motion sensors, especially multi-information fusion based on myoelectricity signals, multi-axis motion sensors and heart rate sensors, which is used for facial recognition of high paraplegia patients. Action recognition, head movement trajectory tracking, and heart rate monitoring; it can also be a wearable device for normal people to interact with humans in a more natural way. Background technique [0002] High paraplegia patients generally suffer from quadriplegia and need care in daily life. Due to quadriplegia, only the head can move normally, resulting in a decline in the patient's quality of life and loss of confidence in life. [0003] Through the recognition of facial movements, such as teeth clenching, blinking, frowning and other movements, and the tracking of head movement trajectory, the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01
CPCG06F3/012G06F3/015
Inventor 朱向阳吕博郭伟超盛鑫军许可
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap