Teaching method and system based on human gestures and voice

A gesture and voice technology, applied in the field of teaching and system based on human gestures and voice, can solve problems such as difficulty in supporting teacher interaction, affecting teaching fluency and efficiency, and achieve the goal of improving teaching effect, releasing interaction constraints, and enhancing appeal. Effect

Inactive Publication Date: 2018-09-14
CHINA UNIV OF MINING & TECH
View PDF9 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Using a mouse and keyboard for control means that teachers cannot leave the teaching computer too far away, and teachers have to often move back and forth between the blackboard and the computer, which affects the smoothness and efficiency of teaching, and it is even more difficult to support teachers to interact with students in other areas of the classroom
Alth...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Teaching method and system based on human gestures and voice
  • Teaching method and system based on human gestures and voice
  • Teaching method and system based on human gestures and voice

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] Embodiment 1: The following describes a teaching method and system based on gesture and speech according to an embodiment of the present invention with reference to the accompanying drawings.

[0046] figure 1 It is a gesture recognition flow chart of a teaching method and system based on gesture and speech provided by an embodiment of the present invention. like figure 1 As shown, the gesture recognition process includes the following steps:

[0047] S101. Collect human body gestures.

[0048] When the teacher appears in the field of vision of the human body gesture collection device, the collection device starts to collect the teacher's gestures. In an embodiment of the present invention, the human body gesture collection device may be a somatosensory sensor. Specifically, when the teacher appears in the collection range of the somatosensory sensor, the somatosensory sensor collects the gesture of the teacher.

[0049] S102, extract gesture features.

[0050] Th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a teaching method and system based on human gestures and voice, and belongs to teaching methods and systems using slide teaching. The method includes the following steps of identifying teacher's gestures; performing operation instructions of the corresponding gestures according to the teacher's gestures; collecting teacher's voice; extracting keywords from the voice; comparing the extracted keywords with preset keywords; when the extracted keywords match with the preset keywords, performing operation instructions corresponding to the preset keywords. Basic components ofthe system include a gesture collection device, a voice collection device, a gesture recognition device, a voice recognition device, slide show software, a projector and a projection screen; enhancement components of the system include a class content synthesis device, a hard disk recorder, a video server, course content playback software, a browser with a video playback function and a video service client. The method and the system can be widely used in occasions such as school teaching, conference speech, exhibition venue visitor interaction and the like.

Description

technical field [0001] The invention relates to a teaching method and system using slides to give lectures, in particular to a teaching method and system based on human body gestures and voice. Background technique [0002] Education is the foundation of a country's sustainable development. Advanced teaching facilities can not only improve the fun of the teaching process, but also greatly reduce the distance between the lecturer and the lecturer, and greatly improve the teaching effect. As a widely used multimedia teaching tool, slides overcome the shortcomings of the traditional blackboard teaching method, allowing teachers to focus more on content explanations rather than blackboard writing. At the same time, they can use sound, video, pictures, animations, etc. A variety of carriers explain the key and difficult points, which greatly improves the fun and teaching effect of the classroom. [0003] When the teacher controls the page turning or jumping of the slides, he usu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06Q50/20G10L15/22G10L15/26
CPCG06F3/017G06Q50/20G10L15/22G10L15/26G10L2015/223
Inventor 胡青松张亮贾升煜程勇罗大伟杨俊伟
Owner CHINA UNIV OF MINING & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap