Teaching system based on internet, facial expression recognition and speech recognition and realizing method of teaching system

A technology of speech recognition and facial expression recognition, applied in the field of teaching systems, can solve problems such as inability to do, adjust, and inability to accurately grasp the state of learners, and achieve the effect of ensuring authenticity and reducing traffic

Active Publication Date: 2017-09-26
深圳极速汉语网络教育有限公司
View PDF12 Cites 54 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The analysis of user behavior by existing teaching software is still very primitive, and it is all based on the operation ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Teaching system based on internet, facial expression recognition and speech recognition and realizing method of teaching system
  • Teaching system based on internet, facial expression recognition and speech recognition and realizing method of teaching system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0051] Such as figure 1 As shown, a teaching system based on the Internet, expression recognition and voice recognition, including a cloud platform, a first terminal, a second terminal, an analysis processor, and a main control processor;

[0052] The cloud platform is used to download the teaching courses corresponding to the user identity from the cloud platform to the content presentation module, and save the user information to the database;

[0053] The first terminal includes the following modules;

[0054] The content presentation module presents the contents of the downloaded teaching courses and the user's three-dimensional avatar to the user;

[0055] The audio playback module plays the recording of the teaching course and the user's voice;

[0056] The video information collection module collects the user's video data information when the teaching course is played;

[0057] The voice information collection module collects the user's voice data information when th...

Embodiment 2

[0065] Such as figure 2 As shown, a method for realizing a teaching system based on the Internet, expression recognition and speech recognition includes the following steps:

[0066] In the first step, the first terminal plays the content of the teaching course.

[0067] Users can search for online teaching courses based on age, gender, location, language ability, interest, teaching level, course pricing, course content, and teaching time, and the system will automatically match the teaching courses for playback.

[0068] In the second step, during playback, the video information collection module collects the user's video data information, the voice information collection module collects the user's voice data information, and the user input module collects user operations.

[0069] Wherein, the collected video data information includes the user's gender, age, race and facial expression information; the collected audio data information includes sound waves and voiceprints. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a teaching system based on an internet, facial expression recognition and speech recognition and a realizing method of the teaching system. The realizing method comprises the following steps: S1, playing contents of teaching courses by a first terminal; S2, acquiring video data information, speech data information of a user and user operation in the playing process; S3, transmitting the information and the user operation to a main control processor; S4, extracting facial features and pronunciation features of the user into an analysis processor by the main control processor; S5, respectively comparing the facial features and the pronunciation features with standard templates by the analysis processor; S6, dynamically adjusting the played contents of the teaching courses or/and teaching procedures by the main control processor according to current operation of the user and feedback of the analysis processor, or transmitting a comparison result to a second terminal by a cloud platform in real time. The teaching system disclosed by the invention is teaching software with the characteristics of mobility, entertainment, sociability and the like and can provide a chance for students to study independently outside class at any time and any place; by means of an online teaching mode for assisting real persons, a traditional mode for teaching Chinese as a foreign language is improved.

Description

technical field [0001] The invention relates to a teaching system based on the Internet, facial expression recognition and voice recognition and its realization method. belongs to the field of teaching. Background technique [0002] Although online learning is becoming more and more popular, the monitoring of learning status and effects is an important part of improving teaching quality. Only by fully understanding students' learning reactions can we ensure high-quality teaching. The analysis of user behavior by existing teaching software is still very primitive, and it is all based on the operation of the interface. This method cannot accurately grasp the status of learners, and cannot achieve effective and timely adjustments. Therefore, how to use facial expression recognition technology and speech recognition technology to accurately sample and intelligently analyze and evaluate the user's learning process is a topic worthy of research and development. Contents of the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06Q50/20G06K9/00G10L15/02H04L29/08
CPCH04L67/02G06Q50/205G10L15/02G06V40/174
Inventor 卢旭峰
Owner 深圳极速汉语网络教育有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap