Man-machine interaction method and system for online education based on artificial intelligence

A human-computer interaction and artificial intelligence technology, applied in the field of electronic information, can solve problems such as different mastery of knowledge points, no patent reports on interactive online education methods and systems, and difficulty in meeting the individualization of audiences.

Pending Publication Date: 2018-04-24
JILIN UNIV
View PDF7 Cites 53 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, some problems also appeared in the process of development: due to the limitation of the virtual world, the interaction between the audience and the teacher is not good; Meet the individual needs of the audience
[0005

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Man-machine interaction method and system for online education based on artificial intelligence
  • Man-machine interaction method and system for online education based on artificial intelligence
  • Man-machine interaction method and system for online education based on artificial intelligence

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028]Locate the user's face position from the video image collected in real time, and perform image preprocessing. First, the real-time video is processed frame by frame, and the face positioning algorithm is called for each frame to determine the position of the face, and then the preprocessing work such as adjusting the size and depth of the face image is performed to adapt to the input requirements of emotion recognition.

[0029] Emotion recognition subsystems (such as figure 1 (shown in the emotion recognition subsystem part) can be summarized into five parts: convolutional neural network to extract image features, recurrent neural network to model temporal features, audio module to process audio information, AggregatedCNN for rough classification, fusion network to combine different types feature fusion. The emotion recognition subsystem divides emotions into seven categories: anger, disgust, fear, happiness, sadness, surprise and neutrality.

[0030] Next, several pa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a man-machine interaction method and system for online education based on artificial intelligence, and relates to the digitalized visual and acoustic technology in the field ofelectronic information. The system comprises a subsystem which can recognize the emotion of an audience and an intelligent session subsystem. Particularly, the two subsystems are combined with an online education system, thereby achieving the better presentation of the personalized teaching contents for the audience. The system starts from the improvement of the man-machine interaction vividnessof the online education. The emotion recognition subsystem judges the learning state of a user through the expression of the user when the user watches a video, and then the intelligent session subsystem carries out the machine Q&A interaction. The emotion recognition subsystem finally classifies the emotions of the audiences into seven types: angry, aversion, fear, sadness, surprise, neutrality,and happiness. The intelligent session subsystem will adjust the corresponding course content according to different emotions, and carry out the machine Q&A interaction, thereby achieving a purpose ofenabling the teacher-student interaction and feedback in the conventional class to be presented in an online mode, and enabling the online class to be more personalized.

Description

technical field [0001] The invention relates to a digital audio-visual technology in the field of electronic information, including a subsystem capable of recognizing the emotions of the audience and an intelligent conversation subsystem, especially combining the two with an online education system, which can better present personalized information to the audience teaching content. Background technique [0002] Online education (also known as e-Learning) is a method of disseminating and sharing course content and learning quickly through the application of information technology and Internet technology. The teaching method of online education uses the network as the medium, and users and teachers can carry out teaching activities through the network even if they are thousands of miles apart; in addition, with the help of network courseware, users can also study anytime and anywhere, which truly breaks the constraints of time and space. Network distance education It is the m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06Q50/20G06N3/04G06K9/00G06F17/30G10L15/26G10L15/06G10L13/02G09B5/08
CPCG06F16/3329G06Q50/205G10L13/02G10L15/063G10L15/26G10L2015/0638G06V40/174G06N3/045
Inventor 吴春国张怡美石一锐
Owner JILIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap