A Portable Multimodal Learning Analysis Smart Glasses

Abstract

The invention discloses a portable multi-modal learning analysis smart glasses, which can monitor, analyze and feed back multi-modal data including indicators such as expression, voice, physiology, eyeball and head movement in real time during the learner's learning process and Data Analysis Results. The chip of the smart glasses integrates real-time data monitoring function, multi-modal data analysis function and data visualization function. The data monitoring function obtains the changes of facial expressions, voice, physiology, eyeball movement and head movement of learners in real time during the learning process; the multimodal data analysis function stores the real-time acquired data into the preset data structure for multimodal Dynamic learning analysis; the data visualization function displays the processing results of data analysis to learners in the form of visual graphics. The invention captures the multimodal data generated during the learning process of learners and users in real time through portable smart glasses, automatically analyzes the multimodal data, and visually displays the data analysis results.

Description

technical field [0001] The invention relates to the technical field of online education, in particular to a portable multimodal learning analysis smart glasses. Background technique [0002] Learning analytics—an emerging subfield within pedagogy—has had a major impact on computer-supported learning and teaching. Learning analytics is the measurement, collection, analysis and reporting of data on learners and their learning environment; its purpose is to better understand and optimize the learning process and learning environment. Among them, the research and application of multimodal learning analysis is one of the important branches in the field of learning analysis. Multimodal learning analysis needs to use various analysis methods and technical means to collect, analyze and mine multimodal data (such as physiological indicators, voice, micro-expressions, etc.) Report to users to help users understand and master learning-related information. The development and applica...

AI Technical Summary

Problems solved by technology

The multi-modal portable device can solve the existing problems in the field of education, such as the lag in the analysis and presentation of learning analysis results, the inability to present the learning status and learning process in multiple dimensions, and the difficulty for students to interpret the learning analysis results from multiple angles and guide their next learning.

Images