Transparent education tracking and evaluation system

Through multi-source data acquisition and deep learning models, combined with high-performance computing equipment, the problem that traditional education management systems cannot fully reflect students' learning process is solved, personalized teaching and real-time feedback are achieved, teaching effect and student experience are improved, and teaching effect and student experience are ensured. Data security.

CN118917719AInactive Publication Date: 2024-11-08TOURISM COLLEGE OF ZHEJIANG +1
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202410940938.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-15
Publication Date
2024-11-08
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The traditional education management system relies on teachers' subjective judgments and limited student performance data, cannot fully reflect students' learning process, lack real-time and personalization, low communication efficiency, and difficult to dynamically adjust teaching plans and provide personalized suggestions.

Method used

Using multi-source data acquisition and deep learning models, students' interaction and learning data are collected through panoramic cameras, microphone arrays, pressure and motion sensors, combined with high-performance computing devices and deep learning models for data analysis, generate detailed learning reports, and support natural language Communication and emotion analysis, dynamic adjustment of teaching plans, and provide personalized resources and learning suggestions.

Benefits of technology

It realizes comprehensive monitoring and evaluation of students' learning process, improves teaching effect and student learning experience, provides personalized teaching resources and real-time feedback, enhances teacher-student interaction, and ensures data security and transparency of the teaching process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118917719A_ABST
    Figure CN118917719A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of education, in particular to a transparent education tracking and evaluation system. According to the system, through a multi-source data acquisition and processing technology, a deep learning model and a high-performance computing device are utilized to realize comprehensive monitoring and evaluation of the learning process of students, and the teaching effect and the learning experience of the students are improved. The system comprises a data collection unit, a data processing unit, a self-adaptive teaching module, an interactive communication unit, a report generation unit, a safety management unit and a tracking and monitoring unit. The data collection unit collects interaction and learning data of students through a panoramic camera, a microphone array, a pressure sensor and a motion sensor. The data processing unit processes and analyzes the collected data by using a deep learning model to generate a comprehensive report of student behaviors and learning efficiency; the self-adaptive teaching module adjusts teaching plans and resources according to real-time performance and historical learning data of students, and provides personalized teaching videos, tests and interactive exercises. The interactive communication unit supports natural language communication and sentiment analysis and enhances teacher-student interaction; the report generation unit generates a detailed learning report by using a data analysis tool; the security management unit ensures the security of the data; and the tracking and monitoring system is used for monitoring positions and learning activities of the students in real time. According to the technical scheme, intelligence, scientization and high efficiency of education management are realized, and the teaching effect and the learning experience of students are remarkably improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of educational technology, and specifically to a transparent education tracking and evaluation system. The system uses multi-source data collection and processing technology, deep learning models and high-performance computing equipment to achieve comprehensive monitoring and evaluation of students' learning process, aiming to improve teaching effectiveness and students' learning experience. Background Art

[0002] Disadvantages of existing technology

[0003] At present, traditional education management systems mainly rely on teachers' subjective judgment and limited student performance data to evaluate students' learning performance. However, this approach has the following problems:

[0004] 1. Data uniformity: Traditional systems rely only on test scores and homework completion, and cannot fully reflect students’ interactions and learning process in class.

[0005] 2. Poor real-time performance: It is difficult for teachers to grasp students’ learning status and behavioral performance in a timely manner, and they are unable to adjust teaching plans based on students’ real-time feedback.

[0006] 3. Lack of personalization: Traditional systems find it difficult to provide personalized learning suggestions and resource recommendations for each student, resulting in limited teaching effectiveness.

[0007] 4. Limited communication: Communication between teachers and students mainly relies on face-to-face interaction, and it is impossible to fully utilize modern technology to improve communication efficiency and effectiveness.

[0008] Related patent technologies

[0009] In recent years, some technologies have attempted to improve education management systems through smart devices and data analysis. For example, Chinese patent CN108829702A discloses a smart campus system based on the Internet of Things, which uses sensors and Internet of Things technology to achieve intelligent management of personnel and equipment on campus. Although this system has improved the level of intelligent campus management to a certain extent, it mainly focuses on the management of hardware equipment and fails to deeply mine students' learning data for educational evaluation.

[0010] Another example is US Patent US20180324511A1, which introduces a method of using artificial intelligence for educational assessment, which can generate personalized learning suggestions based on students' behavioral data and learning records. However, the implementation of this system requires a large amount of manually labeled data, and has weak support for real-time performance, making it difficult to meet the needs of dynamically adjusting teaching plans.

[0011] Related academic research

[0012] In terms of academic research, many researchers are committed to using big data and artificial intelligence technologies to improve the accuracy and effectiveness of educational assessment. For example, Smith et al. pointed out in their paper "Educational Data Mining: A Review of the State of the Art" that educational data mining (EDM) technology can identify key factors that affect learning outcomes by analyzing students' behavioral data, thereby providing a basis for personalized teaching.

[0013] In addition, Jones et al.'s study "Real-time Student Monitoring and Adaptive Learning" proposed a real-time student monitoring and adaptive learning system that can dynamically adjust teaching content based on students' real-time performance. Although these studies have theoretically proved the feasibility of intelligent education evaluation systems, in practical applications, they still face challenges in data security, system integration, and actual effects.

[0014] Innovation of the present invention

[0015] In order to overcome the deficiencies in existing technologies and research, the present invention proposes a transparent education tracking and evaluation system. The system integrates a variety of sensors and data processing technologies, and comprehensively analyzes students' interaction and learning data through high-performance computing devices and deep learning models. The system can generate detailed student behavior and learning efficiency reports, support natural language communication and sentiment analysis, provide personalized teaching resources and learning suggestions, dynamically adjust teaching plans, and improve teaching effects and student learning experience. In addition, the security management unit and tracking monitoring system ensure the security of data and the transparency of the teaching process. Summary of the invention

[0016] Purpose of the Invention

[0017] The purpose of this invention is to provide a transparent education tracking and evaluation system, which, through multi-source data acquisition and processing technology, utilizes high-performance computing equipment and deep learning models to achieve comprehensive monitoring and evaluation of students' learning process, thereby improving teaching effectiveness and students' learning experience.

[0018] Technical Solution

[0019] To achieve the above-mentioned purpose of the invention, the present invention proposes a transparent education tracking and evaluation system, which includes a data collection unit, a data processing unit, an adaptive teaching module, an interactive communication unit, a report generation unit, a security management unit and a tracking and monitoring unit.

[0020] Data collection unit

[0021] The data collection unit collects students’ interaction and learning data through a variety of sensors, including:

[0022] 1. Panoramic camera: 4K panoramic cameras installed in the four corners of the classroom are used to capture student interactions from a panoramic perspective. The camera is installed at a height of 2.5 meters to ensure that the entire classroom is covered. The camera is connected to the switch in the classroom via an RJ45 network cable and is configured using H.265 encoding technology to reduce bandwidth usage while ensuring high-definition image quality.

[0023] 2. Microphone array: A microphone array with directional sensing is used to clearly capture students' speeches and classroom discussions. Each microphone array contains 8 microphone units, arranged to pick up sound in all directions at 360 degrees, connected to the data processing server via a USB interface, and installed with a customized driver, enabling built-in noise reduction and echo cancellation algorithms to ensure recording quality.

[0024] 3. Pressure and motion sensors: Pressure sensors and motion sensors installed on each student seat are used to monitor students' physical activities and posture changes. The pressure sensor is installed under the student's seat and uses capacitive measurement technology with a sensitivity of 0.1 kg; the motion sensor is installed on the seat back and uses a combination of accelerometer and gyroscope to detect students' posture changes in real time. The sensor data is transmitted to the central receiver in the classroom via Bluetooth 5.0 protocol, and then transmitted to the data processing server via Wi-Fi.

[0025] Data processing unit

[0026] The data processing unit uses high-performance computing equipment and deep learning models to process and analyze the collected data, including:

[0027] 1. Data processing server: The data processing server is equipped with NVIDIA A100 GPU, uses dual-core Intel Xeon processors, is equipped with 512GB memory, and is installed with 8 NVIDIA A100 GPUs, each with 40GB video memory. The server is installed in a standard 42U cabinet and connected to the campus network via Gigabit Ethernet.

[0028] 2. Deep learning model: A custom deep learning model written in Python is optimized with TensorFlow and PyTorch frameworks. The data preprocessing module uses NumPy and Pandas libraries for data cleaning and format conversion. Design the convolutional neural network (CNN) model structure, including the input layer, convolution layer, activation layer, pooling layer, fully connected layer, and output layer; design the long short-term memory network (LSTM) model structure, including the input layer, LSTM layer, fully connected layer, and output layer. Use TensorFlow's distributed training strategy to speed up model training, and use cross-validation and hyperparameter tuning techniques for model evaluation and optimization.

[0029] 3. Data processing: The processed video, audio and sensor data are used to generate comprehensive reports on student behavior and learning efficiency. The OpenCV library is used to parse video data and extract key frames and motion features; the Librosa library is used to analyze audio data and extract voice features and emotional information; the SciPy library is used to process sensor data and analyze student physical activity and posture changes. All data are integrated into the comprehensive report generation module to generate charts and text descriptions, which are then presented to teachers and students through the web interface.

[0030] Adaptive teaching module

[0031] The adaptive teaching module adjusts teaching plans and resources based on students' real-time performance and historical learning data, including:

[0032] 1. Integrate the API interfaces of multiple online learning platforms to automatically pull the latest educational resources and materials. The system integrates the API interfaces of Coursera, edX, Khan Academy and other platforms to regularly synchronize the latest courses and teaching materials. The data synchronization module runs automatically every 24 hours to ensure the timely update of teaching resources and store the synchronized data in the local database, including course videos, handouts, exercises and answer analysis.

[0033] 2. Adjust teaching plans and resources based on students' real-time performance and historical learning data, and use collaborative filtering and content recommendation algorithms to adjust teaching content according to students' learning interests and grades. Using real-time performance data (class participation, test scores, and homework completion) and historical data (learning records and test scores) for analysis, the teaching plan adjustment module generates new teaching plans every week and recommends personalized learning paths and resources.

[0034] 3. Built-in recommendation engine, using machine learning algorithms to predict students' learning needs, automatically recommending personalized teaching videos, quizzes and interactive exercises. The recommendation engine is trained with XGBoost and LightGBM models, combined with students' learning behavior data, and pushes the recommendation results to the students' learning interface in real time through the API interface. Students can provide feedback on the recommendation results, and the system continuously optimizes the recommendation model based on the feedback data.

[0035] Interactive Communication Unit

[0036] The interactive communication unit supports natural language communication and sentiment analysis to enhance teacher-student interaction, including:

[0037] 1. Integrate speech recognition and speech synthesis technology to understand and respond to natural language queries. The speech recognition module uses Google

[0038] The Speech-to-Text API supports speech recognition in multiple languages; the speech synthesis module uses the Amazon Polly API to generate natural and fluent speech responses based on text. The system supports real-time voice conversations, and students can ask questions directly to the system through the microphone, and the system will respond immediately.

[0039] 2. Adjust the tone and content of the response to match the student's emotional state through sentiment analysis algorithms. The sentiment analysis module uses the BERT model to analyze the student's emotional state in combination with their voice and expression data. Based on the sentiment analysis results, the system adjusts the tone and content of the voice response, such as providing encouragement and comfort when the student is feeling down. The sentiment analysis results are stored in the student's personal profile, which teachers can view and refer to at any time.

[0040] 3. Support video conferencing function, allowing teachers and students to have face-to-face virtual interactions, enhancing the interactive experience of distance education. The video conferencing module uses WebRTC technology and supports multi-party video calls and screen sharing functions. Teachers can conduct remote teaching, answer questions and provide tutoring through video conferencing functions, and students can join the meeting and interact at any time. The system supports recording and playback of video conferences, and students can review and refer to them after class.

[0041] Report generation unit

[0042] The Report Generation Unit uses data analysis tools to generate detailed study reports, including:

[0043] 1. Use SAS and R languages ​​for data processing and analysis. The data analysis module uses SAS for large-scale data processing to generate detailed statistical reports and charts; uses R language for data visualization to generate intuitive learning progress charts and knowledge mastery depth analysis. Data analysis algorithms include regression analysis, cluster analysis, and association analysis.

[0044] 2. The generated reports include detailed learning progress charts, knowledge mastery depth analysis and future learning suggestions. The learning progress chart shows the student's learning status in different courses and knowledge points, including learning time, completion rate and score; the knowledge mastery depth analysis evaluates the student's mastery of each knowledge point based on the student's test and exam scores, and generates radar charts and heat maps; the future learning suggestion module combines the student's learning performance and interests to recommend suitable learning resources and plans to help students improve their learning effects.

[0045] 3. The report can be viewed in real time in the web interface, or exported as a PDF or Excel file, which is convenient for teachers and parents to download and print. The web interface uses HTML5 and JavaScript technology to provide interactive data display and analysis tools; the report generation module supports exporting analysis results as PDF or Excel files, with beautiful format and detailed content, which is easy to save and share; teachers and parents can log in through the system account to view and download students' learning reports at any time.

[0046] Security Management Unit

[0047] The security management unit ensures data security, including:

[0048] 1. All data transmission uses SSL / TLS encryption technology. The data transmission module uses the OpenSSL library to ensure the encryption and decryption of all data during transmission; SSL / TLS certificates are issued by a trusted certificate authority (CA) to ensure the security and reliability of communications; the system regularly updates SSL / TLS certificates to prevent security risks caused by expired certificates.

[0049] 2. The system database adopts an encrypted storage solution and uses MongoDB's encrypted storage engine to ensure the security of stored data. Database encryption uses the AES-256 algorithm to ensure the confidentiality and integrity of stored data; the MongoDB encrypted storage engine supports transparent encryption, and all data is automatically encrypted and decrypted when written and read; database access control is strictly restricted, and only authorized users and applications can access sensitive data.

[0050] 3. Regularly and automatically updated anti-virus and anti-malware systems, as well as a comprehensive access control system, ensure the security of data access through multi-factor authentication and dynamic permission allocation. The anti-virus and anti-malware systems use enterprise-level solutions to regularly scan and update virus databases; the access control system uses the RBAC (role-based access control) model, with different roles having different permissions to ensure the security of data access; multi-factor authentication includes passwords, SMS verification codes, and biometrics (such as fingerprint or face recognition) to improve the security and protection capabilities of the system.

[0051] Tracking and monitoring systems

[0052] Tracking and monitoring systems are used to monitor students’ location and learning activities in real time, including:

[0053] 1. Integrate GPS and Wi-Fi positioning technology to monitor students' physical location in real time. The GPS module uses a high-precision positioning chip to obtain students' location information in real time, with a positioning accuracy of less than 3 meters; the Wi-Fi positioning module assists in improving indoor positioning accuracy by analyzing the signal strength and MAC address of nearby Wi-Fi hotspots; the positioning data is transmitted to the system server through an encrypted protocol to ensure the security of students' location privacy.

[0054] 2. The system can identify whether students are in the classroom or designated learning area, as well as their attendance. The system determines whether students arrive and leave on time by comparing their real-time location with the location of the classroom or designated learning area; the attendance management module records students' attendance, including arrival time, departure time and absence records, and generates attendance reports; teachers can view students' attendance in real time through the web interface and make necessary reminders and management.

[0055] 3. Analyze students' mobile device usage and monitor the time allocation of learning activities to ensure students' learning efficiency. The mobile device monitoring module analyzes students' device usage logs to record usage time, application type and usage frequency; the learning activity analysis module evaluates students' time allocation on different learning tasks based on device usage data and generates a learning efficiency report; the system provides learning time management suggestions to help students arrange their learning time reasonably and improve their learning efficiency.

[0056] Beneficial Effects

[0057] The present invention realizes comprehensive monitoring and evaluation of students' learning process through a transparent education tracking and evaluation system, which has the following beneficial effects:

[0058] 1. Comprehensiveness of data: This system uses a variety of sensors, such as panoramic cameras, microphone arrays, pressure and motion sensors, to comprehensively collect students’ interaction and learning data in the classroom. These multi-source data can truly and comprehensively reflect students’ learning behaviors and status, overcoming the defects of single data in traditional education management systems.

[0059] 2. Real-time monitoring and feedback: This system can monitor students’ learning status and behavior in real time, and process and analyze data in real time through high-performance computing equipment and deep learning models. Teachers can understand students’ learning status in a timely manner based on the real-time reports generated by the system, and dynamically adjust teaching plans based on feedback to improve the timeliness and effectiveness of teaching.

[0060] 3. Personalized teaching: The system's built-in adaptive teaching module and recommendation engine can provide personalized teaching resources and learning suggestions based on students' real-time performance and historical learning data. Through collaborative filtering and content recommendation algorithms, the system can accurately identify students' learning needs, recommend appropriate learning content and paths, and improve learning outcomes.

[0061] 4. Enhanced interactivity: The interactive communication unit supports natural language communication and sentiment analysis, can understand and respond to students' natural language queries, and enhance the interaction between teachers and students. Through speech recognition and speech synthesis technology, the system can achieve real-time voice dialogue; the sentiment analysis module can adjust the response content according to the emotional state of the students, and improve the emotional and human level of interaction.

[0062] 5. Comprehensive learning assessment: The report generation unit uses data analysis tools such as SAS and R language to generate detailed learning progress charts, knowledge mastery in-depth analysis and future learning suggestions. Through a variety of data analysis algorithms, such as regression analysis, cluster analysis and association analysis, the system can provide scientific and comprehensive learning assessment reports to provide strong decision-making support for teachers and students.

[0063] 6. Data security and privacy protection: The system uses SSL / TLS encryption technology to ensure the security of data transmission and MongoDB's encrypted storage engine to ensure the security of data storage. Multi-layer firewalls and intrusion detection systems, regularly updated anti-virus and anti-malware systems, and comprehensive access control systems with multi-factor authentication and dynamic permission allocation jointly build a highly secure data management environment to protect the privacy and security of student data.

[0064] 7. Efficient attendance management and learning activity monitoring: The system integrates GPS and Wi-Fi positioning technology, which can monitor students' physical location and attendance in real time and automatically generate attendance reports. By analyzing the use of students' mobile devices, the system can monitor the time allocation of learning activities, provide learning time management suggestions, help students arrange their study time reasonably, and improve learning efficiency.

[0065] In summary, the transparent education tracking and evaluation system of the present invention realizes the intelligent, scientific and efficient education management through comprehensive data collection, real-time monitoring and feedback, personalized teaching resource recommendations, enhanced teacher-student interaction, scientific learning evaluation and high data security protection, and significantly improves the teaching effect and students' learning experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] Figure 1 :Overall architecture diagram of transparent education tracking and evaluation system

[0067] The figure shows the overall architecture of the system, which includes a data collection unit, a data processing unit, a dynamic adaptive teaching module, an interactive communication unit, a report generation unit, a security management unit, and a tracking and monitoring unit.

[0068] Figure 2 :Schematic diagram of the composition and installation location of the data collection unit

[0069] The diagram shows the composition of the data collection unit and its installation location in the classroom, including the arrangement of the 4K panoramic camera, microphone array, pressure sensor and motion sensor.

[0070] Figure 3 :Hardware architecture diagram of data processing unit

[0071] The figure shows the hardware composition of the data processing unit, including components such as servers, processors, memory, and GPUs.

[0072] Figure 4 : Deep learning model structure diagram

[0073] This figure shows the deep learning model structure used in the data processing unit, including the detailed structure of the convolutional neural network (CNN) and the long short-term memory network (LSTM).

[0074] Figure 5 :Workflow diagram of the comprehensive report generation module

[0075] The figure shows the workflow of the comprehensive report generation module, including data collection, data processing, analysis, and report generation and presentation.

[0076] Figure 6 :Interactive communication unit architecture diagram

[0077] The figure shows the composition of the interactive communication unit, including the speech recognition module, speech synthesis module and sentiment analysis module.

[0078] Figure 7 : Security management unit architecture diagram

[0079] The diagram shows the composition and workflow of the security management unit, including data transmission encryption, database encryption storage, and access control.

[0080] Figure 8 :Tracking and monitoring system architecture diagram

[0081] The figure shows the composition of the tracking and monitoring system, including the GPS positioning module, Wi-Fi positioning module and attendance management module. Example

[0082] Example 1: Installation and configuration of data collection unit

[0083] Panoramic camera installation

[0084] 1. Determine the four corners of the classroom as the installation locations for panoramic cameras. Each camera should be installed at a height of 2.5 meters to ensure that the viewing angle covers the entire classroom.

[0085] 2. Use an electric drill to drill holes on the walls at the four corners, install the fixed brackets, and ensure that the brackets are stable.

[0086] 3. Fix the 4K panoramic camera on the bracket and use a level to adjust the angle to ensure that the viewing angle covers the entire classroom.

[0087] 4. Use a high-quality RJ45 network cable to connect the camera to the switch in the classroom to ensure stable transmission of the video stream.

[0088] 5. Set H.265 encoding technology in the camera configuration interface to reduce bandwidth usage while ensuring high-definition image quality.

[0089] 6. Test camera connections and video quality to ensure all cameras are working properly.

[0090] Microphone array configuration

[0091] 1. Select the central area of ​​the classroom as the installation location for the microphone array, ensuring that it is arranged to pick up sound in all directions at 360 degrees.

[0092] 2. Use an electric drill to drill holes at the selected locations and install the microphone array bracket.

[0093] 3. Fix the microphone array on the bracket and connect it to the data processing server via USB cable, ensuring a stable connection.

[0094] 4. Install the customized microphone driver on the server to ensure that the device is recognized normally.

[0095] 5. Enable the built-in noise reduction and echo cancellation algorithms in the driver configuration interface to ensure clear recording quality.

[0096] 6. Perform a recording test to ensure that the microphone array can clearly capture sounds from all directions.

[0097] Pressure and Motion Sensor Installation

[0098] 1. Select an appropriate location under each student's seat to install a pressure sensor, using capacitive measurement technology and setting the sensitivity to 0.1 kg.

[0099] 2. Use strong double-sided tape to stick the pressure sensor under the seat to ensure that the sensor is stable and not easy to fall off.

[0100] 3. Arrange the sensor cables and connect them to the data transmission module.

[0101] 4. Install a motion sensor at an appropriate location on the seat back, using a combination of an accelerometer and gyroscope to detect students' posture changes in real time.

[0102] 5. Use strong double-sided tape to stick the motion sensor to the seat back and make sure the cable is neatly connected to the data transmission module.

[0103] 6. Transmit sensor data to a central receiver in the classroom via Bluetooth 5.0 protocol, and then transmit to a data processing server via Wi-Fi.

[0104] 7. Test the connection and data transmission of all sensors to ensure accurate data collection.

[0105] Example 2: Configuration and operation of data processing unit

[0106] Data processing server configuration

[0107] 1. Select a location for a standard 42U cabinet and ensure that the cabinet is securely installed in the data center.

[0108] 2. Install the server components with dual-socket Intel Xeon processors and 512GB of memory in the cabinet.

[0109] 3. Insert and secure 8 NVIDIA A100 GPUs, each with 40GB of video memory, and ensure that the GPUs are properly connected to the motherboard.

[0110] 4. Connect the server power cord and network cable, and connect the server to the campus network via Gigabit Ethernet.

[0111] 5. Start the server and enter the BIOS setup to ensure that all components are recognized normally.

[0112] 6. Install the Linux operating system and perform basic configuration.

[0113] 7. Install necessary drivers and CUDA toolkit to ensure that the GPU can work properly.

[0114] 8. Install TensorFlow and PyTorch frameworks and test the environment configuration to ensure the normal operation of the deep learning framework.

[0115] Deep learning model development

[0116] 1. Use Python to write custom deep learning models and install dependent libraries such as NumPy, Pandas, TensorFlow, and PyTorch.

[0117] 2. Use NumPy and Pandas libraries for data cleaning and format conversion in the data preprocessing module.

[0118] 3. Design the convolutional neural network (CNN) model structure, including input layer, convolution layer, activation layer, pooling layer, fully connected layer and output layer.

[0119] 4. Design the long short-term memory network (LSTM) model structure, including the input layer, LSTM layer, fully connected layer and output layer.

[0120] 5. Use TensorFlow's distributed training strategy to speed up model training, and use cross-validation and hyperparameter tuning techniques to evaluate and optimize the model.

[0121] Data processing and analysis

[0122] 1. Parse video data through the OpenCV library to extract key frames and motion features.

[0123] 2. Analyze audio data through the Librosa library to extract speech features and emotional information.

[0124] 3. Process sensor data through the SciPy library to analyze students’ physical activities and posture changes.

[0125] 4. Integrate all data into the comprehensive report generation module to generate charts and text descriptions.

[0126] 5. The analysis results are displayed through the web interface, and teachers and students can view them in real time.

[0127] Example 3: Implementation of the Adaptive Teaching Module

[0128] Online learning platform integration

[0129] 1. Obtain the API interface development documents of Coursera, edX, Khan Academy and other platforms, write API call programs, and regularly pull the latest course and textbook data.

[0130] 2. Set up a data synchronization module to run automatically every 24 hours to ensure timely updating of teaching resources.

[0131] 3. Store the synchronized data in the local database, including course videos, handouts, exercises, and answers.

[0132] Adaptive algorithm application

[0133] 1. Collect students’ real-time performance data and historical data, use collaborative filtering and content recommendation algorithms, and adjust teaching content according to students’ learning interests and grades.

[0134] 2. Use real-time and historical data for analysis and generate personalized teaching plans.

[0135] 3. The teaching plan adjustment module generates new teaching plans every week and recommends personalized learning paths and resources.

[0136] Intelligent recommendation engine

[0137] 1. Use XGBoost and LightGBM models for training, combine with students’ learning behavior data, and push the recommendation results to students’ learning interface in real time through the API interface.

[0138] 2. Students provide feedback on the recommendation results, and the system continuously optimizes the recommendation model based on the feedback data.

[0139] Example 4: Deployment of interactive communication unit

[0140] Speech Recognition and Synthesis

[0141] 1. Integrate Google Speech-to-Text API for speech recognition and support speech recognition in multiple languages.

[0142] 2. Use the Amazon Polly API for speech synthesis to generate natural and fluent voice responses based on text.

[0143] 3. The system supports real-time voice dialogue. Students can ask questions directly to the system through the microphone, and the system will respond immediately.

[0144] Sentiment Analysis

[0145] 1. The sentiment analysis module uses the BERT model to combine students’ voice and expression data to analyze their emotional state.

[0146] 2. The system adjusts the tone and content of voice responses based on the results of emotion analysis, for example, providing encouragement and comfort when students are depressed.

[0147] 3. The sentiment analysis results are stored in the students’ personal profiles and can be viewed and referenced by teachers at any time.

[0148] Video conferencing capabilities

[0149] 1. The video conferencing module uses WebRTC technology and supports multi-party video calls and screen sharing functions.

[0150] 2. Teachers can conduct remote teaching, answer questions and provide tutoring through video conferencing, and students can join the meeting and interact at any time.

[0151] 3. The system supports recording and playback of video conferences, which students can review and refer to after class.

[0152] Example 5: Implementation of a report generation unit

[0153] Data analysis tool configuration

[0154] 1. The data analysis module uses SAS for large-scale data processing and generates detailed statistical reports and charts.

[0155] 2. Use R language for data visualization to generate intuitive learning progress charts and in-depth analysis of knowledge mastery.

[0156] 3. Data analysis algorithms include regression analysis, cluster analysis and association analysis.

[0157] Study report generation

[0158] 1. Generate detailed learning progress charts, in-depth analysis of knowledge mastery, and future learning suggestions.

[0159] 2. The learning progress chart shows students’ learning status on different courses and knowledge points, including learning time, completion rate and scores.

[0160] 3. In-depth analysis of knowledge mastery: Based on students’ test and exam scores, the system evaluates their mastery of each knowledge point and generates radar charts and heat maps.

[0161] 4. The future learning suggestion module combines students’ learning performance and interests to recommend appropriate learning resources and plans to help students improve their learning outcomes.

[0162] Report display and export

[0163] 1. The report can be viewed in real time in the web interface, and teachers and parents can log in and view it through the system account.

[0164] 2. The report generation module supports exporting analysis results as PDF or Excel files with beautiful format and detailed content, which is easy to save and share.

[0165] 3. Provide interactive data display and analysis tools through the web interface, so that teachers and parents can view and download students' learning reports at any time.

[0166] Example 6: Deployment of a security management unit

[0167] Data transmission security

[0168] 1. All data transmission uses SSL / TLS encryption technology, and the data transmission module uses the OpenSSL library to ensure the encryption and decryption of all data during transmission.

[0169] 2.SSL / TLS certificates are issued by trusted certificate authorities to ensure the security and reliability of communications.

[0170] 3. The system regularly updates SSL / TLS certificates to prevent security risks caused by expired certificates.

[0171] Database security

[0172] 1. The system database uses MongoDB's encrypted storage engine to ensure the security of stored data.

[0173] 2. Database encryption uses AES-256 algorithm to ensure the confidentiality and integrity of stored data.

[0174] 3. The MongoDB encrypted storage engine supports transparent encryption, and all data is automatically encrypted and decrypted when writing and reading.

[0175] 4. Database access control is strictly limited, and only authorized users and applications can access sensitive data.

[0176] Antivirus and access control

[0177] 1. The system uses an anti-virus and anti-malware system that is automatically updated regularly, and the virus database is scanned and updated regularly.

[0178] 2. The access control system adopts a role-based access control model, where different roles have different permissions to ensure the security of data access.

[0179] 3. Multi-factor authentication includes passwords, SMS verification codes and biometrics to improve the security and protection capabilities of the system.

[0180] Example 7: Implementation of Tracking and Monitoring System

[0181] Positioning Technology

[0182] 1. The system integrates GPS and Wi-Fi positioning technology to monitor students’ physical location in real time.

[0183] 2. The GPS module uses a high-precision positioning chip to obtain students' location information in real time, with a positioning accuracy of within 3 meters.

[0184] 3. The Wi-Fi positioning module helps improve indoor positioning accuracy by analyzing the signal strength and MAC address of nearby Wi-Fi hotspots.

[0185] 4. The positioning data is transmitted to the system server through an encrypted protocol to ensure the security of the student's location privacy.

[0186] Attendance Management

[0187] 1. The system can identify whether students are in the classroom or designated learning area, and determine whether students arrive and leave on time by comparing their real-time location with the location of the classroom or designated learning area.

[0188] 2. The attendance management module records students’ attendance, including arrival time, departure time and absence records, and generates attendance reports.

[0189] 3. Teachers can check students' attendance in real time through the web interface and make necessary reminders and management.

[0190] Learning activity monitoring

[0191] 1. The system monitors the time allocation for learning activities by analyzing students’ mobile device usage.

[0192] 2. The mobile device monitoring module records usage time, application type and frequency of use by analyzing students’ device usage logs.

[0193] 3. The learning activity analysis module evaluates students’ time allocation on different learning tasks based on device usage data and generates a learning efficiency report.

[0194] 4. The system provides study time management suggestions to help students allocate study time reasonably and improve learning efficiency.

Claims

1. A transparent education tracking and evaluation system, comprising: A data collection unit for collecting students’ interaction and learning data through panoramic cameras, microphone arrays, pressure sensors, and motion sensors; The data processing unit uses high-performance computing equipment and deep learning models to process and analyze the collected data and generate comprehensive reports on student behavior and learning efficiency; Adaptive teaching module, which adjusts teaching plans and resources based on students' real-time performance and historical learning data, and provides personalized teaching videos, quizzes and interactive exercises; interactive communication unit, which supports natural language communication and sentiment analysis to enhance teacher-student interaction; Report generation unit, which uses data analysis tools to generate detailed study reports; Security management unit to ensure data security; Tracking and monitoring unit for real-time monitoring of students’ location and learning activities.

2. The system according to claim 1, wherein the data collection unit comprises: The panoramic cameras installed at the four corners of the classroom are configured with H.265 encoding technology and connected to the switch in the classroom via RJ45 network cables; The microphone array with direction sensing is connected to the data processing server via a USB interface and a customized driver is installed; the pressure sensors and motion sensors installed at each student's seat transmit data to the central receiver in the classroom via the Bluetooth 5.0 protocol, and then transmit it to the data processing server via Wi-Fi.

3. The system according to claim 1, wherein the data processing unit comprises: Data processing servers equipped with NVIDIA A100 GPUs, dual-core Intel Xeon processors and 512GB of memory, connected to the campus network via Gigabit Ethernet; Deep learning models developed using TensorFlow and PyTorch frameworks are used for data cleaning, format conversion, and analysis.

4. The system according to claim 1, wherein the adaptive teaching module comprises: Integrate API interfaces of online learning platforms such as Coursera, edX, Khan Academy, etc., and regularly synchronize the latest courses and teaching materials; adopt collaborative filtering and content recommendation algorithms to adjust teaching content according to students' learning interests and grades.

5. The system according to claim 1, wherein the interactive communication unit comprises: The speech recognition module integrates the Google Speech-to-Text API. The speech synthesis module integrates the Amazon Polly API. The sentiment analysis module uses the BERT model to analyze students' emotional state.

6. The system according to claim 1, wherein the report generating unit comprises: The data analysis module uses SAS and R languages ​​for data processing and analysis to generate learning progress charts, in-depth analysis of knowledge mastery, and future learning suggestions.

7. The system according to claim 1, wherein the security management unit comprises: Data transmission module, using SSL / TLS encryption technology; Database, using MongoDB's encrypted storage engine; Antivirus and access control systems, using role-based access control models and multi-factor authentication.

8. The system according to claim 1, wherein the tracking and monitoring unit comprises: GPS module, using high-precision positioning chip; Wi-Fi positioning module, which improves indoor positioning accuracy by analyzing the signal strength and MAC address of nearby Wi-Fi hotspots; Attendance management module, which records students’ attendance and generates attendance reports; The learning activity monitoring module analyzes students' mobile device usage logs and generates learning efficiency reports.

Citation Information

Cited By

  • Integrated management system for intelligent digital campus

    CN119228094A