Smart education classroom evaluation platform, electronic equipment and readable storage medium

Through the smart education classroom evaluation platform, combined with smart cameras, EEG signal acquisition and deep learning models, the problem of incomplete and unobjective classroom evaluation in the existing technology has been solved, and comprehensive and accurate evaluation of teachers and students has been achieved, which has improved the Teaching quality and learning effect.

CN118941165AInactive Publication Date: 2024-11-12QILU NORMAL UNIV

Patent Information

Application Number
CN202411413778.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-11
Publication Date
2024-11-12
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

In the existing technology, classroom evaluation mainly relies on teachers to score in class, which consumes a lot of manpower and material resources. The evaluation information is not comprehensive and objective enough, the evaluation analysis is not accurate enough, and the feedback is not timely.

Method used

Design a smart education classroom evaluation platform, including identity verification module, smart classroom information processing module, teacher evaluation module, student independent evaluation module and classroom process evaluation module, capture classroom behavior through intelligent cameras, combining EEG signal acquisition and deep learning model , realize quantitative evaluation of teachers and students' behaviors and attitudes, and conduct multi-dimensional analysis and real-time feedback through the data analysis layer and management application layer.

Benefits of technology

It realizes independent evaluation of students and classroom process evaluation, helps teachers understand teaching problems, improve teaching quality, helps students monitor learning situations, adjust learning strategies, ensures the comprehensiveness and accuracy of evaluation information, and ensures the convenient implementation of classroom evaluation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118941165A_ABST
    Figure CN118941165A_ABST
Patent Text Reader

Abstract

The invention provides an intelligent education classroom evaluation platform, electronic equipment and a readable storage medium, and belongs to the technical field of classroom evaluation. A teacher evaluation module of the intelligent education classroom evaluation platform is used for providing an evaluation interface for evaluating a teacher for students; the student autonomous evaluation module is used for providing a teaching type classroom evaluation operation interface, a practice type classroom evaluation operation interface and a project type classroom evaluation operation interface; the classroom process evaluation module is used for providing a classroom behavior evaluation operation interface, a classroom attitude evaluation operation interface and a classroom language evaluation operation interface for a teacher; and the intelligent classroom information processing module is used for acquiring the teaching information input into each interface, filling the teaching information into the corresponding interface and displaying the teaching information. Different student self-evaluation and classroom process evaluation implementation modes are designed for different classroom teaching modes and teaching scenes, comprehensiveness of evaluation information is guaranteed, and accuracy of evaluation results is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of classroom evaluation, and specifically relates to a smart education classroom evaluation platform, an electronic device and a readable storage medium. Background Art

[0002] At present, school education involves smart education, which improves the convenience of education and can also bring vivid course experience to students.

[0003] For example, the existing document CN202010426922.4 discloses a smart education classroom system, which includes a classroom and a smart display device. A smart processing center module is provided in the classroom, and the smart processing center module and the smart display device cooperate to form a smart education system. The retrieval input end of the smart processing center is connected to the data cloud retrieval module, and the search feedback output end of the smart center is directly connected to the audio module through the teaching push module. The output end of the smart processing center is also connected to the cloud platform through a smart interaction module, so that the document can effectively improve the interactive effect during teaching, and can effectively provide real-time feedback and improvements according to the actual teaching situation, thereby improving the teaching effect.

[0004] Although smart classrooms are assisted by smart terminals and meet teaching requirements, they are still unable to evaluate educational classrooms. The current classroom evaluation content is single, mainly focusing on teaching supervision, student evaluation of teaching, and teacher evaluation of learning, without paying attention to students' independent evaluation. Classroom evaluation mainly relies on teachers' on-the-spot scoring to evaluate students and teaching status. This method not only consumes manpower and material resources, but also the evaluation information is not comprehensive and objective, and there are problems such as inaccurate evaluation analysis and untimely evaluation feedback. Summary of the invention

[0005] The present invention provides a smart education classroom evaluation platform to at least solve the problem in the prior art that classroom evaluation mainly relies on the teacher's on-the-spot scoring, which not only consumes a lot of manpower and material resources, but also has incomplete evaluation information.

[0006] The platform includes: identity authentication module, smart classroom information processing module, teacher evaluation module, student self-evaluation module and classroom process evaluation module; The teacher evaluation module is used to provide students with an evaluation interface for teacher evaluation; The student self-evaluation module is used to provide a teaching-type classroom evaluation operation interface, a practical classroom evaluation operation interface, and a project-based classroom evaluation operation interface; The classroom process evaluation module is used to provide teachers with classroom behavior evaluation operation interface, classroom attitude evaluation operation interface and classroom language evaluation operation interface; The identity authentication module provides teacher and student identity information registration interface and identity information authentication interface, supports username and password authentication, and enables authorized teachers and students to log in to the smart education classroom evaluation platform; The smart classroom information processing module is used to obtain the teaching information entered into each interface, fill it into the corresponding interface, and display it.

[0007] It should be further explained that it also includes: a text scanning module; the text scanning module is used to scan the teaching-type classroom evaluation information, the smart classroom information processing module constructs a teaching-type classroom evaluation operation interface based on the teaching-type classroom evaluation information, sets a teaching-type classroom selection box in the teaching-type classroom evaluation operation interface, and obtains the teaching-type classroom evaluation information input by students in the teaching-type classroom.

[0008] It should be further explained that the smart classroom information processing module constructs an evaluation operation interface for the practical classroom based on the self-evaluation script, obtains the practical classroom evaluation information entered by the students in the practical classroom, and displays it based on the evaluation operation interface.

[0009] It should be further explained that the smart classroom information processing module sets a project stage filling box, a self-evaluation content filling box and a self-evaluation grade filling box in the evaluation operation interface of the project-based classroom.

[0010] It should be further explained that the smart classroom information processing module uses a smart camera installed inside the classroom to capture the classroom status and annotate the captured video; Extract the video images at preset time intervals to obtain an image sequence; annotate the teacher's behavior and the student's behavior in the image sequence to obtain an annotated image sequence; perform behavior recognition on the annotated image sequence to obtain a teacher-student behavior sequence; According to different behavioral performances, corresponding performance factor weights are set, and the teacher-student behavior sequence is quantified to obtain the teacher behavior performance value and the student behavior performance value respectively; Through the behavior and attitude model, the teacher's behavior performance values ​​and the student's behavior performance values ​​are converted into teacher and student classroom attitudes.

[0011] It should be further explained that an EEG signal acquisition device is installed inside the classroom. The EEG signal acquisition device is communicatively connected to the smart classroom information processing module. The EEG signal acquisition device collects students' EEG signals and transmits the EEG signals to the smart classroom information processing module through wireless communication for storage and analysis. The vibration motor installed on the students reminds the students of their class status.

[0012] It should be further explained that the smart classroom information processing module analyzes the emotional state and learning state of teachers and students during class based on the deep forest model and recurrent neural network model selected in the deep learning model.

[0013] It should be further explained that the smart classroom information processing module includes: data source layer, data storage layer, programming model layer, data analysis layer and management application layer; The data source layer is used to complete the collection and processing of classroom evaluation data; The data storage layer is used to migrate all the evaluation data from the data source layer to the data warehouse for storage and management, providing a data source for multi-dimensional analysis of classroom evaluation; The programming model layer is used to complete the processing and analysis of evaluation data, relying on the MapReduce parallel computing component to process the evaluation content; The data analysis layer uses Hive to complete statistical analysis tasks; The management application layer is used to publish evaluation content and display evaluation results, including online publishing of evaluation tasks and online filling of evaluation content. It uses visual analysis technology to display the results and development changes of teacher evaluation and student evaluation in the form of charts and graphs, and provides real-time feedback to teaching management personnel, teachers, and students.

[0014] According to another embodiment of the present application, an electronic device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the smart education classroom evaluation platform when executing the program.

[0015] According to another embodiment of the present application, a readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the smart education classroom evaluation platform are implemented.

[0016] It can be seen from the above technical solutions that the present invention has the following advantages: The smart education classroom evaluation platform provided by the present invention can not only realize the assessment and selection of teachers and students through student self-evaluation and classroom process evaluation, but also help teachers clearly grasp teaching problems and improve teaching quality, and can help students monitor their own learning situation and adjust their learning strategies.

[0017] The present invention designs different implementation modes of student self-evaluation and classroom process evaluation according to different classroom teaching modes and teaching scenarios, ensures the comprehensiveness of evaluation information, improves the accuracy of evaluation results, and ensures that classroom evaluation can be implemented in specific classrooms, which has high practical significance.

[0018] The present invention realizes online publishing of evaluation content, online completion of evaluation, automatic collection of process evaluation data, intelligent analysis of evaluation data, and visual display of evaluation results through the intelligent classroom evaluation platform, thereby ensuring the convenient implementation of classroom evaluation. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solution of the present invention, the accompanying drawings required for use in the description will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0020] Figure 1 This is a schematic diagram of the smart education classroom evaluation platform; Figure 2 Flowchart for classroom behavior assessment; Figure 3 Flowchart for classroom language assessment. DETAILED DESCRIPTION

[0021] Figure 1 A schematic diagram of the smart education classroom evaluation platform of the present invention is shown. The figure only illustrates the basic concept of the present invention. The diagram only shows the modules related to the present invention rather than the number and functions of the modules in actual implementation. In actual implementation, the function, quantity and role of each module can be changed arbitrarily, and the function and use of the module may also be more complicated.

[0022] The smart education classroom evaluation platform provided by the present invention can acquire and process the associated teacher teaching data, student class status data, and teacher and student evaluation data based on intelligent technology. Among them, the digital twin-driven CNC machine tool intelligent diagnosis method uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge, and use knowledge to obtain the best results. The theory, method, technology and application device.

[0023] The smart education classroom evaluation platform provided in the embodiment of the present application may involve computer vision technology of artificial intelligence and artificial intelligence cloud services in cloud technology. Specifically, computer vision technology and artificial intelligence cloud services are used to implement artificial intelligence processing, which can improve the accuracy of artificial intelligence processing.

[0024] The smart education classroom evaluation platform has several major directions, including computer vision technology, speech processing technology for teaching process, natural language processing technology for evaluation, and machine learning / deep learning. Among them, computer vision technology (CV) refers to the use of cameras and computers to replace human eyes to identify, track and measure targets, and further perform graphic processing, so that the smart education classroom evaluation platform can analyze the teaching process information.

[0025] The smart education classroom evaluation platform involved in this application can be applied to one or more electronic devices, where the electronic device is a device that can automatically perform numerical calculations and / or information processing according to pre-set or stored instructions, and its hardware includes but is not limited to microprocessors, application specific integrated circuits (ASICs), programmable gate arrays (FPGAs), digital signal processors (DSPs), embedded devices, etc.

[0026] An electronic device can be any electronic product that can interact with a user, such as a personal computer, a tablet computer, a smart phone, a personal digital assistant (PDA), an interactive Internet Protocol Television (IPTV), a smart wearable device, etc.

[0027] The network where the electronic device is located includes but is not limited to the Internet, wide area network, metropolitan area network, local area network, virtual private network (VPN), etc.

[0028] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0029] See also Figures 1 to 3 The smart education classroom evaluation platform in a specific embodiment includes: an identity authentication module, a smart classroom information processing module, a teacher evaluation module, a student self-evaluation module and a classroom process evaluation module.

[0030] For the identity authentication module, it can provide teacher and student identity information registration interface and identity information authentication interface, support username and password authentication, and enable authorized teachers and students to log in to the smart education classroom evaluation platform.

[0031] In an exemplary embodiment, the platform can also provide identity hierarchical management, and can set corresponding permissions based on different user identities as needed. The platform also supports username and password authentication to meet the access needs of different users to different content on the platform while ensuring information security.

[0032] In this embodiment, user authority management can set different access rights for users, allowing users to access the corresponding functional modules of the platform within the scope of their authority. It should be noted that authority management can be performed by administrators to perform operations such as resource classification configuration, user role definition and authorization. The use of role-based access control strategies can flexibly authorize users and roles. When defining roles, various forms such as students, teachers of different subjects, and school administrators can be used to flexibly reflect the various evaluation modes of the smart education classroom evaluation platform.

[0033] In an exemplary embodiment, the teacher evaluation module is used to provide students with an evaluation interface for evaluating teachers; the student autonomous evaluation module is used to provide an evaluation operation interface for lecture-type classrooms, an evaluation operation interface for practice-type classrooms, and an evaluation operation interface for project-based classrooms; the classroom process evaluation module is used to provide teachers with a classroom behavior evaluation operation interface, a classroom attitude evaluation operation interface, and a classroom language evaluation operation interface.

[0034] In this embodiment, the teaching-type classroom evaluation information can be scanned based on the text scanning module, and the smart classroom information processing module constructs a teaching-type classroom evaluation operation interface based on the teaching-type classroom evaluation information, sets a teaching-type classroom selection box in the teaching-type classroom evaluation operation interface, and obtains the teaching-type classroom evaluation information input by the students in the teaching-type classroom. The text scanning module can use a scanning device or an image acquisition device to obtain the teaching-type classroom evaluation information and display it on the teaching-type classroom evaluation operation interface. The teaching-type classroom evaluation information can be a preset text filling box, and the teaching-type classroom evaluation information is input by the students. Of course, corresponding filling content requirements can also be set for each text filling box to meet the requirements for filling in the teaching-type classroom evaluation information.

[0035] The smart classroom information processing module is used to obtain the teaching information entered into each interface, fill it into the corresponding interface, and display it.

[0036] It should be noted that the smart classroom information processing module is the data processing center of the platform. It analyzes the acquired data, executes the control instructions input by teachers and students, and processes the data of the platform throughout the process.

[0037] In an exemplary embodiment, the teacher evaluation module can adopt the existing "classroom evaluation index system based on the core competencies of each subject" to evaluate the teacher's teaching from three aspects: student evaluation, supervisor evaluation and teacher evaluation, such as the "High School Mathematics Classroom Core Competency Evaluation Index System" designed by Yu Ping et al. of Nanjing Normal University, the "High School Chemistry Classroom Teaching Evaluation Index System Based on the Core Competencies Perspective" designed by Li Yuzhen et al. of Inner Mongolia Normal University, and the "Ideological and Political Course Teaching Evaluation Index System Aimed at the Cultivation of Subject Core Competencies" designed by Fan Shucheng et al. of Hebei Normal University (because the "classroom evaluation index system based on the core competencies of each subject" already has a mature theoretical and time basis in the prior art, the present invention directly adopts the technical solution provided in the prior art, and this aspect will not be further elaborated here).

[0038] As an example, the smart classroom information processing module constructs an evaluation operation interface for a practical classroom based on a self-evaluation script, obtains practical classroom evaluation information entered by students in the practical classroom, and displays it based on the evaluation operation interface.

[0039] Optionally, the evaluation of practical classes can be carried out in the form of a "self-evaluation form". The content of the self-evaluation form is designed in detail by the instructor before class based on the teaching content. Then in class, the instructor guides students to complete the self-evaluation form by scoring their own learning, reflecting on and evaluating their own learning attitude, learning quality, etc. After class, the teacher analyzes and summarizes the self-evaluation form to understand students' learning dynamics.

[0040] The application of the self-evaluation form is now explained using the "Decimal Multiplication" class in the fifth grade mathematics subject as an example. This class adopts the teaching method of teacher explanation as the main part, supplemented by classroom questions and answers and exercises.

[0041] Table 1 Student self-evaluation form

[0042] In this embodiment, the evaluation operation interface of the practical classroom can also be evaluated by using a "self-evaluation script". The self-evaluation script is a set of orderly structured sentences constructed according to the task execution steps, and is also a set of rhetorical questions based on the evaluation criteria. The self-evaluation script is not only a reflection and evaluation of "how well" students have done after completing different operation steps, but also an action guide to guide students on "what to do" and "how to do it" during the operation process.

[0043] Now, let's take the eighth grade chemistry class "Drainage Method to Produce Oxygen" as an example to illustrate the application of the self-evaluation script: (1) Description of the classroom situation.

[0044] This course is conducted in a chemistry laboratory: First, the teacher introduces cases and videos to show the application and preparation of oxygen; second, the students discuss how to prepare oxygen in the laboratory, the equipment and materials needed; third, the teacher distributes the experimental instruction manual, and demonstrates and explains the methods and experimental steps for preparing oxygen in the laboratory; third, according to the experimental instruction manual and the self-evaluation script, the students prepare oxygen in small groups, and the teacher guides the students to complete the self-evaluation in the process; finally, the students present the experimental results in small groups, and the teacher analyzes the self-evaluation form. The course is divided into three parts: before the experiment, during the experiment, and after the experiment. The experiment is divided into seven steps: "check, install, set, point, collect, separate, and extinguish".

[0045] Design of self-assessment script; 1. Before the experiment.

[0046] Question and answer section: Question 1: What is the principle of the experiment? answer: Correctness of answer: Question 2: What experimental equipment do we need to prepare? answer: Correctness of answer: Evaluation: Do you understand all the preparations before the experiment? Is your preparation comprehensive? Very comprehensive and well prepared; partially understood, partially lacking; totally not understood.

[0047] 2. Experiment Question 1: What is the first step? What do I need to check? How do I do it? answer: What is the second step? What do I need to install? How do I install it? ...... What is the seventh step? What should be turned off? How to do it? Evaluation of each step: Evaluation 1: Was the first operation successful? Is it standardized? Know what to do in this step, also know how to do it, and there is no problem with the operation: Know what to do in this step, but there is a problem with the operation; Don't know how to do this step. ...... In this embodiment, the smart classroom information processing module sets a project stage filling box, a self-evaluation content filling box, and a self-evaluation level filling box in the evaluation operation interface of the project-based classroom.

[0049] Specifically, in the process of project-based classroom evaluation, a "comprehensive, step-by-step" approach can be adopted for evaluation.

[0050] First, before starting a learning project, students need to assess their knowledge reserves and whether they can complete the learning tasks with high quality within the specified time; Secondly, during the implementation of the learning project, first, students design their own task plans and self-evaluate the advantages and problems of the plans; second, the group discusses and studies different plans, and again self-evaluates the advantages and problems of the plans; third, through mutual learning in the group, teacher guidance, and self-learning, students modify and improve their own plans, and evaluate the improved plans; fourth, the plan is implemented, the learning tasks are completed, and the implementation results of the project are self-evaluated; Finally, after the project is completed, students use the evaluation form to evaluate their group cooperation, learning attitude, and project achievement. The evaluation form is shown in the following table: Table 2 Project-based classroom self-evaluation form

[0051] In an exemplary embodiment, the classroom process evaluation module may include classroom behavior evaluation, classroom attitude evaluation and classroom language evaluation. The classroom process evaluation module evaluates the teaching classroom based on classroom behavior, classroom attitude and classroom language analysis by intelligent means.

[0052] In this embodiment, the platform can identify and evaluate classroom behavior. It should be noted that teaching attitude and teaching behavior are positively correlated and consistent. On the one hand, although teaching attitude cannot completely determine teaching behavior, it has a great influence on teaching behavior; on the other hand, teaching behavior is the external manifestation of teaching attitude. Because teaching attitude, as an internal psychological construct, is not easy to observe directly, the teaching attitude can be judged by analyzing the teacher's classroom behavior and combining it with specific teaching objectives and content. The teacher's behavioral signals mainly include the teacher's position, posture, and inappropriate movements.

[0053] Students' classroom behavior can most directly reflect their learning status. Through the identification of students' classroom behavior, we can judge whether students are in an effective learning state. In order to highlight the performance of this feature, we use the performance of students not listening carefully in class to illustrate. Students' inappropriate classroom behavior signals include frequent bowing of heads, lying on the table, playing with mobile phones, talking to classmates, etc.

[0054] When evaluating classroom behavior, this embodiment can use smart cameras to capture the classroom behavior of teachers and students in real time and transmit it to the database set up inside the platform for storage. By identifying the classroom behavior of teachers and students and designing performance values ​​for different behavior performances, it can reflect the classroom teaching attitude and learning attitude from the side. Select typical classroom situations such as lectures, experiments, and discussions, capture the classroom performance data of teachers and students, and annotate the behavior as a training database.

[0055] like Figure 2 As shown in Figure 1, the classroom behavior identification and attitude evaluation process of teachers and students mainly includes the following processes: Step 1: Video annotation, including the time, location, subject, content introduction, main teaching methods, etc. of the class, to obtain the annotated classroom video.

[0056] Step 2: Video extraction, extract the video frames at preset time intervals to obtain an image sequence.

[0057] The third step: image annotation, annotating the teacher and student behaviors in the image sequence to obtain the annotated image sequence of the teacher and students.

[0058] The fourth step: behavior recognition, perform behavior recognition on the labeled image sequence to obtain the teacher-student behavior sequence; behavior quantification, set corresponding performance factor weights for different behavioral performances, quantify the teacher-student behavior sequence, and obtain the teacher-student behavior performance values ​​respectively.

[0059] Step 5: Attitude evaluation, through the behavior and attitude model, the behavioral performance values ​​are converted into teacher and student classroom attitudes.

[0060] Optionally, the above steps can be performed based on the following specific process.

[0061] 1) Video annotation: This embodiment can be completed manually or through a dedicated video annotation tool. The annotation information can be saved in a file (such as JSON or CSV) for use in subsequent steps.

[0062] 2) Video extraction: This example can be done using OpenCV or other libraries. The following is a Python example showing how to extract a frame from a video at regular intervals: Python import cv2 # Open the video file video = cv2.VideoCapture('classroom_video.mp4') # Set the preset time interval interval = 1000 # extract one frame per second frame_rate = video.get(cv2.CAP_PROP_FPS) skip_frames = int(frame_rate * interval / 1000) # List to store image sequences images = [] # Read the video frame by frame while True: ret, frame = video.read() if not ret: if skip_frames == 0: # Extract the current frame and add it to the list images.append(frame) skip_frames = int(frame_rate * interval / 1000) else: skip_frames -= 1 # Release the video file video.release() # Save the image sequence to the database 3) Image annotation: This can be done manually or using specialized image annotation tools. The annotated data can be saved as a file for use in subsequent steps.

[0063] 4) Behavior recognition and quantification. This mainly involves image processing and machine learning technologies. Deep learning models (such as convolutional neural networks (CNNs)) can be used to identify teacher and student behaviors in images. Quantifying behavioral performance requires defining a set of behavioral factors and weights, and calculating values ​​based on the recognition results.

[0064] For example, use TensorFlow or PyTorch to train an action recognition model, then load the model to make predictions for an image sequence, and then convert the actions into numerical values ​​based on the preset weights.

[0065] 5) Attitude evaluation: Behavior values ​​can be converted into classroom attitudes and displayed or saved for record.

[0066] In a preferred embodiment, an EEG signal acquisition device is provided inside the classroom. The EEG signal acquisition device is communicatively connected to the smart classroom information processing module. The EEG signal acquisition device collects students' EEG signals and transmits the EEG signals to the smart classroom information processing module via wireless communication for storage and analysis. The students are reminded of their class status via a vibration motor provided on the students.

[0067] This embodiment may be based on the identification and evaluation of classroom attitudes.

[0068] Specifically, a person's emotional state will directly affect the activeness of his or her thinking and behavioral attitude. Teachers' classroom emotions can not only affect their professional happiness and sense of identity, but also have a profound impact on the teacher-student relationship, teaching effect and learning effect in the classroom; students' classroom emotions can not only affect their learning interest and enthusiasm. However, the current classroom evaluation focuses on the achievement of teachers' teaching goals and students' knowledge goals, ignoring the classroom emotional experience process of teachers and students, which leads to problems such as students' aversion to learning, unsatisfactory classroom teaching effects, and students' indifference to life. Therefore, in classroom evaluation, attention should be paid to the emotions of teachers and students.

[0069] The teacher emotional state model of this embodiment can adopt the basic emotion theory model to divide people's subjective emotional feelings into several discrete basic emotions, and different emotional states can be measured. The main representative division criteria are the six basic emotions obtained by Ekman: anger, disgust, fear, happiness, sadness and surprise.

[0070] In the three-dimensional student learning status model of this embodiment, concentration represents the student's attention during classroom learning, interest represents the student's interest in classroom knowledge, and fatigue represents the student's mental state during classroom learning.

[0071] In this embodiment, a teacher's emotional state measurement program based on the basic teacher and student emotion theory model is constructed, which requires the combination of emotion recognition technology, data analysis and user interface design. The following is the specific process: 1) Emotion recognition. This can be achieved through the following methods, including: Video analysis: using computer vision technology to identify emotions from the teacher's video or live camera stream. Speech analysis: identifying emotions by analyzing the teacher's voice characteristics (such as pitch, speaking speed, etc.). Self-reporting: teachers can directly input their emotional state through the application.

[0072] 2) Data measurement. This can be achieved by assigning a numerical value or level to each emotion. For example, anger may be assigned a high numerical value, while happiness may be assigned a low numerical value.

[0073] The following is a specific example to implement the above functions: define opencv-python (for video processing); define librosa (for audio processing); Define tensorflow or pytorch (for deep learning models, if needed); Define numpy and pandas (for data processing); Define flask or django (if you need to build a web interface).

[0074] Python Set up import cv2 import numpy as np import librosa Set up an emotion recognition function that accepts video frames or audio data and returns an emotion label; def recognize_emotion(input_data): This could be algorithms based on computer vision or speech recognition; Returns the recognized emotion label, such as "angry", "happy", etc.

[0075] Set the sentiment measurement function to return the measurement value based on the sentiment label.

[0076] You can define a measure value for each emotion.

[0077]

[0078]

[0079]

[0080]

[0081]

[0082]

[0083]

[0084]

[0085]

[0086]

[0087]

[0088]

[0090]

[0093]

[0094]

[0095]

[0097]

[0098]

[0099]

[0100]

[0101]

[0103]

[0104]

[0106]

[0107]

[0109]

[0111]

[0113] The smart education classroom evaluation platform can also use web frameworks such as Flask or Django to create web applications. In this way, teachers can input data or view the results of sentiment analysis through the web interface.

[0114] In this embodiment, the teacher's emotional state model and the student's three-dimensional learning state model can be used to analyze the classroom mental state in the following manner.

[0115] Among them, beta waves are closely related to the brain's logical thinking process. With the increase of concentration, beta waves tend to increase. When evaluating based on the power spectrum density method, β / α and β / (α+θ) can be used to characterize the state of concentration; when a person is in a state of high interest, gamma waves and beta waves account for a large proportion of the energy in the EEG signal, followed by alpha waves; using the power spectrum density analysis method, it can be obtained that the degree of fatigue is mainly affected by alpha waves, beta waves, and theta waves. Many scholars test the degree of fatigue of the test subject based on ratios such as (α+θ) / β, ɑ / β, (ɑ+θ / (ɑ+β).

[0116] Considering that interest, fatigue and concentration influence and interact with each other, it is difficult to effectively infer the weight values ​​of the three using general quantitative analysis methods. The analytic hierarchy process is a decision analysis method that combines qualitative and quantitative methods to solve multi-objective problems. Therefore, the analytic hierarchy process can be used to obtain the weight coefficients of the three dimensions, and then the values ​​of the three-dimensional state can be obtained based on the EEG signal, and normalized, and finally the weighted sum can be performed to obtain the learning state level.

[0117] In the process of classroom attitude evaluation, the deep forest model and the recurrent neural network model can be selected in the deep learning model to analyze the teacher's emotional state and learning state respectively. Among them, emotion recognition mainly includes emotion and state description, establishment of EEG signal database, design of emotion recognition model, training of emotion recognition model, and conducting emotion recognition experiments.

[0118] The classroom language evaluation of this embodiment is to collect classroom speech signals by evenly placing microphones and microphone arrays composed of additional modules on the podium and in the classroom.

[0119] The processing and analysis of classroom speech signals mainly includes two parts: first, the identification of the number of speakers, judging whether it is a single speaker or multiple speakers; second, the identification of the main speaker, and judging whether it is a teacher.

[0120] The details are as follows: The first step is preprocessing of microphone speech signals.

[0121] First, based on the beamforming method, the speech signals of the microphone array are formed into pickup beams for speech analysis and processing; secondly, a certain time period is selected as the unit time, and the speech signals of the microphone array are divided according to the unit time to form a speech sequence.

[0122] The second step is to identify the number of speakers. First, the broadband source method is used to narrowband the speech signal. Then, the classic source number estimation method is used to estimate the number of speakers and determine whether it is a single speaker or multiple speakers. If it is a single speaker, the third step of recognition is required. If it is multiple speakers, the third step is skipped and the fourth step is entered.

[0123] The third step is key speaker identification. First, the distance between Gaussian mixture models is used to construct an affinity matrix, and speaker spectrum clustering is implemented at the model level. Second, a multi-feature combination method is used to estimate the multi-person conversation speech model and identify the key speaker in the speech. Third, the key speaker's speech is homologous, and the key speaker is determined by comparing feature values ​​to determine whether the key speaker is a teacher.

[0124] The fourth step is to determine the teaching method. In a unit of time, if there are multiple voices, it is discussion-based teaching; if there is a single voice and it is the teacher's voice, it is lecture-based teaching; if there is a single voice and it is not the teacher's voice, it is question-and-answer teaching.

[0125] It should be noted that, in order to realize intelligent classroom evaluation, the present invention designs a classroom evaluation system based on the Hadoop big data platform. The functional design of the intelligent classroom evaluation platform 4 adopts the idea of ​​modularization, and different modules realize different evaluation functions; the architecture design of the platform adopts the idea of ​​layering, and each component in the Hadoop ecosystem is applied to each layer respectively. The overall architecture is divided into a data source layer, a data storage layer, a programming model layer, a data analysis layer, a data management and application layer.

[0126] Among them, the data source layer can complete the collection and processing of classroom evaluation data. The types of classroom evaluation data are diverse, including both structured and unstructured data. Structured evaluation data includes the content of online teaching evaluation, learning evaluation and self-evaluation modules, while unstructured evaluation data mainly includes pictures, videos, audio, etc. of classroom process evaluation.

[0127] The data storage layer migrates all the evaluation data of the data source layer to the data warehouse for unified storage and management, providing a data source for the multidimensional analysis of classroom evaluation; the present invention stores unstructured evaluation data in HDFS and structured evaluation data in Hive.

[0128] The programming model layer mainly completes the processing and analysis of evaluation data. It relies on the parallel computing component MapReduce and is based on the modular design idea. It adopts different computing modules to process different evaluation contents. For each computing module, you can write your own MapReduce program to process educational data, or you can use Hive at the data analysis layer to automatically convert HQL into MapReduce program to run.

[0129] The data analysis layer mainly uses Hive to complete statistical analysis tasks, so the data analysis layer includes the Hive component.

[0130] The management application layer is mainly used to publish evaluation content and display evaluation results, including online publishing of evaluation tasks and online filling of evaluation content. It uses visual analysis technology to display the results and development changes of teacher evaluation and student evaluation in the form of charts and graphs, and provides real-time feedback to teaching management personnel, teachers, and students.

[0131] The smart education classroom evaluation platform provided by the present invention is a unit and algorithm step of each example described in combination with the embodiments disclosed herein, which can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to the function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0132] In the readable storage medium, a program product capable of implementing the above-mentioned smart education classroom evaluation platform of this specification is stored. In some possible implementations, various aspects of the present disclosure can also be implemented in the form of a program product, which includes a program code. When the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary implementations of the present disclosure described in the above-mentioned "Exemplary Method" section of this specification.

[0133] In the readable storage medium, any combination of one or more readable media can be used. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0134] The above description of the disclosed embodiments enables one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A smart education classroom evaluation platform, It is characterized in that include: Identity verification module, smart classroom information processing module, teacher evaluation module, student self-evaluation module and classroom process evaluation module; The teacher evaluation module is used to provide students with an evaluation interface for teacher evaluation; The student self-evaluation module is used to provide a teaching-type classroom evaluation operation interface, a practical classroom evaluation operation interface, and a project-based classroom evaluation operation interface; The classroom process evaluation module is used to provide teachers with classroom behavior evaluation operation interface, classroom attitude evaluation operation interface and classroom language evaluation operation interface; The identity authentication module provides teacher and student identity information registration interface and identity information authentication interface, supports username and password authentication, and enables authorized teachers and students to log in to the smart education classroom evaluation platform; The smart classroom information processing module is used to obtain the teaching information entered into each interface, fill it into the corresponding interface, and display it.

2. According to the smart education classroom evaluation platform of claim 1, It is characterized in that Also includes: Text scanning module; the text scanning module is used to scan the teaching-type classroom evaluation information. The smart classroom information processing module constructs a teaching-type classroom evaluation operation interface based on the teaching-type classroom evaluation information, sets a teaching-type classroom selection box in the teaching-type classroom evaluation operation interface, and obtains the teaching-type classroom evaluation information input by students in the teaching-type classroom.

3. According to the smart education classroom evaluation platform of claim 1, It is characterized in that The smart classroom information processing module constructs an evaluation operation interface for the practical classroom based on the self-evaluation script, obtains the practical classroom evaluation information entered by students in the practical classroom, and displays it based on the evaluation operation interface.

4. According to the smart education classroom evaluation platform of claim 1, It is characterized in that The smart classroom information processing module sets a project stage filling box, a self-evaluation content filling box and a self-evaluation grade filling box in the evaluation operation interface of the project-based classroom.

5. According to the smart education classroom evaluation platform of claim 1, It is characterized in that The smart classroom information processing module uses the smart camera installed inside the classroom to capture the classroom status and annotate the captured video; Extract the video images at preset time intervals to obtain an image sequence; annotate the teacher's behavior and the student's behavior in the image sequence to obtain an annotated image sequence; perform behavior recognition on the annotated image sequence to obtain a teacher-student behavior sequence; According to different behavioral performances, corresponding performance factor weights are set, and the teacher-student behavior sequence is quantified to obtain the teacher behavior performance value and the student behavior performance value respectively; Through the behavior and attitude model, the teacher's behavior performance values ​​and the student's behavior performance values ​​are converted into teacher and student classroom attitudes.

6. The smart education classroom evaluation platform according to claim 1, It is characterized in that An EEG signal acquisition device is installed inside the classroom. The EEG signal acquisition device is connected to the smart classroom information processing module. The EEG signal acquisition device collects students' EEG signals and transmits them to the smart classroom information processing module through wireless communication for storage and analysis. The vibration motor installed on the students reminds the students of their class status.

7. The smart education classroom evaluation platform according to claim 6, It is characterized in that The smart classroom information processing module analyzes the emotional state and learning state of teachers and students during class based on the deep forest model and recurrent neural network model selected from the deep learning model.

8. The smart education classroom evaluation platform according to claim 1, It is characterized in that The smart classroom information processing module includes: data source layer, data storage layer, programming model layer, data analysis layer and management application layer; The data source layer is used to complete the collection and processing of classroom evaluation data; The data storage layer is used to migrate all the evaluation data from the data source layer to the data warehouse for storage and management, providing a data source for multi-dimensional analysis of classroom evaluation; The programming model layer is used to complete the processing and analysis of evaluation data, relying on the MapReduce parallel computing component to process the evaluation content; The data analysis layer uses Hive to complete statistical analysis tasks; The management application layer is used to publish evaluation content and display evaluation results, including online publishing of evaluation tasks and online filling of evaluation content. It uses visual analysis technology to display the results and development changes of teacher evaluation and student evaluation in the form of charts and graphs, and provides real-time feedback to teaching management personnel, teachers, and students.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, It is characterized in that When the processor executes the program, the steps of the smart education classroom evaluation platform as described in any one of claims 1 to 8 are implemented.

10. A readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the steps of the smart education classroom evaluation platform as claimed in any one of claims 1 to 8 are implemented.

Citation Information

Patent Citations

  • Intelligent education classroom system

    CN111554140A

  • Monitoring system for lecture state

    CN106344007A

  • Multi-dimensional classroom quantification system and method based on computer vision

    CN110334610A

  • Interaction method and device, electronic equipment and storage medium

    CN113360040A

  • Teaching planning method and system based on big data

    CN115082269A

Cited By

  • Teaching evaluation method, device and equipment and readable storage medium

    CN119359158A