Classroom behavior analysis method, device, equipment and medium

Abstract

The invention discloses a classroom behavior analysis method and device, equipment and a medium. The method comprises the steps that the actual classroom physical position of each student in a target seat area and the actual classroom interaction behavior of each student are acquired in real time; generating an initial actual space seat map matched with the target seat area according to the actual classroom physical position of each student; determining the classroom interaction times of each student under each target classroom interaction behavior in the classroom teaching process based on the actual classroom interaction behavior; and adding the classroom interaction times of each student under each target classroom interaction behavior to the initial actual space seat map to obtain a corresponding target actual space seat map. According to the invention, the problem of low watching and statistics efficiency caused by manual observation and statistics of classroom interaction behaviors of each student in the prior art is solved, the accuracy and efficiency of observation and statistics of the classroom interaction behaviors are improved, and the effectiveness of teaching improvement of teachers is further improved.

Description

Technical Field

[0001] The present invention relates to the field of teaching technology, and in particular to a classroom behavior analysis method, device, equipment and medium. Background Art

[0002] During the teaching process, the teacher can observe and count each student's classroom interaction behavior. Then after class, the teacher can review the classroom teaching based on the students' classroom situation in order to improve his or her own teaching.

[0003] Among them, the existing methods of counting classroom interactive behaviors include: the teaching assistant counts the classroom interactive behaviors of each student in the class on paper, such as students raising their hands, going on stage, lying on the table, asking questions, etc. However, the current classroom observation method mainly relies on the offline manual observation and statistics of the teaching assistant, resulting in low observation and statistics efficiency. Summary of the invention

[0004] The present invention provides a classroom behavior analysis method, device, equipment and medium to solve the problem of low viewing and statistical efficiency caused by manually observing and counting each student's classroom interactive behavior in the prior art.

[0005] According to one aspect of the present invention, a classroom behavior analysis method is provided, comprising:

[0006] Obtain the actual classroom physical location of each student in the target seating area and the actual classroom interaction behavior of each student in real time;

[0007] generating an initial actual space seating map matching the target seating area according to the actual classroom physical position of each student;

[0008] Determine the number of classroom interactions of each student under each target classroom interaction behavior during classroom teaching based on the actual classroom interaction behavior;

[0009] The number of classroom interactions of each student under each target classroom interaction behavior is added to the initial actual space seating map to obtain the corresponding target actual space seating map.

[0010] According to another aspect of the present invention, there is provided a classroom behavior analysis device, comprising:

[0011] The first acquisition module is used to acquire the actual classroom physical location of each student in the target seat area and the actual classroom interaction behavior of each student in real time;

[0012] A first generating module is used to generate an initial actual space seat map matching the target seat area according to the actual classroom physical position of each student;

[0013] A determination module, used to determine the number of classroom interactions of each student under each target classroom interaction behavior during the classroom teaching process based on the actual classroom interaction behavior;

[0014] The second generating module is used to add the number of classroom interactions of each student under each target classroom interaction behavior to the initial actual space seating map to obtain the corresponding target actual space seating map.

[0015] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0016] at least one processor; and

[0017] a memory communicatively connected to the at least one processor; wherein,

[0018] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the classroom behavior analysis method described in any embodiment of the present invention.

[0019] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the classroom behavior analysis method described in any embodiment of the present invention when executed.

[0020] The technical solution of the embodiment of the present invention obtains the actual classroom physical position and actual classroom interactive behavior of each student in real time during classroom teaching, and automatically draws the actual classroom physical position into a corresponding initial actual space seating map, and counts the number of classroom interactions of each student under each target classroom interactive behavior, and adds the number of classroom interactions of each student under each target classroom interactive behavior to the initial actual space seating map to obtain the corresponding target actual space seating map, so that the teacher can view the classroom performance of each student in the teaching process on the target actual space seating map after class, which solves the problem of low viewing and statistical efficiency caused by manual observation and statistics of each student's classroom interactive behavior in the prior art, improves the accuracy and efficiency of observation and statistics of classroom interactive behaviors, and thereby improves the effectiveness of teachers' teaching improvements.

[0021] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0023] Figure 1 is a flow chart of a classroom behavior analysis method provided by an embodiment of the present invention;

[0024] Figure 2 is a flow chart of another classroom behavior analysis method provided by an embodiment of the present invention;

[0025] Figure 3 It is a schematic diagram of the configuration of a target actual space seat map provided by an embodiment of the present invention;

[0026] Figure 4 is a schematic diagram of displaying interactive description information provided by an embodiment of the present invention;

[0027] Figure 5 is a schematic diagram of displaying actual teaching audio data provided by an embodiment of the present invention;

[0028] Figure 6 is a structural schematic diagram of a classroom behavior analysis device provided by an embodiment of the present invention;

[0029] Figure 7 It is a structural block diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0030] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0031] It should be noted that the terms "initial", "target", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0032] In one embodiment, Figure 1 This is a flow chart of a classroom behavior analysis method provided by an embodiment of the present invention. This embodiment is applicable to the situation where real-time statistics are collected on students' classroom interactive behaviors during classroom teaching. The method can be executed by a classroom behavior analysis device. The classroom behavior analysis device can be implemented in the form of hardware and / or software. The classroom behavior analysis device can be configured in an electronic device. The electronic device can be a server or terminal device for analyzing students' actual classroom interactive behaviors. Figure 1 As shown, the method includes:

[0033] S110. Acquire the actual classroom physical location of each student in the target seating area and the actual classroom interactive behavior of each student in real time.

[0034] Generally, a class includes a student seating area and a podium area. The student seating area includes but is not limited to desks and chairs, and each student is equipped with a corresponding desk and chair; the podium area includes but is not limited to a lectern and a blackboard. In an embodiment, the target seating area refers to the student seating area in a class. The actual classroom physical location refers to the actual seat of each student in a class, which can also be understood as the actual location of the chair corresponding to each student. The number of actual classroom physical locations contained in the target seating area is the same as the number of students who should be in the class.

[0035] Actual classroom interaction behavior refers to the classroom interaction behavior that actually occurs in each student during the classroom teaching process. Actual classroom interaction behavior includes classroom interaction behavior between each student and other students, and may also include classroom interaction behavior between each student and the teacher. Exemplarily, actual classroom interaction behavior includes but is not limited to: raising the head, raising hands, standing up, going up / down the podium, group discussion and other classroom interaction behaviors.

[0036] In actual operation, at least one student camera can be deployed above the blackboard to capture the full view and close-up images of students in the target seating area in real time. In an embodiment, the student camera can capture the actual physical location of each student in the classroom during classroom teaching, as well as the actual classroom interactive behavior of each student in real time.

[0037] S120. Generate an initial actual space seating map that matches the target seating area according to each student's actual physical position in the classroom.

[0038] The initial actual spatial seat map refers to a spatial seat map that maps the target seat area to a line. The initial actual spatial seat map includes multiple spatial seat frames, and the number of spatial seat frames included in the initial actual spatial seat map is equal to the number of actual classroom physical locations included in the target seat area. It can be understood that each spatial seat frame represents a student.

[0039] In an embodiment, a space seat frame corresponding to each student can be constructed, and then the space seat frames can be spliced ​​according to the actual physical position of each student in the classroom to obtain the corresponding initial actual space seat map.

[0040] S130. Determine the number of classroom interactions of each student under each target classroom interaction behavior during the classroom teaching process based on the actual classroom interaction behavior.

[0041] Among them, the target classroom interactive behavior refers to multiple classroom interactive behaviors for which the number of interactions of each student needs to be counted. In an embodiment, the target classroom interactive behavior includes but is not limited to: going on stage, raising hands, and asking questions. It can be understood that the target classroom interactive behavior can be a subset of the actual classroom interactive behavior. The number of classroom interactions refers to the actual number of interactions of each student under each target classroom interactive behavior.

[0042] In an embodiment, the target classroom interactive behavior of each student in the classroom teaching process is screened from the actual classroom interactive behavior, and the actual number of interactions of each student in each target classroom interactive behavior in the classroom teaching process is counted as the corresponding number of classroom interactions. In an embodiment, the displacement of students in the classroom can be analyzed by a camera vision algorithm, and then the position of the human body and face of the students can be identified by a target detection algorithm, and then the human body posture can be identified by a key point detection algorithm, and finally the displacement of the key points of the human body can be identified by a multi-target tracking algorithm to determine the actual classroom interactive behavior of the students.

[0043] S140. Add the number of classroom interactions of each student under each target classroom interaction behavior to the initial actual space seating map to obtain the corresponding target actual space seating map.

[0044] The target actual space seat map includes the number of classroom interactions of each student under the target classroom interaction behavior. In an embodiment, the initial actual space seat map includes a space seat frame of each student, and the number of classroom interactions of the corresponding student under each target classroom interaction behavior is added to the space seat frame to obtain the corresponding target actual space seat map.

[0045] The technical solution of this embodiment obtains the actual classroom physical position and actual classroom interactive behavior of each student in real time during classroom teaching, and automatically draws the actual classroom physical position into a corresponding initial actual space seating map, and counts the number of classroom interactions of each student under each target classroom interactive behavior, and adds the number of classroom interactions of each student under each target classroom interactive behavior to the initial actual space seating map to obtain the corresponding target actual space seating map, so that the teacher can view the classroom performance of each student in the teaching process on the target actual space seating map after class, which solves the problem of low viewing and statistical efficiency caused by manual observation and statistics of each student's classroom interactive behavior in the prior art, improves the accuracy and efficiency of observation and statistics of classroom interactive behaviors, and thus improves the effectiveness of teachers' teaching improvements.

[0046] In one embodiment, Figure 2 1 is a flow chart of another classroom behavior analysis method provided by an embodiment of the present invention. This embodiment is based on the above embodiment and includes the generation process of the initial actual space seat map, the determination process of the number of classroom interactions, and the generation process of the target actual space seat map. Figure 2 As shown, the method includes:

[0047] S210: Acquire the actual classroom physical location of each student in the target seating area and the actual classroom interactive behavior of each student in real time.

[0048] S220. Obtain facial data and / or student information of each student in the target seat area.

[0049] The facial data refers to the facial image of each student. In the embodiment, the facial image can be the real face of each student or the cartoon face corresponding to each student, and there is no limitation on this. Of course, when the cartoon face corresponding to each student is used, on the one hand, it is convenient for the teacher to intuitively identify the corresponding student after class, and on the other hand, the portrait of each student can be protected.

[0050] Student information refers to relevant information that can be used to uniquely identify each student. For example, student information includes, but is not limited to, student name and student ID. Of course, in actual operation, student names can be used so that teachers can more clearly identify the corresponding students after class.

[0051] S230. Generate a space seat frame for each student according to their actual physical position in the classroom.

[0052] In an embodiment, the actual physical location of each student in the classroom is framed and mapped to a seat frame on the line to obtain a corresponding spatial seat frame.

[0053] S240. Add each student's facial data and / or student information to the corresponding spatial seat frame to generate an initial actual spatial seat map that matches the target seat area.

[0054] In an embodiment, the facial data and / or student information of each student is added to the corresponding spatial seat frame so that each spatial seat frame contains student information for uniquely characterizing each student, thereby obtaining an initial actual spatial seat map corresponding to the target seat area.

[0055] S250. Screen the actual classroom interaction behaviors to obtain corresponding target classroom interaction behaviors.

[0056] In an embodiment, actual classroom interaction behaviors of each student are screened to obtain target classroom interaction behaviors for which the number of classroom behaviors needs to be counted.

[0057] S260. Real-time statistics of the number of classroom interactions of each student under each target classroom interaction behavior.

[0058] In the initial state, the number of classroom interactions of each student under each target classroom interaction behavior is 0. During the classroom teaching process, the actual classroom interaction behavior of each student is obtained in real time, and the corresponding target classroom interaction behavior is screened from the actual classroom interaction behavior, and after the target classroom interaction behavior is identified, the number of classroom interactions of the student under the target classroom interaction behavior is increased by one; then the actual classroom interaction behavior of each student is obtained in real time, and the number of classroom interactions of each student under the target classroom interaction behavior is counted until the entire classroom teaching is completed, and the number of classroom interactions of each student under each target classroom interaction behavior is obtained.

[0059] S270, obtaining a display box showing the number of interactions for each student in each target classroom interaction behavior in the initial actual space seating chart.

[0060] Among them, each space seat frame is configured with the same number of interaction times display boxes as the target classroom interaction behavior. In an embodiment, the interaction times display box is used to display the number of classroom interactions of each student under the target classroom interaction behavior. The number of target classroom interaction behaviors is the same as the number of interaction times display boxes. Exemplarily, assuming that the target classroom interaction behaviors are 3, the number of interaction times display boxes contained in each space seat frame is also 3.

[0061] S280. Add the number of classroom interactions of each student under each target classroom interaction behavior to the corresponding interaction number display box to obtain the corresponding target actual space seating chart.

[0062] In an embodiment, during the classroom teaching process, when the number of classroom interactions of a student under a target classroom interactive behavior is counted and updated, the spatial seat box corresponding to the student is automatically searched, and the interaction number display box corresponding to the target classroom interactive behavior is searched in the spatial seat box, and the number of classroom interactions in the interaction number display box is added by one, until the statistics of the number of classroom interactions of each student under each target classroom interactive behavior in the entire classroom teaching process are completed, and the corresponding target actual spatial seat map is obtained.

[0063] In one embodiment, Figure 3 This is a schematic diagram of the configuration of a target actual space seat map provided by an embodiment of the present invention. In this embodiment, the target seat area includes 45 actual classroom physical locations, each row contains 9 students, and there are 5 rows in total, and the target classroom interactive behaviors include: going on stage, raising hands, and asking questions, as an example, to illustrate the configuration schematic diagram of the target actual space seat map. Figure 3 As shown, the target actual space seating chart includes 45 space seating frames, and each space seating frame includes 3 interaction times display frames, each student's face avatar and name. For example, a student in the 5th row and 9th column went on stage 10 times and raised his hand 5 times during the classroom teaching process; as another example, a student in the 1st row and 3rd column answered once during the classroom teaching process. In an embodiment, the number of classroom interactions of each student under each target classroom interaction behavior is added to the target actual space seating chart, that is, detailed data of the number of classroom interactions of each student under the target classroom interaction behavior is displayed, so that teachers can more intuitively view the classroom interaction of each student after class, so as to improve teaching methods.

[0064] The technical solution of this embodiment, based on the above embodiment, adds facial data and / or student information that uniquely characterizes the student in the spatial seat box corresponding to each student, so that teachers can more intuitively view the number of classroom interactions of each student under each target classroom interaction behavior after class.

[0065] In one embodiment, the classroom behavior analysis method further includes: obtaining a space seat frame with a non-zero number of classroom interactions in the target actual space seat map as an interactive space seat frame; and highlighting all interactive space seat frames in the target actual space seat map. Among them, the interactive space seat frame refers to the space seat frame corresponding to the students who have the target classroom interactive behavior during the classroom teaching process. The number of classroom interactions is non-zero, which means that the number of classroom interactions of one of the target classroom interactive behaviors is 1 or a positive integer greater than 1. In an embodiment, the space seat frame with a non-zero number of classroom interactions in the target actual space seat map can be identified and extracted as an interactive space seat frame; then the interactive space seat frame is highlighted so that the teacher can more intuitively view the classroom interaction situation of each student in the classroom after class, so as to improve the subsequent teaching methods.

[0066] In one embodiment, the classroom behavior analysis method further includes: obtaining the actual interaction moment corresponding to each actual classroom interaction behavior; and displaying the target classroom interaction behavior of each student in the classroom teaching process on a pre-created classroom teaching timeline according to the actual interaction moment. Among them, the actual interaction moment refers to the moment when a student's actual classroom interaction behavior occurs in the classroom teaching process. The classroom teaching timeline refers to a timeline that can be used to reflect the entire classroom teaching process. In an embodiment, the target classroom interaction behavior of each student in the classroom teaching process is displayed on the classroom teaching timeline according to the actual interaction moment.

[0067] In one embodiment, the classroom behavior analysis method further includes: adding corresponding classroom interaction mark points at the actual interaction moments on the classroom teaching timeline; in response to the interaction triggering instructions of the classroom interaction mark points, displaying the interaction description information of the target classroom interaction behavior corresponding to the classroom interaction mark points. Among them, the interaction description information refers to information that briefly describes the target classroom interaction behavior. Add classroom interaction mark points corresponding to each actual interaction moment on the classroom teaching timeline, and add the corresponding interaction description information of the target classroom interaction behavior to the classroom interaction mark points, so that when the teacher views the classroom playback video after class, and when the cursor falls on the classroom interaction mark point, the interaction description information of the target classroom interaction behavior can be displayed, so that the teacher can more intuitively view the students' classroom interaction at the actual interaction moment.

[0068] For example, Figure 4 FIG. 1 is a schematic diagram of displaying interactive description information provided by an embodiment of the present invention. Figure 4 As shown in the figure, assuming that the duration of classroom teaching is 45 minutes, there are two marking points in the entire classroom teaching process, at 11 minutes and 30 seconds and 35 minutes and 30 seconds. Among them, at 11 minutes and 30 seconds, students A and student B raise their hands, and at 35 minutes and 30 seconds, students A and student C go on stage.

[0069] In one embodiment, the classroom behavior analysis method further includes: obtaining actual teaching audio data during the classroom teaching process; identifying and extracting target modal particles and classroom teaching terms from the actual teaching audio data; and displaying the target modal particles and classroom teaching terms in real time on the display interface of the pre-generated teaching playback video. Among them, the actual teaching audio data refers to all audio data generated during the classroom teaching process. The actual teaching audio data may include teacher audio data and student audio data. Among them, the teacher audio data may include, but is not limited to: teaching of knowledge points, questions asked to students, etc.; the student audio data may include, but is not limited to: group discussion audio data, answers to questions asked by the teacher, etc.

[0070] In an embodiment, the actual teaching audio data during the classroom teaching process is collected in real time through an audio collection device (such as a microphone), and an audio recognition algorithm is used to identify and classify the actual teaching audio data to obtain corresponding target modal particles and classroom teaching terms. Among them, the target modal particles refer to empty words indicating mood, which can be used at the end of a sentence or at a pause. For example, the target modal particles may include, but are not limited to: ba, le, ne, a, etc. The classroom teaching terms refer to relevant words for analyzing classroom knowledge points.

[0071] In an embodiment, the high-frequency words in the actual teaching audio data can be identified, and the target modal particles and classroom teaching terms can be found. On the one hand, the subsequent teaching methods of the teacher can be improved through the target modal particles to reduce the output of modal particles; at the same time, by displaying the classroom teaching terms on the same display interface as the teaching playback video, during the process of playing the teaching playback video, the actual teaching audio data at the current moment can be viewed, and thus the key knowledge points taught in this classroom teaching can be viewed more intuitively.

[0072] Exemplarily, Figure 5 is a schematic diagram showing the display of actual teaching audio data provided by an embodiment of the present invention. As Figure 5 shown, in a partial area of the same display interface of the playback picture of the teaching playback video, the actual teaching audio data that appears in the playback video is displayed. For example, "ne" belongs to the target modal particle, and "magpie", "bird's nest", etc. belong to the classroom teaching terms.

[0073] It should be noted that the target actual space seat map can also be located on the same display interface as the playback picture of the teaching playback video, that is, Figure 3 the target actual space seat map shown can also be merged with Figure 5 the interface shown, that is, displayed simultaneously, so as to facilitate the teacher to view the classroom interaction situation after class.

[0074] In one embodiment, the classroom behavior analysis method also includes: generating a corresponding classroom interaction heat map according to the number of classroom interactions of each student and the actual classroom physical location; and displaying the classroom interaction heat map in the classroom teaching process in real time on the display interface of the pre-generated teaching playback video. Among them, the classroom interaction heat map is used to characterize the overall classroom interaction situation during the entire classroom teaching process. The classroom interaction heat map can be represented by a variety of different colors. The more classroom interactions a student has at an actual classroom physical location, the more types of colors the actual classroom physical location has on the corresponding classroom interaction heat map; conversely, the fewer classroom interactions a student has at an actual classroom physical location, the fewer types of colors the actual classroom physical location has on the corresponding classroom interaction heat map.

[0075] In an embodiment, after obtaining the classroom interaction heat map at each actual classroom physical location, the corresponding classroom interaction heat map is displayed on the same display interface as the teaching playback video, so that during the playing of the teaching playback video, the teacher can more intuitively view the overall classroom interaction of students during classroom teaching.

[0076] In one embodiment, Figure 6 Schematic diagram of a classroom behavior analysis device provided by an embodiment of the present invention. Figure 6 As shown, the device includes: a first acquisition module 310, a first generation module 320, a determination module 330 and a second generation module 340.

[0077] A first acquisition module 310 is used to acquire the actual classroom physical position of each student in the target seat area and the actual classroom interactive behavior of each student in real time;

[0078] A first generating module 320, for generating an initial actual space seating map matching the target seating area according to the actual classroom physical position of each student;

[0079] A determination module 330 is used to determine the number of classroom interactions of each student under each target classroom interaction behavior during the classroom teaching process based on the actual classroom interaction behavior;

[0080] The second generation module 340 is used to add the number of classroom interactions of each student under each target classroom interaction behavior to the initial actual space seating map to obtain the corresponding target actual space seating map.

[0081] In one embodiment, the first generation module includes:

[0082] A first acquisition unit is used to acquire the face data and / or student information of each student in the target seat area;

[0083] A first generating unit is used to generate a space seat frame corresponding to each student according to the actual physical position of each student in the classroom;

[0084] The second generating unit is used to add each student's facial data and / or student information to the corresponding spatial seat frame to generate an initial actual spatial seat map that matches the target seat area.

[0085] In one embodiment, the determination module includes:

[0086] An analysis unit, used to screen actual classroom interaction behaviors and obtain corresponding target classroom interaction behaviors;

[0087] The statistical unit is used to count the number of classroom interactions of each student under each target classroom interaction behavior in real time.

[0088] In one embodiment, the second generation module includes:

[0089] The second acquisition unit is used to obtain the interaction number display box of each student in each target classroom interaction behavior in the initial actual space seat map; wherein each space seat box is configured with the same number of interaction number display boxes as the target classroom interaction behavior;

[0090] The third generating unit is used to add the number of classroom interactions of each student under each target classroom interaction behavior to the corresponding interaction number display box to obtain the corresponding target actual space seating map.

[0091] In one embodiment, the classroom behavior analysis device further includes:

[0092] The second acquisition module is used to acquire a space seat frame with a non-zero number of classroom interactions in the target actual space seat map as an interactive space seat frame;

[0093] A highlight module is used to highlight all interactive space seat boxes in a target actual space seat map.

[0094] In one embodiment, the classroom behavior analysis device further includes:

[0095] The third acquisition module is used to obtain the actual interaction moment corresponding to each actual classroom interaction behavior;

[0096] The first display module is used to display the target classroom interaction behavior of each student in the classroom teaching process on a pre-created classroom teaching timeline according to the actual interaction moment.

[0097] In one embodiment, the classroom behavior analysis device further includes:

[0098] The first adding module is used to add corresponding classroom interaction marking points at the actual interaction moments on the classroom teaching timeline;

[0099] The second display module is used to respond to the interaction trigger instruction of the classroom interaction mark point and display the interaction description information of the target classroom interaction behavior corresponding to the classroom interaction mark point.

[0100] In one embodiment, the classroom behavior analysis device further includes:

[0101] The third acquisition module is used to acquire actual teaching audio data during classroom teaching;

[0102] The recognition and extraction module is used to recognize and extract the target modal particles and classroom teaching terms in the actual teaching audio data;

[0103] The first display module is used to display the target modal particles and classroom teaching terms in the classroom teaching process in real time on the display interface of the pre-generated teaching playback video.

[0104] In one embodiment, the classroom behavior analysis device further includes:

[0105] The third generation module is used to generate a corresponding classroom interaction heat map according to the number of classroom interactions of each student and the actual physical location of the classroom;

[0106] The second display module is used to display the classroom interaction heat map during the classroom teaching process in real time on the display interface of the pre-generated teaching playback video.

[0107] The classroom behavior analysis device provided in the embodiment of the present invention can execute the classroom behavior analysis method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0108] In one embodiment, Figure 7 is a structural block diagram of an electronic device provided by an embodiment of the present invention, such as Figure 7 As shown, a schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0109] like Figure 7As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0110] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0111] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as a classroom behavior analysis method.

[0112] In some embodiments, the classroom behavior analysis method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the classroom behavior analysis method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the classroom behavior analysis method in any other appropriate manner (e.g., by means of firmware).

[0113] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0114] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0115] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0116] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0117] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0118] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0119] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0120] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A classroom behavior analysis method, characterized in that: include: Obtain the actual classroom physical location of each student in the target seating area and the actual classroom interaction behavior of each student in real time; generating an initial actual space seating map matching the target seating area according to the actual classroom physical position of each student; Determine the number of classroom interactions of each student under each target classroom interaction behavior during classroom teaching based on the actual classroom interaction behavior; The number of classroom interactions of each student under each target classroom interaction behavior is added to the initial actual space seating map to obtain the corresponding target actual space seating map.

2. The method according to claim 1, characterized in that: The step of generating an initial actual space seat map matching the target seat area according to the actual physical position of each student in the classroom includes: Acquire facial data and / or student information of each student in the target seating area; Generate a space seat frame for each student according to their actual physical position in the classroom; Add each student's facial data and / or student information to the corresponding spatial seat frame to generate an initial actual spatial seat map that matches the target seat area.

3. The method according to claim 1, characterized in that: The determining, based on the actual classroom interaction behavior, the number of classroom interactions of each student under each target classroom interaction behavior during the classroom teaching process includes: Screening the actual classroom interactive behaviors to obtain corresponding target classroom interactive behaviors; The number of classroom interactions of each student under each of the target classroom interaction behaviors is counted in real time.

4. The method according to claim 1, characterized in that: The adding the number of classroom interactions of each student under each target classroom interaction behavior to the initial actual space seat map to obtain the corresponding target actual space seat map includes: Obtain a display box for the number of interactions of each student in each target classroom interaction behavior in the initial actual spatial seat map; wherein each of the spatial seat boxes is configured with the same number of display boxes for the number of interactions as the classroom interaction type; Add the number of classroom interactions of each student under each target classroom interaction behavior to the corresponding interaction number display box to obtain the corresponding target actual space seating map.

5. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: Acquire a space seat frame with a non-zero number of classroom interactions in the target actual space seat map as an interactive space seat frame; All of the interactive space seat boxes in the target actual space seat map are highlighted.

6. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: Obtaining the actual interaction moment corresponding to each of the actual classroom interaction behaviors; The target classroom interaction behaviors of each student during the classroom teaching process are displayed on a pre-created classroom teaching timeline according to the actual interaction moments.

7. The method according to claim 6, characterized in that The method further comprises: Adding corresponding classroom interaction marking points at the actual interaction moments on the classroom teaching timeline; In response to the interaction trigger instruction of the classroom interaction mark point, the interaction description information of the target classroom interaction behavior corresponding to the classroom interaction mark point is displayed.

8. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: Acquire actual teaching audio data during classroom teaching; Identifying and extracting target modal particles and classroom teaching terms in the actual teaching audio data; The target modal particles and the classroom teaching terms in the classroom teaching process are displayed in real time on the display interface of the pre-generated teaching playback video.

9. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: Generate a corresponding classroom interaction heat map according to the number of classroom interactions of each student and the actual classroom physical location; The classroom interaction heat map during the classroom teaching process is displayed in real time on the display interface of the pre-generated teaching playback video.

10. A classroom behavior analysis device, characterized in that: include: The first acquisition module is used to acquire the actual classroom physical location of each student in the target seat area and the actual classroom interaction behavior of each student in real time; A first generating module is used to generate an initial actual space seat map matching the target seat area according to the actual classroom physical position of each student; A determination module, used to determine the number of classroom interactions of each student under each target classroom interaction behavior during the classroom teaching process based on the actual classroom interaction behavior; The second generating module is used to add the number of classroom interactions of each student under each target classroom interaction behavior to the initial actual space seating map to obtain the corresponding target actual space seating map.

11. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the classroom behavior analysis method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the classroom behavior analysis method according to any one of claims 1 to 9 when executed.

Images