Teaching behavior analysis method, device, system, equipment, medium and product

Abstract

The invention relates to the technical field of computer vision, and provides a teaching behavior analysis method, device, system, equipment, medium and product, and the method comprises the steps: obtaining the visual information of a teaching environment, the visual information comprises a depth map and a two-dimensional map; capturing a region of interest of the eyeballs of the students on a teaching medium based on the visual information, and generating a teaching medium thermodynamic diagram based on the region of interest of the eyeballs of the students on the teaching medium; and carrying out teaching behavior analysis based on the teaching medium thermodynamic diagram. According to the teaching behavior analysis method, device, system, equipment, medium and product provided by the invention, the attention condition of students can be displayed more intuitively. And on the basis, teaching behavior analysis is performed based on the teaching medium thermodynamic diagram, so that the attention distribution condition of the students in the classroom is known, the feedback information is automatically analyzed, the teaching method and strategy are adjusted according to the analysis result, and the teaching effect can be improved.

Description

Technical Field

[0001] The present invention relates to the field of computer vision technology, and in particular to a teaching behavior analysis method, device, system, equipment, medium and product. Background Art

[0002] The interactive large screen has greatly enriched teaching methods, improved the interactivity and fun of teaching through its intuitive and efficient information display and interactive capabilities, and has become an indispensable part of modern education.

[0003] At present, the design of most electronic courseware and blackboards is mainly completed by the teachers themselves. Although this "self-sufficient" model can give full play to the personalized teaching style of teachers, it also faces problems such as insufficient innovation of courseware content, uneven visual design, and single presentation of knowledge points. At the same time, due to the lack of unified quality standards and effective evaluation mechanisms, it is difficult for teachers to obtain timely and objective feedback from students or other teaching participants, which in turn limits the further improvement of teaching quality.

[0004] Students' perception and satisfaction with the quality of courseware and blackboard writing is one of the important indicators for evaluating teaching effectiveness. However, in the traditional teaching model, the collection of student feedback often relies on post-class questionnaires, oral communication and other methods, which are not only inefficient, but also difficult to achieve systematic, information-based processing and analysis of feedback information. Summary of the invention

[0005] The present invention provides a teaching behavior analysis method, device, system, equipment, medium and product, which are used to solve the defect of low efficiency of feedback analysis of teaching design in the prior art.

[0006] The present invention provides a teaching behavior analysis method, comprising: Acquire visual information of the teaching environment, wherein the visual information includes a depth map and a two-dimensional map; Capturing the area of ​​interest of the students' eyes on the teaching medium based on the visual information, and generating a teaching medium heat map based on the area of ​​interest of the students' eyes on the teaching medium; Based on the teaching medium heat map, teaching behavior analysis is performed.

[0007] According to the teaching behavior analysis method provided by the present invention, the teaching behavior analysis based on the teaching medium heat map includes: Based on the teaching medium heat map, the students' attention to the style, content and layout of the teaching medium is analyzed to obtain analysis results.

[0008] According to the teaching behavior analysis method provided by the present invention, the teaching medium heat map is used to analyze the students' attention to the style, content, and layout of the teaching medium to obtain the analysis results, and then the method further includes: Based on the analysis results of each teaching medium, a target teaching medium is screened from the teaching media, and / or the teaching medium is iteratively optimized.

[0009] According to the teaching behavior analysis method provided by the present invention, the method further comprises: Determine the movement trajectory of the teacher during the teaching process based on the visual information, and generate a movement trajectory heat map based on the movement trajectory; Based on the movement trajectory heat map, the teacher's teaching behavior is analyzed.

[0010] According to the teaching behavior analysis method provided by the present invention, the teaching behavior analysis based on the teaching medium heat map includes: Performing behavior recognition on the visual information to obtain the student's classroom behavior; Based on the teaching medium heat map and the students' classroom behavior, teaching behavior analysis is performed.

[0011] The present invention also provides a teaching behavior analysis device, comprising: An acquisition unit, used to acquire visual information of the teaching environment, wherein the visual information includes a depth map and a two-dimensional map; A generating unit, configured to capture the area of ​​interest of the student's eyes on the teaching medium based on the visual information, and generate a teaching medium heat map based on the area of ​​interest of the student's eyes on the teaching medium; The analysis unit is used to perform teaching behavior analysis based on the teaching medium heat map.

[0012] The present invention also provides a teaching behavior analysis system, comprising: an image acquisition device, a processor and an output device; The image acquisition device is used to acquire visual information of the teaching environment and send the visual information to the processor, wherein the visual information includes a depth map and a two-dimensional map; The processor is used to capture the attention area of ​​the student's eyes on the teaching medium based on the visual information, generate a teaching medium heat map based on the attention area of ​​the student's eyes on the teaching medium, and perform teaching behavior analysis based on the teaching medium heat map; The output device is used to output the teaching medium heat map and the results of the teaching behavior analysis.

[0013] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, any one of the teaching behavior analysis methods described above is implemented.

[0014] The present invention also provides a non-transitory computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the teaching behavior analysis method described in any one of the above is implemented.

[0015] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the teaching behavior analysis method described in any one of the above is implemented.

[0016] The teaching behavior analysis method, device, system, equipment, medium and product provided by the present invention can capture the attention area of ​​students' eyes on the teaching medium by acquiring visual information of the teaching environment, and generate a teaching medium heat map based on the attention area of ​​students' eyes on the teaching medium. The teaching medium heat map can more intuitively show the students' attention situation. On this basis, based on the teaching medium heat map, teaching behavior analysis is performed to understand the distribution of students' attention in class, realize automatic analysis of feedback information, and then adjust teaching methods and strategies according to the analysis results, which can improve teaching effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 It is one of the flow charts of the teaching behavior analysis method provided by the present invention.

[0019] Figure 2 It is a schematic diagram of the teaching medium heat map provided by the present invention.

[0020] Figure 3 This is the second flow chart of the teaching behavior analysis method provided by the present invention.

[0021] Figure 4 It is a schematic diagram of the movement trajectory heat map provided by the present invention.

[0022] Figure 5 This is the third flow chart of the teaching behavior analysis method provided by the present invention.

[0023] Figure 6It is a structural schematic diagram of the teaching behavior analysis device provided by the present invention.

[0024] Figure 7 It is a structural schematic diagram of the teaching behavior analysis system provided by the present invention.

[0025] Figure 8 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0027] In the traditional teaching model, students' perception and satisfaction with the quality of courseware and blackboard writing often rely on post-class questionnaires, oral communication, etc., or by analyzing students' classroom behavior to judge the class status, thereby indirectly providing feedback on the quality of students' listening and teachers' teaching. These methods are not only inefficient, but also difficult to achieve systematic, information-based processing and analysis of feedback information.

[0028] In view of the above problems, an embodiment of the present invention provides a teaching behavior analysis method, in which the visual information of the teaching environment is obtained to capture the attention area of ​​the students' eyes on the teaching media, and based on the attention area of ​​the students' eyes on the teaching media, a teaching media heat map is generated, which can more intuitively show the students' attention. On this basis, based on the teaching media heat map, teaching behavior analysis is performed to understand the distribution of students' attention in class, realize automatic analysis of feedback information, and then adjust teaching methods and strategies according to the analysis results to improve teaching effectiveness.

[0029] The embodiments of the present invention can be applied to scenarios where classroom teaching behavior analysis is required, such as evaluation scenarios of electronic courseware and blackboard writing. The execution subject of the method can be an electronic device such as a terminal device, a computer, a server, a server cluster, or a specially designed teaching behavior analysis device, or a teaching behavior analysis device set in the electronic device, which can be implemented by software, hardware, or a combination of the two.

[0030] Figure 1 It is one of the flow charts of the teaching behavior analysis method provided by the present invention, such as Figure 1 As shown, the method comprises the following steps: Step 110, obtaining visual information of the teaching environment, the visual information including a depth map and a two-dimensional map of the student's facial area; Step 120 , capturing the area where students' eyes focus on the teaching medium based on the visual information, and generating a teaching medium heat map based on the area where students' eyes focus on the teaching medium.

[0031] Specifically, the teaching environment may be a facility environment that can provide teaching activities, and the teaching environment may be an indoor environment or an outdoor environment, which is not specifically limited in the embodiment of the present invention. For example, the teaching environment may be a classroom or an outdoor classroom.

[0032] Taking the classroom as an example, the image acquisition device can be installed at an appropriate location in the classroom to ensure that the facial areas of all students are covered. The image acquisition device can be, for example, a 3D camera, which is installed above the smart interactive large screen to obtain depth maps and two-dimensional maps at the same time.

[0033] 3D cameras can obtain three-dimensional information of objects in the scene, including depth maps, point clouds, etc. This is crucial for capturing the position of students' eyes, because the three-dimensional position information of the eyes can more accurately reflect their gaze direction than two-dimensional images. You can choose a suitable 3D camera to ensure that it has high imaging accuracy and fast processing speed to meet the needs of capturing students' eye positions in real time.

[0034] Eye tracking is a type of biometric technology that detects eye movement to infer a person's line of sight. In eye tracking or face recognition applications, depth maps can be used as auxiliary information to help eye positioning algorithms more accurately lock the position of the eye. By combining depth maps with two-dimensional image information, the algorithm can more effectively filter out background noise and interference, improving the accuracy and robustness of eye positioning. In the student's facial image obtained by a 3D camera, the eye tracking algorithm can locate the position of the eye and further calculate its gaze point.

[0035] Here, the teaching medium refers to the carrier for delivering teaching information in the teaching process. Specifically in the classroom teaching process, the teaching medium may be, for example, blackboard writing, electronic courseware, specimens, experimental equipment, etc. The blackboard writing here may be electronic blackboard writing or traditional chalk blackboard writing, which is not specifically limited in the embodiment of the present invention.

[0036] The area of ​​attention of the students' eyes on the teaching medium refers to the area on the teaching medium where the students' gaze points are projected. For example, for a certain page of electronic courseware, the area of ​​attention of student 1 is the geometric image on the electronic courseware, and the area of ​​attention of student 2 is the formula on the electronic courseware. By analogy, the area of ​​attention of each student's eyes on the teaching medium can be captured. In addition, the length of time each student pays attention to a certain area on the teaching medium can also be captured. For example, student 3 paid attention to area 1 on the electronic courseware for 10 seconds and to area 2 for 20 seconds.

[0037] Then, based on the areas where students' eyes focus on the teaching media, a teaching media heat map is generated. The teaching media heat map reflects the degree of students' attention to each area in the teaching media.

[0038] The generation of the teaching media heat map can be obtained through data analysis methods. For example, according to the number of students who pay attention to each area and the length of time each student pays attention, a comprehensive analysis is performed to obtain analytical data, and then the analytical data is mapped to the teaching media to generate a teaching media heat map. The depth of color in the teaching media heat map reflects the degree of attention of students to the area. For example, it can be configured that the darker the color, the higher the degree of attention; conversely, the lighter the color, the lower the degree of attention. For example, in the teaching media heat map, the areas that the winning students focus on are marked in red, and other areas of attention are reflected in gradient colors. This method can quantify and intuitively reflect the degree of attention of students to the teaching media. Figure 2 It is a schematic diagram of the teaching medium heat map provided by the present invention. Figure 2 (a) is a schematic diagram of the blackboard heat map. Figure 2 (b) is a schematic diagram of the courseware heat map.

[0039] In other embodiments, the teaching medium heat map can be obtained through a pre-trained heat map generation model. The depth map and two-dimensional map in the visual information are input into the pre-trained heat map generation model to obtain the teaching medium heat map output by the model.

[0040] Step 130, conducting teaching behavior analysis based on the teaching medium heat map.

[0041] Specifically, the teaching media heat map can intuitively reflect the area where students' eyes focus on the teaching media. Therefore, teaching behavior analysis can be performed based on the teaching media heat map. The goal of the teaching behavior analysis here is to evaluate students' attention, understanding or interest in different teaching media.

[0042] For example, different teaching media heat maps can be generated by different blackboard content and different blackboard writing styles to analyze students' activity and attention on different teaching media. By analyzing the high-heat and low-heat areas in the heat map, the parts of the teaching media that students are most interested in and least interested in can be identified; by observing the differences in students' feedback on different teaching media in different time periods, it can be analyzed whether there are specific learning behavior patterns.

[0043] On this basis, the teaching media can be optimized through analysis results. According to the heat map analysis results, the content and form of the teaching media can be adjusted to improve students' learning interest and participation. For high-heat areas, the content can be further enriched and interactive links can be added. For low-heat areas, the reasons need to be found (such as too high content difficulty, monotonous form, etc.) and corresponding improvements need to be made.

[0044] The method provided by the embodiment of the present invention obtains visual information of the teaching environment, captures the area of ​​attention of the students' eyes on the teaching media, and generates a teaching media heat map based on the area of ​​attention of the students' eyes on the teaching media. The teaching media heat map can more intuitively show the students' attention. On this basis, based on the teaching media heat map, the teaching behavior analysis is carried out to understand the distribution of students' attention in the classroom, realize automatic analysis of feedback information, and then adjust the teaching methods and strategies according to the analysis results, which can improve the teaching effect.

[0045] Based on any of the above embodiments, the teaching behavior analysis is performed based on the teaching medium heat map, that is, step 130 specifically includes: Based on the teaching media heat map, the students’ attention to the style, content, and layout of the teaching media is analyzed to obtain the analysis results.

[0046] Specifically, the style of teaching media refers to the unique visual, auditory or interactive characteristics of teaching blackboards or courseware when presenting information. These characteristics together constitute the overall atmosphere and experience that students feel when they come into contact with teaching media. The style of teaching media can include traditional style (such as blackboard writing), multimedia style (such as multimedia courseware that combines multiple media elements such as text, images, audio, video, etc.), gamification style, etc.

[0047] The content of teaching media refers to the specific knowledge, information, skills or experience transmitted and presented to students through teaching media. The content of teaching media may include subject knowledge, such as geometric figures, mathematical formulas, conclusion sentences, circled content, etc.

[0048] The layout of teaching media refers to the spatial arrangement and organization of various elements (such as text, images, charts, buttons, etc.) when presenting information on the teaching blackboard or courseware. A good layout can enhance students' viewing experience and help them better understand and remember information.

[0049] By displaying teaching media of different styles, contents and layouts, we can obtain the corresponding teaching media heat map, and on this basis, analyze the students' attention to the style, content and layout of the teaching media to obtain the analysis results.

[0050] For example, it can be clearly seen from the heat map that students may pay more attention to teaching media styles that are colorful and illustrated, pay more attention to picture information with expressions, and have higher heat intensity in the explanation areas of certain key concepts or formulas, indicating that these are the contents that students focus on and learn. Teaching media with a reasonable layout and clear information hierarchy are more likely to attract students' attention. For example, teaching media that adopt layout methods such as "general-specific-general" or "problem-solving" often have more even heat distribution. The reasonable use of elements such as titles, subtitles, and pictures can also help to increase the attractiveness of the layout. These elements are often shown as areas with higher heat intensity in the heat map.

[0051] The method provided in the embodiment of the present invention analyzes students' attention to the style, content, and layout of teaching media based on the teaching media heat map, and obtains analysis results, which can enable teachers to better meet students' learning needs when making teaching media, thereby improving teaching effectiveness and students' learning experience.

[0052] Based on any of the above embodiments, based on the teaching medium heat map, analyzing the students' attention to the style, content, and layout of the teaching medium to obtain the analysis results, and then further comprising: Based on the analysis results of each teaching medium, a target teaching medium is screened from each teaching medium, and / or the teaching medium is iteratively optimized.

[0053] Specifically, the target teaching medium can be any one of the teaching medium styles, contents, and layouts that attracts a high degree of attention. Each teaching medium can be a teaching medium produced for different teachers, that is, a teaching medium with different styles, contents, and layouts, or a teaching medium obtained after the previous iteration optimization.

[0054] For example, a threshold of attention level can be set in advance, and teaching media with attention levels greater than the threshold can be used as target teaching media, thereby screening out the target teaching media. This can promote the production level of teaching media for teachers throughout the school, thereby improving the effectiveness of knowledge transfer and improving teaching quality.

[0055] Iterative optimization of teaching media can be achieved by regularly analyzing the teaching media after the last optimization to understand students' attention level and usage experience of the teaching media, implementing the redesigned teaching media in actual teaching, and obtaining analysis results through teaching media heat maps, thereby achieving continuous iterative optimization of teaching media.

[0056] In addition, the analysis results of each teaching medium can provide the direction for iterative optimization. If any of the style, content, or layout of the teaching medium receives less attention, iterative optimization can be carried out starting from the dimension with less attention.

[0057] Based on any of the above embodiments, Figure 3 This is the second flow chart of the teaching behavior analysis method provided by the present invention, such as Figure 3 As shown, the method also includes: Step 310, determining the movement trajectory of the teacher during the teaching process based on the visual information, and generating a movement trajectory heat map based on the movement trajectory; Step 320: Analyze the teacher's teaching behavior based on the movement trajectory heat map.

[0058] Specifically, the teacher's location information is extracted through visual information, and image processing technology, such as feature point detection and tracking algorithm, is used to continuously track the teacher's location information to form a complete movement trajectory. The tracked data can also be cleaned here to remove noise and outliers to ensure the accuracy and continuity of the movement trajectory.

[0059] Then select a suitable data visualization tool, such as ArcGIS, Tableau, QGIS, or matplotlib and seaborn libraries in Python, and import the cleaned teacher movement trajectory data into the visualization tool.

[0060] Set the parameters of the heat map according to the classroom layout, such as color mapping range, heat point size, transparency, etc. According to the set parameters, generate a heat map of the teacher's movement trajectory, that is, a movement trajectory heat map. Figure 4 It is a schematic diagram of the movement trajectory heat map provided by the present invention. The movement trajectory heat map reflects the movement frequency and residence time of teachers in different areas through the depth of color.

[0061] On this basis, the teacher's teaching behavior is analyzed based on the mobile trajectory heat map. Through the mobile trajectory heat map, we can intuitively see the teacher's movement pattern in the classroom, such as frequently visited areas and seldom visited areas.

[0062] Combined with the teacher's movement trajectory, analyze the teacher's teaching style. For example, if the teacher moves frequently in the front and middle of the classroom, it may indicate that he or she focuses on face-to-face communication with students and blackboard demonstrations; if the teacher stays in the back or corner of the classroom for a long time, it may be that he or she is giving individual tutoring or observing students.

[0063] By observing the hot spots and cold spots in the movement trajectory heat map, you can evaluate the interaction in the class. Hot spots may indicate active and highly engaged students, while cold spots may indicate low student engagement or teaching blind spots.

[0064] Based on the analysis results, targeted improvement suggestions can be put forward. For example, for teaching blind spots, teachers can adjust teaching strategies and increase attention to this area; for low student participation, teachers can design more interactive sessions to increase students' learning interest and participation.

[0065] Based on any of the above embodiments, Figure 5 3 is a flow chart of the teaching behavior analysis method provided by the present invention, such as Figure 5 As shown, based on the teaching medium heat map, the teaching behavior analysis is performed, that is, step 130 specifically includes: Step 131, performing behavior recognition on visual information to obtain the student's classroom behavior; Step 132, conduct teaching behavior analysis based on the teaching medium heat map and students' classroom behavior.

[0066] Specifically, the classroom behavior of students can be obtained through behavior recognition technology, and behavior recognition can be obtained through human key point detection and target detection. For example, algorithms such as OpenPose are used to extract human key points, such as head, hands, body, etc., as posture information. These key point information can reflect the different postures of students, such as sitting upright, raising hands, leaning sideways, lowering heads, etc. Using the target detection model, more detailed detection is performed on specific areas (such as hands) to identify specific hand behaviors (such as taking notes, playing with mobile phones, etc.). Combining posture information and target detection results, student behaviors are divided into different categories, such as using mobile phones, lying on the table, turning around, eating, passing things, reading and writing, standing up, and looking at the blackboard.

[0067] On this basis, the teaching behavior analysis can be conducted by combining the teaching media heat map and the students' classroom behavior. The teaching media heat map can reflect the students' attention to each area in the teaching media. Through the teaching media heat map and the students' classroom behavior, the relationship between student behavior and the use of teaching media can be analyzed, and the changes in students' classroom behavior at different stages of media use can be analyzed, such as students' gaze behavior when the teacher uses PPT, and students' note-taking behavior when the teacher writes on the blackboard. The relationship between behavior and teaching effectiveness can also be analyzed, and the impact of different classroom behaviors on teaching effectiveness can be analyzed by combining students' academic performance, participation and other data.

[0068] The method provided in the embodiment of the present invention performs teaching behavior analysis based on the teaching medium heat map and the students' classroom behavior, and can present classroom data in multiple dimensions, thereby helping teachers to better improve teaching effectiveness.

[0069] Based on any of the above embodiments, a teaching behavior analysis method is provided, the method comprising: S1, obtains visual information of the teaching environment, which includes depth map and two-dimensional map.

[0070] S2, based on visual information, captures the area where students' eyes focus on the teaching media, and generates a teaching media heat map based on the area where students' eyes focus on the teaching media.

[0071] S3, based on the teaching media heat map, conduct teaching behavior analysis. Specifically, by obtaining the heat map of all blackboard writing in the entire class, statistical analysis can be performed on the attention paid to different blackboard writing styles and blackboard writing content. For example, by analyzing the heat map of blackboard writing content, it can be clearly and quantitatively seen that students pay more attention to information such as geometric figures, conclusion sentences, core formulas, and circled content. At the same time, the heat analysis range of each page of blackboard writing can be analyzed and counted to understand students' attention to the layout of the blackboard and the style of content presentation.

[0072] By obtaining the heat map of teachers' courseware, we can also conduct statistical analysis on the attention paid to different courseware styles and courseware contents. We can clearly and quantitatively see that students pay more attention to picture information and picture information with expressions. At the same time, by analyzing and counting the thermal analysis range of each page of the courseware, we can understand students' attention to the layout of the courseware and the style of content presentation.

[0073] By analyzing the heat maps of different teachers' blackboard writing and courseware, we can screen out excellent blackboard writing and courseware templates to promote the improvement of the blackboard writing and courseware level of teachers throughout the school, thereby improving the effectiveness of knowledge transfer and improving teaching quality.

[0074] S4, determines the movement trajectory of the teacher during the teaching process based on visual information, and generates a movement trajectory heat map based on the movement trajectory; based on the movement trajectory heat map, analyzes the teacher's teaching behavior.

[0075] S5, conducts behavior recognition on visual information to obtain students’ classroom behavior; conducts teaching behavior analysis based on the teaching medium heat map and students’ classroom behavior.

[0076] The method provided by the embodiment of the present invention captures the area of ​​students' eye focus on the screen during classroom teaching, and realizes a heat map of the teaching process such as courseware and blackboard writing after processing by an AI algorithm, so as to help teachers analyze students' focus points, promote the improvement of teaching design, improve the quality of courseware and blackboard writing, and thus improve the effectiveness of knowledge transfer; at the same time, it analyzes the teacher's movement trajectory and students' classroom status, presents classroom data in multiple dimensions, and helps teachers better improve teaching results.

[0077] The teaching behavior analysis device provided by the present invention is described below. The teaching behavior analysis device described below and the teaching behavior analysis method described above can be referenced to each other.

[0078] Based on any of the above embodiments, Figure 6 Schematic diagram of the teaching behavior analysis device provided by the present invention. Figure 6 As shown, the device comprises: An acquisition unit 610, configured to acquire visual information of a teaching environment, wherein the visual information includes a depth map and a two-dimensional map; A generating unit 620, configured to capture the area of ​​interest of the student's eyes on the teaching medium based on the visual information, and generate a teaching medium heat map based on the area of ​​interest of the student's eyes on the teaching medium; The analysis unit 630 is used to perform teaching behavior analysis based on the teaching medium heat map.

[0079] The teaching behavior analysis device provided by the embodiment of the present invention obtains visual information of the teaching environment, captures the attention area of ​​the students' eyes on the teaching media, and generates a teaching media heat map based on the attention area of ​​the students' eyes on the teaching media. The teaching media heat map can more intuitively show the students' attention. On this basis, based on the teaching media heat map, the teaching behavior analysis is performed to understand the distribution of students' attention in the classroom, realize automatic analysis of feedback information, and then adjust the teaching methods and strategies according to the analysis results, which can improve the teaching effect.

[0080] Based on any of the above embodiments, the analysis unit is specifically used for: Based on the teaching medium heat map, the students' attention to the style, content and layout of the teaching medium is analyzed to obtain analysis results.

[0081] Based on any of the above embodiments, it also includes an optimization unit, which is used to: Based on the analysis results of each teaching medium, a target teaching medium is screened from the teaching media, and / or the teaching medium is iteratively optimized.

[0082] Based on any of the above embodiments, it also includes a trajectory analysis unit, which is used to: Determine the movement trajectory of the teacher during the teaching process based on the visual information, and generate a movement trajectory heat map based on the movement trajectory; Based on the movement trajectory heat map, the teacher's teaching behavior is analyzed.

[0083] Based on any of the above embodiments, the analysis unit is specifically used for: Performing behavior recognition on the visual information to obtain the student's classroom behavior; Based on the teaching medium heat map and the students' classroom behavior, teaching behavior analysis is performed.

[0084] Based on any of the above embodiments, Figure 7 Schematic diagram of the teaching behavior analysis system provided by the present invention. Figure 7 As shown, the system includes: an image acquisition device 710, a processor 720 and an output device 730; An image acquisition device, used to acquire visual information of the teaching environment and send the visual information to the processor, the visual information including a depth map and a two-dimensional map; A processor, for capturing the attention area of ​​the students' eyes on the teaching medium based on the visual information, generating a teaching medium heat map based on the attention area of ​​the students' eyes on the teaching medium, and performing teaching behavior analysis based on the teaching medium heat map; The output device is used to output the teaching medium heat map and the results of the teaching behavior analysis.

[0085] Specifically, the image acquisition device can be a 3D depth camera, and the 3D depth camera can be an Orbbec FemtoMega model. The teaching medium can be, for example, an intelligent interactive tablet, and the main control platform of the intelligent interactive tablet can be an MTK9666 platform, 3G memory, 16G ROM, and Android 12 system. The processor can be set in a microcomputer, and the microcomputer can be equipped with an 11th generation I5 Intel main control, plus a high-computing power processing card, and the output device can be a display.

[0086] The teaching behavior analysis system provided by the embodiment of the present invention obtains visual information of the teaching environment, captures the attention area of ​​the students' eyes on the teaching media, and generates a teaching media heat map based on the attention area of ​​the students' eyes on the teaching media. The teaching media heat map can more intuitively show the students' attention. On this basis, based on the teaching media heat map, the teaching behavior analysis is performed to understand the distribution of students' attention in the classroom, realize automatic analysis of feedback information, and then adjust the teaching methods and strategies according to the analysis results, which can improve the teaching effect.

[0087] Figure 8 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 8 As shown, the electronic device may include: a processor 810, a communication interface 820, a memory 830 and a communication bus 840, wherein the processor 810, the communication interface 820 and the memory 830 communicate with each other through the communication bus 840. The processor 810 may call the logic instructions in the memory 830 to execute the teaching behavior analysis method, which includes: obtaining visual information of the teaching environment, the visual information including a depth map and a two-dimensional map; based on the visual information, capturing the focus area of ​​the student's eyeball on the teaching medium, and generating a teaching medium heat map based on the focus area of ​​the student's eyeball on the teaching medium; and performing teaching behavior analysis based on the teaching medium heat map.

[0088] In addition, the logic instructions in the above-mentioned memory 830 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0089] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the teaching behavior analysis method provided by the above-mentioned methods, which method includes: obtaining visual information of the teaching environment, wherein the visual information includes a depth map and a two-dimensional map; based on the visual information, capturing the area of ​​interest of the students' eyes on the teaching medium, and based on the area of ​​interest of the students' eyes on the teaching medium, generating a teaching medium heat map; and performing teaching behavior analysis based on the teaching medium heat map.

[0090] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the teaching behavior analysis method provided by the above-mentioned methods, the method comprising: acquiring visual information of the teaching environment, the visual information comprising a depth map and a two-dimensional map; based on the visual information, capturing the area of ​​interest of the students' eyes on the teaching medium, and generating a teaching medium heat map based on the area of ​​interest of the students' eyes on the teaching medium; and performing teaching behavior analysis based on the teaching medium heat map.

[0091] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0092] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0093] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A teaching behavior analysis method, characterized in that: include: Acquire visual information of the teaching environment, wherein the visual information includes a depth map and a two-dimensional map; Capturing the area of ​​interest of the students' eyes on the teaching medium based on the visual information, and generating a teaching medium heat map based on the area of ​​interest of the students' eyes on the teaching medium; Based on the teaching medium heat map, teaching behavior analysis is performed.

2. The teaching behavior analysis method according to claim 1, characterized in that: The teaching behavior analysis based on the teaching medium heat map includes: Based on the teaching medium heat map, the students' attention to the style, content and layout of the teaching medium is analyzed to obtain analysis results.

3. The teaching behavior analysis method according to claim 1, characterized in that: Based on the teaching medium heat map, analyzing the students' attention to the style, content, and layout of the teaching medium to obtain the analysis results, and then further comprising: Based on the analysis results of each teaching medium, a target teaching medium is screened from the teaching media, and / or the teaching medium is iteratively optimized.

4. The teaching behavior analysis method according to any one of claims 1 to 3, characterized in that: The method further comprises: Determine the movement trajectory of the teacher during the teaching process based on the visual information, and generate a movement trajectory heat map based on the movement trajectory; Based on the movement trajectory heat map, the teacher's teaching behavior is analyzed.

5. The teaching behavior analysis method according to any one of claims 1 to 3, characterized in that: The teaching behavior analysis based on the teaching medium heat map includes: Performing behavior recognition on the visual information to obtain the student's classroom behavior; Based on the teaching medium heat map and the students' classroom behavior, teaching behavior analysis is performed.

6. A teaching behavior analysis device, characterized in that: include: An acquisition unit, used to acquire visual information of the teaching environment, wherein the visual information includes a depth map and a two-dimensional map; A generating unit, configured to capture the area of ​​interest of the student's eyes on the teaching medium based on the visual information, and generate a teaching medium heat map based on the area of ​​interest of the student's eyes on the teaching medium; The analysis unit is used to perform teaching behavior analysis based on the teaching medium heat map.

7. A teaching behavior analysis system, characterized in that: include: Image acquisition device, processor and output device; The image acquisition device is used to acquire visual information of the teaching environment and send the visual information to the processor, wherein the visual information includes a depth map and a two-dimensional map; The processor is used to capture the attention area of ​​the student's eyes on the teaching medium based on the visual information, generate a teaching medium heat map based on the attention area of ​​the student's eyes on the teaching medium, and perform teaching behavior analysis based on the teaching medium heat map; The output device is used to output the teaching medium heat map and the results of the teaching behavior analysis.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the teaching behavior analysis method as described in any one of claims 1 to 5 is implemented.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the teaching behavior analysis method according to any one of claims 1 to 5 is implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the teaching behavior analysis method according to any one of claims 1 to 5 is implemented.

Images