Interactive teaching method, device, storage medium and equipment terminal

Abstract

The application is suitable for the technical field of internet education, and provides an interactive teaching method, device, storage medium and equipment terminal, the method comprises the following steps: formulating a teaching plan in accordance with the basic information of students collected during registration; teaching students according to the teaching plan, and collecting picture information and operation information of students in the teaching process; determining the learning state, emotional state and learning progress of students according to the collected picture information and operation information; and adjusting the teaching plan according to the learning state, emotional state and learning progress of students. The interactive teaching method provided by the application solves the problem of poor learning effect and experience when students learn according to fixed courses.

Description

Technical Field

[0001] This invention belongs to the field of internet education technology, and in particular relates to an interactive teaching method, device, storage medium and equipment terminal. Background Technology

[0002] With the advancement of scientific knowledge and parents' growing demand for better learning experiences for their children, more and more parents are turning to online education to enable their children to learn from high-quality content provided by excellent online instructors.

[0003] Currently, due to the nature of online learning, it is impossible to identify students' offline learning behavior in real time. This has led to situations where other users are allowed to complete online courses on behalf of students, or even students using virtual users (such as user images or recorded videos of user viewing behavior) to complete online courses.

[0004] Meanwhile, existing online courses are fixed and unchanging once generated. However, due to the different levels of learning and absorption of knowledge among students, some students experience boredom or even drowsiness and lack of concentration when they have mastered all the knowledge in the fixed courses, while others experience anxiety due to falling behind. Therefore, it is impossible for all students to achieve a completely consistent learning pace with the same fixed courses. It is impossible to personalize courses according to the learning status of each student, resulting in poor learning effectiveness and experience for students learning according to the fixed courses. Summary of the Invention

[0005] The purpose of this invention is to provide an interactive teaching method that aims to solve the problem of poor learning outcomes and experience for students when learning according to fixed courses.

[0006] This invention is implemented as follows: an interactive teaching method, the method comprising:

[0007] A teaching plan tailored to the students will be developed based on the basic information collected during registration.

[0008] The teaching is conducted according to the teaching plan, and the students' screen and operation information is collected during the teaching process;

[0009] The student's learning status, emotional state, and learning progress are determined based on the collected video and operational information.

[0010] The teaching plan should be adjusted according to the students' learning status, emotional state and learning progress.

[0011] Furthermore, the steps for determining the student's learning status, emotional state, and learning progress based on the collected image and operation information include:

[0012] The student's learning status is determined based on the body posture and / or eye movements in the collected video information;

[0013] Determine the student's emotional state based on facial expressions in the collected video footage;

[0014] The student's learning progress is determined based on the collected operational information.

[0015] Furthermore, the basic information includes personal information, identity information, and learning objectives, and the teaching plan includes teaching content and teaching schedule;

[0016] The steps for developing a teaching plan tailored to students based on their basic information collected during registration include:

[0017] Determine the teaching resources needed by students based on their personal information;

[0018] Based on teaching resources and learning objectives, recommend corresponding teaching content;

[0019] Based on the teaching content and learning objectives, a teaching schedule is developed for students.

[0020] Furthermore, the step of adjusting the teaching plan according to the students' learning status, emotional state, and learning progress also includes:

[0021] When any one or more combinations of a student's learning status and emotional status are determined to be negative during the teaching process, voice interaction prompts or preset content will be displayed.

[0022] If, during the teaching process, any one or more combinations of a student's learning state and emotional state are determined to be in a negative state after a predetermined number of attempts, the teaching plan should be suspended.

[0023] Furthermore, the method also includes:

[0024] The student's learning file is sent to the corresponding linked teacher's account so that the teacher can determine whether the teaching plan in the learning file needs to be adjusted. The learning file includes the student's basic information, teaching plan, the student's screen information and operation information collected during the teaching process, as well as the student's learning status, emotional status and learning progress.

[0025] Receive and update the revised lesson plans sent from the teacher's account.

[0026] Furthermore, the method also includes:

[0027] Facial feature information is extracted from the facial information in the collected images.

[0028] The extracted facial features are converted into digital feature information;

[0029] Generate the public and private keys in the key pair based on digital feature information;

[0030] Send the private key from the key pair to the corresponding bound teacher account.

[0031] Furthermore, the step of sending the student's learning record to the corresponding linked teacher account includes:

[0032] The learning file is encrypted using a public key temporarily generated based on facial information and sent to the teacher's account. The teacher's account then uses the received private key to decrypt the encrypted data to obtain the learning file, calculates the hash value of the adjusted teaching plan, and signs the hash value using the private key to obtain a signed file.

[0033] The steps of receiving the adjusted teaching plan sent by the teacher's account and updating the teaching plan include:

[0034] Receive the revised lesson plan and signed documents sent from the teacher's account;

[0035] The hash value is obtained by decrypting and verifying the signature file using a public key temporarily generated based on facial information.

[0036] The received teaching plan is hashed, and the result is compared with the hash value obtained by decrypting the signature.

[0037] When the comparison is consistent, the teaching plan is updated using the adjusted teaching plan.

[0038] Another embodiment of the present invention aims to provide an interactive teaching device, the device comprising:

[0039] The teaching plan development module is used to develop teaching plans that suit students based on the basic information collected during registration. The basic information includes personal information, identity information, and learning objectives.

[0040] The information collection module is used to teach students according to the teaching plan and collect students' screen and operation information during the teaching process.

[0041] The information determination module is used to determine the student's learning status, emotional state, and learning progress based on the collected screen information and operation information.

[0042] The teaching plan adjustment module is used to adjust the teaching plan according to students' learning status, emotional state, and learning progress.

[0043] Another embodiment of the present invention aims to provide a storage medium on which a program is stored, characterized in that the program, when executed by a processor, implements the interactive teaching method as described above.

[0044] Another embodiment of the present invention aims to provide a device terminal, including a memory, a processor, and a program stored in the memory and executable on the processor, wherein the processor executes the program to implement the interactive teaching method as described above.

[0045] The interactive teaching method provided in this invention collects students' basic information to formulate teaching plans tailored to each student. This allows for personalized customization of courses from the outset, creating corresponding teaching plans based on each student's individual circumstances. Furthermore, by collecting and analyzing students' visual and operational information during the teaching process, the method obtains information about their learning status, emotional state, and progress. This allows for understanding of students' learning progress and enabling adjustments to the teaching plan based on their learning status, emotional state, and progress. This includes adjusting teaching strategies such as content and pace to make learning more comfortable, improve learning outcomes and experience, meet the diverse learning needs of students, and solve the problem of poor learning outcomes and experiences when students follow fixed courses. Attached Figure Description

[0046] Figure 1 This is a flowchart of the interactive teaching method provided in the embodiments of the present invention;

[0047] Figure 2 This is a schematic diagram of the structure of the interactive teaching device provided in an embodiment of the present invention;

[0048] Figure 3 This is a schematic diagram of the structure of the device terminal provided in an embodiment of the present invention. Detailed Implementation

[0049] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention.

[0050] In this invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," "linking," "fixing," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal communication between two components. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances. The term "and / or" as used herein includes any and all combinations of one or more of the related listed items.

[0051] Example 1

[0052] Please see Figure 1 This is a flowchart illustrating the interactive teaching method provided in the first embodiment of the present invention. For ease of explanation, only the parts related to the embodiment of the present invention are shown. The method includes:

[0053] Step S10: Develop a teaching plan that suits the students based on the basic information collected during registration;

[0054] In one embodiment of the present invention, the interactive teaching method is mainly applied to the teaching and tutoring application of the device terminal to provide teaching and tutoring for students. The device terminal includes, but is not limited to, smart terminals, smart tablets, laptops and computer devices. It should be noted that the device terminal is equipped with at least one image sensor (specifically a camera) for collecting image information of the student's learning, so that image information can be collected when the student is watching the screen content of the device terminal for learning. That is, the smart terminal, smart tablet or laptop is equipped with at least one front-facing camera, and the computer device is equipped with at least one external camera that collects image information from the student's side.

[0055] Furthermore, when students use the teaching and tutoring application for the first time, they need to register to create a personal learning profile. During registration, the student's basic information is collected, and the student enters various information, including but not limited to personal information, identity information, and learning goals.

[0056] The personal information includes, but is not limited to, name, age, gender, school, grade, class, and teachers of each subject. Based on this personal information, the student's age, school, and grade can be used to preliminarily determine the required textbooks and other information. The grade, class, and teachers can be linked to individual teacher accounts. It should be noted that each teacher also registers in the teaching and tutoring application and can link their account to the student accounts in the classes they teach. This allows for subsequent online teaching of all students in the class and for teachers to access individual student learning information to assess their learning status and preferences.

[0057] The identity information includes, but is not limited to, fingerprint information, facial information, iris information, and voiceprint information. Since the device terminal used in this interactive teaching method is equipped with at least an image sensor, the identity information collected from students is usually facial information. Of course, depending on the specific hardware configuration of the device terminal, it can further collect one or more combinations of fingerprint information, iris information, or voiceprint information as identity information. The identity information is set according to the actual configuration of the device terminal and the actual use needs, and no specific limitation is made here.

[0058] Learning objectives are the goals set by students for learning. They are expected results or goals to be achieved within a certain period of time, whether long-term or short-term. For example, students may read a textbook and complete a test with a passing grade within a month. These are mainly goals set by students based on their actual learning interests or task requirements, and no specific limitations are made here.

[0059] Furthermore, in other embodiments of the present invention, the basic information may also include learning habits, that is, the stable behavioral patterns or thinking patterns formed by students during the learning process. For example, students usually study a certain subject at a certain time, or take a break or switch to other subjects or other learning methods when they reach a preset time or preset progress during the learning process (e.g., from studying reading to answering questions), etc. It is determined according to the actual behavioral patterns of different students during the learning process, and is not specifically limited here.

[0060] Furthermore, after a student registers their basic information—that is, after entering the aforementioned personal information, identity information, learning goals, and even learning habits—a learning profile is created for that student, and this profile is updated accordingly each time the student engages in learning. At this point, a teaching plan tailored to the student is developed based on the basic information collected during registration. This teaching plan includes, but is not limited to, teaching content and schedule, and is also included in the learning profile. Specifically, the teaching plan is primarily developed based on the student's personal information and learning goals. Referring to the above, firstly, the required teaching resources are determined based on the student's age, school, and grade level, such as relevant textbooks, articles, video tutorials, and practice questions. Further, based on the aforementioned teaching resources and learning goals, corresponding teaching content and schedule are developed. In this embodiment of the invention, more specifically, it can first recommend corresponding teaching content based on the aforementioned teaching resources and learning goals; then, based on the teaching content and learning goals, a teaching schedule is developed for the student. Therefore, by developing corresponding teaching plans based on students' basic information, it is possible to provide personalized teaching plans for each student, so as to adapt to the different learning needs of each student and ensure that students can obtain the maximum learning benefits, thereby helping them to better master knowledge.

[0061] Of course, in other embodiments of the present invention, the teaching plan may also include teaching methods, which can correspond to the learning habits described above. For example, the teaching method may involve pausing teaching when a preset time or preset progress is reached, allowing students to take a break; or switching to other subjects or other teaching methods (e.g., changing from reading to answering questions) when a preset time or preset progress is reached. Furthermore, the teaching method can utilize the hardware of the device terminal to implement different teaching methods. For example, using hardware such as gyroscopes, accelerometers, and touchscreens in the device terminal to enable students to conduct hands-on simulations to learn physics, or using microphones and other sound pickup modules in the device terminal to enable voice interaction to learn language arts. By employing multiple interactive methods, students can better participate in the teaching process. It should be noted that different teaching content can correspond to different teaching methods. For example, when learning language arts, oral interaction can be provided, allowing students to learn language arts through voice interaction; while when learning physics, hands-on experiments can be provided, allowing students to learn physics through hands-on experiments. Of course, the same teaching content can correspond to different teaching methods. For example, as mentioned above, students can learn through hands-on interactive methods, or they can learn by reading teaching content such as articles or watching videos. It should be noted that this teaching method needs to be determined based on the curriculum and the hardware configuration of the equipment. If the course provider has not developed and provided corresponding simulated teaching courses or the equipment does not have the corresponding hardware configuration, this hardware-assisted teaching method will not be used. In this case, existing conventional teaching content playback or answering / writing methods are usually chosen. Therefore, based on the students' basic information, a teaching method suitable for their learning can be formulated. More specifically, the teaching method is formulated based on the teaching content and learning objectives mentioned above. This teaching content can be from different subjects, such as text reading in language arts, calculation and answering in mathematics, scientific experiments in physics and chemistry, and singing in music.

[0062] Of course, in other embodiments of the present invention, referring to the above description, when the student's basic information also includes learning habits, a teaching plan can be formulated accordingly based on personal information, learning goals, and learning habits, that is, the teaching content and teaching schedule can be formulated. Referring to the above description, firstly, the teaching resources required by the student are determined based on the age, school, and grade in the personal information, and then the corresponding teaching content and teaching schedule are formulated based on the teaching resources, learning goals, and learning habits mentioned above. More specifically, corresponding teaching content can be recommended first based on the learning goals in the personal information and the teaching resources mentioned above; then, the teaching schedule can be formulated based on the teaching content, learning goals, and learning habits. When the teaching plan as described above also includes teaching methods, the teaching content, teaching schedule, and teaching methods are formulated accordingly based on the personal information, learning goals, and learning habits. In this case, the method of formulating the teaching content and teaching schedule refers to the above description, and the method of formulating the teaching methods is mainly determined based on the teaching content, learning goals, and learning habits, that is, the teaching methods are formulated based on the teaching content, learning goals, and learning habits.

[0063] Step S20: Teach students according to the teaching plan and collect students' screen information and operation information during the teaching process;

[0064] In one embodiment of the present invention, after a teaching plan is formulated based on the student's basic information, when the student chooses to begin learning, the teaching can be conducted accordingly. Specifically, the teaching content in the teaching plan is displayed on the device terminal. For example, when learning reading comprehension in Chinese, the article or teaching video is displayed so that the student can learn according to the teaching content; or when answering questions in subjects such as mathematics, questions are displayed so that the student can answer the questions according to the teaching content. At the same time, the teaching speed of the teaching content is controlled according to the teaching progress in the teaching plan, such as controlling the playback speed of the teaching video and controlling the amount of teaching content to be learned each time.

[0065] Of course, in other embodiments of the present invention, when the teaching plan also includes teaching methods, the teaching pace or type of the teaching content is controlled accordingly based on the teaching methods in the teaching plan. Specifically, as described above, when the teaching method corresponds to the above-mentioned learning habits, the teaching pace of the teaching content can be controlled accordingly based on the teaching method. For example, as described above, teaching can be paused when a preset time or preset progress is reached during the teaching process. When the teaching method also includes implementation by the setting of the teaching course and the hardware configuration of the equipment terminal, the teaching type of the teaching content can also be controlled accordingly based on the teaching method. For example, as described above, hands-on experiments allow students to learn physics knowledge through personal simulation experiments.

[0066] Furthermore, during the teaching process according to the teaching plan, the device terminal also collects the students' screen information and operation information. The screen information consists of image data collected by the image sensor in the device terminal, while the operation information is the data generated when students operate the device terminal, such as answer data during a question-and-answer session or action data during a simulated experiment. It should be noted that the screen information is collected in real-time by the device terminal or at preset intervals (e.g., five seconds, ten seconds), with real-time collection being preferred. Operation information is collected only when students operate the device terminal. Therefore, while the device terminal may continuously collect screen information during data collection, it may not necessarily collect operation information; that is, the collected screen information and operation information are not completely synchronized.

[0067] Step S30: Determine the student's learning status, emotional state, and learning progress based on the collected screen information and operation information;

[0068] In one embodiment of the present invention, after collecting the student's screen information and operation information during the teaching process, the student's learning status, emotional state, and learning progress are determined accordingly based on the collected screen information and operation information. Specifically, step S30 can be implemented through the following steps:

[0069] Determine students' learning and emotional states based on the collected video information;

[0070] The student's learning progress is determined based on the collected operational information.

[0071] Specifically, when a student is within the frame captured by the device, the information captured primarily consists of the student's facial features. This facial information is displayed as a full-body image or a partial headshot, depending on the student's distance from the device. Typically, the captured image mainly shows the student's facial outline, with a smaller portion also including the upper body outline. Based on this captured image information, identity verification can be performed, and the student's learning and emotional states can also be identified and analyzed.

[0072] It should be noted that when a student's facial information is not recognized in the image information captured by the device terminal, meaning the student has left the device terminal, the current teaching plan should be paused, i.e., the display of teaching content should be paused. At this time, a pop-up window or voice prompt can be issued to remind the student to return to the device terminal to continue learning. The current teaching plan can be resumed when the student's facial information is recognized again in the image information captured by the device terminal. This image capture ensures that the student is present and avoids the problem of students not learning effectively when teaching continues even when the student is not present. Optionally, to avoid the problem of students not being captured in the image due to incorrect posture while using the device terminal, the image captured by the image sensor can be displayed in a specific area of ​​the device terminal screen at a specific size, allowing the student to clearly see the image captured by the image sensor.

[0073] Furthermore, in one embodiment of the present invention, since facial recognition technology can be used to authenticate students based on the collected image information, that is, the currently collected image information is compared with the student's identity information collected during registration. When the comparison matches, the current student identity authentication is completed; when the comparison does not match, the identity authentication fails. In this case, if the identity authentication fails based on the image information collected by the device terminal, meaning that the student may have been replaced by another user and the collected image information has changed, the current teaching plan is paused accordingly. Simultaneously, pop-up windows or voice prompts can be displayed to remind the student to return to the device terminal to continue learning until the identity authentication is completed based on the image information collected by the device terminal, at which point the current teaching plan is resumed. This identity authentication ensures the accuracy of the student's identity, preventing the problem of students not receiving effective learning due to other users replacing them; it also ensures the security and privacy of student information.

[0074] Furthermore, in other embodiments of the present invention, when a student is learning at any time, identity authentication is performed based on the screen information collected by the device terminal, and the corresponding student and their learning file are determined based on the identity authentication result. At this time, teaching can continue directly based on the student's previous teaching plan according to the learning file, that is, the student's learning at the previous interruption point can be resumed to achieve the continuity of learning. Of course, if the student does not need to learn the previous teaching plan, the student can also choose to exit and select the subject they need to learn.

[0075] Furthermore, the steps described above for determining students' learning and emotional states based on the collected video information include:

[0076] The student's learning status is determined based on the body posture and / or eye movements in the collected video information;

[0077] The student's emotional state is determined based on the facial expressions captured in the images.

[0078] Specifically, the learning status of students can be determined based on body posture and / or eye movements in the collected image information. This means that the learning status can be determined based on a single body posture or eye movement, or a combination of both. Among the methods of determining the learning status based on body posture, posture recognition technology is mainly used to analyze the student's posture and thus infer their learning status. For example, by analyzing changes in the posture of the student's head and arms, it can be inferred whether the student is paying attention or fatigued. Alternatively, head posture recognition technology can be used to determine whether the student's head is tilted down or away from the screen, thus inferring their learning status, i.e., their level of concentration. If a student is consistently or repeatedly tilted down or away from the screen within a preset time period, it can be inferred that their attention is not focused. Among the methods of determining the learning status based on eye movements, eye-tracking technology is mainly used to track the student's eye movements and thus infer their learning status. For example, by analyzing changes in the student's gaze point to determine whether they frequently shift their gaze, it can be inferred whether the student is focused or distracted. Correspondingly, it determines the student's learning status based on body posture and eye movement. For example, if a student frequently shifts their gaze, looks down, or does not look at the screen, it can be inferred that the student's attention is scattered.

[0079] Furthermore, the student's emotional state is determined based on facial expressions captured in the images. Specifically, facial expression recognition technology is used to analyze the student's micro-expressions, such as changes in the eyebrows, eyes, and mouth, to infer their emotional state and determine whether they are experiencing anxiety, boredom, or fatigue. Understandably, the determination of the learning and emotional states mentioned above can be analyzed and judged using existing image processing techniques and machine learning algorithms; therefore, the specific methods of analysis and judgment are not limited here.

[0080] Furthermore, in other embodiments of the present invention, the collected image information can be combined with the audio information collected by the sound pickup module (specifically, the microphone) in the device terminal to determine the student's emotional state. That is, the student's emotional state is determined based on the image information and audio information. The audio information includes the student's tone of voice and semantics. The emotional state can be determined by changes in tone of voice and semantic recognition. For example, a student using a high-pitched, fast, and fluent tone of voice may indicate a positive attitude towards learning, while a student using a low, slow, and dull tone of voice may indicate a tired and listless attitude towards learning. Semantic recognition technology can be used to obtain the specific content of the student's speech and perform semantic analysis to obtain the corresponding emotional state. For example, if a student keeps saying "It's so hard," it can be determined that the student is experiencing anxiety. Combining image information and audio information allows for a more accurate determination of the student's emotional state.

[0081] It should be noted that both the student's learning state and emotional state are categorized into positive and negative states. For example, when a student is studying diligently and attentively, they are in a positive learning state. Conversely, when a student frequently shifts their gaze, looks down, or is not looking at the screen and their attention is scattered, they are in a negative learning state. When a student is studying diligently, their expression is relaxed, and they have a smile on their face, they are in a positive emotional state. Conversely, when a student studies with a worried expression, furrowed brows, and a tired demeanor, they are in a negative emotional state.

[0082] Furthermore, the student's learning progress is determined based on the collected operational information. Specifically, by collecting and recording data such as student operation records and answer records during the learning process, including learning time, touch / keyboard / mouse operation data, and answer data, the student's learning speed and accuracy are analyzed to determine their learning progress. It should be noted that when making this judgment, factors such as the subject, learning stage, and individual student characteristics need to be considered. Also, the methods for judging learning progress may not be the same for different subjects. For example, for mathematics, a student's learning progress can be judged by their answering speed and accuracy; for language arts, it can be judged by their reading speed and comprehension ability.

[0083] Step S40: Adjust the teaching plan accordingly based on the students' learning status, emotional state, and learning progress.

[0084] In one embodiment of the present invention, after determining the student's learning status, emotional state, and learning progress based on the collected screen information and operation information, the teaching plan is adjusted accordingly, that is, the teaching content and teaching progress are adjusted.

[0085] Specifically, when a student's learning and emotional state are positive, but their learning progress is faster or slower than the teaching schedule, the teaching schedule will be adjusted accordingly, but the teaching content will not be adjusted. If, after adjusting the teaching schedule, the student's learning progress is still faster or slower than the teaching schedule, then the teaching content and teaching schedule will be adjusted accordingly. For example, if the student's initial learning progress was slow and the teaching content was not adjusted, and the student's progress remains slow after adjusting the teaching schedule, then the teaching content will be adjusted to be slightly easier. For example, in mathematics, the difficulty and number of problems will be adjusted to provide the most suitable learning experience for the student. If the student performs well, more difficult problems will be provided to challenge their abilities; if the student performs poorly, simpler problems will be provided to help them consolidate their basic knowledge.

[0086] Furthermore, if a student's learning status and emotional state are negative in one or more ways, and their learning progress is slower than the teaching progress, the teaching content will be adjusted accordingly. Based on the adjusted content, it will be determined whether the teaching progress needs further adjustment; that is, the difficulty of the content will be reduced, and then the teaching progress will be adjusted accordingly. If, after adjusting the teaching content and pace, the student's learning status and emotional state remain negative in one or more ways, and their learning progress is slower than the teaching progress, the teaching content will be adjusted again. If, after this adjustment, the student's learning status and emotional state are positive, and their learning progress matches the teaching progress, the teaching content and pace will be maintained. If, after this second adjustment, the student's learning status and emotional state remain negative in one or more ways, and their learning progress is slower than the teaching progress, the current teaching plan will be discontinued.

[0087] Furthermore, in other embodiments of the present invention, when the teaching plan also includes teaching methods, the teaching content, teaching progress, and teaching methods are adjusted according to the students' learning status, emotional state, and learning progress. For example, the teaching rhythm or type of the teaching content can be adjusted as described above. For instance, when adjusting the teaching rhythm, the preset time or preset progress for pausing teaching during the teaching process can be adjusted accordingly, or the teaching method can be adjusted (e.g., changing reading to answering questions). When adjusting the teaching type, the teaching type can be changed accordingly, for example, changing the way of reading teaching content to learning teaching content through hands-on simulation experiments.

[0088] Furthermore, in other embodiments of the present invention, when the basic information also includes learning habits, the learning habits can be adjusted accordingly based on the student's learning state, emotional state, and learning progress during the learning process, so as to better meet actual learning needs. For example, if it is detected that a student begins to feel fatigued after studying for 30 minutes, the learning habit can be adjusted accordingly to pause teaching for a period of rest every 30 minutes. Therefore, the teaching method can be adjusted accordingly to pause teaching every 30 minutes. For example, if it is detected that when a student learns a certain course (e.g., physics) using traditional text or video content playback, the student is prone to a negative state; while using an interactive teaching method with hardware-assisted simulated teaching courses, the student is prone to a positive state. Therefore, the learning habit and the teaching method can be adjusted accordingly.

[0089] It should be noted that the above is only one implementation method for adjusting the teaching plan according to the student's learning status, emotional state and learning progress. It cannot exhaust all possible implementations. Various adjustable teaching plans can be set according to actual needs. The purpose of this invention is to achieve adaptive adjustment of the teaching plan according to the student's learning status, emotional state and learning progress, to design a teaching path suitable for the student's individual level and learning interests, to improve the student's learning effect and interest, and to meet the student's learning needs so that the student can better master knowledge. It is not about how to adjust any specific teaching plan.

[0090] Furthermore, in other embodiments of the present invention, the step of adjusting the teaching plan according to the student's learning status, emotional state, and learning progress further includes:

[0091] When any one or more combinations of a student's learning status and emotional status are determined to be negative during the teaching process, voice interaction prompts or preset content will be displayed.

[0092] If, during the teaching process, any one or more combinations of a student's learning state and emotional state are determined to be in a negative state after a predetermined number of attempts, the teaching plan should be suspended.

[0093] In other words, in addition to adjusting the teaching plan as mentioned above, voice interaction prompts or preset content displays can also be used. For example, reminding students to rest and suggesting that they do appropriate exercise or relaxation activities to relieve fatigue; or conveying positive emotional information to students, such as encouragement, support, and understanding, to alleviate students' emotions and thus achieve emotional support; or popping up preset content such as mini-games, music, or videos to allow students to relax and play for a period of time, thereby adjusting their learning state.

[0094] The teaching process resumes after voice interaction prompts or pre-set content display. If, during the pre-set number of teaching sessions, the student's learning and emotional states, determined by the collected visual information, remain in a negative state, the teaching plan is paused. For example, if fatigue recurs after a break as described above, the current learning session is stopped until the next session.

[0095] Therefore, by collecting students' visual information, their learning and emotional states can be determined, allowing for monitoring of their attention span and understanding of their learning progress. This ensures students maintain a high level of concentration and provides breaks when their attention wanes, preventing them from falling behind and hindering their absorption of the material. This effectively improves learning outcomes and experience. Furthermore, collecting students' operational information allows for monitoring their learning progress, ensuring they follow the predetermined learning plan. Adjustments to the learning plan based on changes in students' learning states, emotional states, and progress—such as reminding them to rest, adjusting their pace, or recommending learning resources more suited to their individual levels and interests—create a more comfortable learning environment, ensuring better knowledge acquisition, promoting learning progress, and enhancing both learning effectiveness and experience.

[0096] Furthermore, in other embodiments of the present invention, referring to step S10, the student's learning account is associated with the teacher's account. After the student finishes learning, the student's learning file is sent to the corresponding bound teacher's account. It should be noted that this learning file includes teaching plans for each subject, which are sent to the corresponding teacher's account. This allows the teacher to understand the student's learning status in their assigned subject based on the received learning file and determine whether the adjusted teaching plan needs further optimization. The teacher then receives the adjusted teaching plan from the teacher's account and updates the plan accordingly. Specifically, the learning file includes the student's basic information, the teaching plan, student's visual and operational information collected during the teaching process, and the determined student's learning status, emotional state, and learning progress. It should be noted that the system can annotate keyframes in the visual and operational information (such as images showing negative learning or emotional states, or incorrect answer records), or only provide visual and operational information when the learning, emotional, or learning progress is negative. This allows teachers to quickly determine students' learning status and assess whether a student's current state is poor or the learning difficulty is too high, requiring adjustments to the teaching plan. Teachers can then evaluate the appropriateness of the adjusted plan and optimize it accordingly if deemed unsuitable. This teacher involvement enables more precise adjustments to the teaching plan, leading to a more comfortable learning environment and improved learning outcomes and experience for students. Simultaneously, teachers can better understand students' learning progress based on the teaching plan, allowing for more effective teaching in the classroom.

[0097] Furthermore, in other embodiments of the present invention, during the process of sending student learning files to the corresponding bound teacher accounts and receiving teaching plans sent by the teacher accounts, key encryption technology can be used to encrypt and decrypt the learning files to ensure the security and privacy of student information. Specifically, the teacher account can publish a public key to each bound student account, then use the public key to encrypt the learning files and send them to the teacher account. The teacher account then uses its private key to decrypt the encrypted data to obtain the learning files. When it is determined to adjust the teaching plan based on the learning files, the teacher account first calculates the hash value of the teaching plan, then uses its private key to sign the hash value to obtain a signature file, and then sends the teaching plan and the signature file together to the student account. The student account first uses its public key to decrypt and verify the signature file to obtain a hash value, then calculates the hash value of the received teaching plan, and compares the calculation result with the hash value obtained from the decrypted signature. If the comparison matches, the original teaching plan is updated using the adjusted teaching plan.

[0098] Furthermore, in other embodiments of the present invention, a key can be generated using the student's basic information, thereby further ensuring the security and privacy of the student information, wherein the steps include:

[0099] Facial feature information is extracted from the facial information in the collected student images.

[0100] The extracted facial features are converted into digital feature information;

[0101] Generate the public and private keys in the key pair based on digital feature information.

[0102] Specifically, facial recognition algorithms are first used to identify the collected facial information to determine identity. Once the student's identity is verified, facial features, such as facial contours and eye positions, are extracted from the facial recognition data. These features are then converted into digital features, for example, using a hash algorithm to convert them into digital hash values. The converted digital features are then used as input to generate the private key in an asymmetric encryption algorithm. The generated private key and public key are then used to generate the public key in the key pair. The private key is then sent to the teacher's account so that the teacher can store the private key provided by the linked student account. Furthermore, the student can choose not to store the public key on their device. When the student is learning from the lesson plan on any device, a temporary key is generated based on the collected student facial information. At the end of the lesson, the public key from this temporary key is used to encrypt the lesson plan. The key is then destroyed after use, further ensuring the security of student information and preventing the leakage of keys stored on the device. Correspondingly, the encryption and decryption process follows the above description, except that the public and private keys are generated based on the student's facial information rather than the public and private keys issued by the teacher's account, which will not be elaborated here.

[0103] In this embodiment, by collecting students' basic information, a teaching plan tailored to each student is developed. This allows for personalized customization of the curriculum from the outset, tailoring the teaching plan to each student's individual circumstances. Furthermore, by collecting and analyzing students' visual and operational information during the teaching process, their learning status, emotional state, and learning progress are obtained. This allows for understanding of students' learning progress and enabling adjustments to the teaching plan based on their learning status, emotional state, and learning progress. This includes adjusting teaching strategies such as content and pace to make learning more comfortable for students, improve learning outcomes and experience, meet the diverse learning needs of students, and solve the problem of poor learning outcomes and experiences when students follow fixed courses.

[0104] Example 2

[0105] Please see Figure 2 This is a schematic diagram of the interactive teaching device provided in the second embodiment of the present invention. For ease of explanation, only the parts related to the embodiment of the present invention are shown. The device includes:

[0106] The teaching plan development module 11 is used to develop teaching plans that suit the students based on the basic information collected during registration.

[0107] The information acquisition module 12 is used to teach students according to the teaching plan and to collect students' screen information and operation information during the teaching process.

[0108] The information determination module 13 is used to determine the student's learning status, emotional state, and learning progress based on the collected screen information and operation information.

[0109] The teaching plan adjustment module 14 is used to adjust the teaching plan according to the students' learning status, emotional state and learning progress.

[0110] Furthermore, the information determination module 13 includes:

[0111] The learning status determination unit is used to determine the student's learning status based on the body posture and / or eye movements in the collected image information.

[0112] The emotional state determination unit is used to determine the student's emotional state based on facial expressions in the collected video information.

[0113] The learning progress determination unit is used to determine the student's learning progress based on the collected operational information.

[0114] Furthermore, basic information includes personal information, identity information, and learning objectives, while the teaching plan includes teaching content and teaching schedule;

[0115] Module 11 of the teaching plan development includes:

[0116] The teaching resource determination unit is used to determine the teaching resources needed by students based on their personal information.

[0117] The teaching content development unit is used to recommend corresponding teaching content based on teaching resources and learning objectives;

[0118] The teaching schedule planning unit is used to develop a teaching schedule for students based on the teaching content and learning objectives.

[0119] Furthermore, module 14 of the teaching plan adjustment includes:

[0120] The prompting unit is used to provide voice interaction prompts or display preset content when any one or more combinations of a student's learning status and emotional status are determined to be negative during the teaching process.

[0121] The pause unit is used to pause the teaching plan when, after a predetermined number of times, any one or more combinations of a student's learning status and emotional state are determined to be in a negative state.

[0122] Furthermore, the device also includes:

[0123] The information sending module is used to send students' learning files to the corresponding bound teacher accounts, so that the teachers can determine whether the teaching plan in the learning files needs to be adjusted. The learning files include students' basic information, teaching plans, students' screen information and operation information collected during the teaching process, as well as the students' learning status, emotional status and learning progress.

[0124] The information receiving module is used to receive the adjusted teaching plan sent by the teacher's account and update the teaching plan.

[0125] Furthermore, the device is also used for:

[0126] Facial feature information is extracted from the facial information in the collected images.

[0127] The extracted facial features are converted into digital feature information;

[0128] Generate the public and private keys in the key pair based on digital feature information;

[0129] Send the private key from the key pair to the corresponding bound teacher account.

[0130] Furthermore, the information sending module is also used for:

[0131] The learning file is encrypted using a public key temporarily generated based on facial information and sent to the teacher's account. The teacher's account then uses the received private key to decrypt the encrypted data to obtain the learning file, calculates the hash value of the adjusted teaching plan, and signs the hash value using the private key to obtain a signed file.

[0132] The information receiving module is also used for:

[0133] Receive the revised lesson plan and signed documents sent from the teacher's account;

[0134] The hash value is obtained by decrypting and verifying the signature file using a public key temporarily generated based on facial information.

[0135] The received teaching plan is hashed, and the result is compared with the hash value obtained by decrypting the signature.

[0136] When the comparison is consistent, the teaching plan is updated using the adjusted teaching plan.

[0137] The interactive teaching device provided in this embodiment of the invention has the same implementation principle and technical effects as the aforementioned method embodiment. For the sake of brevity, any parts not mentioned in the device embodiment can be referred to the corresponding content in the aforementioned method embodiment.

[0138] Example 3

[0139] In another aspect, the present invention also proposes a device terminal, please refer to [link / reference]. Figure 3 The device terminal shown is a third embodiment of the present invention, including a memory 20, a processor 10, and a program 30 stored in the memory 20 and executable on the processor. When the processor 10 executes the program 30, it implements the interactive teaching method described above.

[0140] In some embodiments, the processor 10 may be a central processing unit (CPU), controller, microcontroller, microprocessor or other data processing chip, used to run program code stored in memory 20 or process data, such as executing access restriction programs.

[0141] The memory 20 includes at least one type of readable storage medium, such as flash memory, hard disk, multimedia card, card-type memory (e.g., SD or DX memory), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 20 can be an internal storage unit of the device terminal, such as the hard disk of the device terminal. In other embodiments, the memory 20 can be an external storage device of the device terminal, such as a Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the device terminal. Furthermore, the memory 20 can include both internal and external storage units of the device terminal. The memory 20 can be used not only to store application software and various types of data installed on the device terminal, but also to temporarily store data that has been output or will be output.

[0142] It should be pointed out that, Figure 3 The structure shown does not constitute a limitation on the device terminal. In other embodiments, the device terminal may include fewer or more components than shown, or combine certain components, or have different component arrangements.

[0143] In summary, the device terminal in the above embodiments of the present invention, by collecting students' basic information and formulating teaching plans tailored to them, enables personalized customization of courses from the outset. This allows for the creation of corresponding teaching plans based on each student's individual circumstances. Furthermore, by collecting and analyzing students' screen and operational information during the teaching process, the device terminal obtains information about their learning status, emotional state, and learning progress. This allows for understanding of students' learning situation during the teaching process. The device terminal then adjusts the teaching plan accordingly based on students' learning status, emotional state, and learning progress. This adjustment can be made to teaching strategies such as adjusting teaching content and pace, allowing students to learn more comfortably, improving their learning outcomes and experience, meeting the learning needs of different students, and solving the problem of poor learning outcomes and experiences when students follow fixed courses.

[0144] This invention also proposes a storage medium storing a program that, when executed by a processor, implements the interactive teaching method described above.

[0145] Those skilled in the art will understand that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any storage medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "storage medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device.

[0146] More specific examples of storage media (a non-exhaustive list) include: electrical connections (electronic devices) with one or more wires, portable computer disk drives (magnetic devices), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Furthermore, the storage medium can even be paper or other suitable media on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in memory.

[0147] It should be understood that various parts of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0148] In the description of this specification, references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0149] The embodiments described above are merely illustrative of several implementations of the present invention, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of the invention. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of the present invention, and these modifications and improvements all fall within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the appended claims.

Claims

1. An interactive teaching method, characterized in that, The method includes: A teaching plan tailored to the students will be developed based on the basic information collected during registration. The teaching is conducted according to the teaching plan, and the students' screen and operation information is collected during the teaching process; The student's learning status, emotional state, and learning progress are determined based on the collected video and operational information. The teaching plan should be adjusted according to the students' learning status, emotional state and learning progress.

2. The interactive teaching method as described in claim 1, characterized in that, The steps for determining the student's learning status, emotional state, and learning progress based on the collected image and operation information include: The student's learning status is determined based on the body posture and / or eye movements in the collected video information; Determine the student's emotional state based on facial expressions in the collected video footage; The student's learning progress is determined based on the collected operational information.

3. The interactive teaching method as described in claim 1, characterized in that, The basic information includes personal information, identity information, and learning objectives; the teaching plan includes teaching content and teaching schedule. The steps for developing a teaching plan tailored to students based on their basic information collected during registration include: Determine the teaching resources needed by students based on their personal information; Based on teaching resources and learning objectives, recommend corresponding teaching content; Based on the teaching content and learning objectives, a teaching schedule is developed for students.

4. The interactive teaching method as described in claim 1, characterized in that, The steps for adjusting the teaching plan according to students' learning status, emotional state, and learning progress also include: When any one or more combinations of a student's learning status and emotional status are determined to be negative during the teaching process, voice interaction prompts or preset content will be displayed. If, during the teaching process, any one or more combinations of a student's learning state and emotional state are determined to be in a negative state after a predetermined number of attempts, the teaching plan should be suspended.

5. The interactive teaching method as described in claim 1, characterized in that, The method further includes: The student's learning file is sent to the corresponding linked teacher's account so that the teacher can determine whether the teaching plan in the learning file needs to be adjusted. The learning file includes the student's basic information, teaching plan, the student's screen information and operation information collected during the teaching process, as well as the student's learning status, emotional status and learning progress. Receive and update the revised lesson plans sent from the teacher's account.

6. The interactive teaching method as described in claim 5, characterized in that, The method further includes: Facial feature information is extracted from the facial information in the collected images. The extracted facial features are converted into digital feature information; Generate the public and private keys in the key pair based on digital feature information; Send the private key from the key pair to the corresponding bound teacher account.

7. The interactive teaching method as described in claim 6, characterized in that, The steps of sending students' learning records to the corresponding linked teacher accounts include: The learning file is encrypted using a public key temporarily generated based on facial information and sent to the teacher's account. The teacher's account then uses the received private key to decrypt the encrypted data to obtain the learning file, calculates the hash value of the adjusted teaching plan, and signs the hash value using the private key to obtain a signed file. The steps of receiving the adjusted teaching plan sent by the teacher's account and updating the teaching plan include: Receive the revised lesson plan and signed documents sent from the teacher's account; The hash value is obtained by decrypting and verifying the signature file using a public key temporarily generated based on facial information. The received teaching plan is hashed, and the result is compared with the hash value obtained by decrypting the signature. When the comparison is consistent, the teaching plan is updated using the adjusted teaching plan.

8. An interactive teaching device, characterized in that, The device includes: The teaching plan development module is used to develop teaching plans that suit the students based on the basic information collected during registration. The information collection module is used to teach students according to the teaching plan and collect students' screen and operation information during the teaching process. The information determination module is used to determine the student's learning status, emotional state, and learning progress based on the collected screen information and operation information. The teaching plan adjustment module is used to adjust the teaching plan according to students' learning status, emotional state, and learning progress.

9. A storage medium having a program stored thereon, characterized in that, When the program is executed by the processor, it implements the interactive teaching method as described in any one of claims 1-7.

10. A device terminal, characterized in that, It includes a memory, a processor, and a program stored in the memory and executable on the processor, wherein the processor executes the program to implement the interactive teaching method as described in any one of claims 1-7.

Images