Interactive teaching method and device, computing equipment, storage medium and program product

Abstract

The embodiment of the invention discloses an interactive teaching method and device, computing equipment, a storage medium and a program product. The method comprises the following steps: recording an online teaching audio / video and a course script containing an interaction event in an online teaching process to obtain a recorded teaching audio / video and a recorded course script; according to a recording teaching audio and video watching request triggered by a first client, a recording course script is obtained, and the recording course script is analyzed to obtain a corresponding interaction event; and obtaining and playing the recorded teaching audio and video, and if it is monitored that the audio and video resource playing time of the recorded teaching audio and video is consistent with the interaction time of the interaction event, executing the interaction event in the process of playing the audio and video resources, so that the first client participates in teaching interaction. According to the invention, the AI teaching environment of real classroom interaction can be simulated, and based on the pre-recorded course script, the interaction event is executed when the recorded teaching audio / video is played, so that students can also realize interaction when going to the recording class.

Description

Technical Field

[0001] The present application relates to the field of Internet technology, and in particular to an interactive teaching method, apparatus, computing device, storage medium and program product. Background Art

[0002] In today's rapidly developing education field, language teaching is facing many challenges, especially in the context of uneven resource distribution and high teaching costs. Traditional language teaching methods rely on face-to-face interaction, which not only limits the scale of teaching, but also increases the cost of education. With the continuous advancement of technology, automated interactive language teaching methods have emerged, aiming to reduce costs and improve teaching efficiency and quality through technological innovation. However, this teaching method is limited to "live online" teaching and is costly. Summary of the invention

[0003] In view of the above problems, the present application is proposed to provide an interactive teaching method, apparatus, computing device, storage medium and program product that overcome the above problems or at least partially solve the above problems.

[0004] According to one aspect of an embodiment of the present application, an interactive teaching method is provided, the method comprising:

[0005] Recording online teaching audio and video and course scripts including interactive events during the online teaching process to obtain recorded teaching audio and video and recorded course scripts;

[0006] According to the viewing request of the recorded teaching audio and video triggered by the first client, the recorded course script is obtained, and the recorded course script is parsed to obtain the corresponding interactive event;

[0007] Acquire and play the recorded audio and video of the teaching. If it is monitored that the playing time of the audio and video resources of the recorded audio and video of the teaching is consistent with the interaction time of the interactive event, the interactive event is executed during the playing of the audio and video resources to enable the first client to participate in the teaching interaction.

[0008] Further, the method also includes: loading the image acquisition device of the first client;

[0009] Executing interactive events during the playback of audio and video resources further includes:

[0010] If the interactive event includes the second client identifier and wall coordinates of the student occupying the wall, the client video corresponding to the first client will be replaced in the teaching interface of the played video resource according to the wall coordinates corresponding to the second client identifier recorded in the recorded course script.

[0011] Furthermore, executing interactive events during the process of playing audio and video resources further includes:

[0012] If the interactive event type is question answering, then during the playback of the audio and video resources, the question to be answered is displayed to the first client according to the interactive event;

[0013] The method further includes: receiving an interactive operation carrying a first interactive option sent by the first client;

[0014] Determine whether the second interactive option corresponding to the interactive event recorded in the course script is consistent with the first interactive option;

[0015] The preset interaction result is returned to the first client according to the determination result.

[0016] Furthermore, the method also includes: slicing the recorded teaching audio and video, and uploading the sliced ​​audio and video to cloud storage;

[0017] Acquire and play the recorded audio and video of the lecture. If it is monitored that the playback time of the audio and video resources of the recorded audio and video of the lecture is consistent with the interaction time of the interaction event, then executing the interaction event in the process of playing the audio and video resources further includes:

[0018] The sliced ​​audio and video are obtained and played from the cloud. If the playback time of the audio and video resources of the sliced ​​audio and video is monitored to be consistent with the interaction time corresponding to the interaction event, the interaction event is executed during the playback of the sliced ​​audio and video.

[0019] Furthermore, the method further includes: determining the course mastery level of the first client according to the judgment result;

[0020] According to the level of course mastery, the recorded course script and sliced ​​audio and video after the interaction time of the interactive event targeted by the last interactive operation will be replaced.

[0021] Furthermore, obtaining and playing the recorded teaching audio and video further includes:

[0022] The recorded teaching audio and video is obtained according to the acquisition address of the recorded teaching audio and video recorded in the recorded course script, and the recorded teaching audio and video is played.

[0023] According to another aspect of an embodiment of the present application, an interactive teaching device is provided, the device comprising:

[0024] A video recording module, suitable for recording online teaching audio and video, and obtaining recorded teaching audio and video;

[0025] A script recording module is suitable for recording course scripts containing interactive events during online teaching to obtain recorded course scripts;

[0026] The class process module is suitable for obtaining the recorded course script according to the viewing request of the recorded teaching audio and video triggered by the first client; parsing the recorded course script to obtain the corresponding interactive event; obtaining and playing the recorded teaching audio and video; if it is monitored that the playback time of the audio and video resources of the recorded teaching audio and video is consistent with the interactive time of the interactive event, then executing the interactive event during the playback of the audio and video resources to enable the first client to participate in the teaching interaction.

[0027] According to another aspect of the embodiment of the present application, there is provided a computing device, including: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus;

[0028] The memory is used to store at least one executable instruction, and the executable instruction enables the processor to execute operations corresponding to the above-mentioned interactive teaching method.

[0029] According to another aspect of the embodiments of the present application, a computer storage medium is provided, in which at least one executable instruction is stored, and the executable instruction enables a processor to perform operations corresponding to the above-mentioned interactive teaching method.

[0030] According to another aspect of the present application, a computer program product is provided, comprising at least one executable instruction, wherein the executable instruction enables a processor to perform operations corresponding to the above-mentioned interactive teaching method.

[0031] According to the technical solution provided in the present application, an AI teaching environment that can simulate real classroom interaction can be created. Based on pre-recorded course scripts, interactive events can be executed when playing recorded teaching audio and video, so that students can also interact when taking recorded classes, thereby improving the interactivity of the teaching process and increasing its fun. It solves the problem in the prior art that only live online interactive experiences can be experienced while recorded courses lack effective classroom interactive means. At the same time, it achieves efficient use of resources and effective reduction of costs, thereby improving students' learning experience.

[0032] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present application. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0034] Figure 1 A schematic diagram showing a flow chart of an interactive teaching method according to an embodiment of the present application is shown;

[0035] Figure 2 A schematic diagram showing a flow chart of an interactive teaching method according to another embodiment of the present application is shown;

[0036] Figure 3 A schematic diagram showing a flow chart of an interactive teaching method according to another embodiment of the present application is shown;

[0037] Figure 4 A structural block diagram of an interactive teaching device according to an embodiment of the present application is shown;

[0038] Figure 5 A schematic diagram of the structure of a computing device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0039] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0040] Figure 1 A flow chart of an interactive teaching method according to an embodiment of the present application is shown. Figure 1 As shown, the method comprises the following steps:

[0041] Step S101, recording the online teaching audio and video and the course script containing interactive events during the online teaching process, and obtaining the recorded teaching audio and video and the recorded course script.

[0042] In actual teaching, the syllabus is usually fixed. Therefore, after the teacher enters the live classroom and teaches, the online teaching audio and video can be recorded through the image acquisition device to obtain the recorded teaching audio and video. The recorded teaching audio and video can be reused in different teaching scenarios, thereby reducing repetitive work and costs.

[0043] During the teaching process, there will be many aspects of interaction between the teacher and the students who are listening to the class online, and between the students who are listening to the class online, such as the teacher asking students voice questions, the teacher showing the answers to the students in writing, the teacher using a brush on the whiteboard, the students' videos going up and down the wall, etc. In order to enable students to interact when watching the recorded audio and video of the class, it is necessary to record the course script of the online class to obtain the recorded course script, which records various interactions that occur during the entire teaching process.

[0044] Step S102, according to the viewing request of the recorded teaching audio and video triggered by the first client, the recorded course script is obtained, and the recorded course script is parsed to obtain the corresponding interactive event.

[0045] When a student wants to watch the audio and video of a course, he can initiate a viewing request for the recorded audio and video of the course through the first client. According to the viewing request, the recorded course script can be obtained, and the recorded course script can be parsed to obtain the corresponding interactive events. For example, the recorded course script can be analyzed using natural language processing (NLP) methods or machine learning algorithms to obtain the interactive events recorded in the recorded course script.

[0046] Among them, interactive events include: interactive time, interactive content, and interactive event type. The interactive event types include: answering questions, student video uploading, student video downloading, and brush operation. It should be noted that in addition to the above types, other types not listed can also be included.

[0047] Step S103, obtaining and playing the recorded teaching audio and video. If it is monitored that the playing time of the audio and video resources of the recorded teaching audio and video is consistent with the interaction time of the interactive event, the interactive event is executed during the playing of the audio and video resources to enable the first client to participate in the teaching interaction.

[0048] The recorded course script records the course script during the teaching process. In order to enable students to attend classes, it is also necessary to obtain the recorded teaching audio and video, and play the recorded teaching audio and video. The audio and video resources of the recorded teaching audio and video all have corresponding playback time, and step S102 parses the interactive events in the recorded course script. Each interactive event corresponds to an interactive time. Therefore, whether to execute the interactive event can be determined by monitoring whether the playback time of the audio and video resources of the recorded teaching audio and video is consistent with the interactive time of the interactive event. If they are consistent, it can be considered that the students have watched the audio and video resources corresponding to the interactive event, and the interactive event is executed in the process of playing the audio and video resources, so that the students of the first client can participate in the teaching interaction.

[0049] For example, if the current time is a time period when a teacher asks questions, then the questions raised by the teacher can be displayed; or if the current time is a time period when students' videos are uploaded to the teaching interface, then the student videos can be displayed in the teaching interface.

[0050] If students watch the recorded lecture audio and video in its entirety, then all interactive events in the recorded course script can be executed correctly.

[0051] According to the interactive teaching method provided in the embodiment of the present application, it is possible to simulate an AI teaching environment of real classroom interaction. Based on pre-recorded course scripts, interactive events can be executed when playing recorded teaching audio and video, so that students can also interact when taking recorded classes, thereby improving the interactivity of the teaching process and increasing its fun. It solves the problem in the prior art that only live online interactive experience can be achieved while recorded courses lack effective classroom interactive means. At the same time, it achieves efficient use of resources and effective reduction of costs, thereby improving students' learning experience.

[0052] Figure 2 A flow chart of an interactive teaching method according to another embodiment of the present application is shown. Figure 2 As shown, the method comprises the following steps:

[0053] Step S201, recording the teacher's online teaching audio and video and at least one non-place-occupying student's online audio and video, and obtaining the recorded teacher's teaching audio and video and at least one non-place-occupying student's recorded student audio and video.

[0054] After the teacher enters the live classroom and teaches, the teacher's online teaching audio and video and at least one non-placeholder student's online audio and video can be recorded through an image acquisition device, where the non-placeholder students are real students attending the class, and the placeholder students refer to virtual students. The virtual students do not participate in the actual teaching activities, but can participate in the interactive session. This embodiment can record multiple audio and video resources at the same time. For example, the timing function of the timer can be used to achieve simultaneous recording of multiple audio and video resources.

[0055] When recording, the start time of each recorded event is also recorded, providing an accurate timestamp for later editing, retrieval and playback, ensuring that the required course segments can be easily found.

[0056] Step S202: merge the audio of the recorded audio and video of the teacher's lecture with the audio of the recorded audio and video of at least one non-place-occupying student, remove the audio track of the recorded audio and video of at least one non-place-occupying student, and obtain the recorded audio and video of the lecture.

[0057] After obtaining the recorded audio and video of the teacher's lecture and the recorded audio and video of at least one non-placeholder student according to step S201, the audio in the recorded audio and video of the teacher's lecture and the recorded audio and video of at least one non-placeholder student can be merged. For example, the audio in the recorded audio and video of at least one non-placeholder student can be separated first, and the separated audio and the recorded audio of the teacher's lecture are aligned on the time axis to ensure audio synchronization. Then, multiple audio tracks are synthesized into one. The final recorded audio and video of the teacher's lecture contains the audio of at least one non-placeholder student, and the recorded audio and video of at least one non-placeholder student will be processed for audio track removal. After the audio track is removed, for at least one non-placeholder student, what remains is a video without an audio track. The final recorded audio and video of the lecture includes: the recorded audio and video of the teacher's lecture synthesized with the audio of at least one non-placeholder student and the video of at least one non-placeholder student without an audio track.

[0058] Since recorded audio and video lectures can be reused in different teaching scenarios, duplication of work and costs are reduced.

[0059] Step S203, recording the course script including the interaction events between the teacher and all students during the online teaching process, and uploading it to the cloud storage.

[0060] During the teaching process, teachers and students who listen to the class online, and students who listen to the class online will interact in many aspects, such as teachers asking students voice questions, teachers showing students written answers, teachers using brushes on the whiteboard, students putting videos on the wall, and students taking videos off the wall. In order to enable students to interact while watching the recorded audio and video of the lecture, it is necessary to record the course script during the online lecture to obtain the recorded course script, which records the various interactions between the teacher and all students during the entire teaching process. The recorded course script will be uploaded to the cloud for storage, so that the course content can be effectively reused and analyzed, and it is also convenient for subsequent adjustments to the difficulty of the course content. In addition, the recorded course script also contains the address for obtaining the recorded audio and video of the lecture.

[0061] All students include placeholder students and non-placeholder students. Placeholder students are mainly used to replace the placeholder students with real students when other students besides the online students watch the recorded class later.

[0062] It should be noted that the placeholder student may exist only in some interactive scenes. When there is no corresponding interactive event, there may be no placeholder student, and the students in the corresponding steps S201 to S203 are all non-placeholder students.

[0063] Step S204, slice the recorded teaching audio and video, and upload the sliced ​​audio and video to cloud storage.

[0064] Specifically, FFmpeg and other tools can be used to slice the recorded audio and video of the lecture, which not only ensures the video quality, but also makes the video files more efficiently stored and transmitted. For example, the video can be evenly divided into segments of fixed length, or the video can be sliced ​​based on the change of content themes, or the video can be sliced ​​based on key frames by identifying key frames.

[0065] It should be noted that this embodiment does not limit the execution order of step S203 and step S204.

[0066] Step S205, according to the viewing request of the recorded teaching audio and video triggered by the first client, the recorded course script is obtained, and the recorded course script is parsed to obtain the corresponding interactive event.

[0067] When a student wants to watch the audio and video of a course, he can initiate a viewing request for the recorded audio and video of the course through the first client. According to the viewing request, the recorded course script can be obtained, and the recorded course script can be parsed to obtain the corresponding interactive events. For example, the recorded course script can be analyzed using natural language processing (NLP) methods or machine learning algorithms to obtain the interactive events recorded in the recorded course script. In addition, by parsing the recorded course script, the acquisition address of the corresponding recorded audio and video of the course can also be obtained.

[0068] Among them, interactive events include: interactive time, interactive content, and interactive event type. The interactive event types include: answering questions, student video uploading, student video downloading, and brush operation. It should be noted that in addition to the above types, other types not listed can also be included.

[0069] An efficient script download mechanism is provided here to ensure that all learning materials can be obtained quickly and safely.

[0070] Step S206, obtain the sliced ​​audio and video from the cloud according to the acquisition address of the recorded teaching audio and video recorded in the recorded course script, and play the sliced ​​audio and video. If it is monitored that the playback time of the audio and video resources of the sliced ​​audio and video is consistent with the interaction time corresponding to the interactive event and the interactive event type is question answering, then during the process of playing the audio and video resources, the questions to be answered are displayed to the first client according to the interactive event.

[0071] Specifically, the recorded teaching audio and video are uploaded to the cloud, and each file has a unique acquisition address, namely, a URL. In order to accurately determine which recorded teaching audio and video the recorded course script corresponds to, the acquisition address of the recorded teaching audio and video can be recorded in the recorded course script. Therefore, the sliced ​​audio and video can be obtained from the cloud according to the acquisition address of the recorded teaching audio and video recorded in the recorded course script, and the sliced ​​audio and video can be played.

[0072] The audio and video resources of each sliced ​​audio and video have their own specific playback timestamp. Interactive events (such as answering questions) also have corresponding timestamps to synchronize with the playback progress of the audio and video. Therefore, it is possible to determine whether to execute an interactive event by monitoring whether the playback time of the audio and video resources of the recorded teaching audio and video is consistent with the interactive time of the interactive event. If it is monitored that the playback time of the audio and video resources of the sliced ​​audio and video is consistent with the interactive time corresponding to the interactive event and the interactive event type is answering questions, during the playback of the audio and video resources, the questions to be answered are displayed to the first client according to the interactive event, so that the students corresponding to the first client can answer. Among them, the questions to be answered can be displayed in text form or in language form.

[0073] Through intensive timestamp marking and content matching analysis, accurate synchronization of audio and video resources and interactive events is achieved on the two-dimensional timeline, ensuring that interactive content and message exchanges can be closely integrated with real-time course data streams, guaranteeing the synchronization of information transmission and communication. Teaching content, student interaction, and real-time course information can be presented in a coordinated and consistent manner. This approach can greatly reduce learning and enterprise costs while providing a personalized learning experience.

[0074] In this embodiment, a multi-threaded playback, acquisition, cache, and deletion mechanism can be used to ensure the continuity and fluency of teaching activities through multi-threaded playback, acquisition, cache, and deletion of recorded teaching audio and video. At the same time, through intelligent resource management, unnecessary bandwidth consumption and storage costs are reduced. The precise implementation of synchronization logic ensures the real-time and interactivity of teaching content, improves user experience, and avoids waste of resources. Efficient video playback and resource management are achieved, optimizing students' learning process.

[0075] The recorded audio and video of the lectures contain multiple videos. In order to ensure the synchronization of the teacher and student video playback, the timing function of the timer can be used to ensure on-time playback and provide a consistent classroom experience.

[0076] Step S207: receiving an interactive operation carrying a first interactive option sent by the first client.

[0077] If the interactive event type is answering a question, the student corresponding to the first client can participate in the interaction. After seeing the question to be answered, the student can submit a first interactive option through the first client, where the first interactive option can be the answer result of the first client to the question. Therefore, the interactive operation carrying the first interactive option sent by the first client can be received.

[0078] Step S208, determining whether the second interactive option corresponding to the interactive event recorded in the course script is consistent with the first interactive option.

[0079] The recorded course script records the correct answer results of the questions to be answered, that is, the second interactive option. Therefore, after receiving the interactive operation carrying the first interactive option sent by the first client, the second interactive option can be matched with the first interactive option to determine whether the two are consistent. The judgment result mainly includes: the second interactive option is consistent with the first interactive option or the second interactive option is inconsistent with the first interactive option.

[0080] Step S209: returning a preset interaction result to the first client according to the determination result.

[0081] If the second interactive option is consistent with the first interactive option, the first preset interactive result may be returned to the first client, for example, “∨” or a correct answer, or other results that can indicate that the student’s answer is correct; if the second interactive option is inconsistent with the first interactive option, the first preset interactive result may be returned to the first client, for example, “×” or an incorrect answer, or other results that can indicate that the student’s answer is incorrect.

[0082] Step S210: determining the course mastery level of the first client according to the judgment result.

[0083] During the entire teaching process, there may be multiple questions to answer. Therefore, the judgment results can be combined to determine the degree of mastery of the course by the students of the first client. For example, the correspondence between the number of occurrences of specific judgment results and the degree of mastery of the course can be pre-set. For example, the second interactive option and the first interactive option appear 5 times, which corresponds to proficient mastery of the course; the second interactive option and the first interactive option appear 3 times, which corresponds to a preliminary understanding of the course; the second interactive option and the first interactive option appear once, which corresponds to no understanding of the course. This is just an example, and the correspondence between the number of occurrences of specific judgment results and the degree of mastery of the course can be set according to actual needs.

[0084] Step S211, according to the degree of course mastery, replace the recorded course script and sliced ​​audio and video after the interaction time of the interactive event targeted by the last interactive operation.

[0085] After determining the course mastery level of the first client, the difficulty and rhythm of the content learned by the first client can be adjusted according to the course mastery level. When making adjustments, the recorded course script and sliced ​​audio and video after the interaction time of the interactive event targeted by the first client's last interactive operation are replaced. For example, first determine the interactive event targeted by the first client's last interactive operation, determine the interaction time corresponding to the interactive event, and replace the recorded course script and sliced ​​audio and video after the interaction time, for example, adjust to sliced ​​audio and video and recorded course scripts with higher teaching difficulty, or adjust to sliced ​​audio and video and recorded course scripts with lower teaching difficulty.

[0086] As a result, the difficulty and pace of teaching content are automatically adjusted according to students' learning progress and comprehension ability. The customized learning route provided allows each student to learn at a level that suits them, providing a personalized learning experience and ensuring that students progress at a pace that suits them.

[0087] In an optional implementation of the present application, the following method can also be used to determine whether to replace: the statistical judgment result is the statistical number of inconsistencies between the second interactive option and the first interactive option; the statistical number is compared with the preset threshold, and according to the comparison result, the recorded course script and sliced ​​audio and video after the interactive time of the interactive event targeted by the last interactive operation are replaced. In this implementation, the students' mastery of the course can be simply divided into mastered and unmastered, and the preset threshold is used to distinguish the students' mastery of the course. The statistical judgment result is the statistical number of inconsistencies between the second interactive option and the first interactive option; the statistical number is compared with the preset threshold. If the statistical number is greater than or equal to the preset threshold, it means that the first client has not mastered the course, and the recorded course script and sliced ​​audio and video after the interactive time of the interactive event targeted by the last interactive operation can be replaced with sliced ​​audio and video and recorded course scripts of lower difficulty; if the statistical number is less than the preset threshold, it means that the first client has mastered the course, and the recorded course script and sliced ​​audio and video after the interactive time of the interactive event targeted by the last interactive operation can be replaced with sliced ​​audio and video and recorded course scripts of higher difficulty.

[0088] In an optional implementation of the present application, after requesting a class, the first client will load the image acquisition device of the first client to acquire the corresponding client video, and when the interactive event is that the student video is put on the wall, the interactive event includes: the second client identifier and the wall coordinates of the placeholder student on the wall. Therefore, the teaching interaction of the first client can be realized by the following method: according to the wall coordinates corresponding to the second client identifier of the placeholder student recorded in the recorded course script, the client video corresponding to the first client is replaced and displayed in the teaching interface of the played video resource. During class, the first client will replace the placeholder student. Therefore, the student video of the placeholder student on the wall will be replaced by the first client accordingly. The wall coordinates corresponding to the second client identifier of the placeholder student are recorded in the recorded course script. Therefore, in the teaching interaction in which the first client participates, the wall coordinates corresponding to the second client identifier of the placeholder student recorded in the recorded course script can be used to replace the client video corresponding to the first client in the teaching interface of the played video resource. That is to say, when the first client is in class, it is actually the first client on the wall, not the placeholder student.

[0089] In the case of unstable network, the class may be interrupted. Since some sliced ​​videos have been acquired in advance, they can be acquired and sliced ​​after the network is restored without affecting students' normal classes, ensuring minimal interference with teaching activities.

[0090] This solution is implemented by the online education platform, which can flexibly process and parse various types of data, ensuring the compatibility of learning materials in different formats and sources. The online education platform optimizes the processing of data obtained from H5 pages, ensuring the smooth display of web content and the user's interactive experience.

[0091] Through the implementation of these core technologies, our online education platform can not only provide high-quality recording and production services, but also provide a stable, smooth and synchronous learning experience during class. At the same time, our technical solutions focus on cost-effectiveness, ensuring efficient use of resources and long-term sustainable development.

[0092] Figure 3 A flow chart of an interactive teaching method according to another embodiment of the present application is shown. Figure 3 As shown, here, three real students (real students A, B, and C) are taken as an example to explain the online course. When the video recording is started, after the teacher enters the classroom before or during the class, one channel of teacher audio and video and three channels of student audio and video will be recorded, and the script will be recorded. After the script is recorded, the script is made to obtain the course script, and the course script is uploaded to the cloud, thus the recording ends;

[0093] Start making resources. Here, the teacher's audio and video are merged with 3 student audios. After synthesis, the teacher's video contains 4 audio tracks, and the videos of real students A, B, and C have no audio tracks. Then the service automatically slices the video and uploads the sliced ​​audio and video to the cloud. Resource production is completed.

[0094] After the class starts, the course script is downloaded, parsed and executed. It should be noted that the script parsing is performed in a loop according to the script timing. The video download address can be recorded in the script. Sliced ​​videos can be downloaded and played, mainly the teacher's video (synthesized with 4 audio tracks) and the videos of real students A, B, and C without audio tracks. When the interaction time of the interaction event arrives, each interaction event is executed. The interaction event can be an SVC or h5 event. In addition, after the class starts, the camera of the current student in class needs to be loaded.

[0095] The interactive teaching method provided in the embodiment of the present application aims to create an interactive course that simulates a real classroom environment by recording the video and actions of professional teachers and students and combining advanced technology. The core of this method is to record the teaching behavior of teachers and the interactive mode of students through precise scripts, so as to generate personalized teaching content and feedback mechanism.

[0096] In this method, the teacher's lecture video and the students' responses are recorded and uploaded to the cloud server. The service automatically records and switches the video to produce teaching resources, while the script events recorded by the client record all key teaching elements and interactions. Then, the difficulty and rhythm of the teaching content can be automatically adjusted according to the students' learning progress and comprehension ability, ensuring that each student can learn at a level that suits them.

[0097] In addition, it can also simulate the interaction between teachers and students, drive various teaching elements and interactive actions by playing script event types, and realize real-time dialogue and interaction between students and AI teachers and other students in the classroom. This automated interactive teaching method can not only provide a personalized learning experience, but also significantly reduce teaching costs, making high-quality language education resources more popular and accessible.

[0098] Through this method, students can access courses through smart devices at any time and any place for independent learning. This innovative teaching model is expected to change the face of traditional language teaching and bring new opportunities for the development of global language education.

[0099] The focus is not only on providing a seamless and interactive learning experience, but also on achieving the reusability of resources and effective cost reduction.

[0100] According to the interactive teaching method provided in the embodiment of the present application, it is possible to simulate an AI teaching environment of real classroom interaction. Based on the pre-recorded course script, interactive events can be executed when playing the recorded teaching audio and video, so that students can also interact when taking the recorded class, thereby improving the interactivity of the teaching process and increasing the fun. It solves the problem in the prior art that only live online interactive experience can be achieved while recorded courses lack effective classroom interactive means. At the same time, it achieves efficient use of resources and effective reduction of costs, improves students' learning experience, and can adjust the difficulty of the course based on the students' mastery of the course.

[0101] Figure 4 A structural block diagram of an interactive teaching device according to an embodiment of the present application is shown. Figure 4 As shown, the device comprises:

[0102] The video recording module 401 is suitable for recording the online teaching audio and video to obtain the recorded teaching audio and video;

[0103] The script recording module 402 is adapted to record the course script including the interactive events during the online teaching process to obtain the recorded course script;

[0104] The class process module 403 is suitable for obtaining the recorded course script according to the viewing request of the recorded teaching audio and video triggered by the first client; parsing the recorded course script to obtain the corresponding interactive event; obtaining and playing the recorded teaching audio and video; if it is monitored that the playback time of the audio and video resources of the recorded teaching audio and video is consistent with the interactive time of the interactive event, then executing the interactive event during the playback of the audio and video resources to enable the first client to participate in the teaching interaction.

[0105] Optionally, the class process module is further adapted to: load the image acquisition device of the first client;

[0106] If the interactive event includes the second client identifier and wall coordinates of the student occupying the wall, the client video corresponding to the first client will be replaced in the teaching interface of the played video resource according to the wall coordinates corresponding to the second client identifier recorded in the recorded course script.

[0107] Optionally, the class process module is further adapted to: if the interactive event type is question answering, then during the process of playing the audio and video resources, displaying the question to be answered to the first client according to the interactive event;

[0108] The method further includes: receiving an interactive operation carrying a first interactive option sent by the first client;

[0109] Determine whether the second interactive option corresponding to the interactive event recorded in the course script is consistent with the first interactive option;

[0110] The preset interaction result is returned to the first client according to the determination result.

[0111] Optionally, the device further comprises: a video production module, adapted to slice the recorded audio and video of the lecture and upload the sliced ​​audio and video to cloud storage;

[0112] The class process module is further adapted to: obtain and play sliced ​​audio and video from the cloud, and if it is monitored that the playback time of the audio and video resources of the sliced ​​audio and video is consistent with the interaction time corresponding to the interactive event, the interactive event is executed during the playback of the sliced ​​audio and video.

[0113] Optionally, the class process module is further adapted to: determine the course mastery level of the first client according to the judgment result;

[0114] According to the level of course mastery, the recorded course script and sliced ​​audio and video after the interaction time of the interactive event targeted by the last interactive operation will be replaced.

[0115] Optionally, the class process module is further adapted to: obtain the recorded teaching audio and video according to the acquisition address of the recorded teaching audio and video recorded in the recorded course script, and play the recorded teaching audio and video.

[0116] In this embodiment, the video recording module is a module executed on the server, which is responsible for recording the interactive video of the teacher and the students. The module can record multiple video sources at the same time and merge the audio and video tracks to ensure that the final output video is smooth and synchronized.

[0117] The script recording module is defined as a module involving client and server interaction, responsible for recording interactive events during the teaching process. This module records interactive events in the course in detail, providing data support for course analysis and personalized learning.

[0118] The video production module is defined as a module that is mainly executed on the server and uses tools such as FFmpeg to process the video. This module slices the video and processes the audio track to ensure the video quality while improving the storage and transmission efficiency.

[0119] The class process module is defined as involving video playback logic and script playback logic, which may involve the interaction between the server and the client. The server provides video and script data, and the client is responsible for playback and user interaction, ensuring the accuracy of the video playback starting point and implementing multi-threaded playback, downloading, caching, and deletion mechanisms.

[0120] The interactive teaching device provided in the embodiment of the present application can simulate an AI teaching environment of real classroom interaction. Based on the pre-recorded course script, interactive events can be executed when playing the recorded teaching audio and video, so that students can also interact when taking the recorded class, thereby improving the interactivity of the teaching process and increasing the fun. It solves the problem that only live online interactive experience can be achieved in the prior art, while recorded courses lack effective classroom interactive means. At the same time, it realizes efficient use of resources and effective reduction of costs, improves students' learning experience, and can adjust the difficulty of the course according to the students' mastery of the course.

[0121] An embodiment of the present application provides a non-volatile computer storage medium, which stores at least one executable instruction or computer program, and the executable instruction or computer program can enable a processor to perform operations corresponding to the interactive teaching method in any of the above method embodiments.

[0122] An embodiment of the present application provides a computer program product, which includes at least one executable instruction or computer program, and the executable instruction or computer program can enable a processor to perform operations corresponding to the interactive teaching method in any of the above method embodiments.

[0123] Figure 5 A schematic diagram of the structure of an embodiment of a computing device of the present application is shown. The specific embodiment of the present application does not limit the specific implementation of the computing device.

[0124] like Figure 5As shown, the computing device may include: a processor (processor) 502 , a communications interface (Communications Interface) 504 , a memory (memory) 506 , and a communication bus 508 .

[0125] The processor 502, the communication interface 504, and the memory 506 communicate with each other via the communication bus 508. The communication interface 504 is used to communicate with other devices such as a client or other server network elements. The processor 502 is used to execute the program 510, which can specifically execute the relevant steps in the above-mentioned interactive teaching method embodiment for a computing device.

[0126] Specifically, the program 510 may include program codes, which include computer operation instructions.

[0127] The processor 502 may be a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application. The one or more processors included in the computing device may be processors of the same type, such as one or more CPUs; or may be processors of different types, such as one or more CPUs and one or more ASICs.

[0128] The memory 506 is used to store the program 510. The memory 506 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0129] The program 510 can be specifically used to enable the processor 502 to execute the interactive teaching method in any of the above-mentioned method embodiments. The specific implementation of each step in the program 510 can refer to the corresponding descriptions in the corresponding steps and units in the above-mentioned interactive teaching embodiments, which will not be repeated here. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the above-described devices and modules can refer to the corresponding process description in the above-mentioned method embodiments, which will not be repeated here.

[0130] The algorithm and display provided herein are not inherently related to any particular computer, virtual system or other device. Various general purpose systems can also be used together with the teachings based on this. According to the above description, it is obvious that the structure required for constructing such systems. In addition, the application is not directed to any specific programming language either. It should be understood that various programming languages ​​can be utilized to realize the content of the application described herein, and the description of the specific language above is for the purpose of disclosing the best mode of implementation of the application.

[0131] In the description provided herein, a large number of specific details are described. However, it is understood that the embodiments of the present application can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0132] Similarly, it should be understood that in order to streamline the present disclosure and aid in understanding one or more of the various inventive aspects, in the above description of the exemplary embodiments of the present application, the various features of the present application are sometimes grouped together into a single embodiment, figure, or description thereof. However, this disclosed method should not be interpreted as reflecting the following intention: the claimed application requires more features than the features explicitly recited in each claim. More specifically, as reflected in the claims, the inventive aspects lie in less than all the features of the individual embodiments disclosed above. Therefore, the claims that follow the specific embodiment are hereby expressly incorporated into the specific embodiment, with each claim itself serving as a separate embodiment of the present application.

[0133] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.

[0134] In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present application and form different embodiments. For example, in the claims, any one of the claimed embodiments can be used in any combination.

[0135] The various component embodiments of the present application can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It should be understood by those skilled in the art that a microprocessor or digital signal processor (DSP) can be used in practice to implement some or all functions of some or all components in the embodiments of the present application. The application can also be implemented as a device or apparatus program (e.g., computer program and computer program product) for executing part or all of the methods described herein. Such a program implementing the present application can be stored on a computer-readable medium, or can have the form of one or more signals. Such a signal can be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form.

[0136] It should be noted that the above embodiments illustrate the present application rather than limit the present application, and that those skilled in the art may design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference symbol between brackets should not be constructed as a limitation to the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "one" or "an" preceding an element does not exclude the presence of multiple such elements. The present application may be implemented by means of hardware including several different elements and by means of a suitably programmed computer. In a unit claim that lists several devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names.

Claims

1. An interactive teaching method, characterized in that: The method comprises: Recording online teaching audio and video and course scripts including interactive events during the online teaching process to obtain recorded teaching audio and video and recorded course scripts; According to the viewing request of the recorded teaching audio and video triggered by the first client, the recorded course script is obtained, and the recorded course script is parsed to obtain the corresponding interactive event; Obtain and play the recorded teaching audio and video. If it is monitored that the playing time of the audio and video resources of the recorded teaching audio and video is consistent with the interaction time of the interactive event, execute the interactive event during the playing of the audio and video resources to enable the first client to participate in the teaching interaction.

2. The method according to claim 1, characterized in that The method further comprises: loading an image acquisition device of the first client; The performing of the interactive event during the playing of the audio and video resources further comprises: If the interactive event includes the second client identifier and wall coordinates of the student occupying the place on the wall, then the client video corresponding to the first client is replaced and displayed in the teaching interface of the played video resource according to the wall coordinates corresponding to the second client identifier recorded in the recorded course script.

3. The method according to claim 1 or 2, characterized in that: The performing of the interactive event during the playing of the audio and video resources further comprises: If the interactive event type is question answering, then during the playback of the audio and video resources, the question to be answered is displayed to the first client according to the interactive event; The method further includes: receiving an interactive operation carrying a first interactive option sent by the first client; Determine whether the second interactive option corresponding to the interactive event recorded in the recorded course script is consistent with the first interactive option; Return a preset interaction result to the first client according to the determination result.

4. The method according to claim 3, characterized in that The method further comprises: Slice the recorded teaching audio and video, and upload the sliced ​​audio and video to cloud storage; The obtaining and playing of the recorded audio and video of the teaching, if it is monitored that the playing time of the audio and video resources of the recorded audio and video of the teaching is consistent with the interaction time of the interaction event, then executing the interaction event in the process of playing the audio and video resources further includes: The sliced ​​audio and video are obtained and played from the cloud. If it is monitored that the playing time of the audio and video resources of the sliced ​​audio and video is consistent with the interactive time corresponding to the interactive event, the interactive event is executed during the playing of the sliced ​​audio and video.

5. The method according to claim 4, characterized in that The method further includes: determining the course mastery level of the first client according to the judgment result; According to the degree of mastery of the course, the recorded course script and sliced ​​audio and video after the interaction time of the interactive event targeted by the last interactive operation are replaced.

6. The method according to claim 1 or 2, characterized in that: The obtaining and playing of the recorded teaching audio and video further comprises: The recorded teaching audio and video is obtained according to the acquisition address of the recorded teaching audio and video recorded in the recorded course script, and the recorded teaching audio and video is played.

7. An interactive teaching device, characterized in that: The device comprises: A video recording module, suitable for recording online teaching audio and video, and obtaining recorded teaching audio and video; A script recording module is suitable for recording course scripts containing interactive events during online teaching to obtain recorded course scripts; The class process module is suitable for obtaining the recorded course script according to the viewing request of the recorded teaching audio and video triggered by the first client; parsing the recorded course script to obtain the corresponding interactive event; obtaining and playing the recorded teaching audio and video; if it is monitored that the playback time of the audio and video resources of the recorded teaching audio and video is consistent with the interactive time of the interactive event, then executing the interactive event during the playback of the audio and video resources, so as to enable the first client to participate in the teaching interaction.

8. A computing device, characterized in that include: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform an operation corresponding to the interactive teaching method according to any one of claims 1-6.

9. A computer storage medium, characterized in that The computer storage medium stores at least one executable instruction, and the executable instruction enables the processor to execute operations corresponding to the interactive teaching method according to any one of claims 1 to 6.

10. A computer program product, characterized in that It includes at least one executable instruction, and the executable instruction enables the processor to execute the operation corresponding to the interactive teaching method according to any one of claims 1-6.

Images