Classroom playback method, classroom playback device, playback terminal and storage medium

Abstract

The application provides a classroom playback method, a classroom playback device, a playback terminal and a storage medium. In response to a click operation on playback content corresponding to a target classroom, recorded classroom materials, an input control and a target control are displayed. This can view the classroom materials required for playback of the target classroom. When the entire target classroom is played back, the target control can be clicked. When playback is performed from a certain classroom material, the corresponding classroom material can be clicked. When only the playback content of the candidate classroom material of interest is played back, the target filtering condition can be input in the input control to achieve this. The method can select the playback mode of the target classroom based on its own needs. When the target classroom is played back from the intermediate classroom material, the playback terminal does not need to waste the time wasted by starting from the beginning; the target filtering condition can be input in the input control, and only the playback content of the candidate classroom material is played back, which can save unnecessary time waste. Therefore, the method can improve the human-computer interaction efficiency when the target classroom is played back.

Description

Technical Field

[0001] This application relates to the field of electronic equipment technology, and more specifically, to classroom playback methods, classroom playback devices, playback terminals, and storage media in the field of electronic equipment technology. Background Technology

[0002] With the continuous advancement of modern teaching systems in schools, these systems typically record classes to obtain recording resources. These recordings are then uploaded to a playback device, allowing students to review the lessons.

[0003] In the existing technology, when students operate the playback terminal to replay the class, there is a problem of low operation efficiency. Therefore, it is necessary to improve the human-computer interaction efficiency between students and the playback terminal when replaying the class. Summary of the Invention

[0004] This application provides a classroom playback method, a classroom playback device, a playback terminal, and a storage medium. The method can improve the efficiency of human-computer interaction between students and the playback terminal when playing back a target classroom.

[0005] Firstly, a classroom playback method is provided, executed by a playback terminal that provides playback functionality for a target classroom. The method includes: in response to a click operation on playback content corresponding to the target classroom in a classroom list, displaying recorded classroom materials, an input control for filtering classroom materials, and a target control for playback of the target classroom on a first screen of the playback terminal's display interface; in response to a click operation on a first classroom material among the classroom materials, playing back the target classroom starting from the first classroom material on a second screen of the display interface; in response to an input operation on target filtering conditions in the input control, filtering at least one candidate classroom material from the recorded classroom materials based on the target filtering conditions, and playing back the target classroom based on the at least one candidate classroom material on a third screen of the display interface; and in response to a click operation on the target control, playing back the target classroom starting from the beginning of recording on a fourth screen of the display interface.

[0006] In the above technical solution, on the playback end, if a student or teacher needs to replay a target lesson, they can directly click on the corresponding playback content. Responding to this click, the playback end displays the recorded lesson materials and the target control for replaying the lesson on the first screen of its interface. This allows students or teachers to intuitively view all the lesson materials needed for playback and the target control on the first screen. When a student or teacher needs to replay the entire target lesson (from the beginning), they can do so by directly clicking the target control. When a student or teacher needs to replay a specific point (a particular lesson material), they can do so by directly clicking the corresponding lesson material. When a student or teacher only needs to replay lesson materials of interest, they can do so by entering target filtering conditions in the input control. These three methods for replaying the target lesson allow students or teachers to choose freely based on their needs. Furthermore, when students or teachers do not need to replay the target lesson from the beginning, but rather need to start replaying from a specific intermediate lesson, they can directly click on the corresponding intermediate lesson, eliminating the time wasted on replaying from the beginning. They can also input target filtering criteria in the input control to replay only the candidate lesson materials of interest, saving a significant amount of unnecessary time. Therefore, the above method can improve the efficiency of human-computer interaction between students / teachers and the playback device when replaying the target lesson.

[0007] In conjunction with the first aspect, in some possible implementations, the first classroom material is a first image material or a first video material. In response to a click operation on the first classroom material within the classroom material, playback of the target classroom begins on the second screen of the display interface, starting from the first classroom material. This includes: in response to a click operation on the first image material, playback of the target classroom begins on the second screen from the first image material; in response to a click operation on the first video material, playback of the first video material begins on the second screen, and after playback of the first video material is complete, displaying a prompt on the fifth screen of the display interface asking whether to continue playback of the target classroom; and in response to a confirmation operation of the prompt to continue playback of the target classroom, identifying at least one classroom material recorded after the first video material, and playing back of the target classroom begins from this at least one classroom material.

[0008] In combination with the first aspect and the above implementation methods, in some possible implementation methods, the method further includes: in response to a confirmation operation of a prompt message indicating that the playback of the target class should not continue, jumping from the fifth screen to the first screen.

[0009] Combining the first aspect and the above implementation methods, in some possible implementation methods, the target classroom is replayed on the second screen starting from the first image material, including: obtaining the set of actions performed on the target image material recorded in the target classroom and the target audio associated with the target classroom, the target image material including the first image material and the image materials after the first image material, and the target audio being the audio recorded synchronously when the target image material was recorded; on the second screen, the target image material and the target audio are played synchronously, and the corresponding actions are performed on the target image material according to the execution time of each action in the action set.

[0010] Combining the first aspect and the above implementation methods, in some possible implementation methods, the corresponding action is executed on the target image material according to the execution time of each action in the action set, including: when the playback time corresponding to the playback progress of the target audio is equal to the execution time of an action in the action set, the action is executed on the target image material at that playback time.

[0011] Combining the first aspect and the above implementation methods, in some possible implementation methods, the corresponding actions are executed on the target image material according to the execution time of each action in the action set, including: determining whether there are actions with the same execution time in the action set; if there are actions with the same execution time in the action set, obtaining the execution priority of each action; and executing the corresponding actions on the target image material according to the execution time and execution priority of each action.

[0012] Combining the first aspect and the above implementation methods, in some possible implementation methods, the corresponding actions are executed on the teaching courseware according to the execution time and execution priority of each action, including: determining the target execution time that matches the current playback time from the execution times of multiple actions in the action set; if the number of actions corresponding to the target execution time is greater than the preset number, the actions corresponding to the target execution time are executed on the target image material in sequence according to the execution priority at the current playback time.

[0013] In combination with the first aspect and the above implementation methods, in some possible implementation methods, the target classroom is replayed based on the at least one candidate classroom material, including: obtaining the recording time period corresponding to the recording of each candidate classroom material; and replaying the target classroom of each recording time period in the at least one recording time period in chronological order of recording time.

[0014] In combination with the first aspect and the above implementation methods, in some possible implementation methods, at least one candidate classroom material is selected from the recorded classroom materials, and the target classroom is replayed on the third screen of the display interface based on the at least one candidate classroom material, including: selecting the at least one candidate classroom material from the recorded classroom materials and displaying the at least one candidate classroom material on the sixth screen of the display interface; in response to the deletion operation of some classroom materials in the at least one candidate classroom materials, the target classroom is replayed based on the remaining classroom materials in the at least one candidate classroom materials.

[0015] Secondly, a classroom playback device is provided, which is installed on a playback terminal for providing playback functionality for a target classroom. The device includes: a display module, configured to display, in response to a click operation on the playback content corresponding to the target classroom in the classroom list, the recorded classroom materials of the target classroom, an input control for filtering classroom materials, and a target control for playing back the target classroom on a first screen of the display interface of the playback terminal; and a playback module, configured to: in response to a click operation on a first classroom material in the classroom materials, play back the target classroom starting from the first classroom material on a second screen of the display interface; in response to an input operation on the input control for target filtering conditions, filter at least one candidate classroom material from the recorded classroom materials based on the target filtering conditions, and play back the target classroom based on the at least one candidate classroom material on a third screen of the display interface; and in response to a click operation on the target control, play back the target classroom starting from the beginning of recording on a fourth screen of the display interface.

[0016] In conjunction with the second aspect, in some possible implementations, the first classroom material is a first image material or a first video material. The playback module is specifically used for: responding to a click operation on the first image material, playing back the target classroom on the second screen starting from the first image material; responding to a click operation on the first video material, playing back the first video material on the second screen, and after playing back the first video material, displaying a prompt message on the fifth screen of the display interface asking whether to continue playing back the target classroom; and responding to a confirmation operation of the prompt message to continue playing back the target classroom, identifying at least one classroom material recorded after the first video material, and playing back the target classroom starting from the at least one classroom material.

[0017] In combination with the second aspect and the above implementation methods, in some possible implementation methods, the device further includes: a jump module, used to jump from the fifth screen to the first screen in response to a confirmation operation of a prompt message indicating that the playback of the target class should not continue.

[0018] In conjunction with the second aspect and the above implementation methods, in some possible implementation methods, the device further includes: an acquisition module, used to acquire a set of actions performed on the target image material recorded in the target classroom and target audio associated with the target classroom, wherein the target image material includes the first image material and image materials after the first image material, and the target audio is audio recorded synchronously when the target image material is recorded; the playback module is specifically used to synchronously play the target image material and the target audio on the second screen, and perform corresponding actions on the target image material according to the execution time of each action in the action set.

[0019] In combination with the second aspect and the above implementation methods, in some possible implementation methods, the playback module includes a processing submodule, which is used to execute the action on the target image material at the playback time when the playback time corresponding to the playback progress of the target audio is equal to the execution time of an action in the action set.

[0020] In conjunction with the second aspect and the above implementation methods, in some possible implementation methods, the device further includes: a determining module, used to determine whether there are actions with the same execution time in the action set; the obtaining module, specifically used to obtain the execution priority of each action when there are actions with the same execution time in the action set; and the processing submodule, specifically used to execute the corresponding action on the target image material according to the execution time and execution priority of each action.

[0021] Combining the second aspect and the above implementation methods, in some possible implementation methods, the determining module is specifically used to determine the target execution time that matches the current playback time from the execution times of multiple actions in the action set; the processing submodule is also specifically used to execute the actions corresponding to the target execution time on the target image material in sequence according to the execution priority when the number of actions corresponding to the target execution time is greater than the preset number.

[0022] In combination with the second aspect and the above implementation methods, in some possible implementation methods, the acquisition module is specifically used to acquire the recording time period corresponding to each candidate classroom material; the playback module is also specifically used to play back the target classroom of each recording time period in at least one recording time period according to the order of recording time.

[0023] In combination with the second aspect and the above implementation methods, in some possible implementation methods, the display module is specifically used to filter out the at least one candidate classroom material from the recorded classroom materials and display the at least one candidate classroom material on the sixth interface of the display interface; the playback module is also specifically used to respond to the deletion operation of some classroom materials in the at least one candidate classroom material and play back the target classroom based on the remaining classroom materials in the at least one candidate classroom material.

[0024] Thirdly, a playback terminal is provided, including a memory and a processor. The memory is used to store executable program code, and the processor is used to call and run the executable program code from the memory, causing the playback terminal to perform the methods in the first aspect or any possible implementation thereof.

[0025] Fourthly, a computer-readable storage medium is provided that stores executable program code, which, when executed, implements the method described in the first aspect or any possible implementation thereof. Attached Figure Description

[0026] Figure 1 This is a schematic diagram of the structure of a recording and playback system provided in an embodiment of this application;

[0027] Figure 2 This is a schematic flowchart illustrating a classroom playback method provided in an embodiment of this application;

[0028] Figure 3 This is a schematic diagram illustrating how to synchronize the first execution time of each action in a first action set with the candidate audio, as provided in an embodiment of this application.

[0029] Figure 4 This is a schematic flowchart illustrating another classroom playback method provided in the embodiments of this application;

[0030] Figure 5 This is a schematic diagram of an interface for recording classroom materials in the first classroom, provided in an embodiment of this application;

[0031] Figure 6(a) is a schematic diagram of an interface for replaying the first lesson provided in an embodiment of this application;

[0032] Figure 6(b) is a schematic diagram of another interface for replaying the first classroom provided in an embodiment of this application; Figure 6(c) is a schematic diagram of another interface for replaying the first classroom provided in an embodiment of this application; Figure 6(d) is a schematic diagram of another interface for replaying the first classroom provided in an embodiment of this application.

[0033] Figure 7This is a schematic diagram of the structure of a classroom playback device provided in an embodiment of this application;

[0034] Figure 8 This is a schematic diagram of another classroom playback device provided in an embodiment of this application;

[0035] Figure 9 This is a schematic diagram of the structure of a playback terminal provided in an embodiment of this application. Detailed Implementation

[0036] The technical solutions in this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B. "And / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0037] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

[0038] The technical solutions in the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0039] Figure 1 This is a schematic diagram of the structure of a recording and playback system provided in an embodiment of this application. Specifically, as shown... Figure 1 As shown, a recording and playback system in a modern teaching system includes a recording terminal, a server terminal, and a playback terminal. The recording terminal is the end that records (obtains) the teaching process in any classroom, and can be the teacher's end. The playback terminal is the end that plays back any classroom (the teaching process in the classroom), and can be the student's end; of course, the teacher can also play back any classroom, meaning the teacher's end can also act as a playback terminal. The server terminal is used to store and process the recorded content associated with the classroom sent by the recording terminal.

[0040] Currently, the teaching process in the target classroom is typically recorded as a video stream at the recording end to capture the teacher's explanations. Furthermore, the recorded resources are stored as teaching videos on the server. When a student or teacher needs to replay the target classroom lesson, they can retrieve the corresponding teaching video from the server for playback.

[0041] However, in related technologies, the teaching videos in the recorded resources corresponding to the target lesson are usually divided into multiple segments according to the recording duration of the target lesson, resulting in multiple video segments. Students or teachers can click on any video segment to replay the target lesson. However, since the above-mentioned multiple video segments are obtained by equally dividing the teaching videos according to the recording duration, students or teachers cannot quickly locate the video segment they need to replay among multiple video segments. In other words, when students or teachers operate the playback terminal to replay the target lesson, there is a situation of low operation efficiency.

[0042] To address the aforementioned problems, this application proposes a classroom replay method, which relies on... Figure 1 The structure of the recording and playback system shown above demonstrates that the above method can improve the efficiency of human-computer interaction between students and the playback device when playing back the target classroom.

[0043] Figure 2 This is a schematic flowchart of a classroom playback method provided in an embodiment of this application.

[0044] For example, the above-mentioned classroom replay method can be derived from the above-mentioned Figure 1 The server-side execution in the recording and playback system shown is as follows: Figure 2 As shown, the method 200 includes the following steps 201 and 202.

[0045] Step 201: Receive classroom materials recorded in the target classroom, a set of actions performed on various image materials in the classroom materials, and audio associated with the target classroom sent by the recording terminal. The set of actions includes control actions when displaying the image materials and trajectory actions marked on the image materials.

[0046] It should be understood that the "target classroom" in step 201 above refers to a specific lesson recorded by the teacher on the recording device, which could be the 21st lesson of a mathematics course. The "classroom materials recorded in the target classroom" in step 201 above refers to the teaching materials needed when explaining the target lesson. In some embodiments, these teaching materials include at least one of PowerPoint presentations, Word documents, Portable Document Format (PDF) files, videos, and web pages. The image materials mentioned above include the PowerPoint presentations, Word documents, PDF files, whiteboard notes, and web pages (these materials), and the whiteboard notes can be generated through a collaborative whiteboard system. Each page of these materials can be considered an image.

[0047] It should also be understood that the "set of actions performed on the image material" in step 201 above includes control actions that directly display the image material itself at the recording end and trajectory actions that are marked on a target layer related to the image material. The control actions are only used to control the display state of the image material. In some embodiments, these control actions include page turning, scaling the display view of the image material, pausing / playing (for PowerPoint presentations), and triggering an element to play an entrance / exit effect (for PowerPoint presentations). The trajectory actions include writing text, adding formulas, and drawing line segments, etc.

[0048] It should be noted that the aforementioned image materials can serve as the underlying layer for displaying teaching content, while the target layer is a transparent or semi-transparent digital whiteboard layer created by the collaborative whiteboard system. That is, the target layer is located above the underlying layer. This collaborative whiteboard system allows multiple users to operate on the digital whiteboard layer simultaneously. Furthermore, image materials can be converted into a set of operable objects (e.g., static images) within the whiteboard canvas. The whiteboard acts as a container to hold the teaching content within the image materials, leaving extra space around it or on the page for executing trajectory actions. In other words, the aforementioned target layer refers to the layer obtained after embedding the image materials into the whiteboard canvas.

[0049] The whiteboard described above is the core container of the collaborative whiteboard system. Teachers can import and store image materials by operating the whiteboard at the recording end. The whiteboard canvas described above is the visual operation surface within the whiteboard.

[0050] It should also be noted that the "audio associated with the target classroom" in step 201 above refers to the recordings of teachers teaching about the image materials in the target classroom.

[0051] In some embodiments, prior to step 201, when teaching is conducted using classroom materials, the recording end records the set of actions performed on the image material and the audio during teaching in the target classroom; the recording end sends the classroom materials, the set of actions performed on the image material, and the audio associated with the image material to the server through a preset audio transmission protocol.

[0052] In some embodiments, the recording end includes an event capture device and an audio acquisition module. The event capture device is used to capture and record the control actions performed on the image material and the trajectory actions marked on the image material when the image material is displayed, as well as the execution time corresponding to the control actions and trajectory actions. The audio acquisition module is used to collect the audio during teaching in the target classroom.

[0053] Optionally, the audio transmission protocol is the Real-Time Messaging Protocol (RTMP), which can send audio to the server in real time.

[0054] Optionally, the event capturer is a Conflict-Free Replicated DataType (CRDT) event trigger, which can listen for actions performed on image materials in a collaborative whiteboard system through a CRDT model.

[0055] In some embodiments, the server includes a storage module. After step 201, method 200 further includes storing the classroom material, the set of actions performed on the image material, and the audio associated with the target classroom into the storage module.

[0056] Step 202: Send the classroom materials, the set of actions, and the audio to the playback device.

[0057] In one possible implementation, before sending the classroom materials, the action set, and the audio to the playback end in step 202, method 200 further includes: processing the action set and the audio to obtain a candidate action set and a candidate audio, wherein the candidate action set and the candidate audio are time-synchronized; and, sending the classroom materials, the action set, and the audio to the playback end in step 202 includes: sending the classroom materials, the candidate action set, and the candidate audio to the playback end.

[0058] It should be understood that video materials in classroom materials typically consist of both images and audio. Therefore, for video materials, the process described above—"processing the set of actions and the audio to obtain a set of candidate actions and candidate audio, with the candidate action set and candidate audio synchronized in time"—does not exist. It is assumed that the images and audio in the aforementioned video materials are synchronized in time.

[0059] It should also be understood that "synchronization of candidate action set with candidate audio time" in the above scheme means that each action in the candidate action set is precisely matched with the candidate audio in time, ensuring that the first action used to indicate the execution of the audio segment at the same time is the same as the second action in the action set, or ensuring that the time deviation between the time corresponding to the first action and the execution time of the second action is less than the preset time deviation, that is, the time corresponding to the first action and the execution time of the second action are very close.

[0060] In the above technical solution, by preprocessing the action set and audio, precise temporal alignment of the action set and audio is achieved. This means that the solution eliminates potential time discrepancies in the original data (action set and audio) in advance, reducing the computational complexity and resource consumption of real-time synchronization of the action set and audio at the playback end. By completing the time synchronization of the action set and audio before transmission—for example, by pruning invalid actions, filtering erroneous actions, or adjusting audio segments—the solution also reduces data transmission volume and avoids delays or stuttering caused by dynamic correction of the action set and audio at the playback end. This improves the execution efficiency and reliability of the action set, making the playback process smoother and more stable.

[0061] In some embodiments, the server further includes a synchronization processing module to process the action set and the audio to obtain a candidate action set and a candidate audio, including: processing the action set and the audio through the synchronization processing module to obtain the candidate action set and the candidate audio.

[0062] In one possible implementation, the action set and the audio are processed to obtain a candidate action set and a candidate audio, including: converting the local execution time of each action in the action set at the recording end to the first execution time of each action at the server according to the first time deviation between the recording end and the server, to obtain a first action set; converting the local time period corresponding to the audio at the recording end to the first time period at the server according to the first time deviation, to obtain the candidate audio; and synchronizing the first execution time of each action in the first action set with the candidate audio based on the candidate audio, to obtain the candidate action set.

[0063] It should be understood that the "first time deviation" in the above scheme refers to the time difference between the system clocks of the recording end and the server at the same real time point. This real time point is the time under a unified time standard (such as UTC time). In some embodiments, the real absolute time (UTC) is 10:00:00.000, the display time on the recording end is 10:00:05.000, the display time on the server is 10:00:00.000, and the first time deviation is 5 seconds, meaning the recording end is 5 seconds ahead of the server. Essentially, the above scheme first unifies the local time of the recording end (including the local execution time of the action and the local time segment corresponding to the audio) to the time of the server (server time), i.e., the time unification stage; further, based on the server time, the first execution time (server time) of each action in the first action set is synchronized with the candidate audio, i.e., the time synchronization stage.

[0064] It should be noted that the aforementioned collaborative whiteboard system allows multiple users to operate simultaneously on the digital whiteboard layer. When multiple users (including at least one teacher and at least one student) are on multiple recording devices and perform actions on the same image material, a set of actions performed on the image material can be obtained. This set of actions includes the actions recorded by multiple recording devices and their corresponding execution times. If the execution times of the multiple actions performed on the image material recorded by each recording device are their own local time, and if the local times of each recording device are inconsistent, this will lead to confusion in the execution times of the actions recorded by multiple recording devices, making it impossible to generate an action set based on the actions recorded by multiple recording devices in chronological order. Therefore, it is necessary to unify the execution times of the actions recorded by multiple recording devices to the server time.

[0065] It should also be understood that the above scheme of "synchronizing the first execution time of each action in the first action set with the candidate audio" is to ensure that the execution time of the target action performed by the teacher on the picture material is aligned with the playback time of the audio segment in the classroom recording (i.e., the candidate audio) used to indicate the execution of the target action (i.e., the execution time and the playback time are very close), so that the two can be presented synchronously during playback.

[0066] In the above technical solution, by utilizing the first time deviation between the recording end and the server, the local time of the actions and audio at the recording end is unified to the server time, eliminating the timing misalignment problem caused by the local clock of the recording end being out of sync with the server, and avoiding the misalignment phenomenon of actions being ahead or behind the audio explanation at the playback end due to the difference in time base. Furthermore, based on candidate audio, the first execution time of each action in the first action set is synchronized with the candidate audio to obtain a candidate action set. This allows for the simultaneous playback of image materials and target audio at the playback end, as well as the synchronous presentation of each action in the target action set on the image materials. This makes the teaching playback process more closely resemble the actual teaching rhythm, enhances the reliability of data synchronization in cross-platform and multi-device scenarios, and reduces the complexity of time error correction at the playback end.

[0067] In one possible implementation, the method for determining the first time deviation between the recording end and the server includes: obtaining the first time when the recording end sends a recording request to the server, the second time when the server receives the recording request, the third time when the server returns a start recording command after processing the recording request, and the fourth time when the recording end receives the start recording command, wherein the fourth time is the local time when the audio recording begins; determining the time difference between the second time and the first time as the first total time from when the recording end sends the recording request to when the server receives the recording request; determining the time difference between the fourth time and the third time as the second total time from when the server sends the start recording command to when the recording end receives the start recording command; and determining the first time deviation based on the first total time and the second total time.

[0068] It should be understood that in the above scheme, "first time" refers to the recording time, "second time" refers to the server time, "third time" refers to the server time, and "fourth time" refers to the recording time. Furthermore, the first local time at which the recording of the action set begins is equal to or later than the fourth time.

[0069] In the above technical solution, by bidirectionally measuring the network transmission time between the recording end and the server, the first time deviation can be accurately assessed to eliminate the impact of network latency on time synchronization. This solution dynamically infers the clock difference between the recording end and the server by using the average of the bidirectional timestamp difference between the recording request and the start recording command—that is, the difference between the uplink time of the recording request (first total time) and the downlink time of the start recording command (second total time)—overcoming the problem of inaccurate estimation when dealing with one-way network latency. Furthermore, incorporating the total time into the time deviation calculation reflects the impact of the current network status on time synchronization in real time, ensuring that the time transition between the action set and the audio is closer to the real interactive scenario, further reducing the misalignment phenomenon at the playback end where actions are ahead or behind the audio narration due to differences in time references.

[0070] In some embodiments, determining the first time deviation based on the first total time and the second total time includes: determining the first time deviation based on the following formula (1);

[0071] T diff1 =(T2-T1)-(T4-T3) / 2(1)

[0072] Among them, T diff1 Let T2 be the first time deviation, T1 be the first time, T4 be the fourth time, T3 be the third time, (T2-T1) be the first total time, and (T4-T3) be the second total time.

[0073] The correctness of the above formula (1) is verified below, with the following assumptions: 1. The network uplink delay from the recording end to the server end is: D up 2. The network downlink latency from the server to the recording end is: D down =D up =D; 3, the first time deviation between the recording end and the server end is: T diff1 .

[0074] 1) The second time the server receives the recording request, it satisfies the following formula (2):

[0075] T2 = T1 + T diff1 +D up (2)

[0076] 2) The fourth time the recording terminal receives the start recording command satisfies the following formula (3):

[0077] T4 = T3 - T diff1 +D down (3)

[0078] By combining formulas (2) and (3), we can determine T. diff1 Specifically, it can be obtained through formula (1).

[0079] In some embodiments, based on the candidate audio, the first execution time of each action in the first action set is synchronized with the candidate audio, including: selecting key actions from the first action set, the key actions being actions that control page changes of the image material; and synchronizing the second execution time of each key action in the first action set with the candidate audio.

[0080] Optionally, the key action includes turning the page on the instructional page in the image material.

[0081] In one possible implementation, based on the candidate audio, the first execution time of each action in the first action set is synchronized with the candidate audio to obtain the candidate action set. This includes: taking any action in the first action set as a target action, generating a second time period based on the first execution time of the target action and a preset time period before and after the first execution time; determining a target time period that matches the second time period from the first time period corresponding to the candidate audio; performing speech recognition on an audio segment of the target time period in the candidate audio to determine whether the audio segment includes a target audio segment used to instruct the execution of the target action; if the audio segment includes the target audio segment, adjusting the first execution time based on the time in the time period corresponding to the target audio segment to obtain the candidate action set.

[0082] It should be understood that the above scheme describes that, for any action (target action), an audio segment matching a preset time period corresponding to the target action is determined from the candidate audio; when the audio segment includes a target audio segment for indicating the execution of the target action, the first execution time of the target action is adjusted by the time in the time period corresponding to the target audio segment.

[0083] It should also be understood that the "time period corresponding to the target audio segment" in the above scheme refers to the time period between the start of issuing the target audio segment (the voice command of the target action) and the end of issuing the target audio segment.

[0084] In the above technical solution, a second time period is generated by using the first execution time and a preset time period before and after the first execution time. The target audio segment associated with the target action is retrieved from the candidate audio, and then the first execution time of the target action is adjusted based on the time within the corresponding time period of the target audio segment. For example, when a "page turning" voice command is detected, the first execution time of the page turning action is automatically aligned to the precise time point after the voice command is issued, eliminating the misalignment between action and audio explanation caused by local clock errors or network latency at the recording end, achieving more accurate audio-visual synchronization. Simultaneously, the preset time period design takes into account the fault tolerance when recognizing voice commands, allowing matching of voice commands and actions within a reasonable time window, avoiding matching failures due to minute time fluctuations, enhancing the robustness of the synchronization mechanism in complex scenarios, and making the teaching playback process more closely resemble the actual teaching rhythm.

[0085] In some embodiments, generating a second time period based on a first execution time of the target action and a preset time period before and after the first execution time includes: determining a fifth time based on the first execution time and a first preset time period before the first execution time; determining a sixth time based on the first execution time and a second preset time period after the first execution time; and determining the time period between the fifth time and the sixth time as the second time period.

[0086] Optionally, the duration of the first preset time period is the same as the duration of the second preset time period.

[0087] In one possible implementation, adjusting the first execution time based on the time in the time period corresponding to the target audio segment includes: determining the time deviation between the first execution time and the end time corresponding to the target audio segment as a second time deviation; and adjusting the first execution time of the target action to the end time if the second time deviation is greater than a preset time deviation.

[0088] It should be understood that the "end time corresponding to the target audio segment" in the above scheme refers to the time when the target audio segment ends, that is, the time when the voice command of the target action is completely issued. Furthermore, the aforementioned preset time deviation refers to the maximum time deviation between the allowed execution time of the target action and the time when the voice command of the target action is completely issued.

[0089] In the aforementioned technical solution, when a significant time deviation is detected between the first execution time of the target action and the end time of the voice command for the target action, the first execution time of the target action is calibrated using the end time of the voice command. For example, if the playback device does not respond promptly after the teacher says the voice command "highlight the key points," the first execution time of the "highlight the key points" action is automatically aligned to the end time of the voice command. This eliminates the perceptual incongruity of the action lagging behind the voice command, ensuring strong temporal consistency between the action and the audio explanation during playback. By filtering out minor time deviations through preset deviations, adjustments are triggered only when the time deviation exceeds the limit, reducing unnecessary temporal corrections, maintaining the original logic of action execution while avoiding rhythm distortion caused by excessive intervention.

[0090] Optionally, the preset time deviation is 500 milliseconds.

[0091] Figure 3 This is a schematic diagram illustrating how to synchronize the first execution time of each action in a first action set with the candidate audio, as provided in an embodiment of this application.

[0092] For example, such as Figure 3 As shown, taking the target action in the first action set as action 1, the first execution time of action 1 is 10:00:05.000, and the preset time deviation is 500 milliseconds as an example, the process of synchronizing the first execution time of action 1 with the candidate audio is described.

[0093] Specifically, based on the first execution time of action 1, the first preset time period a1 before the first execution time, and the second preset time period a2 after the first execution time, a second time period is generated; a target time period a3 matching the second time period is determined from the first time period corresponding to the candidate audio; speech recognition is performed on the audio segment of the target time period in the candidate audio to determine whether the audio segment includes a target audio segment used to instruct the execution of the target action; if the audio segment includes the target audio segment a4, the time deviation between the first execution time and the end time (10:00:02.000) corresponding to the target audio segment is determined as the second time deviation (3 seconds); 3 seconds is far greater than 500 milliseconds, so the first execution time of the target action is adjusted to the end time.

[0094] Figure 4This is a schematic flowchart illustrating another classroom playback method provided in the embodiments of this application.

[0095] For example, the above-mentioned classroom replay method can be derived from the above-mentioned Figure 1 The playback terminal in the recording and playback system shown is used to provide playback functionality for the target lesson, such as... Figure 4 As shown, the method 400 includes the following steps 401 and 404.

[0096] Step 401: In response to the click operation on the playback content corresponding to the target classroom in the classroom list, the recorded classroom materials, the input control for filtering classroom materials, and the target control for playing back the target classroom are displayed on the first screen of the display interface of the playback terminal.

[0097] It should be understood that the "target classroom" in step 401 above has the same meaning and specific implementation method as the "target classroom" in step 201 above, and can both be the 21st lesson of the mathematics course.

[0098] It should also be understood that the "classroom materials" in step 401 above have the same meaning and specific implementation method as the "classroom materials" in step 201 above, and will not be repeated here.

[0099] Optionally, the target control mentioned above is a playback control.

[0100] In some embodiments, prior to step 401, method 400 further includes: responding to a link address input on the playback device for playing back multiple classes; displaying a class list containing multiple classes and playback content corresponding to each class on a seventh screen of the display interface based on the link address; and step 401 includes: if a click operation on the playback content corresponding to a target class is detected, responding to the click operation on the playback content corresponding to the target class in the class list, displaying the recorded class material in the target class and the target control for playing back the target class on the first screen.

[0101] It should be understood that the "link address" in the above scheme can be regarded as a Uniform Resource Locator (URL) address. On the recording end, the interface on the server can be directly accessed through the above link address to upload the recorded classroom materials to the server. On the playback end, the screen on the server can be directly accessed through the above link address to replay any classroom.

[0102] Step 402: In response to the click operation of the first classroom material in the classroom materials, the target classroom is replayed on the second screen of the display interface, starting from the first classroom material.

[0103] It should be understood that "playing back the target classroom starting from the first classroom material" in step 402 above means that when playing back the target classroom, the first frame of the playback belongs to the first classroom material.

[0104] One possible implementation is that the first classroom material is a first image material or a first video material. Step 402 includes: in response to a click operation on the first image material, playing back the target classroom on the second screen starting from the first image material; in response to a click operation on the first video material, playing back the first video material on the second screen, and after playing back the first video material, displaying a prompt message on the fifth screen of the display interface asking whether to continue playing back the target classroom; in response to a confirmation operation of the prompt message asking whether to continue playing back the target classroom, identifying at least one classroom material recorded after the first video material, and playing back the target classroom starting from the at least one classroom material.

[0105] It should be understood that "playing back the target lesson starting from the first image material" in the above scheme means that when playing back the target lesson, the first frame is the image corresponding to the first image material. Similarly, if the first lesson material is the first video material, then playing back the target lesson starting from the first video material means playing the first video material first.

[0106] In the above technical solution, clicking on any image material allows the second screen to start replaying the target lesson from the corresponding image material, directly jumping the playback progress to the lesson replay process corresponding to that image material. This eliminates the need for students or teachers to waste time watching the replays of previous image materials when they only need to replay the lesson for a specific image material, providing a better lesson replay experience. Similarly, clicking on any video material allows the second screen to first replay the corresponding video material, directly jumping the playback progress to the lesson replay process for that video material. This also eliminates the need for students or teachers to waste time watching the replays of other materials when they only need to replay the teaching process for certain video materials, providing a better lesson replay experience.

[0107] In some embodiments, the target classroom is replayed on the second screen starting from the first image material, and during the replay of the target classroom starting from the first image material, it is detected whether a click operation on the return control on the second screen is received; in response to the click operation on the return operation, the screen jumps from the second screen to the first screen.

[0108] The above technical solution facilitates students or teachers to continue watching the classroom replay process corresponding to a certain image material after watching it, and further replay only the classroom replay process corresponding to other image materials by clicking on other image materials on the first screen. This can improve the replay efficiency of the replay terminal for any classroom.

[0109] In one possible implementation, the method 400 further includes: in response to a confirmation of a prompt message indicating that playback of the target lesson should not continue, switching from the fifth screen to the first screen.

[0110] It should be understood that after switching from the fifth screen to the first screen, students or teachers can continue to operate on the classroom materials and target controls on the first screen based on playback needs.

[0111] The above technical solution facilitates students or teachers to continue watching other video materials on the first screen after watching the classroom replay of a certain video material, and further replay only the classroom replay of other video materials. This can improve the replay efficiency of the playback terminal for any classroom.

[0112] One possible implementation is that, in step 202, the playback of the target classroom on the second screen starting from the first image material includes: obtaining a set of actions performed on the target image material recorded during the target classroom and the target audio associated with the target classroom. The target image material includes the first image material and the image materials following the first image material, and the target audio is the audio recorded synchronously when the target image material was recorded. On the second screen, the target image material and the target audio are played synchronously, and the corresponding actions are performed on the target image material according to the execution time of each action in the action set.

[0113] It should be understood that "the target audio is the audio recorded synchronously when recording the target image material" in the above scheme refers to the classroom recording when explaining the target image material.

[0114] In some embodiments, the target image material and the target audio are played synchronously, and corresponding actions are performed on the target image material according to the execution time of each action in the action set. This includes: playing the target image material and the target audio synchronously in the left area of ​​the second screen, performing corresponding actions on the target image material according to the execution time of each action in the action set, displaying the playback progress of the target audio in the right area of ​​the second screen, and synchronously displaying the text content converted from the target audio.

[0115] The process of "synchronously playing target image materials and target audio" is described below in two scenarios.

[0116] Scenario 1:

[0117] In one possible implementation, the corresponding action is executed on the target image material according to the execution time of each action in the action set, including: when the playback time corresponding to the playback progress of the target audio is equal to the execution time of an action in the action set, the action is executed on the target image material at that playback time.

[0118] It should be understood that in the above solution, the playback progress of the target audio can be displayed on the playback interface of the playback terminal. The above solution treats the action set as a time-discrete series of actions. It requires real-time comparison of the time corresponding to the playback progress (specifically the current time) with the execution times of the actions in the action set (usually arranged in chronological order). When the time corresponding to the playback progress of the target audio matches the execution time of a certain action, the action is executed on the target image material at that time.

[0119] In the above technical solution, target image materials and target audio are played synchronously. During the synchronous playback of target image materials and target audio, the execution time of the action is precisely aligned with the playback progress of the target audio. This enables real-time synchronization between the operation of the target image materials and the explanation of the target audio. This ensures the timing accuracy of the teaching scene restoration and ensures that when teachers or students view the target image materials, the target audio can correspond to the currently displayed teaching content in real time. It also avoids redundant data storage caused by recording at full frame rate using video streams in traditional solutions.

[0120] Scenario 2:

[0121] In some embodiments, performing corresponding actions on the target image material according to the execution time of each action in the action set includes: displaying a first timeline for controlling the playback progress of the action set and a second timeline for controlling the playback progress of the target audio on the second screen, and determining a third time deviation between the current first time of the playback progress on the first timeline and the current second time of the playback progress on the second timeline; if the third time deviation does not meet a preset time deviation, determining a seventh time based on the current first time and the preset time deviation, and adjusting the current first time of the playback progress on the first timeline to the seventh time, wherein the preset time deviation is the time deviation that should exist between the current first time and the current second time; and when the seventh time is equal to the execution time of an action in the action set, performing the action on the target image material at the seventh time.

[0122] It should be understood that in the above solution, the playback progress of the action set (specifically the first timeline) and the playback progress of the target audio (specifically the second timeline) are simultaneously displayed on the second screen of the display interface. In this solution, the action set is treated as a time-continuous series of actions, and the playback progress of the action set is adjusted in real time according to the playback progress of the target audio. After adjustment, when the time corresponding to the playback progress of the action set (specifically the seventh time) matches the execution time of a certain action, the action is executed on the target image material at that seventh time.

[0123] It should also be understood that adjusting the playback progress of the action set based on the playback progress of the target audio is primarily based on the following design logic: the second timeline corresponding to the target audio serves as the core timeline of the target lesson, and its playback progress corresponds to the actual temporal sequence of the teaching content in the target image materials. During recording, the execution time of all actions (such as page turning and annotation) is recorded relative to the starting point of the audio. This design allows the playback end to quickly retrieve and trigger the corresponding action simply by using the current playback time of the target audio. Furthermore, because the target audio has strict continuity, there will be no time jumps or deviations, ensuring that operations such as trajectory actions and control actions are completely synchronized with the rhythm of the teacher's explanation. In some embodiments, the aforementioned preset time deviation is the time deviation that exists when the recording of the audio and action set begins at the recording end (i.e., the time deviation between the first local time and the fourth time).

[0124] In one possible implementation, the corresponding actions are executed on the target image material according to the execution time of each action in the action set, including: determining whether there are actions with the same execution time in the action set; if there are actions with the same execution time in the action set, obtaining the execution priority of each action; and executing the corresponding actions on the target image material according to the execution time and execution priority of each action.

[0125] It should be understood that in the above scheme, multiple actions may be performed on the target image material simultaneously at the recording end. This phenomenon can occur in the following scenarios: Scenario 1: Real-time operation by multiple users, specifically, multiple users (including at least one teacher and at least one student) simultaneously annotate, write text, add formulas, and draw line segments on the target image material. Scenario 2: Dynamic courseware interaction scenario, specifically, interactive elements (such as buttons and animation triggers) are embedded in the target image material. When the teacher triggers the interactive element (manually controls the action), the automatic triggering event (automatic control action) of the target image material occurs simultaneously. Optionally, when a user clicks a button to play the video, a timed page-turning event of the target image material also occurs simultaneously.

[0126] Furthermore, it should be noted that the executor in the collaborative whiteboard system can acquire multiple actions at the same time, but the executor can only process the actions sequentially (such as checking the legality of the actions), and then distribute each action to the corresponding renderer for rendering. Therefore, it is necessary to prioritize multiple actions at the same time, which leads to the execution priority of each action mentioned above.

[0127] In the above technical solution, by detecting and handling action conflicts with the same execution time, and dynamically scheduling the execution order of multiple actions using execution priorities, it is possible to ensure that the operation of target image materials and audio explanations are strictly matched in temporal logic. This solution effectively solves the problem of sequential disorder that may occur when multiple actions are executed concurrently. For example, in scenarios where page-turning actions are executed before annotation actions, it avoids display abnormalities or logical errors in target image materials caused by action stacking. Therefore, this solution can accurately reproduce the interactive details of the target classroom teaching process. At the same time, the priority rule also assigns differentiated weights to different action types, ensuring both the continuity of the teaching process and the integrity of auxiliary operations such as trajectory actions, improving the reliability and consistency of playback content in complex teaching scenarios.

[0128] Optionally, when the above-mentioned multiple actions with the same execution time include both manual control actions and automatic control actions, the execution priority of these multiple actions is: manual control actions > automatic control actions.

[0129] Optionally, when the above-mentioned multiple actions with the same execution time include the action of changing the playback viewport of the target image material, the trajectory action of marking on the target image material, and the screen projection action implemented through the collaborative whiteboard system, the execution priority of these multiple actions is: trajectory action > action of changing the playback viewport of the target image material > screen projection action.

[0130] In one possible implementation, the corresponding actions are executed on the teaching courseware according to the execution time and execution priority of each action, including: determining a target execution time that matches the current playback time from the execution times of multiple actions in the action set; if the number of actions corresponding to the target execution time is greater than a preset number, the actions corresponding to the target execution time are executed on the target image material in sequence according to the execution priority during the current playback time.

[0131] It should be understood that in the above scheme, the "preset quantity" is usually 1, that is, when the number of actions corresponding to the target execution time is at least 2, each action is executed on the target image material in sequence according to the execution priority of each action corresponding to the target execution time.

[0132] In the above technical solution, the scale of concurrent execution of multiple actions occurring simultaneously on the target image material is controlled by a preset quantity. Combined with execution priority, this ensures the orderly processing of multiple actions, effectively alleviating instantaneous rendering pressure and avoiding logical conflicts in operations. When encountering high-density concurrent actions, this solution can prioritize the execution of critical actions that affect subsequent processes, such as page turning, before handling actions that change the playback viewport of the target image material. This prevents screen distortion or delays caused by action accumulation and ensures the continuity and accuracy of the target image material. Furthermore, the preset quantity can be dynamically adjusted according to hardware performance, balancing the operational stability of low-performance devices with the real-time requirements of high-performance devices. This enhances the solution's device adaptability and scene generalization capabilities, accurately reproducing the operational details of complex interactive scenes while maintaining the smooth playback of the target image material.

[0133] In some embodiments, after determining a target execution time that matches the current playback time from the execution times of multiple actions in the action set, the method 400 further includes: if the number of actions corresponding to the target execution time is equal to a preset number, executing the action corresponding to the target execution time on the target image material at the current playback time.

[0134] Step 403: In response to the input operation of the target filtering conditions in the input control, at least one candidate classroom material is selected from the recorded classroom materials based on the target filtering conditions, and the target classroom is replayed on the third screen of the display interface based on the at least one candidate classroom material.

[0135] It should be understood that the target filtering conditions entered in the "input control" in step 403 above can be composite filtering conditions or simple filtering conditions. The composite filtering conditions are composed of two or more simple filtering conditions combined by Boolean operators (such as AND and OR). Therefore, the filtered candidate classroom materials are one or more candidate classroom materials.

[0136] Optionally, the target selection criteria are: explain the target formula AND explain the target topic.

[0137] In one possible implementation, step 403, which involves replaying the target classroom based on the at least one candidate classroom material, includes: obtaining the recording time slots corresponding to the recording of each candidate classroom material; and replaying the target classroom for each recording time slot in the at least one recording time slot according to the order of recording time.

[0138] In the above technical solution, the recording time slots corresponding to each candidate classroom material can be obtained, allowing direct location of the recording time slots (class time slots) that students or teachers are interested in. Furthermore, by playing back the target classrooms of each recording time slot that students or teachers are interested in in chronological order of recording time, the playback of playback content that students or teachers are interested in can be done in a step-by-step manner. This not only helps students or teachers understand the teaching content, but also avoids wasting students' or teachers' time by playing back irrelevant playback content.

[0139] In one possible implementation, step 403, which involves selecting at least one candidate classroom material from the recorded classroom materials and replaying the target classroom on the third screen of the display interface based on the at least one candidate classroom material, includes: selecting the at least one candidate classroom material from the recorded classroom materials and displaying the at least one candidate classroom material on the sixth screen of the display interface; and replaying the target classroom based on the remaining classroom materials in response to a deletion operation of some classroom materials in the at least one candidate classroom materials.

[0140] In the above technical solution, after displaying at least one candidate classroom material selected by students or teachers based on target filtering conditions on the sixth interface of the display interface, students or teachers are allowed to further delete at least one candidate classroom material on the sixth interface. This can avoid mis-screening caused by students or teachers when filtering classroom materials through target filtering conditions. The above method can efficiently determine classroom materials that students or teachers are interested in.

[0141] Step 404: In response to a click on the target control, the target lesson is replayed on the fourth screen of the display interface from the start of recording.

[0142] It should be understood that "playing back the target classroom from the start of recording" in step 404 above means playing back the target classroom from the beginning.

[0143] In some embodiments, the playback end includes a scheduling center, an action rendering engine, and a media playback engine. The method 400 further includes: distributing an action set to the action rendering engine through the scheduling center and distributing the target audio to the media playback engine; synchronously playing the target image material and the target audio, and performing corresponding actions on the target image material according to the execution time of each action in the action set, including: synchronously playing the target image material and the target audio, rendering the target audio through the media playback engine, and performing corresponding actions on the target image material according to the execution time of each action in the action set, while simultaneously rendering the corresponding actions through the action rendering engine.

[0144] Optionally, the aforementioned media playback engine can render the sound effects of the sounds in the target audio.

[0145] In some embodiments, the motion rendering engine includes a whiteboard rendering engine and a trajectory rendering engine, wherein the whiteboard rendering engine is used to render control actions and the trajectory rendering engine is used to render trajectory actions.

[0146] Optionally, the aforementioned trajectory rendering engine can render the color and thickness of text, formulas, and line segments generated after performing trajectory actions on the target image material, and the aforementioned whiteboard rendering engine can adjust the speed of page turning actions.

[0147] Specifically, the whiteboard rendering engine can be adjusted from using a smooth animation at 60 frames per second for page turning to using a smooth animation at 30 frames per second. The aforementioned smooth animation refers to an animation effect that is perceived by the user as without any stuttering or visual continuity.

[0148] The following is a procedure for replaying a class session. Specifically, Figure 5 This is a schematic diagram of an interface for recording classroom materials in the first classroom, provided in an embodiment of this application.

[0149] For example, such as Figure 5 The recording device shown can be clicked by the teacher when starting the first lesson. Figure 5 Use the recording control in the app to record classroom sessions and obtain classroom materials recorded during the first class.

[0150] Subsequently, the recorded classroom materials from the first classroom can be uploaded to the server by entering the URL address corresponding to multiple classrooms in the browser interface of the recording terminal.

[0151] Next, Figure 6(a) is a schematic diagram of an interface for replaying the first class as provided in an embodiment of this application. As shown in Figure 6(a), the student can enter the above URL address (P.seewo.com / v4 / pc / latest / index.html# / page / homepage) in the browser interface of the playback terminal to enter the display screen for replaying the class. The left area of ​​the display screen shows a search control, an add control, and a class control. After the student clicks the class control, a class list is displayed in the right area of ​​the display screen. The class list includes multiple classes and corresponding playback content. The playback content includes the total recording time of the corresponding class, the recording start time, and the uploader information. Among them, the search control is used to directly search for a specific class, and the add control is used to add a class and its corresponding playback content, as well as the classroom materials recorded in the class, to the class list.

[0152] As shown in Figure 6(b), after a student clicks on the replay content of the first lesson in the class list, the replay terminal displays the first screen as shown in Figure 6(c) (the corresponding URL address is P.seewo.com / v4 / pc / latest / index.html# / page / board / 154621346). This first screen displays the class materials recorded in the first lesson, input controls for filtering class materials, and playback controls for replaying the first lesson. Students can input filtering criteria for the class materials in the input controls. The class materials include the first, second, third, and fourth slides of the PPT, the first page of whiteboard notes generated through the collaborative whiteboard system, and video 1 generated through screen projection. Furthermore, when there are many class materials, students can quickly view other class materials using the slider on the right side of the first screen. After the student clicks the playback control, the replay terminal displays the second screen as shown in Figure 6(d). This second screen is used to replay the first lesson. Specifically, the left side of the second screen is used to play classroom materials. When playing image materials within the classroom materials, the associated audio is played simultaneously, and corresponding actions are performed on the image materials according to the execution time of each action in the set of actions performed on the image materials. The left side of the second screen also displays the trajectory actions performed on the PowerPoint slides to highlight the main topic. Furthermore, the right side of the second screen displays the audio playback progress and the converted text content.

[0153] Figure 7 This is a schematic diagram of the structure of a classroom playback device provided in an embodiment of this application.

[0154] For example, the device is installed at a playback end, which is used to provide playback functionality for the target lesson, such as... Figure 7 As shown, the device 700 includes:

[0155] Display module 701 is used to respond to the click operation on the playback content corresponding to the target classroom in the classroom list, and to display the recorded classroom materials, the input control for filtering classroom materials, and the target control for playing back the target classroom on the first screen of the display interface of the playback end.

[0156] Playback module 702 is used for:

[0157] In response to a click operation on the first lesson material in the lesson materials, the target lesson is replayed on the second screen of the display interface, starting from the first lesson material;

[0158] In response to the input operation of the target filtering conditions in the input control, at least one candidate classroom material is selected from the recorded classroom materials based on the target filtering conditions, and the target classroom is replayed on the third screen of the display interface based on the at least one candidate classroom material;

[0159] In response to a click on the target control, the target lesson is replayed on the fourth screen of the display interface from the start of recording.

[0160] Optionally, the first classroom material is a first image material or a first video material. The playback module 702 is specifically used for: responding to a click operation on the first image material, playing back the target classroom on the second screen starting from the first image material; responding to a click operation on the first video material, playing back the first video material on the second screen, and after playing back the first video material, displaying a prompt message on the fifth screen of the display interface asking whether to continue playing back the target classroom; and responding to a confirmation operation of the prompt message asking whether to continue playing back the target classroom, identifying at least one classroom material recorded after the first video material, and playing back the target classroom starting from the at least one classroom material.

[0161] Optionally, the device 700 further includes a jump module for jumping from the fifth screen to the first screen in response to a confirmation operation of a prompt message indicating that playback of the target class should not continue.

[0162] Optionally, the device 700 further includes: an acquisition module, used to acquire a set of actions performed on target image materials recorded in the target classroom and target audio associated with the target classroom, the target image materials including the first image material and image materials after the first image material, and the target audio being audio recorded synchronously when the target image materials were recorded; the playback module 702 is specifically used to synchronously play the target image materials and the target audio on the second screen, and to perform corresponding actions on the target image materials according to the execution time of each action in the action set.

[0163] Optionally, the playback module 702 includes a processing submodule, which is used to execute the action on the target image material at the playback time when the playback time corresponding to the playback progress of the target audio is equal to the execution time of an action in the action set.

[0164] Optionally, the device 700 further includes: a determining module, used to determine whether there are actions with the same execution time in the action set; the obtaining module, specifically used to obtain the execution priority of each action when there are actions with the same execution time in the action set; and the processing submodule, specifically used to execute the corresponding action on the target image material according to the execution time and execution priority of each action.

[0165] Optionally, the determining module is specifically used to determine the target execution time that matches the current playback time from the execution times of multiple actions in the action set; the processing submodule is further used to execute the actions corresponding to the target execution time on the target image material in sequence according to the execution priority when the number of actions corresponding to the target execution time is greater than the preset number.

[0166] Optionally, the acquisition module is specifically used to acquire the recording time period corresponding to each candidate classroom material; the playback module 702 is also specifically used to play back the target classroom of each recording time period in at least one recording time period according to the order of recording time.

[0167] Optionally, the display module 701 is specifically used to filter out the at least one candidate classroom material from the recorded classroom materials and display the at least one candidate classroom material on the sixth interface of the display interface; the playback module 702 is further used to respond to the deletion operation of some classroom materials in the at least one candidate classroom material and play back the target classroom based on the remaining classroom materials in the at least one candidate classroom material.

[0168] Figure 8 This is a schematic diagram of the structure of a classroom playback device provided in an embodiment of this application.

[0169] For example, the device is installed on the server side, such as... Figure 8 As shown, the device 800 includes:

[0170] The receiving module 801 is used to receive classroom materials recorded in the target classroom, a set of actions performed on each image material in the classroom materials, and audio associated with the target classroom sent by the recording end. The set of actions includes control actions when displaying the image material and trajectory actions marked on the image material.

[0171] The sending module 802 is used to send the classroom materials, the set of actions, and the audio to the playback end.

[0172] Figure 9 This is a schematic diagram of the structure of a playback terminal provided in an embodiment of this application.

[0173] For example, such as Figure 9 As shown, the playback terminal 900 includes a memory 901 and a processor 902. The memory 901 stores executable program code 903, and the processor 902 is used to call and execute the executable program code 903 to perform a classroom playback method.

[0174] Furthermore, embodiments of this application also protect an apparatus that may include a memory and a processor, wherein the memory stores executable program code, and the processor is used to call and execute the executable program code to perform a classroom playback method provided in embodiments of this application.

[0175] This embodiment can divide the device into functional modules based on the above method example. For example, each module can correspond to a separate function, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0176] When each functional module is divided according to its corresponding function, the device may further include an acquisition module, a processing sub-module, a determination module, a receiving module, a sending module, a playback module, and a jump module. It should be noted that all relevant content in the above method embodiments can be referenced from the functional descriptions of the corresponding functional modules, and will not be repeated here.

[0177] It should be understood that the device provided in this embodiment is used to execute the above-described classroom playback method, and therefore can achieve the same effect as the above-described implementation method.

[0178] When using integrated units, the device may include a processing module and a storage module. When applied to an electronic device, the processing module can be used to control and manage the operation of the electronic device. The storage module can be used to support the execution of relevant executable program code by the electronic device.

[0179] The processing module may be a processor or a controller, which can implement or execute various exemplary logic blocks, modules, and circuits shown in conjunction with the disclosure of this application. The processor may also be a combination of functions that implement computing capabilities, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc., and the storage module may be a memory.

[0180] In addition, the device provided in the embodiments of this application may specifically be a chip, component or module. The chip may include a connected processor and a memory. The memory is used to store instructions. When the processor calls and executes the instructions, the chip can execute a classroom playback method provided in the above embodiments.

[0181] This embodiment also provides a computer-readable storage medium storing executable program code. When the executable program code is run on a computer, the computer performs the aforementioned method steps to implement the classroom playback method provided in the above embodiment.

[0182] This embodiment also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement a classroom playback method provided in the above embodiment.

[0183] In this embodiment, the device, computer-readable storage medium, computer program product, or chip are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0184] Through the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0185] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0186] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for replaying classroom lessons, characterized in that, The method is executed by a playback terminal, which provides playback functionality for the target lesson. The method includes: In response to a click operation on the playback content corresponding to the target classroom in the classroom list, the recorded classroom materials, input controls for filtering classroom materials, and target controls for playing back the target classroom are displayed on the first screen of the display interface of the playback terminal. In response to a click operation on the first classroom material in the classroom materials, the target classroom is replayed on the second screen of the display interface, starting from the first classroom material; In response to the input operation of target filtering conditions in the input control, at least one candidate classroom material is selected from the recorded classroom materials based on the target filtering conditions, and the target classroom is replayed on the third screen of the display interface based on the at least one candidate classroom material; In response to a click on the target control, the target lesson is replayed on the fourth screen of the display interface from the start of recording.

2. The method according to claim 1, characterized in that, The first classroom material is a first image material or a first video material. The step of responding to a click operation on the first classroom material in the classroom materials by replaying the target lesson on the second screen of the display interface, starting from the first classroom material, includes: In response to a click on the first image material, the target classroom is replayed on the second screen, starting from the first image material; In response to a click operation on the first video material, the first video material is played back on the second screen, and after the first video material has been played back, a prompt message is displayed on the fifth screen of the display interface asking whether to continue playing back the target classroom. In response to a confirmation message prompting to continue playing back the target class, at least one class recording material recorded after the first video material is identified, and playback of the target class begins from the at least one class recording material.

3. The method according to claim 2, characterized in that, The method further includes: In response to the confirmation message indicating that the playback of the target class should not continue, the screen will switch from the fifth screen to the first screen.

4. The method according to claim 2, characterized in that, The replay of the target classroom on the second screen, starting from the first image material, includes: Obtain the set of actions performed on the target image material recorded in the target classroom and the target audio associated with the target classroom. The target image material includes the first image material and the image material after the first image material. The target audio is the audio recorded synchronously when the target image material was recorded. On the second screen, the target image material and the target audio are played synchronously, and the corresponding actions are performed on the target image material according to the execution time of each action in the action set.

5. The method according to claim 4, characterized in that, The step of performing corresponding actions on the target image material according to the execution time of each action in the action set includes: When the playback time corresponding to the playback progress of the target audio is equal to the execution time of an action in the action set, the action is executed on the target image material during the playback time.

6. The method according to claim 4, characterized in that, The step of performing corresponding actions on the target image material according to the execution time of each action in the action set includes: Determine whether there are actions with the same execution time in the set of actions; If there are actions with the same execution time in the set of actions, obtain the execution priority of each action; According to the execution time and execution priority of each action, the corresponding action is executed on the target image material.

7. The method according to claim 6, characterized in that, The step of performing corresponding actions on the target image material according to the execution time and execution priority of each action includes: Determine the target execution time that matches the current playback time from the execution times of multiple actions in the action set; If the number of actions corresponding to the target execution time is greater than the preset number, the actions corresponding to the target execution time are executed on the target image material in sequence according to the execution priority at the current playback time.

8. The method according to claim 1, characterized in that, The step of replaying the target classroom based on the at least one candidate classroom material includes: Obtain the recording time slots corresponding to each candidate classroom material; Playback of the target classroom for each of the recorded periods in chronological order of recording time.

9. The method according to claim 1, characterized in that, The step of selecting at least one candidate classroom material from the recorded classroom materials and replaying the target classroom on the third screen of the display interface based on the at least one candidate classroom material includes: The at least one candidate classroom material is selected from the recorded classroom materials and displayed on the sixth interface of the display interface; In response to the deletion operation of a portion of the classroom materials in the at least one candidate classroom materials, the target classroom is replayed based on the remaining classroom materials in the at least one candidate classroom materials.

10. A classroom playback device, characterized in that, The device is installed at a playback terminal, which provides playback functionality for the target lesson. The device includes: The display module is used to respond to the click operation on the playback content corresponding to the target classroom in the classroom list, and to display the recorded classroom materials, the input control for filtering classroom materials, and the target control for playing back the target classroom on the first screen of the display interface of the playback terminal. The playback module is used for: In response to a click operation on the first classroom material in the classroom materials, the target classroom is replayed on the second screen of the display interface, starting from the first classroom material; In response to the input operation of target filtering conditions in the input control, at least one candidate classroom material is selected from the recorded classroom materials based on the target filtering conditions, and the target classroom is replayed on the third screen of the display interface based on the at least one candidate classroom material; In response to a click on the target control, the target lesson is replayed on the fourth screen of the display interface from the start of recording.

11. A playback terminal, characterized in that, The playback terminal is used to provide playback functionality for the target lesson, and the playback terminal includes: Memory, used to store executable program code; A processor for calling and running the executable program code from the memory, such that the playback end performs the method as described in any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores executable program code that, when executed, implements the method as described in any one of claims 1 to 9.

Images