A teacher terminal and a student terminal

By allowing students to show or hide the teacher's video based on the course mode identifier on their terminals, and teachers to flexibly switch course modes and control the camera, the problem of poor user experience when students see teacher videos or courseware on their terminals has been solved. This enables synchronous transmission and flexible switching of audio and video data, thus improving the student's user experience.

CN116564145BActive Publication Date: 2026-05-29JUHAOKAN TECH CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
JUHAOKAN TECH CO LTD
Filing Date
2022-01-27
Publication Date
2026-05-29

AI Technical Summary

Technical Problem

When displaying teacher videos or courseware on existing student terminals, the video either obscures the courseware content or only displays the courseware without showing the teacher's video, resulting in a poor student experience.

Method used

The student terminal displays or hides the teacher's video according to the course mode identifier, and controls the display of the teacher's window through video controls. The teacher terminal can flexibly switch course modes and control the camera to turn on or off, ensuring the synchronous transmission of audio and video data.

Benefits of technology

It enables students to flexibly control the display of teacher video in different course modes, improving the students' experience and ensuring the synchronous transmission and flexible switching of audio and video data to meet the needs of different courses.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116564145B_ABST
    Figure CN116564145B_ABST
Patent Text Reader

Abstract

The embodiment provides a teacher terminal and a student terminal. When a teacher teaches, the teacher terminal sends a mode identifier to a server. When a student joins an online class, the student terminal sends a student request to the server, so that the server responds to the student request and issues a request content. The request content includes the mode identifier. If the mode identifier is a first identifier, the student terminal displays a first student interface. The first student interface includes a video control. The student can use the video control to control the display of the second terminal to display / hide the teacher window according to the requirement. The student has a better experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of smart terminal technology, and in particular to a teacher terminal and a student terminal. Background Technology

[0002] Currently, online classes are becoming increasingly common, especially when schools are unable to open normally due to special unforeseen circumstances. Online classes have become an important means for teachers and students to ensure that learning continues despite school closures.

[0003] During online classes, students and teachers can communicate remotely through the online learning system. This system can include student terminals, teacher terminals, and a server. Teachers can use their terminals to send videos or courseware to the server; the server can download these videos or courseware to student terminals; and student terminals can display and view the downloaded videos or courseware.

[0004] In existing student terminals, when displaying teacher videos or courseware, the teacher video either remains constantly displayed, obscuring the courseware content, or only the courseware is displayed without the teacher video, resulting in a poor student experience. Summary of the Invention

[0005] The first aspect of this application provides a student terminal configured as follows:

[0006] When a student joins an online class, a student request is sent to the server. The student request includes at least a course identifier, so that the server responds to the student request, selects the course corresponding to the course identifier, and sends the requested content of the course. If the mode identifier of the course is a first identifier, the request content includes at least the mode identifier, teacher video, and teacher audio. If the mode identifier is a second identifier, the request content includes at least the mode identifier and teacher audio.

[0007] In response to receiving the request content, the pattern identifier is read;

[0008] If the mode identifier is the first identifier, the teacher's audio is played and the first student interface is displayed. The first student interface includes courseware and video controls. The courseware is pre-stored in the student terminal, or distributed by the server, or generated in real time during class.

[0009] In response to a user's touch on the video control, the teacher window is shown / hidden, and the teacher window is used to play the teacher video;

[0010] If the mode identifier is the second identifier, the teacher's audio is played and a second student interface is displayed, which includes the courseware.

[0011] A second aspect of this application provides a teacher terminal equipped with a camera for capturing teacher videos; configured to:

[0012] When a teacher starts an online class, in response to the teacher's selection of a course, the mode identifier corresponding to the course is read.

[0013] If the mode identifier is the first identifier, the camera is turned on to capture the teacher's video and the audio capture device is turned on to capture the teacher's audio. The teacher's video, the teacher's audio, and the mode identifier are then pushed to the server.

[0014] If the pattern identifier is the second identifier, send the teacher's audio and the pattern identifier to the server.

[0015] This embodiment provides a technical solution. When a teacher is teaching, the teacher's terminal sends a mode identifier to the server. When a student joins the online class, the student's terminal sends a student request to the server, so that the server responds to the student's request and sends the requested content. The request content includes a mode identifier. If the mode identifier is a first identifier, the student's terminal displays a first student interface. The first student interface includes video controls, which students can use to control the display of the teacher window on the second terminal's screen as needed, resulting in a better student experience. Attached Figure Description

[0016] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 A structural block diagram of an online course system provided as a feasible embodiment;

[0018] Figure 2 A flowchart of an online course system assignment provided as a feasible embodiment;

[0019] Figure 3 A schematic diagram of a first student interface provided for a feasible embodiment;

[0020] Figure 4 A schematic diagram of a second student interface provided for a feasible embodiment;

[0021] Figure 5 A diagram showing the changes in the student terminal display interface during online classes, provided as a feasible embodiment.

[0022] Figure 6 A flowchart of a course mode switching method provided as a feasible embodiment;

[0023] Figure 7 A schematic diagram of a first teacher interface provided for a feasible embodiment;

[0024] Figure 8 A schematic diagram of a first teacher interface provided for a feasible embodiment;

[0025] Figure 9 A flowchart illustrating a student interface switching method provided in a feasible embodiment;

[0026] Figure 10 A schematic diagram of a second teacher interface provided for a feasible embodiment;

[0027] Figure 11 This is a diagram illustrating the changes in the display interfaces of the teacher's and student's terminals during an online class, provided as a feasible embodiment.

[0028] Figure 12 A flowchart illustrating a student interface switching method provided in a feasible embodiment;

[0029] Figure 13 This is a diagram illustrating the changes in the display interfaces of the teacher's and student's terminals during an online class, provided as a feasible embodiment.

[0030] Figure 14 A flowchart of a camera control method provided in a feasible embodiment;

[0031] Figure 15 A schematic diagram of a first teacher interface provided for a feasible embodiment;

[0032] Figure 16 A flowchart for retrieving teacher videos is provided as a feasible implementation example;

[0033] Figure 17 A flowchart for retrieving teacher videos is provided as a feasible implementation example;

[0034] Figure 18 A structural block diagram of an online course system provided as a feasible embodiment;

[0035] Figure 19 A flowchart of an online course system operation is provided as a feasible embodiment. Detailed Implementation

[0036] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0037] It should be understood that, when used in this specification and the appended claims, the terms "comprising" and "including" indicate the presence of the described features, integrals, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or collections thereof.

[0038] It should also be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of the application. As used in this specification and the appended claims, unless the context clearly indicates otherwise.

[0039] The word "a", "one", and "the" in the singular form are intended to include the plural form.

[0040] In some embodiments, the viewer terminal may not capture audio and video, but only pull the audio and / or video streams from the broadcaster terminal in the service room. Alternatively, the viewer terminal may only capture audio and not video, or only capture video and not audio, while simultaneously pulling the audio and / or video streams from the broadcaster terminal in the service room.

[0041] During online classes, students and teachers can communicate remotely through an online learning system. This system includes student terminals, teacher terminals, and a server. Teachers can send videos or courseware to the server using their terminals; the server can download these videos or courseware to student terminals; and student terminals can display the downloaded videos or courseware, allowing students to watch them. However, current student terminals either display the teacher's video continuously, obscuring the courseware content, or only show the courseware without displaying the teacher's video, resulting in a poor student experience.

[0042] To address the aforementioned technical problems, the first aspect of this application provides an online learning system, the details of which can be found in [reference needed]. Figure 1 and Figure 2 , Figure 1 This is a structural block diagram of an online course system provided in a feasible embodiment. Figure 2 The diagram below shows a workflow of an online course system provided as a feasible embodiment. It can be seen that the online course system may include: a server, a teacher terminal, and a student terminal.

[0043] In this application, the server is deployed on a cloud-based management platform. Communication between the cloud server and student / teacher terminals can be achieved through a communication network. This communication network typically includes access devices and network devices; this application does not limit the types of access devices and network devices. Specifically, access devices can be base stations of evolved universal terrestrial radio access networks (E-UTRAN) or 5G networks. Network devices can be 4G core network (CN) devices or network elements, or 5G CN devices or network elements.

[0044] The teacher terminal can be a handheld device with wireless connectivity or other processing devices connected to a wireless modem. For example, it can be a mobile phone, computer, tablet, personal digital assistant (PDA), mobile internet device (MID), wearable device, or e-bookreader; it can also be a portable, pocket-sized, handheld, computer-built-in, or vehicle-mounted mobile device. The teacher terminal is equipped with a camera for capturing the teacher's video. In some embodiments, the teacher terminal refers to the terminal hosting this live audio and video broadcast.

[0045] Student terminals can be handheld devices with wireless connectivity or other processing devices connected to a wireless modem. For example, they can be mobile phones, computers, tablets, personal digital assistants (PDAs), mobile internet devices (MIDs), wearable devices, and e-book readers; they can also be portable, pocket-sized, handheld, computer-embedded, or vehicle-mounted mobile devices. In some embodiments, the teacher terminal refers to the audience terminal for this audio / video live stream.

[0046] In some embodiments, the server provides online course services to registered users. Teachers can pre-book online courses and send class notification messages to students (either those on the teacher's end or those subscribed to the teacher's courses) via the server. Within a specified time, users can access the online course service on the server to send and receive messages and stream audio and video. Unlike video calls, the online course service also requires the transmission of file data streams. This file can be sent from the teacher's end to each student's end via the server according to a sharing operation, or it can be a file pre-stored by the server and bound to the online course service, which can be simultaneously distributed to both the teacher's end and each student's end.

[0047] In some embodiments, the teacher's and / or each student's client needs to have a separate playback window set up on the interface to display the course file.

[0048] In some embodiments, the teacher's end records and uploads the user's annotations in the courseware window so that the student's end can obtain the annotations through the server and display them in the courseware window.

[0049] In some cases, the teacher's terminal is also configured to execute S21 to S24:

[0050] When a teacher starts an online class, S21 responds to the input operation and reads the mode identifier corresponding to the course.

[0051] In some embodiments, courses correspond to a normal mode and a simplified mode. A first identifier is configured for courses in normal mode, and a second identifier is configured for courses in simplified mode. In some embodiments, the styles of the first and second identifiers are not limited; any identifier that can serve an identification function can be used as the first or second identifier in some embodiments. Teachers can configure the first or second identifier for each course according to actual needs. Specifically, for some courses where teachers believe students need real-time interaction with the teacher during class, such as experimental classes, the teacher configures the first identifier for these courses. For some courses where teachers believe students only need to view teaching materials during class, such as listening classes, the teacher configures the second identifier for these courses.

[0052] In some embodiments, there is no limitation on the configuration time of the mode identifier. For example, in some feasible embodiments, the teacher can pre-configure a mode identifier for each course. In some feasible embodiments, the teacher configures a mode identifier for the course when teaching. In some embodiments, the mode identifier can also be preset, for example, manually set through the terminal or set by default by the system according to the content of the course.

[0053] In some embodiments, teachers can reset the course identifier via controls on the interface during a live course. This allows teachers flexible configuration options; for example, they can choose not to select video output during the audio explanation phase and select video output only when video display is required.

[0054] In some embodiments, the input operation can be a course selection operation or an operation that triggers a change in the mode identifier.

[0055] The method for reading the mode identifier corresponding to the course can adopt the commonly used identifier value reading method in this field, and the applicant will not impose any further restrictions here.

[0056] In some embodiments, upon detecting a mode identifier, a prompt will appear on the teacher's end to allow the teacher to further confirm the mode used for the current course. This is to prevent situations where, although a course identifier is preset during class, if the teacher has new needs or the identifier differs from the server's default setting, the course identifier can be modified using the icon control on the prompt interface. Alternatively, the teacher can choose the control indicating continued class to proceed with the original identifier. In some embodiments, the above process can be displayed and operated before entering the course; in other embodiments, it can be displayed and operated after entering the course.

[0057] In some embodiments, the course interface displayed after entering a course includes a courseware window and mode control controls. The courseware window displays files associated with the course. The mode control controls are used to switch modes during the course.

[0058] In some embodiments, when the mode identifier indicates that the teacher needs to turn on the camera, the course interface also includes a local preview window to preview data captured by the local camera. When the mode identifier indicates that the teacher does not need to turn on the camera, the course interface cancels / does not display the local preview window.

[0059] If the mode identifier is the first identifier, S22 collects the teacher's video and audio;

[0060] In some embodiments, the teacher video is a video recorded in real-time by a camera during the teacher's lecture. S23 pushes the teacher video, teacher audio, course identifier, and mode identifier to the server;

[0061] If the mode identifier is the first identifier, the second terminal pushes the mode identifier and course identifier once when the teacher starts the class, and pushes the teacher's video and audio to the server in real time during the class. The course identifier is used to uniquely identify the teacher's video and audio.

[0062] In some embodiments, if the pattern identifier is obtained from the server, it is not necessary to continue sending the first identifier to the server; if the pattern identifier is obtained locally, it is necessary to continue sending the first identifier to the server so that the server can synchronize it to the student terminal.

[0063] If the pattern identifier is the second identifier, S24 sends the pattern identifier, course identifier, and teacher audio to the server;

[0064] If the mode identifier is the second identifier, the second terminal will push the mode identifier once when the teacher starts the class.

[0065] In some embodiments, if the pattern identifier is obtained from the server, there is no need to send a second identifier to the server; if the pattern identifier is obtained locally, there is a need to send a second identifier to the server so that the server can synchronize it with the student terminal.

[0066] During the teacher's lesson, in application scenarios where the mode identifier is either the first or second identifier, the second terminal captures the teacher's audio in real time and pushes it to the server in real time. As a feasible implementation method, the teacher's video push and pull streams and the teacher's audio push and pull streams can be run on different threads. This ensures that the teacher closing the video push stream or the student closing the video pull stream does not affect the sending and receiving of the audio stream. Therefore, while flexibly controlling the display and hiding of the teacher's video on each terminal, the quality of the course audio will not be affected.

[0067] In some embodiments, the audio and video data uploaded by the teacher also includes a teacher identifier, so that the server can determine the audio and video data uploaded by the teacher based on the teacher identifier.

[0068] In some embodiments, the teacher's end is equipped with a first thread and a second thread. The first thread can be used for processing the teacher's audio, and the second thread can be used for processing the teacher's video. In an application scenario where the mode identifier is the first identifier, the first thread of the controller controls the audio data acquisition device to acquire the teacher's audio; the second thread of the controller controls the camera to acquire the teacher's video.

[0069] In some embodiments, the collected data can be sent directly as raw data. In other embodiments, to better meet the format requirements during transmission, the first thread can encode the teacher's audio, and the second thread can encode the teacher's video.

[0070] As a feasible approach, in order to reduce the bandwidth occupied during the transmission of audio and video data (including teacher audio and teacher video), the teacher audio and teacher video can be merged into one audio and video data stream and pushed to the server.

[0071] In some embodiments, teacher audio and teacher video can be uploaded separately.

[0072] As a feasible implementation method, to ensure the synchronization of teacher audio and teacher video, the teacher audio and teacher video can be aligned during the merging process. The specific alignment method can be based on the timestamps of the teacher audio and teacher video acquisition. In the application scenario where the mode identifier is the second identifier, the controller controls the audio data acquisition device to acquire teacher audio data, calls the first thread to collect the teacher audio data, and pushes the teacher audio data to the server.

[0073] In some embodiments, during the merging process, a mapping relationship between audio and video data segments can be generated based on alignment. The server responds to the student's request to pull the stream based on this mapping relationship, so that the student can synchronize the teacher's audio and video data.

[0074] When the server receives a student request, it reads the teacher identifier carried in the request and locates the audio and video data corresponding to the teacher identifier. When the mode identifier corresponding to the audio and video data is a first identifier, the server pushes the encoded audio data and encoded video data to the student's terminal; when the mode identifier corresponding to the audio and video data is a second identifier, the server pushes the audio data to the student's terminal.

[0075] In some embodiments, when the course mode identifier is the first identifier, the teacher can choose to turn off the camera. In this case, the uploaded data includes audio data but not the video data captured by the camera. The teacher will send a first video status change identifier to the student. Upon receiving the first video status change identifier, the student will update the teacher's video area. In some embodiments, updating the teacher's video area can be done by stopping the video stream and inserting a black frame in the teacher's window. In some embodiments, updating the teacher's video area can be done by stopping the video stream and retrieving the image corresponding to the teacher identifier and displaying it in the teacher's window. The teacher can also choose to turn on the camera. In this case, the uploaded data includes audio data and video data captured by the camera. The teacher will send a second video status change identifier to the student. Upon receiving the second video status change identifier, the student will update the teacher's video area. In some embodiments, updating the teacher's video area can be done by starting the video stream and displaying it in the teacher's window.

[0076] In some embodiments, when a student joins a course or pulls a stream, the server sends a mode identifier to each student's client. The student's client displays different course interfaces based on the different service identifiers. For example, when the course identifier is the first identifier, the teacher's window is displayed on the course interface; when the course identifier is the second identifier, the teacher's window is not displayed on the page. The student terminal is configured to execute S25–S28:

[0077] The student terminal executes S25 to send a student request to the server. The student request includes at least a course identifier, so that the server responds to the student request, selects the course corresponding to the course identifier, and sends the requested content of the course.

[0078] In some embodiments, a student terminal may send a student request to the server when joining an online class; may send a student request to the server upon receiving a mode identifier sent by a teacher terminal (this application scenario will be further explained later); or may send a student request to the server when other student terminals join an online class. In some embodiments, the student request includes at least a teacher identifier.

[0079] In some embodiments, if the course mode identifier is a first identifier, the requested content may include the mode identifier, teacher video, teacher audio, and courseware; if the mode identifier is a second identifier, the requested content may include the mode identifier and courseware, and as a feasible implementation, the courseware may be pre-stored in the server.

[0080] Student terminals join online classes via HTTP requests (which may also be referred to as student requests in some embodiments). Upon receiving a student request, the server first identifies the course identifier, locates the course corresponding to that identifier, and then reads the course's mode identifier. If the mode identifier is a first identifier, the request content sent by the server may include the mode identifier, teacher video and audio, and courseware; if the mode identifier is a second identifier, the request content includes at least the mode identifier, teacher audio, and courseware.

[0081] S26 responds to receiving the request content by reading the mode identifier;

[0082] The method for reading the mode identifier corresponding to the course can adopt the commonly used identifier value reading method in this field, and the applicant will not impose any further restrictions here.

[0083] If the mode identifier is the first identifier, S27 displays the first student interface and plays the teacher's audio. The first student interface includes video controls and a courseware window.

[0084] As one feasible implementation method, the courseware can be distributed by the server; as another feasible implementation method, the courseware displayed in the courseware window can be pre-stored in the student terminal; as yet another feasible implementation method, the courseware can be generated in real time during class.

[0085] In some embodiments, real-time generation simply involves downloading data from the server, parsing it, and then generating the courseware displayed in the window.

[0086] In application scenarios where courseware is distributed by the server, when a teacher creates a course, the server distributes the courseware to the teacher's terminal, which then displays the courseware. When a student joins the class, the server distributes the courseware to the student's terminal, which then displays the courseware.

[0087] In some embodiments, the courseware is generated in real-time during class. Teachers can annotate the courseware window, and the annotations and the original courseware are combined and sent to the server in real-time. Upon receiving the courseware generated by the teacher, the server immediately sends the visible portion to the student's terminal. The student's terminal then displays the courseware.

[0088] In some embodiments, after students join the live class service, they only pull audio and video streams, and the terminal and / or server settings prevent students from pushing audio and video streams.

[0089] In some embodiments, the teacher can control the uploading of audio and video data from the students. For example, in a question-and-answer scenario, a student can select a hand-raising control on the interface to trigger the server to send a corresponding identifier to the teacher, displaying a message on the teacher indicating that the student wishes to speak. The teacher can select one or more students from multiple ready-to-speak students and send their identifiers to the server. The server will configure its course operations to allow streaming from the student corresponding to the identifier and notify all students via a message. The student corresponding to the identifier will then upload an audio and video stream containing that identifier. Other students can then pull the stream based on the identifier. In some embodiments, the audio and video can include both audio and video; in others, it may only include audio. When video is included, each end (student and teacher) needs to create a new video window for displaying the video. When no video is included, this is not necessary.

[0090] In some embodiments, the server-side course services include an audio / video platform and a messaging group platform. The audio / video platform is a platform that can provide audio and video transmission, and the messaging group platform is a text messaging and message sending platform.

[0091] In application scenarios where the courseware can be pre-stored on the student's terminal, the teacher's terminal can call the locally stored courseware when creating a course. The locally stored courseware is also called when a student joins the class.

[0092] In response to the user's touch on the video control, S28 shows / hides the teacher window, which is used to play the teacher's video;

[0093] In some embodiments, the first student interface includes a video control, which students can use to control the display of the second terminal to show / hide the teacher window as needed. For example, in a scenario where the teacher window obscures the courseware, students can use the video control to control the display of the second terminal to hide the teacher window. In a scenario where the teacher window does not obscure the courseware, students can use the video control to control the display of the second terminal to show the teacher window.

[0094] The first student interface will be described below with reference to the specific attached diagram. Figure 3 This is a schematic diagram of a first student interface provided in a feasible embodiment. Initially, the first student interface can be referred to as interface 3A, and includes a video control 3A1, a teacher window 3A2, and courseware 3A3. In response to the user's touch on the video control 3A1, the first student interface can be referred to as interface 3B, and includes a video control 3A1 and courseware 3B2.

[0095] If the mode identifier is the second identifier, S29 displays the second student interface, which includes courseware and plays audio data.

[0096] The second student interface will be explained below with reference to the attached diagram. Figure 4 This is a schematic diagram of a second student interface provided as a feasible embodiment. The second student interface includes courseware 41.

[0097] The following diagram further illustrates the assignment process of the online learning system:

[0098] Figure 5 This is a feasible embodiment illustrating the changes in the student terminal's display interface during online classes. The teacher selects an experimental online class, and the teacher's terminal reads the experimental online class mode identifier as a first identifier, activates the camera to capture the teacher's video, and pushes the teacher's video and the first identifier to the server. When a student joins the online class, the student terminal sends a student request to the server, causing the server to respond to the student's request and send the requested content. In some embodiments, the requested content includes courseware, the first identifier, and the teacher's video. In response to receiving the requested content, the student terminal displays a first student interface, specifically interface 5A, which includes a video control 5A1, a teacher window 5A2, and courseware 5A3. After a period of time, the teacher window partially obscures the content in the courseware, specifically interface 5B. The student controls the second terminal to hide the teacher window 5B2 by touching the video control 5B1. At this time, the interface displayed on the second terminal can be seen in interface 5C.

[0099] In some embodiments, a student's control over the teacher window applies only to that student's terminal. When the teacher window is not hidden on the student's terminal, the student sends a first streaming request containing a teacher identifier to the server. This first streaming request indicates a need to simultaneously acquire audio and video data. In response to the first streaming request, the server sends the audio and video data corresponding to the teacher identifier to the student's terminal. When the teacher window is hidden on the student's terminal, the student sends a second streaming request to the server. This second streaming request indicates a need to acquire audio data, but not video data. In response to the second streaming request, the server sends the audio data corresponding to the teacher identifier to the student's terminal.

[0100] In some embodiments, the identifiers carried by the first pull request and the second pull request are different.

[0101] In some embodiments, the first streaming request includes both an audio streaming request and a video streaming request, while the second streaming request includes only an audio streaming request and does not include a video streaming request. When the teacher window is not hidden on the student's end, the student sends both an audio streaming request and a video streaming request containing the teacher's identifier to the server. The server then sends the audio and video data corresponding to the teacher's identifier to the student's end. When the teacher window is hidden on the student's end, the student sends an audio streaming request containing the teacher's identifier to the server, but does not send a video streaming request. The server then sends the audio data corresponding to the teacher's identifier to the student's end.

[0102] In some embodiments, when the server switches from the second streaming request to the first streaming request received from the student, it needs to first confirm the audio segment to be transmitted, determine the video segment to be transmitted based on the audio segment to be transmitted and the mapping relationship, and then synchronously send the determined audio segment to be transmitted and video segment to be transmitted, as well as send subsequent audio segments and subsequent video segments at subsequent times.

[0103] In some embodiments, the mapping relationship is generated and uploaded when the teacher's end merges the data. In some embodiments, the mapping relationship can also be determined by the server after receiving the audio and video data uploaded by the teacher's end, based on the timestamps of the audio and video data.

[0104] In some embodiments, when the server switches from the second streaming request to the first streaming request received from the student, it first needs to confirm the audio segment to be transmitted, determine the video segment to be transmitted containing the same timestamp based on the timestamp of the audio segment to be transmitted, and then synchronously send the determined audio segment and video segment to be transmitted, as well as send the subsequent audio segment and subsequent video segment at subsequent times.

[0105] In some embodiments, when the server receives a streaming request from a student and switches from a first streaming request to a second streaming request, it stops sending the video segment corresponding to the teacher identifier.

[0106] Some embodiments of the online learning system include a server, a teacher terminal, and a student terminal. When a teacher teaches a class, the teacher terminal sends a mode identifier to the server. When a student joins the online class, the student terminal sends a student request to the server, causing the server to respond to the student request and send the requested content. The request content includes a mode identifier. If the mode identifier is a first identifier, the student terminal displays a first student interface. The first student interface includes video controls, which students can use to control the display of the teacher window on the second terminal's screen as needed, resulting in a better student experience.

[0107] Based on the technical solutions shown in the above embodiments, in order to enable teachers to flexibly switch course modes during the teaching process, this embodiment further optimizes the online course system provided in the above embodiments. For details, please refer to [link / reference needed]. Figure 6 , Figure 6 A flowchart of a course mode switching method provided in a feasible embodiment shows that, after the step of reading the mode identifier corresponding to the course, the teacher terminal is configured to execute S61 to S63:

[0108] S61 If the mode identifier is the first identifier, the first teacher interface is displayed. The first teacher interface includes courseware, teacher window and mode selection control. The teacher window is used to display the teacher video.

[0109] The first teacher interface will be described below with reference to the specific attached diagrams. Figure 7 This is a schematic diagram of a first teacher interface provided in a feasible embodiment. In an application scenario where the mode identifier is the first identifier, the first teacher interface includes courseware 71, teacher window 72, and mode selection control 73. The teacher window is used to display teacher videos.

[0110] S62 responds to the teacher adjusting the mode selection control to simplified mode, displays a second teacher interface, and sends a course identifier and the second identifier to the server. The second teacher interface includes courseware and mode selection control.

[0111] In some embodiments, after receiving the course identifier and the second identifier, the server selects the course corresponding to the course identifier and switches the course's mode identifier from the first identifier to the second identifier.

[0112] The second teacher interface will be described below with reference to the attached diagrams. Figure 8 The diagram illustrates a first teacher interface provided in a feasible embodiment. The second teacher interface includes courseware 81 and mode selection control 82.

[0113] In some embodiments, when the teacher terminal displays a second teacher interface, the teacher can use the mode selection control to adjust the course mode to normal mode. When the course mode is normal mode, the teacher terminal displays the first teacher interface.

[0114] As a feasible implementation, in response to the teacher adjusting the mode selection control to the simplified mode, the teacher terminal is also configured to execute S63 to turn off the camera and stop pushing teacher videos to the server.

[0115] In some embodiments, the technical solutions provided include a teacher interface (which can be a first teacher interface or a second teacher interface) displayed on the teacher's terminal during the teacher's class. The teacher interface is equipped with a mode selection control, which allows the teacher to switch between course modes by touching the mode selection control.

[0116] In the online course system provided in the above embodiments, since teachers can switch course modes during class, the student interface displayed on the student terminal may not match the current course mode. To ensure that the student interface displayed on the student terminal (which can be either the first or second student interface) always matches the current course mode, this embodiment further optimizes the online course system provided in the above embodiments. For details, please refer to [link to relevant documentation]. Figure 9 , Figure 9 The flowchart illustrates a student interface switching method provided in a feasible embodiment, wherein the teacher terminal is configured to execute S91, and the student terminal is configured to execute S92.

[0117] In response to the teacher adjusting the mode selection control to simplified mode, the teacher terminal is also configured to execute S91: send a second identifier to the student terminal;

[0118] In some embodiments, the second identifier may be transmitted in the form of an IM (Instant Messaging) message.

[0119] The student terminal is also configured to execute S92, in response to receiving the second identifier, display the second student interface, and send a student request to the server.

[0120] In some embodiments, in response to the teacher adjusting the mode selection control to simplified mode, the teacher terminal simultaneously sends a second identifier to both the student terminal and the server. Upon receiving the second identifier, the student sends a student request to the server. Therefore, the server receives the second identifier sent by the teacher terminal first. Upon receiving the second identifier, the server switches the course mode identifier from the first identifier to the second identifier. Therefore, when the server subsequently receives a student request from the student terminal, the request content sent by the server is the request content in the second mode, i.e., it includes the teacher's audio but does not include the teacher's video.

[0121] The second teacher interface will be described below with reference to the attached diagrams. Figure 10 This is a schematic diagram of a second student interface provided as a feasible embodiment. In an application scenario where the mode identifier is the second identifier, the second student interface includes courseware.

[0122] The following diagram further illustrates the assignment process of the online learning system:

[0123] Figure 11 This diagram illustrates the changes in the display interfaces of the teacher's and student's terminals during an online class, as provided in a feasible embodiment. When a teacher selects an online experimental class, the teacher's terminal reads the experimental class's mode identifier as a first identifier, activates the camera to capture the teacher's video, and pushes the teacher's video and the first identifier to the server. The interface displayed on the teacher's terminal at this time can be seen in interface 11A. When a student joins the online class, a student request is sent to the server, causing the server to respond to the request and send requested content. In some embodiments, the requested content includes courseware, the first identifier, and the teacher's video. Upon receiving the requested content, the student's terminal displays a first student interface, which can be seen in interface 11B. During the class, the teacher adjusts the mode selection control to a simplified mode, and the interface displayed on the teacher's terminal at this time can be seen in interface 11C. In response to the teacher adjusting the mode selection control to simplified mode, the teacher's terminal sends a second identifier to the student's terminal; upon receiving the second identifier, the student's terminal displays a second student interface, which can be seen in interface 110D.

[0124] In some embodiments of the online learning system, when the teacher adjusts the mode selection control to a simplified mode, the teacher's terminal sends a second identifier to the student's terminal. Upon receiving the second identifier, the student's terminal sends a student request to the server and displays a second student interface. This ensures that the student interface displayed on the student's terminal always matches the current course mode, resulting in a better student experience.

[0125] In the online course system provided in the above embodiments, since teachers can switch course modes during class, the student interface displayed on the student terminal may not match the current course mode. To ensure that the student interface displayed on the student terminal (which can be either the first or second student interface) always matches the current course mode, this embodiment further optimizes the online course system provided in the above embodiments. For details, please refer to [link to relevant documentation]. Figure 12 , Figure 12 The flowchart illustrates a student interface switching method provided in a feasible embodiment, wherein the teacher terminal is configured to execute S121, and the student terminal is configured to execute S122.

[0126] In response to the teacher adjusting the mode selection control to normal mode, the teacher terminal is also configured to execute S121: send the first identifier to the student terminal.

[0127] The student terminal is configured to execute S122 in response to the first identifier, send a student request to the server, and display the first student interface.

[0128] In some embodiments, in response to the teacher adjusting the mode selection control to normal mode, the teacher terminal simultaneously sends a first identifier to both the student terminal and the server. Upon receiving the first identifier, the student sends a student request to the server. Therefore, the server receives the first identifier sent by the teacher terminal first. Upon receiving the first identifier, the server switches the course mode identifier from a second identifier to the first identifier. Therefore, when the server subsequently receives a student request from the student terminal, the request content sent by the server is the request content in the first mode, i.e., it includes the teacher's audio and video. The student terminal plays the teacher's audio and video.

[0129] The following diagram further illustrates the assignment process of the online learning system:

[0130] Figure 13This diagram illustrates the changes in the display interfaces of the teacher's and student's terminals during online classes, as provided in a feasible embodiment. When a teacher selects to attend an online listening class, the teacher's terminal reads the mode identifier of the listening class as a second identifier and sends the second identifier to the server. The interface displayed on the teacher's terminal at this time can be seen in interface 13A. When a student joins the online class, a student request is sent to the server, causing the server to respond to the student request and send the requested content. In some embodiments, the requested content includes courseware and the second identifier. Upon receiving the requested content, the student's terminal displays a second student interface, as shown in interface 13B. During the class, the teacher adjusts the mode selection control to normal mode, and the interface displayed on the teacher's terminal at this time can be seen in interface 13C. In response to the teacher adjusting the mode selection control to simplified mode, the teacher's terminal sends a first identifier to the student's terminal. Upon receiving the first identifier, the student's terminal displays a first student interface, as shown in interface 13D.

[0131] In some embodiments of the online learning system, when the teacher adjusts the mode selection control to normal mode, the teacher's terminal sends a first identifier to the student's terminal. Upon receiving the first identifier, the student's terminal displays the first student interface. This ensures that the student interface displayed on the student's terminal always matches the current course mode, resulting in a better student experience.

[0132] Based on the technical solutions shown in the above embodiments, in order to enable teachers to flexibly turn their cameras on or off during lectures, this embodiment further optimizes the online class system provided in the above embodiments. For details, please refer to [link / reference needed]. Figure 14 , Figure 14 A flowchart of a camera control method provided in a feasible embodiment, wherein a teacher terminal is configured to execute S141-S142:

[0133] In some embodiments, the first teacher interface further includes a camera control, which includes an on state and an off state.

[0134] The first teacher interface will be described below with reference to the specific attached diagrams. Figure 15 The diagram shows a first teacher interface provided for a feasible embodiment, which can be seen that the first teacher interface also includes a camera control 15.

[0135] S141 responds to the teacher adjusting the camera control to the off state, turning off the camera; and terminates the push of the teacher's video to the server.

[0136] As a feasible implementation method, in response to the teacher changing the camera control from the on state to the off state, the teacher terminal is also configured to display the teacher's avatar in the teacher window.

[0137] As one feasible approach, the teacher's avatar can be pre-stored locally.

[0138] S142 responds to the teacher adjusting the camera control to the on state, turning on the camera to capture the teacher's video, and sending the teacher's video to the server.

[0139] The following diagram further illustrates the assignment process of the online learning system:

[0140] Figure 15 This is a feasible embodiment illustrating the changes in the display interfaces of the teacher's terminal and the student's terminal during online classes. When the teacher selects an online experimental class, the teacher's terminal reads the experimental class mode identifier as a first identifier, activates the camera to capture the teacher's video, and pushes the teacher's video and the first identifier to the server. At this time, the interface displayed on the teacher's terminal can be seen in interface 15A, which may include a camera control 15A1 and a teacher window 15A2, where the teacher window displays the teacher's video. In response to the teacher adjusting the camera control to the off state, the teacher's terminal turns off the camera and stops pushing the teacher's video to the server. At this time, the interface displayed on the teacher's terminal can be seen in interface 15B, which may include a camera control 15B1 and a teacher window 15B2, where the teacher window displays the teacher's avatar.

[0141] In some embodiments, the technical solutions provided are applied in scenarios where the teacher terminal displays the first teacher interface (i.e., in scenarios where the course mode is normal). In these scenarios, the camera control on the first teacher interface allows the teacher to flexibly turn the camera on or off by touching the mode selection control.

[0142] In an embodiment where a camera control is provided on the first teacher interface, the teacher's camera may be on or off when the course mode is normal. In scenarios where the teacher's camera is off, the teacher does not send video to the server. If student terminals continue to stream video to the server in this situation, it would be a waste of network resources. To address this technical problem, this embodiment further optimizes the online course system provided in the previous embodiment. For details, please refer to [link to relevant documentation]. Figure 16 and Figure 17 , Figure 16 A flowchart for retrieving a teacher's video is provided as a feasible embodiment, wherein the teacher's terminal is configured to execute S161, and the student's terminal is configured to execute S162:

[0143] In response to the teacher changing the camera control from the on state to the off state, the teacher terminal is also configured to execute S161: send a camera off message to the student terminal;

[0144] The student terminal is configured to perform S162: in response to a camera-off message, display the teacher's avatar in the teacher window.

[0145] The camera-off message can be transmitted using RTC (Web Real-Time Communications).

[0146] In some embodiments, in response to a teacher changing the camera control from an on state to an off state, the teacher's terminal stops sending teacher video to the server, and correspondingly, the request content sent by the server to the student's terminal does not include teacher video.

[0147] Figure 17 A flowchart for retrieving a teacher's video is provided as a feasible embodiment, wherein the teacher's terminal is configured to execute S171, and the student's terminal is configured to execute S172:

[0148] In response to the teacher changing the camera control from the off state to the on state, the teacher terminal is also configured to execute S171: send a camera on message to the student terminal and the server;

[0149] The server responds to the camera activation message by sending teacher video and teacher audio to the student terminal;

[0150] The camera activation message can be transmitted using RTC (Web Real-Time Communications).

[0151] The student terminal is configured to execute S172 in response to the camera being turned on message, and the content displayed in the teacher window is changed from the teacher's avatar to the teacher's video.

[0152] The second aspect of this embodiment also provides an online learning system, for details of which can be found in [reference needed]. Figure 18 and Figure 19 , Figure 18 This is a structural block diagram of an online course system provided in a feasible embodiment. Figure 19 The following is a flowchart of an online course system provided as a feasible embodiment; it can be seen that the online course system may include: a server, an institution terminal, a teacher terminal, and a student terminal.

[0153] The institutional terminal is configured to execute S191 to build courses, with each course corresponding to a pattern identifier; and send the courses to the server.

[0154] The teacher's terminal is equipped with a camera for capturing video of the teacher; it is configured to execute S192-S195:

[0155] S192 When a teacher starts an online class, in response to the teacher's course selection operation, a teacher request is sent to the server. The teacher request must include at least the course so that the server can issue the mode identifier corresponding to the course.

[0156] S193 If the received pattern identifier is the first identifier, collect the teacher's video.

[0157] S194 pushes the teacher's video to the server. The teacher's video is a real-time video recorded by the camera during the teacher's lecture.

[0158] The student terminal is configured as follows:

[0159] S195 When a student joins an online class, a student request is sent to the server so that the server responds to the student request and sends the requested content; if the mode identifier is the first identifier, the request content includes at least the mode identifier, the teacher's video, and the courseware; if the mode identifier is the second identifier, the request content includes at least the mode identifier and the courseware, and the courseware is stored on the server.

[0160] S196 responds to receiving the request content and reads the mode identifier;

[0161] S197 If the mode identifier is the first identifier, the first student interface is displayed. The first student interface includes courseware and video controls.

[0162] S198 responds to the user's touch on the video control, showing / hiding the teacher window, which is used to play the teacher's video;

[0163] S199 If the mode identifier is the second identifier, the second student interface is displayed, which includes the courseware.

[0164] Some embodiments of the online learning system include a server, an institution terminal, a teacher terminal, and a student terminal. When a teacher teaches a class, the teacher terminal sends a mode identifier to the server. When a student joins the online class, the student terminal sends a student request to the server, causing the server to respond to the student request and send the requested content. The request content includes a mode identifier. If the mode identifier is a first identifier, the student terminal displays a first student interface. The first student interface includes video controls, which students can use to control the display of the teacher window on the second terminal's screen as needed, resulting in a better student experience.

[0165] Those skilled in the art will recognize that the prior art has progressed to the point where the differences between hardware and software implementations of various aspects of a system are minimal, and the use of hardware or software is often (but not always, as the choice between hardware and software becomes important in certain environments) a design choice that balances cost and efficiency. Those skilled in the art will understand that many tools (e.g., hardware, software, and / or firmware) exist that can implement the processes and / or systems and / or other technologies described herein, and that preferred tools will vary depending on the deployment process and / or the environment in which the system and / or other technologies are implemented.

[0166] Those skilled in the art will understand that all or part of the subject matter of this application can be implemented in software combined with hardware and / or firmware. For example, the subject matter described herein can be implemented in software executed by one or more processors. In one exemplary embodiment, the subject matter described herein can be implemented using a non-transitory computer-readable medium storing computer-executable instructions that, when executed by a computer processor, control the computer to perform steps. Example computer-readable media suitable for implementing the subject matter described herein include non-transitory computer-readable media, such as disk storage devices, on-chip memory devices, programmable logic devices, and application-specific integrated circuits (ASICs). Furthermore, computer-readable media for implementing the subject matter described herein may reside on a single device or computing platform, or may be distributed across multiple devices or computing platforms.

[0167] Finally, it should be understood that the above embodiments are merely illustrative and are not limited to the technical solutions of this application. Although this application has been described in detail with reference to the above preferred embodiments, it should be understood that those skilled in the art can make various modifications, alterations, or equivalent substitutions without departing from the scope of this application and the appended claims.

Claims

1. A student terminal, characterized in that, Configured as: When a student joins an online class, a student request is sent to the server. The student request includes at least a course identifier, so that the server responds to the student request, selects the course corresponding to the course identifier, and sends the requested content of the course. If the course mode identifier is a first identifier, the request content includes at least the mode identifier, teacher video, and teacher audio; If the mode identifier is a second identifier, the request content includes at least the mode identifier and the teacher's audio; wherein, the mode identifier in the request content changes dynamically according to the teacher's terminal operation based on the mode selection control; In response to receiving the request content, the pattern identifier is read; If the mode identifier is the first identifier, the teacher's audio is played and the first student interface is displayed. The first student interface includes courseware and video controls. The courseware is pre-stored in the student terminal, or distributed by the server, or generated in real time during class. In response to a user's touch on the video control, the teacher window is shown / hidden, and the teacher window is used to play the teacher video; If the mode identifier is the second identifier, the teacher's audio is played and the second student interface is displayed, the second student interface including the courseware; In response to a received video status change identifier, the student interface is updated according to the video status change identifier, wherein the video status change identifier is sent by the teacher terminal after switching the camera's on / off state under the mode identifier of the first identifier.

2. A teacher terminal, characterized in that, A camera is installed to capture video of teachers; it is configured as follows: When a teacher starts an online class, in response to the teacher's selection of a course, the mode identifier corresponding to the course is read. If the mode identifier is the first identifier, the camera is turned on to capture the teacher's video and the audio capture device is turned on to capture the teacher's audio, and the teacher's video, the teacher's audio and the mode identifier are pushed to the server; If the pattern identifier is the second identifier, send the teacher's audio and the pattern identifier to the server; The course interface includes a courseware window and a mode selection control. The courseware window is used to display the files associated with the course, and the mode selection control is used to switch the course mode. When the mode identifier is set to the first identifier, in response to the teacher switching the camera's on / off state, a video state change identifier is sent to the student terminal so that the student terminal updates the student interface according to the video state change identifier; wherein, if the on / off state changes from the on state to the off state, the camera is turned off and the push of the teacher's video to the server is stopped.

3. The teacher terminal according to claim 2, characterized in that, After reading the mode identifier corresponding to the course, the teacher terminal is further configured to: If the mode identifier is the first identifier, the first teacher interface is displayed. The first teacher interface includes courseware, a teacher window, and a mode selection control. The teacher window is used to display the teacher video. In response to the teacher adjusting the mode selection control to a simplified mode, a second teacher interface is displayed, which includes courseware and the mode selection control.

4. The teacher terminal according to claim 3, characterized in that, In response to the teacher adjusting the mode selection control to simplified mode, the teacher terminal is further configured as follows: The camera is turned off, the teacher's video is stopped from being pushed to the server, and the second identifier is sent to the server. In response to receiving the second identifier, the server switches the mode identifier of the course from the first identifier to the second identifier.

5. The teacher terminal according to claim 3, characterized in that, In response to the teacher adjusting the mode selection control to simplified mode, the teacher terminal is further configured as follows: A second identifier is sent to the student terminal and the server. The student terminal responds to the second identifier by displaying a second student interface and sending the student request to the server.

6. The teacher terminal according to claim 3, characterized in that, After reading the mode identifier corresponding to the course, the teacher terminal is further configured to: If the mode identifier is the second identifier, a second teacher interface is displayed, which includes courseware and mode selection controls.

7. The teacher terminal according to claim 6, characterized in that, In response to the teacher adjusting the mode selection control to normal mode, the teacher terminal is further configured to: Turn on the camera to capture the teacher's video; The teacher's video and a first identifier are pushed to the server. In response to receiving the first identifier, the server adjusts the course's mode identifier to the first identifier.

8. The teacher terminal according to claim 6, characterized in that, In response to the teacher adjusting the mode selection control to normal mode, the teacher terminal is further configured to: A first identifier is sent to the student terminal, so that the student terminal responds to the first identifier, sends a student request to the server, and displays a first student interface.

9. The teacher terminal according to any one of claims 3-8, characterized in that, The first teacher interface also includes a camera control, which includes an on state and an off state. The teacher terminal is further configured as follows: In response to the teacher adjusting the camera control to the on state, the camera is turned on and the teacher's video is pushed to the server.

10. The teacher terminal according to claim 8, characterized in that, In response to the teacher changing the camera control from the on state to the off state, the teacher terminal is also configured to display the teacher's avatar in the teacher window; Alternatively, in response to the teacher changing the camera control from an on state to an off state, the teacher terminal is further configured to: A camera-off message is sent to the student terminal, causing the student terminal to respond to the camera-off message by switching the content displayed in the teacher window from the teacher's video to the teacher's avatar.