Teaching live broadcast method and display device

Abstract

The application discloses a teaching live broadcast method and a display device. When a first program of a student-side display device is started, the student-side display device queries a server whether the student-side display device has a handwriting input function. When the student-side display device has the handwriting input function, a handwriting input function control is displayed on a first live broadcast interface. When the student-side display device does not have the handwriting input function, the handwriting input function control is not displayed on the first live broadcast interface. A teacher-side display device displays a corresponding permission control button according to a handwriting input function query result of the student-side display device, so as to authorize handwriting input function of any student.

Description

[0001] This application claims priority to Chinese Patent Application No. 202011103569.2, filed on October 15, 2020, Chinese Patent Application No. 202110003691.0, filed on January 04, 2021, Chinese Patent Application No. 202110014131.5, filed on January 06, 2021, Chinese Patent Application No. 202110067566.6, filed on January 19, 2021, Chinese Patent Application No. 202011437934.3, filed on December 07, 2020, the contents of which are incorporated herein by reference in their entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of display devices, in particular to a teaching live broadcast method and a display device. BACKGROUND

[0003] Remote education refers to a teaching mode relying on computer, television and Internet and other communication media. It breaks through the time and space boundaries and enables students to attend classes in different places. Live broadcast education is a teaching form gradually emerging in remote education. Live broadcast education refers to a teaching mode in which students in different places can simultaneously log in and interact with teachers at a specific time through live broadcast. Compared with other remote education modes, the biggest advantage of live broadcast education is that it can increase the interaction between teachers and students and improve the learning enthusiasm of students.

[0004] The existing teaching live broadcast system is composed of multiple software. Each software realizes a function, for example, a software is used to realize enrollment, a software is used to realize teaching, and a software is used to realize examination. The software is disconnected with each other, and data is not shared in real time. Each time it is used, it needs to be manually imported, which is relatively cumbersome. Moreover, the existing teaching live broadcast system is usually applied to the mobile phone end, and is not suitable for the television end. SUMMARY

[0005] In a first aspect, the present application provides a display device, comprising:

[0006] a display configured to present a first live broadcast interface;

[0007] a controller connected with the display, the controller being configured to:

[0008] in response to an application start instruction for starting a first program, send a handwriting input function query instruction to a server, the handwriting input function query instruction being used to instruct the server to query whether a handwriting input function is configured at a local end;

[0009] If the handwriting input function query result returned by the server is that the local end has handwriting input function, a handwriting input function control is displayed in the first live interface.

[0010] If the handwriting input function query result returned by the server is that the local end does not have handwriting input function, no handwriting input function control is displayed in the first live interface.

[0011] In a second aspect, the present application also provides a display device, comprising:

[0012] a display configured to present a second live interface;

[0013] a controller connected to the display, the controller being configured to:

[0014] after the second program is started, receive a handwriting input function query result sent by a student end display device, the handwriting input function query result being a result of the student end display device requesting a server to query whether the local end is configured with handwriting input function;

[0015] if the handwriting input function query result is that handwriting input function is available, display a first operation item corresponding to each student end display device with handwriting input function in the second live interface, the first operation item including a first permission control button with handwriting input function control permission of the corresponding student end display device;

[0016] if the handwriting input function query result is that handwriting input function is not available, display a second operation item corresponding to each student end display device without handwriting input function in the second live interface, the second operation item including a second permission control button without handwriting input function control permission of the corresponding student end display device.

[0017] In a third aspect, the present application also provides a teaching live method applied to a student end display device, the method comprising:

[0018] in response to an application start instruction for starting a first program, sending a handwriting input function query instruction to a server, the handwriting input function query instruction being used to instruct the server to query whether the local end is configured with handwriting input function;

[0019] if the handwriting input function query result returned by the server is that the local end has handwriting input function, a handwriting input function control is displayed in the first live interface.

[0020] if the handwriting input function query result returned by the server is that the local end does not have handwriting input function, no handwriting input function control is displayed in the first live interface.

[0021] In a fourth aspect, the present application provides a teaching live broadcast method, applied to a teacher-side display device, the method comprising:

[0022] After the second program is started, a handwriting input function query result sent by a student-side display device is received, the handwriting input function query result being a result of the student-side display device requesting the server to query whether the student-side display device is configured with a handwriting input function;

[0023] When the handwriting input function query result is that the student-side display device is configured with the handwriting input function, a first operation item corresponding to each student-side display device configured with the handwriting input function is displayed on the second live broadcast interface, and the first operation item comprises a first permission control button having handwriting input function control permission of the corresponding student-side display device;

[0024] When the handwriting input function query result is that the student-side display device is not configured with the handwriting input function, a second operation item corresponding to each student-side display device not configured with the handwriting input function is displayed on the second live broadcast interface, and the second operation item comprises a second permission control button not having handwriting input function control permission of the corresponding student-side display device.

[0025] In a fifth aspect, the present application provides a computer storage medium, which can store a program, and the program can implement some or all steps of the teaching live broadcast method provided by the present application when executed. BRIEF DESCRIPTION OF DRAWINGS

[0026] Figure 1 is a schematic diagram of an operation scenario between a display device and a control device in some embodiments of the present application;

[0027] Figure 2 is a page schematic diagram of an access application in some embodiments of the present application;

[0028] Figure 3 is a schematic diagram of a display device online live broadcast course user interface in some embodiments of the present application;

[0029] Figure 4 is a schematic diagram of a display device online live broadcast course user interface in some embodiments of the present application;

[0030] Figure 5 is a schematic diagram of a display device, a server online live broadcast course interaction timing in some embodiments of the present application;

[0031] Figure 6 is a schematic diagram of a display device, a server online live broadcast course interaction timing in some embodiments of the present application;

[0032] Figure 7is a schematic diagram of a page of team management in some embodiments of the present application;

[0033] Figure 8 is a schematic diagram of a page of mode management in some embodiments of the present application;

[0034] Figure 9 is a schematic diagram of a page of three-screen live class in some embodiments of the present application;

[0035] Figure 10 is a schematic diagram of a page of three-screen live class in some embodiments of the present application;

[0036] Figure 11 is a schematic diagram of a page of the home page of the student end in some embodiments of the present application;

[0037] Figure 12 is a schematic diagram of a page of the student end in some embodiments of the present application;

[0038] Figure 13 is a schematic diagram of a page of the student end in some embodiments of the present application;

[0039] Figure 14 is a schematic diagram of a first live interface in some embodiments of the present application;

[0040] Figure 15 is a schematic diagram of a course content area in a live interface when using handwriting input for scribbling in some embodiments of the present application;

[0041] Figure 16 is a schematic diagram of a live teaching in which the handwriting input function is automatically displayed in some embodiments of the present application;

[0042] Figure 17 is a flowchart of a live teaching in which the handwriting input function is automatically displayed in some embodiments of the present application;

[0043] Figure 18 is a flowchart of a method of sending a handwriting input function query instruction in some embodiments of the present application;

[0044] Figure 19 is a schematic diagram of a first live interface in which a handwriting input function control is displayed in some embodiments of the present application;

[0045] Figure 20 is another flowchart of a live teaching in which the handwriting input function is automatically displayed in some embodiments of the present application;

[0046] Figure 21 is a schematic diagram of a student list in a second live interface in some embodiments of the present application;

[0047] Figure 22is a schematic diagram of an interface for the teacher end to use the handwriting input function to write in some embodiments of the present application;

[0048] Figure 23 is another flowchart of automatically displaying the handwriting input function in the live teaching in some embodiments of the present application;

[0049] Figure 24 is a schematic diagram of a user interface during live broadcast in some embodiments of the present application;

[0050] Figure 25 is a flowchart of a message display method in some embodiments of the present application;

[0051] Figure 26 is a timing diagram of a message display method in some embodiments of the present application;

[0052] Figure 27 is a schematic diagram of list paging in some embodiments of the present application;

[0053] Figure 28 is a schematic diagram of a message list in some embodiments of the present application;

[0054] Figure 29 is a schematic diagram of displaying a message list on a user interface in some embodiments of the present application;

[0055] Figure 30 is a schematic diagram of an interface when a new message sending exception occurs in some embodiments of the present application;

[0056] Figure 31 is a schematic diagram of displaying a new message in a message list in some embodiments of the present application;

[0057] Figure 32 is a schematic diagram of displaying a new message reminder interface in a message list in some embodiments of the present application;

[0058] Figure 33 is a schematic diagram of displaying a loading state prompt box in a message list in some embodiments of the present application;

[0059] Figure 34 is a business flowchart of a message display method in some embodiments of the present application;

[0060] Figure 35 is a schematic diagram of a live class application scenario in some embodiments of the present application;

[0061] Figure 36 is a flowchart of a live class recording method in some embodiments of the present application;

[0062] Figure 37 is an interaction flowchart of a live class recording method in some embodiments of the present application;

[0063] Figure 38 FIG. 1 is a display diagram of a teacher-side live class interface in some embodiments of the present application;

[0064] Figure 39 FIG. 2 is a display diagram of a student-side live class interface in some embodiments of the present application;

[0065] Figure 40 FIG. 3 is a diagram of recording a live class in some embodiments of the present application;

[0066] Figure 41 FIG. 4 is a diagram of a class practice interface in some embodiments of the present application;

[0067] Figure 42 FIG. 5 is a diagram of a student-side display device presenting teacher interaction data in some embodiments of the present application;

[0068] Figure 43 FIG. 6 is a display diagram of a student-side live class display interface in some embodiments of the present application;

[0069] Figure 44 FIG. 7 is a table of student interaction data in some embodiments of the present application;

[0070] Figure 45 FIG. 8 is a flowchart of a live class review method in some embodiments of the present application;

[0071] Figure 46 FIG. 9 is an interactive flowchart of a live class review method in some embodiments of the present application;

[0072] Figure 47 FIG. 10 is a diagram of a live class review interface in some embodiments of the present application;

[0073] Figure 48 FIG. 11 is a flowchart of a method of presenting interaction data in some embodiments of the present application;

[0074] Figure 49 FIG. 12 is a display diagram of a student-side presentation of interaction data in some embodiments of the present application;

[0075] Figure 50 FIG. 13 is a display diagram of generating an interaction interface during review in some embodiments of the present application;

[0076] Figure 51 FIG. 14 is a display diagram of a student performing real-time interaction based on the interaction interface during review in some embodiments of the present application;

[0077] Figure 52 FIG. 15 is another flowchart of a live class review method in some embodiments of the present application. DETAILED DESCRIPTION

[0078] For the purposes of the present application, the exemplary embodiments will be described in the context of the appended drawings, in which it is shown that the exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

[0079] Figure 1 In some embodiments of the present application, the schematic diagram of the operating scenario between the display device and the control device is shown. As shown in Figure 1 As shown, the user can operate the display device 200 through the mobile terminal 300 and the control device 100.

[0080] In some embodiments, the control device 100 can be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc. The display device 200 is controlled by wireless or other wired means. The user can input user instructions through the keys on the remote controller, voice input, control panel input, etc. to control the display device 200. For example, the user can input corresponding control instructions through the volume up and down keys, channel control keys, up / down / left / right movement keys, voice input keys, menu keys, power on / off keys, etc. on the remote controller to realize the function of controlling the display device 200.

[0081] In some embodiments, the mobile terminal, tablet computer, computer, notebook computer, and other smart devices can also be used to control the display device 200. For example, the display device 200 is controlled by using an application program running on a smart device. The application program can provide various controls for the user in an intuitive user interface (UI) on the screen associated with the smart device through configuration. In some embodiments, the mobile terminal 300 can also be used as a display device.

[0082] In some embodiments, the mobile terminal 300 can install a software application with the display device 200, implement connection communication through a network communication protocol, and achieve the purpose of one-to-one control operation and data communication. For example, the mobile terminal 300 and the display device 200 can establish a control instruction protocol, synchronize the remote control keyboard to the mobile terminal 300, control the user interface on the mobile terminal 300, and realize the function of controlling the display device 200. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to realize the function of synchronous display.

[0083] As shown in Figure 1 As shown in the figure, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 can be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 can provide various content and interaction to the display device 200.

[0084] In some embodiments, the application installed in the display device for providing online courses can be a "Micro School" application.

[0085] When a live teaching is performed using the "Micro School" application, a corresponding login or registration page can be presented according to different users.

[0086] After the user logs in, the user avatar included in the account information is a default avatar. The default avatar can be displayed by cutting the username, for example, the first two characters of the username can be cut from left to right. If the third character is a Chinese character, the last one or two characters of the APP end or the web end are displayed; if the third character is not a Chinese character, the first two characters or the second character are displayed; if the username is an English name, the first letter is displayed, for example, the username is Jerry, and J is displayed; if the username is a special character, it is not displayed, but a default avatar provided by the system is displayed. The user can also change the avatar according to his or her preferences.

[0087] Figure 2 A schematic diagram of a page of the application in some embodiments of the application is shown in FIG. 1. Figure 2 As shown, when the user accesses the "Micro School" application, the application interface displays the "Micro School" home page by default.

[0088] In some embodiments, the home page supports up to 5 carousel pictures for introducing the related functions of the "Micro School". The carousel pictures are automatically played in rotation. If only one carousel picture is displayed, the carousel state is not displayed.

[0089] In some embodiments, the live course includes a teacher-side display device, a student-side display device, and a server. The teacher-side display device provided by the application includes a display and a first controller. The first controller is configured to send a course creation instruction including course information to the server, wherein the course creation instruction is used to add a course corresponding to the course information to a live course list by the server, the course information includes the start time of the course, the live course list is used to create a first live room for a first course that will start teaching within a preset time length and generate a live room creation completion message according to the start time of the course by the server; and no live room is created for a second course that does not start teaching within the preset time length.

[0090] In some embodiments, the course information further includes one or a combination of course name, end time, student list, and teaching mode.

[0091] For example, the teacher-side sends a course creation instruction to the server, and the course creation instruction includes course information of the first course, the second course, the third course, and the fourth course.

[0092] The course information of the first course can include: a start time of 18:00, an end time of 18:30, a student list 1, and a public class mode;

[0093] The start time of the second course is 19:00, the end time is 19:30, the student list is 2, and the class mode is public;

[0094] The start time of the third course is 20:00, the end time is 20:30, the student list is 3, and the class mode is public;

[0095] The start time of the fourth course is 21:00, the end time is 21:30, the student list is 4, and the class mode is public.

[0096] The course creation instruction can enable the server to identify a first course that will start in a preset time period according to the start time of the course information contained therein, create a first live room for the first course for online live course use, and generate a live room creation completion message, so that the student end display device and the teacher end display device can immediately obtain information that the corresponding course preparation is successful.

[0097] In some embodiments, the present application also provides a server comprising a second controller configured to: periodically scan a live course list, wherein the live course list is generated by the second controller according to the course information in the received course creation instruction, and the course information includes the start time of the course.

[0098] For example, after receiving the course creation instruction sent by the first controller, the second controller of the server adds the corresponding course to the live course list according to the start time of the corresponding course information and other course information in the course creation instruction. It can be understood that the start time in the course information is necessary information for the live course list.

[0099] The second controller periodically scans the live course list containing different course start times, and automatically prepares for a course that meets the preparation conditions in advance, such as establishing a dedicated live room, a chat room, and pushing preparation status information to the display device end.

[0100] In some embodiments, when the scanned course is a first course that will start in a preset time period, the second controller creates a first live room for the first course according to the course information and generates a live room creation completion message.

[0101] For example, the second controller of the server scans the live course list containing multiple courses in the background at a frequency of every 30 minutes, and finds a course that can be in, for example, 15 minutes as the first course.

[0102] After confirming the first course meeting the condition, the second controller creates a first live room dedicated to the first course; if the first live room is successfully created, the second controller generates a live room creation completion message.

[0103] In some embodiments, the second controller generates the live room creation completion message, specifically including that the second controller: after creating the first live room, marks the first course in the live course list as an in-process state, which can be obtained by the display device when remotely querying the live course list.

[0104] For example, the second controller marks the first course in the live course list as an in-process state after creating the first live room; wherein the state of each course in the live course list can be obtained by the display device when remotely querying in a round-robin manner.

[0105] In some embodiments, after the second controller generates the live room creation completion message, the second controller is further configured to: send the live room creation completion message to the display device, so that the user interface of the display device displays an entering control for entering the first live room.

[0106] For example, after the second controller creates the first live room, the second controller records the related data of the first live room into the first course of the live course list, which may, for example, include the code of the first live room, and the user can enter the corresponding live room according to the code of the first live room; the second controller sends the live room creation completion message containing the code of the first live room to the display device, so that the user interface of the display device displays an entering control for entering the first live room.

[0107] In some embodiments, after the corresponding display device first controller obtains the live room creation completion message, the entering control for entering the first live room is displayed on the user interface, including that the first controller: after receiving the live room creation completion message sent by the server, displays the entering control for entering the first live room on the user interface; or sends an instruction for querying the live room creation state at a preset time interval, and controls the user interface to display the entering control for entering the first live room after querying that the first live room is created.

[0108] In some embodiments, when the scanned course is a second course that does not start a class within a preset time length, the second controller does not create a live room for the second course, and continues to scan the live course list.

[0109] That is, the server does not perform the preparation operation such as creating a live room for a course that does not meet the preparation condition according to the start time included in each course in the live course list.

[0110] Figure 3 A schematic diagram of a user interface of a display device of a teacher terminal for online live courses in some embodiments of the present application.

[0111] The user interface of the display device of the teacher terminal for online live courses is shown in the figure. When the system time is 15:00, the live course list includes four courses, namely, the first course, the second course, the third course, and the fourth course.

[0112] The start time of the first course is 18:00, the start time of the second course is 19:00, the start time of the third course is 20:00, and the start time of the fourth course is 21:00. The status of the above four courses is displayed as not started.

[0113] In some embodiments, the server second controller scans the live course list at a regular time interval. When the scanned course is a first course that will start teaching within a preset time length, the server second controller creates a first live room for the first course according to the course information. The server second controller includes the following steps: scanning the live course list at a first time interval; determining that the scanned course is the first course when the start time of the scanned course is within a preset time length based on the current time; and creating a first live room for the first course according to the course information of the first course.

[0114] For example, at 15:00, the server second controller scans the live course list established by the background database at a first time interval of 15 minutes repeatedly. With the start time in the live course list as the target, the server second controller queries and filters out the courses that will start after a second time interval of 30 minutes. It can be found that Figure 3 In the user interface shown in the figure, there is no live course that needs to be automatically created a live room at 15:00. After no live course that needs to be created a live room is obtained, the second controller will scan the live course list again at 15:15, 15:30, 15:45, 16:00, and so on at an interval of 15 minutes.

[0115] Figure 4 A schematic diagram of a user interface of a display device of a teacher terminal for online live courses in some embodiments of the present application.

[0116] When the system time is 15:31, the first controller of the display device has scanned the live course list at 15:30 and successfully obtained the first course that needs to be created a first live room. After the first live room is successfully created, the first course identifier in the live course list in the user interface is displayed as the in-process state, as shown in the figure.

[0117] In some embodiments, the second controller continues to cycle through the list of live courses at the first time interval to create a second live room for a second course that is about to start within the preset time duration after creating the first live room for the first course.

[0118] In some embodiments, the list of live courses is further configured to cause the server to create a first chat room for a first course that is about to start within the preset time duration according to the start time of the course and generate a chat room creation completion message, the first chat room being coupled to the first live room.

[0119] For example, the display device first controller sends a course creation instruction containing course information to the server, the course creation instruction being configured to cause the server to add a course corresponding to the course information to the list of live courses;

[0120] The second controller of the server creates a first chat room for the first course according to the course information and generates a chat room creation completion message, wherein the first chat room can be coupled to the first live room.

[0121] The second controller of the server creates a first chat room for the first course according to the course information of the first course; after the first chat room is successfully created, the chat room service interface returns the first chat room code; the second controller updates and stores the first chat room code to the corresponding first course in the list of live courses.

[0122] In some embodiments, the second controller of the server further creates the first live room according to the course information of the first course, for example, taking the course name as the name of the first live room, and taking the start time and end time as the use time interval of the first live room.

[0123] After the second controller of the server successfully executes the request for live room service creation, the live room service interface returns the first live room code of the newly created first live room, and the second controller updates and stores the first live room code to the corresponding first course in the database list of live courses.

[0124] In some embodiments, the second controller of the server creates a first chat room and a first live room for the first course according to the course information, the first chat room being coupled to the first live room; after the first chat room and the first live room are successfully created, the second controller sends a live room creation completion message containing the first live room code and a chat room creation completion message containing the first chat room code to the display device.

[0125] After the server successfully creates the first live room and the first chat room, the second controller sends feedback information containing the first live room code and the first chat room code to the display device.

[0126] In some embodiments, the server second controller detects whether the first chat room code and the first live room code are empty; if neither is empty, it indicates that the first chat room and the first live room are both successfully created.

[0127] In some embodiments, after the first controller obtains the message that the live room creation is completed, the user interface displays an entering control for entering the first live room; after obtaining a confirmation operation on the entering control, the user interface displays a live user interface of the first live room, wherein the live user interface is provided with a local window for displaying local video data and a peer window for displaying peer video data.

[0128] For example, when the first course in the live course list is in a proceeding state, the student can click to enter the first course for pre-class interaction.

[0129] The first course is in a ready state, the teacher can enter for pre-class interaction in advance, or can enter the first live room to teach when the course officially starts, if the teacher is not ready, the student can be notified to delay the start through the first chat room.

[0130] The live user interface includes a local window and a peer window, the local window is used to display local video data, and the peer window is used to display peer video data.

[0131] In some embodiments, if the first chat room or the first live room fails to be successfully created, the second controller does not modify the state of the first course in the live course list, and reprocesses the course by scanning the live course list again.

[0132] Figure 5 In some embodiments of the application, the teacher end display device, the student end display device, and the server online live course interaction timing diagram.

[0133] In some embodiments, the teacher creates a live course through the live course management interface of the teacher end display device, including configuring course name, start time, end time, student list, teaching mode and other parameters, and calling a business service live course saving interface;

[0134] The live course saving interface verifies the validity of the parameters, including the length of the course name, whether the course name contains sensitive content, whether the start time and the end time meet the requirements, and saves the live course data to a database (DB) after the verification is passed;

[0135] The background task scans the live course list in the database in the background at a fixed time, queries the live course that will start in a preset time period, i.e., the first course, based on the start time of the course, and processes other courses in the live course list in a loop;

[0136] The background task obtains the course name, the number of students in the course, and other parameters of the first course, requests the chat room service to create the first chat room, and returns the code of the newly created first chat room after the creation is successful, and updates and saves the code to the first course in the database;

[0137] The background task obtains the course name of the first course as the name of the first live room, and obtains the start time and the end time as the use time interval of the first live room, and requests the live room service to create the first live room, and returns the code of the newly created first live room after the creation is successful, and updates and saves the code to the first course in the database;

[0138] After the creation of the first chat room and the first live room is completed, the background task checks whether the first chat room code and the first live room code of the first course are empty, and if both are not empty, it indicates that the two are successfully created, and then the state of the first course is changed to in progress.

[0139] The student terminal display device requests the business service to query the live course list belonging to the student, and enters the live course in the in progress state; at this time, the student terminal carries the first course ID of the live course, calls the course details interface of the business service, and obtains the course details from the business service, including the course name, the start time, the end time, the course material list, the first chat room code, and the first live room code.

[0140] The student terminal parses the first chat room code from the course details, calls the chat room service interface, and enters the corresponding first chat room, and the students who have entered the chat room can interact with each other.

[0141] At the same time, the student terminal parses the first live room code from the course details, calls the live room service interface, and enters the first live room, at this time, the live room has no picture, i.e., before the teacher starts the live broadcast, the live room does not display the picture.

[0142] After the first course starts formally, the teacher enters the live course, obtains the first chat room code and the first live room code from the live course details, enters the first chat room and the first live room to start the class as an administrator, and manages the first chat room and the first live room, including prohibiting all people from chatting, designating a person to speak, connecting the microphone of a student, and the like.

[0143] At this time, the student terminal can see the live picture of the teacher, and formally enters the class stage.

[0144] Figure 6 The interactive timing diagram of the teacher terminal display device, the server implementing online live course control in some embodiments of the present application.

[0145] In step S1001, the first controller of the teacher terminal display device sends a course creation instruction containing course information to the server, and the course information further includes one or a combination of course name, end time, student list, and class mode.

[0146] In step S1002, the second controller of the server adds the corresponding course to the live course list. After receiving the course creation instruction sent by the first controller, the second controller of the server adds the corresponding course to the live course list according to the start time of the corresponding course information and other course information.

[0147] In step S1003, the second controller of the server scans the live course list at a first time interval. For example, the second controller scans the live course list with multiple added courses in the background at a frequency of every 30 minutes, and finds a course that can be in the future for example 15 minutes as the first course.

[0148] In step S1004, the second controller of the server determines that the scanned course is the first course when the start time of the scanned course is within a preset time range based on the current time. The second controller scans the obtained course as the first course that will start the class within the preset time range.

[0149] In step S1005, the second controller creates a first live room for the first course according to the course information. After confirming the qualified first course, the second controller creates a dedicated first live room for the first course; if the first live room is created successfully, the second controller generates a message that the live room creation is completed.

[0150] In step S1006, the second controller identifies the first course in the live course list as a state of being in progress, which can be obtained by the display device when remotely querying the live course list.

[0151] In step S1007, the user of the teacher terminal display device confirms the first course in the live course list in the state of being in progress. After obtaining the message that the live room creation is completed, the first controller displays an entering control into the first live room on the user interface.

[0152] In step S1008, the first controller controls the user interface to display a user interface of the first live room. After obtaining the confirmation operation on the entering control, the first controller controls the user interface to display a live user interface of the first live room, wherein the live user interface is provided with a local window for displaying local video data and a peer window for displaying peer video data.

[0153] Based on the above description of the display device implementing the online live course control scheme, the application further provides an online live course control method applied to a display device, which comprises: sending a course creation instruction containing course information to a server, wherein the course creation instruction is used to make the server add a course corresponding to the course information to a live course list, the course information comprises a start time of the course, the live course list is used to make the server create a first live room for a first course that will start teaching within a preset time length according to the start time of the course and generate a live room creation completion message; not creating a live room for a second course that does not start teaching within the preset time length; after obtaining the live room creation completion message, displaying an entering control for entering the first live room; after obtaining a confirmation operation on the entering control, displaying a live user interface of the first live room, wherein the live user interface is provided with a local window for displaying local video data and a peer window for displaying peer video data. The specific operation method and steps of the display device online live course control scheme have been described in detail in the above description of the display device implementation scheme, and will not be repeated here.

[0154] Based on the above description of the server implementing the online live course control scheme, the application further provides an online live course control method applied to a server, which comprises: regularly scanning a live course list, wherein the live course list is generated according to course information in a received course creation instruction, and the course information comprises a start time of a course; when the scanned course is a first course that will start teaching within a preset time length, creating a first live room for the first course according to the course information and generating a live room creation completion message; when the scanned course is a second course that does not start teaching within the preset time length, not creating a live room for the second course, and continuing to scan the live course list. The specific operation method and steps of the server online live course control scheme have been described in detail in the above description of the display device implementation scheme, and will not be repeated here.

[0155] In some embodiments, the message that the live room creation is completed is generated, including: after the first live room is created, the first course in the live course list is marked as an in-process state, which can be obtained by the display device when remotely querying the live course list; and after the message that the live room creation is completed is generated, the method further includes: sending the message that the live room creation is completed to the display device, and the message that the live room creation is completed is used to make the user interface of the display device display an entering control containing entering the first live room. The specific operation method and steps of the server online live course control scheme have been described in detail in the display device implementation scheme above, and will not be repeated here.

[0156] In some embodiments, the teacher end display device can also manage the course after setting the live course, for example, selecting the course corresponding to the list of Figure 3 or Figure 4 , the team management shown in Figure 7 , or the class mode setting shown in Figure 8 .

[0157] Figure 7 The page schematic diagram of team management in some embodiments of the present application. Referring to Figure 7 , in the team management page, before the live class starts, the teacher can modify the team. After the live class starts, the team cannot be added or modified, and the corresponding team option is gray. The teacher can select two from the candidate team names as the team names of this live class, for example, after selecting “Panda Team” and “Dinosaur Team”, selecting “Confirm Selection” creates two teams, and students will be evenly distributed in the two teams; if “No team is set”, the default state is restored; if the teacher selects a number of teams that is not two, a prompt “Please select two teams” is popped up. After the teacher selects two team names, the two teams PK during the live class. The PK team is temporarily formed each time, and the right to assign a long-term group (team) can also be assigned by the teacher end in the application process. The same student repeatedly enters and exits the same live class, the grouping does not change, and the score is also continued. Each new user entering the live room is assigned to the team with fewer people, and if the number of people is the same, the user is randomly assigned. The team obtains points in the following way: each student online time is 1 point every 5 minutes, and less than 5 minutes has no points; the time of less than 5 minutes before the student exits can be accumulated after the student enters the live room again. The student gets 1 point for participating in the quiz, 2 points for answering the question correctly, 2 points for successfully participating in the mic, and 2 points for being praised by the teacher. The team score is saved according to the grouping result of each class, and the score result and details of each student are also saved. The teacher ends the team when completing the team assignment and at the end of the course, and both will display an animation, which will automatically disappear after X seconds by default.

[0158] Figure 8 The page diagram of mode management in some embodiments of the present application is shown. Referring to Figure 8 In the mode management page, the teacher can select the class mode, including the three-screen class mode and the multi-video class mode. Among them, the three-screen class mode is selected by default. After clicking "Confirm selection", the live room is entered.

[0159] In some embodiments, the display device includes a display for presenting a live teaching interface and a controller for implementing live teaching according to live related operations. The live class program can be a "Jumi School" program. The live class program includes a second program and a first program. The second program is a program configured in the teacher's display device, and when the second program is started, a second live interface is displayed in the display. The first program is a program configured in the student's display device, and when the first program is started, a first live interface is displayed in the display.

[0160] In some embodiments, after entering the live room, the second live interface shown in the schematic diagram is entered. Figure 9 The teacher can enter the live room after logging into the "Jumi School" application and creating a new live class at the class time. In this embodiment, since the display screen of the display device is larger and can accommodate more content, a three-screen live class mode can be used. The second live interface displays a course content area, a student video area, a teacher video area, a main function area, and a live information display area, which can realize three-screen class. The student video area is used to display student images, and the teacher video area is used to display teacher images. The student images and teacher images are collected by the camera (such as the image collector in Figure 3 The course content area displays the live picture, and the main function area is displayed below the course content area. The main function area is used to switch the functions of notes, whiteboard, and video, etc.

[0161] In some embodiments, the live operation button and the team competition situation are displayed below the main function area. The live operation button includes a handwriting input function (button text is "brush"), a start live button (switched to pause live after starting), an end live button, etc.

[0162] In some embodiments, to improve the effect of the class, the teacher can divide the students in the class into two teams before live broadcast, and the students in the team with higher score will get corresponding rewards after the class. The score of the two teams is displayed in real time. The live broadcast operation button is used to start, pause and end the live broadcast. After clicking start, the live broadcast signal is sent to the student end, the lecture area and the discussion area can be used, and the playback is recorded at the same time. When pausing the live broadcast, the lecture area is retained, the teacher's audio and video are not transmitted, and the live playback does not record. After ending the live broadcast, all teachers and students can leave the live broadcast room. Among them, half an hour before the end of the live broadcast, press return to exit the live broadcast room, but do not end the live broadcast; half an hour after the live broadcast time, and there is no teacher in the live broadcast room, the live broadcast is ended.

[0163] In some embodiments, the handwriting input function control displayed in the second live interface is used to simulate a real classroom scene when the teacher needs to arrange homework or mark course content on the blackboard. For example, in the lecture function mode, the teacher's touch pen or finger touch triggers the handwriting input function control in the live operation button, such as the "brush" control in Figure 9 , to perform interactive operations such as drawing lines, writing characters, and painting pictures on the lecture displayed on the display by manually touching the display

[0164] The display interface of the three-split-screen live class displays the theme name of the live class, the broadcast time of the class, the pause time, the teacher's avatar and name, and other live broadcast information. During the class, the teacher clicks the "brush" to support the use of the lecture and whiteboard, and can be synchronized to all students. The brush stroke thickness can be adjusted, and functions such as undoing the last step of the brush, deleting all brushes, and adjusting the brush color can also be performed. During the class, the teacher can provide questions for the students to answer, and the students can answer the questions in the corresponding area. After each student finishes answering the question, the selection rate and answering time of each selection are displayed, and the number of correct answers, the number of answered people, and the number of online people are also displayed. The number of online people refers to the number of online people at the moment of clicking the question, and when the number of answered people is greater than the number, the number of answered people is taken. When there are multiple questions in the random test, the display order of each question is the order in the random test management. During the class, the teacher can provide each student with a discussion time, and the teacher can send messages to any student or all students in the discussion area to ask questions. When selecting students, you can choose through a drop-down list or directly input the student's name. The teacher can clear his own discussion area, but cannot restore it; after clicking "mute", the students in the discussion area cannot leave messages (the teacher can still leave messages), and after clicking "unmute", the message leaving function is restored.

[0165] During the class, the teacher can interact with any student in the class through the microphone and camera. The process includes the student raising or not raising his hand, the teacher turning on the student's camera and microphone, the student's hand being put down, and the student's video area being on stage, so that all teachers and students can see and hear. When the microphone is on, only the function area of the blackboard and the whiteboard can be used. When the video is playing, the view of the microphone prompt is "not available". Only one student can be connected to the microphone at the same time. After the student is on stage, the video area is designed to be the size of the teacher's desktop, and the teacher can drag the student's image to any position in the function area to avoid blocking the content of the whiteboard. The terminal used by the student connected to the microphone needs to be equipped with a camera and a microphone.

[0166] The function area can display tabs such as whiteboard, lecture notes (imported attachments) and video, and the order of the tabs can be dragged and exchanged. Except for the whiteboard, the names of the rest of the tabs can be modified by double-clicking. The content of the first tab is displayed by default. When the function area is a video, the video area can be clicked to pause or resume playing, and the progress bar can be dragged to select the progress. When the function area is a lecture note (PPT or PDF), the control button is displayed in the lower right corner. The lecture notes can be scrolled up and down by responding to the mouse and the keyboard, and the pen can be used to mark on the PPT.

[0167] Teachers can view the current number of online participants in the live stream using the "Online" button provided in the live stream room. Clicking the "Online" button displays all students in the class for this lesson, including both students and teachers. To the left of each student's name is the device type, i.e., the terminal the student is using to participate in the live stream, such as TV, PAD, etc. To the right of each student's name are controls for raising hands, microphone, receiving likes, and drawing. Any of these controls is red to indicate the function is enabled, while gray indicates the function is disabled. For the hand-raising control, a student can left-click to raise their hand and turn it red; clicking it again changes the direction of the raised hand and turns it gray. Teachers cannot raise hands for students; students can only raise their hands again after lowering them. The camera and microphone are controlled by a single microphone button. A red button indicates a live connection, a gray button indicates a supported device is not connected, and a slash indicates no microphone or camera device is available. During a live connection, only one student can receive video or be connected at a time, and it must be the same student. A red pen button indicates that the teacher has pen access; left-clicking authorizes pen access. A gray button indicates that the teacher does not have pen access. After authorization, if a student raises their hand, the pen access is revoked, and only one student can have pen access at a time. A button with a slash indicates that the device is not touch-sensitive. The teacher can also click the "Release All Hands" button to reset all raised hands, with the number indicating the number of raised hands. The "Online" page also displays "Not Present 10," indicating that 10 students are absent. Each student's name in the absent list shows their absence status and leave request. If the teacher clicks the "Not Present" button, the corresponding position changes to display the "Present" button.

[0168] Figure 10 This application provides an illustration of another three-screen live online class format in some embodiments. See also... Figure 10, live teaching can also support multi-channel video teaching, which is more suitable for 1 to 1 to 1 to 7 small class teaching scene (up to 8 video). When live teaching, the teacher's video is by default in the first place, the video area is slightly larger, the student's own video is by default in the second place, and the rest of the student's video is displayed in the order of entering the live room. When too many people, rotate. Before the teacher starts live, all videos and microphones are turned off; after starting live, all videos are turned on by default, student microphones are turned off by default, and teacher microphones are turned on by default. When connected to the microphone, only one student can connect to the microphone, and the video and the microphone must be the same person. During the process of connecting to the microphone, the teacher right-clicks on the image of a student and clicks, which can pop up a shortcut menu. Left-click in the shortcut menu, execute the corresponding operation (send likes, end the microphone, grant the brush), and the interface disappears. Among them, clicking "send likes" means clicking to give students likes, and the pop-up layer disappears after sending; clicking "end microphone" ends the microphone, and the student returns to the seat, and the pop-up layer disappears; clicking "grant brush" gives the student the right to use the brush, and the pop-up layer disappears. When not connected to the microphone, the teacher right-clicks on the image of a student and clicks, which can pop up a shortcut menu. Left-click in the shortcut menu, execute the corresponding operation (send likes, go on stage, put down the hand, and recycle the brush), and the interface disappears. Among them, clicking "send likes" means clicking to give students likes, and the pop-up layer disappears after sending; clicking "go on stage" opens the video and microphone, and the student goes on stage. The hand is put down ("put down the hand" text becomes gray), and the single layer disappears; clicking "put down the hand" puts down the hand, and the pop-up layer disappears; clicking "recycle the brush" recycles the brush, and the pop-up layer disappears. During the class, each student can raise his hand to have the right to answer questions, and the upper right corner of each student's video area will display a "hand" icon. The "hand" icon is red, indicating that the student has raised his hand, and the "hand" icon is white, indicating that the student has not raised his hand. The student's video area also displays the student's name and the number of points, and a single click can give the student likes; it also displays whether the microphone is turned on, and a single click connects to the microphone. Click again to disconnect the microphone.

[0169] The teacher's end can also close the lecture area and restore the lecture area. After closing the lecture area, the teacher's video is enlarged to the function area. The teacher can also close all student videos and restore all student videos, as well as conduct in-class exercises and discussion areas. The contents of these two parts can refer to the three-screen teaching content, which will not be repeated here.

[0170] Whether it is three-screen class or multi-video class, after completing the current live class, students can play back the already live course. The playback content only includes course content and image video of teacher and student live. The playback resource comes from the real-time recording content during live teaching. The content that can be played back includes: recording of the mic process, but cannot participate; pop-up of the test questions during the class, can participate in doing the questions and feedback of right or wrong, the results of doing the questions are not recorded; full recording of the brush process, but cannot operate; no display of the hand raising function. The parts that do not need to be recorded include the discussion area, student list and team, which are not required to be displayed in the playback area. The progress bar is displayed below the playback video, marking which time period has the mic and which time period has the test questions during the class, and the colors are distinguished. When playing the playback video, the progress bar is automatically hidden after X seconds by default, clicking the video area can pause, and clicking the video area again can play; left and right dragging the progress bar can realize fast forward and fast backward, and there is no collection function. In addition, the two-screen class mode can also be used, and the corresponding live room displays the course content and student video area, and no longer displays the teacher video area. Similarly, the student end can also use the two-screen class mode, and the corresponding live room displays the course content and student video area, and no longer displays the teacher video area.

[0171] After the student end logs into the "Jumi School" application, it can enter the live room according to the class schedule when it reaches the class time. Since the teacher end can use the three-screen class mode and the multi-video class mode, correspondingly, the student end can also use the three-screen class mode and the multi-video class mode.

[0172] Figure 11 The page schematic diagram of the student end homepage in some embodiments of the present application. After the student end logs into the "Jumi School" application, it enters the user homepage. Referring to Figure 11 , the left side of the user homepage displays the user avatar and the student name, and if the user avatar is empty, the last two characters of the name are used as the avatar. The right side displays the my parents button and the exit button, and clicking returns to the login interface. The user homepage displays the class schedule information and the homework information.

[0173] The homework information includes the today's homework list, and the "all homework" button is displayed in the upper right corner of the today's homework list. Clicking jumps to the all homework interface. The today's homework displays the homework whose start time is today, and by default, the unfinished homework is displayed, and the selection of unfinished and completed homework is supported. In addition to the unfinished homework, the homework in other states is displayed in the completed homework. After the student clicks on a homework to complete and submit and returns, this homework needs to be hidden from the unfinished module. Each homework displays the subject icon of the homework, the subject title of the homework and the deadline of the homework. The icon data comes from the background configuration.

[0174] The timetable information includes a timetable list of mine, and the top of the timetable list displays a year-month selection bar, which can be flipped month by month to the left and right, and the date below changes accordingly, and the first week is displayed by default, and the 1st is selected. The selected date in each month is green, and the first day the application is opened is selected by default. Before exiting, the selected position is remembered. The orange small dots below the date represent that there is at least one live class on that day. In the display date box, the timetable arrangement of other dates can be viewed by sliding left and right, and the selected date does not change when sliding. If the date without orange small dots is selected, the prompt "No class on this day" is displayed.

[0175] The course list is displayed below the date box, arranged in chronological order of each course, with earlier courses displayed higher. The class time, team situation and score situation are displayed on each course. If a course has been completed, the team situation displayed is the team battle result of the student's own team at the current live class time, and the score situation is the corresponding live score obtained. The operation buttons are displayed on the right side of each course, including watch playback, class, leave and leave. The watch playback button is displayed on the right side of the live class that has been completed. The student clicks the watch playback button to play back the course video; the class button indicates that the course is about to be live, and the student can click to enter the class 15 minutes in advance. If the student enters in advance, there is no live stream in the live room, and the prompt "Live has not started yet" is displayed. The leave button can be selected 15 minutes before the class, and after being selected, the button is replaced by the leave button. The leave button is displayed on the right side of the course, indicating that the student has left the course. After the live starts, click to enter the live room to calculate the attendance; if the live has not started, click to cancel the leave. Specifically, the "leave" button is displayed 15 minutes before the class (not included), and after 15 minutes before the class, if the student has not left, the "class" button is displayed, and if the student has left, the "leave" button is displayed.

[0176] Figure 12 The page diagram of the student end listening to the class in some embodiments of the present application is shown. After the student clicks the "class" button, the corresponding live room can be entered to listen to the class. The student listening mode is the same as the teacher's class mode. When the three-split-screen listening mode is adopted, refer to Figure 12The live broadcast page of the student is similar to the live broadcast page of the teacher, and the live broadcast page of the student includes a course content area, a student video area, a teacher video area and a function area. The live broadcast page displays the live broadcast course theme name and the live broadcast time length. If the student presses the back button in the live broadcast page, the student end exits the live broadcast room. The course content area is used to present the live broadcast content such as lecture notes, whiteboard and video. The student video area is used to display the student's own image, name and the number of points in the live broadcast course. The teacher video area is used to display the image of the teacher. The function area displays the operation buttons during the live broadcast interaction. The operation buttons during the live broadcast interaction include a microphone, a camera, a hand-raising, a brush and a discussion button. The “hand-raising” button is red when the student has raised his hand, and is gray when the student has not raised his hand. The “camera” button is red when the camera is turned on, and is gray when the camera is turned off. If the “camera” button displays a slash, it means that the student's device does not have a camera. When the student triggers the “camera” button, a purchase camera interface is popped up. The “microphone” button is red when the microphone is turned on, and is gray when the microphone is turned off. If the “microphone” button displays a slash, it means that the student's device does not have a microphone. When the student triggers the “microphone” button, a purchase microphone interface is popped up. When the “brush” button has the permission, the student triggers the button to expand the brush panel, and the default brush color is red. When the student returns, the panel is closed. When the “brush” button does not have the permission, the student triggers the button to pop up a “brush cannot be used” prompt.

[0177] When the camera or the microphone is not configured and the live broadcast needs to call the camera or the microphone, a purchase QR code link and a call-in use instruction are displayed in the display screen. The call-in use instruction can be a static or dynamic picture, which is used to describe how to call in. At the same time, a refusal button is also displayed in the display screen. If the “first do not buy, just look around” button is clicked, the page is closed. When the camera needs to be used, the device is detected first to determine whether the “Jumi school” application has the permission to call the camera. If the application does not have the permission, a prompt “Do you want to allow Jumi school to take pictures and record videos?” is popped up. If the student refuses, the AI monitoring video area is empty. If the student allows, the camera is normally called and the image of the student is collected and displayed in the video area. If the device is configured with the camera and the “Jumi school” application has the permission to call the camera, but the camera is occupied by other applications, when the “Jumi school” application calls the camera, a prompt “The camera is occupied, the teacher cannot see your video picture” is popped up. If the student forcibly exits the other application that occupies the camera, the student can enter the live broadcast room. If the student chooses not to use the camera, the AI monitoring video area is empty when the student enters the live broadcast room.

[0178] When the student enters the live broadcast room, the "discussion" button is selected by default, and the discussion area is displayed on the right side of the live broadcast picture. Right-clicking the "discussion" button to the "discussion area tab", the "discussion area tab" can be pressed to view the previous chat records, and the back key is pressed to return to the "discussion area tab". Pressing the right key of the "discussion area tab" can switch to the "student tab", clicking can view the student list, and pressing the back key can return to the "discussion area tab".

[0179] In the multi-channel video listening mode, the live broadcast interface is the same as that in the three-split-screen listening mode, and the difference lies in the call of the discussion area. In the multi-channel video listening mode, the discussion area is popped up by pressing the OK key of the remote controller, and the selection area is also popped up. The first item of the script is selected by default, and the back key is pressed to disappear. The discussion area stores the selected input script, and the selected input can be up to 20 short texts. If the text width is exceeded, the marquee is selected, for example, no sound, video card, no understanding, thank you teacher, etc. The selection input mode can also be voice input, which converts voice into text and displays it. The student can operate the direction keys of the remote controller to control the focus on each script in the selection input, and click the OK key to send it in the discussion area.

[0180] Figure 13 The page schematic diagram of the student's in-class practice in some embodiments of the present application is shown in FIG. 12. Figure 13 When the teacher is live teaching, the in-class practice can be performed during the live course, and the related options of the in-class practice are displayed in the live interface. When the in-class practice is popped up, the option button is selected by default, and no other position can get the focus before the answer is submitted. If the student tries to cut away, the option area will shake. The student interacts with the in-class practice. When interacting, if it is a multiple-choice question, the student selects several options and clicks submit to output the answer. After the teacher ends the answer, the answer disappears. If it is a single-choice question or a judgment question, one is selected to directly output the answer. The student's answer is correct or incorrect, and the corresponding sound effect and bonus effect are given, and the student's selected answer cannot be modified. If a student performs well in the classroom or answers the most correct questions, the teacher can like the student. After the teacher likes, all student terminals and teacher terminals receive the "like" special effect at the same time. The "like" special effect displays the student's name in the middle, indicating the winner. The "like" special effect cannot get the focus and automatically disappears after a few seconds.

[0181] The student end opens the AI monitoring function when the camera is called after entering the live room. The display device detects whether there is a camera when the student enters the live room. If there is a camera, a prompt for obtaining camera permission is popped up. If the camera is occupied by other applications, a prompt "occupied" is given. If the display device is not configured with a camera, the student's own video area is not displayed. The AI monitoring function can detect whether the student is in the video: when the camera collects the student's image, a human form box is displayed in the collection area. If the student is not in the box, the human form dotted line flashes, and the voice broadcast "I can't see you, please do well, listen to the teacher's class oh~", the default detection interval is X seconds. The AI monitoring function can also detect whether the student's posture is correct: if the student's posture is not correct, the human form dotted line flashes, and the voice broadcast "please correct and do well, follow the teacher's class oh~", the default detection interval is X seconds; the definition of correct is reference: lying down no, lying down no, non-frontal to the camera no. The AI monitoring function can be provided with a monitoring switch. If the monitoring switch is turned off, the camera area will not be displayed.

[0182] If the AI monitoring broadcast is not complete and the student's posture is detected to be correct, the broadcast will be completed and disappear. If no one is detected to be in the correct posture, the broadcast will be repeated every 1 minute. If there is one person in the human form dotted line box and the posture is correct, it meets the requirements. If there are multiple people in the video, the detected person is used as the standard.

[0183] If the student is connected to the teacher for live streaming, the microphone and "live streaming" badge are displayed and the user is prompted to flash. When live streaming, the student's own live streaming is displayed in the left area, and the right area is empty, or vice versa. After completing the live class, the system provides a live report, including the answer situation, the number of times raising hands, the number of times live streaming, and the number of times liking.

[0184] Figure 14 The schematic diagram of the first live interface in some embodiments of the present application. Referring to Figure 14 , the student end display device starts the first program, clicks on one of the live classes that have reached the class time or are already in the live class based on the live class list, to present the first live interface in the student end display device. The first live interface displays a course content area, a student video area, a teacher video area, and a function area. The live picture of the course content area is consistent with the live picture of the course content area of the second live interface. The teacher video area is used to display the teacher image, and the student video area is used to display the student image. When multiple students are simultaneously conducting live class, the student video area displays multiple student images.

[0185] In some embodiments, when the student image and the teacher image are displayed, the student video area and the teacher video area are displayed above the course content area, and the teacher video area is displayed in the first position, and the student video area is located to the right of the teacher video area, and the image of the local student is displayed in the first position of the student video area, and the images of the remaining students are displayed in sequence according to the order of entering the live class.

[0186] The function area is used to realize the interaction function of the student during the live class, including the hand-raising, handwriting input (selectively configured), discussion, and help functions. During the live class, if the student wants to actively answer the teacher's question, the student can trigger the hand-raising function to inform the teacher that he wants to answer the question. The handwriting input function is used to perform corresponding handwriting input operations according to the authorization of the teacher, for example, adjusting the handwriting input style and scribbling, drawing, etc. The handwriting input style includes but is not limited to brush shape, color, thickness, font, etc. When scribbling, the student can use a stylus in combination with the display device to scribble on the touch screen display, or directly use a finger to scribble on the touch screen display, Figure 14 The first live interface shown is a case where the handwriting input function is not configured, Figure 19 The first live interface shown is a case where the handwriting input function is configured. The discussion control can realize real-time text discussion and interaction between the teacher and the student, and between the students. The discussion area function in the second live interface can be referred to. The help function control can provide help function to the program platform when the application program abnormally during the live class, such as unable to start the camera, unable to see the live picture, etc.

[0187] Figure 15 The schematic diagram of the course content area in the live interface when scribbling by handwriting input in some embodiments of the present application. In order to simulate the real classroom scene during the live class by using the display device, for example, the teacher arranges homework on the blackboard, and the student answers questions on the blackboard, etc. In some embodiments, referring to Figure 15 The online virtual interface formed by the live interface is used as a blackboard, and the student and the teacher use their respective handwriting input functions to perform scribbling operations on the corresponding live interface, wherein the live interface scribbled by the teacher is the second live interface, and the live interface scribbled by the student is the first live interface.

[0188] In some embodiments, whether it is a student end or a teacher end, the handwriting input function can be used to write on the corresponding live interface. The display device used needs to have a touch screen. For display devices with ordinary screens, the handwriting input function cannot be used for writing temporarily, and other devices need to be used for operation. Therefore, for different models of display devices, different live class programs need to be provided when live classes are conducted, that is, a live class program with handwriting input function needs to be configured for touch screen display devices, and a live class program without handwriting input function needs to be configured for ordinary display devices.

[0189] Since the program platform needs to provide two versions of programs for live classes on the student end and the teacher end, if the display devices used by each student end are different, the program platform needs to maintain more versions of programs, which will inevitably lead to high maintenance cost of the platform. Therefore, in order to reduce development cost, the program platform can provide the same version of the first program for different models of student end display devices, that is, different models of display devices can be compatible, that is, different models of display devices can be compatible with two different forms of display modes, that is, the first live interface with handwriting input function and the first live interface without handwriting input function.

[0190] Therefore, when configuring the first program on different models of display devices, it is necessary to control the automatic display of the handwriting input function in the live interface according to whether the display device is a touch screen. Therefore, the display device provided by the embodiments of the present application needs to control whether the handwriting input function is turned on or off for different models of display devices when the same version of the first program is configured, so as to realize that one version is suitable for all models of display devices and two forms of interface display are compatible.

[0191] In some embodiments, in the scenario of configuring the first program for the student end display device, different students use different display devices, and different display devices may be different in model. Therefore, when the student starts the first program, the student end display device used needs to query whether it is configured with handwriting input capability, so as to accurately determine whether the handwriting input function control needs to be displayed in the first live interface.

[0192] In some embodiments, when developing a display device, the developer needs to configure whether the handwriting input capability is turned on according to the model, whether the CPU and memory resources of the model meet the use requirements, and other factors. That is, when the model is a touch screen and the CPU, memory resources and the like meet the requirements, the handwriting input capability is configured for the display device. When the model is an ordinary screen, even if the CPU, memory resources and the like meet the requirements, the handwriting input capability is not configured for the display device.

[0193] In some embodiments, after the developer completes the pen capability and model configuration of each display device, the developer obtains the function configuration information and stores it to the server, and the server stores the function configuration information of each display device according to the identification information. When the live class is conducted, the first program needs to query the model, pen capability configuration and other information of the device according to the current device capability, to determine whether to display the handwriting input function control.

[0194] In some embodiments, the terminal devices with the same hardware configuration may exhibit the handwriting input function control when the condition is met and may not exhibit the handwriting input function control when the condition is not met due to different installed software versions.

[0195] In some embodiments, the student terminal device with the pen function can manually turn off or turn on the pen function, and the student terminal device can synchronize the changed information to the teacher terminal device.

[0196] Figure 16 An interaction diagram for automatically exhibiting the handwriting input function in the teaching live broadcast in some embodiments of the present application; Figure 17 A flowchart for automatically exhibiting the handwriting input function in the teaching live broadcast in some embodiments of the present application. The present application provides a display device applied to a student terminal display device, which includes a display configured to present a first live interface generated when a first program is started; a storage configured with the first program for implementing online live class; and a controller connected with the display and the storage, which, when executing the control method for automatically exhibiting the handwriting input function, refers to Figure 16 and Figure 17 , the controller is configured to execute the following steps:

[0197] S11, in response to an application start instruction for starting the first program, sending a handwriting input function query instruction to the server, the handwriting input function query instruction being used to instruct the server to query whether the handwriting input function is configured on the terminal.

[0198] Before the live class is conducted, the student triggers the first program configured on the display device used by the student in the form of a remote controller or voice to generate an application start instruction, and the controller responds to the application start instruction to call the display interface of the first program, that is, to generate a first live interface and display it in the display. One display form of the first live interface can refer to the interface content shown in Figure 14 .

[0199] When the student starts the first program, the controller of the student terminal display device generates a handwriting input function query instruction and sends it to the server. The server queries whether the student terminal display device is configured with handwriting input function according to the handwriting input function query instruction of the student terminal display device. If the device sending the handwriting input function query instruction is a touch screen model, the display device is configured with handwriting input function. At this time, the server sends an instruction supporting handwriting input function to the corresponding student terminal display device. If the device sending the handwriting input function query instruction is a normal screen model, the display device is not configured with handwriting input function. At this time, the server sends an instruction not supporting handwriting input function to the corresponding student terminal display device.

[0200] In some embodiments, the subject querying whether the display device is configured with handwriting input function is the server rather than the device itself. Querying handwriting input function by the server can reduce the occupation of CPU and memory resources of the display device and avoid affecting the normal operation of the display device.

[0201] Since there are multiple students attending the live class, when multiple students start the live class program configured on their respective display devices, the student terminal display devices used by the students all generate handwriting input function query instructions and send them to the server respectively. At this time, the server may receive multiple handwriting input function query instructions simultaneously. To ensure that the server can accurately return the corresponding handwriting input function query result for each student terminal display device, the student terminal display device needs to carry its own identification information when sending the handwriting input function query instruction. The identification information is used to identify at least one of the model information, hardware configuration information and version information of the display device.

[0202] Figure 18 Method flow chart for sending handwriting input function query instruction in some embodiments of the application. In some embodiments, referring to Figure 18 The controller is further configured to perform the following steps in response to the application start instruction for starting the first program:

[0203] S111, receiving an application start instruction for starting the first program.

[0204] S112, in response to the application start instruction, obtaining local identification information, the local identification information being used to identify at least one of the model information, hardware configuration information and version information of the local display device.

[0205] S113, generating a handwriting input function query instruction based on the local identification information, wherein the handwriting input function query instruction contains the local identification information.

[0206] S114, send the handwriting input function query instruction to the server, the handwriting input function query instruction is used to instruct the server to query the handwriting input function query result of the display device corresponding to the local identification information according to the local identification information.

[0207] The student generates an application start instruction when starting the first program configured in the display device used by the student, and the server acquires the local identification information in response to the application start instruction. The identification information is a unique identification corresponding to the display device, and is used to distinguish different student display devices.

[0208] In some embodiments, to ensure uniqueness, the identification information of the display device can be generated based on the related information of the device and a random string. Therefore, the controller is further configured to perform the following steps when acquiring the local identification information:

[0209] Step 1111, when starting the first program, acquire the model information, version information and hardware configuration information of the local display device.

[0210] Step 1112, generate the local identification information based on the model information, version information, hardware configuration information of the local display device and a randomly generated string.

[0211] After the first program is started, the controller of the display device acquires the model information, version information and hardware configuration information of the device. The model information includes touch screen models and ordinary screen models, the hardware configuration information includes CPU, memory resources and other hardware information, and the version information includes device system version and other information.

[0212] At the same time, a random string is generated, and the local identification information is generated based on the model information, version information, hardware configuration information and the randomly generated string. The model information, version information and hardware configuration information are used to distinguish the hardware structures of different display devices, and the randomly generated string is used to further distinguish different display devices, so as to avoid the identification information of display devices with the same hardware structure being the same. Therefore, the local identification information generated based on the model information, version information, hardware configuration information and random string has uniqueness.

[0213] After the student display device acquires the local identification information, it can generate a handwriting input function query instruction carrying the local identification information and send it to the server. After the server receives the handwriting input function query instruction, it parses the instruction to obtain the corresponding identification information, and then queries the handwriting input function query result corresponding to the student display device based on the unique identification information.

[0214] The handwriting input function query result includes two contents, one is to support handwriting input function, and the other is not to support handwriting input function.

[0215] S12, if the handwriting input function query result returned by the server is that the local end has handwriting input function, the handwriting input function control is displayed in the first live interface.

[0216] Referring to Figure 16 In (a), the first program is configured in the student end display device A, and steps S11 and related steps are performed, and the server is queried whether the student end display device A is configured with handwriting input function. If the server returns handwriting input function query result supporting handwriting input function to the student end display device A, the handwriting input function control is displayed in the first live interface corresponding to the student end display device A.

[0217] Figure 19 In some embodiments of the present application, a schematic diagram of the first live interface with handwriting input function control is shown. Referring to Figure 19 Another display form of the first live interface is shown. If the student end display device A is a touch screen model, it has handwriting input function, so when the first program is started, the handwriting input function control is displayed in the generated first live interface, such as Figure 19 The "brush" control displayed in the function area.

[0218] S13, if the handwriting input function query result returned by the server is that the local end does not have handwriting input function, the handwriting input function control is not displayed in the first live interface.

[0219] Referring to Figure 16 In (b), the first program is configured in the student end display device B, and steps S11 and related steps are performed, and the server is queried whether the student end display device B is configured with handwriting input function. If the server returns handwriting input function query result not supporting handwriting input function to the student end display device B, the handwriting input function control is not displayed in the first live interface corresponding to the student end display device B.

[0220] Referring again to Figure 14 The first live interface is shown, and the handwriting input function control is not displayed in the interface. If the student end display device B is a normal screen model, it does not have handwriting input function, so when the first program is started, the handwriting input function control is not displayed in the generated first live interface.

[0221] Different students enter the live class for learning, according to the models of the display devices used by each student, such as normal screen display device and touch screen display device, different students will see different first live interfaces, that is, the first live interface with handwriting input function control and the first live interface without handwriting input function control. It can be seen that the two interfaces of the same version of the first program used in the present application can be compatible.

[0222] When different display devices start the live-streaming program, they all need to report their local identification information to the server. The server then issues a decision on whether to enable the handwriting input function, i.e., whether to display the handwriting input control in the first live-streaming interface. Therefore, different display devices can run the same version of the first program, automatically determining whether to display the handwriting input control by reporting their local identification information. This ensures compatibility between two different interface types, eliminating the need for the program platform to maintain different versions for different device models, thus reducing development costs.

[0223] Display devices with handwriting input function controls allow students to directly participate in the shared handwriting input function via touch. Display devices without handwriting input function controls do not allow students to directly participate in the shared handwriting input function; they need to use other external devices to participate in the interaction.

[0224] In some embodiments, if students use a standard screen display device, since the display lacks touch functionality, they cannot directly input relevant information (writing, drawing, etc.) via touch. However, information input can be achieved by connecting an external device to the display device; for example, the external device could be a terminal that provides touch input functionality. Students use a stylus or finger to write, draw, etc., on the terminal with touch input functionality to generate input information. The terminal then transmits the input information to the display device. After receiving the input information, the display device parses it and displays the content on the live broadcast interface, specifically in the answer area or lecture handout area, enabling students using standard screen display devices to participate in the shared operation of handwriting input functionality.

[0225] Since ordinary screen display devices connected externally can also implement handwriting input functionality, when a student's display device using an ordinary screen reports its capabilities to the server, the server recognizes the display device as having handwriting input functionality. Therefore, when the student's display device starts the live class program (such as the first program), the query result for handwriting input functionality from the server shows that it has handwriting input functionality. At this time, the handwriting input function control is displayed in the live class interface of the student's display device using an ordinary screen.

[0226] The student needs to obtain the teacher's pen authorization to participate in the shared handwriting input function operation. The teacher's display device needs to know whether the display device used by each student participating in the live class has a handwriting input function. Therefore, after each student's display device obtains the handwriting input function configuration, it immediately synchronously informs the teacher's display device, so that the teacher can clearly know which students can obtain handwriting input function authorization and which students cannot obtain handwriting input function authorization, to ensure the normal progress of the live class. The student display device that can obtain handwriting input function authorization includes a touch screen display device and a normal screen display device with a touch input terminal.

[0227] In some embodiments, when the automatic display of the handwriting input function control method is executed, after the student's display device obtains the handwriting input function query result, the controller is further configured to perform the following steps: after receiving the handwriting input function query result returned by the server, the handwriting input function query result is sent to the teacher's display device to display a first permission control button for representing the control authority of the student's display device with handwriting input function and a second permission control button for representing the control authority of the student's display device without handwriting input function. The first permission control button is in a triggerable state, and the second permission control button is in a non-triggerable state.

[0228] After each student's display device queries the respective handwriting input function query result, it needs to timely send the respective handwriting input function query result to the teacher's display device. The teacher's display device generates a corresponding student list according to the handwriting input function configuration of each student's display device, to display whether the corresponding student can participate in the shared handwriting input function operation according to the received different handwriting input function configurations. In some embodiments, whether each student's display device can participate in the shared handwriting input function operation can be determined by displaying the permission control button in the second live interface.

[0229] The student list includes a first operation item and a second operation item. The first operation item displays the student name corresponding to the student's display device with handwriting input function and the first permission control button, and the second operation item displays the student name corresponding to the student's display device without handwriting input function and the second permission control button. The first permission control button is in a triggerable state and has handwriting input function control authority of the corresponding student's display device; the second permission control button is in a non-triggerable state and does not have handwriting input function control authority of the corresponding student's display device.

[0230] For example, the student-side display device A sends the result with the handwriting input function to the teacher-side display device, the student-side display device B sends the result without the handwriting input function to the teacher-side display device, the teacher-side display device generates a student list according to the handwriting input function configuration of the student-side display device A and the student-side display device B, generates a first operation item based on the result sent by the student-side display device A, and generates a second operation item based on the result sent by the student-side display device B. The first permission control button of the student-side display device with the handwriting input function control permission is displayed in the first operation item, and the second permission control button of the student-side display device without the handwriting input function control permission is displayed in the second operation item. It can be seen that the permission control buttons displayed by the teacher-side display include two display forms of the handwriting input function control permission and the handwriting input function control permission. When sharing the handwriting input function, the teacher can only select the students with the handwriting input function to participate in the shared handwriting input function operation, that is, the handwriting input function can be started by triggering the first permission control button to authorize the handwriting input function of the corresponding student-side display.

[0231] When the teacher clicks the first permission control button in the second live interface of the teacher-side display device, a handwriting input authorization instruction is generated to authorize the handwriting input function of the student-side display device corresponding to the first permission control button. At this time, the student-side display device receives the handwriting input authorization instruction, and can start the handwriting input function configured by the student-side display device to perform handwriting input operation.

[0232] In this scenario, the controller in the student-side display device is further configured to perform the following steps:

[0233] Step 141, receiving the handwriting input authorization instruction sent by the teacher-side display device, the handwriting input authorization instruction being an instruction generated when the teacher-side display device triggers the first permission control button.

[0234] Step 142, in response to the handwriting input authorization instruction, starting the handwriting input function control in a triggerable state.

[0235] Step 143, in response to triggering the handwriting input function control in the triggerable state, generating a handwriting input function starting instruction, the handwriting input function starting instruction being used to start the handwriting input function to perform handwriting input operation in the first live interface.

[0236] Since the student does not have the right to actively open the handwriting input function control configured in the student end display device used by the student, the handwriting input function control can only be opened by the teacher end after authorization, that is, although the handwriting input function control is displayed in the first live interface of the student end display device, the control is in a non-triggerable state without authorization from the teacher. Therefore, during the live class, if a student needs to participate in the live class through the handwriting input function, the teacher can click the first permission control button corresponding to the student in the student list presented in the second live interface of the teacher, to open the handwriting input function of the device used by the student, so that the student end obtains authorization of the handwriting input function.

[0237] The teacher end triggers the first permission control button to generate a handwriting input authorization instruction, and sends the handwriting input authorization instruction to the corresponding student end display device. After receiving the handwriting input authorization instruction, the student end display device opens the trigger state of the handwriting input function control configured therein, so that the handwriting input function control is in a triggerable state. At the same time, to inform the student that the student has obtained authorization of the handwriting input function, a prompt can be popped up in the first live interface in synchronization, and the prompt content can be "You have obtained authorization of the handwriting input function, and can perform handwriting input operation".

[0238] After seeing the prompt content, the student can trigger the handwriting input function control by means of a stylus or a finger to generate a handwriting input function call instruction, and the handwriting input function call instruction is used to call the handwriting input function to perform handwriting input operation in the first live interface.

[0239] It can be seen that the embodiment of the present application provides a display device, which, when the first program is started, executes an automatic handwriting input function query strategy to query a server whether the display device has handwriting input function. When the display device has handwriting input function, the handwriting input function control is displayed on the first live interface; and when the display device does not have handwriting input function, the handwriting input function control is not displayed on the first live interface, so that the first program can be compatible with two different display modes, the two live class interfaces are compatible with each other, one version of the live class program can be adapted to all display devices, and multiple versions of the program do not need to be developed and maintained, so that the development cost is reduced.

[0240] When the first program is started, each student end display device sends the handwriting input function query result automatically queried by the student end display device to the teacher end display device, so that the teacher can select students having handwriting input function to participate in the shared brush.

[0241] Figure 20Another flowchart for automatically displaying a handwriting input function in a live teaching broadcast in some embodiments of the present application. An embodiment of the present application provides a display device, which is applied to a teacher's display device, comprising: a display configured to present a second live interface generated when a second program is started; a memory configured with a second program for implementing online live teaching; and a controller connected with the display and the memory, which, when executing a control method for automatically displaying a handwriting input function, refers to Figure 16 (c) and Figure 20 , the controller is configured to perform the following steps:

[0242] S21, after the second program is started, receiving a handwriting input function query result sent by a student's display device, the handwriting input function query result being a result of the student's display device requesting the server to query whether the handwriting input function is configured at the student's end.

[0243] When conducting a live class, the teacher starts the second program configured on the display device used by the teacher in the form of a remote controller or voice, generating an application start instruction. The controller responds to the application start instruction to call the display interface of the second program, i.e., to generate a second live interface and display it on the display.

[0244] In some embodiments, the live class needs to be initiated by the teacher's end, so after the teacher's end starts the second program, a corresponding notification is pushed to each student's display device, and the student's end starts the corresponding first program after receiving the notification. The student's end automatically queries the configuration of the handwriting input function of each student's end to the server when starting the first program of each student, and sends the handwriting input function query result of each student to the teacher's display device.

[0245] Therefore, after the teacher's display device starts the second program, the handwriting input function query result sent by each student's display device can be received, the handwriting input function query result being a result of the student's display device requesting the server to query whether the handwriting input function is configured at the student's end, and the specific implementation process can refer to the content of steps S11 to S13 and related implementation content provided in the foregoing embodiments, which will not be described here.

[0246] After the teacher's display device receives the handwriting input function query result of each student's display device, in order to clearly determine whether each student can enjoy the handwriting input function authorization, the handwriting input function configuration of each student can be displayed in the form of a list.

[0247] In some embodiments, the controller in the teacher-side display device is further configured to perform the following steps when the second live interface is displayed: receiving the handwriting input function query result sent by each student-side display device; based on each handwriting input function query result, displaying a student list in the second live interface, the student list displaying the first operation item and the second operation item, the first operation item displaying the student name corresponding to the student-side display device with handwriting input function and the first permission control button, and the second operation item displaying the student name corresponding to the student-side display device without handwriting input function and the second permission control button, the first permission control button being in a triggerable state, and the second permission control button being in a non-triggerable state.

[0248] Figure 21 In some embodiments of the present application, a schematic diagram of the student list in the second live interface is shown. Referring to Figure 21 , the teacher-side display device generates a student list based on each student name and handwriting input function query result after receiving handwriting input function query results sent by a plurality of student-side display devices. The student list is displayed in the live information display area in the second live interface, and the student list displays the number of students currently online participating in the live class, each student name, and the permission control button of the handwriting input function.

[0249] To facilitate the distinction between whether the display device used by different students has handwriting input function, the teacher-side display device distinguishes the students participating in the live class according to the handwriting input function query result when generating the student list, i.e., generates the first operation item and the second operation item, the first operation item displays the student information of the display device configured with handwriting input function, and the second operation item displays the student information of the display device without handwriting input function.

[0250] In some embodiments, the first operation item displays the student name corresponding to the student-side display device with handwriting input function and the first permission control button, and the second operation item displays the student name corresponding to the student-side display device without handwriting input function and the second permission control button, the first permission control button being in a triggerable state, and the second permission control button being in a non-triggerable state.

[0251] In some embodiments, the teacher-side display device can generate the student list after receiving the handwriting input function query result sent by each student-side display device. Therefore, the generation of the student list can exist in different application scenarios. One application scenario is that when the live class is started, the teacher has just entered the live room and has not started the real class. At this time, the student list can be generated based on the handwriting input function query result sent by the display device used by the student entering the live room. Another application scenario is that during the live class, some students enter the live room after the class has started due to tardiness, that is, students join the live room one after another. The teacher-side display device can update the student list in real time according to the handwriting input function query result sent by the student-side display device currently entering the live room. The teacher can perform corresponding handwriting input function authorization operation based on the information presented by the latest student list.

[0252] Since the display device used by part of the students does not have handwriting input function and cannot participate in handwriting input function sharing operation, the second permission control button displayed in the student list does not have the control permission of the handwriting input function of the corresponding student-side display device. The display device used by another part of the students has handwriting input function and can participate in handwriting input function sharing operation. Therefore, the first permission control button displayed in the student list has the control permission of the handwriting input function of the corresponding student-side display device. That is, the handwriting input function query result corresponds to the display form of the permission control button.

[0253] In some embodiments, the display form of the permission control button can be a white paintbrush pattern (first permission control button) and a gray paintbrush pattern (second permission control button). The white paintbrush pattern represents the control permission of the handwriting input function of the corresponding student-side display device, and the teacher can click to trigger. The gray paintbrush pattern represents the control permission of the handwriting input function of the corresponding student-side display device, and the teacher cannot click to trigger. To distinguish the permission control buttons with and without control permission, the display form of the button can also be other colors or forms, which are not limited in the embodiment.

[0254] S22, when the handwriting input function query result is that the handwriting input function is available, the first operation item corresponding to each student-side display device with handwriting input function is displayed on the second live interface. The first operation item includes the first permission control button with the control permission of the handwriting input function of the corresponding student-side display device.

[0255] S23, when the handwriting input function query result is that the handwriting input function is not available, the second operation item corresponding to each student-side display device without handwriting input function is displayed on the second live interface. The second operation item includes the second permission control button without the control permission of the handwriting input function of the corresponding student-side display device.

[0256] When the teacher's display device receives a query result from the student's display device indicating that the student has handwriting input functionality, it means that the student's display device is a touchscreen model, or a regular screen model with an external touch input terminal, and is configured with handwriting input functionality, thus allowing them to participate in the shared handwriting input function operation. Therefore, the second live broadcast interface displays the first operation entry corresponding to the student's display device with handwriting input functionality, and within the first operation entry, a first permission control button with handwriting input function control permissions for the corresponding student's display device is presented, such as a button with a white pen icon.

[0257] When the teacher's display device receives a query result from the student's display device indicating that it does not have handwriting input functionality, it means that the student's display device is a standard screen model and is not connected to an external touch input terminal. Therefore, this device is not configured with handwriting input functionality and cannot participate in the shared handwriting input operation. Consequently, the second operation entry corresponding to the student's display device that does not have handwriting input functionality is displayed on the second live streaming interface. This second operation entry also includes a second permission control button (such as a button with a gray pen icon) that does not have the handwriting input function control permissions for the corresponding student's display device.

[0258] For example, see again Figure 21 The student list shown contains 300 students participating in the live class. Information for three students is illustrated. If the display devices used by students A and C have handwriting input functionality, a corresponding first operation entry will be displayed on the second live interface. Within this first operation entry, a first permission control button with a white pen icon will be displayed. This means that the first operation entry is generated based on student A, and student A and the first permission control button with a white pen icon are displayed to the right of student A. Similarly, the first operation entry is generated based on student C, and the first permission control button with a white pen icon is displayed to the right of student C. This indicates that the first permission control button in the student list, from top to bottom, has permission to control the handwriting input function on student display device A, and the third permission control button has permission to control the handwriting input function on student display device C.

[0259] If the display device used by student B does not have handwriting input functionality, a second operation entry will be displayed in the second live broadcast interface, and a second permission control button with a gray pen icon will be displayed in the second operation entry. That is, a second operation entry will be generated based on student B, and student B will be displayed in the second operation entry, along with a second permission control button with a gray pen icon displayed to the right of student B. This indicates that the second permission control button from top to bottom in the student list does not have the permission to control the handwriting input functionality of student's display device B.

[0260] Since the first permission control button of the white brush pattern can be triggered by clicking, and the second permission control button of the gray brush pattern cannot be triggered by clicking, when the teacher needs to select a student to share the handwriting input function, the first permission control button of the white brush pattern can be triggered to authorize the handwriting input function of the corresponding student, so that the student participates in the handwriting input interaction.

[0261] In some embodiments, when a student needs to be selected for handwriting input interaction, the controller in the teacher terminal display device is further configured to perform the following steps:

[0262] Step 241, when the student is authorized to perform handwriting input operation, receiving handwriting input authorization instruction generated when the first permission control button corresponding to the student is triggered.

[0263] Step 242, sending the handwriting input authorization instruction to the student terminal display device corresponding to the first permission control button that performs the triggering operation, and the handwriting input authorization instruction is used to start the trigger state of the handwriting input function control displayed in the first live interface by the student terminal display device. The student clicks the handwriting input function control in the triggerable state to start the handwriting input function to perform handwriting input operation in the first live interface.

[0264] Again referring to Figure 9 or Figure 10 , the handwriting input function control presented in the live operation button area displayed below the main function area of the second live interface is like the "brush" control in Figure 9 or Figure 10 . Since the model of the teacher terminal display device can be a touch screen and a normal screen, when the teacher terminal starts the second program, it also automatically sends the local identification information to the server to query whether the display device has handwriting input function. When it is found that the display device has handwriting input function, the handwriting input function control is displayed below the main function area; if it is found that the display device does not have handwriting input function, the handwriting input function control is not displayed below the main function area. The display of the handwriting input function control in the second live interface is the same as the steps of the automatic display of the handwriting input function control method performed by the student terminal display device, which will not be repeated here.

[0265] Figure 22 Interface diagram for the teacher terminal to use handwriting input function to write in some embodiments of the present application. Referring to Figure 22If the handwriting input function control is displayed in the second live interface, the teacher can trigger the handwriting input function control, and in the display area of the lecture note function mode, the teacher can write on the lecture note interface through the handwriting input function control. In the lecture note function mode, the course content area of the second live interface will switch to display the lecture note display area, and the lecture note display area will simulate a blackboard, so as to simulate the process of the teacher writing on the blackboard in a real classroom.

[0266] After the teacher writes the question in the lecture note mode through the handwriting input function control, the teacher can select one student to participate in the answering. Although the handwriting input function control is displayed in the first live interface of the student end, the student end cannot trigger the handwriting input function control actively. If the student wants to use the handwriting input function, the student needs to obtain the authorization of the teacher end.

[0267] In some embodiments, during the live class, the handwriting input function of the display device of the student end is not enabled, and the handwriting input function control displayed in the first live interface is in a gray state, i.e., a state that cannot be triggered, and the student cannot trigger the handwriting input function to perform handwriting input operation actively. The student needs to obtain the authorization of the teacher end to use the handwriting input function, i.e., when the teacher end authorizes a student to use the handwriting input function, the display device used by the student receives the handwriting input authorization instruction, the handwriting input function of the display device of the student end is enabled, and the handwriting input function control in the first live interface is switched to a white state, i.e., a state that can be triggered. The display forms of the untriggerable state and the triggerable state of the handwriting input function control can not only use gray and white patterns to display, but also use other forms to display, as long as the two different trigger states can be distinguished.

[0268] After the display device of the student end obtains the handwriting input function authorization of the teacher end, the handwriting input function of the display device of the student end is enabled, and the student can trigger the handwriting input function control displayed in the first live interface in a triggerable state. After triggering, the student can adjust the handwriting input style such as brush shape, thickness, color, and font in the generated brush setting interface. After the adjustment is completed, the student uses a stylus or a finger to perform operations such as writing on the touch screen display (or the display of the touch input terminal) to complete information input and realize interactive operations such as answering questions.

[0269] When the student end does not obtain the handwriting input function authorization of the teacher end, if the student triggers the handwriting input function control, the handwriting input function control of the student end does not respond to the trigger of the student because the handwriting input function control in the current state is in an untriggerable state, and a prompt is popped up in the first live interface. The prompt content can be “You have not obtained the brush authorization and cannot perform handwriting input operation”.

[0270] In some embodiments, when the teacher wants to select a student to authorize the handwriting input function, i.e., when the teacher writes a question on the lecture notes, the handwriting input function authorization can be initiated for the student with the handwriting input function to enable the student to participate in the question answering. In a specific implementation, the teacher triggers any first permission control button with handwriting input function control authority displayed in the student list, for example, if the teacher wants to select student A to answer the question, the first permission control button with a white brush pattern displayed on the right side of student A is triggered. If the teacher wants to select student C to answer the question, the first permission control button with a white brush pattern displayed on the right side of student C is triggered.

[0271] After triggering the first permission control button, a handwriting input authorization instruction is generated and sent to the student end display device corresponding to the first permission control button that is triggered. For example, if the teacher triggers the first permission control button corresponding to student A, the handwriting input authorization instruction is sent to the student end display device A used by student A. If the teacher triggers the first permission control button corresponding to student C, the handwriting input authorization instruction is sent to the student end display device C used by student C.

[0272] The live class content displayed in the course content area of the first live interface is the same as the live class content displayed in the course content area of the second live interface, so after the teacher end switches to the lecture notes mode and completes the question arrangement, the course content area of the first live interface synchronously displays the question.

[0273] After a student end display device receives the handwriting input authorization instruction sent by the teacher end display device, the student end display device receives a prompt and displays prompt information in the first live interface, for example, “received brush authorization, can write”. After the student end display device receives the handwriting input function authorization from the teacher, the handwriting input function is enabled, and the student can use the handwriting input function to answer, i.e., through the way of touching the display screen, write in the course content area corresponding position in the first live interface.

[0274] For example, if student end display device A receives the handwriting input authorization instruction sent by the teacher end display device, the handwriting input function of student end display device A is enabled, and student A can use the handwriting input function to write in the course content area. The content written by student A is displayed in the course content area and is synchronously sent to the teacher end display device and the remaining student end display devices, so that the handwriting input interaction content of student A is synchronously displayed on the display devices used by the teacher and students participating in the live class.

[0275] In some embodiments, after the student completes the handwriting input function, the teacher needs to cancel the handwriting input function authorization of the student, at this time, the teacher clicks the first permission control button corresponding to the student in the second live interface again, generates a handwriting input authorization cancellation instruction, and sends it to the student terminal display device. At this time, the first live interface in the student terminal display device displays a pen authorization cancellation prompt, and the prompt information can be "your handwriting input function has been cancelled". After the handwriting input authorization of the student terminal is cancelled, the handwriting input function control of the student terminal is in a non-triggerable state again, and the teacher can continue the subsequent course, or the teacher can continue to use the handwriting input function configured by the teacher to continue to write.

[0276] In some embodiments, if the teacher terminal display device wants to end the handwriting input operation and proceed with the subsequent normal course, the teacher can click the handwriting input function control displayed in the second live interface to end the activation of the handwriting input function of the teacher terminal. After the handwriting input function is cancelled, the teacher can continue the subsequent course.

[0277] In some embodiments, when the teacher shares the handwriting input function with any student, the teacher needs to click the permission control button in the student list displayed in the second live interface. However, since the permission control button includes a button with handwriting input function control permission of the student terminal display device and a button without handwriting input function control permission of the student terminal display device, when the teacher clicks to trigger a certain permission control button, the teacher may make a selection error, that is, the first permission control button should be triggered, but the second permission control button is mistakenly clicked.

[0278] For example, the teacher wants to trigger the first permission control button with handwriting input function control permission of the student terminal display device, but mistakenly triggers the second permission control button without handwriting input function control permission of the student terminal display device. The permission control button with handwriting input function control permission of the student terminal display device can perform a trigger operation, and the permission control button without handwriting input function control permission of the student terminal display device cannot perform a trigger operation.

[0279] Therefore, in order to ensure the normal operation of the handwriting input function authorization of the teacher terminal, when the teacher triggers the second permission control button without handwriting input function control permission of the student terminal display device, an error prompt is popped up in the second live interface, and the prompt content can be "the device used by the student you selected is not configured with handwriting input function". After seeing the error prompt, the teacher can know that the student selected by the teacher cannot use the handwriting input function, that is, cannot answer the question, and needs to select other students with handwriting input function to answer the question.

[0280] In some embodiments, the teacher terminal corresponds to a time limit for each question when the teacher terminal sets the question for the student to answer. For example, if the teacher terminal provides the student with 30 seconds to answer the question, when the teacher terminal selects a student to authorize the handwriting input function, the handwriting input function of the student terminal display device is enabled, and a 30-second countdown control and the corresponding question are displayed in the course content area of the student terminal display device. The student needs to complete the answer within 30 seconds.

[0281] If the student uses the handwriting input function to process beyond the time limit, i.e., the answer time is exceeded, the server automatically withdraws the question, and the handwriting input function authorization obtained by the student terminal is cancelled, so that the student cannot answer the question again. If the student inputs incorrect content or random inputs when using the handwriting input function to answer the question, the teacher terminal triggers the eraser function to erase the student's input. The eraser function can be configured in the second live interface in the form of a control, and the teacher can click to trigger the function. Clicking again cancels the eraser function.

[0282] In some embodiments, when the teacher terminal authorizes the handwriting input function for a student, the teacher terminal display device sends a handwriting input authorization instruction to the student terminal display device through the server. To avoid the situation that the student terminal display device cannot receive the handwriting input authorization instruction due to network communication abnormalities, and the teacher terminal display device cannot know about this situation, causing the live class to temporarily enter a waiting state, a time limit can be added to the handwriting input authorization instruction. If the student terminal display device still does not receive the instruction within the time limit of the instruction, i.e., the time limit of the instruction is invalid, the teacher terminal needs to click the first permission control button corresponding to the student again to resend the handwriting input authorization instruction.

[0283] In some embodiments, after the student terminal completes the handwriting input function operation, the teacher terminal needs to recover the handwriting input function authorization of the student terminal. If the teacher terminal handwriting input function authorization recovery fails due to network communication abnormalities, the teacher terminal display device can report to the server for forced recovery. If the student still writes or draws randomly after completing the answer, the teacher terminal can kick the student out of the live room and disconnect all message transmissions between the student and the live room. If the student wants to continue listening to the class, the student needs to click the first live interface again.

[0284] The functions of forced handwriting input function authorization recovery and forced disconnection of student communication can be configured in the second live interface and displayed in the form of controls. When a function needs to be executed, the teacher can click the corresponding control. When the teacher clicks the forced recovery control or the forced disconnection communication control, the corresponding instruction is sent to the server, and the server executes the received instruction to perform the corresponding operation, such as forced handwriting input function authorization recovery or forced disconnection of student communication.

[0285] It can be seen that the display device provided in the embodiments of the present application obtains the handwriting input function query result sent by each student terminal display device after executing the automatic handwriting input function query when the second program is started. When the handwriting input function query result is that the handwriting input function is possessed, the authority control button with the handwriting input function control authority of the corresponding student terminal display device is displayed on the second live interface. When the handwriting input function query result is that the handwriting input function is not possessed, the authority control button without the handwriting input function control authority of the corresponding student terminal display device is displayed on the second live interface, so that the teacher can select the student with the handwriting input function to participate in sharing the handwriting input function, the handwriting input function of the student terminal can be controlled by the teacher, and the development cost is further reduced.

[0286] Because the developer configures whether the handwriting input capability is started when configuring the display device according to whether the CPU and memory resources of the model meet the use demand and other factors. That is, when the model is a touch screen and the CPU, memory resources and the like meet the demand, the display device is configured with handwriting input capability; and when the model is a normal screen, even if the CPU, memory resources and the like meet the demand, the display device is not configured with handwriting input capability.

[0287] After the developer configures each display device with handwriting input capability and model, the function configuration information is obtained and stored to the server, and the function configuration information of each display device is stored in the server according to the identification information. When the live class is conducted, the first program needs to query the model, handwriting input capability configuration and the like of the device according to the current device capability to the server to determine whether to display the handwriting input function.

[0288] Figure 23 Another flowchart of the control method for automatically displaying the handwriting input function in some embodiments of the present application. Referring to Figure 16 and Figure 23 The embodiments of the present application provide a server, which comprises: a database configured to store function configuration information of a display device; and a controller connected with the database, which is configured to execute the following steps when a student terminal display device executes an automatic handwriting input function query strategy:

[0289] S31, in response to the handwriting input function query instruction sent by the student terminal display device, querying the handwriting input function query result corresponding to the student terminal display device from the database.

[0290] When the first program is started on the student terminal display device, the student terminal display device automatically generates a handwriting input function query instruction to the server to query whether the device has handwriting input function.

[0291] The controller of the server sends the handwriting input function query instruction to the database after receiving the handwriting input function query instruction sent by the student-side display device, to obtain the function configuration information stored by the database, and obtains the handwriting input function query result of the student-side display device based on the function configuration information and the handwriting input function query instruction.

[0292] Since multiple students exist when the live class is conducted, multiple handwriting input function query instructions sent by student-side display devices exist, and the student-side display device obtains the pen capability of the student-side display device based on the unique identifier of the student-side display device, to facilitate distinguishing different student-side display devices and ensuring the accuracy of the handwriting input function query result.

[0293] In some embodiments, when the configuration of the handwriting input function is queried, the controller is further configured to perform the following steps in response to the handwriting input function query instruction sent by the student-side display device:

[0294] Step 311: In response to the handwriting input function query instruction sent by the student-side display device, the student-side display device analyzes the local identifier information of the student-side display device carried in the handwriting input function query instruction.

[0295] Step 312: Based on the local identifier information of the student-side display device, the handwriting input function query result corresponding to the local identifier information is queried in the function configuration information stored in the database.

[0296] To ensure the accuracy of the result query, the handwriting input function query instruction is generated by the student-side display device based on the local identifier information, and the local identifier information is used to identify the model information of the student-side display device. The generation process of the local identifier information can refer to the related content of steps S111 to S114 and steps 1111 to 1112 provided in the foregoing embodiments, which will not be described here.

[0297] To facilitate the server to obtain the handwriting input function query result corresponding to the student-side display device, the handwriting input function query instruction is analyzed by the controller to obtain the local identifier information of the student-side display device carried in the instruction. The local identifier information is the unique identifier of the student-side display device, and the function configuration information stored in the database includes the related function configuration corresponding to the identifier information. Therefore, the handwriting input function query result corresponding to the local identifier information of the student-side display device can be queried in the function configuration information according to the local identifier information.

[0298] The handwriting input function configuration of the display device is related to its model, that is, if it is a touch screen model, the handwriting input function is configured; if it is a normal screen model, the handwriting input function is not configured. Therefore, the controller will obtain two query results when the database is queried based on the local identification information of the student display device.

[0299] If the local identification information of the student display device represents a touch screen model, in the function configuration information stored in the database, the handwriting input function query result corresponding to the local identification information is that the handwriting input function is enabled; if the local identification information of the student display device represents a normal model, in the function configuration information stored in the database, the handwriting input function query result corresponding to the local identification information is that the handwriting input function is not enabled.

[0300] S32, send the handwriting input function query result to the student display device, so that the student display device determines the display result of the handwriting input function control in the first live interface.

[0301] After the server queries the handwriting input function query result corresponding to the student display device in the database according to the handwriting input function query instruction sent by the student display device, the handwriting input function query result is returned to the corresponding student display device. The student display device determines whether the handwriting input function control needs to be displayed in the first live interface according to the handwriting input function query result. If the handwriting input function query result returned by the server is that the local handwriting input function is enabled, the handwriting input function control is displayed in the first live interface. For example, if the handwriting input function query result returned by the server is that the local handwriting input function is not enabled, the handwriting input function control is not displayed in the first live interface. The related process refers to the content of steps S11 to S13 and the related implementation content provided in the foregoing embodiments, which will not be repeated here.

[0302] The student display device also needs to send the handwriting input function query result to the teacher display device, and the teacher display device presents a student list in the second live interface according to the handwriting input function query result sent by each student display device, to display the permission control button of the handwriting input function of the corresponding student display device, and to determine whether each student display device can participate in the shared handwriting input operation by displaying the permission control button in the second live interface. The related process refers to the content of steps S21 to S23 and the related implementation content provided in the foregoing embodiments, which will not be repeated here.

[0303] It can be seen that the embodiments of the present application provide a server. When a first program is started on a student display device, the student display device executes an automatic handwriting input function query strategy and queries the server whether it has handwriting input function. The server returns the handwriting input function query result to the student display device, so that when the handwriting input function is available, the handwriting input function control is displayed on the first live interface; when the handwriting input function is not available, the handwriting input function control is not displayed on the first live interface, so that the first program can be compatible with two different forms of display modes at the same time, and the two live interfaces are compatible with each other, so that one version of the first program can be adapted to all display devices, without the need to develop and maintain multiple versions of the program, thereby reducing the development cost.

[0304] In some embodiments, when a user uses a display device to attend a live class, the live program includes a first program and a second program, the second program is a program configured in the teacher display device, and when the second program is started, a second live interface is displayed in the display; the first program is a program configured in the student display device, and when the first program is started, a first live interface is displayed in the display.

[0305] Different users configure different versions of programs, and the content of the user interface displayed on the display device is different. However, during the live broadcast, in order to keep the live room quiet, whether the teacher or the student will communicate through text chat.

[0306] Figure 24 The schematic diagram of the user interface during the live broadcast in some embodiments of the present application. Referring to Figure 24 When attending a live class, taking the user interface displayed in the display of the student display device as an example, the student user interface displays a first live interface, and the first live interface displays a lecture note area, a student's own video area, a teacher video area, a function area, a discussion area and a student list. The lecture note area is a course content area, and the live picture of this area is consistent with the live picture of the course content area in the teacher live interface, which displays the teacher's shared lecture notes, shared desktop, shared video, etc., and is mainly used to display the content that the teacher wants to present to the students. This area cannot be selected. The teacher video area is used to display the teacher image, and the student can watch the real-time state of the teacher through this area. This area can only be watched, and cannot be selected. The student video area is used to display the student's own image, and the student's own camera picture is displayed in this area. Only watching is allowed, and selection is not allowed.

[0307] The function area is used to realize the interaction function of students in the live class, including the functions of raising hands, handwriting input (brush), discussion and feedback. The students can operate the function area, and each button can be selected and clicked. During the live class, if the student wants to actively answer the teacher's question, the student can trigger the raise hand function control to inform the teacher that he wants to answer the question. The handwriting input function control is used to perform corresponding handwriting input operation according to the authorization of the teacher, for example, adjusting the handwriting input style and erasing, drawing, etc. The handwriting input style includes but is not limited to brush shape, color, thickness, font, etc. When erasing, the student can erase in the touch screen display by using the touch pen matched with the display device, or directly erase in the touch screen display by using the finger. The discussion control can realize real-time text discussion and interaction between the teacher and the students, and between the students. The discussion area function in the second live interface can be referred to. The feedback function control can provide help function to the program platform when the application program abnormally during the live class, such as unable to start the camera, unable to see the live picture, etc.

[0308] The discussion area and the student list are two tabs arranged side by side. After being selected, the tab can be switched. The message list area below the two tabs is used to display the discussion record of the live room or the student list of the live room. When switching to the discussion area tab, the message list area below the discussion area tab presents a list display window, which is used to display real-time text chat messages between students and between students and teachers. When switching to the student list tab, the message list area below the student list tab presents the relevant information of all students participating in the live class.

[0309] In some embodiments, in order to facilitate the generation of text messages between students and teachers, an input box is displayed in the list display window. The input box can be displayed at the bottom of the list display window.

[0310] When it is necessary to switch to the discussion area tab to input text chat messages, the user needs to move on different function controls of the function area by the remote control keys (left key or right key) configured by the display device. When moving to the function control on the last side, continue to press the right key, and the focus selects the discussion area tab.

[0311] If the user presses the left key of the remote control on the discussion area tab, the function area is returned; if the user presses the right key of the remote control on the discussion area tab, the student list tab is switched to; if the user presses the down key of the remote control on the discussion area tab, the content of the discussion area is browsed, that is, the message list presented in the list display window. If the user presses the up key of the remote control on the message list, the discussion area tab is returned.

[0312] In the common message display mode, the latest message is usually displayed at the bottom of the message list. However, if the user triggers the remote control down key from the discussion area tab, the focus will be on the top of the message list, and the latest message cannot be located. When the user wants to view the historical messages in the message list, the up key needs to be pressed to start browsing from the new message at the bottom, which will conflict with the operation of pressing the up key to return to the discussion area tab. It can be seen that the display mode of displaying the message at the bottom of the message list will cause the problem of inconvenience in browsing the historical messages from the new message.

[0313] To meet the browsing habits of users, the display device provided in the embodiments of the present application places the latest message published and received by the user at the top of the historical messages in the message list when displaying the message, so that the focus of the user falls on the new message at the top of the message list when triggering the remote control down key from the discussion area tab, and the new message at the top is pressed by the remote control down key to realize the browsing of the historical messages downwards, which facilitates the key operation of the user. To this end, the newly received message and the historical message need to be reordered before being displayed, so as to ensure that the new message is published at the top of the historical messages, which is more in line with the operation logic of the user using the remote control button and facilitates the user to browse the historical messages.

[0314] Figure 25 Flowchart of the message display method in some embodiments of the present application; Figure 26 To display the new message received by the user at the top of the message list, the display device provided in the embodiments of the present application comprises a display configured to present a user interface displaying a discussion control; and a controller connected with the display, configured to perform the following steps when executing the message display method shown in Figure 25 and Figure 26 The controller is configured to perform the following steps when executing the message display method shown in

[0315] S1, in response to the control start instruction generated when the discussion control is triggered, obtaining the messages generated by all users participating in the live program during the interaction, and generating a list display window in the user interface.

[0316] During the live class, the live interface is presented in the user interface, and the discussion control is displayed in the live interface, such as the discussion area tab in Figure 24 Triggering the discussion control generates a control start instruction to display a list display window in the user interface for displaying the message list.

[0317] In some embodiments, the discussion control can be triggered by triggering the direction keys of the remote controller. For example, if the control focus of the remote controller is on the function area, triggering the right key of the remote controller will move the control focus from the rightmost function control of the function area to the discussion control (discussion tab). If the control focus of the remote controller is on the student list tab or the display position of the information of a student in the student list, triggering the left key of the remote controller will move the control focus to the left to the discussion control. If the control focus of the remote controller is on the display position of a message in the message list, triggering the up key of the remote controller will move the control focus up to the discussion control.

[0318] In any of the above triggering methods, when the control focus is on the discussion control, a control start instruction is generated, and at this time, the list display window needs to be displayed in the message list area to display the text chat messages between the students and the students and the teacher.

[0319] After receiving the control start instruction, the controller needs to obtain all the messages generated by the users participating in the live program during the interaction. The messages generated during the interaction include historical messages generated during the last live broadcast and real-time messages generated during the current live broadcast. Therefore, when obtaining the messages, the controller can obtain the historical messages generated by all the users during the interaction corresponding to the control start instruction generated when the discussion control is triggered when starting the live program last time; and after starting the live program this time, the real-time messages generated by all the users during the interaction when starting the live program this time are obtained.

[0320] S2, sort all the messages according to the generation time of each message, generate a message list, and display the messages with generation time close to the current time at the top of the message list.

[0321] The messages received by the user include the messages sent by himself and the messages generated by the third party. For example, in a live class, the number of students participating in the live class is several, and the users who can generate chat messages can be all the students or the teacher. The chat information generated by the teacher or other students needs to be displayed in the message list of the display device in real time. Similarly, the messages generated by the display device in the local end are also displayed in the message list of the display device in the third end in real time. The method of displaying messages by the display device in the third end is the same as that of the display device in the local end, which is not described here.

[0322] To ensure that the latest message received by the user can be displayed at the top of the message list, all messages need to be sorted in chronological order to generate the message list. The message sorting rule in the message list is to display the messages received from late to early in turn from top to bottom. That is, the closer the generation time of each message to the current time, the closer the position of the message to the top of the message list, and the message closest to the current time is displayed at the top of the message list.

[0323] In some embodiments, the controller, in performing the step of sorting all messages in chronological order according to the generation time of each message to generate the message list, is further configured to perform the following steps:

[0324] Step 21, obtaining the generation time of each message.

[0325] Step 22, sorting all messages in chronological order from adjacent to the current time to away from the current time to obtain a message sequence, and the message closest to the current time is the first message in the message sequence.

[0326] Step 23, generating the message list based on the message sequence, and the first message in the message sequence is located at the top of the message list.

[0327] Each user sends a message corresponding to a sending time, i.e., a generation time. The controller sorts all messages in chronological order according to the generation time to ensure that the latest message received is located at the top of the message list. Therefore, the messages need to be sorted in chronological order from adjacent to the current time to away from the current time to obtain a message sequence. The current time refers to a time later than the generation time of each message, at most the same as the generation time of each message. The current time can be the time when all messages are obtained when starting the discussion control, or the time when a new message is received.

[0328] In the message sequence, the first message is the message closest to the current time, i.e., the latest message received. According to the message list generated based on the message sequence, the first message in the message sequence is located at the top of the message list, i.e., the latest message received is displayed at the top of the message list, and the remaining messages are displayed according to the sorting result.

[0329] Taking the sorting of five messages as an example, the current time is 9:05, the generation time of message 1 is 8:05, the generation time of message 2 is 8:06, the generation time of message 3 is 8:00, the generation time of message 4 is 8:10, and the generation time of message 5 is 7:55. The generation times of the five messages are sorted in chronological order from adjacent to the current time to away from the current time, i.e., 8:10>8:06>8:05>8:00>7:55.

[0330] Based on the sorting result from late to early, the message sequence obtained is message 4>message 2>message 1>message 3>message 5. The first message in the message sequence is message 4, that is, message 4 is displayed at the top of the message list, and the remaining messages are displayed according to the sorting result.

[0331] In some embodiments, the controller is configured to perform the following steps based on the message sequence, generate the message list:

[0332] Step 231, when the total number of messages exceeds the visible number threshold of the message list, grouping all messages in the message sequence according to the number corresponding to the visible number threshold to obtain a plurality of message groups.

[0333] Step 232, based on each message group, generate a corresponding list page, each list page includes a number of display positions corresponding to the visible number threshold, the first display position is located at the top of the list page, and the last display position is located at the bottom of the list page, and the first display position displays the first message in the corresponding message group whose generation time is adjacent to the current time.

[0334] Step 233, generate a message list by a plurality of list pages displaying message groups, and sort the plurality of list pages based on the display order of each message in the corresponding message group.

[0335] Since a student and a teacher will generate a number of messages during a live class, the visible area of the list display window is limited and can only display a certain number of messages. Therefore, when the total number of all messages obtained by the controller exceeds the visible number threshold of the visible area, the messages need to be displayed in pages. The first few list pages display a number of messages corresponding to the visible number threshold, and the last list page displays a number of messages less than or equal to the number corresponding to the visible number threshold.

[0336] The visible area of the list display window is limited, so when the message list including a number of messages is displayed in the list display window, only part of the messages can be displayed. Therefore, the visible number threshold of the messages in the visible message list is the visible number threshold of the list display window.

[0337] When the total number of all messages obtained by the controller exceeds the visible number threshold of the message list, all messages in the message sequence are grouped according to the number corresponding to the visible number threshold to obtain a plurality of message groups. For example, if the total number of all messages included in the message sequence is 53, and the number of the visible number threshold is 5, then the messages 1-5 in the message sequence are grouped into the first group, the messages 6-10 are grouped into the second group, the messages 11-15 are grouped into the third group, and so on, and the messages 51-53 are grouped into the eleventh group. The first ten message groups each include 5 messages, and the last message group (the eleventh group) includes 3 messages.

[0338] Figure 27 A schematic diagram of list paging in some embodiments of the present application. The plurality of message groups obtained are generated into a plurality of list pages, each of which includes a number of display positions corresponding to the visible number threshold, for example, see Figure 27 When the visible number threshold is 5, the list page includes 5 display positions. The display positions are sequentially sorted, the first display position is located at the top of the list page, and the last (fifth) display position is located at the bottom of the list page. The first display position displays the first message (e.g., message 1) in the corresponding message group whose generation time is closest to the current time, and the last display position displays the last message (e.g., message 5) in the corresponding message group whose generation time is farthest from the current time.

[0339] The display order of each list page is the same as the grouping order of each message group, that is, each list page is sorted according to the display order of each message in the corresponding message group, and each message in each message group is sorted according to the generation time from the time closest to the current time to the time farthest from the current time. Then each list page is also sorted according to the generation time of each message from the time closest to the current time to the time farthest from the current time.

[0340] Figure 28 A schematic diagram of the message list in some embodiments of the present application. See Figure 28 The plurality of list pages displaying the message groups are generated into a message list, which includes each message in each list page sorted according to the generation time from the time closest to the current time to the time farthest from the current time. If the total number of all messages included in the message sequence is 53, and the number of the visible number threshold is 5, then the first list page includes the messages 1-5 in the message sequence (the first message group), the second list page includes the messages 6-10 in the message sequence (the second message group), the third list page includes the messages 11-15 in the message sequence (the third message group), and so on, the tenth list page includes the messages 46-50 in the message sequence (the tenth message group), and the eleventh list page includes the messages 51-53 in the message sequence (the eleventh message group).

[0341] Since the messages in the message list are sorted according to the time of generation of each message, and the newly generated new message is located at the first position, when displayed, the newly received new message can be ensured to be displayed at the top of the message list.

[0342] S3, display the message list in the list display window.

[0343] After starting the discussion control, the message list is obtained after sorting according to all the obtained messages, and the message list can be displayed in the list display window, so as to facilitate the user to browse.

[0344] Figure 29 The schematic diagram of the user interface for displaying the message list in some embodiments of the present application is shown. Referring to Figure 29 When the user moves the control focus to the message list displayed in the list display window below the discussion control by triggering the down key of the remote controller, and the control focus is located at the top of the message list. The top of the message list displays the newly received new message (message 1), and the historical messages (messages 2, 3, 4, 5, etc.) are displayed in turn according to the time of generation from late to early, so that the user can continue to trigger the down key of the remote controller to move the control focus down in the message list, and realize browsing the historical messages from the latest message.

[0345] If the current control focus is located at the bottom of the visible area of the message list, if the user wants to browse the messages upward or return to the newly received new message at this time, the user can trigger the up key of the remote controller to move the control focus upward along the message list until the latest message is moved to.

[0346] The message display method adopted by the display device provided in the embodiments of the present application can make the user trigger the down key of the remote controller from the discussion tab, and the focus will fall on the top of the message list and be positioned on the latest message. When the user wants to view the historical messages in the message list, the down key of the remote controller is pressed to start browsing from the top new message. If the user wants to return to the discussion tab, the up key of the remote controller can be triggered. It can be seen that the operation of the user returning to the discussion tab (pressing the up key) and the operation of browsing the historical messages (pressing the down key) will not conflict. Displaying the messages at the top of the message list can facilitate browsing the historical messages from the new message, meet the browsing habit of the user, and improve the user experience.

[0347] In some embodiments, during the live class, each student and teacher participating in the live class can realize text chatting through the discussion tab, so it is necessary to synchronize the newly generated new messages to the other student or teacher end.

[0348] Therefore, when displaying the new message sent by the user himself or the new message sent by other third-end users, the controller is further configured to perform the following steps:

[0349] Step 41, receiving the new message generated when the user inputs in the input box displayed in the list display window.

[0350] Step 42, displaying the new message at the top of the message list, and sending the new message to the server for displaying in the list display window of the third-end device.

[0351] When the user triggers the discussion control through the remote controller, the list display window is presented in the message list area, and the input box is displayed in the list display window, in which the user can input text to generate a new message. The third-end user can also generate a new message through the input box in the user interface displayed in the display device used by the third-end user.

[0352] To realize the information interaction display of each student and the teacher end participating in the live class, taking the reception of the new message in the local end as an example, after receiving the new message, since the generation time of the new message is necessarily later than the existing historical messages in the message list, the new message can be directly displayed at the top of the message list.

[0353] After the user in the local end inputs in the input box to generate a new message, the new message is directly displayed at the top of the message list in the local end, and the new message is sent to the server, which forwards the new message to other third-end devices for display in the list display window of the third-end device, specifically, at the top of the message list in the third-end device.

[0354] When the server forwards the new message in the local end to other third-end devices, the server needs to first judge whether the new message sent by the local end is successful. If there is a poor network or server failure, it will cause the new message sent by the local end to fail, therefore, only when the server detects that the new message sent by the local end is successful, the new message is forwarded to other third-end devices for display.

[0355] In some embodiments, if the server detects that the new message sent by the local end fails, the controller is further configured to perform the following steps:

[0356] Step 51, receiving the failure notification generated by the server when judging that the new message fails to send.

[0357] Step 52, in response to the failure notification, generating a sending failure prompt box, and displaying the sending failure prompt box at one side of the display position of the new message.

[0358] If the server detects that the new message from the local end fails to be sent due to network problems or server failure, etc., the receiving server returns a failure notification, indicating that the new message from the local end cannot be sent to other third end devices for display.

[0359] Figure 30 Interface schematic diagram when the new message sending is abnormal in some embodiments of the present application. Referring to Figure 30 To prompt the abnormal sending of the new message from the local end, a sending failure prompt box can be displayed in the list display window after receiving the failure notification returned by the server, specifically, the sending failure prompt box is displayed on one side of the position of the new message that fails to be sent. The sending failure prompt box can be displayed in the form of an abnormal pattern, for example, the abnormal pattern can use a "red exclamation mark" to represent.

[0360] In some embodiments, since the message list includes multiple list pages, the user can browse historical messages based on the multiple list pages, and if a new message generated by the user from the local end or a new message sent from other third end devices is received during the user's browsing of the historical messages, the position of the historical message browsed by the user in the message list needs to be determined before the new message is displayed.

[0361] Therefore, after receiving the new message, the controller, when performing the step of displaying the new message at the top of the message list, is further configured to perform the following steps:

[0362] Step 421, determining whether the first visible message of the message list is the message displayed at the first display position of the first list page, the first list page refers to the list page located at the first position of the message list.

[0363] Step 422, if yes, displaying the new message at the first display position of the first list page, and moving the previously displayed message in the first list page down by one position for display, and the message at the end of the first list page is scrolled to the first display position of the next list page for display.

[0364] After receiving the new message from the local end, it is first determined whether the first visible message of the current message list is the message displayed at the top of the message list, that is, whether it is the message displayed at the first display position of the first list page, the first visible message refers to the first message that can be seen among the part of the messages displayed in the list display window.

[0365] Since if the user is browsing the history messages based on the order of the list pages, the list page being browsed is in the visual area of the list display window. Therefore, if the first visual message of the message list is the message at the top of the message list, it means that the current user is not browsing the history messages in the message list; if the first visual message of the message list is not the message at the top of the message list, it means that the current user is browsing the history messages in the message list.

[0366] When it is judged that the first visual message of the message list is the message at the top of the message list, at this time, the received new message can be directly displayed at the top of the message list, that is, displayed in the first display position of the first list page. The message originally in the first display position of the first list page is moved down one position as a history message and displayed in the second display position.

[0367] Since only a number of messages corresponding to the visible number threshold can be displayed in each list page, after the new message is displayed in the first list page, the total number of messages in the first list page exceeds the visible number threshold, at this time, the message originally in the last display position of the first list page is moved to the next list page for display, specifically, moved to the first display position of the second list page for display. The message in the last display position of the second list page is moved to the next list page for display, and so on, the history messages in the message list are all moved down one position for display.

[0368] Figure 31 The schematic diagram of displaying a new message in the message list in some embodiments of the present application. Referring to Figure 31 For example, if the messages 1, 2, 3, 4, and 5 are displayed in the first list page in the order of the display positions, and the messages 6, 7, 8, 9, and 10 are displayed in the second list page in the order of the display positions. If a new message is received at this time, the new message is displayed in the first display position of the first list page, that is, the display position of the original message 1. The message 1 originally in the first display position of the first list page is moved down one position as a history message and displayed in the second display position; and so on, the message 5 originally displayed in the last display position of the first list page is displayed in the first display position of the second list page. The remaining messages are displayed in the same way, please refer to the content shown in Figure 31 , which will not be described here.

[0369] In some embodiments, when it is judged that the first visual message of the message list is not the message at the top of the message list, it means that the user is browsing the history messages at this time, at this time, the controller is further configured to perform the following steps:

[0370] Step 423, if the first visible message in the message list is not the message displayed in the first display position of the first list page, display the new message in the first display position of the first list page in the background, and generate a new message prompt interface.

[0371] Step 424, display the new message prompt interface in the list display window.

[0372] When the local display device receives a new message (a message sent by itself or a message sent by a third device), and it is determined that the first visible message in the message list is not the message at the top of the message list, it indicates that the user is currently browsing historical messages in other list pages. To avoid affecting the user's browsing process of historical messages, the new message is only displayed in the first display position of the first list page in the background, and the message list is not scrolled to the top, i.e., the message list is maintained in its current state.

[0373] After displaying the new message, to remind the user to view the new message in time, a new message prompt interface is generated in the background when the new message is displayed, and the new message prompt interface is displayed in the list display window.

[0374] Figure 32 The interface schematic diagram of the message list in some embodiments of the present application displays a new message prompt interface. Referring to Figure 32 When the new message prompt interface is displayed, it can be displayed at the bottom of the list display window, specifically at the bottom of the currently browsed list page, to avoid blocking the information in the currently browsed list page. The content of the new message prompt information can be generated based on the number of new messages received by the local device. If multiple new messages are received by the local device during the user's browsing of historical messages, a prompt information containing the number of new messages can be generated accordingly. For example, the new message prompt interface presents new message prompt information, and the information content can be "You have received X new messages".

[0375] In some embodiments, if the message list displays a plurality of information in the form of a plurality of list pages, the user can browse each piece of information in the message list in the form of page browsing. At this time, the controller is further configured to:

[0376] Step 61, in response to a downward browsing instruction of any message in the message list generated by the user based on the discussion control, moving the control focus from the discussion control to the first display position of the first list page in the message list.

[0377] Step 62, when the control focus moves to the last display position of the first list page, generating a loading state prompt box, and displaying the loading state prompt box at the bottom of the first list page.

[0378] After a user wants to activate the discussion control and display the message list in the list display window, if the user wants to browse the historical messages in the message list, they can trigger the down button on the remote control to generate a down browsing command. The controller responds to the down browsing command and moves the control focus from the discussion control to the top of the message list, that is, to the first display position of the first list page in the message list.

[0379] If the user wants to continue browsing other historical messages, they can repeatedly press the down button on the remote control to move the control focus down the currently viewed list page.

[0380] When the control focus moves to the end of the currently viewed list page, it indicates that the user has viewed the last message in the current list page. Therefore, to prompt the user to continue to the next list page, a loading status prompt box can be displayed at the bottom of the currently viewed list page.

[0381] Figure 33 This application includes schematic diagrams illustrating the interface displaying a loading status prompt in the message list in some embodiments. See also... Figure 33 In (a), when a user navigates to the last message of the currently viewed list page by pressing the down button on the remote control, for example, when browsing to the message displayed at the end of the first list page, a loading status prompt box can be automatically displayed at the bottom of the message, and the prompt message in the loading status prompt box can be "Loading...".

[0382] In some embodiments, when browsing history messages in pages, the controller is further configured to perform the following steps:

[0383] Step 63: In response to the system notification generated when the loading status prompt is generated, retrieve the messages from the second list page of the message list.

[0384] Step 64: When the display duration of the loading status prompt box reaches the preset time threshold, display the messages in the second list page at the bottom of the first list page.

[0385] After browsing the messages in the current list page, a loading status indicator is displayed simultaneously. To retrieve messages from the next list page, a system notification can be generated at the same time as the loading status indicator. Upon receiving the system notification, the controller can retrieve messages from the next list page in the message list. For example, if the currently viewed list page is the first list page, then messages from the second list page are retrieved; if the currently viewed list page is the second list page, then messages from the third list page are retrieved.

[0386] A time threshold is set for the display duration of the loading status prompt box, and the messages in the next list page need to be acquired within the time threshold. When the display duration of the loading status prompt box reaches the preset time threshold, the acquired messages in the next list page are displayed at the bottom of the currently browsed list page, for example, the messages in the second list page are displayed at the bottom of the first list page, and meanwhile, the display of the loading status prompt box is cancelled.

[0387] Referring to Figure 33 In (b), when the messages in the second list page are displayed, each message in the second list page is displayed in a continuous state below the last message in the first list page, for example, the message 6 in the first display position in the second list page is displayed below the message 5 in the last display position in the first list page, and the other messages are displayed in turn.

[0388] When the historical messages are browsed in pages, if the down key is triggered again after the last message in the current list page is browsed (the control focus is located on the message), the messages in the next list page are acquired automatically, and the user can trigger the down key of the remote controller to continue moving the control focus downward, so that the user can browse the earlier chat records.

[0389] In some embodiments, during the browsing of the historical messages by the user, if the user browses the messages in the subsequent list pages, when the user wants to exit the browsing of the historical messages and return to the discussion control (discussion area tab) or view the newly received new messages, generally, the messages are browsed upward, and the up key of the remote controller can be triggered to achieve this. However, when the browsed messages are more, the up key of the remote controller cannot be continuously pressed to return to the previous message, which is low in efficiency. Therefore, to quickly return to the discussion control, the controller is further configured to perform the following steps:

[0390] Step 71: When the control focus is located on any display position in the message list, a return instruction generated by the user triggering the return key is received.

[0391] Step 72: In response to the return instruction, the control focus is moved from any display position in the message list to the discussion control, and the messages in the first list page of the message list are displayed in the list display window, and the first visible message in the list display window is the message in the first display position of the first list page.

[0392] During the browsing of the historical messages by the user, when the user wants to quickly return to the discussion control or wants to view the newly received new messages, the return key of the remote controller can be triggered to generate a return instruction.

[0393] Figure 34 The business flowchart of the message display method in some embodiments of the present application. Referring to Figure 34, the controller receives the return instruction, the control focus originally located at the display position of the message browsed can be moved to the discussion control. Meanwhile, the message list is automatically scrolled to the top, i.e. the messages of the first list page of the message list are displayed in the list display window, and the first visible message of the list display window is the message at the first display position of the first list page.

[0394] In some embodiments, since the user can use the remote controller to switch the control focus between the clickable controls in the live interface presented in the user interface, to facilitate the user to directly view the newly received new message when the control focus is switched to the discussion control, the message list can also be automatically scrolled to the top. In this process, the controller is further configured to perform the following steps:

[0395] Step 81, receiving a switching instruction generated when the user switches from other controls to the discussion control.

[0396] Step 82, in response to the switching instruction, moving the control focus from the other controls to the discussion control, and displaying the messages of the first list page of the message list in the list display window, and the first visible message of the list display window is the message at the first display position of the first list page.

[0397] The other controls in the user interface include the student list tab and each function control in the display function area. When the user triggers the remote controller to switch from the above-mentioned controls to the discussion area control, the switching instruction is generated to move the control focus from the other controls to the discussion control.

[0398] For example, referring again to Figure 32 When switching from the function area to the discussion control, the user needs to move the different function controls in the function area by the remote controller keys (left key or right key), and when moving to the function control at the last side, continue to press the right key, the control focus selects the discussion area tab, and the switching instruction is generated at the same time. When switching from the student list tab to the discussion area tab, the user can trigger the left key of the remote controller to generate the switching instruction, and at the same time, the control focus is switched from the student list tab to the discussion area tab.

[0399] After the controller receives the switching instruction, the control focus originally located at the other controls can be moved to the discussion control. Meanwhile, to facilitate the user to view the latest message, the message list is automatically scrolled to the top, i.e. the messages of the first list page of the message list are displayed in the list display window, and the first visible message of the list display window is the message at the first display position of the first list page.

[0400] It can be seen that the display device provided in the embodiments of the present application can display the new message at the top of the message list when the new message is received, and can automatically scroll the message list to the top when the user switches from other controls to the discussion control by using the direction keys of the remote controller. In addition, when browsing the historical messages, the message list can be automatically scrolled to the top when the return key is triggered while the control focus is located at the display position of any message. When displaying the messages, the new message can be ensured to be always displayed at the top of the message list, so that the user can view the newly received new message in time when browsing the historical messages, and the operation of switching between the controls in the user interface does not conflict with the browsing of the historical messages, thereby facilitating the user to browse the messages.

[0401] Figure 25 The flowchart of the message display method in some embodiments of the present application. Referring to Figure 25 The present application also provides a message display method, which is executed by the controller in the display device provided in the foregoing embodiments, and the method comprises the following steps:

[0402] S1, in response to the control starting instruction generated when the discussion control is triggered, acquiring the messages generated by all users participating in the live program when interacting, and generating a list display window in the user interface;

[0403] S2, sorting all the messages according to the generation time of each message, generating a message list, and displaying the message with a generation time close to the current time at the top of the message list;

[0404] S3, displaying the message list in the list display window.

[0405] According to the above technical solution, the message display method and the display device provided in the embodiments of the present application acquire the messages generated by all users participating in the live program when interacting when the discussion control is triggered, sort all the messages according to the generation time of each message, generate a message list, and display the message list in the list display window, so that the latest received message is displayed at the top of the message list. It can be seen that the method and the display device provided in the embodiments of the present application sort all the messages according to the generation time from late to early, and place the latest message at the top of the message list, so that the control focus falls on the new message at the top of the message list when the user triggers the down key of the remote controller from the discussion control, and the browsing of the historical messages starts from the new message at the top, which is more in line with the operation logic of the user using the keys of the remote controller, thereby facilitating the user to browse the historical messages.

[0406] In some embodiments, in order to conduct online live teaching, a live class application program can be configured in the display device. The teacher end display device and the student end display device are respectively configured with respective live class application programs, and the teacher and each student can log in to the application program to enter the live room and implement the live teaching process of the target live class.

[0407] In order to enable the students to review the live class content after the end of the live class, the teaching process of the teacher and each student usually needs to be recorded to generate a review video file for the students to review.

[0408] The common recording method is to use screen recording to record all the content in the live class process, and the students directly play the video file when reviewing. However, when reviewing later, all students see the same content, which lacks personalization, while actually in the live class, student A answers the teacher's questions, and student B does not answer the teacher's questions, so the courses experienced by student A and student B are different. In addition, when all students review, they can only passively watch, lack of interactivity, and cannot attract students to pay full attention to the video file, resulting in poor student experience.

[0409] Therefore, in this application scenario, the live class review method is proposed, which can restore the scene of online live class during the live class review process, so that the students can experience the live class process again, and improve the students' attention. In addition, during the review, the students can also participate in the review live class, realize some interaction, and improve the user experience.

[0410] Figure 35 The live class application scenario in some embodiments of the present application is shown. Referring to Figure 35 In the same live class process, there will be at least one teacher and at least one student, each teacher and each student uses their respective display devices to participate in the live class process, such as teacher A1, teacher A2, … teacher AN, student B1, student B2, student BN. To realize the live class, the teacher and the student use their respective display devices, install the live class application program in each display device, and log in to their respective accounts to obtain the teacher end display device 201 and the student end display device 202.

[0411] The teacher end display device 201 and the student end display device 202 are respectively connected with the business server 500 and the live server 600, and when implementing the live class review method, the teaching content during the live class needs to be recorded, that is, the business server obtains the interaction data of each teacher end display device 201 and each student end display device 202, and the database 501 in the business server 500 is configured to store the interaction data obtained by the business server; the live server 600 realizes the online live class of the teacher and the student and records the live class content.

[0412] To ensure that the student can interact in real time when reviewing the video file recorded in the live class, on the one hand, the business server is used to store the interaction data generated by the teacher and the student in the live class, and the live server is used to record the live class picture to form a video file; on the other hand, when reviewing, the video file is played, and based on the interaction identifier, the interaction data generated by the teacher and the interaction data generated by the student are displayed correspondingly, to realize the real-time interaction of the student when reviewing the video file.

[0413] Therefore, when the live class recording process is performed, the server provided by the embodiments of the present application is applied to the business server, to ensure that the student can interact in real time when reviewing the video file, and when recording, the live class picture and the interaction data need to be stored separately, that is, only the content of the teacher's teaching is recorded, and the interaction data of the teacher and the student is stored in the database of the business server based on the time axis of the live class. The interaction data includes the interaction data generated by the teacher and the interaction data generated by the student.

[0414] Figure 36 The flowchart of the live class recording method in some embodiments of the present application; Figure 37 The interaction flowchart of the live class recording method in some embodiments of the present application. Referring to Figure 36 and Figure 37 The server provided by the embodiments of the present application includes a database and a controller. The database is configured to store student interaction data, teacher interaction data and video file information. The controller is connected with the database, and when the live class recording method is executed, the controller is configured to execute the following steps:

[0415] S11A, after the live server responds to the live class start recording instruction generated by the teacher end display device, the teacher interaction data generated by the teacher end display device in the live class process is acquired.

[0416] The teacher end display device enters the live room of the live class, and the display of the teacher end display device presents the teacher end live class interface.

[0417] Figure 38 The display schematic diagram of the teacher end live class interface in some embodiments of the present application. Referring to Figure 38 When the live class starts, the teacher end live class interface displays a course content area, a student video area, a teacher video area and a live information display area, which can realize three-split screen teaching. The student video area is used to display the student image, and the teacher video area is used to display the teacher image. The student image and the teacher image are configured by the camera of the display device used by them (such as Figure 3The image is captured using an image capture device. The course content area displays the live stream, and below it is the main function area, used to switch between handouts, whiteboard, and video functions. Below the main function area are the live stream operation buttons and team competition status. The live stream operation buttons include a drawing tool, start live stream (which switches to pause live stream after starting), and end live stream. To improve the teaching effect, before the live stream, the teacher can divide the students participating in the live class into two teams, such as the Tiger Team and the Woof Woof Team. Students accumulate points by answering questions during the class. At the end of the class, the team with the higher score will receive a corresponding reward. The team competition status is displayed in real time, showing the scores of the two teams.

[0418] The live class information display area on the teacher's side of the live class interface provides information about the current live class, including a discussion area, a student list, and in-class exercises. The discussion area allows for real-time text (or voice) discussion and interaction between the teacher and students, and among students themselves, during the live class. The student list displays the number of students attending the current live class and their information. The in-class exercises allow teachers to create questions online in real-time. During the live class, teachers can create questions through the in-class exercises and push them to students' devices, where students can answer them using their respective display devices.

[0419] Figure 39 This application includes schematic diagrams illustrating the display of the student-side live class interface in some embodiments. See also... Figure 39 When the live class begins, the student's display device also enters the live room, and the student's live class interface is displayed on the student's screen. The student's live class interface displays the course content area, student video area, teacher video area, function area, and team competition status. The live class screen in the course content area is consistent with the live class screen in the teacher's live class interface. The teacher's video area displays the teacher's image, and the student video area displays the student's image. When multiple students are attending the live class simultaneously, the student video area displays multiple student images. If the teacher connects with one student during the live class, the image of that student is displayed in the course content area.

[0420] The function area is used to realize the interaction function of students in the live class, including microphone, camera, hand raising, brush and discussion function controls. In the live class, if a student wants to actively answer the teacher's question, he can trigger the hand raising function control to inform the teacher that he wants to answer the question; the microphone control is used to realize the opening and closing of the voice. The camera control is used to control whether to collect the image of the student. The brush function control is used to perform corresponding brush operation according to the authorization of the teacher, for example, adjusting the brush style and writing, drawing, etc. The brush style includes but is not limited to brush shape, color, thickness, font, etc. When writing, the student can write in the touch screen display by using the touch pen matched with the display device, or directly write with the finger in the touch screen display. The discussion control can realize the real-time text discussion and interaction between the teacher and the students, and between the students, which can refer to the discussion area function in the teacher end live class interface. The team comparison situation displayed by the student end is used to display the team joined by the student and the team score, the size of the name of the team to which the student belongs is larger than that of the other team, as shown in Figure 39

[0421] After the teacher and the student enter the live room corresponding to the live class, the teacher clicks the start live button in the teacher end live class interface presented in the teacher end display device to start the class, and generates a live class start recording instruction, which is sent to the live server. The live server is used to realize the live class of the live class, and the course content area in the live class interface of the teacher end display device displays the live class picture.

[0422] Figure 40 The schematic diagram of recording the live class in some embodiments of the application. After receiving the live class start recording instruction, the live server starts recording the video data, which includes the live class picture, the teacher image displayed in the teacher video area and the voice data of the teacher and the student, as shown in the two boxes in Figure 40 The live class picture displayed in the course content area and the teacher image displayed in the teacher video area. If the teacher and one of the students are in the mic state during the live class, the course content area displays the image of the student. At this time, the live class picture includes the course content and the mic student image. At the same time, the live server pushes the live class picture to each student end display device. At this time, the display content of the live class picture in the teacher end display device is the same as that in the student end display device.

[0423] ​After the live class begins, the teacher will generate interactive data in real time. For example, based on the content of the live class, the teacher will ask different questions for students to answer. Interactive buttons will be displayed in the corresponding live room on the teacher's device, such as the "In-Class Practice" button shown in the live information display area. Clicking the "In-Class Practice" button (interactive button) allows the teacher to create questions and generate interactive information. This interactive information includes the interaction number, interaction content, interaction options, and the correct answer. The interaction number indicates the question number created by the teacher, the interaction content indicates the question type, the interaction options indicate the alternative answers, and the correct answer indicates the correct answer.

[0424] Figure 41 This application includes schematic diagrams of the in-class practice interface in some embodiments. See also... Figure 41 The teacher clicks the "In-Class Practice" button to enter the In-Class Practice interface. On this interface, the teacher sets the interaction sequence number (question number), interaction content (question), interaction options (answer choices), and correct result (correct answer). Then, clicking the "Create Question" button completes one interaction action (question creation). The interaction content specifies the question stem and question type, including multiple choice, true / false, etc. After responding to the question creation command (interaction command) triggered by the "Create Question" button, the teacher's display device sends the teacher's interaction information to the business server for storage. Each interaction generates teacher interaction data; for example, each time the teacher creates a question, a set of teacher interaction data containing the teacher's interaction information is generated.

[0425] Teachers can set the display time for each question during the question-setting stage, which is the time students have to answer the questions; teachers can also manually end the question-answering process, for example, by clicking [the button] after all students in the live class have finished answering the questions or most of them have answered the questions. Figure 41 The "End Answering" button shown indicates the end of the question-answering process; students will no longer be able to answer questions after this step. The timer area displayed on the in-class practice interface shows the current answering time. This answering time refers to the duration from when the teacher clicks the "Present Question" button to when the student clicks the "End Answering" button, or it refers to the display time set by the teacher for each question.

[0426] The business server monitors the instructions from the teacher's display device in real time. If it detects a question-generating instruction (interaction instruction) from the teacher's display device, it means the teacher clicked the "In-Class Practice" button and completed a question-generating action. The server then acquires the teacher interaction data generated by the teacher's display device. During a live class, the teacher will perform multiple interaction actions, generating multiple questions, thus producing multiple sets of teacher interaction data.

[0427] S12A: Send the teacher's interactive data to the student's display device for display.

[0428] The teacher performs an interactive action after completing a question, and the business server sends the teacher interactive data to the student display device for display. If multiple students participate in the live class, the teacher interactive data is displayed on each student display device.

[0429] Figure 42 The application provides a schematic diagram of a teacher interactive data interface displayed on a student display device. Referring to FIG. 8, the teacher interactive data interface includes an interactive serial number, interactive content, interactive options, and a submit button. Figure 42 In some embodiments, after the student display device receives the teacher interactive data sent by the teacher display device, the student display device generates an interactive interface based on the teacher interactive data. The interactive interface displays the interactive serial number, interactive content, and interactive options in the teacher interactive data, and displays a submit button. The correct result of the interaction is not displayed during the question stage, but is displayed after the student completes the answer. The interactive interface is displayed in a floating window on the upper layer of the course content area. The student can click any interactive option displayed in the interactive interface using a stylus, remote control, or finger. After the selection is completed, the student clicks the submit button to complete the current student interaction.

[0430] For example, the interactive interface displays an interactive serial number “8”, interactive content “question and multiple-choice question”, interactive options “ABCD”, and a submit button. Each interactive option is in a triggerable state, and the submit button is schematically arranged on the right side of the interactive options.

[0431] S13A, obtaining student interactive data generated by the student display device based on the teacher interactive data, and video file information sent by the live server. The video file information is the information of the file generated by the live server in response to the live class end recording instruction generated by the teacher display device.

[0432] After the business server pushes the teacher interactive data generated by the teacher to the student display device, each corresponding student can interact according to the teacher interactive data displayed in the interactive interface of the display device used by each student, that is, according to the question and the interactive options, the student clicks one of the interactive options that the student believes matches the question as an answer. After the student clicks one of the interactive options, the student clicks the submit button to generate student interactive data. The student interactive data includes the content of at least one interactive option clicked by the student, that is, the answer to the student's answer.

[0433] Each time the student clicks the submit button based on one teacher interactive data, it is an interaction, and corresponding student interactive data is generated. The time of the interaction is the generation time point of the student interactive data. The student interactive data, the corresponding generation time point, and the student ID are sent to the business server for storage.

[0434] The live class picture is displayed in the live room of the student terminal display device. After receiving the teacher interaction data sent by the service server, an interaction interface is generated based on the teacher interaction data and displayed on the upper layer of the live class picture. Referring again to Figure 42 As shown, the student interacts based on the teacher interaction information displayed in the interaction interface. If the current student triggers the interaction option A based on the question with the interaction number "8" and then clicks the submit button, student interaction data is generated. At this time, the student interaction data is the content corresponding to the interaction option A.

[0435] During the live class, the teacher generates multiple teacher interaction data and sequentially pushes it to the student terminal display device by the service server according to the time sequence. The student generates multiple student interaction data according to the teacher interaction data presented in the interaction interface displayed on the display device used by the student.

[0436] At the end of the live class, the teacher clicks the end live button (which can be located at the bottom of the live class picture) displayed in the live room to generate a live class end recording instruction to the live server, closes the live room of the live class, and the live class recording ends. At this time, the live class is in an ended state but cannot be reviewed.

[0437] The live server generates a video file in response to the live class end recording instruction based on the live class picture, the teacher image in the teacher video area, and the voice information of the teacher and the student during the live class. The live server generates video file information based on the video file and sends it to the service server. The video file information includes a video file review address and a video file timeline. The video file review address is a URL address that can be used to access the video file. The video file timeline represents the video duration of the video file. The video file timeline is the same as the timeline of the live class.

[0438] After the live server processes the video file and returns to the service server, the service server can modify the course state of the live class to a reviewable state to facilitate the student to click to review. At the same time, a review button can be displayed in the live class display interface to facilitate the student to trigger to review the video file.

[0439] Figure 43 Some embodiments of the student terminal live class display interface display schematic diagram. Referring to Figure 43After the live class is completed, the student terminal display device returns to the live class display interface, and the live class display interface presents a date selection area and a list of live classes that the student has completed or will attend. The date selection area is used to display dates, and each date corresponds to a list of live classes that exist on that day. Each live class in the live class list corresponds to a live class status, including but not limited to a live status, a live soon status, and a watchable status. After completing a live class, a watch button, such as “Watch Replay”, is displayed on the right side of the corresponding live class to modify the course status of the live class to a watchable status. When a student wants to watch a live class later, the student can click the watch button to enter a live class replay interface to watch the live class.

[0440] S14A, the teacher interaction data, the student interaction data, and the video file information are sent to the database for storage.

[0441] To facilitate subsequent real-time interaction of students based on video files when watching live classes, the business server needs to store the interaction data and video file information separately and store them in the database. When storing, the live class ID during the live class can be used as a storage identifier, and the interaction data and video file information are stored after establishing a corresponding relationship with the live class ID, so that the interaction data and video file information can be accurately retrieved based on the live class ID later.

[0442] In some embodiments, the controller in the business server, when performing the step of sending the teacher interaction data to the database for storage, is further configured to perform the following steps:

[0443] Step 1411, obtaining the live class ID and the live class timeline of the live class, and the start time, the duration, and the teacher interaction information generated by the teacher terminal display device when performing each interaction action. The interaction action refers to an action generated by the teacher terminal display device based on an interaction button displayed on the live class screen. The live class screen refers to a screen displayed by the teacher terminal display device after generating a live class start recording instruction.

[0444] Step 1412, generating teacher interaction data corresponding to each interaction action based on the start time, the duration, and the teacher interaction information corresponding to each interaction action.

[0445] Step 1413, adding a teacher interaction identifier on the live class timeline based on the time correspondence between the live class timeline and the start time of each interaction action.

[0446] Step 1414, creating a correspondence between each teacher interaction data, the live class ID, the teacher interaction identifier, and the live class timeline, and storing the correspondence in the database.

[0447] Since the teacher will perform multiple interaction actions in the process of the live class, multiple corresponding teacher interaction data are generated. Therefore, in order to ensure that the teacher interaction data is displayed in correspondence with the live class timeline, the multiple teacher interaction data need to be taken as the benchmark of the live class timeline, that is, the teacher interaction identifier is added on the live class timeline, and the teacher interaction identifier is added in turn according to the time sequence of each interaction action. When stored, each teacher interaction data is also stored in turn according to the time sequence. The teacher interaction identifier is used to represent that the teacher interaction data exists at the current time of the live class timeline.

[0448] The live class ID and the live class timeline of the live class are obtained. The live class ID is used to represent the name or serial number of the live class conducted by the teacher and the student, so as to distinguish it from other live classes. The live class timeline is used to represent the duration of the live class.

[0449] The live class picture is displayed in the live room interface with an interaction button (class practice button). The teacher clicks the interaction button once, completes the setting of the corresponding interaction information, and then performs an interaction action. The teacher performs an interaction action each time, which generates corresponding start time, duration and teacher interaction information, and adds a teacher interaction identifier on the live class timeline at the time corresponding to the start time. The interaction action is a question setting action. The start time is used to represent the time point of generating the question, that is, the time point of clicking the question setting button. The duration is used to represent the display duration of the question. The teacher interaction information is the question information set by the teacher. The teacher interaction information refers to the interaction serial number, interaction content, interaction option and interaction correct result generated by the teacher display device. The start time, duration and teacher interaction information corresponding to each interaction action are the teacher interaction data generated corresponding to the interaction action.

[0450] The start time of each interaction action is corresponded to the time on the live class timeline. For example, if the start time of the interaction action 1 is 0:23:28 and the duration is 5 seconds, the teacher interaction identifier 1 is added at 23:28 on the live class timeline to establish the association with the teacher interaction data generated by the interaction action 1, and the display duration of the teacher interaction data is set to 5 seconds. If the start time of the interaction action 2 is 0:35:50 and the duration is 6 seconds, the teacher interaction identifier 2 is added at 35:50 on the live class timeline to correspond to the teacher interaction data generated by the interaction action 2, and the display duration of the teacher interaction data is set to 6 seconds.

[0451] Based on this, the corresponding relationship between each interaction action and the time of the live class timeline is taken as the association benchmark, the corresponding each teacher interaction data, the live class ID, each teacher interaction identifier and the live class timeline are established in correspondence, and the corresponding relationship is stored in the database.

[0452] In some embodiments, the teacher generates a corresponding relationship each time an interactive action is performed. A plurality of interactive actions generated during the live class can be stored in the server in unison after the live class ends, or can be stored in the server immediately after each corresponding relationship is generated. That is, the process of storing the corresponding relationship can occur after the live class ends, and the process of storing the corresponding relationship in the database can also occur after the server receives the teacher interaction data from the teacher display device, that is, the server sends the data to the database for storage after receiving the teacher interaction data, and then pushes the teacher interaction data to each student display device for display. The specific storage process can be determined according to actual application, and is not limited here.

[0453] In some embodiments, the controller in the server, when performing the step of sending the student interaction data to the database for storage, is further configured to perform the following steps:

[0454] Step 1421: obtaining the live class ID and live class timeline of the live class, and the student ID corresponding to each student display device, each student interaction data, and the time point of generation of each student interaction data.

[0455] Step 1422: requesting the stored teacher interaction information from the database, wherein the teacher interaction information refers to the information generated by the teacher display device when each interactive action is performed.

[0456] Step 1423: determining the interaction result of each student interaction data based on the teacher interaction information and each student interaction data.

[0457] Step 1424: adding a student interaction mark on the live class timeline based on the time corresponding relationship between the live class timeline and the time point of generation of each student interaction data.

[0458] Step 1425: establishing a corresponding relationship between each student ID, each student interaction data, the interaction result corresponding to each student interaction data, the time point of generation of each student interaction data, each student interaction mark, the live class ID, and the live class timeline, and storing the corresponding relationship in the database.

[0459] Each student generates a student interaction data based on a teacher interaction data, and therefore, to ensure that the student interaction data is displayed in correspondence with the live class timeline, a plurality of student interaction data is added to the live class timeline as a basis, that is, a student interaction mark is added to the live class timeline in time sequence according to the time point of generation of each student interaction data. When storing, each student interaction data is also stored in time sequence. The student interaction mark is used to represent that there is student interaction data at the current time of the live class timeline.

[0460] Obtain each student ID, the student ID belongs to the student generated by the student interaction data and the generation time point of each student interaction data, and the student ID is used to distinguish all students in the live room for live class, such as student B1, student B2, student BN, etc. The same student will generate multiple student interaction data, and the number of student interaction data is the same as the number of teacher interaction data.

[0461] Figure 44 In some embodiments of the present application, the student interaction data is compared. Referring to Figure 44 , if the teacher interaction data is m, the student interaction data generated by each student is m, for example, student B1 generates m student interaction data, student B2 generates m student interaction data, and student BN generates m student interaction data.

[0462] For the same student, the time point of the multiple student interaction data generated by the student corresponds to the generation time point of the teacher interaction data, so the generation time point of each student interaction data needs to be obtained, that is, the time corresponding to the time when the student selects a certain interaction option and clicks the submit button. For example, the m student interaction data generated by student B1 corresponds to the generation time points t1 B1 , t2 B1 ……tm B1 . The m student interaction data generated by student B2 corresponds to the generation time points t1 B2 , t2 B2 ……tm B2 . The m student interaction data generated by student BN corresponds to the generation time points t1 BN , t2 BN ……tm BN .

[0463] The business server stores the student interaction data, and also needs to judge the correctness of the student interaction data and store the judgment result. The information for judging correctness is stored in the database, so the business server needs to obtain the interaction information from the server, and the interaction information includes the correct interaction result. The business server judges the correctness of a certain student interaction data and the correct interaction result to obtain the corresponding interaction result, which can be "correct" or "incorrect and provide the correct answer".

[0464] Correspond the generation time point of each student interaction data to the time on the live class timeline, and add a student interaction identifier, for example, if the generation time point t1 B1 of student B1's student interaction data S1 B1 is 0:23:30, then add student interaction identifier M1 B1, to associate with the student interaction data S1 B1 is established; if the generation time point t2 B1 of the student interaction data S2 B1 of the student B1 is 0:35:55, the student interaction mark M2 B1 is added at 35:55 on the live class timeline to associate with the student interaction data S2 B1 .

[0465] Based on this, the time corresponding relationship between each student interaction data corresponding to each student and the live class timeline is taken as the association reference, the corresponding relationship between each student ID, each student interaction data, the interaction result corresponding to each student interaction data, the generation time point of each student interaction data, each student interaction mark, the live class ID and the live class timeline is established, and the corresponding relationship is stored to the database. One student corresponds to several corresponding relationships, and one corresponding relationship includes the student ID, one student interaction data, one generation time point, one interaction result, one student interaction mark, the live class ID and the live class timeline.

[0466] For example, the corresponding relationship L1 B1 generated by the student B1 includes the student B1, the student interaction data S1 B1 , the generation time point t1 B1 , the interaction result P1 B1 , the student interaction mark M1 B1 , the live class ID and the live class timeline; the corresponding relationship L2 B1 includes the student B1, the student interaction data S2 B1 , the generation time point t1 B2 , the interaction result P2 B1 , the student interaction mark M2 B1 , the live class ID and the live class timeline, and other students are similar, and specific contents can be referred to Figure 44 .

[0467] In some embodiments, the controller in the business server is further configured to: send the interaction result of each student interaction data to the corresponding student end display device, and display the corresponding interaction result by each student end display device.

[0468] After each student generates student interaction data, that is, answers a question, the student needs to know the correctness of the answer, therefore, the business server needs to return the interaction result generated by the student to the corresponding student end display device and display it in the live class picture to inform the student of the answer result. The interaction result includes the answer correctness result and the interaction correctness result, for example, the answer correctness result includes “correct” and “incorrect”, and the interaction correctness result is the correct answer.

[0469] In some embodiments, the video file information includes a video file review address and a video file timeline; and the controller in the service server, in performing the step of sending the video file information to the database for storage, is further configured to perform the following steps:

[0470] Step 1431, obtaining a live class ID of the live class and a teacher ID corresponding to the teacher-side display device.

[0471] Step 1432, generating, based on the teacher ID, the video file review address and the video file timeline, video file information of the live class corresponding to the live class ID.

[0472] Step 1433, storing the video file information corresponding to the live class ID to the database.

[0473] After the live server generates the video file, the live server sends the video file information to the service server. The service server does not directly store the video file to avoid occupying too much space, but instead stores the video file information. When it is necessary to access the video file, the service server can access the video file based on the video file review address.

[0474] Therefore, when storing the video file information to the database, the live class ID and the teacher ID are respectively matched with the video file information, so that the corresponding video file information can be obtained according to the live class ID and the teacher ID during subsequent review. The teacher ID, the video file review address and the video file timeline are used to generate the video file information of the live class corresponding to the live class ID, and the video file information is stored to the database, so as to facilitate subsequent retrieval and review.

[0475] In some embodiments, since the interactive data and the video file information need to be stored separately after the live class recording is completed, the live class detail information is generated based on the teacher interactive data, the student interactive data and the video file information, and is stored to the database of the service server.

[0476] It can be seen that the server provided in the embodiments of the present application is applied to the service server, and can obtain, in real time, the teacher interactive data generated by the teacher-side display device, the student interactive data generated by the student-side display device based on the teacher interactive data, and the video file information of the live class recording including the live class picture during the live class. The teacher interactive data, the student interactive data and the video file information are respectively stored to the database, so that the teacher interactive data and / or the student interactive data can be synchronously displayed while the video file is watched during subsequent student review, the student can re-experience the live class, and can participate in the live class and interact during the review process, thereby improving the user experience.

[0477] After the live class recording is completed, the student can click to review the video file based on his own needs. In order to provide interaction for the student when reviewing, during the live class review process, the application embodiment provides a display device applied to the student end display device, when reviewing, the corresponding teacher interaction data is displayed in real time according to the video file time axis, and whether real-time interaction is needed is determined according to the operation of the student. When real-time interaction is needed, an interaction interface is generated in the live class review screen for the student to interact.

[0478] Figure 45 Flowchart of the live class review method in some embodiments of the application; Figure 46 Interaction flowchart of the live class review method in some embodiments of the application. Referring to Figure 45 and Figure 46 The display device provided by the application embodiment comprises a display and a controller. The display is configured to present a live class display interface, and the live class display interface displays a review button corresponding to a live class ID. The controller is connected with the display, and when the live class review method is executed, the controller is configured to execute the following steps:

[0479] S21A, in response to the live class review instruction triggered by the review button, a live class review interface including a video playback window, a playback button and a student data display button is generated.

[0480] When the student needs to review the video file of a certain live class, he clicks the configured live class application, and the live class display interface is presented in the user interface of the display. Referring again to Figure 44 , the live class display interface displays a plurality of live classes, and each live class corresponds to a review button. The plurality of live classes can be distinguished by respective live class IDs, and one live class ID is bound to one review button.

[0481] When the student selects one of the live classes in the live class display interface for review, he clicks the review button corresponding to the selected live class to generate a live class review instruction carrying a live class ID. The controller generates a live class review interface in response to the live class review instruction, and switches the display of the live class display interface in the display to the live class review interface.

[0482] Figure 47 The schematic diagram of the live class review interface in some embodiments of the application. Referring to Figure 47 , the live class review interface of the student end includes a video playback window, a playback button and a student data display button. The video playback window is used to play the video file generated when the live class is recorded, the playback button is used to control the playback and pause of the video file, and the student data display button is used to control whether to synchronously display the student interaction data when reviewing the live class.

[0483] S22A, acquire, from the service server, video file information, teacher interaction data, and student interaction data corresponding to the live class ID, the video file information being video files recorded during the live class including live class pictures and video file time axes corresponding to a live class time axis, the teacher interaction data being interaction data corresponding to the live class time axis generated by the teacher during the live class, and the student interaction data being interaction data corresponding to the live class time axis generated by the student based on the teacher interaction data during the live class.

[0484] When the student selects one of the live classes to review in the live class display interface and clicks a review button corresponding to the selected live class, a live class review instruction carrying the live class ID is generated to acquire live class detail information. Since the live class detail information is stored in the service server, the live class review instruction is sent to the service server, and the service server acquires, from the database, live class detail information corresponding to the live class ID, the live class detail information including the video file information, the teacher interaction data, and the student interaction data.

[0485] In some embodiments, the controller of the student-side display device, when acquiring, from the service server, the video file information, the teacher interaction data, and the student interaction data corresponding to the live class ID, is further configured to perform the following steps:

[0486] Step 221, in response to the live class review instruction, send a live class detail request carrying the live class ID to the service server, the live class detail request being used to instruct the service server to acquire, from the database, live class detail information corresponding to the live class ID, the live class detail information including the teacher ID and the video file information.

[0487] Step 222, receive the live class detail information corresponding to the live class ID returned by the service server.

[0488] Step 223, send an interaction data request carrying the teacher ID to the service server, the interaction data request carrying the teacher ID being used to instruct the service server to acquire, from the database, teacher interaction data corresponding to the teacher ID.

[0489] Step 224, receive the teacher interaction data corresponding to the teacher ID returned by the service server.

[0490] Step 225, send an interaction data request carrying the student ID to the service server, the interaction data request carrying the student ID being used to instruct the service server to acquire, from the database, student interaction data corresponding to the student ID.

[0491] Step 226, receive the student interaction data corresponding to the student ID returned by the service server.

[0492] To ensure that when students watch the replay of a live class, the interactive data generated by the teacher during the live class can be displayed while playing the video file, thus recreating the scene of the live class for students, the student's display device needs to sequentially obtain the video file information, teacher interaction data, and student interaction data corresponding to the live class from the business server.

[0493] When a student triggers the replay button for a live-streamed class, a replay command carrying the live-streamed class ID is generated. The student's display device then generates a live-streamed class details request carrying the live-streamed class ID based on the replay command and sends it to the business server. The business server, based on the live-streamed class ID in the details request, retrieves the corresponding live-streamed class details information from its database, including the teacher ID and video file information.

[0494] After receiving the live class details, the student-side display device sends an interaction data request carrying the teacher's ID to the business server to request the interaction data generated by the teacher during the live class corresponding to the live class ID, so that it can be displayed in real time when playing the video file.

[0495] When a student logs into the live-streaming application configured on their display device, a student ID is generated. During a live online class, all student interaction data is stored on the business server. Therefore, when a student wants to watch a replay, they can send an interaction data request carrying their student ID to the business server. Upon receiving the request, the business server searches its database for the student interaction data corresponding to the student ID and returns it to the student's display device.

[0496] Because a single teacher may generate multiple teacher interaction data points during the same live-streamed class, the service server can store these data points in a list format, ordered by their start time, and return this list format to the student's display device. Similarly, since a student may generate multiple student interaction data points during a live-streamed class, the service server can return all student interaction data related to that student's live-streamed class ID to the student's display device. These student interaction data points can be arranged in chronological order of their occurrence, returning them as an interaction data list. The student's display device then sequentially displays each student interaction data point in the live-streamed class replay screen.

[0497] S23A: In response to the video playback command generated by triggering the play button, the video file is displayed in the video playback window for playback.

[0498] After receiving the video file information returned by the business server, the student-side display device can play the video file based on the video file information, that is, play the video file in the video playback window.

[0499] In some embodiments, the controller of the student-side display device, in response to the video play instruction generated by triggering the play button, displays the video file in the video play window for playing, is further configured to perform the following steps:

[0500] Step 231, in response to the video play instruction generated by triggering the play button, obtaining the video file review address and the video file timeline corresponding to the video file information.

[0501] Step 232, based on the video file review address and the video file timeline, playing the corresponding video file in the video play window.

[0502] The play button is displayed in the live class review interface, which can be displayed below the video play window or in the floating layer above the video play window. The student clicks the play button to generate a video play instruction, and the controller responds to the video play instruction to obtain the video file review address and the video file timeline in the video file information.

[0503] The video file review address is the URL address of accessing the video file, and the controller can access the video file based on the URL address to present the play picture of the video file in the video play window. During playing, the video file is played based on the video file timeline, and the video file timeline is displayed below the video play window.

[0504] S24A, based on the video file timeline and the on-off state of the student data display button, display the teacher interaction data and the student interaction data in the floating layer above the video play window.

[0505] Based on the video file review address and the video file timeline, the corresponding video file can be played, and during the playing of the video file, the teacher interaction data or the student interaction data can be displayed in the video play window for the convenience of providing personalized experience to the student. Whether the student interaction data is displayed or not is related to the on-off state of the student data display button. If the student data display button is turned on, the student data is displayed in the video play window, and if the student data display button is turned off, the student data is not displayed in the video play window.

[0506] The video file is played based on the video file timeline, and for the convenience of timely displaying the teacher interaction data and the student interaction data in the video play window, the teacher interaction mark and the student interaction mark on the video file timeline are detected in real time during the playing of the video file. Based on the teacher interaction mark and the student interaction mark on the video file timeline, the corresponding teacher interaction data and student interaction data are retrieved for display.

[0507] Figure 48Method flow chart for displaying interactive data in some embodiments of the present application. Referring to Figure 48 In some embodiments, the controller of the student terminal display device, in displaying the teacher interactive data and the student interactive data in the floating layer above the video playback window based on the video file timeline and the switch state of the student data display button, is further configured to perform the following steps:

[0508] S241, detecting whether there is a teacher interactive mark and a student interactive mark on the video file timeline in the process of playing the video file in the video playback window, the teacher interactive mark being used to represent that there is teacher interactive data, and the student interactive mark being used to represent that there is student interactive data.

[0509] S242, when there is a teacher interactive mark at the current playing time of the video file timeline, displaying the teacher interactive data corresponding to the teacher interactive mark in the floating layer above the video playback window.

[0510] S243, when there is a student interactive mark at the current playing time of the video file timeline, determining whether to display the student interactive data in the floating layer above the video playback window according to the switch state of the student data display button.

[0511] During the live class, if the teacher generates interactive data at a certain time, a teacher interactive mark is added on the live class timeline accordingly, and if the student generates interactive data at a certain time, a student interactive mark is added on the live class timeline accordingly. The live class timeline is the same as the video file timeline obtained by recording, so whether there is a teacher interactive mark and a student interactive mark on the video file timeline can be detected in real time during the video file playing process.

[0512] In some embodiments, if there is a teacher interactive mark at a certain time on the video file timeline, it means that the teacher interactive data generated by the teacher during the live class needs to be displayed. The teacher interactive data is displayed in the floating layer above the video playback window, that is, the teacher interactive data is displayed in the upper layer of the video file.

[0513] Specifically, when displaying the teacher interactive data, the controller of the student terminal display device, in displaying the teacher interactive data in the floating layer above the video playback window when there is a teacher interactive mark at the current playing time of the video file timeline, is further configured to perform the following steps:

[0514] Step 2421, when there is a teacher interactive mark at the current playing time of the video file timeline, obtaining the start time, duration and teacher interactive information of each interactive action performed by the teacher during the live class in the teacher interactive data.

[0515] Step 2422, generate a teacher interaction data display window based on the teacher interaction information, and display the teacher interaction data display window in a floating layer above the video playing window according to the start time and the duration, and the teacher interaction information is suspended above the video file, and the start time is the same as the current playing time of the teacher interaction identifier.

[0516] When the teacher interaction identifier exists at the current playing time of the video file time axis, it means that the current playing time reaches the start time of a certain interaction action corresponding to the teacher interaction data, and the start time, the duration and the teacher interaction information of each interaction action generated by the teacher when conducting the live class are obtained.

[0517] To display the teacher interaction data, the teacher interaction data display window is generated according to the teacher interaction information, and the teacher interaction data display window is displayed in the form of a floating window. In some embodiments, the teacher interaction data display window can be a semi-transparent gradient interface to avoid blocking the video file picture currently played in the video playing window.

[0518] According to the start time and the duration, the teacher interaction data display window is displayed in a floating layer above the video playing window, and the start display time of the teacher interaction data display window is the same as the start time of the interaction action generated when recording the live class, that is, the same as the current playing time of the teacher interaction identifier. The display duration of the teacher interaction data display window is the same as the duration of the teacher interaction information displayed when recording the live class.

[0519] Figure 49 Some embodiments of the present application display the display schematic diagram of the student end interaction data. Referring to Figure 49 When the student end displays the teacher interaction data, the student reviews the live class by using the student end display device, and if the teacher interaction identifier exists at the current playing time of the video file time axis, the teacher interaction information corresponding to the live class is obtained, the teacher interaction information includes the interaction serial number (8), the interaction content (the question and the multiple-choice question) and the interaction option (ABCD), the teacher interaction data display window is generated according to the teacher interaction information, and is displayed above the floating layer of the video playing window, and the relative physical position is below the video playing window. The display duration of the teacher interaction data display window is the same as the duration of the teacher interaction information displayed on the student end when the teacher teaches the live class.

[0520] If the current playing time of the video file timeline reaches 0:23:28 and the teacher interaction identifier 1 is detected, the start time of the interaction action 1 in the teacher interaction data corresponding to this time is 0:23:28, so the teacher interaction information corresponding to the interaction action 1 is played when the current time reaches 0:23:28, the teacher interaction data display window is generated based on the teacher interaction information, and the display duration of the teacher interaction data display window is the continuous duration, which is 5 seconds. If the current playing time of the video file timeline reaches 0:35:50 and the teacher interaction identifier 2 is detected, the start time of the interaction action 2 in the teacher interaction data corresponding to this time is 0:35:50, so the teacher interaction information corresponding to the interaction action 2 is played when the current time reaches 0:35:50, the teacher interaction data display window is generated based on the teacher interaction information, and the display duration of the teacher interaction data display window is the continuous duration, which is 6 seconds.

[0521] The teacher interaction data includes a plurality of teacher interaction information, one teacher interaction information corresponds to one start time, and corresponds to one teacher interaction identifier. According to the order of the start time and the corresponding relationship with the video file timeline, each teacher interaction information corresponding to each detected teacher interaction identifier is displayed in the floating layer above the video playing window in turn.

[0522] In some embodiments, the teacher interaction information includes an interaction serial number, interaction content, interaction options and interaction correct results. The interaction correct results are not always displayed according to the teacher interaction identifier, but are displayed according to whether the student interaction data is displayed or not. For example, if the student interaction data is displayed, the interaction correct results in the teacher interaction data are displayed, and the interaction options cannot be triggered; if the student interaction data is not displayed, the interaction correct results in the teacher interaction data are not displayed, and the interaction options can be triggered for the student to interact in real time.

[0523] In some embodiments, if there is a student interaction identifier at a certain time on the video file timeline, it means that the student interaction data generated by the student during the live class needs to be displayed at the moment. At this time, the on-off state of the student data display button needs to be detected to determine whether the student needs to display the student interaction data synchronously. If the student data display button is in the on state (such as Figure 49

[0524] ​Specifically, when a student interaction indicator exists at the current playback moment of the video file's timeline, the controller in the student-side display device determines whether to display student interaction data in the overlay above the video playback window based on the on / off state of the student data display button, and is further configured to perform the following steps:

[0525] Step 2431: When there is a student interaction indicator at the current playback moment of the video file timeline, determine the on / off state of the student data display button.

[0526] Step 2432: If the student data display button is on, then display the student interaction data in the overlay above the video playback window.

[0527] Step 2433: If the student data display button is off, student interaction data will not be displayed in the overlay above the video playback window.

[0528] To enhance student interactivity when watching replays of live classes, a button for displaying student data can be generated synchronously within the live class interface to control whether student interaction data needs to be displayed simultaneously.

[0529] When a student interaction indicator appears at the current playback moment on the video file's timeline, it means that student interaction data is available and can be displayed. To determine whether student interaction data is displayed, the on / off state of the student data display button is checked. If the student data display button is on, such as... Figure 49 The indicated state means that students do not need to interact in real time, and in this case, student interaction data will be displayed in a floating layer above the video playback window. If the student data display button is off, as shown... Figure 50 The status shown indicates that students need to interact in real time, so student interaction data will not be displayed in the overlay above the video playback window.

[0530] Because teacher interaction data is always displayed in a pop-up above the video playback window based on the teacher interaction icon during live class replays, when the student data display button is on, both teacher and student interaction data are displayed simultaneously in the pop-up above the video playback window. When the student data display button is off, only teacher interaction data is displayed in the pop-up above the video playback window.

[0531] When reviewing the video file, it is necessary to ensure that the student interaction data is displayed in the video playback window of the live class review interface in a timely manner, that is, after the teacher interaction data is displayed in the video playback window, the corresponding student interaction data is displayed in a timely manner within a specified time, so that the display time interval of the teacher interaction data and the student interaction data in the review process is the same as the display time interval of the teacher interaction data and the student interaction data in the previous live class, and then the scene of the live class is restored. The specified time can be the duration of the teacher's interaction action.

[0532] To accurately display the student interaction data during the live class review, the student interaction data can be displayed based on the time point at which the student generates interaction each time during the recording of the live class. In some embodiments, the controller of the student terminal display device, when executing the step of displaying the student interaction data in the floating layer above the video playback window, is further configured to execute the following steps:

[0533] Step 24321, obtaining the time point at which each interaction corresponding to the student interaction data is generated and the student interaction information.

[0534] Step 24322, generating a student interaction data display window based on the student interaction information, displaying the student interaction data display window in the floating layer above the video playback window according to the time point, and arranging the student interaction data display window above the teacher interaction data display window. The time point is the same as the current playback time at which the student interaction identifier exists.

[0535] When the student interaction identifier exists at the current playback time of the video file timeline and the student data display button is in the open state, the time point at which each interaction corresponding to the student interaction data is generated and the student interaction information are obtained, that is, the time point at which the student generates the corresponding interaction operation based on the teacher interaction data each time during the recording of the live class and the student interaction information. For example, the interaction generated by the student based on the teacher interaction data is the operation action of the student answering the question, and the student interaction information is the content corresponding to the interaction option clicked by the student.

[0536] To display the student interaction data in a timely manner, the time point at which the student generates interaction based on the teacher interaction data is obtained, and when the current playback time of the video file timeline reaches a certain time point, that is, when the student interaction identifier exists, a student interaction data display window is generated based on the student interaction information. In some embodiments, referring again to Figure 49 , the student interaction data display window can be a semi-transparent gradient interface, and the student interaction data display window is arranged above the teacher interaction data display window to avoid blocking the video file picture currently played in the video playback window and the teacher interaction data presented in the teacher interaction data display window.

[0537] The student interaction data display window is displayed in a floating layer above the video playing window according to a time point of generation. The display time point of the student interaction data display window is the same as the time point of generation of the student interaction in the live class recording, that is, the same as the current playing time point of the existing student interaction identifier.

[0538] Referring to Figure 49 For example, in the case of needing to synchronously display student interaction data when the student data display button is in the open state, if the live class is in the live class teaching, the student generates a student interaction data at 25 minutes and 30 seconds based on the teacher interaction data (the start time is 25 minutes and 28 seconds, the duration is 5 seconds, and the interaction correct result is A). The student interaction data includes: selecting the interaction option A, and the interaction result is correct selection. When playing the video file for review, the current playing time of the video file time axis reaches 25 minutes and 30 seconds, and it is detected that there is a student interaction identifier. At this time, the student interaction data display window is generated based on the corresponding student interaction data and is displayed in a floating layer above the video playing window. The student interaction data display window is superimposed and displayed above the teacher interaction data display window, that is, the student interaction data display window is displayed in a floating layer above the teacher interaction data display window which displays “interaction serial number (8), interaction content (multiple-choice question and topic), interaction option (ABCD), and interaction correct result (correct answer A)”. The interaction option A is presented in the student interaction data display window, and the interaction result is correct selection ().

[0539] As can be seen, when the student terminal display device reviews the video file of the live class, if it is detected that there is a teacher interaction identifier on the video file time axis, the corresponding teacher interaction data is displayed. If it is detected that there is a student interaction identifier on the video file time axis, the switch state of the student data display button in the live class interface of the student terminal is first detected. If it is in the open state, the teacher interaction data (including the interaction correct result) and the student interaction data are displayed at the time corresponding to the interaction identifier. If it is in the closed state, only the teacher interaction data (without the interaction correct result) is displayed, and the student interaction data is not displayed. At this time, the student can perform real-time interaction.

[0540] In some embodiments, the student can adjust whether the student interaction data needs to be displayed at any time during the live class review, and can perform real-time interaction without displaying the student interaction data. Therefore, the student can control the switch state of the student data display button at any time during the live class review.

[0541] In some embodiments, if the student data display button is originally in the closed state, the student data display button can be reopened to display the student interaction data. Specifically, the controller, in execution of the determination of whether to display the student interaction data in the floating layer above the video playing window according to the on-off state of the student data display button, is further configured to: in the process of playing the video file, in response to a data display opening instruction generated by triggering the student data display button, display the student interaction data in the floating layer above the video playing window.

[0542] In the live class review process, if the student data display button is originally in the closed state, the student interaction data is not displayed in the video playing window. If the student wants to see his / her interaction in the live class recording process, the student data display button can be clicked to open it, and at this time, a data display opening instruction is generated.

[0543] In response to the data display opening instruction, the controller displays the student interaction data at the corresponding time when the student interaction identifier is detected on the video file timeline, i.e., displays the student interaction data in the floating layer above the video playing window. The teacher interaction data is always displayed according to the time when the teacher interaction identifier is detected on the video file timeline, and whether to display the teacher interaction data is not affected by the on-off state of the student data display button. The display process of the student interaction data can refer to the content of the aforementioned embodiment steps 24321 to 24322, and the display process of the teacher interaction data can refer to the content of the aforementioned embodiment steps 2421 to 2422, which will not be described here.

[0544] In some embodiments, if the student data display button is originally in the open state, the student data display button can be closed to cancel the display of the student interaction data. Specifically, the controller, in execution of the determination of whether to display the student interaction data in the floating layer above the video playing window according to the on-off state of the student data display button, is further configured to: in the process of playing the video file, in response to a data display closing instruction generated by triggering the student data display button, display the teacher interaction data according to the current playing time corresponding to the teacher interaction identifier on the video file timeline, and cancel the display of the student interaction data.

[0545] In the live class review process, if the student data display button is originally in the open state, the student interaction data is already displayed in the video playing window. If the student does not want to see his / her interaction in the live class recording process, the student data display button can be clicked to close it, and at this time, a data display closing instruction is generated.

[0546] The controller responds to the data display closing instruction, at this time, even if the student interaction identifier is detected on the video file timeline, the student interaction data is not displayed, and the teacher interaction data continues to be displayed according to the current playing time corresponding to the teacher interaction identifier on the video file timeline, that is, displayed in the floating layer above the video playing window. The display process of the teacher interaction data can refer to the content of the foregoing embodiment steps 2421 to 2422, which will not be described here.

[0547] In some embodiments, when the student data display button is in the closed state, the student interaction data is no longer displayed in the video playing window, at this time, the student can perform real-time interaction during the live class review process. In order to perform real-time interaction, the student needs to interact based on the teacher interaction data generated during the live class recording process.

[0548] Therefore, during the live class review process, the controller of the student end display device is further configured to:

[0549] Step 251, when the student data display button is in the closed state, and there is a teacher interaction identifier at the current playing time of the video file timeline, an interaction interface is generated based on the teacher interaction data, the interaction interface is used to provide interaction for the student during the live class review, and the teacher interaction data includes the start time, the duration and the teacher interaction information of each interaction action.

[0550] Step 252, the interaction interface is displayed in the floating layer above the video playing window according to the start time and the duration, the interaction interface is suspended above the video file corresponding picture, the teacher interaction information is presented in the interaction interface, and the start time is the same as the current playing time of the existing teacher interaction identifier.

[0551] During the live class review or during the live class review process, if it is detected that the student data display button is in the closed state, it indicates that the student needs to perform real-time interaction. At this time, if a teacher interaction identifier is detected on the video file timeline, the corresponding teacher interaction data is obtained, and an interaction interface is generated based on the teacher interaction data. In order to generate student interaction data, a submit button is also displayed in the interaction interface. The interaction interface can be clicked by the student to perform real-time interaction.

[0552] Figure 50 The display schematic diagram of the interaction interface generated during the review in some embodiments of the present application is shown. Referring to Figure 50 , the student data display button is in the closed state, the teacher interaction data includes the start time, the duration and the teacher interaction information of each interaction action, the teacher interaction information and the submit button are displayed in the interaction interface, for example, the interaction interface displays the interaction serial number (18), the interaction content (the question and the multiple choice question), the interaction option (ABCD) and the submit button, and the interaction option is in a clickable state, and the interaction correct result is not displayed.

[0553] Since the time axis of the live class recording is the same as the time axis of the video file, the starting display time and display duration of the interaction interface are the same as the starting time and duration of the teacher interaction information during the live class recording, that is, when the interaction interface is displayed in the floating layer above the video playing window, the display time of the interaction interface is the starting time of the interaction action, and the display duration is the detected current playing time corresponding to the teacher interaction identifier, and the students can interact in real time within the display duration.

[0554] For example, during the live class recording, the starting time of a certain interaction action in the teacher interaction data is 25 minutes and 28 seconds, and the duration is 5 seconds. During the live class review, the detected teacher interaction identifier on the video file time axis is also 25 minutes and 28 seconds. Therefore, the interaction interface is generated according to the teacher interaction data corresponding to 25 minutes and 28 seconds, the display time of the interaction interface is 25 minutes and 28 seconds, the display duration is 5 seconds, and the students interact in real time within 5 seconds.

[0555] The students can interact in real time based on the interaction information presented in the interaction interface in the live class review interface of the student terminal display device, for example, the interaction interface displays a question with an interaction number of 18 and interaction options, the student selects one of the interaction options, that is, answers the question with the number of 18, and the selected interaction option is the real-time interaction data of the student.

[0556] It can be seen that the student terminal display device provided in the embodiments of the present application plays the video file corresponding to the live class ID during the live class review, and presents the interaction interface generated based on the teacher interaction data corresponding to the starting time of a certain interaction action in the live class review interface when the video file in the live class review interface plays to the starting time, that is, displays the interaction interface in the floating layer above the video playing window, so that the students can interact in real time, and the personalized experience of the students is improved in the case of restoring the live class scene.

[0557] In some embodiments, when the students interact in real time based on the interaction interface, the business server can further judge the correctness of the interaction data after the real-time interaction data is generated. Therefore, during the live class review, the controller in the student terminal display device is further configured to perform the following steps:

[0558] Step 261, when the student interaction data is not displayed, receiving a current interaction instruction generated when the student triggers the submit button based on the interaction content and interaction options presented in the interaction interface, the teacher interaction information includes the interaction content and the interaction options, and the submit button is displayed in the interaction interface.

[0559] Step 262, in response to the current interaction instruction, generating current student interaction data.

[0560] Step 263, sending the current student interaction data to the business server, and the business server is configured to generate a current interaction result according to the current student interaction data;

[0561] Step 264, receiving the current interaction result returned by the business server and displaying the current interaction result in the interaction interface.

[0562] During the live class review process, if the student wants to re-experience the answering process, the student interaction data display button can be closed, and the student interaction data displayed in the video playing window can be canceled. At this time, only the teacher interaction data is displayed in the live class review picture. Based on the teacher interaction data, an interaction interface is generated in the live class review picture, so that the student can interact in real time based on the interaction interface, that is, re-experience the answering process once.

[0563] Figure 51 The display schematic diagram of the student interacting in real time based on the interaction interface during the review in some embodiments of the present application. Referring to Figure 50 and 22 When interacting in real time, the teacher interaction information corresponding to the current time and the submit button are displayed in the interaction interface. The teacher interaction information includes the interaction serial number (18), the interaction content (the question and the multiple-choice question), and the interaction option (ABCD), and the interaction option is in a triggerable state. The student can click any interaction option based on the interaction content as the current interaction operation, and click the submit button after completing the selection to generate the current interaction instruction. For example, the student clicks the interaction option AB, and then clicks the submit button to generate the current interaction instruction.

[0564] The controller generates the current student interaction data in response to the current interaction instruction. The current student interaction data includes the interaction option AB selected by the student. The controller sends the current student interaction data to the business server. The business server retrieves the correct answer (interaction correct result) of the corresponding question (question with serial number 18) from the database, and judges the correctness according to the current student interaction data made by the student and the correct answer to obtain the current interaction result. The business server returns the current interaction result to the student terminal display device and displays the current interaction result in the interaction interface.

[0565] For example, referring to Figure 51 , the controller of the student terminal display device sends the current interaction instruction carrying the interaction option AB to the business server. The business server retrieves the interaction correct answer (AB) of the question with serial number 18. The correctness of the current interaction data (interaction option AB) of the student and the interaction correct answer (AB) is judged. If they are consistent, the current interaction result (correct √) is returned. In some embodiments, if the current interaction data of the student and the interaction correct answer are inconsistent, the current interaction result (incorrect X) is returned.

[0566] The business server returns the current interaction result (correct √) to the student terminal display device and displays it in the interaction interface, and also displays the correct answer (AB) of the interaction in the interaction interface, to realize the judgment of the real-time interaction result.

[0567] After completing an answer, the submit button is converted to show the exit answer button. The student clicks the exit answer button displayed in the interaction interface to exit the answer interface and end the current question in advance. At this time, the display of the interaction interface is cancelled. Otherwise, the interaction interface will be displayed in the video playing window, and the display time of the interaction interface is the same as the duration of the question.

[0568] Therefore, when the live class is reviewed, the student terminal display device can perform real-time interaction and further restore the scene in the class to enable the student to experience the online live class again, thereby improving the user experience.

[0569] As can be seen, when the student terminal display device reviews the video file, two interaction modes can be provided for the student. One is based on the teacher interaction identifier and the student interaction identifier detected on the video file timeline and the student data display button in the on state, and the teacher interaction data and the student interaction data are displayed in turn. The other is based on the video file timeline and the student data display button in the off state, and only the teacher interaction data is displayed. At this time, the interaction interface can be provided for the student to perform real-time interaction. Both interaction modes can display other interaction content in addition to the live class picture to the student during review, enrich the display content of the reviewed video file, and improve the user experience.

[0570] As can be seen, the display device provided by the embodiments of the present application is applied to the student terminal display device, can generate a live class review interface including a video playing window, a play button and a student data display button in response to a live class review instruction generated by the student triggering the review button during live class review, acquire video file information, teacher interaction data and student interaction data corresponding to the live class ID from the business server, and display the video file in the video playing window in response to a video playing instruction generated by triggering the play button. The teacher interaction data and the student interaction data are displayed in the floating layer above the video playing window based on the video file timeline and the on-off state of the student data display button. As can be seen, the display device provided by the embodiments of the present application can display the teacher interaction data and / or the student interaction data synchronously while the student reviews the video file, so that the student can experience the live class again, and can participate in the live class and perform real-time interaction during review, thereby improving the user experience.

[0571] Figure 52 Another flowchart of the live class review method in some embodiments of the present application. Referring toFigure 52 The embodiment of the application provides a server applied to a service server, comprising: a database configured to store student interaction data, teacher interaction data and video file information generated by a display device during live class recording; and a controller connected with the database, configured to execute the following steps during live class review method execution:

[0572] S3A1, live class information request carrying a live class ID sent by a display device is acquired, wherein the live class information request is a request generated by the display device in response to a live class review instruction generated by triggering a review button.

[0573] S32A, in response to the live class information request, live class detail information corresponding to the live class ID is queried from the database, wherein the live class detail information comprises video file information, teacher interaction data and student interaction data, the video file information refers to a video file comprising a live class picture and a video file time axis corresponding to a live class time axis recorded during live class, the teacher interaction data refers to interaction data corresponding to the live class time axis generated by a teacher during live class, and the student interaction data refers to interaction data corresponding to the live class time axis generated by a student based on the teacher interaction data during live class.

[0574] S33A, the live class detail information is returned to the display device, and the live class detail information is used for display device live class review display.

[0575] When a student reviews a live class by using a student terminal display device, the student selects one of live classes in a live class display interface of the student terminal display device, clicks a review button corresponding to the selected live class, and generates a live class review instruction carrying a live class ID. The controller generates a live class information request in response to the live class review instruction and sends the live class information request to the service server to obtain live class detail information. Since the live class detail information is stored in the database of the service server, the service server obtains the live class detail information corresponding to the live class ID from the database in response to the live class information request, and the live class detail information comprises video file information, teacher interaction data and student interaction data.

[0576] The service server obtains the live class detail information from the database, that is, the specific implementation process of obtaining the video file information, the teacher interaction data and the student interaction data, which can refer to the content shown in steps 221 to 226 of the foregoing embodiment, and details are not described herein.

[0577] The business server returns the obtained live class detail information corresponding to the live class ID to the corresponding student end display device, so as to facilitate the display of the live class detail information when the student uses the student end display device to review the live class. The student end display device displays the live class detail information. The related steps can refer to the contents shown in steps 21 to 24 and the related implementation contents of the foregoing embodiments, and will not be described here.

[0578] It can be seen that the server provided in the embodiments of the present application is applied to a business server, and can obtain live class detail information corresponding to a live class ID from a database according to a live class information request carrying a live class ID generated by a student end display device when reviewing a live class, such as video file information, teacher interaction data and student interaction data, and return the live class detail information to the display device. The live class detail information is used for display when the display device reviews the live class. It can be seen that the server provided in the embodiments of the present application can provide live class detail information for the student end display device while the student reviews the video file, so that the student end display device synchronously displays the teacher interaction data and / or the student interaction data, so that the student can experience the live class again, and can participate in the live class and interact in real time during the review process, thereby improving the user experience.

[0579] Figure 45 Flowchart of the live class review method in some embodiments of the present application. Referring to Figure 45 The embodiments of the present application provide a live class review method applied to a student end display device, and the method comprises:

[0580] S21, in response to a live class review instruction generated by triggering a review button, a live class review interface including a video playback window, a playback button and a student data display button is generated, the review button is displayed in a live class display interface, and the review button corresponds to a live class ID;

[0581] S22, video file information, teacher interaction data and student interaction data corresponding to the live class ID are obtained from a business server, the video file information refers to a video file including a live class picture recorded during the live class and a video file time axis corresponding to a live class time axis, the teacher interaction data refers to interaction data corresponding to the live class time axis generated by a teacher during the live class, and the student interaction data refers to interaction data corresponding to the live class time axis generated by a student based on the teacher interaction data during the live class;

[0582] S23, in response to a video playback instruction generated by triggering the playback button, the video file is displayed in the video playback window for playback;

[0583] S24, based on the video file timeline and the student data, display the teacher interaction data and the student interaction data in the floating layer above the video playback window.

[0584] Figure 52 Another flowchart of the live class review method in some embodiments of the application. Referring to Figure 52 The live class review method provided by the embodiments of the application is applied to a business server, and the method comprises:

[0585] S31, obtaining a live class information request carrying a live class ID sent by a display device, wherein the live class information request is a request generated by the display device in response to a live class review instruction generated by triggering a review button;

[0586] S32, in response to the live class information request, querying live class detail information corresponding to the live class ID in a database, wherein the live class detail information comprises video file information, teacher interaction data and student interaction data, the video file information refers to a video file comprising a live class picture and a video file timeline corresponding to a live class timeline recorded during the live class, the teacher interaction data refers to interaction data corresponding to the live class timeline generated by the teacher during the live class, and the student interaction data refers to interaction data corresponding to the live class timeline generated by the student based on the teacher interaction data during the live class;

[0587] S33, returning the live class detail information to the display device, wherein the live class detail information is used for display by the display device during the live class review.

[0588] In some embodiments, the application provides a teaching live method, which is executed by a controller in a display device of a teacher end, and the method comprises:

[0589] S1, receiving a live class teaching signal generated by a teacher triggering a live control in a live teaching interface;

[0590] S2, in response to the live class teaching signal, entering a specified live room for teaching, and sending the live class teaching signal to a student end device, wherein the student end device is used to enter a specified live room for listening in response to the live class teaching signal;

[0591] S3, after completing the live class teaching, receiving a homework assignment signal generated by the teacher triggering a homework control in the live teaching interface;

[0592] S4, in response to the homework assignment signal, entering a homework assignment interface, wherein the homework assignment interface is used to provide an input interface for assigning homework corresponding to the live class;

[0593] S5, receiving a homework arrangement confirmation signal generated by the teacher triggering the arrangement homework button in the arrangement homework interface, and sending the homework arrangement confirmation signal to a student terminal device, the student terminal device being configured to enter a homework answering page to answer in response to the homework arrangement confirmation signal, the homework answering page being the same as the homework presented in the arrangement homework interface.

[0594] For the convenience of explanation, the foregoing description has been made in connection with specific embodiments. However, the foregoing exemplary discussion is not intended to be exhaustive or to limit the embodiments to the precise forms disclosed. Various modifications and changes are possible in light of the teachings above. The selection and arrangement of various described embodiments are designed to provide the best illustration of the principles of the application and its practical application to thereby enable one of ordinary skill in the art to use the application in practical implementations and with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, characterized by comprising: include: The monitor is configured to display the teacher's live course interface; A communicator used to communicate with the live streaming server and the business server; A first controller connected to the display, the first controller being configured to: In response to a confirmation operation on the entry control used to enter the first live streaming room, the control user interface displays the teacher-side live streaming course interface of the first live streaming room and sends a live streaming class recording start command to the live streaming server; wherein, the first live streaming room is created by the server according to the start time of the live streaming class for the first class that is about to start within a preset duration, the teacher-side live streaming course interface is provided with a local window for displaying local video data and a peer window for displaying peer video data; the live streaming class recording start command is used to instruct the live streaming server to record the video file of the live streaming class in the first live streaming room. In response to an interaction command, teacher interaction data matching the interaction command is sent to the business server, so that the business server forwards the teacher interaction data to the student's display device. The teacher interaction data includes interaction options and correct interaction results. The system receives student interaction data sent by the business server. This student interaction data is generated by the student-side display device based on the teacher interaction data and sent to the business server. After the live stream ends, the teacher's live course interface displays a replay button corresponding to the live stream ID of the first live stream room. In response to the live class replay command generated by triggering the replay button, a live class replay interface is generated, including a video playback window, a play button, and an interactive data display button, wherein the interactive data display button includes a student interaction data display button. Obtain video file information corresponding to the live stream ID, teacher interaction data corresponding to the teacher ID, and student interaction data corresponding to the student ID from the business server; wherein, the video file information includes the video file playback address and video file timeline of the video file recorded by the live stream server; Based on the video file playback address and the video file timeline, control the display to play the video file in the video playback window; When a teacher interaction identifier and a student interaction identifier are detected on the video file timeline, and the student interaction data display button is on, the control monitor displays the teacher interaction data and the student interaction data in a floating layer above the video playback window, respectively. The teacher interaction identifier is added to the live stream timeline by the business server based on the start time of the interaction action corresponding to the teacher interaction data; the student interaction identifier is added to the live stream timeline by the business server based on the start time of the interaction action corresponding to the student interaction data; the teacher interaction data displays the correct interaction result, and the interaction option is not triggerable. When it is detected that the teacher interaction identifier exists on the video file timeline and the switch state of the student interaction data display button represents off, the display is controlled to display the teacher interaction data in a floating layer above the video playback window and not display the student interaction data; wherein the teacher interaction data does not show the correct interaction result, and the interaction option can be triggered.

2. The display device of claim 1, wherein, The first controller is further configured to, before the confirmation operation on the entering control for entering the first live room: send a course creation instruction containing course information to a server; wherein the course creation instruction is used to make the server add the live course corresponding to the course information to a live course list; in response to a selection instruction on the live course in the live course list, jump to a mode management page; the mode management page includes a three-split-screen class mode control and a multi-video class mode control; in response to a class mode instruction generated by triggering the three-split-screen class mode control or the multi-video class mode control, control the first live room to live according to the class mode corresponding to the class mode instruction.

3. The display device of claim 1, wherein, The first controller is further configured to, before the confirmation operation on the entering control for entering the first live room: send a course creation instruction containing course information to a server; wherein the course creation instruction is used to make the server add the live course corresponding to the course information to a live course list; in response to a selection instruction on the live course in the live course list, jump to a team management page; the team management page includes at least one candidate team name; in response to a team selection instruction of selecting the at least one candidate team name, create a team corresponding to the team selection instruction.

4. The display device of claim 1, wherein, The first controller controls the user interface to display the teacher-side live course interface of the first live room, which is specifically configured to: in response to an interaction instruction generated by triggering the in-class practice button of the teacher-side live course interface, control the teacher-side live course interface to display at least one in-class practice question and send the in-class practice question to a business server; wherein each in-class practice question includes at least one option button; the option button is configured to default to focus; control the display to display the selection rate, answer time, correct answer number, answered number, and online answer number corresponding to each option in the in-class practice.

5. The display device of claim 1, wherein, The first controller controls the user interface to display the teacher-side live course interface of the first live room, which is specifically configured to: receive a handwriting input function query result sent by a student-side display device; the handwriting input function query result is a result of the student-side display device requesting the server to query whether the handwriting input function is configured on the student-side display device; The student list is displayed in the teacher-side live course interface based on the handwriting input function query result, and a first operation item and a first permission control button are displayed in the student list. The first operation item displays a student name corresponding to a student-side display device with handwriting input function and the first permission control button. The first permission control button is used to trigger handwriting function input permission of the student side. A handwriting input authorization instruction is generated when the first permission control button corresponding to the student is triggered. The handwriting input authorization instruction is sent to the student-side display device corresponding to the first permission control button that is triggered. The student-side display device performs handwriting input operation.

6. The display device of claim 1, wherein, The first controller controls the user interface to display the teacher-side live course interface of the first live room, which is specifically configured to: In response to a control start instruction generated when the discussion control is triggered, messages generated by all users in the live course when interacting are obtained, and a list display window is generated in the teacher-side live course interface; The messages are sorted according to their generation time, and a message list is generated. Messages with generation time close to the current time are displayed at the top of the message list; When the total number of messages exceeds the visible number threshold of the message list, all messages in the message sequence are grouped according to the number corresponding to the visible number threshold, and a plurality of message groups are obtained; Based on each message group, a corresponding list page is generated. Each list page includes a number of display positions corresponding to the visible number threshold. The first display position is located at the top of the list page, and the last display position is located at the bottom of the list page. The first display position displays the first message in the corresponding message group with generation time close to the current time.

7. A display device, characterized by It includes: a display configured to display a student-side live course interface; a communicator for communicating with a live server and a service server; a second controller connected to the display, the second controller being configured to: after confirming the operation of the entering control for entering the first live room, control the user interface to display the student-side live course interface of the first live room; wherein the first live room is created by the server according to the start time of the live course for the first course that will start in a preset time period. The student-side live course interface is provided with a local window for displaying local video data and a peer window for displaying peer video data; after receiving the teacher interaction data sent by the service server, obtaining student interaction data generated based on the teacher interaction data, and sending the student interaction data to the service server, so that the service server forwards the student interaction data to the teacher-side display device. The teacher interaction data includes interaction options and interaction correct results; after the live broadcast ends, the student-side live course interface displays a review button corresponding to the live ID of the first live room. In response to the live class review instruction generated by triggering the review button, a live class review interface including a video playback window, a play button and an interactive data display button is generated, and the interactive data display button includes a student interactive data display button; Obtain the video file information corresponding to the live ID, the teacher interactive data corresponding to the teacher ID and the student interactive data corresponding to the student ID from the business server; wherein the video file information includes the video file review address and the video file timeline of the video file recorded by the live server; the video file is recorded by the live server in response to the live class start recording instruction sent by the teacher terminal display device; Based on the video file review address and the video file timeline, the display is controlled to play the video file in the video playback window; When it is detected that there are teacher interaction marks and student interaction marks on the video file timeline, and the switch state of the student interactive data display button represents opening, the display is controlled to display the teacher interactive data and the student interactive data in the floating layer above the video playback window respectively; wherein the teacher interaction mark is added by the business server on the live timeline according to the start time of the interactive action corresponding to the teacher interactive data; the student interaction mark is added by the business server on the live timeline according to the start time of the interactive action corresponding to the student interactive data; the interactive correct result is displayed in the teacher interactive data, and the interactive option cannot be triggered; When it is detected that there are teacher interaction marks on the video file timeline and the switch state of the student interactive data display button represents closing, the display is controlled to display the teacher interactive data in the floating layer above the video playback window, and not to display the student interactive data; wherein the interactive correct result is not displayed in the teacher interactive data, and the interactive option can be triggered.

8. The display device of claim 7, wherein, The second controller, in response to a confirmation operation on an entering control for entering a first live room, controls the user interface to display the student-side live class interface of the first live room, and is specifically configured to: Call a course details interface of a business server according to the live ID, to obtain course details from the course details interface; Control the user interface to display the student-side live class interface of the first live room according to the course details; Wherein, the course details include course name, start time, end time, course material list, first chat room code and first live room code.

9. The display device of claim 7, wherein, After the second controller generates a live class review interface including a video playback window, a play button and an interactive data display button in response to a live class review instruction generated by triggering the review button, it is further configured to: obtain video file information, teacher interaction data and student interaction data corresponding to the live ID from a service server, the video file information being video files including live course pictures recorded when the live course is recorded and a video file timeline corresponding to a live course timeline, the teacher interaction data being interaction data corresponding to the live course timeline generated by a teacher when the live course is conducted, and the student interaction data being interaction data corresponding to the live course timeline generated by a student based on the teacher interaction data when the live course is conducted; in response to a video playing instruction generated by triggering the play button, display the video file in the video playing window for playing; based on the video file timeline and the switch state of the interaction data display button, display the teacher interaction data and the student interaction data in the floating layer above the video playing window, respectively.

10. A method of live teaching, characterized by, comprise: in response to a confirmation operation on an entering control for entering a first live room, control a user interface to display a teacher-side live course interface of the first live room and send a live course recording instruction to a live server; wherein the first live room is created by the server according to the start time of a live course for a first course that will start teaching within a preset time length, the teacher-side live course interface is provided with a local window for displaying local video data and a peer window for displaying peer video data; the live course recording instruction is used to instruct the live server to record a video file of the live course of the first live room; in response to an interaction instruction, send teacher interaction data matched with the interaction instruction to a service server, so that the service server forwards the teacher interaction data to a student-side display device, the teacher interaction data including an interaction option and an interaction correct result; receive student interaction data sent by the service server, the student interaction data being generated by the student-side display device based on the teacher interaction data and sent to the service server; after the live broadcast ends, control the teacher-side live course interface to display a review button corresponding to the live ID of the first live room; in response to a live course review instruction generated by triggering the review button, generate a live course review interface including a video playing window, a play button and an interaction data display button, the interaction data display button including a student interaction data display button; obtain video file information corresponding to the live ID, teacher interaction data corresponding to a teacher ID and student interaction data corresponding to a student ID from the service server; wherein the video file information includes a video file review address and a video file timeline of the video file recorded by the live server; based on the video file review address and the video file timeline, control a display to play the video file in the video playing window; When it is detected that the video file timeline has a teacher interaction mark and a student interaction mark, and the switch state of the student interaction data display button is turned on, the display is controlled to display the teacher interaction data and the student interaction data in the floating layer above the video playback window respectively; wherein the teacher interaction mark is added by the business server on the live timeline according to the start time of the interaction action corresponding to the teacher interaction data; the student interaction mark is added by the business server on the live timeline according to the start time of the interaction action corresponding to the student interaction data; the interaction correct result is displayed in the teacher interaction data, and the interaction option cannot be triggered; When it is detected that the video file timeline has a teacher interaction mark and the switch state of the student interaction data display button is turned off, the display is controlled to display the teacher interaction data in the floating layer above the video playback window, and not to display the student interaction data; wherein the interaction correct result is not displayed in the teacher interaction data, and the interaction option can be triggered.

Images