Remote classroom live broadcast method and system, storage medium and electronic equipment

Abstract

The embodiment of the invention provides a remote classroom live broadcast method and system, a storage medium and electronic equipment, and the method comprises the steps that main equipment responds to a remote classroom live broadcast starting instruction, and sends a flow mixing mode corresponding to the remote classroom live broadcast starting instruction to a server; the server obtains a stream mixing mode, a whiteboard picture video stream collected by the first slave device, a teacher picture video stream and student picture video streams collected by the plurality of lecture attending ends; the plurality of watching ends display the mixed video stream; wherein the mixed video stream is a video stream obtained by mixing the teacher picture video stream, the whiteboard picture video stream and the plurality of student picture video streams according to a stream mixing mode. According to the invention, the master device and the first slave device push the teacher picture video stream and the whiteboard picture video stream respectively, so that the quality of the teacher picture and the whiteboard picture is improved, the quality of the mixed video stream is improved, and the teaching effect of remote classroom live broadcast is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of education and teaching technology, and in particular, to a remote classroom live broadcast method, system, storage medium and electronic device. Background Art

[0002] With the continuous development of the Internet, distance education has become a common teaching model. Through the Internet, it combines teachers' online teaching and supervision with students' offline independent learning, breaking through the time and space limitations of traditional education and bringing about a huge change in the way of acquiring knowledge. Among them, distance classroom live broadcast is a teaching form that is gradually emerging in distance education. Distance classroom live broadcast refers to the use of live broadcast to enable audiences in different places to watch the teaching interaction between teachers and students at the same time within a specific time.

[0003] However, the live broadcast images of remote classrooms in related technologies have low quality and poor teaching effects. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present application provides a remote classroom live broadcast method, system, storage medium and electronic device, which can improve the picture quality of remote classroom live broadcast.

[0005] According to a first aspect of an embodiment of the present application, a remote classroom live broadcast method is provided, and the method is applied to a remote classroom live broadcast system; the remote classroom live broadcast system includes a teaching end, a plurality of listening ends, a server, and a plurality of viewing ends; the teaching end includes a master device and a first slave device; the first slave device is used to display a whiteboard screen, and includes the following steps:

[0006] The master device responds to the remote classroom live broadcast start instruction and sends the mixed flow mode corresponding to the remote classroom live broadcast start instruction to the server;

[0007] The server obtains the mixed stream mode, the whiteboard screen video stream collected by the first slave device, the teacher screen video stream, and the student screen video streams collected by several listening terminals;

[0008] Several viewing terminals display mixed video streams; wherein the mixed video stream is a video stream obtained by mixing a teacher's screen video stream, a whiteboard screen video stream, and several student screen video streams according to a mixing method.

[0009] According to a second aspect of an embodiment of the present application, a remote classroom live broadcast system is provided, comprising a teaching end, a plurality of listening ends, a server, and a plurality of viewing ends; the teaching end comprises a master device and a first slave device;

[0010] The master device is used to respond to the remote classroom live broadcast start instruction and send the mixed flow mode corresponding to the remote classroom live broadcast start instruction to the server;

[0011] The first slave device is used to display the whiteboard screen and send the collected whiteboard screen video stream to the server;

[0012] The server is used to obtain the mixed stream mode, the whiteboard screen video stream, the teacher screen video stream and the student screen video streams sent by several listening terminals;

[0013] Several viewing terminals are used to display mixed video streams; wherein the mixed video stream is a video stream obtained by mixing a teacher's screen video stream, a whiteboard screen video stream and several student screen video streams according to a mixing method.

[0014] According to a third aspect of an embodiment of the present application, there is provided an electronic device, comprising a display, a processor and a memory; the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the remote classroom live broadcast method as described above.

[0015] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the remote classroom live broadcast method as described above is implemented.

[0016] In the embodiment of the present application, the master device responds to the remote classroom live broadcast start instruction, and sends the mixed flow mode corresponding to the remote classroom live broadcast start instruction to the server; the server obtains the mixed flow mode, the whiteboard screen video stream collected by the first slave device, the teacher screen video stream, and the student screen video streams collected by several listening terminals; several viewing terminals display the mixed video stream; wherein the mixed video stream is a video stream obtained by mixing the teacher screen video stream, the whiteboard screen video stream, and several student screen video streams according to the mixed flow mode. The present application improves the quality of the teacher screen and the whiteboard screen by respectively pushing the teacher screen video stream and the whiteboard screen video stream through the master device and the first slave device, thereby improving the quality of the mixed video stream, and the viewing terminal can display a high-quality remote classroom live broadcast screen, thereby improving the teaching effect of the remote classroom live broadcast.

[0017] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application.

[0018] For better understanding and implementation, the present invention is described in detail below with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 A flowchart of a remote classroom live broadcast method shown as an embodiment of the present application;

[0020] Figure 2 A schematic diagram of a remote classroom live broadcast system shown in one embodiment of the present application;

[0021] Figure 3 This is a flow chart before step S10 in a remote classroom live broadcast method according to an embodiment of the present application;

[0022] Figure 4 This is a flow chart before step S12 in a remote classroom live broadcast method according to an embodiment of the present application;

[0023] Figure 5 This is a flow chart before step S20 in a remote classroom live broadcast method according to an embodiment of the present application;

[0024] Figure 6 This is a flow chart before step S20 in a remote classroom live broadcast method according to another embodiment of the present application;

[0025] Figure 7 This is a schematic block diagram of the structure of a remote classroom live broadcast system shown in one embodiment of the present application;

[0026] Figure 8 This is a schematic block diagram of the structure of an electronic device shown in one embodiment of the present application. DETAILED DESCRIPTION

[0027] In order to make the objectives, technical solutions and advantages of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

[0028] It should be clear that the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the embodiments of the present application.

[0029] When the following description relates to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. In the description of the present application, it should be understood that the terms "first", "second", "third", etc. are only used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence, nor can they be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to the specific circumstances. The singular forms of "a", "said" and "the" used in the present application and the appended claims are also intended to include the majority form, unless the context clearly indicates other meanings. The words "if" / "if" used herein can be interpreted as "at the time of" or "when" or "in response to determination".

[0030] In addition, in the description of this application, unless otherwise specified, "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0031] The remote classroom live broadcast method of the embodiment of the present application can be applied to educational and teaching scenarios. In one application scenario of the present application: the teacher uses a mobile device to give remote lessons, and the mobile device must not only capture the teacher's screen, obtain the teacher's screen video stream, and push the teacher's screen video stream to the server. The mobile device must also record the whiteboard screen on the screen, obtain the whiteboard screen video stream, and push the whiteboard screen video stream to the server, and the server sends the teacher's screen video stream and the whiteboard screen video stream to the viewing end.

[0032] However, the above process will have the following problems: the mobile device screen is small, part of the area displays the teacher's screen, and part of the area displays the whiteboard screen, resulting in a smaller display area of ​​the whiteboard, making it difficult for the teacher to operate the whiteboard. Moreover, when recording the whiteboard screen, since the top and bottom of the mobile device screen display classroom information and toolbars, the recorded whiteboard screen video stream will also contain classroom information and toolbars, which will cause the remote classroom live broadcast screen displayed on the viewing end to also contain classroom information and toolbars, reducing the quality of the remote classroom live broadcast screen, affecting the viewing effect of the viewing end, and making the remote classroom teaching effect poor. When the teacher is operating the whiteboard, the teacher cannot adjust the position of the mobile device, otherwise the teacher's posture in the collected teacher screen will be bad. In addition, the mobile device needs to push the teacher's screen video stream and the whiteboard screen video stream to the server, which loses performance and causes the quality of both video streams to be low.

[0033] Based on this, the present application proposes a remote classroom live broadcast method, system, storage medium and electronic device.

[0034] See also Figure 1 , the remote classroom live broadcast method provided in the embodiment of the present application is applied to the remote classroom live broadcast system; please refer to Figure 2 The remote classroom live broadcast system includes a teaching end, several listening ends, a server and several viewing ends; the teaching end includes a master device and a first slave device; the first slave device is used to display a whiteboard screen, including the following steps:

[0035] S10: The master device responds to the remote classroom live broadcast start instruction and sends the mixed flow mode corresponding to the remote classroom live broadcast start instruction to the server.

[0036] The teaching end is the client where the teacher is located, the listening end is the client where the students are located, and the viewing end is the client where the audience watching the remote classroom live broadcast is located. The teaching end, several listening ends and several viewing ends are respectively connected to the server for communication.

[0037] The master device includes but is not limited to mobile devices such as mobile phones, tablets, and computers, and the first slave device includes but is not limited to mobile devices such as mobile phones, tablets, and computers. The master device and the first slave device are respectively connected to the server for communication.

[0038] The remote classroom live broadcast start instruction is used to instruct the start of the remote classroom live broadcast. The mixing mode corresponding to the remote classroom live broadcast start instruction is used to instruct various video streams collected during the remote classroom live broadcast to be mixed according to the screen layout or screen rules.

[0039] In an embodiment of the present application, the teacher starts a remote classroom live broadcast on the main device. Specifically, the teacher may trigger the remote classroom live broadcast control on the main device, and the main device detects the triggering operation of the remote classroom live broadcast control and generates a remote classroom live broadcast start instruction. Several mixing modes may be preset and stored on the main device, and the mixing modes include but are not limited to parallel picture mode and picture-in-picture mode. The main device may randomly select a mixing mode from several preset and stored mixing modes and send it to the server.

[0040] S20: The server obtains a mixed stream mode, a whiteboard screen video stream collected by a first slave device, a teacher screen video stream, and student screen video streams collected by a plurality of listening terminals.

[0041] In an embodiment of the present application, the first slave device only displays the whiteboard area and the functional controls for operating the whiteboard area. Specifically, the teacher can directly operate the first slave device to open the whiteboard of the first slave device, so that the first slave device displays the whiteboard area. The teacher can write in the whiteboard area and perform editing operations with the help of functional controls to generate whiteboard data, and display the whiteboard screen according to the whiteboard data. For example, the teacher can use a writing pen or a stylus to write handwriting in the whiteboard area, the teacher uses an eraser control to delete the handwriting, and uses an arrow control to drag and move the notes. The first slave device records the whiteboard screen in the whiteboard area, obtains a whiteboard screen video stream, and sends the whiteboard screen video stream to the server.

[0042] The teacher can also operate the master device, open the whiteboard of the first slave device through the master device, control the first slave device to record the whiteboard screen, and obtain the whiteboard screen video stream. Specifically, the first slave device communicates with the master device through the server, the master device sends a whiteboard opening instruction to the server, and the server sends a whiteboard screen push instruction to the first slave device, so that the first slave device opens the whiteboard according to the whiteboard screen push instruction, collects the whiteboard screen, and pushes the whiteboard screen video stream to the server.

[0043] The video stream of the teacher's screen can be obtained by the main device collecting the teacher's screen, and the main device sends the video stream of the teacher's screen to the server. It can also be obtained by other mobile devices other than the main device collecting the teacher's screen. Other mobile devices include but are not limited to mobile devices such as mobile phones, tablets, computers, cameras, and video cameras. Other mobile devices are connected to the server in communication and send the video stream of the teacher's screen to the server.

[0044] The master device also includes a whiteboard area, so that the whiteboard data of the first slave device can be shared. Specifically, the first slave device can send the whiteboard data to the master device via the server, so that the master device displays the whiteboard screen according to the whiteboard data. The master device also includes several video areas, and the master device pulls the student screen video stream pushed by each listening end from the server, obtains the teacher screen video stream, and displays the teacher screen video stream and the student screen video stream in the video area. For example, screen 1 is a whiteboard screen, screen 2 is a teacher screen, and screens 3, 4, and 5 are student screens. The display positions of the whiteboard area and several video areas of the master device can be set according to the screen layout or screen rules. The teacher can change the screen layout and screen rules on the master device, so as to display the teacher screen, the student screen and the whiteboard screen according to the changed screen layout or screen rules. In order to make the remote classroom live broadcast screen of the viewing end consistent with the screen on the master device, the master device can send the changed screen layout or screen rules as a mixed stream mode to the server. In order to make the screen of the listening end consistent with the screen on the master device, the master device can forward the changed screen layout or screen rules to the listening end via the server.

[0045] The main device also includes a toolbar. Teachers can interact with students by triggering the function controls in the toolbar. For example, they can control students to go on and off the stage, enlarge students' screens, invite students to join, and interact with students through text.

[0046] Each student's listening end can call a camera to collect the student's screen, obtain the student's screen video stream, and send the student's screen video stream to the server. Among them, the student's screen includes the student's head portrait. Each student's listening end also includes a whiteboard area, so that the whiteboard data of the first slave device can be shared. Specifically, the first slave device can send the whiteboard data to each student's listening end via the server, so that each student's listening end displays the whiteboard screen according to the whiteboard data.

[0047] S30: Several viewing terminals display mixed video streams; wherein the mixed video stream is a video stream obtained by mixing a teacher screen video stream, a whiteboard screen video stream, and several student screen video streams according to a mixing method.

[0048] In an embodiment of the present application, the server may mix the teacher's screen video stream, the whiteboard screen video stream, and several student screen video streams according to the mixing mode to obtain a mixed video stream, and send the mixed video stream to each viewing end, and each viewing end displays the mixed video stream. Alternatively, the server may send the mixing mode, the teacher's screen video stream, the whiteboard screen video stream, and several student screen video streams to each viewing end, and the viewing end may mix the teacher's screen video stream, the whiteboard screen video stream, and several student screen video streams according to the mixing mode to obtain a mixed video stream, and display the mixed video stream. Since the mixing mode is sent from the main device to the server, the remote classroom live broadcast screen displayed on the viewing end is consistent with the screen displayed on the main device.

[0049] In the live broadcast of the remote classroom, the teacher interacts with the students at the listening end through the main device. The main device can push the teacher's screen video stream, and the first slave device pushes the whiteboard screen video stream. The classroom information included at the top of the whiteboard area on the main device and the toolbar included at the bottom will not appear in the teacher's screen video stream or the whiteboard screen video stream. Therefore, the mixed video stream will not include classroom information and toolbars, which improves the quality of the remote classroom live broadcast picture at the viewing end. Since the main device pushes the teacher's screen video stream and the first slave device pushes the whiteboard screen video stream, the burden of a single device is reduced and the quality of the single device pushing a single screen is improved. In addition, when the teacher operates the whiteboard on the first slave device, the main device can adjust the shooting angle and can collect the teacher's posture at a fixed position, which not only brings convenience to the teacher's class, but also ensures the quality of the collected teacher's picture.

[0050] In the application of the embodiment of the present application, the master device responds to the remote classroom live broadcast start instruction and sends the mixed flow mode corresponding to the remote classroom live broadcast start instruction to the server; the server obtains the mixed flow mode, the whiteboard screen video stream collected by the first slave device, the teacher screen video stream and the student screen video stream collected by several listening terminals; several viewing terminals display the mixed video stream; wherein the mixed video stream is a video stream obtained by mixing the teacher screen video stream, the whiteboard screen video stream and several student screen video streams according to the mixed flow mode. The present application improves the quality of the teacher screen and the whiteboard screen by respectively pushing the teacher screen video stream and the whiteboard screen video stream through the master device and the first slave device, thereby improving the quality of the mixed video stream, and the viewing terminal can display a high-quality remote classroom live broadcast screen, thereby improving the teaching effect of the remote classroom live broadcast.

[0051] In an alternative embodiment, see Figure 2 ,The teaching end also includes a second slave device, and the teacher’s screen video stream is collected through the second slave device.

[0052] The second slave device includes but is not limited to mobile devices such as mobile phones, tablets, and computers, and the second slave device is connected to the server for communication.

[0053] In an embodiment of the present application, the teacher can directly operate the second slave device. Specifically, the teacher turns on the camera of the second slave device, adjusts the shooting angle and position of the camera, shoots the teacher, obtains the teacher screen video stream, and sends the teacher screen video stream to the server. By collecting the teacher screen video stream by the second slave device instead of the master device collecting the teacher screen video stream, the burden of the master device can be reduced.

[0054] In an alternative embodiment, see Figure 3 , before step S10, including steps S11 to S13, which are specifically as follows:

[0055] S11: The server creates a course room in response to the remote classroom live broadcast start instruction.

[0056] The course room is used to realize the server's control over the remote classroom teaching process of the lecturer and several listeners.

[0057] In the embodiment of the present application, the teacher can start the remote classroom live broadcast on the mobile device, generate a remote classroom live broadcast start instruction, send the remote classroom live broadcast start instruction to the server, and the server receives the remote classroom live broadcast start instruction and creates a course room. The mobile device can be any mobile device at the teaching end, and can be one of the first device, the second device, and the third device.

[0058] S12: Obtain the first time, the second time and the third time when the first device, the second device and the third device at the teaching end join the course room respectively.

[0059] In the embodiment of the present application, the server detects the time when the first device, the second device, and the third device respectively join the course room, and saves the time.

[0060] S13: If the first time is earlier than the second time, and the second time is earlier than the third time, determine the first device as a master device, determine the second device as a first slave device, and determine the third device as a second slave device.

[0061] In an embodiment of the present application, the server compares the time when the first device, the second device, and the third device respectively join the course room, determines the device that first joins the course room as the master device, determines the device that joins the course room last as the second slave device, and determines the device with the middle joining time as the first slave device.

[0062] The server can automatically and quickly determine the master device, the first slave device and the second slave device from the first device, the second device and the third device respectively according to the order in which the devices join the conference room.

[0063] In an alternative embodiment, see Figure 4 , before step S12, including steps S121 to S122, which are specifically as follows:

[0064] S121: The first device sends a first teaching login request to the server, the second device sends a second teaching login request to the server, and the third device sends a third teaching login request to the server; wherein, the first teaching login request includes the first teaching login account and the first device universal identification code, the second teaching login request includes the second teaching login account and the second device universal identification code; the third teaching login request includes the third teaching login account and the third device universal identification code; the first teaching login account, the second teaching login account and the third teaching login account are all the same, and the first device universal identification code, the second device universal identification code and the third device universal identification code are all different.

[0065] In the embodiment of the present application, the first teaching login account, the second teaching login account and the third teaching login account are all the same, which can be the teacher's mobile phone number, ID number, etc. The first device universal identification code, the second device universal identification code and the third device universal identification code are all different, which can be device identification codes. Specifically, it can be a universal unique identification code uuid.

[0066] S122: The server receives the first teaching login request, the second teaching login request, and the third teaching login request, and adds the first device, the second device, and the third device as teaching terminals to the course room respectively.

[0067] In the embodiment of the present application, since the teacher uses the same account to add the first device, the second device and the third device to the course room, the first device, the second device and the third device are mutually associated. That is, the master device, the first slave device and the second slave device are mutually associated. Since the first device, the second device and the third device have a unique device universal identification code, the server can distinguish the master device, the first slave device and the second slave device according to the device universal identification code.

[0068] By using the same account and universal identification codes of different devices on multiple teaching devices to log in to the course room, multiple devices can be automatically and quickly associated and communicate with each other.

[0069] In an alternative embodiment, see Figure 5 , before step S20, including steps S211 to S212, which are specifically as follows:

[0070] S211: The first slave device receives a whiteboard screen streaming instruction from the master device through the server, collects a whiteboard screen video stream, and sends the whiteboard screen video stream to the server.

[0071] Among them, since the master device and the first slave device log in to the same course room, the first slave device communicates with the master device through the server.

[0072] In an embodiment of the present application, after the master device and the first slave device log in to the same course room, the master device is associated with the first slave device, and the control button of the first slave device is displayed on the master device. The teacher can trigger the control button on the master device and send a whiteboard screen streaming instruction to the first slave device to control the first slave device to open the whiteboard, record the whiteboard screen on the first slave device, obtain the whiteboard screen video stream, and control the first slave device to send the whiteboard screen video stream to the server.

[0073] S212: The second slave device receives the teacher screen streaming instruction from the master device through the server, collects the teacher screen video stream, and sends the teacher screen video stream to the server.

[0074] Among them, since the master device and the second slave device log in to the same course room, the second slave device communicates with the master device through the server.

[0075] In an embodiment of the present application, after the master device and the second slave device log in to the same course room, the master device is associated with the second slave device, and a control button of the second slave device is displayed on the master device. The teacher can trigger the control button on the master device and send a teacher screen streaming instruction to the second slave device to control the second slave device to turn on the camera, take a picture of the teacher, obtain the teacher screen video stream, and control the second slave device to send the teacher screen video stream to the server.

[0076] Since the master device is interconnected with the first slave device and the second slave device, the teacher can directly control the first slave device and the second slave device on the master device to push the whiteboard screen video stream and the teacher screen video stream respectively, which facilitates the teacher's operation and improves teaching efficiency.

[0077] In an alternative embodiment, see Figure 6 , before step S20, including steps S221 to S223, which are as follows:

[0078] S221: The first slave device generates first whiteboard operation data in response to a touch operation on a first whiteboard area; wherein the first whiteboard area is a whiteboard area on the first slave device.

[0079] In an embodiment of the present application, touch operations include but are not limited to writing operations and editing operations. The first whiteboard operation data is the writing content and editing content of the first whiteboard area by the teacher on the first slave device, which may include handwriting in the first whiteboard area, handwriting modification, picture selection and picture editing, etc.

[0080] S222: The first slave device updates the whiteboard screen according to the first whiteboard operation data.

[0081] In the embodiment of the present application, after the teacher performs a touch operation on the first whiteboard area, the content of the whiteboard screen will change accordingly. For example, the teacher performs a writing operation on the first whiteboard area, and a first handwriting is displayed. After the teacher modifies the first handwriting, a second handwriting is displayed, and the second handwriting is the updated first handwriting.

[0082] S223: The first slave device collects the updated whiteboard screen video stream, and sends the updated whiteboard screen video stream to the server.

[0083] In an embodiment of the present application, the first slave device records the updated whiteboard screen, obtains an updated whiteboard screen video stream, and sends the updated whiteboard screen video stream to the server.

[0084] By recording the updated whiteboard screen, the whiteboard screen video stream can be updated automatically and quickly.

[0085] In an optional embodiment, the student can touch the whiteboard area at the listening end to generate whiteboard operation data, and synchronize the whiteboard operation data to the whiteboard area of ​​the master device and the first slave device through the server. Specifically, the target listening end generates the second whiteboard operation data in response to the touch operation on the second whiteboard area, and sends the second whiteboard operation data to the server. Among them, the second whiteboard area is the whiteboard area on the target listening end, and the target listening end is any one of the several listening ends. The server sends the second whiteboard operation data to the first slave device, and the first slave device changes the first whiteboard operation data according to the second whiteboard operation data to update the whiteboard screen. The first slave device records the updated whiteboard screen, obtains the updated whiteboard screen video stream, and sends the updated whiteboard screen video stream to the server. In this process, the first slave device can also transmit the second whiteboard operation data to the master device through the server to realize the update of the whiteboard screen on the master device.

[0086] In an optional embodiment, the student at the target listening end touches the second whiteboard area to generate second whiteboard operation data, which requires authorization from the master device. Specifically, the master device generates electronic whiteboard touch authorization information in response to the electronic whiteboard touch authorization operation on the target listening end, and sends the electronic whiteboard touch authorization information to the server. The server sends the electronic whiteboard touch authorization information to the target listening end, and the target listening end receives the touch operation on the second whiteboard area based on the electronic whiteboard touch authorization information. By controlling the touch authorization of the whiteboard area at the listening end through the master device, the teacher can manage the students and avoid students from accidentally touching the whiteboard area, which affects the teaching effect.

[0087] The present application also provides a system embodiment that can be used to execute the contents of the remote classroom live broadcast method in the embodiment of the present application. For details not disclosed in the system embodiment of the present application, please refer to the contents of the remote classroom live broadcast method in the embodiment of the present application.

[0088] See also Figure 7 , a remote classroom live broadcast system 10 disclosed in an embodiment of the present application includes a teaching terminal 100, a plurality of listening terminals 110, a server 120 and a plurality of viewing terminals 130; the teaching terminal 100 includes a master device 101 and a first slave device 102;

[0089] The main device 102 is used to respond to the remote classroom live broadcast start instruction and send the mixed flow mode corresponding to the remote classroom live broadcast start instruction to the server 120;

[0090] The first slave device 102 is used to display the whiteboard screen and send the collected whiteboard screen video stream to the server 120;

[0091] The server 120 is used to obtain the mixed stream mode, the whiteboard screen video stream, the teacher screen video stream and the student screen video streams sent by the multiple listening terminals 110;

[0092] Several viewing terminals 130 are used to display mixed video streams; wherein the mixed video stream is a video stream obtained by mixing the teacher's screen video stream, the whiteboard screen video stream and several student screen video streams according to a mixing method.

[0093] The remote classroom live broadcast system provided in the above embodiment and the remote classroom live broadcast method provided in the embodiment of the present application belong to the same concept. For details on the implementation process, please refer to steps S10 to S30 of the method embodiment, which will not be repeated here.

[0094] The present application also provides a device embodiment, which can be used to execute the contents of the screen directing method in the embodiment of the present application. For details not disclosed in the device embodiment of the present application, please refer to the contents of the screen directing method in the embodiment of the present application.

[0095] See also Figure 8 The present application also provides an electronic device 300, which can be a computer, a remote classroom live broadcast device, etc. In an exemplary embodiment of the present application, the electronic device 300 is a remote classroom live broadcast device, which includes: at least one processor 301, at least one memory 302, at least one display, at least one network interface 303, a user interface 304, and at least one communication bus 305.

[0096] The user interface 304 is mainly used to provide an input interface for the user and obtain data input by the user. Optionally, the user interface may also include a standard wired interface or a wireless interface.

[0097] The network interface 303 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0098] The communication bus 305 is used to realize the connection and communication between these components.

[0099] Among them, the processor 301 may include one or more processing cores. The processor uses various interfaces and lines to connect various parts of the entire electronic device, and executes various functions of the electronic device and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory, and calling data stored in the memory. Optionally, the processor can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor can integrate one or more combinations of central processing unit (Central Processing Unit, CPU), image processor (Graphics Processing Unit, GPU) and modem. Among them, the CPU mainly processes the operating system, user interface and application program, etc.; the GPU is responsible for rendering and drawing the content to be displayed by the display layer; the modem is used to process wireless communication. It can be understood that the above-mentioned modem may not be integrated into the processor, but implemented by a single chip.

[0100] Among them, the memory 302 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory includes a non-transitory computer-readable storage medium. The memory can be used to store instructions, programs, codes, code sets or instruction sets. The memory may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned method embodiments, etc.; the data storage area may store data involved in the above-mentioned method embodiments, etc. The memory may also be optionally at least one storage device located away from the aforementioned processor. As Figure 8 As shown, the memory as a computer storage medium may include an operating system, a network communication module, a user interface module, and an operating application program.

[0101] The processor can be used to call the application of the remote classroom live broadcast method of the remote classroom live broadcast device stored in the memory, and specifically execute the method steps of the above-mentioned embodiment. The specific execution process can refer to the specific description shown in the method embodiment, which will not be repeated here.

[0102] The present application also provides a computer-readable storage medium on which a computer program is stored, and the instructions are suitable for being loaded by a processor and executing the method steps of the above-mentioned embodiment. The specific execution process can refer to the specific description shown in the embodiment, and will not be repeated here. The device where the storage medium is located can be a personal computer, a laptop computer, a smart phone, a tablet computer, a picture director device and other electronic devices.

[0103] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can refer to the partial description of the method embodiments. The device embodiments described above are merely schematic, wherein the components described as separate parts may or may not be physically separated, and the parts displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present application scheme. A person of ordinary skill in the art can understand and implement it without paying any creative work.

[0104] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0105] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the function selected in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 function selected in a box or multiple boxes.

[0106] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 steps for the function selected in a box or multiple boxes.

[0107] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0108] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0109] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0110] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0111] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A remote classroom live broadcast method, characterized in that: The method is applied to a remote classroom live broadcast system; the remote classroom live broadcast system includes a teaching end, a plurality of listening ends, a server and a plurality of viewing ends; the teaching end includes a master device and a first slave device; the first slave device is used to display a whiteboard screen; the method includes the following steps: The master device responds to the remote classroom live broadcast start instruction and sends the mixed flow mode corresponding to the remote classroom live broadcast start instruction to the server; The server obtains the mixed stream mode, the whiteboard screen video stream collected by the first slave device, the teacher screen video stream, and the student screen video streams collected by the plurality of the listening terminals; Several viewing terminals display mixed video streams; wherein, the mixed video stream is a video stream obtained by mixing the teacher screen video stream, the whiteboard screen video stream and several student screen video streams according to the mixing method.

2. The remote classroom live broadcast method according to claim 1, characterized in that: The teaching end also includes a second slave device; the teacher's screen video stream is collected through the second slave device.

3. The remote classroom live broadcast method according to claim 2, characterized in that: Before the server obtains the mixed stream mode, the whiteboard screen video stream collected by the first slave device, the teacher screen video stream and the student screen video streams collected by the plurality of the listening terminals, the following steps are also included: The first slave device receives a whiteboard screen streaming instruction from the master device through the server, collects a whiteboard screen video stream, and sends the whiteboard screen video stream to the server; The second slave device receives the teacher screen streaming instruction of the master device through the server, collects the teacher screen video stream, and sends the teacher screen video stream to the server.

4. The remote classroom live broadcast method according to claim 2, characterized in that: Before the master device responds to the remote classroom live broadcast start instruction and sends the mixed stream mode corresponding to the remote classroom live broadcast start instruction to the server, the master device also includes the following steps: The server creates a course room in response to the remote classroom live broadcast start instruction; Obtain the first time, the second time and the third time that the first device, the second device and the third device of the teaching end join the course room respectively; If the first time is earlier than the second time, and the second time is earlier than the third time, the first device is determined as the master device, the second device is determined as the first slave device, and the third device is determined as the second slave device.

5. The remote classroom live broadcast method according to claim 4, characterized in that: Before the step of obtaining the first time, the second time and the third time when the first device, the second device and the third device of the teaching end join the course room respectively, the method includes: The first device sends a first teaching login request to the server, the second device sends a second teaching login request to the server, and the third device sends a third teaching login request to the server; wherein the first teaching login request includes a first teaching login account and a first device universal identification code, the second teaching login request includes a second teaching login account and a second device universal identification code; the third teaching login request includes a third teaching login account and a third device universal identification code; the first teaching login account, the second teaching login account and the third teaching login account are all the same, and the first device universal identification code, the second device universal identification code and the third device universal identification code are all different; The server receives the first teaching login request, the second teaching login request and the third teaching login request, and adds the first device, the second device and the third device as teaching terminals to the course room respectively.

6. The remote classroom live broadcast method according to any one of claims 1 to 5, characterized in that: include: Before the server obtains the mixed stream mode, the whiteboard screen video stream collected by the first slave device, the teacher screen video stream, and the student screen video streams collected by the plurality of the listening terminals, the step includes: The first slave device generates first whiteboard operation data in response to a touch operation on a first whiteboard area; wherein the first whiteboard area is a whiteboard area on the first slave device; The first slave device updates the whiteboard screen according to the first whiteboard operation data; The first slave device collects an updated whiteboard screen video stream, and sends the updated whiteboard screen video stream to the server.

7. The remote classroom live broadcast method according to any one of claims 1 to 5, characterized in that: The step of displaying the mixed video stream on the plurality of viewing terminals comprises: The server mixes the teacher screen video stream, the whiteboard screen video stream and a plurality of student screen video streams according to the mixing mode to obtain a mixed video stream; and sends the mixed video stream to a plurality of viewing terminals; Several viewing terminals display the mixed video stream.

8. A remote classroom live broadcast system, characterized in that: It includes a teaching end, several listening ends, a server and several viewing ends; the teaching end includes a master device and a first slave device; The master device is used to respond to the remote classroom live broadcast start instruction and send the mixed flow mode corresponding to the remote classroom live broadcast start instruction to the server; The first slave device is used to display a whiteboard screen and send a collected whiteboard screen video stream to the server; The server is used to obtain the mixed stream mode, the whiteboard screen video stream, the teacher screen video stream and the student screen video streams sent by the plurality of listening terminals; The several viewing terminals are used to display mixed video streams; wherein the mixed video stream is a video stream obtained by mixing the teacher screen video stream, the whiteboard screen video stream and several student screen video streams according to the mixing method.

9. An electronic device comprising a display, a processor and a memory; characterized in that: The memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the remote classroom live broadcast method as described in any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the remote classroom live broadcast method as described in any one of claims 1 to 7 is implemented.

Images