Direct wideband method and generator

Abstract

The invention reveals a method, machine, and system for direct broadcasting, a server, terminal, and computer-readable storage medium. In this method, the first server identifies the first information of the first terminal, wherein the first information is used to indicate the destination media stream that the first terminal needs to receive; the first server receives the first media stream generated in the direct broadcasting procedure; and the first server transmits the destination media stream in the first media stream to the first terminal in accordance with the indication of the first information.According to the invention, the first terminal can selectively display the content of media streams, avoiding the problem of displaying too many types of media streams on the same first terminal, preventing the problem of relatively small display space for media streams, avoiding the problem of users being unable to clearly see the content directly, and improving the user's viewing experience.

Description

Live broadcast method, device and system

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on February 20, 2021, with application number 202110192823.9 and invention name “A live broadcast method, device and system”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of communication technology, and in particular to a live broadcast method, device and system. Background Art

[0003] Currently, live streaming technology is widely used to meet the needs of user communication and interaction. During a live broadcast, the user who generates the live content typically generates a live media stream through a terminal device and transmits this media stream to a cloud server. The cloud server then transmits the media stream to other terminal devices, allowing other terminal devices to display the live content based on the received media stream for other users to watch.

[0004] For example, referring to Figure 1, during the live broadcast of an online class, the user who generates the live content is usually a teacher, and the user who watches the live content is usually a student. The terminal device on the teacher's side can generate a live media stream during the live broadcast, and transmit the media stream to the terminal device on the student side through the cloud server for the student to watch the online class.

[0005] Furthermore, as user communication needs increase, the types of media streams generated during live streaming are increasing. For example, during a live online course, a teacher can share courseware on their desktop so that students can view it. In this case, the media stream includes the shared desktop media stream. To enhance the fun of the course, the teacher's terminal device may include a camera for capturing the teacher's posture, allowing students to see the teacher's posture during the online course. In this case, the media stream includes the camera's media stream. To enhance the interactivity between teachers and students, both the teacher's and student's terminal devices can display a chat box for the teacher and students to exchange information. Accordingly, the media stream also includes the media stream of the exchanged information.

[0006] If the live broadcast includes multiple media streams, the cloud server can receive the multiple media streams at the same time and push the multiple media streams to the terminal device on the display side.

[0007] In the scenario of the above example, see Figure 2, the terminal device on the teacher's side can generate multiple media streams and transmit the multiple media streams to the cloud server respectively. After receiving the multiple media streams, the cloud server processes the multiple media streams and then pushes them to the terminal device on the student side. The terminal device on the student side decodes the multiple media streams and displays the content of the media streams.

[0008] That is to say, if the media stream during the live broadcast includes multiple media streams, under the push of the cloud server, the same terminal device on the display side will often receive and display multiple media streams at the same time.

[0009] When displaying multiple media streams, terminal devices typically divide the screen into multiple areas, each dedicated to displaying a specific media stream. This often results in a smaller display space for each stream, impacting the user's viewing experience and sometimes even preventing the user from clearly seeing the content.

[0010] Summary of the Invention

[0011] In order to solve the problem in existing live broadcast technology that multiple media streams are displayed on the same screen of a terminal device, affecting the user's viewing experience, the embodiments of the present application provide a live broadcast method, device and system.

[0012] In a first aspect, an embodiment of the present application discloses a live broadcast method, comprising:

[0013] The first server determines first information of the first terminal device, where the first information is used to indicate a target media stream that the first terminal device needs to obtain;

[0014] The first server receives a first media stream generated during the live broadcast;

[0015] The first server transmits the target media stream in the first media stream to the first terminal device according to an instruction of the first information.

[0016] Through the above steps, the first terminal device can obtain the target media stream transmitted by the first server. Accordingly, the first terminal device only needs to display the content of the target media stream, thereby avoiding too many types of media streams being crowded in the same first terminal device for display, avoiding the problem of a small display space for the media stream, and further avoiding the problem of users being unable to clearly watch the live content, thereby improving the user's viewing experience.

[0017] In an optional design, the first information includes information of the target media stream;

[0018] Alternatively, the first information includes an account level of a first account of the first terminal device, where the first account is an account registered by the first terminal device on the first server.

[0019] In an optional design, the first information includes information of the target media stream, and the first server transmits the target media stream in the first media stream to the first terminal device according to an instruction of the first information, including:

[0020] The first server determines the target media stream in the first media stream according to the information of the target streaming media;

[0021] The first server transmits the target media stream to the first terminal device.

[0022] Through the above steps, the first server can determine the target media stream required by the first terminal device according to the information of the target media stream transmitted by the first terminal device.

[0023] In an optional design, the first information includes an account level of a first account of the first terminal device, and the first server transmits the target media stream in the first media stream to the first terminal device according to an instruction of the first information, including:

[0024] The first server determines the target media stream in the first media stream according to the media stream levels corresponding to various media streams in the first media stream and the account level;

[0025] The first server transmits the target media stream to the first terminal device.

[0026] Through the above steps, the first server can determine the target media stream required by the first terminal device according to the account level of the first account of the first terminal device.

[0027] An optional design also includes:

[0028] The first server determines, based on registration information of a first account of the first terminal device, that the first terminal device has permission to obtain the target media stream, where the first account is an account registered by the first terminal device on the first server.

[0029] Through this step, the first server can detect whether the first terminal device has the authority to obtain the target media stream, thereby improving the reliability of the communication system.

[0030] In a second aspect, an embodiment of the present application discloses a live broadcast method, comprising:

[0031] The first terminal device transmits first information to the first server, where the first information is used to indicate a target media stream that the first terminal device needs to obtain;

[0032] The first terminal device receives a target media stream transmitted by the first server;

[0033] The first terminal device displays the content of the target media stream.

[0034] Through the above steps, the first terminal device only needs to display the content of the target media stream, thereby avoiding too many types of media streams being displayed in the same first terminal device, avoiding the problem of a small display space for the media stream, and further avoiding the problem of users being unable to clearly watch the live content, thereby improving the user's viewing experience.

[0035] In an optional design, the first information includes information of the target media stream;

[0036] Alternatively, the first information includes an account level of a first account of the first terminal device, where the first account is an account registered by the first terminal device on the first server.

[0037] In an optional design, the first information includes information of the target media stream, and the first terminal device transmits the first information to the first server, including:

[0038] The first terminal device displays a registration interface for a first account, where the first account is an account registered by the first terminal device on the first server, and the registration interface includes at least one media stream option;

[0039] Receiving, by the first terminal device, a first operation on an option of the at least one media stream, the first operation being used to select a target media stream from the at least one media stream;

[0040] The first terminal device transmits the first information to the first server according to the first operation.

[0041] Through the above steps, the first terminal device can obtain first information including information of the target media stream, and transmit the first information to the first server, so that the first server determines the target media stream of the first terminal device according to the first information.

[0042] An optional design also includes:

[0043] receiving, by the first terminal device, a second operation;

[0044] In response to the second operation, the first terminal device displays a selection interface including options for at least one media stream;

[0045] The first terminal device receives a third operation on the selection interface, where the third operation is used to select a target media stream that the first terminal device needs to obtain;

[0046] The first terminal device adjusts the first information according to the third operation, and transmits the adjusted first information to the first server, where the adjusted first information includes information of the target media stream selected by the third operation.

[0047] In a first aspect, an embodiment of the present application discloses a live broadcast device, comprising:

[0048] Processor and transceiver interface;

[0049] The processor is configured to determine first information of a first terminal device, where the first information is used to indicate a target media stream that the first terminal device needs to obtain;

[0050] The transceiver interface is used to receive a first media stream generated during a live broadcast process, and transmit the target media stream in the first media stream to the first terminal device according to an instruction of the first information.

[0051] In an optional design, the first information includes information of the target media stream;

[0052] Alternatively, the first information includes an account level of a first account of the first terminal device, where the first account is an account registered by the first terminal device on the first server.

[0053] In an optional design, the first information includes information of the target media stream;

[0054] The transceiver interface is specifically configured to transmit the target media stream to the first terminal device after the processor determines the target media stream in the first media stream according to the information of the target streaming media.

[0055] In an optional design, the first information includes an account level of the first account of the first terminal device;

[0056] The transceiver interface is specifically configured to transmit the target media stream to the first terminal device after the processor determines the target media stream in the first media stream according to the media stream levels corresponding to various media streams in the first media stream and the account level.

[0057] In an optional design, the processor is further used to determine whether the first terminal device has the authority to obtain the target media stream based on the registration information of the first account of the first terminal device, where the first account is the account registered by the first terminal device on the first server.

[0058] In a first aspect, an embodiment of the present application discloses a live broadcast device, comprising:

[0059] Processor and transceiver interface;

[0060] The transceiver interface is used to transmit first information to the first server, where the first information is used to indicate a target media stream that the first terminal device needs to obtain, and receive the target media stream transmitted by the first server;

[0061] The processor is configured to control a screen to display the content of the target media stream.

[0062] In an optional design, the first information includes information of the target media stream;

[0063] Alternatively, the first information includes an account level of a first account of the first terminal device, where the first account is an account registered by the first terminal device on the first server.

[0064] In an optional design, the first information includes information of the target media stream;

[0065] The transceiver interface is specifically configured to, after displaying a registration interface for the first account and receiving a first operation for an option of the at least one media stream, transmit the first information to the first server according to the first operation;

[0066] The first account is an account registered by the first terminal device on the first server, the registration interface includes at least one media stream option, and the first operation is used to select a target media stream from the at least one media stream.

[0067] In an optional design, the transceiver interface is further used to receive a second operation;

[0068] The processor is further configured to, in response to the second operation, display a selection interface including options for at least one media stream;

[0069] The transceiver interface is further configured to receive a third operation on the selection interface, where the third operation is configured to select a target media stream that the first terminal device needs to obtain;

[0070] The processor is further configured to adjust the first information according to the third operation;

[0071] The processor is further configured to transmit the adjusted first information to the first server, where the adjusted first information includes information of the target media stream selected by the third operation.

[0072] In a third aspect, an embodiment of the present application discloses a server, comprising:

[0073] at least one processor and memory,

[0074] The memory is used to store program instructions;

[0075] The processor is used to call and execute the program instructions stored in the memory so that the terminal device executes the live broadcast method described in the first aspect.

[0076] In a fourth aspect, an embodiment of the present application discloses a terminal device, including:

[0077] at least one processor and memory,

[0078] The memory is used to store program instructions;

[0079] The processor is used to call and execute the program instructions stored in the memory so that the terminal device executes the live broadcast method described in the second aspect.

[0080] In a fifth aspect, an embodiment of the present application discloses a live broadcast system, including:

[0081] The server according to the third aspect;

[0082] The terminal device described in the fourth aspect.

[0083] In a sixth aspect, an embodiment of the present application discloses a computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium. When the computer-readable storage medium is run on a computer, the computer executes the live broadcast method described in the first aspect.

[0084] In a seventh aspect, an embodiment of the present application discloses a computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium. When the computer-readable storage medium is run on a computer, the computer executes the live broadcast method described in the second aspect.

[0085] An embodiment of the present application provides a live broadcast method, device, and system. In the method, a first server obtains first information of a first terminal device, where the first information is used to indicate a target media stream that the first terminal device needs to obtain; then, the first server receives a first media stream generated during the live broadcast process, and after receiving the first media stream, transmits the target media stream in the first media stream to the first terminal device.

[0086] In existing live broadcast solutions, the terminal device used to display live content often obtains all types of media streams generated during the live broadcast and displays the content of all types of media streams on the terminal device's screen. The media stream generated during the live broadcast is set as the first media stream. In the prior art, the terminal device will display the content of all types of media streams included in the first media stream, where the content of different types of media streams is displayed in different areas of the terminal device's screen. Because the terminal device needs to display all types of media streams, the display space for each media stream is relatively small, affecting the user's viewing experience. In some cases, the user may even be unable to clearly see the content displayed on the screen.

[0087] With the solution provided by the embodiments of the present application, the first terminal device can transmit first information to the first server to indicate the target media stream it wishes to obtain. In this case, the first server transmits the target media stream within the first media stream to the first terminal device, and the first terminal device only needs to display the content of the target media stream. Therefore, the first terminal device can selectively display the content of the media stream, thereby avoiding the problem of too many different media streams being crowded together on the same first terminal device, thus avoiding the problem of a small display space for the media streams, and further preventing the user from being unable to clearly view the live broadcast content, thereby improving the user's viewing experience.

[0088] Furthermore, in the solution provided in the embodiments of the present application, the first terminal device only needs to display the content of the target media stream, which is one or more media streams among all the media streams generated during the live broadcast. In this case, if the user of the first terminal device is only interested in a portion of the total media streams, the first terminal device can use these portions as the target media streams. Accordingly, the first terminal device only needs to display the content of these portions. Compared with the prior art, the display area of ​​these portions of the media streams on the screen is expanded, making it easier for users to view the content they are interested in, thereby improving the user experience.

[0089] Furthermore, if a user owns multiple first terminal devices, the target media streams for each of the user's first terminal devices can be different. In this case, each of the user's first terminal devices can receive different target media streams, allowing each first terminal device to display different media stream contents. This solution not only allows users to view different live broadcast content through different first terminal devices, but also expands the display area of ​​various media streams on the screen compared to existing technologies. Furthermore, each of the user's first terminal devices operates independently without interfering with each other, improving the user experience during the live broadcast. BRIEF DESCRIPTION OF THE DRAWINGS

[0090] FIG1 is a schematic diagram of information interaction during a live broadcast;

[0091] FIG2 is a schematic diagram of information interaction during another live broadcast;

[0092] FIG3 is an example diagram of a communication system provided by the prior art;

[0093] FIG4 is an example diagram of a screen in existing live broadcast technology;

[0094] FIG5( a ) is a schematic diagram of a communication system disclosed in an embodiment of the present application;

[0095] FIG5( b ) is a schematic diagram of a communication system disclosed in an embodiment of the present application;

[0096] FIG6 is a schematic structural diagram of a terminal device disclosed in an embodiment of the present application;

[0097] FIG7 is a schematic diagram of a workflow of a live broadcast method disclosed in an embodiment of the present application;

[0098] FIG8( a ) is a schematic diagram of an interface of a terminal device in a live broadcast method disclosed in an embodiment of the present application;

[0099] FIG8( b ) is a schematic diagram of an interface of another terminal device in a live broadcast method disclosed in an embodiment of the present application;

[0100] FIG8( c ) is a schematic diagram of an interface of another terminal device in a live broadcast method disclosed in an embodiment of the present application;

[0101] FIG8( d ) is a schematic diagram of an interface of another terminal device in a live broadcast method disclosed in an embodiment of the present application;

[0102] FIG9( a ) is a schematic diagram of an interface of a terminal device in a live broadcast method in the prior art;

[0103] FIG9( b ) is a schematic diagram of an interface of another terminal device in a live broadcast method in the prior art;

[0104] FIG10 is a schematic diagram of a workflow of a live broadcast method disclosed in an embodiment of the present application;

[0105] FIG11 is a schematic diagram of a workflow of a live broadcast method disclosed in an embodiment of the present application;

[0106] FIG12 is a schematic diagram of a workflow of a live broadcast method disclosed in an embodiment of the present application;

[0107] FIG13 is a schematic diagram of a workflow of a live broadcast method disclosed in an embodiment of the present application;

[0108] FIG14 is a schematic diagram of information interaction of a communication system disclosed in an embodiment of the present application;

[0109] FIG15 is a schematic structural diagram of a live broadcast device disclosed in an embodiment of the present application;

[0110] FIG16 is a schematic diagram of the structure of a server disclosed in an embodiment of the present application. DETAILED DESCRIPTION

[0111] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0112] In the description of the embodiments of this application, unless otherwise specified, " / " represents or. For example, A / B can represent A or B. "And / or" in this article is simply a description of the association relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of this application, "plurality" means two or more than two.

[0113] In the following, the terms "first" and "second" are used for description purposes only. In the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0114] To make the description of the following embodiments clear and concise, a brief introduction to the related technologies is first given:

[0115] An example diagram of a current communication system for live streaming is shown in Figure 3. Referring to Figure 3, a current communication system typically includes a production terminal 10, a cloud server 20, and a display terminal 30. The production terminal 10 refers to a terminal device capable of generating a live media stream. For example, the production terminal 10 may be a terminal device on the live streaming target side. The live streaming target typically refers to the user being broadcast during the live streaming process. For example, in an online training scenario, the live streaming target is typically the lecturer; in an online conference scenario, the live streaming target is typically the speaker at the conference.

[0116] The production terminal 10 is connected to the cloud server 20 via a communication network. During the live broadcast process, the production terminal 10 generates a live media stream and transmits the live media stream to the cloud server 20 via the communication network.

[0117] The display terminal 30 is a terminal device for displaying live content, wherein the display terminal 30 is usually placed on the user side of watching the live content. For example, in an online course training scenario, the display terminal 30 is located on the student side watching the online course; in an online conference scenario, the display terminal 30 is located on the user side watching the conference content.

[0118] In addition, the display terminal 30 is also connected to the cloud server 20 via a communication network. After receiving the media stream transmitted by the production terminal 10, the cloud server 20 transmits the media stream to the display terminal 30 in real time via the communication network. After receiving the media stream, the display terminal 30 decodes and displays the media stream, allowing users on the display terminal 30 to view the live content.

[0119] The media streams generated by the production terminal 10 often include multiple types. Currently, after receiving the multiple media streams transmitted by the production terminal 10, the cloud server 20 will simultaneously transmit all media streams included in the live broadcast content to each display terminal 30. In other words, currently, a display terminal 30 can simultaneously receive all types of media streams generated during the live broadcast process and display the content of all types of media streams simultaneously.

[0120] For example, during a live online class, the teacher can share the courseware on the desktop so that students can watch the courseware. The media stream includes the media stream of the shared desktop. In order to increase the fun of the course, the terminal device on the teacher's side may include a camera for capturing the teacher's posture so that students can see the teacher's posture while watching the online class. In this case, the media stream includes the media stream of the camera. In order to improve the interactivity between teachers and students, the terminal devices on both the teacher's side and the student's side can display a chat box for teachers and students to exchange information through the chat box. Accordingly, the media stream also includes the media stream of the exchange information.

[0121] In this case, during the live broadcast, the production terminal 10 will simultaneously generate a media stream for the shared desktop, a media stream for the camera, and a media stream for communication information. Furthermore, under the push of the cloud server 20, a display terminal 30 can simultaneously receive these three media streams and display the contents of these three media streams on the screen of the display terminal 30.

[0122] Furthermore, after receiving multiple media streams, the display terminal 30 typically displays the content of each media stream in different areas of the screen. Referring to the example diagram shown in FIG4 , in this example, the display terminal 30 divides the screen into three areas. The left area displays the content of the shared desktop media stream. Through this area, users watching the live broadcast can view the shared desktop and understand the courseware content. In this example, the live online course content is an introduction to mountain ranges, and the courseware content is an image of the mountain range. Accordingly, the left area displays the image of the mountain range. Furthermore, the upper right area of ​​the screen displays the content of the camera media stream. Through this area, users watching the live broadcast can observe the teacher's gestures and other body movements. The lower right area of ​​the screen displays the content of the communication information media stream. Through this area, users watching the live broadcast can view communication messages between other users and upload their own communication messages to communicate with other users. In this example, the student "sunnny" asks the teacher a question through uploaded communication messages. The teacher answers the student's question through uploaded communication messages. Furthermore, the student "Beautiful Spring" also uploads her own communication message, asking the teacher to introduce the resources of the mountain range.

[0123] In the current live broadcast solution, a display terminal 30 needs to display the contents of multiple media streams simultaneously. That is, multiple media streams are squeezed onto the same screen of the display terminal 30, which often results in a relatively small display space for each media stream, affecting the user's viewing experience. In some cases, the user may even be unable to see the displayed content clearly.

[0124] In order to solve the problem in existing live broadcast technology that multiple media streams are displayed on the same screen of a display terminal, affecting the user's viewing experience, the embodiments of the present application provide a live broadcast method, device and system.

[0125] To clarify the solution provided by the embodiments of this application, Figures 5(a) and 5(b) are provided in the embodiments of this application. Figures 5(a) and 5(b) illustrate a communication system that utilizes the live broadcast method provided by the embodiments of this application. The communication system includes a first terminal device 40, a first server 50, and a second terminal device 60.

[0126] The first terminal device 40 is a terminal device that displays live content. In this embodiment of the present application, the same user watching the live broadcast can be equipped with multiple first terminal devices 40, and different first terminal devices 40 can display different media streams. Furthermore, the multiple first terminal devices 40 equipped by the same user can be the same terminal device or different terminal devices.

[0127] For example, in Figures 5(a) and 5(b), user 1 is equipped with three first terminal devices 40, which may be a computer, a mobile phone, and a television. Furthermore, user 2 is equipped with two first terminal devices 40, which may be a computer and a mobile phone, and user n is equipped with two first terminal devices 40, which may be a computer and a television.

[0128] In the solution provided in the embodiments of the present application, the first terminal device 40 may transmit first information to the first server 50, where the first information is used to indicate the target media stream that the first terminal device 40 wishes to obtain. If the same user is equipped with multiple first terminal devices 40, and different first terminal devices 40 wish to display different media stream contents, the different first terminal devices 40 may transmit different first information to indicate that the different first terminal devices 40 wish to obtain different target media streams.

[0129] The second terminal device 60 is a terminal device that generates live content. Furthermore, the second terminal device 60 is connected to the first server 50 via a communication network. After generating a live media stream, the second terminal device 60 transmits the media stream to the first server 50 in real time via the communication network.

[0130] In the communication system, the second terminal device 60 may include one or more second terminal devices 60 , and during the live broadcast process, the second terminal device 60 may generate multiple media streams.

[0131] For example, in Figure 5(a), there is a second terminal device 60, which is a computer and generates multiple types of media streams. Alternatively, in Figure 5(b), there are two second terminal devices 60, one a computer and one a camera. In this case, different second terminal devices can generate different types of media streams. After generating a media stream, the second terminal device 60 transmits the media stream to the first server. The media stream transmitted by the second terminal device is referred to as a first media stream, which may include at least one media stream.

[0132] In addition, after receiving the media stream, the first server 50 may transmit a target media stream that meets the needs of each first terminal device 40 to each first terminal device 40 according to the first information transmitted by each first terminal device 40, so that each first terminal device 40 obtains the target media stream that meets its own needs.

[0133] In this case, if different first terminal devices 40 equipped with the same user wish to display different media stream contents, the first information transmitted by the different first terminal devices 40 will indicate different media streams. Accordingly, the first server 50 can transmit different media streams to the different first terminal devices 40 based on the first information, thereby enabling the different first terminal devices 40 to display different media stream contents.

[0134] Through the communication system provided in the embodiment of the present application, the first terminal device can selectively display the content of the media stream, thereby avoiding too many types of media streams being displayed in the same first terminal device, avoiding the problem of users being unable to clearly view the live content, and improving the user's viewing experience.

[0135] In addition, it should be noted that the above-mentioned communication network can be a local area network, or a wide area network transferred through a relay device, or include a local area network and a wide area network. When the communication network is a local area network, illustratively, the communication network can be a short-range communication network such as a WiFi hotspot network, a WiFi peer-to-peer (P2P) network, a Bluetooth network, a ZigBee network, or a near-field communication (NFC) network. When the communication network is a wide area network, illustratively, the communication network can be a third-generation wireless telephone technology (3G) network, a fourth-generation mobile communication technology (4G) network, a fifth-generation mobile communication technology (5G) network, a future-evolved public land mobile network (PLMN) or the Internet, etc., and this application does not limit this.

[0136] In addition, it should be understood that Figures 5(a) and 5(b) are only for ease of understanding and schematically illustrate a communication system, but this should not constitute any limitation on the present application. The communication system can also include a larger number of servers and a larger number of terminal devices. The servers communicating with different terminal devices can be the same server or different servers, and the number of servers communicating with different terminal devices can be the same or different. The embodiments of the present application do not limit this. It should also be understood that the server in the communication system can be any device with transceiver functions or a chip that can be set in the device.

[0137] Furthermore, in the embodiments of the present application, the first terminal device can be a variety of terminal devices. In some embodiments, the first terminal device can be a mobile phone, tablet computer, desktop computer, laptop computer, notebook computer, ultra-mobile personal computer (UMPC), handheld computer, netbook computer, or other terminal device capable of displaying live content. This application does not impose any particular restrictions on the specific form of the terminal device.

[0138] Taking a smartphone as an example, the first terminal device may be shown in FIG6 . Referring to FIG6 , the terminal device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a radio frequency module 150, a communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195.

[0139] It should be understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the mobile phone. In other embodiments of this application, the mobile phone may include more or fewer components than shown in the figure, or some components may be combined or separated, or the components may be arranged differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0140] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0141] The controller can be the nerve center and command center of the mobile phone. It can generate operation control signals based on instruction opcodes and timing signals to complete the control of instruction fetching and execution.

[0142] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0143] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0144] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C busses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, and the like via different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K via the I2C interface, enabling communication between the processor 110 and the touch sensor 180K via the I2C bus interface, thereby enabling the touch function of the mobile phone.

[0145] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.

[0146] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0147] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the communication module 160. For example, the processor 110 communicates with the Bluetooth module in the communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the communication module 160 via the UART interface, enabling the function of playing music through Bluetooth headphones.

[0148] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the phone's camera function. The processor 110 and the display 194 communicate via the DSI interface to implement the phone's display function.

[0149] The GPIO interface can be configured via software. It can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display 194, communication module 160, audio module 170, sensor module 180, and the like. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

[0150] USB port 130 is an interface that complies with USB standards and specifications, and may be a Mini USB port, a Micro USB port, a USB Type-C port, or the like. USB port 130 can be used to connect a charger to charge the phone, transfer data between the phone and peripheral devices, connect headphones to play audio, and connect to other devices, such as AR devices.

[0151] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the mobile phone. In other embodiments of the present application, the mobile phone may also adopt a different interface connection method from the above embodiments, or a combination of multiple interface connection methods.

[0152] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the phone's wireless charging coil. While charging the battery 142, the charging management module 140 can also provide power to the terminal device via the power management module 141.

[0153] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0154] The wireless communication function of the mobile phone can be realized through antenna 1, antenna 2, radio frequency module 150, communication module 160, modem processor and baseband processor.

[0155] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in a mobile phone can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0156] The RF module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G used in mobile phones. The RF module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The RF module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The RF module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the RF module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the RF module 150 can be set in the same device as at least some of the modules of the processor 110.

[0157] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the RF module 150 or other functional modules.

[0158] The communication module 160 can provide wireless communication solutions for mobile phones, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The communication module 160 can be one or more devices that integrate at least one communication processing module. The communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0159] In some embodiments, the mobile phone's antenna 1 is coupled to the RF module 150, and the antenna 2 is coupled to the communication module 160, so that the mobile phone can communicate with the network and other devices via wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite-based augmentation system (SBAS).

[0160] The mobile phone implements its display functions through a GPU, display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information. In the embodiment of the present application, the display screen 194 may include a display and a touch-sensitive device. The display is used to output display content to the user, and the touch-sensitive device is used to receive touch events input by the user on the display screen 194.

[0161] In a mobile phone, the sensor module 180 may include one or more of a gyroscope, an acceleration sensor, a pressure sensor, an air pressure sensor, a magnetic sensor (such as a Hall sensor), a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, a pyroelectric infrared sensor, an ambient light sensor or a bone conduction sensor, and the embodiments of the present application do not impose any restrictions on this.

[0162] The mobile phone can realize the shooting function through ISP, camera 193, video codec, GPU, flexible display 194 and application processor.

[0163] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0164] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the mobile phone may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0165] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when a mobile phone selects a frequency, the DSP performs a Fourier transform on the frequency energy.

[0166] Video codecs are used to compress or decompress digital video. A mobile phone may support one or more video codecs. This allows it to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0167] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU enables intelligent cognitive applications in mobile phones, such as image recognition, face recognition, voice recognition, and text comprehension.

[0168] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the phone's storage capacity. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage. For example, files such as music and videos can be stored on the external memory card.

[0169] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the mobile phone by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0170] The mobile phone can implement audio functions such as network standard determination and recording through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0171] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0172] The speaker 170A, also called a "speaker," is used to convert audio electrical signals into sound signals. The mobile phone can listen to music or make hands-free calls through the speaker 170A.

[0173] The receiver 170B, also called the "earpiece", is used to convert audio electrical signals into sound signals. When the mobile phone receives a call or voice message, the voice can be heard by placing the receiver 170B close to the human ear.

[0174] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The mobile phone can be provided with at least one microphone 170C. In other embodiments, the mobile phone can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the mobile phone can also be provided with three, four or more microphones 170C to realize sound signal collection, noise reduction, and identification of sound sources, and realize directional recording function, etc.

[0175] The headphone jack 170D is used to connect a wired headphone and can be the USB interface 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0176] Keys 190 include a power button, a volume button, and the like. Keys 190 may be mechanical keys or touch-sensitive keys. The mobile phone may receive key inputs and generate key signal inputs related to user settings and function control of the mobile phone.

[0177] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the flexible display 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0178] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0179] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the mobile phone by inserting it into or removing it from the SIM card interface 195. The mobile phone can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The mobile phone interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the mobile phone uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the mobile phone and cannot be separated from the mobile phone.

[0180] Furthermore, operating systems run on the above components, such as the iOS operating system developed by Apple, the Android open-source operating system developed by Google, and the Windows operating system developed by Microsoft. Application programs can be installed and run on these operating systems.

[0181] In order to solve the problem in existing live broadcast technology that multiple media streams are displayed on the same screen of a display terminal, affecting the user's viewing experience, the embodiments of the present application provide a live broadcast method, device and system.

[0182] In order to clarify the solution provided by this application, the solution provided by this application is introduced and explained through various embodiments in conjunction with the accompanying drawings.

[0183] Referring to the workflow diagram shown in FIG7 , the live broadcast method provided in the embodiment of the present application includes the following steps:

[0184] Step S11: The first server determines first information of a first terminal device, where the first information is used to indicate a target media stream that the first terminal device needs to obtain.

[0185] In an embodiment of the present application, the first server is connected to a first terminal device and a second terminal device through a communication network, respectively, wherein the first terminal device includes a terminal device for displaying live content, and the second terminal device includes a terminal device for generating live content.

[0186] In addition, during the live broadcast process, the live broadcast content may include one or more media streams. In this case, the first terminal device may obtain one or more media streams. Accordingly, the target media stream that the first terminal device needs to obtain may include one or more.

[0187] There are often multiple first terminal devices connected to the first server. In the solution provided in the embodiments of the present application, if the same user views a live broadcast through multiple first terminal devices, the multiple first terminal devices can each display different media stream contents, and the target media streams required to be obtained by the multiple first terminal devices are often different. When the same user's multiple first terminal devices broadcast a live broadcast, they can log in to the first server using the same account or different accounts.

[0188] For example, if a user's first terminal device includes a TV, a computer, and a mobile phone, when the user watches an online course through live broadcast, the media streams generated during the live broadcast often include a media stream of the shared desktop, a media stream of the camera, and a media stream of communication information. Since the screen size of the TV is relatively large, the target media stream that the TV needs to obtain may be the media stream of the shared desktop, so that the user can view the content of the courseware through the large screen of the TV; in addition, the target media stream that the computer needs to obtain may be the media stream of the camera, so that the user can use the computer to observe the changes in the teacher's body posture during the lecture; the target media stream that the mobile phone needs to obtain may be the media stream of communication information. In this case, the user can use the mobile phone to view the communication information and input the communication information he wants to express through the mobile phone to achieve communication and interaction with other viewers and teachers.

[0189] In addition, if the live broadcast content includes at least two media streams, and a certain user only pays attention to some of the media streams, the target media stream that the first terminal device of the user needs to obtain may be the said part of the media stream, so as to avoid displaying the content of all types of media streams on the screen of the first terminal device, and correspondingly avoid the screen of the first terminal device being crowded. For example, when a user watches an online class through a mobile phone, the media streams generated during the live broadcast often include the media stream of the shared desktop, the media stream of the camera, and the media stream of communication information. Since the screen size of the mobile phone is small, if the content of all media streams is displayed, the screen interface will often be crowded. In this case, users tend to pay more attention to the media stream of the shared desktop and the media stream of communication information in order to watch the courseware and communicate and interact with the teacher. In this case, the target media stream that the mobile phone needs to obtain is the media stream of the shared desktop and the media stream of communication information.

[0190] Step S12: The first server receives a first media stream generated during the live broadcast process.

[0191] In an embodiment of the present application, the first server can be connected to the second terminal device that generates live content through a communication network. During the live broadcast process, the second terminal device generates a media stream of the live content and transmits the media stream to the first server in real time.

[0192] The media stream generated by the second terminal device during the live broadcast process often includes at least one, and the first media stream includes at least one media stream.

[0193] Step S13: The first server transmits the target media stream in the first media stream to the first terminal device according to the instruction of the first information.

[0194] After receiving the first information, the first server may determine, based on the first information, a target media stream that the first terminal device needs to obtain. After receiving the first media stream generated during the live broadcast, the first server may determine a target media stream within the first media stream and transmit the target media stream to the first terminal device.

[0195] In this step, in order to improve the user's experience of watching live broadcasts, the first server usually transmits the target media stream to the first terminal device in real time after receiving the first media stream.

[0196] In addition, after receiving the target media stream, the first terminal device may display the content of the target media stream in real time for the user to watch.

[0197] An embodiment of the present application provides a live broadcast method, in which a first server obtains first information of a first terminal device, where the first information is used to indicate a target media stream that the first terminal device needs to obtain; then, the first server receives a first media stream generated during the live broadcast process, and after receiving the first media stream, transmits the target media stream in the first media stream to the first terminal device.

[0198] In existing live broadcast solutions, the terminal device used to display live content often obtains all types of media streams generated during the live broadcast and displays the content of all types of media streams on the terminal device's screen. The media stream generated during the live broadcast is set as the first media stream. In the prior art, the terminal device will display the content of all types of media streams included in the first media stream, where the content of different types of media streams is displayed in different areas of the terminal device's screen. Because the terminal device needs to display all types of media streams, the display space for each media stream is relatively small, affecting the user's viewing experience. In some cases, the user may even be unable to clearly see the content displayed on the screen.

[0199] With the solution provided by the embodiments of the present application, the first terminal device can transmit first information to the first server to indicate the target media stream it wishes to obtain. In this case, the first server transmits the target media stream within the first media stream to the first terminal device, and the first terminal device only needs to display the content of the target media stream. Therefore, the first terminal device can selectively display the content of the media stream, thereby avoiding the problem of too many different media streams being crowded together on the same first terminal device, thus avoiding the problem of a small display space for the media streams, and further preventing the user from being unable to clearly view the live broadcast content, thereby improving the user's viewing experience.

[0200] Furthermore, in the solution provided in the embodiments of the present application, the first terminal device only needs to display the content of the target media stream, which is one or more media streams among all the media streams generated during the live broadcast. In this case, if the user of the first terminal device is only interested in a portion of the total media streams, the first terminal device can use these portions as the target media streams. Accordingly, the first terminal device only needs to display the content of these portions. Compared with the prior art, the display area of ​​these portions of the media streams on the screen is expanded, making it easier for users to view the content they are interested in, thereby improving the user experience.

[0201] Furthermore, if a user owns multiple first terminal devices, the target media streams for each of the user's first terminal devices can be different. In this case, each of the user's first terminal devices can receive different target media streams, allowing each first terminal device to display different media stream contents. This solution not only allows users to view different live broadcast content through different first terminal devices, but also expands the display area of ​​various media streams on the screen compared to existing technologies. Furthermore, each of the user's first terminal devices operates independently without interfering with each other, improving the user experience during the live broadcast.

[0202] In order to clarify the advantages of the embodiments of the present application, the embodiments of the present application provide two examples. In both examples, the first terminal device is used to watch online classes.

[0203] Among them, Figures 8(a) to 8(c) correspond to an example, in which the first terminal devices owned by the same user include a television, a computer, and a mobile phone, and Figures 8(a) to 8(c) are respectively schematic diagrams of the interfaces of each first terminal device of the user. The first terminal device in Figure 8(a) is a television, and the target media stream of the television is the media stream of the shared desktop. The corresponding screen of the television displays the content of the media stream of the shared desktop, so that the user can watch the courseware of the online class through the television. In addition, the first terminal device in Figure 8(b) is a computer, and the target media stream of the computer is the media stream of the camera. The corresponding screen of the computer displays the content of the media stream of the camera. The target media stream in Figure 8(c) is the media stream of communication information, and the corresponding screen of the mobile phone displays the content of the media stream of communication information.

[0204] In this example, different first terminal devices of the same user receive different target media streams and display different media stream contents, without interfering with each other. Furthermore, the display area of ​​each target media stream is large, making it easier for users to view and improving the user's live broadcast experience.

[0205] In addition, Figure 8(d) corresponds to another example, in which the first terminal device owned by the same user includes a television and a computer. The target media stream of the television is the media stream of the shared desktop, and the corresponding screen displays the content of the shared desktop media stream. The screen diagram of the television can be shown in Figure 8(a). In addition, Figure 8(d) is a schematic diagram of the interface of the user's computer. The target media streams of the computer include the media stream of the camera and the media stream of the communication information. The corresponding computer screen displays the content of the media stream of the camera and the content of the media stream of the communication information.

[0206] In this example, the first terminal devices of the same user will not interfere with each other. Moreover, compared with the prior art, the display area of ​​each target media stream is larger, which is convenient for users to watch and improves the user's experience of watching live broadcasts.

[0207] Alternatively, in another example, a film and television company offers a live movie broadcast and a chat window through which moviegoers and the company's operations staff can communicate during the live broadcast. In this case, the first media stream includes a media stream of the movie content and a media stream of the communication information.

[0208] In the prior art, the same terminal device that displays live content will receive the media stream of the movie content and the media stream of the communication information, and will simultaneously display the movie content interface and the chat window in different screen areas of the terminal device, with the communication information displayed in the chat window. The screen of the terminal device may be as shown in FIG9(a) or FIG9(b). In FIG9(a), the chat window is located to the right of the movie content interface, and in FIG9(b), the chat window is located below the movie content. The movie content interface and the chat window are displayed together on the same screen of the terminal device, for displaying the movie content and the communication information, respectively. This results in a smaller display area for the movie content, which affects the viewing experience.

[0209] User A has a large-screen smart screen and a computer at home. The user wants to watch live movies through the smart screen and communicate with other moviegoers and operators through the computer while watching the movie.

[0210] In this case, user A's smart screen and computer are both first terminal devices, where the target media stream of the smart screen includes the media stream of movie content, and the target media stream of the computer includes the media stream of communication information. Accordingly, the film and television company's server transmits the media stream of movie content to the smart screen. After receiving the media stream of movie content, the smart screen displays the movie content on the smart screen to meet the needs of user A to watch live movies. In addition, the server can also transmit the media stream of communication information to the computer. After receiving the media stream of communication information, the computer displays the communication information to meet the needs of user A to communicate while watching live movies.

[0211] Therefore, through the solution of the embodiment of the present application, user A can experience the large-screen audio-visual effects provided by the smart screen while also communicating and interacting with others in real time through the computer. The smart screen and computer operate independently and do not interfere with each other. In addition, because the movie content can be displayed independently on the screen of the smart screen, the display area of ​​the movie content is larger, which improves the user's viewing experience.

[0212] It can be seen from the above examples that the solution provided by the embodiments of the present application can enable the first terminal device to obtain one or more media streams generated during the live broadcast (i.e., the target media stream of the first terminal device) without having to obtain all the media streams each time. Accordingly, there is no need to display the content of all the media streams on the first terminal device, which effectively alleviates the problem of the small display space of each media stream in the existing technology, thereby avoiding the problem of users not being able to clearly watch the live broadcast content, and improving the user's viewing experience.

[0213] The first terminal device indicates the target media stream that it needs to obtain through first information. The first information may include multiple types of information. In one feasible implementation, the first information includes information about the target media stream.

[0214] The target media stream information may include the name of the target media stream, or, if a protocol is set between the first server and the first terminal device, the protocol sets encodings for various media streams. In this case, the target media stream information may include the encoding of the target media stream. Of course, the target media stream information may also include other information that allows the first server to determine the type of the target media stream, which is not limited in this embodiment of the present application.

[0215] Alternatively, in another feasible implementation, the first information includes an account level of a first account of the first terminal device, where the first account is an account registered by the first terminal device on the first server.

[0216] The media stream level of the target media stream of the first terminal device may be the same as the account level of the first account of the first terminal device. Alternatively, a correspondence between account levels and media stream levels may be set. In this case, after determining the account level of the first account, the target media stream of the first terminal device may be determined based on the account level of the first account and the correspondence between the account level and the media stream level.

[0217] The first terminal device often needs to register a first account on the first server. After registering the first account, the first server transmits the media stream to the first terminal device so that the user on the first terminal device can watch the live broadcast. In the solution provided in the embodiment of the present application, multiple account levels can be set, and different account levels correspond to different media streams. In this case, the first server can determine the target media stream in the first media stream for the first terminal device based on the account level of the first account.

[0218] For example, when an enterprise conducts remote training via live streaming, the first terminal device often includes office computers and the mobile phones of each participant, while the second terminal device includes the terminal device of the instructor. During the training, the instructor can share the training courseware on their desktop so that the participants can view the courseware. The live streaming media stream includes the media stream of the shared desktop. To facilitate communication during the training, the live streaming media stream may also include the media stream of the exchanged information.

[0219] Because computer screens are larger, it's often desirable to have the computer receive the shared desktop media stream for displaying courseware, while each mobile phone receives the communication information media stream for communication between participants and the instructor. In this case, the account level of the computer's primary account can be set to the same as the media stream level for the shared desktop media stream, and the account level of the mobile phone's primary account can be set to the same as the media stream level for the communication information media stream.

[0220] In this case, the first server can determine, based on the account level of the computer's first account, that the computer's target media stream is the shared desktop media stream, and transmit the shared desktop media stream to the computer, so that the computer displays the training courseware. Additionally, the first server can determine, based on the account level of the mobile phone's first account, that the mobile phone's target media stream is the communication information media stream, and transmit the communication information media stream to the mobile phone, so that each user participating in the training can display the communication information in a chat box, thereby enabling communication.

[0221] Since the first account is a registered account of the first terminal device on the first server, the first server can usually determine the account level of the first account according to the relevant information of the first account.

[0222] In one feasible implementation, the relevant information of the first account includes recharge information of the first account. When the first terminal device needs to recharge when watching a live broadcast, the account level can be determined by the recharge fee of the first terminal device. The higher the recharge fee of the first terminal device, the higher the account level of the first account of the first terminal device. The first server can determine the account level of the first account of each terminal device based on the recharge information of each first terminal device.

[0223] Alternatively, in another embodiment, the relevant information of the first account includes the identity information of the first terminal device corresponding to the first account. Typically, multiple first terminal devices watch a live broadcast together, and the identities of each first terminal device are often different. For example, multiple first terminal devices form a group including a group owner and group members. The identities of the first terminal devices may include the group owner and group members.

[0224] In this solution, the first server determines the account level of the first account based on the relevant information of the first account, and then determines the target media stream of the first terminal device based on the account level.

[0225] For example, multiple first terminal devices watching a live broadcast form a group, wherein the account level of the first account of the group owner in the group is higher, while the account levels of the first accounts of other group members are lower. In this case, during live remote training, the computer in the conference room and the mobile phones of each user participating in the training form a group. Among them, if the media stream level of the shared desktop media stream is higher, the computer can be set as the group owner, and each mobile phone can be set as a group member. Correspondingly, the computer has a higher account level. The first server can determine the target media stream of the computer as the media stream of the shared desktop based on the computer's account level. In addition, the first server can also determine the target media stream of the mobile phone as the media stream of communication information based on the account level of the mobile phone.

[0226] Of course, the first server may also determine the account level of the first account in other ways, which is not limited in this embodiment of the present application.

[0227] The first terminal device may transmit the target media stream in different ways for different first information. The first information includes information about the target media stream, and the first server transmits the target media stream in the first media stream to the first terminal device according to the instruction of the first information, including the following steps:

[0228] First, the first server determines the target media stream in the first media stream according to the information of the target streaming media.

[0229] Then, the first server transmits the target media stream to the first terminal device.

[0230] That is, in this solution, the first server determines the target media stream of the first terminal device according to the information of the target media stream included in the first information and transmits the target media stream.

[0231] The first information includes an account level of a first account of the first terminal device, and the first server transmits the target media stream in the first media stream to the first terminal device according to an instruction of the first information, including the following steps:

[0232] The first server determines the target media stream in the first media stream according to the media stream levels corresponding to various media streams in the first media stream and the account level;

[0233] The first server transmits the target media stream to the first terminal device.

[0234] That is, in this solution, the first server determines and transmits the target media stream according to the media stream levels of various media streams and the account level of the first account of the first terminal device.

[0235] Among them, if the media stream level of the target media stream is set to be the same as the account level of the first account, when the first server determines the target media stream in the first media stream, it determines that the media stream in the first media stream whose media stream level is the same as the account level of the first account is the target media stream.

[0236] In addition, if a correspondence is set between the media stream level of the target media stream and the account level of the first account, in this embodiment of the present application, when the first server determines the target media stream in the first media stream, it determines the target media stream of the first terminal device based on the account level of the first account and the correspondence.

[0237] Furthermore, referring to the workflow diagram shown in FIG10 , the embodiment of the present application further includes the following steps:

[0238] Step S14: The first server determines, based on the registration information of the first account of the first terminal device, that the first terminal device has the authority to obtain the target media stream.

[0239] The first account is an account registered by the first terminal device on the first server.

[0240] Through this step, the first server can authenticate the first account to determine whether the first terminal device has the authority to obtain the target media stream, and then transmit the target media stream to the first terminal device after determining that the first terminal device has the authority.

[0241] With the above solution, the first server can transmit the target media stream to the first terminal device after determining that the first terminal device has the authority to obtain the target media stream, thereby improving the reliability of the communication system formed by the first server and the first terminal device.

[0242] In Figure 10 provided in the embodiment of the present application, after executing step S12, step S14 is executed. That is, after receiving the first media stream, the first server determines whether the first terminal device has permission to obtain the target media stream based on the registration information of the first account. In actual application scenarios, there is no strict time limit between these two steps. For example, the first server can also determine in advance that the first terminal device has permission to obtain the target media stream based on the registration information of the first account. Then, after receiving the first media stream during the live broadcast, the first server transmits the target media stream to the authorized first terminal device.

[0243] Accordingly, an embodiment of the present application provides a live broadcast method, which is applied to a first terminal device, wherein the first terminal device includes a terminal device for displaying live broadcast content. Through the first terminal device, a user can watch the live broadcast content.

[0244] Referring to the workflow diagram shown in FIG11 , the live broadcast method provided in the embodiment of the present application includes the following steps:

[0245] Step S21: A first terminal device transmits first information to a first server, where the first information is used to indicate a target media stream that the first terminal device needs to obtain.

[0246] The first server may obtain a first media stream generated during the live broadcast process. After receiving the first information, the first server determines a target media stream in the first media stream based on the first information, where the target media stream is at least one media stream in the first media stream.

[0247] Step S22: The first terminal device receives the target media stream transmitted by the first server.

[0248] After determining the target media stream in the first media stream, the first server transmits the target media stream to the first terminal device, so that the first terminal device obtains the target media stream.

[0249] Step S23: The first terminal device displays the content of the target media stream.

[0250] After receiving the target media stream, the first terminal device may perform processing such as decoding on the target media stream and display the content of the target media stream.

[0251] To ensure a good live broadcast quality, after acquiring the first media stream, the first server typically transmits a target media stream within the first media stream to the first terminal device in real time. Furthermore, after receiving the target media stream, the first terminal device typically displays the content of the target media stream in real time, thereby providing a good live broadcast quality for the first terminal device and ensuring that the content displayed by each first terminal device remains synchronized.

[0252] Through the solution provided in the embodiment of the present application, the first terminal device only needs to display the content of the target media stream, thereby avoiding too many types of media streams being crowded into the same first terminal device for display, avoiding the problem of a small display space for the media stream, avoiding the problem of users being unable to clearly view the live content, and improving the user's viewing experience.

[0253] In the embodiment of the present application, the first information may include various forms. In one feasible solution, the first information includes information about the target media stream.

[0254] Alternatively, in another feasible solution, the first information includes an account level of a first account of the first terminal device, where the first account is an account registered by the first terminal device on the first server.

[0255] If the first information includes information about the target media stream, referring to the workflow diagram shown in FIG12 , the first terminal device transmits the first information to the first server, including the following steps:

[0256] Step S211: The first terminal device displays a registration interface for a first account.

[0257] The first account is an account registered by the first terminal device on the first server, and the registration interface includes at least one media stream option.

[0258] If a first terminal device wishes to watch a live broadcast, it must register an account on the first server. During the registration process, the first terminal device displays a registration interface for the first account to receive the user's registration operation. In the solution provided in the embodiment of the present application, the registration interface includes not only an area for receiving the registration operation but also an area for displaying at least one media stream option, allowing the user to select the option corresponding to the target media stream.

[0259] Step S212: The first terminal device receives a first operation for an option of the at least one media stream, where the first operation is used to select a target media stream from the at least one media stream.

[0260] For example, the media stream options displayed on the registration interface include: a shared desktop media stream, a camera media stream, and a communication information media stream, and the first terminal device wishes to receive the communication information media stream, i.e., the first terminal device's target media stream is the communication information media stream. In this case, the first operation may be a selection operation for the communication information media stream displayed on the registration interface.

[0261] Step S213: The first terminal device transmits the first information to the first server according to the first operation.

[0262] In this step, the first terminal device may transmit the first information and the registration information of the first account to the first server at the same time. Alternatively, the first terminal device may transmit the first information to the first server after transmitting the registration information of the first account.

[0263] Through the above solution, the first terminal device can determine the first information based on the first operation on the registration interface, so that the first server can determine the target media stream to be transmitted to the first terminal device based on the first information. In this case, the first terminal device can generate the first information during the process of registering the first account.

[0264] In addition, during the application process of the first terminal device, the target media stream that the first terminal device wants to obtain may change. In order to meet this requirement, referring to the workflow diagram shown in Figure 13, the embodiment of the present application also provides the following steps:

[0265] Step S214: The first terminal device receives a second operation.

[0266] Step S215: The first terminal device displays a selection interface including options for at least one media stream in response to the second operation.

[0267] The second operation is used to trigger the first terminal device to display the selection interface. The second operation may include various forms of operations. For example, the second operation may include a long press operation on a certain area of ​​the interface displaying live content, or the second operation may include a sliding operation along a specific trajectory in a certain area of ​​the interface displaying live content. Of course, the second operation may also be other forms of operations, which are not limited in the embodiments of the present application.

[0268] Step S216: The first terminal device receives a third operation on the selection interface, where the third operation is used to select a target media stream that the first terminal device needs to obtain.

[0269] Step S217: The first terminal device adjusts the first information according to the third operation, and transmits the adjusted first information to the first server.

[0270] The adjusted first information includes information about the target media stream selected by the third operation. After receiving the adjusted first information, the first server determines the target media stream to be transmitted to the first terminal device based on the adjusted first information.

[0271] Through the operations of steps S214 to S217, the first terminal device can adjust the first information according to its own needs to obtain the target media stream, and transmit the adjusted first information to the first server, so that the first server transmits the target media stream to the first terminal device according to the adjusted first information, thereby meeting the needs of the first terminal device to obtain the target media stream.

[0272] In the above embodiments of the present application, a live broadcast method performed by a first server and a live broadcast method performed by a first terminal device are provided. To clarify the advantages of the present application, an example is disclosed below, and FIG14 is disclosed. FIG14 is an interactive diagram of a communication system using the live broadcast method provided in the embodiments of the present application.

[0273] In this example, the communication system includes: a first terminal device, a first server and a second terminal device, and in this example, the first terminal device includes four terminal devices owned by the same user, namely a TV, a mobile phone, a computer and a watch, and the first server includes cloud server 1 and cloud server 2.

[0274] The second terminal device is used to generate a first media stream during the live broadcast. In this example, the first media stream includes a shared desktop media stream, a camera media stream, a communication information media stream, and a notification information media stream. The notification information is used to notify users of subscribed announcements and other information during the live broadcast. Furthermore, after generating the above four media streams, the second terminal device can report the media streams to cloud server 1 in real time.

[0275] Before starting this live broadcast, the cloud server 1 may determine the types of various media streams included in the first media stream based on the previous live broadcast content, and report the types of the media streams to the cloud server 2.

[0276] The first terminal device can register a first account in the cloud server 2 so as to obtain the media stream it needs through the first account. After obtaining the first account registered by the first terminal device, the cloud server 2 detects whether the first terminal device has the authority to obtain the target media stream.

[0277] In addition, each first terminal device can determine the types of various media streams generated during the live broadcast through the cloud server 2, and subscribe to the target media streams it needs from the cloud server 2 through the first information. In this example, among the first terminal devices, the TV wants to obtain the media stream of the shared desktop, the mobile phone wants to obtain the media stream of the camera and the media stream of communication information, the computer wants to obtain the media stream of the camera, and the watch wants to obtain the media stream of notification information.

[0278] Each first terminal device registers a first account with cloud server 2. During the first account registration process, the first terminal device may receive a first operation on the registration interface for the first account and, based on the first operation, report first information to cloud server 2. The first information includes information about the target media stream required by the first terminal device. Furthermore, the first information may also include information about the first account of the first terminal device.

[0279] In this case, the first information reported by the TV is used to subscribe to the media stream of the shared desktop, the first information reported by the mobile phone is used to subscribe to the media stream of the camera and the media stream of communication information, the first information reported by the computer is used to subscribe to the media stream of the camera, and the first information reported by the watch is used to subscribe to the media stream of notification information.

[0280] During the live broadcast process, each first terminal device may send a request to the cloud server 1 to obtain the live broadcast content, so as to request a target media stream.

[0281] After receiving the request, cloud server 1 can interact with cloud server 2 to determine whether the first terminal device has permission to access the target media stream. If so, cloud server 1 will also query each first terminal device for the target media stream it requires, that is, the target media streams each first terminal device has subscribed to. Accordingly, cloud server 2 can provide cloud server 1 with feedback on the target media streams each first terminal device has subscribed to.

[0282] Then, the cloud server 1 can transmit the target media stream in the first media stream to each first terminal device respectively. In the example of the present application, the cloud server 1 can transmit the media stream of the shared desktop to the computer, transmit the media stream of the camera and the media stream of the communication information to the mobile phone, transmit the media stream of the camera to the computer, and transmit the media stream of the notification information to the watch.

[0283] After receiving the target media stream required by itself, each first terminal device performs corresponding display, so that different first terminal devices can display the content of the target media stream required by itself.

[0284] Specifically, in this example, the computer will display the content of the shared desktop, and the mobile phone will display the content captured by the camera and the content of the communication information through different areas of the screen. The computer displays the content captured by the camera, and the mobile phone displays the content of the notification information.

[0285] In this case, the first terminal devices do not interfere with each other, and the area displaying the content of each media stream is large, which is convenient for users to watch and improves the user's experience of watching live broadcasts.

[0286] The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

[0287] As an implementation of the above embodiments, the present application discloses a live broadcast device. Referring to the structural diagram shown in FIG15 , the live broadcast device disclosed in the present application embodiment includes: a processor 1110 and a transceiver interface 1120 .

[0288] The live broadcast device is usually applied to the first server. In the embodiment of the present application, the first server is connected to the first terminal device and the second terminal device through a communication network, respectively, wherein the first terminal device includes a terminal device for displaying live broadcast content, and the second terminal device includes a terminal device for generating live broadcast content.

[0289] The processor 1110 is configured to determine first information of a first terminal device, where the first information is used to indicate a target media stream that the first terminal device needs to obtain.

[0290] The transceiver interface 1120 is configured to receive a first media stream generated during a live broadcast process, and transmit the target media stream in the first media stream to the first terminal device according to an instruction of the first information.

[0291] In an embodiment of the present application, the first server may be connected to a second terminal device that generates live content. During the live broadcast process, the second terminal device generates a media stream of the live content and transmits the first media stream to the first server in real time.

[0292] The first media stream often includes at least one media stream. In this case, after receiving the first information, the live broadcast device can determine the target media stream that the first terminal device needs to obtain based on the first information, and transmit the target media stream to the first terminal device through the transceiver interface.

[0293] In this step, in order to improve the user's experience of watching live broadcasts, the transceiver interface 1120 usually transmits the target media stream to the first terminal device in real time after receiving the first media stream.

[0294] In existing live streaming solutions, the terminal device used to display live content often obtains all types of media streams generated during the live broadcast and displays the content of all types of media streams on the terminal device's screen. The media stream generated during the live broadcast is set as the first media stream. In the existing technology, the terminal device will display all types of media streams included in the first media stream. Because the terminal device needs to display all types of media streams, the display space for each media stream is relatively small, affecting the user's viewing experience. In some cases, the user may even be unable to see the displayed content clearly.

[0295] With the solution provided by the embodiments of the present application, the first terminal device can transmit first information to the first server to indicate the target media stream it wishes to obtain. In this case, the first server transmits the target media stream within the first media stream to the first terminal device, and the first terminal device only needs to display the content of the target media stream. Therefore, the first terminal device can selectively display the content of the media stream, thereby avoiding the problem of too many different media streams being crowded on the same first terminal device, avoiding the problem of a small display space for media streams, and preventing users from being unable to clearly view the live broadcast content, thereby improving the user's viewing experience.

[0296] The first terminal device indicates the target media stream that it needs to obtain through first information. The first information may include multiple types of information. In one feasible implementation, the first information includes information about the target media stream.

[0297] Alternatively, in another feasible implementation, the first information includes an account level of a first account of the first terminal device, where the first account is an account registered by the first terminal device on the first server.

[0298] The first terminal device may transmit the target media stream in different ways for different first information. Wherein, the first information includes information about the target media stream, and the transceiver interface is specifically configured to transmit the target media stream to the first terminal device after the processor determines the target media stream in the first media stream based on the information about the target media stream.

[0299] That is, in this solution, the first server determines the target media stream of the first terminal device according to the information of the target media stream included in the first information and transmits the target media stream.

[0300] In addition, the first information includes the account level of the first account of the first terminal device. In this case, the transceiver interface is specifically used to transmit the target media stream to the first terminal device after the processor determines the target media stream in the first media stream based on the media stream level corresponding to the media stream included in the first media stream and the account level.

[0301] That is, in this solution, the first server determines and transmits the target media stream according to the media stream levels of various media streams and the account level of the first account of the first terminal device.

[0302] Furthermore, in an embodiment of the present application, the processor is also used to determine, based on registration information of a first account of the first terminal device, whether the first terminal device has permission to obtain the target media stream, where the first account is an account registered by the first terminal device on the first server.

[0303] With the above solution, the first server can transmit the target media stream to the first terminal device after determining that the first terminal device has the authority to obtain the target media stream, thereby improving the security of the communication system formed by the first server and the first terminal device.

[0304] Accordingly, an embodiment of the present application further provides a live broadcast device. The device can generally be applied to a first terminal device, which includes a terminal device for displaying live broadcast content, and a user can watch the live broadcast content through the first terminal device.

[0305] Wherein, the live broadcast device includes: a processor and a transceiver interface;

[0306] The transceiver interface is used to transmit first information to the first server, where the first information is used to indicate a target media stream that the first terminal device needs to obtain, and receive the target media stream transmitted by the first server;

[0307] The processor is configured to control a screen to display the content of the target media stream.

[0308] After receiving the first information, the first server may determine a target media stream in the first media stream based on the first information, where the target media stream is at least one media stream in the first media stream, and then transmit the target media stream to the first terminal device.

[0309] In this case, the first terminal device can receive the target media stream transmitted by the first server through the transceiver interface, and the processor will control the screen of the first terminal device to display the content of the target media stream, thereby meeting the user's need to watch live broadcast.

[0310] In the embodiment of the present application, the first information may include various forms. In one feasible solution, the first information includes information about the target media stream.

[0311] Alternatively, in another feasible solution, the first information includes an account level of a first account of the first terminal device, where the first account is an account registered by the first terminal device on the first server.

[0312] The first information includes information about the target media stream, and the transceiver interface is specifically configured to, after displaying a registration interface for a first account and receiving a first operation for an option of the at least one media stream, transmit the first information to the first server according to the first operation;

[0313] The first account is an account registered by the first terminal device on the first server, the registration interface includes at least one media stream option, and the first operation is used to select a target media stream from the at least one media stream.

[0314] If the first information includes information of the target media stream, the first terminal device may display a registration interface for the first account, where the registration interface includes at least one media stream option for the user to select an option corresponding to the target media stream.

[0315] In addition, the first operation may be a selection operation for the media stream of the communication information displayed on the registration interface. After receiving the first operation for the option of at least one media stream, the first terminal device may transmit first information to the first server so that the first server determines the target media stream based on the first information.

[0316] Furthermore, during the application process of the first terminal device, the target media stream that the first terminal device wishes to obtain may change. To meet this requirement, in the solution provided in the embodiment of the present application, the transceiver interface is further configured to receive a second operation. The second operation is configured to trigger the first terminal device to display the selection interface.

[0317] The processor is further configured to, in response to the second operation, display a selection interface including options for at least one media stream.

[0318] The transceiver interface is further configured to receive a third operation on the selection interface, where the third operation is configured to select a target media stream that the first terminal device needs to obtain.

[0319] The processor is further configured to adjust the first information according to the third operation;

[0320] The processor is further configured to transmit the adjusted first information to the first server, where the adjusted first information includes information of the target media stream selected by the third operation.

[0321] The adjusted first information includes information about the target media stream selected by the third operation. After receiving the adjusted first information, the first server determines the target media stream to be transmitted to the first terminal device based on the adjusted first information.

[0322] Through the above scheme, the first terminal device can adjust the first information according to its own needs to obtain the target media stream, and transmit the adjusted first information to the first server, so that the first server transmits the target media stream to the first terminal device according to the adjusted first information, thereby meeting the needs of the first terminal device to obtain the target media stream.

[0323] Correspondingly, corresponding to the above method, the embodiment of the present application also discloses a server. Referring to the structural diagram shown in FIG16 , the server includes:

[0324] at least one first processor 1101 and a memory,

[0325] Wherein, the memory is used to store program instructions;

[0326] The first processor is configured to call and execute program instructions stored in the memory, so as to enable the terminal device to execute all or part of the steps in the embodiments corresponding to FIG. 7 and FIG. 10 .

[0327] Furthermore, the terminal device may further include: a transceiver 1102 and a bus 1103 , and the memory includes a random access memory 1104 and a read-only memory 1105 .

[0328] The first processor is coupled to the transceiver, random access memory, and read-only memory via a bus. When the terminal device needs to be operated, it is booted using the basic input / output system (BIOS) embedded in the read-only memory or the bootloader in the embedded system, guiding the terminal device into normal operation. After the terminal device enters normal operation, the application program and operating system are run in the random access memory, causing the terminal device to execute all or part of the steps in the embodiments corresponding to Figures 7 and 10.

[0329] The device of the embodiment of the present invention may correspond to the live broadcast device in the embodiments corresponding to Figures 7 and 10 above, and the processor in the device may implement the functions or various steps and methods implemented by the live broadcast device in the embodiments corresponding to Figures 7 and 10. For the sake of brevity, they will not be repeated here.

[0330] Correspondingly, corresponding to the above method, the embodiment of the present application further discloses a terminal device. The terminal device includes:

[0331] at least one first processor and memory,

[0332] Wherein, the memory is used to store program instructions;

[0333] The first processor is configured to call and execute program instructions stored in the memory, so as to enable the terminal device to execute all or part of the steps in the embodiments corresponding to FIG. 11 to FIG. 13 .

[0334] Furthermore, the terminal device may further include: a transceiver and a bus, and the memory includes a random access memory and a read-only memory.

[0335] The first processor is coupled to the transceiver, random access memory, and read-only memory via a bus. When the terminal device needs to be operated, it is booted using the basic input / output system (BIOS) embedded in the read-only memory or the bootloader in the embedded system, guiding the terminal device into normal operation. After the terminal device enters normal operation, the application program and operating system are run in the random access memory, causing the terminal device to execute all or part of the steps in the embodiments corresponding to Figures 11 to 13.

[0336] The device of the embodiment of the present invention may correspond to the live broadcast device in the embodiments corresponding to Figures 11 to 13 above, and the processor in the device may implement the functions or various steps and methods implemented by the live broadcast device in the embodiments corresponding to Figures 11 to 13. For the sake of brevity, they will not be repeated here.

[0337] Accordingly, in an embodiment of the present application, a live broadcast system is provided, which includes a server and a terminal device.

[0338] In an embodiment of the present application, the server may serve as a first server in a communication system for live broadcasting. During the live broadcasting process, the server obtains a first media stream generated during the live broadcasting process, and determines a target media stream in the first media stream based on the first information of the first terminal device, and transmits the target media stream to the first terminal device so that the first terminal device displays the content of the target media stream.

[0339] In an embodiment of the present application, the server may correspond to the live broadcast device in the embodiments corresponding to Figures 7 and 10 above, and the processor in the device may implement the functions or various steps and methods implemented by the live broadcast device in the embodiments corresponding to Figures 7 and 10. For the sake of brevity, they will not be repeated here.

[0340] In an embodiment of the present application, the terminal device can serve as a first terminal device in a communication system for live broadcasting. During the live broadcasting process, the terminal device can obtain the target media stream transmitted by the first server and display the content of the target media stream.

[0341] In an embodiment of the present application, the terminal device may correspond to the live broadcast device in the embodiments corresponding to Figures 11 to 13 above, and the processor in the device may implement the functions or various steps and methods implemented by the live broadcast device in the embodiments corresponding to Figures 11 to 13. For the sake of brevity, they will not be repeated here.

[0342] Furthermore, the system provided in the embodiments of the present application generally includes a second terminal device, which includes a terminal device for generating live content. During the live broadcast process, the second terminal device can generate a first media stream, which includes at least one media stream. After generating the first media stream, the second terminal device transmits the first media stream to the first server, and the first server transmits the target media stream in the first media stream to the corresponding first terminal device, so that the first terminal device can display the content of the target media stream.

[0343] In a specific implementation, an embodiment of the present application further provides a computer-readable storage medium comprising instructions. When the computer-readable medium is set in any device and runs on a computer, it can implement all or part of the steps in the embodiments corresponding to Figures 7 and 10. The storage medium of the computer-readable medium can be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0344] In a specific implementation, an embodiment of the present application further provides a computer-readable storage medium, which includes instructions. When the computer-readable medium is set in any device and runs on a computer, it can implement all or part of the steps in the embodiments corresponding to Figures 11 to 13. The storage medium of the computer-readable medium can be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0345] In addition, another embodiment of the present application further discloses a computer program product containing instructions. When the computer program product is run on an electronic device, the electronic device can implement all or part of the steps in the embodiments corresponding to Figures 7 and 10.

[0346] In addition, another embodiment of the present application further discloses a computer program product containing instructions. When the computer program product runs on an electronic device, the electronic device can implement all or part of the steps in the embodiments corresponding to Figures 11 to 13.

[0347] The various illustrative logic units and circuits described in the embodiments of the present application can be implemented or operated by a design of a general-purpose processor, a digital information processor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof. The general-purpose processor can be a microprocessor, alternatively, the general-purpose processor can also be any traditional processor, controller, microcontroller or state machine. The processor can also be implemented by a combination of computing devices, such as a digital information processor and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a digital information processor core, or any other similar configuration to implement.

[0348] The steps of the methods or algorithms described in the embodiments of the present application can be directly embedded in hardware, software units executed by a processor, or a combination of the two. The software units can be stored in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art. For example, the storage medium can be connected to the processor so that the processor can read information from the storage medium and write information to the storage medium. Alternatively, the storage medium can be integrated into the processor. The processor and storage medium can be provided in an ASIC, which can be provided in a UE. Alternatively, the processor and storage medium can be provided in different components within the UE.

[0349] It should be understood that in the various embodiments of the present application, the size of the serial number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0350] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0351] The same or similar parts between the various embodiments of this specification can be referred to in conjunction with each other, and each embodiment focuses on the differences between the other embodiments. In particular, for the device and system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiments.

[0352] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus a necessary general-purpose hardware platform. Based on this understanding, the technical solutions in the embodiments of the present invention, or the portion that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium such as ROM / RAM, a magnetic disk, or an optical disk, and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments of the present invention or certain portions of the embodiments.

[0353] In this specification, the same or similar parts between the various embodiments can be referred to each other. In particular, for the embodiment of the road constraint determination device disclosed in this application, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description in the method embodiment.

[0354] The above-described embodiments of the present invention do not limit the protection scope of the present invention.

Claims

1. A live broadcast method, characterized in that: include: The first server determines first information of the first terminal device, where the first information is used to indicate a target media stream that the first terminal device needs to obtain; The first server receives a first media stream generated during the live broadcast; The first server transmits the target media stream in the first media stream to the first terminal device according to an instruction of the first information.

2. The method according to claim 1, characterized in that The first information includes information of the target media stream; Alternatively, the first information includes an account level of a first account of the first terminal device, where the first account is an account registered by the first terminal device on the first server.

3. The method according to claim 1, characterized in that The first information includes information of the target media stream, and the first server transmits the target media stream in the first media stream to the first terminal device according to an instruction of the first information, including: The first server determines the target media stream in the first media stream according to the information of the target streaming media; The first server transmits the target media stream to the first terminal device.

4. The method according to claim 1, wherein The first information includes an account level of a first account of the first terminal device, and the first server transmits the target media stream in the first media stream to the first terminal device according to an instruction of the first information, including: The first server determines the target media stream in the first media stream according to the media stream levels corresponding to various media streams in the first media stream and the account level; The first server transmits the target media stream to the first terminal device.

5. The method according to any one of claims 1 to 4, characterized in that Also includes: The first server determines, based on registration information of a first account of the first terminal device, that the first terminal device has permission to obtain the target media stream, where the first account is an account registered by the first terminal device on the first server.

6. A live broadcast method, characterized in that: include: The first terminal device transmits first information to the first server, where the first information is used to indicate a target media stream that the first terminal device needs to obtain; The first terminal device receives a target media stream transmitted by the first server; The first terminal device displays the content of the target media stream.

7. The method according to claim 6, characterized in that The first information includes information of the target media stream; Alternatively, the first information includes an account level of a first account of the first terminal device, where the first account is an account registered by the first terminal device on the first server.

8. The method according to claim 7, characterized in that The first information includes information of the target media stream, and the first terminal device transmits the first information to the first server, including: The first terminal device displays a registration interface for a first account, where the first account is an account registered by the first terminal device on the first server, and the registration interface includes at least one media stream option; Receiving, by the first terminal device, a first operation on an option of the at least one media stream, the first operation being used to select a target media stream from the at least one media stream; The first terminal device transmits the first information to the first server according to the first operation.

9. The method according to claim 8, characterized in that Also includes: receiving, by the first terminal device, a second operation; In response to the second operation, the first terminal device displays a selection interface including options for at least one media stream; The first terminal device receives a third operation on the selection interface, where the third operation is used to select a target media stream that the first terminal device needs to obtain; The first terminal device adjusts the first information according to the third operation, and transmits the adjusted first information to the first server, where the adjusted first information includes information of the target media stream selected by the third operation.

10. A live broadcast device, characterized in that: include: Processor and transceiver interface; The processor is configured to determine first information of a first terminal device, where the first information is used to indicate a target media stream that the first terminal device needs to obtain; The transceiver interface is used to receive a first media stream generated during a live broadcast process, and transmit the target media stream in the first media stream to the first terminal device according to an instruction of the first information.

11. The device according to claim 10, characterized in that The first information includes information of the target media stream; Alternatively, the first information includes an account level of a first account of the first terminal device, where the first account is an account registered by the first terminal device on the first server.

12. The device according to claim 10, characterized in that The first information includes information of the target media stream; The transceiver interface is specifically configured to transmit the target media stream to the first terminal device after the processor determines the target media stream in the first media stream according to the information of the target streaming media.

13. The device according to claim 10, characterized in that The first information includes an account level of a first account of the first terminal device; The transceiver interface is specifically configured to transmit the target media stream to the first terminal device after the processor determines the target media stream in the first media stream according to the media stream levels corresponding to various media streams in the first media stream and the account level.

14. The device according to any one of claims 10 to 13, characterized in that The processor is further configured to determine, based on registration information of a first account of the first terminal device, whether the first terminal device has permission to obtain the target media stream, where the first account is an account registered by the first terminal device on the first server.

15. A live broadcast device, characterized in that: include: Processor and transceiver interface; The transceiver interface is used to transmit first information to the first server, where the first information is used to indicate a target media stream that the first terminal device needs to obtain, and receive the target media stream transmitted by the first server; The processor is configured to control a screen to display the content of the target media stream.

16. The device according to claim 15, characterized in that The first information includes information of the target media stream; Alternatively, the first information includes an account level of a first account of the first terminal device, where the first account is an account registered by the first terminal device on the first server.

17. The device according to claim 16, characterized in that The first information includes information of the target media stream; The transceiver interface is specifically configured to, after displaying a registration interface for the first account and receiving a first operation for an option of the at least one media stream, transmit the first information to the first server according to the first operation; The first account is an account registered by the first terminal device on the first server, the registration interface includes at least one media stream option, and the first operation is used to select a target media stream from the at least one media stream.

18. The device according to claim 17, characterized in that The transceiver interface is further configured to receive a second operation; The processor is further configured to, in response to the second operation, display a selection interface including options for at least one media stream; The transceiver interface is further configured to receive a third operation on the selection interface, where the third operation is configured to select a target media stream that the first terminal device needs to obtain; The processor is further configured to adjust the first information according to the third operation; The processor is further configured to transmit the adjusted first information to the first server, where the adjusted first information includes information of the target media stream selected by the third operation.

19. A server, characterized in that: include: at least one processor and memory, The memory is used to store program instructions; The processor is used to call and execute the program instructions stored in the memory so that the terminal device executes the live broadcast method described in any one of claims 1-5.

20. A terminal device, characterized in that: include: at least one processor and memory, The memory is used to store program instructions; The processor is used to call and execute the program instructions stored in the memory so that the terminal device executes the live broadcast method described in any one of claims 6-9.

21. A live broadcast system, characterized in that: include: The server according to claim 19; The terminal device according to claim 20.

22. A computer-readable storage medium, characterized in that The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the live broadcast method according to any one of claims 1 to 5.

23. A computer-readable storage medium, characterized in that The computer-readable storage medium stores instructions, which, when executed on a computer, enable the computer to execute the live broadcast method according to any one of claims 6 to 9.

Images