Live streaming screen processing method, apparatus, device, and storage medium

Abstract

The present disclosure provides a live streaming screen processing method, apparatus, device, and storage medium. In the method, first, the viewing side pulls a live streaming merged screen and screen position information corresponding to the live streaming merged screen from a live streaming media server. Here, the live streaming merged screen is obtained by merging at least two live streaming screens, and the screen position information is for marking the positions of at least two live streaming screens in the live streaming merged screen respectively. Then, based on the screen position information, at least two live streaming screens are separated from the live streaming merged screen respectively, and further, at least two live streaming screens are displayed based on a preset live streaming screen display layout. Therefore, the embodiments of the present disclosure can separate a plurality of live streaming screens from the pulled live streaming merged screen and display each live streaming screen based on the preset live streaming screen display layout, enrich the related functions of video live streaming, and improve the viewing experience of users.

Description

Technical Field

[0001] [Cross - reference to Related Applications] This application is based on a Chinese application with application number 202211387325.0 and filing date November 7, 2022, claims its priority, and the entire disclosure content of this Chinese application is incorporated into this application by reference.

[0002] [Technical Field] The present disclosure relates to the field of data processing, and particularly to a method, apparatus, device, and storage medium for processing live streaming screens.

Background Art

[0003] With the rapid development of the Internet, the video live streaming format is being used in more and more scenarios, such as game live streaming, tournament live streaming, shopping live streaming, etc.

[0004] Therefore, how to enrich the related functions of video live streaming to improve the user's viewing experience is a technical problem that is currently strongly desired to be solved.

Summary of the Invention

[0005] To solve the above technical problems, embodiments of the present disclosure provide a method for processing live streaming screens.

[0006] According to a first aspect, the present disclosure is pulling a live streaming merged screen and screen position information corresponding to the live streaming merged screen from a live streaming media server, where the live streaming merged screen is obtained by merging at least two live streaming screens, and the screen position information is for marking the positions of the at least two live streaming screens in the live streaming merged screen respectively; separating the at least two live streaming screens from the live streaming merged screen based on the screen position information; The present invention provides a live streaming screen processing method that includes displaying at least two live streaming screens based on a pre-configured live streaming screen display layout.

[0007] In one selective embodiment, the at least two live streaming screens include a first live streaming screen and a second live streaming screen, and the at least two live streaming screens are displayed based on the pre-configured live streaming screen display layout. The method includes displaying the first live streaming screen within a first area indicated by a pre-configured live streaming screen display layout, and displaying the second live streaming screen within a second area indicated by the pre-configured live streaming screen display layout, wherein there is no overlapping area between the first area and the second area.

[0008] In one selective embodiment, the first live streaming screen is a live streaming screen collected in real time by the live streaming side using a local camera, and the second live streaming screen is a live streaming screen pulled in real time by the live streaming side.

[0009] In one selective embodiment, displaying the at least two live streaming screens based on the pre-configured live streaming screen display layout is: The above-mentioned at least two live streaming screens are drawn on separate canvases, This includes displaying a canvas on which the live streaming screen is drawn, based on a pre-configured live streaming screen display layout.

[0010] In one selective embodiment, screen coordinate information corresponding to the live streaming merge screen is transmitted to SEI information.

[0011] According to the second aspect, this disclosure is: To merge at least two live streaming screens to obtain a merged live streaming screen, The location information on the live streaming merge screen of each of the at least two live streaming screens is obtained and used as the screen location information corresponding to the live streaming merge screen. The present invention provides a live streaming screen processing method, which includes pushing the live streaming merge screen and screen position information corresponding to the live streaming merge screen to a live streaming media server, wherein the screen position information is for separating the at least two live streaming screens from the live streaming merge screen.

[0012] In one selective embodiment, the aforementioned method of merging at least two live streaming screens to obtain a combined live streaming screen is: This involves using a local camera to collect the first live streaming screen in real time, and simultaneously pulling the second live streaming screen in real time from a pre-configured live streaming server. This includes merging the first live streaming screen and the second live streaming screen to obtain a combined live streaming screen.

[0013] In one selective embodiment, the aforementioned method of merging at least two live streaming screens to obtain a combined live streaming screen is: This includes merging at least two live streaming screens using a target merge template to obtain a live streaming merge screen, wherein the target merge template defines the position information of each of the at least two live streaming screens on the live streaming merge screen. Accordingly, obtaining the location information on the live streaming merge screen for each of the at least two live streaming screens as described above, and using this as the screen location information corresponding to the live streaming merge screen, This includes obtaining location information on each of the at least two live streaming screens from the target merging template and using this as screen location information corresponding to the live streaming merging screen.

[0014] According to a third aspect, this disclosure is: A live streaming screen processing system that includes both the live streamer and the viewer, The live streaming side merges at least two live streaming screens to obtain a merged live streaming screen, acquires screen position information corresponding to the merged live streaming screen, and pushes the merged live streaming screen and the corresponding screen position information to the live streaming media server, where the screen position information indicates the position of each of the at least two live streaming screens on the merged live streaming screen. The viewer side provides a live streaming screen processing system for which it pulls the live streaming merge screen and screen position information corresponding to the live streaming merge screen from the live streaming media server, separates at least two live streaming screens from the live streaming merge screen based on the screen position information, and displays the at least two live streaming screens based on a pre-configured live streaming screen display layout.

[0015] In one selective embodiment, the live streaming side is specifically used to collect a first live streaming screen in real time using a local camera, to pull a second live streaming screen in real time from a pre-configured live streaming server, and to merge the first live streaming screen and the second live streaming screen to obtain a merged live streaming screen.

[0016] According to the fourth aspect, this disclosure is, A pull module for pulling a live streaming merge screen and screen position information corresponding to the live streaming merge screen from a live streaming media server, wherein the live streaming merge screen is obtained by merging at least two live streaming screens, and the screen position information is for indicating the position of each of the at least two live streaming screens in the live streaming merge screen; Based on the aforementioned screen position information, a separation module for separating at least two live streaming screens from the live streaming merge screen, A display module for displaying the at least two live streaming screens based on a preset live streaming screen display layout, and a live streaming screen processing apparatus including the same are provided.

[0017] According to a fifth aspect, the present disclosure A merging module for merging at least two live streaming screens to obtain a live streaming merged screen, An acquisition module for acquiring position information of each of the at least two live streaming screens on the live streaming merged screen and using the acquired position information as screen position information corresponding to the live streaming merged screen, A push module for pushing the live streaming merged screen and the screen position information corresponding to the live streaming merged screen to a live streaming stream media server, where the screen position information is for separating the at least two live streaming screens from the live streaming merged screen, and a live streaming screen processing apparatus including the same are provided.

[0018] According to a sixth aspect, the present disclosure provides a computer-readable storage medium storing instructions for causing a terminal device to implement the above method when the computer-readable storage medium runs on the terminal device.

[0019] According to a seventh aspect, the present disclosure provides a live streaming screen processing device including a memory, a processor, and a computer program stored in the memory and executable by the processor, where when the processor executes the computer program, the above method is implemented.

[0020] According to an eighth aspect, the present disclosure provides a computer program product including a computer program / instructions that, when executed by a processor, implements the above method.

[0021] The technical solution according to the embodiments of the present disclosure has at least the following advantages compared with the prior art.

[0022] Embodiments of the present disclosure provide a live broadcast screen processing method. First, on the viewing side, a live broadcast merged screen and screen position information corresponding to the live broadcast merged screen are pulled from a live broadcast streaming media server. Here, the live broadcast merged screen is obtained by merging at least two live broadcast screens, and the screen position information is for marking the positions of at least two live broadcast screens in their respective live broadcast merged screens. Next, based on the screen position information, at least two live broadcast screens are separated from the live broadcast merged screen, and further, at least two live broadcast screens are displayed based on a preset live broadcast screen display layout. Therefore, the embodiments of the present disclosure can separate a plurality of live broadcast screens from the pulled live broadcast merged screen and display each live broadcast screen based on a preset live broadcast screen display layout, enriching the related functions of video live broadcast and improving the viewing experience of users.

Brief Description of the Drawings

[0023] The drawings here are incorporated into the specification, form a part of this specification, show embodiments that conform to the present disclosure, and are used to interpret the principles of the present disclosure together with the specification.

[0024] To more clearly explain the technical solutions in the embodiments of the present disclosure or the prior art, the following briefly describes the drawings that need to be used in the description of the embodiments or the prior art. It is self-evident that those skilled in the art can also obtain other drawings based on these drawings without creative efforts. [Figure 1] It is a schematic configuration diagram of a live broadcast screen processing system according to an embodiment of the present disclosure. [Figure 2] It is a flowchart of a live broadcast screen processing method according to an embodiment of the present disclosure. [Figure 3] It is a schematic diagram of a live broadcast merged screen according to an embodiment of the present disclosure. [Figure 4] It is a schematic diagram of a live broadcast screen display according to an embodiment of the present disclosure. [Figure 5]This is a flowchart of another live streaming screen processing method according to an embodiment of the present disclosure. [Figure 6] This is a schematic diagram of the configuration of a live streaming screen processing device according to an embodiment of the present disclosure. [Figure 7] This is a schematic diagram of the configuration of another live streaming screen processing device according to an embodiment of the present disclosure. [Figure 8] This is a schematic diagram of the configuration of a live streaming screen processing device according to an embodiment of the present disclosure. [Modes for carrying out the invention]

[0025] To better understand the above-mentioned objectives, features, and benefits of this disclosure, the following describes aspects of this disclosure. The embodiments and features of the embodiments of this disclosure can be combined with each other, as long as they do not contradict each other.

[0026] Many specific details are provided below in order to fully understand this disclosure, but this disclosure may be implemented in forms other than those described herein. Clearly, the examples in this specification are only a selection of the examples of this disclosure, not all of them.

[0027] With the rapid development of the internet, live video streaming formats are being used in an increasing number of situations, such as live game streaming, live tournament streaming, and live shopping streaming.

[0028] Therefore, a key technical challenge that urgently needs to be addressed is how to enhance the user viewing experience by enriching the features related to live video streaming.

[0029] To enhance the user viewing experience by enriching the related functions of live video streaming, an embodiment of this disclosure provides a live streaming screen processing method. First, the viewer pulls a live streaming merge screen and corresponding screen position information from a live streaming media server. Here, the live streaming merge screen is obtained by merging at least two live streaming screens, and the screen position information is for marking the position of each of the at least two live streaming screens on the live streaming merge screen. Next, based on the screen position information, at least two live streaming screens are separated from the live streaming merge screen, and then at least two live streaming screens are displayed based on a pre-configured live streaming screen display layout. Thus, an embodiment of this disclosure can separate multiple live streaming screens from a pulled live streaming merge screen and display each live streaming screen based on a pre-configured live streaming screen display layout, enriching the related functions of live video streaming and improving the user viewing experience.

[0030] Based on this, the embodiments of the present disclosure provide a live streaming screen processing system. Figure 1 is a schematic diagram of the configuration of the live streaming screen processing system according to the embodiments of the present disclosure. As shown in Figure 1, the live streaming screen processing system includes a live streaming side 11 and a viewing side 12, where the live streaming side 11 can interact with a live streaming media server 13, and the live streaming side 11 may be a terminal device on the streamer's side. The viewing side 12 can also interact with the live streaming media server 13. The viewing side 12 may be a terminal device on the viewer's side.

[0031] In the embodiments of this disclosure, the live streaming side 11 is used to merge at least two live streaming screens to obtain a merged live streaming screen, acquire screen position information corresponding to the merged live streaming screen, and push the merged live streaming screen and the screen position information corresponding to the merged live streaming screen to the live streaming media server 13, where the screen position information is used to indicate the position of each of the at least two live streaming screens on the merged live streaming screen.

[0032] The viewer 12 pulls the live streaming merge screen and corresponding screen position information from the live streaming media server 13, separates at least two live streaming screens from the live streaming merge screen based on the screen position information, and displays at least two live streaming screens based on a pre-configured live streaming screen display layout.

[0033] In one selective embodiment, the live streaming side 11 is specifically used to collect a first live streaming screen in real time using a local camera, to pull a second live streaming screen in real time from a pre-configured live streaming server, and to merge the first live streaming screen and the second live streaming screen to obtain a merged live streaming screen.

[0034] In the live streaming screen processing system according to the embodiment of this disclosure, the live streaming side 11 can push the live streaming merge screen and screen position information corresponding to the live streaming merge screen to the live streaming media server 13. After the viewer side 12 pulls the live streaming merge screen from the live streaming media server 13, it can separate at least two live streaming screens from the live streaming merge screen based on the screen position information and display at least two live streaming screens based on a pre-configured live streaming screen display layout. Thus, the viewer side 12 can separate multiple live streaming screens from the live streaming merge screen and then display the layout of the multiple live streaming screens based on a pre-configured live streaming screen display layout, which may differ from the display layout for the multiple live streaming screens by the live streaming side 11, thereby increasing the flexibility of displaying the live streaming merge screen and improving the user's viewing experience.

[0035] Based on the live streaming screen processing system described above, embodiments of this disclosure provide a live streaming screen processing method. Figure 2 is a flowchart of the live streaming screen processing method according to embodiments of this disclosure. As shown in Figure 2, the method is applied to the viewer side and includes the following steps.

[0036] S201: Pulls the live streaming merge screen and the corresponding screen position information from the live streaming media server.

[0037] Here, the live stream merge screen is obtained by merging at least two live stream screens, and the screen position information is used to mark the position of each of the at least two live stream screens on the live stream merge screen.

[0038] The live streaming screen processing method according to the embodiments of this disclosure is applied to the viewer side. Here, the viewer side may be a viewer's client, and includes, for example, a smartphone client deployed on the viewer side, a tablet client deployed on the viewer side, etc. The viewer side can interact with the live streaming media server. The viewer side can pull the live streaming screen from the live streaming media server.

[0039] In embodiments of this disclosure, the viewer can pull a live stream merge screen from a live streaming media server. Here, the live stream merge screen includes at least two live streaming screens, and the live streamer can merge at least two live streaming screens to obtain the live stream merge screen. For example, the live streaming screens may include a game streamer screen, a tournament commentator screen, a game live streaming screen, a tournament live streaming screen, etc., and the live streamer can merge at least two live streaming screens to obtain a live stream merge screen including game streamer screen A and game live streaming screen a; or a live stream merge screen including tournament commentator screen A, tournament commentator screen B, and tournament live streaming screen b; and so on.

[0040] In the embodiments of this disclosure, the viewer can also obtain screen position information corresponding to the live streaming merge screen from the live streaming media server. Here, the screen position information is for marking the position of each of the at least two live streaming screens on the live streaming merge screen. Specifically, the screen position information may be screen coordinate information.

[0041] In one selective embodiment, screen coordinate information corresponding to the live streaming merge screen is transmitted to SEI information.

[0042] In the embodiments of this disclosure, screen coordinate information corresponding to the live streaming merge screen obtained by the viewer from the live streaming media server may be carried as SEI information (Supplemental Enhancement Information). Here, the SEI information can label the screen coordinate information of each live streaming screen in the live streaming merge screen.

[0043] For example, the live stream merge screen pulled by the viewer from the live streaming media server includes the game streamer screen A, the game live stream screen a, and SEI information. Figure 3 is a schematic diagram of the live stream merge screen according to an embodiment of the present disclosure. Referring to Figure 3, based on the SEI information, the coordinate information of the game streamer screen A in the live stream merge screen is indicated as coordinate 1, and the coordinate information of the game live stream screen a in the live stream merge screen is indicated as coordinate 2, thereby determining the respective positions of the game streamer screen A and the game live stream screen a in the live stream merge screen.

[0044] S202: Based on screen position information, separate at least two live streaming screens from each live streaming merge screen.

[0045] In the embodiments of this disclosure, the position of each live streaming screen included in the live streaming merge screen is determined based on the screen position information corresponding to the live streaming merge screen pulled in S201. Furthermore, each live streaming screen can be separated from the live streaming merge screen. For example, if the pulled live streaming merge screen is obtained by merging two live streaming screens, the two live streaming screens can be separated from the live streaming merge screen based on the screen position information; if the pulled live streaming merge screen is obtained by merging three live streaming screens, the three live streaming screens can be separated from the live streaming merge screen based on the screen position information; and so on.

[0046] Referring to Figure 3, the positions of Game Live Streamer Screen A and Game Live Stream Screen a on the live streaming merge screen are determined based on coordinates 1 and 2, and then Game Live Streamer Screen A and Game Live Stream Screen a are separated from the live streaming merge screen, respectively.

[0047] S203: Display at least two live streaming screens based on a pre-configured live streaming screen display layout.

[0048] In embodiments of the present disclosure, the viewer has one or more pre-configured live streaming screen display layouts, which can display at least two live streaming screens according to pre-configured positions based on the pre-configured live streaming screen display layouts. Here, the pre-configured live streaming screen display layouts may be configured based on factors such as the viewer's user preferences and the viewer's equipment conditions, and there may or may not be overlapping areas between the areas in which each live streaming screen is located in the pre-configured live streaming screen display layouts, and embodiments of the present disclosure are not limited to the specific style and number of pre-configured live streaming screen display layouts.

[0049] For example, as shown in Figure 4, a schematic diagram of the live streaming screen display according to an embodiment of the present disclosure, it includes two pre-configured live streaming screen display layouts. Here, live streaming screen display layout a includes two live streaming screen display areas, and there is an overlapping area between the areas where each of the two live streaming screens is located. Live streaming screen display layout b includes three live streaming screen display areas, and there is no overlapping area between the areas where each of the three live streaming screens is located.

[0050] In one selective embodiment, first, at least two live streaming screens are drawn on separate canvases. Then, the canvases on which the live streaming screens are drawn are displayed based on a pre-configured live streaming screen display layout.

[0051] In the embodiments of this disclosure, at least two live streaming screens separated from the live streaming merge screen in S202 can be drawn on different canvases, and by displaying the canvases, the live streaming screens on the canvases can be displayed.

[0052] For example, if three live streaming screens are separated from the live streaming merge screen, first, each of the three live streaming screens is drawn on a different canvas. Specifically, game streamer screen A1 is drawn on canvas 1, game streamer screen A2 is drawn on canvas 2, and game live streaming screen a is drawn on canvas 3. Furthermore, based on the pre-configured live streaming screen display layout, and referring to live streaming screen display layout b in Figure 4, canvas 1 is displayed in display area 2, canvas 2 is displayed in display area 3, and canvas 3 is displayed in display area 1, thereby displaying the three live streaming screens (game streamer screen A1, game streamer screen A2, and game live streaming screen a).

[0053] In the embodiments of this disclosure, each separated live streaming screen is drawn on a different canvas, thereby preventing interference between multiple live streaming screens when they are displayed and improving the user's viewing experience.

[0054] In one selective embodiment, at least two live streaming screens include a first live streaming screen and a second live streaming screen, wherein the first live streaming screen is displayed within a first area indicated by a pre-configured live streaming screen display layout, and the second live streaming screen is displayed within a second area indicated by a pre-configured live streaming screen display layout, thereby displaying at least two live streaming screens. Here, there is no overlapping area between the first area and the second area.

[0055] In the embodiments of this disclosure, based on a pre-configured live streaming screen display layout, the first live streaming screen and the second live streaming screen can be displayed in two areas that do not overlap with each other, thereby achieving the effect that at least two live streaming screens do not obstruct each other.

[0056] For example, if, in a game live streaming commentary scene, viewers wish that the game streamer's live streaming screen not obstruct the game live streaming screen in order to improve the viewing experience, then, based on the live streaming screen display layout b in Figure 4, the game streamer screen may be displayed in display area 2 and the game live streaming screen in display area 1.

[0057] In one selective embodiment, the first live streaming screen is a live streaming screen collected in real time by the live streaming provider using a local camera, and the second live streaming screen is a live streaming screen pulled in real time by the live streaming provider.

[0058] In the embodiments of this disclosure, the first live streaming screen may be a live streaming screen collected in real time by the live streaming side using a local camera, for example, a game streamer screen, a tournament streamer screen, etc. The second live streaming screen may be a live streaming screen pulled in real time by the live streaming side, for example, a game live streaming screen, a tournament live streaming screen, etc., pulled in real time by the live streaming side from a pre-configured live streaming server. In the embodiments of this disclosure, based on the viewer's selection of a pre-configured live streaming screen display layout, at least two live streaming screens are displayed in separate areas where there is no overlap between them, solving the problem of the live streaming screen not being fully displayed due to the streamer's screen obstructing the live streaming screen, thereby improving the user's viewing experience.

[0059] In the live streaming screen processing method according to the embodiment of this disclosure, first, the viewer pulls a live streaming merge screen and screen position information corresponding to the live streaming merge screen from the live streaming media server. Here, the live streaming merge screen is obtained by merging based on at least two live streaming screens, and the screen position information is for marking the position of each of the at least two live streaming screens on the live streaming merge screen. Subsequently, based on the screen position information, at least two live streaming screens are separated from the live streaming merge screen, and then at least two live streaming screens are displayed based on a pre-configured live streaming screen display layout. Thus, the embodiment of this disclosure can separate multiple live streaming screens from the pulled live streaming merge screen and display each live streaming screen based on a pre-configured live streaming screen display layout, enriching the related functions of video live streaming and improving the user's viewing experience.

[0060] Based on the live streaming screen processing system described above, embodiments of this disclosure provide another live streaming screen processing method. Figure 5 is a flowchart of another live streaming screen processing method according to embodiments of this disclosure. As shown in Figure 5, the method is applied to the live streaming side and includes the following steps.

[0061] S501: Merge at least two live streaming screens to obtain a merged live streaming screen.

[0062] The live streaming screen processing method according to the embodiments of this disclosure is applied to the live streaming side. Here, the live streaming side may be a client on the streamer's side, and includes, for example, a smartphone client deployed on the streamer's side, a tablet client deployed on the streamer's side, etc. The live streaming side can interact with the live streaming media server, and the live streaming side can push the live streaming screen to the live streaming media server.

[0063] In the embodiments of this disclosure, the live streaming side merges at least two live streaming screens to obtain a merged live streaming screen. Here, the live streaming screens may be local live streaming screens of the live streaming side, or they may be live streaming screens pulled in real time from other live streaming servers. For example, the live streaming side can merge game streamer screen A and game live streaming screen a to obtain the merged live streaming screen shown in Figure 3.

[0064] In one selective embodiment, the live streaming side first collects a first live streaming screen in real time using a local camera, and also pulls a second live streaming screen in real time from a pre-configured live streaming server, and then merges the first live streaming screen and the second live streaming screen to obtain a merged live streaming screen.

[0065] In the embodiments of this disclosure, if the live streamer is a game streamer, the game streamer can collect the game streamer screen in real time using a local camera to create a first live stream screen, and also pull the game live stream screen in real time from a pre-configured live stream server to create a second live stream screen, and further merge the first and second live stream screens to obtain a combined live stream screen in which the game streamer provides commentary on the game; if the live streamer is a tournament streamer, the tournament streamer can collect the tournament streamer screen in real time using a local camera to create a first live stream screen, and also pull the tournament live stream screen in real time from a pre-configured live stream server to create a second live stream screen, and further merge the first and second live stream screens to obtain a combined live stream screen in which the tournament streamer provides commentary on the tournament; and so on.

[0066] In one selective embodiment, a target merge template is used to merge at least two live streaming screens to obtain a merged live streaming screen. Here, the target merge template defines the position information of at least two live streaming screens on the merged live streaming screen.

[0067] In embodiments of this disclosure, the live streaming side includes one or more merge templates, each merge template containing location information on each live streaming merge screen for each live streaming screen. Here, the location information of the live streaming screen may be indicated by the coordinate information of the live streaming screen, and the coordinate information of the live streaming screen may be carried in SEI information. The merge templates may be pre-configured based on factors such as the individual habits of the live streamer on the live streaming side and the equipment conditions of the live streamer's client, and embodiments of this disclosure do not limit the specific style and number of merge templates.

[0068] In the embodiments of this disclosure, first, one target merge template is selected from one or more merge templates, and then, using the target merge template, each live streaming screen is merged according to the corresponding location information to obtain a merged live streaming screen. For example, referring to Figure 3, the merged live streaming screen is obtained by merging the game streamer screen A and the game live streaming screen a using one of the target merge templates.

[0069] S502: Obtain the location information on the live streaming merge screen for at least two live streaming screens and use it as the screen location information corresponding to the live streaming merge screen.

[0070] In the embodiments of this disclosure, the target merge template defines location information on each of the live streaming merge screens for at least two live streaming screens. Therefore, the live streaming side can obtain the location information on each of the live streaming merge screens for at least two live streaming screens from the target merge template and use it as screen location information corresponding to the live streaming merge screen.

[0071] Referring to Figure 3, the live streamer can obtain the position information (coordinate 1) of game streamer screen A on the live stream merge screen and the position information (coordinate 2) of game live stream screen a on the live stream merge screen from the target merge template. Therefore, the screen position information corresponding to the live stream merge screen shown in Figure 3 may include coordinates 1 and 2.

[0072] S503: The live streaming merge screen and corresponding screen position information are pushed to the live streaming media server, where the screen position information is used to separate at least two live streaming screens from the live streaming merge screen.

[0073] In the embodiments of this disclosure, the live streaming side can push the live streaming merge screen obtained in S501 and the screen position information corresponding to the live streaming merge screen acquired in S502 to the live streaming media server. Here, the screen position information may be used by the viewer to separate at least two live streaming screens from the live streaming merge screen.

[0074] In the live streaming screen processing method according to the embodiment of this disclosure, first, the live streaming side merges at least two live streaming screens to obtain a merged live streaming screen. Then, it obtains the position information of each of the at least two live streaming screens on the merged live streaming screen and uses this as screen position information corresponding to the merged live streaming screen. Furthermore, it pushes the merged live streaming screen and the screen position information corresponding to the merged live streaming screen to the live streaming media server. Here, the screen position information is for the viewer to separate at least two live streaming screens from the merged live streaming screen. Therefore, in the embodiment of this disclosure, the live streaming side can not only push the merged live streaming screen, but also push the position information of each live streaming screen on the merged live streaming screen to the live streaming media server. As a result, the viewer can separate each live streaming screen from the merged live streaming screen.

[0075] Based on the above-described embodiment of the method, the present disclosure further provides a live streaming screen processing device. Figure 6 is a schematic diagram of the configuration of a live streaming screen processing device according to an embodiment of the present disclosure.

[0076] Referring to Figure 6, the apparatus is A pull module for pulling a live streaming merge screen and screen position information corresponding to the live streaming merge screen from a live streaming media server, wherein the live streaming merge screen is obtained by merging at least two live streaming screens, and the screen position information is for marking the position of each of the at least two live streaming screens in the live streaming merge screen, the pull module 601, Based on the aforementioned screen position information, a separation module 602 is provided for separating at least two live streaming screens from the live streaming merge screen, The system includes a display module 603 for displaying at least two of the live streaming screens based on a pre-configured live streaming screen display layout.

[0077] In one selective embodiment, the at least two live streaming screens include a first live streaming screen and a second live streaming screen, and the display module 603 includes a first display submodule for displaying the first live streaming screen in a first area shown in a pre-configured live streaming screen display layout, and for displaying the second live streaming screen in a second area shown in the pre-configured live streaming screen display layout, wherein there is no overlapping area between the first area and the second area.

[0078] In one selective embodiment, the first live streaming screen is a live streaming screen collected in real time by the live streaming side using a local camera, and the second live streaming screen is a live streaming screen pulled in real time by the live streaming side.

[0079] In one selective embodiment, the display module 603 is: A drawing submodule for drawing at least two of the aforementioned live streaming screens on different canvases, It includes a second display submodule for displaying a canvas on which the live streaming screen is drawn, based on a pre-configured live streaming screen display layout.

[0080] In one selective embodiment, screen coordinate information corresponding to the live streaming merge screen is transmitted to SEI information.

[0081] In the live streaming screen processing device according to the embodiment of this disclosure, first, the viewer pulls a live streaming merge screen and screen position information corresponding to the live streaming merge screen from the live streaming media server. Here, the live streaming merge screen is obtained by merging at least two live streaming screens, and the screen position information is for marking the position of each of the at least two live streaming screens in the live streaming merge screen. Subsequently, at least two live streaming screens are separated from the live streaming merge screen based on the screen position information, and then at least two live streaming screens are displayed based on a pre-configured live streaming screen display layout. Thus, the embodiment of this disclosure can separate multiple live streaming screens from the pulled live streaming merge screen and display each live streaming screen based on a pre-configured live streaming screen display layout, enriching the related functions of video live streaming and improving the user's viewing experience.

[0082] Based on the above-described embodiment of the method, the present disclosure further provides a live streaming screen processing device. Figure 7 is a schematic diagram of the configuration of another live streaming screen processing device according to an embodiment of the present disclosure. Referring to Figure 7, the device is A merge module 701 for merging at least two live streaming screens to obtain a merged live streaming screen, An acquisition module 702 for acquiring location information on the live streaming merge screen for each of the at least two live streaming screens and converting it into screen location information corresponding to the live streaming merge screen, A push module for pushing the live streaming merge screen and screen position information corresponding to the live streaming merge screen to a live streaming media server, the push module 703 comprising the screen position information for separating the at least two live streaming screens from the live streaming merge screen.

[0083] In one selective embodiment, the merging module 701 is A collection submodule for collecting the first live streaming screen in real time using a local camera, and for pulling the second live streaming screen in real time from a pre-configured live streaming server, It includes a first merge submodule for merging the first live streaming screen and the second live streaming screen to obtain a merged live streaming screen.

[0084] In one selective embodiment, the merging module 701 is It includes a second merge submodule for merging at least two live streaming screens using a target merge template to obtain a live streaming merge screen, wherein the target merge template defines the position information of each of the at least two live streaming screens on the live streaming merge screen. Accordingly, the acquisition module 702, The system includes an acquisition submodule for obtaining location information on each of the at least two live streaming screens from the target merge template and converting it into screen location information corresponding to the live streaming merge screen.

[0085] In the live streaming screen processing device according to the embodiment of this disclosure, first, the live streaming side merges at least two live streaming screens to obtain a merged live streaming screen. Then, it obtains the position information of each of the at least two live streaming screens on the merged live streaming screen and uses this as screen position information corresponding to the merged live streaming screen. Furthermore, it pushes the merged live streaming screen and the screen position information corresponding to the merged live streaming screen to the live streaming media server. Here, the screen position information is for the viewer to separate at least two live streaming screens from the merged live streaming screen. Therefore, in the embodiment of this disclosure, the live streaming side can not only push the merged live streaming screen, but also push the position information of each live streaming screen on the merged live streaming screen to the live streaming media server. As a result, the viewer can separate each live streaming screen from the merged live streaming screen.

[0086] In addition to the methods and apparatus described above, the embodiments of this disclosure further provide a computer-readable storage medium in which, when operated on a terminal device, instructions are stored that enable the terminal device to implement the live streaming screen processing method according to the embodiments of this disclosure.

[0087] The embodiments of this disclosure further provide a computer program product that, when executed by a processor, includes a computer program / instruction that implements the live streaming screen processing method described in the embodiments of this disclosure.

[0088] Furthermore, embodiments of this disclosure further provide live streaming screen processing equipment, which may include a processor 801, memory 802, input device 803, and output device 804, as shown in Figure 8. The number of processors 801 in the live streaming screen processing equipment may be one or more, with Figure 8 showing one processor as an example. In some embodiments of this disclosure, the processor 801, memory 802, input device 803, and output device 804 may be connected via a bus or other means, with Figure 8 showing an example where they are connected via a bus.

[0089] Memory 802 may be used to store software programs and modules. Processor 801 executes various functional applications and data processing of the live streaming screen processing device by executing the software programs and modules stored in memory 802. Memory 802 may mainly include a program storage area and a data storage area. Of these, the program storage area can store the operating system, applications necessary for at least one function, etc. Memory 802 may also include high-speed random access memory and may further include non-volatile memory, such as at least one magnetic disk memory device, flash memory device, or other volatile solid-state memory device. Input device 803 may be used to receive input numerical or character information and to generate signal inputs related to user settings and function control of the live streaming screen processing device.

[0090] Specifically, in this embodiment, the processor 801 loads executable files corresponding to the processes of one or more applications into memory 802 according to the following instructions, and the processor 801 executes the applications stored in memory 802, thereby realizing each of the functions of the live streaming screen processing device described above.

[0091] In this specification, relational terms such as "first" and "second" are used solely for the purpose of distinguishing one entity or operation from another, and do not require or imply that such an actual relationship or order exists between these entities or operations. Furthermore, the terms "include," "contain," or any other variant thereof, by indicating non-exclusive inclusion, mean that a process, method, article, or apparatus containing a series of elements includes not only those elements but also other elements not explicitly stated, or elements specific to such a process, method, article, or apparatus. Unless further restrictions are imposed, an element limited by "include one..." does not exclude other identical elements from being included in a process, method, article, or apparatus containing the aforementioned element.

[0092] The above are merely specific embodiments of the Disclosure and are used to enable those skilled in the art to understand or implement the Disclosure. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the Disclosure. Accordingly, the Disclosure is not limited to these embodiments herein and has the broadest scope to be compatible with the principles and novel features disclosed herein.

Claims

1. The method involves retrieving a live streaming merge screen and corresponding screen position information from a live streaming media server, wherein the live streaming merge screen is obtained by merging at least two live streaming screens, and the screen position information is for marking the position of each of the at least two live streaming screens on the live streaming merge screen. Based on the aforementioned screen position information, the at least two live streaming screens are separated from the live streaming merge screen, A live streaming screen processing method, comprising displaying at least two live streaming screens based on a pre-configured live streaming screen display layout.

2. The at least two live streaming screens include a first live streaming screen and a second live streaming screen, and the at least two live streaming screens are displayed based on the pre-configured live streaming screen display layout. The method according to claim 1, comprising displaying the first live streaming screen within a first area indicated by a pre-configured live streaming screen display layout, and displaying the second live streaming screen within a second area indicated by the pre-configured live streaming screen display layout, wherein there is no overlapping area between the first area and the second area.

3. The method according to claim 2, wherein the first live streaming screen is a live streaming screen collected in real time by the live streaming side using a local camera, and the second live streaming screen is a live streaming screen pulled in real time by the live streaming side.

4. Displaying at least two live streaming screens based on the aforementioned pre-configured live streaming screen display layout is: The above-mentioned at least two live streaming screens are drawn on separate canvases, The method according to claim 1, comprising displaying a canvas on which a live streaming screen has been drawn based on a pre-configured live streaming screen display layout.

5. The method according to claim 1, wherein screen coordinate information corresponding to the live streaming merge screen is transmitted to SEI information.

6. To merge at least two live streaming screens to obtain a merged live streaming screen, The location information on the live streaming merge screen for each of the at least two live streaming screens is obtained and used as the screen location information corresponding to the live streaming merge screen. A live streaming screen processing method comprising pushing the live streaming merge screen and screen position information corresponding to the live streaming merge screen to a live streaming media server, wherein the screen position information is for separating the at least two live streaming screens from the live streaming merge screen.

7. Combining the two aforementioned live streaming screens to obtain a combined live streaming screen is, The system collects the first live streaming screen in real time using a local camera, and also pulls the second live streaming screen in real time from a pre-configured live streaming server. The method according to claim 6, comprising merging the first live streaming screen and the second live streaming screen to obtain a combined live streaming screen.

8. Combining the two aforementioned live streaming screens to obtain a combined live streaming screen is, This includes merging at least two live streaming screens using a target merge template to obtain a live streaming merge screen, wherein the target merge template defines the position information of each of the at least two live streaming screens on the live streaming merge screen. Accordingly, obtaining the location information on the live streaming merge screen for each of the at least two live streaming screens and using it as the screen location information corresponding to the live streaming merge screen is: The method according to claim 6, further comprising obtaining location information on each of the at least two live streaming screens from the target merging template and using this as screen location information corresponding to the live streaming merging screen.

9. A live streaming screen processing system that includes both the live streamer and the viewer, The live streaming side merges at least two live streaming screens to obtain a merged live streaming screen, acquires screen position information corresponding to the merged live streaming screen, and pushes the merged live streaming screen and the corresponding screen position information to the live streaming media server, where the screen position information indicates the position of each of the at least two live streaming screens on the merged live streaming screen. A live streaming screen processing system for the viewer side, which pulls the live streaming merge screen and screen position information corresponding to the live streaming merge screen from the live streaming media server, separates at least two live streaming screens from the live streaming merge screen based on the screen position information, and displays the at least two live streaming screens based on a pre-configured live streaming screen display layout.

10. The system according to claim 9, wherein the live streaming side is specifically used to collect a first live streaming screen in real time using a local camera, to pull a second live streaming screen in real time from a pre-configured live streaming server, and to merge the first live streaming screen and the second live streaming screen to obtain a merged live streaming screen.

11. A pull module for pulling a live streaming merge screen and screen position information corresponding to the live streaming merge screen from a live streaming media server, wherein the live streaming merge screen is obtained by merging at least two live streaming screens, and the screen position information is for indicating the position of each of the at least two live streaming screens in the live streaming merge screen; Based on the aforementioned screen position information, a separation module for separating at least two live streaming screens from the live streaming merge screen, A live streaming screen processing device, comprising: a display module for displaying at least two live streaming screens based on a pre-configured live streaming screen display layout;

12. A merge module to combine at least two live streaming screens to obtain a merged live streaming screen, An acquisition module for obtaining location information on the live streaming merge screen for each of the at least two live streaming screens and converting it into screen location information corresponding to the live streaming merge screen, A live streaming screen processing device comprising: a push module for pushing the live streaming merge screen and screen position information corresponding to the live streaming merge screen to a live streaming media server, wherein the screen position information is for separating the at least two live streaming screens from the live streaming merge screen.

13. A computer-readable storage medium, which, when operated by a terminal device, stores instructions in the terminal device that enable the implementation of the method according to any one of claims 1 to 8.

14. A live streaming screen processing device comprising memory, a processor, and a computer program stored in the memory and operable by the processor, wherein when the processor executes the computer program, the device realizes the method according to any one of claims 1 to 8.

15. A computer program, when executed by a processor, that implements the method described in any one of claims 1 to 8.

Images