Live Streaming Screen Processing Method, Apparatus, Device, and Storage Medium

Abstract

The present disclosure provides a live streaming screen processing method, apparatus, device, and storage medium. In the method, first, the viewing side pulls a live streaming merged screen and screen position information corresponding to the live streaming merged screen from a live streaming media server. Here, the live streaming merged screen is obtained by merging at least two live streaming screens, and the screen position information is for marking the positions of at least two live streaming screens in the live streaming merged screen respectively. Then, based on the screen position information, at least two live streaming screens are separated from the live streaming merged screen respectively, and further, at least two live streaming screens are displayed based on a preset live streaming screen display layout. Therefore, the embodiments of the present disclosure can separate a plurality of live streaming screens from the pulled live streaming merged screen and display each live streaming screen based on the preset live streaming screen display layout, enrich the related functions of video live streaming, and improve the viewing experience of users.

Description

Technical Field

[0001] [Cross - reference to Related Applications] This application is based on and claims priority to a Chinese application with an application number of 202211387325.0 and a filing date of November 7, 2022, and the entire disclosure of this Chinese application is incorporated herein by reference.

[0002] [Technical Field] The present disclosure relates to the field of data processing, and in particular, to a method, apparatus, device, and storage medium for processing a live streaming screen.

Background Art

[0003] With the rapid development of the Internet, the video live streaming format is increasingly used in more and more scenarios, such as game live streaming, tournament live streaming, shopping live streaming, and so on.

[0004] Therefore, how to enrich the related functions of video live streaming to improve the viewing experience of users is currently a technical problem that urgently needs to be solved.

Summary of the Invention

[0005] To solve the above - mentioned technical problems, embodiments of the present disclosure provide a method for processing a live streaming screen.

[0006] According to a first aspect, the present disclosure is pulling a live streaming merged screen and screen position information corresponding to the live streaming merged screen from a live streaming media server, where the live streaming merged screen is obtained by merging at least two live streaming screens, and the screen position information is for marking the positions of the at least two live streaming screens in the live streaming merged screen respectively; separating the at least two live streaming screens from the live streaming merged screen based on the screen position information; Provided is a live distribution screen processing method including: displaying the at least two live distribution screens based on a preset live distribution screen display layout.

[0007] In an alternative embodiment, the at least two live distribution screens include a first live distribution screen and a second live distribution screen, and displaying the at least two live distribution screens based on the preset live distribution screen display layout includes: displaying the first live distribution screen within a first area shown in the preset live distribution screen display layout, and displaying the second live distribution screen within a second area shown in the preset live distribution screen display layout, where there is no overlapping area between the first area and the second area.

[0008] In an alternative embodiment, the first live distribution screen is a live distribution screen that the live distribution side collects in real time using a local camera, and the second live distribution screen is a live distribution screen that the live distribution side pulls in real time.

[0009] In an alternative embodiment, displaying the at least two live distribution screens based on the preset live distribution screen display layout includes: drawing each of the at least two live distribution screens on a different canvas; and displaying the canvas on which the live distribution screen is drawn based on the preset live distribution screen display layout.

[0010] In an alternative embodiment, the screen coordinate information corresponding to the live distribution merger screen is carried in the SEI information.

[0011] According to a second aspect, the present disclosure provides: merging at least two live distribution screens to obtain a live distribution merger screen; Obtaining the position information of each of the at least two live streaming screens on the live streaming merge screen, and using it as the screen position information corresponding to the live streaming merge screen; Pushing the live streaming merge screen and the screen position information corresponding to the live streaming merge screen to a live streaming stream media server, where the screen position information is for separating the at least two live streaming screens from the live streaming merge screen, and providing a live streaming screen processing method including this.

[0012] In an alternative embodiment, obtaining a live streaming merge screen by merging at least two live streaming screens as described above includes: Collecting a first live streaming screen in real time using a local camera and pulling a second live streaming screen in real time from a preset live streaming server; Merging the first live streaming screen and the second live streaming screen to obtain a live streaming merge screen.

[0013] In an alternative embodiment, obtaining a live streaming merge screen by merging at least two live streaming screens as described above includes: Merging at least two live streaming screens using a target merge template to obtain a live streaming merge screen, where the position information of each of the at least two live streaming screens on the live streaming merge screen is defined in the target merge template; Accordingly, obtaining the position information of each of the at least two live streaming screens on the live streaming merge screen as described above and using it as the screen position information corresponding to the live streaming merge screen includes: Obtaining the position information of each of the at least two live streaming screens on the live streaming merge screen from the target merge template and using it as the screen position information corresponding to the live streaming merge screen.

[0014] According to a third aspect, the present disclosure provides: A live streaming screen processing system including a live streaming side and a viewing side, The live streaming side is for merging at least two live streaming screens to obtain a live streaming merged screen, acquiring screen position information corresponding to the live streaming merged screen, and pushing the live streaming merged screen and the screen position information corresponding to the live streaming merged screen to a live streaming stream media server. Here, the screen position information is for indicating the position of each of the at least two live streaming screens on the live streaming merged screen, The viewing side is for pulling the live streaming merged screen and the screen position information corresponding to the live streaming merged screen from the live streaming stream media server, separating each of the at least two live streaming screens from the live streaming merged screen based on the screen position information, and displaying the at least two live streaming screens based on a preset live streaming screen display layout. A live streaming screen processing system is provided.

[0015] In an alternative embodiment, the live streaming side is specifically used for collecting a first live streaming screen in real time using a local camera, pulling a second live streaming screen in real time from a preset live streaming server, and merging the first live streaming screen and the second live streaming screen to obtain a live streaming merged screen.

[0016] According to a fourth aspect, the present disclosure provides A pull module for pulling a live streaming merged screen and the screen position information corresponding to the live streaming merged screen from a live streaming stream media server, where the live streaming merged screen is obtained by merging based on at least two live streaming screens, and the screen position information is for marking the position of each of the at least two live streaming screens in the live streaming merged screen, A separation module for separating each of the at least two live streaming screens from the live streaming merged screen based on the screen position information, A display module for displaying the at least two live streaming screens based on a preset live streaming screen display layout, and a live streaming screen processing apparatus including the same are provided.

[0017] According to a fifth aspect, the present disclosure A merging module for merging at least two live streaming screens to obtain a live streaming merged screen, and an acquisition module for acquiring position information of each of the at least two live streaming screens on the live streaming merged screen and using the position information as screen position information corresponding to the live streaming merged screen, and a push module for pushing the live streaming merged screen and the screen position information corresponding to the live streaming merged screen to a live streaming stream media server, wherein the screen position information is for separating the at least two live streaming screens from the live streaming merged screen, and a live streaming screen processing apparatus including the same are provided. A merging module for merging at least two live streaming screens to obtain a live streaming merged screen, and an acquisition module for acquiring position information of each of the at least two live streaming screens on the live streaming merged screen and using the position information as screen position information corresponding to the live streaming merged screen, and a push module for pushing the live streaming merged screen and the screen position information corresponding to the live streaming merged screen to a live streaming stream media server, wherein the screen position information is for separating the at least two live streaming screens from the live streaming merged screen, and a live streaming screen processing apparatus including the same are provided. A merging module for merging at least two live streaming screens to obtain a live streaming merged screen, and an acquisition module for acquiring position information of each of the at least two live streaming screens on the live streaming merged screen and using the position information as screen position information corresponding to the live streaming merged screen, and a push module for pushing the live streaming merged screen and the screen position information corresponding to the live streaming merged screen to a live streaming stream media server, wherein the screen position information is for separating the at least two live streaming screens from the live streaming merged screen, and a live streaming screen processing apparatus including the same are provided.

[0018] According to a sixth aspect, the present disclosure provides a computer-readable storage medium storing instructions that, when executed on a terminal device, cause the terminal device to implement the above method.

[0019] According to a seventh aspect, the present disclosure provides a live streaming screen processing device including a memory, a processor, and a computer program stored in the memory and executable by the processor, wherein when the processor executes the computer program, the above method is implemented.

[0020] According to an eighth aspect, the present disclosure provides a computer program product including a computer program / instructions that, when executed by a processor, implement the above method.

[0021] The technical solution according to the embodiments of the present disclosure has at least the following advantages compared with the prior art.

[0022] Embodiments of the present disclosure provide a method for processing a live streaming screen. First, the viewing side pulls the live streaming merged screen and the screen position information corresponding to the live streaming merged screen from the live streaming media server. Here, the live streaming merged screen is obtained by merging at least two live streaming screens, and the screen position information is for marking the positions of at least two live streaming screens in their respective live streaming merged screens. Next, based on the screen position information, at least two live streaming screens are separated from the live streaming merged screen, and further, based on a preset live streaming screen display layout, at least two live streaming screens are displayed. Therefore, the embodiments of the present disclosure can separate a plurality of live streaming screens from the pulled live streaming merged screen and display each live streaming screen based on a preset live streaming screen display layout, enriching the related functions of video live streaming and improving the viewing experience of users.

Brief Description of the Drawings

[0023] The drawings here are incorporated into the specification, form a part of this specification, show embodiments that conform to the present disclosure, and are used to interpret the principles of the present disclosure together with the specification.

[0024] To more clearly explain the embodiments of the present disclosure or the technical solutions in the prior art, the following briefly describes the drawings that need to be used in the description of the embodiments or the prior art. Obviously, those skilled in the art can also obtain other drawings based on these drawings without creative efforts.

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Embodiments for Carrying Out the Invention

[0025] In order to more clearly understand the above objects, features, and advantages of the present disclosure, the following further describes the aspects of the present disclosure. Note that, unless there is a contradiction, the embodiments of the present disclosure and the features in the embodiments can be combined with each other.

[0026] In order to fully understand the present disclosure, many specific details are described in the following description. However, the present disclosure may be implemented in other forms different from those described herein. Obviously, the embodiments in the specification are only some embodiments of the present disclosure, not all embodiments.

[0027] With the rapid development of the Internet, the video live streaming format is increasingly used in more and more scenarios. For example, there are game live streaming, tournament live streaming, shopping live streaming, and so on.

[0028] Therefore, how to enrich the related functions of video live streaming to improve the user's viewing experience is a technical problem that is currently strongly desired to be solved.

[0029] By enriching the related functions of video live streaming, in order to improve the viewing experience of users, embodiments of the present disclosure provide a method for processing live streaming screens. First, the viewing side pulls the live streaming merged screen and the screen position information corresponding to the live streaming merged screen from the live streaming media server. Here, the live streaming merged screen is obtained by merging at least two live streaming screens, and the screen position information is for marking the positions of at least two live streaming screens in their respective live streaming merged screens. Next, based on the screen position information, at least two live streaming screens are separated from the live streaming merged screen, and further, based on a preset live streaming screen display layout, at least two live streaming screens are displayed. Therefore, the embodiments of the present disclosure can separate a plurality of live streaming screens from the pulled live streaming merged screen and display each live streaming screen based on a preset live streaming screen display layout, enriching the related functions of video live streaming and improving the viewing experience of users.

[0030] Based on this, embodiments of the present disclosure provide a live streaming screen processing system. FIG. 1 is a schematic configuration diagram of a live streaming screen processing system according to an embodiment of the present disclosure. As shown in FIG. 1, the live streaming screen processing system includes a live streaming side 11 and a viewing side 12. Here, the live streaming side 11 can interact with the live streaming media server 13, and the live streaming side 11 may be a terminal device on the live streaming side. The viewing side 12 can also interact with the live streaming media server 13. The viewing side 12 may be a terminal device on the viewer side.

[0031] In an embodiment of the present disclosure, the live streaming side 11 is used to merge at least two live streaming screens to obtain a live streaming merged screen and acquire screen position information corresponding to the live streaming merged screen, and push the live streaming merged screen and the screen position information corresponding to the live streaming merged screen to the live streaming stream media server 13. Here, the screen position information is for indicating the positions of the at least two live streaming screens on the live streaming merged screen respectively.

[0032] The viewing side 12 is used to pull the live streaming merged screen and the screen position information corresponding to the live streaming merged screen from the live streaming stream media server 13, separate at least two live streaming screens from the live streaming merged screen based on the screen position information, and display the at least two live streaming screens based on a preset live streaming screen display layout.

[0033] In an alternative embodiment, specifically, the live streaming side 11 is used to collect the first live streaming screen in real time by using a local camera, pull the second live streaming screen in real time from a preset live streaming server, and merge the first live streaming screen and the second live streaming screen to obtain a live streaming merged screen.

[0034] In the live streaming screen processing system according to an embodiment of the present disclosure, the live streaming side 11 can push the live streaming merged screen and the screen position information corresponding to the live streaming merged screen to the live streaming stream media server 13. After pulling the live streaming merged screen from the live streaming stream media server 13, the viewing side 12 separates at least two live streaming screens from the live streaming merged screen based on the screen position information, and can display at least two live streaming screens based on a preset live streaming screen display layout. Therefore, the viewing side 12 can separate a plurality of live streaming screens from the live streaming merged screen, and then realize the layout display of the plurality of live streaming screens based on a preset live streaming screen display layout. It may be different from the display layout of the plurality of live streaming screens by the live streaming side 11, improving the flexibility of the display of the live streaming merged screen, thereby improving the viewing experience of the user.

[0035] Based on the above live streaming screen processing system, an embodiment of the present disclosure provides a live streaming screen processing method. FIG. 2 is a flowchart of the live streaming screen processing method according to an embodiment of the present disclosure. As shown in FIG. 2, the method is applied to the viewing side, and the method includes the following steps.

[0036] S201: Pull the live streaming merged screen and the screen position information corresponding to the live streaming merged screen from the live streaming stream media server.

[0037] Here, the live streaming merged screen is obtained by merging based on at least two live streaming screens, and the screen position information is for marking the positions of the at least two live streaming screens in the respective live streaming merged screens.

[0038] The live streaming screen processing method according to an embodiment of the present disclosure is applied to the viewing side. Here, the viewing side may be a client on the viewer side, and includes, for example, a smartphone client deployed on the viewer side, a tablet client deployed on the viewer side, and the like. The viewing side can interact with the live streaming media server. The viewing side can pull the live streaming screen from the live streaming media server.

[0039] In an embodiment of the present disclosure, the viewing side can pull the live streaming merged screen from the live streaming media server. Here, the live streaming merged screen includes at least two live streaming screens, and the live streaming side can merge at least two live streaming screens to obtain the live streaming merged screen. For example, the live streaming screen may include a game streamer screen, a tournament commentator screen, a game live streaming screen, a tournament live streaming screen, etc., and the live streaming side can merge at least two live streaming screens to obtain a live streaming merged screen including a game streamer screen A and a game live streaming screen a; or, obtain a live streaming merged screen including a tournament commentator screen A, a tournament commentator screen B, and a tournament live streaming screen b; and so on.

[0040] In an embodiment of the present disclosure, the viewing side can also obtain the screen position information corresponding to the live streaming merged screen from the live streaming media server. Here, the screen position information is for marking the positions of at least two live streaming screens in the respective live streaming merged screens. Specifically, the screen position information may be screen coordinate information.

[0041] In an alternative embodiment, the screen coordinate information corresponding to the live streaming merged screen is carried in the SEI information.

[0042] In an embodiment of the present disclosure, the screen coordinate information corresponding to the live streaming merged screen obtained by the viewing side from the live streaming media server may be carried in SEI information (Supplemental Enhancement Information). Here, the SEI information can label the screen coordinate information in the live streaming merged screen of each live streaming screen.

[0043] For example, the live streaming merged screen pulled by the viewing side from the live streaming media server includes the game live streamer screen A, the game live streaming screen a, and SEI information. FIG. 3 is a schematic diagram of the live streaming merged screen according to an embodiment of the present disclosure. Referring to FIG. 3, based on the SEI information, it can be labeled that the coordinate information of the game live streamer screen A in the live streaming merged screen is coordinate 1, and the coordinate information of the game live streaming screen a in the live streaming merged screen is coordinate 2, whereby the positions of the game live streamer screen A and the game live streaming screen a in their respective live streaming merged screens can be determined.

[0044] S202: Based on the screen position information, separate at least two live streaming screens from the live streaming merged screen respectively.

[0045] In an embodiment of the present disclosure, based on the screen position information corresponding to the live streaming merged screen pulled in S201 above, the position of each live streaming screen included in the live streaming merged screen in its respective live streaming merged screen is determined. Furthermore, each live streaming screen can be separated from the live streaming merged screen. For example, if the pulled live streaming merged screen is obtained by merging based on two live streaming screens, then based on the screen position information, the two live streaming screens can be separated from the live streaming merged screen; if the pulled live streaming merged screen is obtained by merging based on three live streaming screens, then based on the screen position information, the three live streaming screens can be separated from the live streaming merged screen; and so on.

[0046] Referring to FIG. 3, based on coordinates 1 and coordinates 2, determine the positions of the respective live streaming merger screens of the game streamer screen A and the game live streaming screen a, and further separate the game streamer screen A and the game live streaming screen a from the live streaming merger screen respectively.

[0047] S203: Display at least two live streaming screens based on a preset live streaming screen display layout.

[0048] In the embodiments of the present disclosure, the viewing side includes one or more preset live streaming screen display layouts, and based on the preset live streaming screen display layout, at least two live streaming screens can be displayed according to the preset positions. Here, the preset live streaming screen display layout may be set based on elements such as the preferences of the users on the viewing side and the device conditions on the viewing side. There may or may not be overlapping areas between the areas where each live streaming screen is located in the preset live streaming screen display layout. The embodiments of the present disclosure do not limit the specific style and number of the preset live streaming screen display layouts.

[0049] For example, as shown in FIG. 4, which is a schematic diagram of live streaming screen display according to the embodiments of the present disclosure, it includes two preset live streaming screen display layouts. Here, the live streaming screen display layout a includes two live streaming screen display areas, and there is an overlapping area between the areas where each of the two live streaming screens is located. The live streaming screen display layout b includes three live streaming screen display areas, and there is no overlapping area between the areas where each of the three live streaming screens is located.

[0050] In an alternative embodiment, first, draw at least two live streaming screens on different canvases respectively. Further, based on the preset live streaming screen display layout, display the canvases on which the live streaming screens are drawn.

[0051] In an embodiment of the present disclosure, based on at least two live streaming screens separated from the live streaming merger screen in S202 above, they can be drawn on different canvases respectively. By displaying the canvases, the live streaming screens on the canvases can be displayed.

[0052] For example, if it is assumed that three live streaming screens are separated from the live streaming merger screen, first, the three live streaming screens are drawn on different canvases respectively. Specifically, the game streamer screen A1 is drawn on canvas 1, the game streamer screen A2 is drawn on canvas 2, and the game live streaming screen a is drawn on canvas 3. Further, based on the preset live streaming screen display layout, referring to the live streaming screen display layout b in FIG. 4, canvas 1 is displayed in display area 2, canvas 2 is displayed in display area 3, and canvas 3 is displayed in display area 1, and the above three live streaming screens (game streamer screen A1, game streamer screen A2, and game live streaming screen a) are displayed.

[0053] In an embodiment of the present disclosure, by drawing each separated live streaming screen on a different canvas respectively, when multiple live streaming screens are displayed, they do not interfere with each other, improving the user's viewing experience.

[0054] In an alternative embodiment, at least two live streaming screens include a first live streaming screen and a second live streaming screen. The first live streaming screen is displayed within a first area indicated by a preset live streaming screen display layout, and the second live streaming screen is displayed within a second area indicated by the preset live streaming screen display layout, and at least two live streaming screens are displayed. Here, there is no overlapping area between the first area and the second area.

[0055] In an embodiment of the present disclosure, based on a preset live broadcast screen display layout, the first live broadcast screen and the second live broadcast screen can be respectively displayed in two regions without overlapping regions with each other, achieving the effect that at least two live broadcast screens do not block each other.

[0056] For example, in the case of a game live broadcast commentary scene, if the viewing-side user hopes that the live broadcast screen of the game streamer does not block the game live broadcast screen in order to improve the viewing experience, based on the live broadcast screen display layout b in FIG. 4, the game streamer screen can be displayed in display area 2, and the game live broadcast screen can be displayed in display area 1.

[0057] In an alternative embodiment, the first live broadcast screen is a live broadcast screen collected in real time by the live broadcast side using a local camera, and the second live broadcast screen is a live broadcast screen pulled in real time by the live broadcast side.

[0058] In an embodiment of the present disclosure, the first live broadcast screen may be a live broadcast screen collected in real time by the live broadcast side using a local camera, for example, a game streamer screen, a tournament streamer screen, etc. The second live broadcast screen may be a live broadcast screen pulled in real time by the live broadcast side, for example, a game live broadcast screen, a tournament live broadcast screen, etc. pulled in real time by the live broadcast side from a preset live broadcast server. In an embodiment of the present disclosure, based on the selection of the preset live broadcast screen display layout by the viewing side, at least two live broadcast screens are respectively displayed in each region without overlapping regions with each other, solving the problem that the live broadcast screen cannot be completely displayed due to the streamer screen blocking the live broadcast screen, thereby improving the user's viewing experience.

[0059] In the live streaming screen processing method according to an embodiment of the present disclosure, first, on the viewing side, a live streaming merged screen and screen position information corresponding to the live streaming merged screen are pulled from a live streaming media server. Here, the live streaming merged screen is obtained by merging at least two live streaming screens, and the screen position information is for marking the positions of at least two live streaming screens in the respective live streaming merged screens. Then, based on the screen position information, at least two live streaming screens are separated from the live streaming merged screen, and further, at least two live streaming screens are displayed based on a preset live streaming screen display layout. Therefore, the embodiment of the present disclosure can separate a plurality of live streaming screens from the pulled live streaming merged screen and display each live streaming screen based on the preset live streaming screen display layout, enriching the related functions of video live streaming and improving the viewing experience of users.

[0060] Based on the above live streaming screen processing system, an embodiment of the present disclosure provides another live streaming screen processing method. FIG. 5 is a flowchart of another live streaming screen processing method according to an embodiment of the present disclosure. As shown in FIG. 5, the method is applied to the live streaming side, and the method includes the following steps.

[0061] S501: Merge at least two live streaming screens to obtain a live streaming merged screen.

[0062] The live streaming screen processing method according to an embodiment of the present disclosure is applied to the live streaming side. Here, the live streaming side may be a client on the live streaming side, for example, including a smartphone client deployed on the live streaming side, a tablet client deployed on the live streaming side, and the like. The live streaming side can interact with the live streaming media server, and the live streaming side can push a live streaming screen to the live streaming media server.

[0063] In an embodiment of the present disclosure, the live streaming side combines at least two live streaming screens to obtain a live streaming combined screen. Here, the live streaming screen may be the local live streaming screen on the live streaming side, or may be a live streaming screen pulled in real time from another live streaming server. For example, the live streaming side can combine the game player screen A and the game live streaming screen a to obtain the live streaming combined screen shown in FIG. 3.

[0064] In an alternative embodiment, first, the live streaming side collects the first live streaming screen in real time using a local camera, and also pulls the second live streaming screen in real time from a preset live streaming server, and further combines the first live streaming screen and the second live streaming screen to obtain a live streaming combined screen.

[0065] In an embodiment of the present disclosure, if the live streaming side is the game player side, the game player side collects the game player screen in real time using a local camera as the first live streaming screen, and also pulls the game live streaming screen in real time from a preset live streaming server as the second live streaming screen. Further, the game player side can combine the first live streaming screen and the second live streaming screen to obtain a live streaming combined screen in which the game player explains the game; if the live streaming side is the tournament player side, the tournament player side collects the tournament player screen in real time using a local camera as the first live streaming screen, and also pulls the tournament live streaming screen in real time from a preset live streaming server as the second live streaming screen. Further, the tournament player side can combine the first live streaming screen and the second live streaming screen to obtain a live streaming combined screen in which the tournament player explains the tournament; and so on.

[0066] In an alternative embodiment, at least two live streaming screens are merged using a target merging template to obtain a live streaming merged screen. Here, the target merging template defines the position information of each of the at least two live streaming screens on the live streaming merged screen.

[0067] In the embodiments of the present disclosure, the live streaming side includes one or more merging templates, and the merging templates include the position information of each of the live streaming screens on the corresponding live streaming merged screen. Here, the position information of the live streaming screen may be indicated by the coordinate information of the live streaming screen, and the coordinate information of the live streaming screen may be carried in the SEI information. The merging template may be preset based on factors such as the personal habits of the live streamer on the live streaming side and the device conditions of the client on the live streamer side. The embodiments of the present disclosure do not limit the specific style and number of the merging templates.

[0068] In the embodiments of the present disclosure, first, one target merging template is determined from one or more merging templates, and then the target merging template is used to merge each live streaming screen according to the corresponding position information to obtain a live streaming merged screen. For example, referring to FIG. 3, it is a live streaming merged screen obtained by merging the game streamer screen A and the game live streaming screen a using one of the target merging templates.

[0069] S502: Obtain the position information of each of the at least two live streaming screens on the corresponding live streaming merged screen, and use it as the screen position information corresponding to the live streaming merged screen.

[0070] In the embodiments of the present disclosure, since the target merging template defines the position information of each of the at least two live streaming screens on the live streaming merged screen, the live streaming side can obtain the position information of each of the at least two live streaming screens on the live streaming merged screen from the target merging template and use it as the screen position information corresponding to the live streaming merged screen.

[0071] Referring to FIG. 3, the live streaming side can obtain the position information (coordinate 1) on the live streaming merging screen of the game streamer screen A and the position information (coordinate 2) on the live streaming merging screen of the game live streaming screen a from the target merging template. Therefore, the screen position information corresponding to the live streaming merging screen shown in FIG. 3 may include coordinate 1 and coordinate 2.

[0072] S503: Push the live streaming merging screen and the screen position information corresponding to the live streaming merging screen to the live streaming stream media server, where the screen position information is for separating at least two live streaming screens from the live streaming merging screen.

[0073] In the embodiment of the present disclosure, the live streaming side can push the live streaming merging screen obtained in S501 above and the screen position information corresponding to the live streaming merging screen obtained in S502 above to the live streaming stream media server. Here, the screen position information may be used for the viewing side to separate at least two live streaming screens from the live streaming merging screen.

[0074] In the live streaming screen processing method according to the embodiment of the present disclosure, first, the live streaming side merges at least two live streaming screens to obtain a live streaming merging screen. Then, obtain the position information of each of the at least two live streaming screens on the live streaming merging screen, and use it as the screen position information corresponding to the live streaming merging screen. Further, push the live streaming merging screen and the screen position information corresponding to the live streaming merging screen to the live streaming stream media server. Here, the screen position information is for the viewing side to separate at least two live streaming screens from the live streaming merging screen. Therefore, in the embodiment of the present disclosure, the live streaming side can not only push the live streaming merging screen, but also push the position information of each live streaming screen on the live streaming merging screen to the live streaming stream media server. Thereby, the viewing side can separate each live streaming screen from the live streaming merging screen.

[0075] Based on the above method embodiments, the present disclosure further provides a live streaming screen processing apparatus. FIG. 6 is a schematic configuration diagram of a live streaming screen processing apparatus according to an embodiment of the present disclosure.

[0076] Referring to FIG. 6, the apparatus includes a pull module for pulling a live streaming merged screen and screen position information corresponding to the live streaming merged screen from a live streaming media server, wherein the live streaming merged screen is obtained by merging at least two live streaming screens, and the screen position information is for marking the positions of the at least two live streaming screens in the live streaming merged screen, namely, pull module 601, a separation module 602 for separating the at least two live streaming screens from the live streaming merged screen based on the screen position information, and a display module 603 for displaying the at least two live streaming screens based on a preset live streaming screen display layout.

[0077] In an alternative embodiment, the at least two live streaming screens include a first live streaming screen and a second live streaming screen, and the display module 603 includes a first display sub-module for displaying the first live streaming screen within a first area shown in a preset live streaming screen display layout, and for displaying the second live streaming screen within a second area shown in the preset live streaming screen display layout, where there is no overlapping area between the first area and the second area.

[0078] In an alternative embodiment, the first live streaming screen is a live streaming screen collected in real time by the live streaming side using a local camera, and the second live streaming screen is a live streaming screen pulled in real time by the live streaming side.

[0079] In an alternative embodiment, the display module 603 A rendering sub-module for rendering the at least two live broadcast screens on different canvases respectively, A second display sub-module for displaying the canvas on which the live broadcast screen is rendered based on a preset live broadcast screen display layout, and includes.

[0080] In an alternative embodiment, the screen coordinate information corresponding to the live broadcast merging screen is carried in the SEI information.

[0081] In the live broadcast screen processing apparatus according to the embodiment of the present disclosure, first, the viewing side pulls the live broadcast merging screen and the screen position information corresponding to the live broadcast merging screen from the live broadcast stream media server. Here, the live broadcast merging screen is obtained by merging based on at least two live broadcast screens, and the screen position information is for marking the positions of the at least two live broadcast screens in the respective live broadcast merging screens. Then, based on the screen position information, at least two live broadcast screens are separated from the live broadcast merging screen, and further, based on a preset live broadcast screen display layout, at least two live broadcast screens are displayed. Therefore, the embodiment of the present disclosure can separate a plurality of live broadcast screens from the pulled live broadcast merging screen and display each live broadcast screen based on a preset live broadcast screen display layout, enriching the related functions of video live broadcast and improving the viewing experience of users.

[0082] Based on the above method embodiment, the present disclosure further provides a live broadcast screen processing apparatus. FIG. 7 is a schematic configuration diagram of another live broadcast screen processing apparatus according to the embodiment of the present disclosure. Referring to FIG. 7, the apparatus includes A merging module 701 for merging at least two live broadcast screens to obtain a live broadcast merging screen, An acquisition module 702 for acquiring the position information of each of the at least two live broadcast screens on the live broadcast merging screen and using it as the screen position information corresponding to the live broadcast merging screen, A push module for pushing the live streaming merger screen and the screen position information corresponding to the live streaming merger screen to a live streaming stream media server, wherein the screen position information is for separating at least two live streaming screens from the live streaming merger screen, and a push module 703.

[0083] In an alternative embodiment, the merger module 701 includes a collection sub-module for collecting a first live streaming screen in real time using a local camera and pulling a second live streaming screen in real time from a preset live streaming server. and a first merger sub-module for merging the first live streaming screen and the second live streaming screen to obtain a live streaming merger screen.

[0084] In an alternative embodiment, the merger module 701 includes a second merger sub-module for merging at least two live streaming screens using a target merger template to obtain a live streaming merger screen, wherein position information of each of the at least two live streaming screens on the live streaming merger screen is defined in the target merger template. Accordingly, the acquisition module 702 includes an acquisition sub-module for acquiring position information of each of the at least two live streaming screens on the live streaming merger screen from the target merger template and using it as the screen position information corresponding to the live streaming merger screen.

[0085] In the live streaming screen processing apparatus according to an embodiment of the present disclosure, first, on the live streaming side, at least two live streaming screens are merged to obtain a live streaming merged screen. Then, the position information of each of the at least two live streaming screens on the live streaming merged screen is acquired and used as the screen position information corresponding to the live streaming merged screen. Further, the live streaming merged screen and the screen position information corresponding to the live streaming merged screen are pushed to a live streaming stream media server. Here, the screen position information is for the viewing side to separate at least two live streaming screens from the live streaming merged screen. Therefore, in the embodiment of the present disclosure, the live streaming side can not only push the live streaming merged screen, but also push the position information of each live streaming screen on the live streaming merged screen to the live streaming stream media server. Thereby, the viewing side can separate each live streaming screen from the live streaming merged screen.

[0086] In addition to the above method and apparatus, an embodiment of the present disclosure further provides a computer-readable storage medium storing instructions that, when run on a terminal device, cause the terminal device to implement the live streaming screen processing method according to an embodiment of the present disclosure.

[0087] An embodiment of the present disclosure further provides a computer program product including a computer program / instructions that, when executed by a processor, implement the live streaming screen processing method described in an embodiment of the present disclosure.

[0088] Also, an embodiment of the present disclosure further provides a live streaming screen processing device, which may include a processor 801, a memory 802, an input device 803, and an output device 804 as shown in FIG. 8. The number of processors 801 in the live streaming screen processing device may be one or more. In FIG. 8, one processor is taken as an example. In some embodiments of the present disclosure, the processor 801, the memory 802, the input device 803, and the output device 804 may be connected via a bus or other means. Here, in FIG. 8, the case of being connected via a bus is taken as an example.

[0089] Memory 802 can be used to store software programs and modules. The processor 801 executes the software programs and modules stored in the memory 802 to perform various functional applications and data processing of the live streaming screen processing device. The memory 802 may mainly include a program storage area and a data storage area. Among them, the program storage area can store an operating system, applications required for at least one function, and the like. Note that the memory 802 may include a high-speed random access memory, and may further include a non-volatile memory, for example, at least one magnetic disk memory device, a flash memory device, or other volatile solid-state memory devices. The input device 803 can be used to receive the input numerical or character information and generate signal inputs related to the settings and function controls by the user of the live streaming screen processing device.

[0090] Specifically, in this embodiment, the processor 801 loads an executable file corresponding to the process of one or more applications into the memory 802 according to the following instructions, and by executing the application stored in the memory 802 by the processor 801, each function of the above-described live streaming screen processing device is realized.

[0091] In addition, in this specification, relational terms such as "first" and "second" are used only for the purpose of distinguishing one entity or operation from another entity or operation, and do not require or imply the existence of such an actual relationship or order between these entities or operations. Furthermore, the terms "comprising", "including" or any other variant thereof indicate non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements but also other elements not explicitly listed, or also includes elements specific to such a process, method, article or device. Further, when there are no more restrictions, elements limited by "comprising one..." do not exclude the inclusion of other same elements in the process, method, article or device comprising the said elements.

[0092] The above are only specific embodiments of the present disclosure and are used to enable those skilled in the art to understand or implement the present disclosure. Various modifications to these examples will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other examples without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not limited to these examples in this specification, but has the broadest scope that conforms to the principles and novel features disclosed herein.

Claims

1. Pulling a live streaming merge screen and screen position information corresponding to the live streaming merge screen from a live streaming media server, wherein the live streaming merge screen is obtained by merging at least two live streaming screens, and the screen position information is for marking the positions of the at least two live streaming screens in the live streaming merge screen respectively, Separating the at least two live streaming screens from the live streaming merge screen respectively based on the screen position information, Displaying the at least two live streaming screens based on a preset live streaming screen display layout. A live streaming screen processing method comprising the above steps.

2. The at least two live streaming screens include a first live streaming screen and a second live streaming screen. Displaying the at least two live streaming screens based on the preset live streaming screen display layout means Displaying the first live streaming screen within a first area shown in the preset live streaming screen display layout, and displaying the second live streaming screen within a second area shown in the preset live streaming screen display layout, where there is no overlapping area between the first area and the second area. The method according to Claim 1.

3. The first live streaming screen is a live streaming screen collected in real time by the live streaming side using a local camera, and the second live streaming screen is a live streaming screen pulled in real time by the live streaming side. The method according to Claim 2.

4. Displaying the at least two live streaming screens based on the preset live streaming screen display layout means Drawing the at least two live streaming screens on different canvases respectively, Displaying the canvases on which the live streaming screens are drawn based on the preset live streaming screen display layout. The method according to Claim 1.

5. The screen coordinate information corresponding to the live streaming merge screen is carried in SEI information. The method according to Claim 1.

6. Merging at least two live streaming screens to obtain a live streaming merge screen, Obtaining the position information of each of the at least two live distribution screens on the live distribution merging screen, and using it as the screen position information corresponding to the live distribution merging screen; Pushing the live distribution merging screen and the screen position information corresponding to the live distribution merging screen to a live distribution stream media server, where the screen position information is for separating the at least two live distribution screens from the live distribution merging screen. The live distribution screen processing method includes the above.

7. The obtaining of the live distribution merging screen by merging the at least two live distribution screens includes: Collecting the first live distribution screen in real time using a local camera, and pulling the second live distribution screen in real time from a preset live distribution server; Merging the first live distribution screen and the second live distribution screen to obtain a live distribution merging screen. The method according to claim 6 includes the above.

8. The obtaining of the live distribution merging screen by merging the at least two live distribution screens includes: Using a target merging template to merge at least two live distribution screens to obtain a live distribution merging screen. Here, the position information of each of the at least two live distribution screens on the live distribution merging screen is defined in the target merging template. Accordingly, the obtaining of the position information of each of the at least two live distribution screens on the live distribution merging screen and using it as the screen position information corresponding to the live distribution merging screen includes: Obtaining the position information of each of the at least two live distribution screens on the live distribution merging screen from the target merging template and using it as the screen position information corresponding to the live distribution merging screen. The method according to claim 6 includes the above.

9. A live distribution screen processing system including a live distribution side and a viewing side, The live streaming side combines at least two live streaming screens to obtain a live streaming combined screen, acquires screen position information corresponding to the live streaming combined screen, and pushes the live streaming combined screen and the screen position information corresponding to the live streaming combined screen to a live streaming stream media server. Here, the screen position information is for indicating the position of each of the at least two live streaming screens on the live streaming combined screen. The viewing side pulls the live streaming combined screen and the screen position information corresponding to the live streaming combined screen from the live streaming stream media server, separates the at least two live streaming screens from the live streaming combined screen based on the screen position information, and displays the at least two live streaming screens based on a preset live streaming screen display layout. It is a live streaming screen processing system.

10. Specifically, the live streaming side is used for collecting a first live streaming screen in real time using a local camera, pulling a second live streaming screen in real time from a preset live streaming server, and combining the first live streaming screen and the second live streaming screen to obtain a live streaming combined screen. The system according to claim 9.

11. A pull module for pulling a live streaming combined screen and the screen position information corresponding to the live streaming combined screen from a live streaming stream media server. The live streaming combined screen is obtained by combining based on at least two live streaming screens, and the screen position information is for marking the position of each of the at least two live streaming screens on the live streaming combined screen. The pull module, A separation module for separating the at least two live streaming screens from the live streaming combined screen based on the screen position information, A display module for displaying the at least two live streaming screens based on a preset live streaming screen display layout. The live streaming screen processing device includes.

12. A combining module for combining at least two live streaming screens to obtain a live streaming combined screen, An acquisition module for acquiring position information of each of the at least two live streaming screens on the live streaming merger screen and using it as screen position information corresponding to the live streaming merger screen; A push module for pushing the live streaming merger screen and the screen position information corresponding to the live streaming merger screen to a live streaming stream media server, wherein the screen position information is for separating the at least two live streaming screens from the live streaming merger screen. A live streaming screen processing device including the push module.

13. A computer-readable storage medium storing instructions that, when run on a terminal device, cause the terminal device to implement the method according to any one of Claims 1 to 8.

14. A live streaming screen processing device including a memory, a processor, and a computer program stored in the memory and executable by the processor, wherein when the processor executes the computer program, the method according to any one of Claims 1 to 8 is implemented.

15. A computer program product including a computer program that, when executed by a processor, implements the method according to any one of Claims 1 to 8.

Images