Live broadcast processing method, device and system and storage medium

Abstract

The invention relates to the technical field of live broadcast, and discloses a live broadcast processing method, device and system, and a storage medium. The method comprises the following steps: acquiring a live broadcast scene corresponding to each live broadcast link in multi-user live broadcast, wherein the live broadcast scene comprises at least one layer object; based on the layer object, determining layer configuration of each live broadcast link; when it is monitored that the multi-user live broadcast enters a new live broadcast link, acquiring layer configuration corresponding to the new live broadcast link; and uploading the layer configuration corresponding to the new live broadcast link to a server, so that the server pushes the layer configuration to a plurality of anchor ends corresponding to multi-person live broadcast, and each anchor end performs layer adaptation on the live broadcast picture based on the layer configuration to generate a target live broadcast picture. According to the method and the device, unified scene layer configuration can be carried out on pictures of a plurality of live broadcast rooms according to the promotion of live broadcast links in multi-user live broadcast, the consistency of scene materials in the multi-user live broadcast pictures is ensured, and the director efficiency and reliability of multi-user live broadcast are improved.

Description

Technical Field

[0001] The present invention relates to the field of live broadcast technology, and in particular to a live broadcast processing method, device, system and storage medium. Background Art

[0002] In the current live streaming industry, offline variety shows hosted by television stations are a common form of entertainment. These events offer viewers a rich audio-visual experience by coordinating participants for live events and inserting appropriate advertisements. However, with the rise of online live streaming, traditional offline variety shows are gradually shifting online, but online variety shows still face some technical challenges.

[0003] During online live streaming, bringing together multiple hosts to collaborate on a variety show or other product promotion is incredibly challenging. The most challenging aspect is appropriately adding decorative elements, such as event logos, gameplay instructions, and advertising slogans, to the live feeds of multiple hosts. These elements need to be added in real time during the live stream, maintaining a consistent visual effect across all hosts' rooms. However, since hosts must focus on interacting with their audience and presenting content, they cannot afford to distract themselves from these operations. The timing of the slogan screens can be missed, making this task difficult for hosts to accomplish independently. Furthermore, due to differences in host operating habits and live streaming equipment, even attempts at decoration can result in inconsistent visual effects across different rooms, severely impacting the audience's viewing experience. Summary of the Invention

[0004] The main purpose of the present invention is to provide a live broadcast processing method, device, system and storage medium, aiming to solve the technical problem that it is difficult to uniformly add scene materials to a live broadcast by multiple people.

[0005] A first aspect of the present invention provides a live broadcast processing method, which includes: obtaining a live broadcast scene corresponding to each live broadcast link in a multi-person live broadcast, wherein the live broadcast scene includes at least one layer object; based on the layer object, determining the layer configuration of each live broadcast link, wherein the layer configuration includes the relative position and relative resolution of each layer object in the corresponding live broadcast scene, and the material information of the layer object; when it is monitored that the multi-person live broadcast enters a new live broadcast link, obtaining the layer configuration corresponding to the new live broadcast link; uploading the layer configuration corresponding to the new live broadcast link to a server, so that the server can push the layer configuration to multiple anchor terminals corresponding to the multi-person live broadcast, so that each anchor terminal can perform layer adaptation on the live broadcast screen based on the layer configuration to generate a target live broadcast screen.

[0006] Optionally, in a first implementation manner of the first aspect of the present invention, the live broadcast processing method further includes: generating a monitoring list based on the anchor identification information of the multiple anchor terminals corresponding to the multi-person live broadcast; uploading the monitoring list to the server for pulling from the server the low-resolution video streams uploaded to the server by each anchor terminal corresponding to the monitoring list; and rendering each of the low-resolution video streams into different sub-windows of the same monitoring window.

[0007] Optionally, in a second implementation method of the first aspect of the present invention, after uploading the layer configuration corresponding to the new live broadcast link to the server, it also includes: monitoring whether feedback information from the server forwarding the anchor end is received within a preset time, and the feedback information is generated after the anchor end confirms receipt of the layer configuration; if the feedback information from the server forwarding the anchor end is not received within the preset time, uploading the layer configuration to the server again, or sending a resend instruction to the server, so that the server can push the layer configuration to the corresponding anchor end again.

[0008] The second aspect of the present invention provides another live broadcast processing method, which includes: obtaining an original live broadcast picture and generating a blank scene with the same resolution and size as the original live broadcast picture; receiving a layer configuration pushed by a server, wherein the layer configuration is processed by the director end for the live broadcast scene corresponding to the current live broadcast link in the multi-person live broadcast and uploaded to the server, the live broadcast scene includes at least one layer object, and the layer configuration includes the relative position and relative resolution of each layer object in the corresponding live broadcast scene, as well as the material information of the layer object; based on the relative position and relative resolution of the layer object, the material information is loaded into the blank scene to generate a push stream scene adapted to the original live broadcast picture; the push stream scene is added to the original live broadcast picture to generate a target live broadcast picture; the target live broadcast picture is pushed to the server so that the server can push the target live broadcast picture to the audience end.

[0009] The third aspect of the present invention provides another live broadcast processing method, which includes: receiving a layer configuration uploaded by a director end, the layer configuration is obtained by the director end processing the live broadcast scene corresponding to the current live broadcast link in the multi-person live broadcast, the live broadcast scene includes at least one layer object, and the layer configuration includes the relative position and relative resolution of each layer object in the corresponding live broadcast scene, as well as the material information of the layer object; pushing the layer configuration to multiple anchor ends corresponding to the multi-person live broadcast, so that each anchor end can perform layer adaptation on the live broadcast screen based on the layer configuration to generate a target live broadcast screen; receiving the target live broadcast screen generated by each anchor end, and pushing the target live broadcast screen to the audience end.

[0010] Optionally, in a first implementation manner of the third aspect of the present invention, the live broadcast processing method further includes: receiving low-resolution video streams uploaded by each of the anchor terminals, and receiving a monitoring list uploaded by the director terminal, the monitoring list being determined based on the anchor identification information of the multiple anchor terminals corresponding to the multi-person live broadcast; determining the corresponding multiple anchor terminals based on the anchor identification information in the monitoring list; pushing the low-resolution video streams uploaded by each of the anchor terminals corresponding to the monitoring list to the director terminal, so that the director terminal can render each of the low-resolution video streams into different sub-windows of the same monitoring window; determining that a selection instruction for the sub-window is received from the director terminal, receiving the target live broadcast screen of the anchor terminal corresponding to the selection instruction, and pushing the target live broadcast screen to the audience terminal.

[0011] The fourth aspect of the present invention also provides a broadcast director device, which includes: a first memory and at least one first processor, wherein instructions are stored in the first memory; the at least one first processor calls the instructions in the first memory so that the broadcast director device executes the live broadcast processing method as described in the first aspect above.

[0012] In a fifth aspect, the present invention further provides an anchor device, comprising: a second memory and at least one second processor, wherein the second memory stores instructions; the at least one second processor calls the instructions in the second memory so that the anchor device executes the live broadcast processing method of the second aspect described above.

[0013] Optionally, in a first implementation of the fifth aspect of the present invention, the anchor device includes a broadcast platform module, a live broadcast processing module, a memory module and a graphics card module; the broadcast platform module and the live broadcast processing module are connected to the same memory module, the memory module is used to access the received data, and the push stream scene and the original live broadcast picture are both stored in the memory module; the graphics card module is connected to the broadcast platform module for rendering the received scene; the broadcast platform module is used to: read the push stream scene from the memory module, and load the push stream scene into the graphics card module; the graphics card module is used to The live streaming processing module is used to: read the scene texture from the memory module and restore the streaming scene based on the scene texture; add the streaming scene to the original live broadcast screen to generate the target live broadcast screen; store the generated target live broadcast screen in the memory module; the live streaming platform module is also used to: read the target live broadcast screen from the memory module and stream the target live broadcast screen to the server.

[0014] The sixth aspect of the present invention also provides a service device, which includes a third memory and at least one third processor, and instructions are stored in the third memory; the at least one third processor calls the instructions in the third memory to enable the service device to execute the live broadcast processing method of the third aspect as described above.

[0015] The seventh aspect of the present invention also provides a live broadcast system, which includes: at least one audience device; at least one broadcast director device as described above; at least one anchor device as described above; and a service device as described above, wherein the service device is respectively connected to each of the audience devices, each of the broadcast director devices and the anchor device.

[0016] The eighth aspect of the present invention also provides a computer-readable storage medium, on which instructions are stored. When the instructions are executed by a processor, the live broadcast processing method as described above is implemented.

[0017] Embodiments of the present invention provide a live broadcast processing method, apparatus, device, and storage medium. The method first obtains a live broadcast scene corresponding to each live broadcast segment in a multi-person live broadcast, wherein the live broadcast scene includes at least one layer object. Based on the layer object, the layer configuration of each live broadcast segment is determined. When it is detected that the multi-person live broadcast enters a new live broadcast segment, the layer configuration corresponding to the new live broadcast segment is obtained. The layer configuration corresponding to the new live broadcast segment is uploaded to a server, so that the server pushes the layer configuration to multiple anchor terminals corresponding to the multi-person live broadcast. Each anchor terminal performs layer adaptation on the live broadcast screen based on the layer configuration to generate a target live broadcast screen. This method enables director control of the live broadcast screens of multiple anchors, thereby uniformly adding decorative scene materials to the live broadcast screens of each anchor terminal. The relative resolution and relative position included in the layer configuration can guide the anchor terminal to more accurately configure the corresponding layer, ensure the consistency of the position and size of the scene materials, improve the overall effect of the live broadcast screen and the audience's viewing experience, meet the needs of multi-person online live broadcasts or product promotion activities, achieve real-time monitoring and flexible adjustment of the live broadcast screen, and improve the director efficiency and reliability of multi-person live broadcasts. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 This is a flow chart of a first embodiment of a live broadcast processing method according to an embodiment of the present invention;

[0019] Figure 2 for Figure 1 A flowchart of a live broadcast processing method according to an embodiment of the present invention;

[0020] Figure 3 for Figure 1 A schematic diagram of a flow chart of an embodiment after step 104 in the embodiment;

[0021] Figure 4 1 is a flow chart of a second embodiment of a live broadcast processing method according to an embodiment of the present invention;

[0022] Figure 5 1 is a flow chart of a third embodiment of a live broadcast processing method according to an embodiment of the present invention;

[0023] Figure 6 for Figure 5 A flowchart of a live broadcast processing method according to an embodiment of the present invention;

[0024] Figure 7 This is a schematic diagram of the functional modules of an embodiment of a broadcast director device according to an embodiment of the present invention;

[0025] Figure 8 This is a schematic diagram of the functional modules of an embodiment of a host device according to an embodiment of the present invention;

[0026] Figure 9This is a functional module diagram of an embodiment of a service device according to an embodiment of the present invention;

[0027] Figure 10 This is a schematic diagram of the functional modules of an embodiment of a live broadcast system in an embodiment of the present invention. DETAILED DESCRIPTION

[0028] The terms "first," "second," "third," "fourth," and the like (if any) in the description and claims of the present invention and in the accompanying drawings are used to distinguish similar objects and are not necessarily used to describe a particular order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "including" or "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or apparatus that includes a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units that are not explicitly listed or that are inherent to these processes, methods, products, or apparatus.

[0029] For ease of understanding, the specific process of the live broadcast processing method in the embodiment of the present invention is described below. The live broadcast processing method of this embodiment is applied to electronic devices, which can be terminals, such as smart phones, laptops, tablet computers, desktop computers, etc., or development boards, chip systems, etc. Please refer to Figure 1 , Figure 1 This is a flow chart of a first embodiment of a live broadcast processing method according to an embodiment of the present invention. In this embodiment, the live broadcast processing method includes:

[0030] 101. Obtain a live broadcast scene corresponding to each live broadcast link in a multi-person live broadcast, where the live broadcast scene includes at least one layer object.

[0031] 102. Determine the layer configuration of each live broadcast link based on the layer object, wherein the layer configuration includes the relative position and relative resolution of each layer object in the corresponding live broadcast scene, as well as the material information of the layer object.

[0032] 103. When it is detected that multiple live broadcasters enter a new live broadcast session, the layer configuration corresponding to the new live broadcast session is obtained.

[0033] 104. Upload the layer configuration corresponding to the new live broadcast link to the server, so that the server can push the layer configuration to multiple anchor terminals corresponding to the multi-person live broadcast, so that each anchor terminal can adapt the layer of the live broadcast screen based on the layer configuration to generate the target live broadcast screen.

[0034] In this embodiment, multi-person live broadcast refers to a live broadcast activity conducted by two or more live broadcast rooms in the same time period. During the multi-person live broadcast process, the screens of different live broadcast rooms can be switched by the director and played in the same director live broadcast room, so as to realize the push streaming live broadcast to the audience end watching the director live broadcast room. At the same time, each live broadcast room can also independently present the live content and present the screen of the live broadcast room to the audience end watching the live broadcast room. The multi-person live broadcast can specifically be a multi-person live broadcast of an online variety show, a multi-person live broadcast of a product promotion activity, or a multi-person game live broadcast, etc. This application does not make specific restrictions on this. During the multi-person live broadcast process, multiple live broadcast links are usually set according to the script or live broadcast process, and the corresponding gameplay description entries, advertising voice-over entries, and watermark materials will be configured in the live broadcast screen of each corresponding live broadcast room in different live broadcast links according to the needs of content presentation, product promotion, and activity identification, so as to present different live broadcast scenes in different live broadcast links.

[0035] In this embodiment, the scene is a container for integrating the coating, which has width and height attributes. The live broadcast scene is a scene constructed according to the needs of the live broadcast link during the live broadcast process. The layer objects in the live broadcast scene are text or image type materials such as the gameplay instructions, advertising voice-over terms, and watermark materials of the corresponding live broadcast link. Among them, the text type layer object usually includes the original configuration information such as the text content, the position of the text box, and the resolution size, while the image type layer object includes the original configuration information such as the download address of the image, the position of the image, and the resolution size. These layer objects are accurately placed at the specified position in the live broadcast scene through specific layer configurations and presented at the corresponding resolution.

[0036] In this embodiment, since the resolution of the start-up screen of each anchor terminal is different, for example, there are resolutions of specifications such as 2560*1440, 1920*1080, and 1280*720, the configuration information of the corresponding layer object is usually difficult to be compatible with different live broadcast terminals under the configuration information of fixed position and resolution size. Therefore, this solution further determines the layer configuration of each live broadcast link based on the layer object. The layer configuration is different from the original configuration information of the layer object. It uses relative position and relative resolution to replace the fixed position and resolution information in the original configuration information. It is transmitted according to the proportion of the entire screen size and used for subsequent adaptation of each anchor terminal to adapt to anchor terminals with different start-up screen resolution sizes. Among them, the relative position refers to the offset of the position of the layer object in the live broadcast scene relative to the reference point such as the upper left corner or center point of the live broadcast scene, while the relative resolution refers to the scaling ratio of the resolution size of the layer object in the live broadcast scene relative to the resolution size of the live broadcast scene. This way, even if the broadcast screen resolutions vary between different hosts, layer objects can be precisely placed at the specified location based on relative position and resolution, and presented at the corresponding resolution. This avoids the problem of inconsistent position and size of layer objects in the broadcast screens of different hosts, improving the overall effect of the live broadcast and the audience's viewing experience. The material information of the layer objects included in the layer configuration is the specific material content required to be presented, such as the corresponding text content and image download links.

[0037] In this embodiment, after determining the layer configuration of the live broadcast scene corresponding to the live broadcast link, when it is monitored that the multi-person live broadcast enters a new live broadcast link, that is, according to the real-time progress, and the script or live broadcast process determines that it is necessary to switch to a new live broadcast scene, the layer configuration corresponding to the new live broadcast link can be obtained to perform the corresponding layer configuration processing. In this embodiment, the layer configuration is uploaded to the server, so that after the server receives the layer configuration, it pushes it to the multiple anchor terminals corresponding to the multi-person live broadcast. After receiving the new layer configuration, each anchor terminal performs layer adaptation on its own live broadcast screen based on the layer configuration, that is, the material information of the layer object is accurately placed in the live broadcast screen according to the relative position and relative resolution in the layer configuration to generate the target live broadcast screen. Finally, each anchor terminal can push the generated target live broadcast screen to the server, and the server then pushes the target live broadcast screen to the audience terminal for the audience to watch.

[0038] In this embodiment, the server and host are connected in communication. In practice, the server and host are typically provided by the same live streaming platform, enabling the corresponding live streaming process to be implemented through that platform. The audience establishes a connection with the server through the live streaming platform, thereby viewing the target live streaming image pushed by the host. In this way, the audience can view the target live streaming image after layer adaptation in real time, obtaining a better viewing experience. This ensures that during a multi-person live streaming process, as the live streaming session progresses, the live streaming image of each host can be switched to the new live scene in real time, while maintaining the consistency of the position and size of the layer objects, thereby improving the overall effect of the live streaming image and the audience's viewing experience.

[0039] Optional, see Figure 2 In some embodiments, the first embodiment of the live broadcast processing method further includes:

[0040] 1031. Generate a monitoring list based on the anchor identification information of multiple anchor terminals corresponding to the multi-person live broadcast.

[0041] 1032. Upload the monitoring list to the server so that the low-resolution video streams uploaded to the server by the anchor terminals corresponding to the monitoring list can be pulled from the server.

[0042] 1033. Render each low-resolution video stream into a different sub-window of the same monitoring window.

[0043] In this optional embodiment, the host identification information refers to information that uniquely identifies a host, such as the host's device ID (Identity Document), host account, and host's IP (Internet Protocol) address. During a multi-person live broadcast, a monitoring list can be generated based on the host identification information of all participants in the multi-person live broadcast. Alternatively, hosts that require key monitoring can be selected from all participants, and a monitoring list can be generated based on the host identification information of these hosts. This monitoring list instructs the server to select the video stream of the host that requires monitoring from among the video streams uploaded by all hosts.

[0044] In this optional embodiment, by uploading a monitoring list to the server, the server can pull the corresponding low-resolution video stream from the video streams uploaded by all hosts based on the monitoring list. This low-resolution video stream refers to a video stream with a lower resolution and is used only for monitoring. For example, its resolution can be 192*108, 128*72, etc. Compared with the original high-resolution video streams with a resolution of 2560*1440, 1920*1080, 1280*720, etc., it consumes less server transmission bandwidth and storage space, thereby reducing the server load while ensuring monitoring effectiveness. The server renders these low-resolution video streams into different subwindows of the same monitoring window, allowing monitoring personnel to simultaneously view the live broadcast images of multiple hosts on the same interface, achieving convenient monitoring management. In this way, monitoring personnel can monitor the live broadcast status of each host in real time during a multi-person live broadcast, promptly identify and address any problems that may arise during the live broadcast, and ensure the smooth progress of the live broadcast. At the same time, the use of low-resolution video streams also reduces the performance requirements of the monitoring personnel's equipment, improving the flexibility and convenience of monitoring. In addition, since the low-resolution video stream is not provided to a large number of viewers distributed across different networks, it does not need to be uploaded to the CDN (Content Delivery Network). It can be directly uploaded to the server to pull the required low resolution from the server to monitor the corresponding anchor's end screen, avoiding the transcoding and distribution processing of live screen monitoring, which can effectively reduce latency and bandwidth requirements and improve supervision efficiency.

[0045] In this optional embodiment, after pulling the low-resolution video streams uploaded by the corresponding anchor terminals, these low-resolution streams can be further rendered into different sub-windows of the same monitoring window. The monitoring window includes display areas of multiple sub-windows. These sub-windows can be arranged according to rules, draggable, or randomly. This application does not impose specific restrictions on this. In this way, the live broadcast images of different anchor terminals can be intuitively compared and observed, and differences and problems in the images can be discovered in a timely manner, such as position offset of layer objects, resolution mismatch, or material content errors, so that corresponding adjustments and processing can be quickly made. The progress of the live broadcast link can also be judged through the monitoring window, thereby improving the efficiency, accuracy, and reliability of monitoring and live broadcast processing.

[0046] In this optional embodiment, further optionally, after rendering each low-resolution video stream into different sub-windows of the same monitoring window, it also includes: selecting a sub-window from the monitoring window to trigger a selection instruction for the corresponding sub-window; uploading the selection instruction to the server, so that the server can select the target live broadcast picture of the corresponding anchor end based on the selection instruction, and push the target live broadcast picture to the audience end.

[0047] In this optional embodiment, in the monitoring window, the monitoring personnel can select one of the sub-windows by clicking or framing, thereby triggering the selection instruction for the corresponding sub-window. After the selection instruction is uploaded to the server, the server will pull the target live screen from the anchor end corresponding to the selected sub-window based on the selection instruction. The target live screen here refers to the live screen after layer adaptation, that is, the live screen generated after the material information of the layer object is accurately placed in the live screen according to the layer configuration. The server pushes the target live screen to the audience end for the audience to watch. In this way, the audience can watch high-quality live screens that have been screened and confirmed by the monitoring personnel, further enhancing the audience's viewing experience. At the same time, the monitoring personnel can also use this operation to switch the live screen watched by the audience end in real time, thereby realizing the director switching processing of the live screen, so that in the process of multi-person live broadcast, according to the advancement of the live link and the presentation of the live content, a richer and more exciting live experience is provided to the audience.

[0048] Optional, see Figure 3 In some embodiments, after uploading the layer configuration corresponding to the new live broadcast session to the server, the process further includes:

[0049] 1041. Monitor whether the server has received feedback from the host within a preset time. Feedback is generated after the host confirms receipt of the layer configuration.

[0050] 1042. If no feedback information from the server forwarding the anchor terminal is received within the preset time, the layer configuration is uploaded to the server again, or a resend instruction is sent to the server so that the server can push the layer configuration to the corresponding anchor terminal again.

[0051] In this optional embodiment, after uploading the layer configuration to the server, for a type of anchor terminal that sends feedback information to indicate receipt of the corresponding layer configuration after receiving the layer configuration, the corresponding anchor terminal may fail to successfully receive the layer configuration in the first place due to network delays or device failures. In order to ensure that all anchor terminals can accurately receive the layer configuration so that correct layer adaptation processing can be performed later, this embodiment further provides a feedback information monitoring mechanism. If the feedback information forwarded from the anchor terminal by the server is not received within a preset time, it can be determined that the corresponding anchor terminal has failed to successfully receive the layer configuration. The preset time can be a reasonable time threshold pre-set based on factors such as the network environment and device performance, such as 0.5 seconds, 1 second, 2 seconds, etc., and the feedback information is a signal that the anchor terminal actively generates and sends to the server after confirming receipt of the layer configuration, indicating that the layer configuration has been successfully received. It is automatically generated by the anchor terminal.

[0052] In this optional embodiment, in order to avoid problems with subsequent layer adaptation processing caused by the failure to successfully receive the layer configuration, this embodiment provides two processing methods: one is a processing method set for servers with poor temporary storage capabilities, by uploading the layer configuration to the server again, and the server re-pushes the layer configuration; the other is a processing method set for servers with the ability to cache layer configurations, by sending a resend instruction to the server, the server retrieves the corresponding layer configuration from the cache and pushes it again to the host end that failed to successfully receive it. In this way, it can be ensured that all host ends can accurately receive the layer configuration, avoiding problems with subsequent layer adaptation processing caused by the failure to successfully receive the layer configuration, and improving the reliability and stability of the live broadcast processing. At the same time, because the server can choose to re-upload the layer configuration or retrieve the layer configuration from the cache for resending according to the actual situation, the flexibility and efficiency of the live broadcast processing are also improved.

[0053] Optionally, the first embodiment of the above-mentioned live broadcast processing method is applied to the director end.

[0054] In this optional embodiment, the director end refers to a terminal that monitors, switches and processes the live broadcast images of multiple anchor ends in real time through a specific director device, such as a professional director console or a computer device equipped with professional director software. By applying the first embodiment of the above-mentioned live broadcast processing method, the director end can realize the rendering and presentation of low-resolution video streams in the sub-window of the monitoring window, thereby realizing the functions of real-time monitoring and live broadcast image switching, and by uploading the layer configuration to the server, the server pushes the layer configuration to multiple anchor ends for layer adaptation, thereby generating the target live broadcast image, and effectively processing the live broadcast image to meet the needs of the director function. Therefore, by applying the first embodiment of the above-mentioned live broadcast processing method on the director end, real-time monitoring, switching and processing of multiple live broadcast images can be realized, which improves the flexibility and efficiency of the live broadcast, and makes the corresponding director end have higher performance and richer functions, which can better meet the needs of the director end for live broadcast processing.

[0055] This embodiment, through the first embodiment of the live broadcast processing method described above, adopts a relative position and relative resolution layer configuration method to achieve compatible adaptation of layer objects between anchor terminals with different broadcast screen resolutions, avoiding the problem of inconsistent position and size of layer objects in the broadcast screens of different anchor terminals, ensuring the consistency of the overall effect of the live broadcast screen and the audience's viewing experience. By uploading the layer configuration to the server and pushing it to multiple anchor terminals for layer adaptation, unified processing and efficient transmission of the live broadcast screen are achieved, improving the efficiency and reliability of live broadcast processing. At the same time, by setting a monitoring list and pulling low-resolution video streams for monitoring, the server load is reduced, the flexibility and convenience of monitoring are improved, and at the same time, problems that may arise during the live broadcast process can be discovered and handled in a timely manner to ensure the smooth progress of the live broadcast. Real-time monitoring and switching of the live broadcast screen through the monitoring window is also conducive to providing a smoother live broadcast experience for the audience.

[0056] Please refer to Figure 4 , Figure 4 2 is a flow chart of a second embodiment of a live broadcast processing method according to an embodiment of the present invention. In this embodiment, the live broadcast processing method includes:

[0057] 201. Obtain the original live broadcast image and generate a blank scene with the same resolution and size as the original live broadcast image;

[0058] 202. Receive layer configuration pushed by the server. The layer configuration is processed by the director for the live broadcast scene corresponding to the current live broadcast segment in the multi-person live broadcast and uploaded to the server. The live broadcast scene includes at least one layer object. The layer configuration includes the relative position and relative resolution of each layer object in the corresponding live broadcast scene, as well as the material information of the layer object.

[0059] 203. Based on the relative position and relative resolution of the layer objects, the material information is loaded into the blank scene to generate a push streaming scene that is adapted to the original live broadcast screen;

[0060] 204. Add the streaming scene to the original live broadcast screen to generate the target live broadcast screen;

[0061] 205. Push the target live broadcast image to the server, so that the server can push the target live broadcast image to the audience end.

[0062] In this embodiment, the original live broadcast image refers to the live broadcast image directly captured and generated by a camera or screen recording tool without additional processing. It can be obtained from the broadcast platform, live broadcast processing software, or other live broadcast image acquisition devices. The blank scene is a blank image scene with the same resolution and size as the original live broadcast image. It is used for subsequent loading and adaptation of layer objects. When layer objects are subsequently loaded into the blank scene, the position and size of the layer objects in the live broadcast image are maintained.

[0063] In this embodiment, the layer configuration and its relative position, relative resolution, and material information are described in detail in the first embodiment of the live broadcast processing method described above and will not be further described here. After receiving the layer configuration pushed by the server, the material information of the layer object can be accurately loaded into the blank scene based on the relative position and relative resolution in the layer configuration, thereby generating a push-stream scene that matches the original live broadcast image. For example, if the relative position of a layer is such that the center point of the layer object represented by the material information is at 20% of the width and 30% of the height of the scene, and the relative resolution is 20% of the size of the scene, then a layer object of size 384*216 will be loaded into a 1920*1080 blank scene, with the center point of the layer object located at 384 pixels in width and 324 pixels in height of the blank scene, resulting in a push-stream scene. Finally, the push-stream scene can be added to the original live broadcast image to generate a target live broadcast image. Because the target live broadcast image contains the precisely adapted layer objects, i.e., the scene materials required for each live broadcast link, it has richer live content and better visual effects than the original live broadcast image.

[0064] Optionally, after receiving the layer configuration pushed by the server, the method further includes: sending feedback information to the server.

[0065] In this optional embodiment, by sending feedback information to the server after receiving the layer configuration pushed by the server, it can be indicated that the layer configuration has been successfully received. This step is crucial to ensure that the layer configuration can be conveyed accurately. After receiving the feedback information, the server can further confirm that the layer configuration has been successfully pushed. When the layer configuration sent by the director end is not successfully received, the director end can also be prompted to resend the layer configuration through feedback information, thereby avoiding the problem of failure to successfully receive the layer configuration due to network delays or equipment failures. For details, please refer to the introduction of the first embodiment of the live broadcast processing method mentioned above, which will not be repeated here.

[0066] Optionally, the second embodiment of the live broadcast processing method further includes: uploading a low-resolution video stream to the server, so that when the low-resolution video stream corresponds to the anchor identification information in the monitoring list, the director end pulls the low-resolution video stream from the server, wherein the monitoring list is determined based on the anchor identification information of multiple anchor ends corresponding to the multi-person live broadcast.

[0067] In this optional embodiment, by uploading a low-resolution video stream to the server, the corresponding live screen information is provided to the director end for viewing and control by the director end. The specific use of the monitoring list and the low-resolution video stream can be found in the first embodiment of the aforementioned live broadcast processing method, which will not be repeated here. After transmitting these low-resolution video streams to the director end via the server, the director end will render these low-resolution video streams into different sub-windows of the monitoring window, so that multiple live screens can be viewed and compared intuitively, so that possible problems can be discovered and handled in a timely manner to ensure the smooth progress of the live broadcast.

[0068] Optionally, the second embodiment of the live broadcast processing method is applied to the anchor end.

[0069] In this optional embodiment, the anchor end refers to a terminal that collects, processes and pushes live broadcast images through a specific anchor device, such as a mobile phone, computer or tablet that has or is connected to a camera, screen recording tool and streaming platform. By applying the second embodiment of the above-mentioned live broadcast processing method, the anchor end can realize layer adaptation processing of the live broadcast image, thereby generating a target live broadcast image, and push the target live broadcast image to the server, so that the server can push the target live broadcast image to the audience end. By applying the above-mentioned live broadcast processing method, the anchor end can effectively receive and process the layer configuration pushed by the director end, and accurately load the material information of the layer object into the live broadcast image according to the relative position and relative resolution in the layer configuration, thereby generating a live broadcast image with rich content and good visual effects, meeting the demand for unified processing of scene materials in the live broadcast image in the live broadcast scene. At the same time, by uploading the low-resolution video stream to the server, it is also convenient for the director end to perform real-time monitoring and processing, thereby improving the flexibility and efficiency of the live broadcast. Therefore, by applying the second embodiment of the above-mentioned live broadcast processing method on the anchor end, unified processing of decorative scene materials in the live broadcast screen can be achieved, thereby improving the quality of the live broadcast and the audience's viewing experience, and enabling the corresponding anchor end to have higher performance and richer functions, which can better meet the live broadcast processing needs of the anchor end.

[0070] In this optional embodiment, when the broadcast is directly started through the corresponding broadcast platform, the broadcast platform can directly add the push stream scene to the original picture to generate the target live broadcast picture. For example, when the broadcast is started on platform A, the anchor end can directly add the push stream scene to the original live broadcast picture collected by the broadcast tool provided by platform A to generate the target live broadcast picture, and push the target live broadcast picture to the server of platform A through the push stream function of platform A, so that the server of platform A can push the target live broadcast picture to the audience end, and the audience can watch the corresponding live broadcast picture in the live broadcast column of platform A. In this way, the anchor end can flexibly adapt to different broadcast platforms, making the live broadcast processing process more efficient and convenient. At the same time, due to the use of relative position and relative resolution layer configuration method, it also ensures the consistency of the position and size of the layer objects in the live broadcast pictures of different broadcast platforms, further improving the overall effect of the live broadcast picture.

[0071] Optionally, in order to be compatible with the live broadcast processing software, the host terminal specifically includes a broadcast platform, live broadcast processing software, a memory unit and a graphics card unit; the broadcast platform and the live broadcast processing software are connected to the same memory unit, the memory unit is used to access the received data, and the push stream scene and the original live broadcast picture are both stored in the memory unit; the graphics card unit is connected to the broadcast platform and is used to render the received scene; the broadcast platform is used to: read the push stream scene from the memory unit and load the push stream scene into the graphics card unit; the graphics card unit is used to: render the push stream scene to obtain the scene texture; the broadcast platform is also used to: read the scene texture from the graphics card unit and store the scene texture in the memory unit; the live broadcast processing software is used to: read the scene texture from the memory unit and restore the push stream scene based on the scene texture; add the push stream scene to the original live broadcast picture to generate the target live broadcast picture; store the generated target live broadcast picture in the memory unit; the broadcast platform is also used to: read the target live broadcast picture from the memory unit and push the target live broadcast picture to the server.

[0072] In this optional embodiment, the broadcast platform is a software platform for acquiring, processing and pushing live broadcast images, while the live broadcast processing software is a third-party software platform for further editing and processing live broadcast images. The broadcast platform and live broadcast processing software are applications set at the software level in the anchor terminal. For details, please refer to the above introduction and will not be repeated here. The memory unit and graphics card unit are hardware components set at the hardware level in the anchor terminal, which are used to support the functional implementation of the broadcast platform and live broadcast processing software. As the center of data storage and interaction, the memory unit is responsible for receiving, storing and transmitting various data required in the live broadcast processing process, including original live broadcast images, streaming scenes, layer configurations, etc., to ensure the integrity and real-time nature of the data. The graphics card unit focuses on rendering the received scenes, converting the scene data into visual image textures, and providing high-quality live broadcast images for the audience.

[0073] In this optional embodiment, the connection between the broadcast platform and the live broadcast processing software and the same memory unit implements a memory sharing mechanism. Since the current mainstream live broadcast platform and the current live broadcast processing software usually share a set of memory devices, the data of one can be stored in the memory for the other to read, thereby avoiding repeated transmission and storage of data, improving the efficiency and stability of the live broadcast processing, and ensuring the continuity and smoothness of the live broadcast processing process. The graphics card device is usually only connected to the broadcast platform. Some live broadcast processing software can also directly or indirectly establish a connection with the graphics card device. The graphics card device renders the live broadcast screen by receiving instructions from the broadcast platform. By loading the push stream scene into the graphics card unit for rendering, the scene texture is obtained. The broadcast platform then reads the scene texture from the graphics card unit and stores it in the memory unit for the live broadcast processing software to read and process, thereby realizing data interaction and collaborative work between the broadcast platform and the live broadcast processing software.

[0074] In this optional embodiment, since some layer materials in the push-streaming scene cannot be read by the live broadcast processing software and can only be processed on the broadcast platform, the broadcast platform is also required to process the push-streaming scene into a scene texture. Here, texture refers to an image or pattern applied to a surface in three-dimensional computer graphics, which is used to describe the details and features of the surface of the scene layer. Texture is the same concept for the broadcast platform and the live broadcast processing software. By rendering the push-streaming scene into a scene texture, the live broadcast processing software can restore the push-streaming scene based on the scene texture, and add the push-streaming scene to the original live broadcast picture to generate the target live broadcast picture. Thereby, data compatibility and collaborative processing between the broadcast platform and the live broadcast processing software are achieved, and the flexibility and efficiency of the live broadcast processing are improved. In this way, it is equivalent to injecting the business module of the broadcast platform into the live broadcast processing software. The business module supports pushing the picture of the broadcast platform to the live broadcast processing software and processing it in the scene of the live broadcast processing software.

[0075] In this optional embodiment, since the scene texture is obtained by rendering the push-stream scene, the layer configuration and layer object information in the push-stream scene are also retained, ensuring the consistency of the overall effect of the live broadcast picture and the audience's viewing experience. In a specific implementation, the broadcast platform can store the rendered scene texture in the form of an image file in a memory unit for the live broadcast processing software to read and process. After reading the scene texture, the live broadcast processing software can restore the push-stream scene based on the scene texture, and synthesize the push-stream scene with the original live broadcast picture to generate a target live broadcast picture. Finally, the broadcast platform reads the generated target live broadcast picture from the memory unit, and pushes the stream to the server for distribution, so that the live broadcast processing software also supports the second embodiment of the above-mentioned live broadcast processing method. In this way, the anchor terminal can flexibly adapt to different broadcast platforms and live broadcast processing software, thereby improving the compatibility and efficiency of live broadcast processing.

[0076] This embodiment, through the second embodiment of the live broadcast processing method described above, provides an efficient and flexible method for processing live broadcast images. By creating a blank scene with the same resolution as the original live broadcast image as a carrier, the director receives layer configurations sent by the server, and accurately maps advertising terms, gameplay instructions, and other materials to the blank scene at a preset ratio, generating a standardized push stream scene that is independent of the host's resolution. The push stream scene is then merged with the original image through layer overlay, ultimately outputting a target live stream with unified visual elements. This significantly improves the collaborative efficiency and visual effects of multi-person live broadcasts. On the one hand, relative position calculation based on the screen ratio enables pixel-level alignment of elements such as advertising banners and watermarks on devices with different resolutions, avoiding the problem of misalignment of screen elements across multiple hosts. On the other hand, centralized layer configuration distribution via the server enables millisecond-level synchronization of screen decorations across live broadcast rooms. It also supports seamless integration of third-party push streaming tools through a memory sharing mechanism. This ensures visual consistency of multi-view images in scenarios such as variety shows and live streaming, while reducing the host's operational complexity, the difficulty of adapting to the live broadcast processing method, and hardware performance consumption.

[0077] Please refer to Figure 5 , Figure 5 2 is a flow chart of a third embodiment of a live broadcast processing method according to an embodiment of the present invention. In this embodiment, the live broadcast processing method includes:

[0078] 301. Receive a layer configuration uploaded by a director. The layer configuration is obtained by the director by processing a live broadcast scene corresponding to a current live broadcast segment in a multi-person live broadcast. The live broadcast scene includes at least one layer object. The layer configuration includes the relative position and relative resolution of each layer object in the corresponding live broadcast scene, as well as material information of the layer object.

[0079] 302. Push the layer configuration to multiple anchor terminals corresponding to the multi-person live broadcast, so that each anchor terminal can adapt the live broadcast screen layer based on the layer configuration to generate the target live broadcast screen;

[0080] 303. Receive the target live broadcast images generated by each anchor terminal, and push the target live broadcast images to the audience terminal.

[0081] In this embodiment, the acquisition of layer configuration, the processing of layer adaptation, and the generation and push of the target live broadcast screen can be referred to the first embodiment of the live broadcast processing method and the second embodiment of the live broadcast processing method mentioned above. This application will not repeat them here. This embodiment accepts the layer configuration of the director end and pushes the layer configuration to multiple anchor ends corresponding to the multi-person live broadcast, thereby realizing the unified processing of the live broadcast screen in the multi-person live broadcast scene, which is conducive to providing the audience with a high-quality live viewing experience. In this way, this embodiment effectively solves the problems of inconsistent live broadcast screens and poor visual effects in multi-person live broadcasts, improves the collaborative efficiency of live broadcasts and the audience's viewing experience, and ensures the smooth progress of live broadcast activities.

[0082] Optional, see Figure 6 In some embodiments, the third embodiment of the live broadcast processing method further includes:

[0083] 304. Receive low-resolution video streams uploaded by each anchor terminal, and receive a monitoring list uploaded by the director terminal, where the monitoring list is determined based on anchor identification information of multiple anchor terminals corresponding to the multi-person live broadcast;

[0084] 305. Determine the corresponding multiple anchor terminals based on the anchor identification information in the monitoring list;

[0085] 306. Push the low-resolution video streams uploaded by the anchor terminals corresponding to the monitoring list to the director terminal, so that the director terminal can render the low-resolution video streams into different sub-windows of the same monitoring window.

[0086] 307. Determine that a selection instruction for a sub-window is received from the director end, receive a target live broadcast screen from the anchor end corresponding to the selection instruction, and push the target live broadcast screen to the viewer end.

[0087] For details about this optional embodiment, please refer to the descriptions of the first and second embodiments of the live broadcast processing method described above, and will not be repeated here. In this optional embodiment, by receiving low-resolution video streams uploaded by each host and a monitoring list uploaded by the director, real-time monitoring and management of a multi-person live broadcast scenario is achieved. The monitoring list is determined based on the host identification information of the multiple hosts corresponding to the multi-person live broadcast, ensuring the accuracy and effectiveness of monitoring. Subsequently, the corresponding hosts are identified based on the host identification information in the monitoring list, and the low-resolution video streams uploaded by each host corresponding to the monitoring list are pushed to the director. After receiving these low-resolution video streams, the director can render them into different subwindows of the same monitoring window, allowing intuitive viewing and comparison of multiple live broadcast images. In this way, the director can promptly detect and address potential problems, such as live broadcast image freezes and host disconnections, ensuring the smooth progress of the live broadcast. In addition, when the director selects a live broadcast image in a subwindow, it receives a selection instruction sent by the director and the target live broadcast image of the host corresponding to the selection instruction. The target live video can then be pushed to the viewer's terminal for viewing. In this way, this embodiment achieves real-time monitoring, management, and push of live video in a multi-person live broadcast scenario, improving the collaborative efficiency of the live broadcast and the viewer's viewing experience. At the same time, the use of low-resolution video streams for monitoring also reduces bandwidth pressure and storage costs, making the live broadcast processing process more efficient and convenient.

[0088] Optionally, in some embodiments, after pushing the layer configuration to multiple anchor terminals corresponding to the multi-person live broadcast, it also includes: receiving feedback information sent by the anchor terminal, and forwarding the feedback information to the director terminal, so that the director terminal can detect whether the feedback information is received within a preset time; when receiving the layer configuration uploaded by the director terminal, or the retransmission instruction sent by the director terminal, the layer configuration is pushed to the corresponding anchor terminal again.

[0089] This optional embodiment can also be referred to in the description of the first and second embodiments of the live broadcast processing method described above, and will not be repeated here. In this optional embodiment, to ensure that the layer configuration is successfully pushed to each host terminal and correctly received and processed by each host terminal, after pushing the layer configuration to the multiple host terminals corresponding to the multi-person live broadcast, feedback information from the host terminal is also received. The feedback information can be a confirmation message from the host terminal that the layer configuration has been successfully received, or it can be a report of the layer configuration processing results by the host terminal. By forwarding the received feedback information to the director terminal, the director terminal can detect whether the feedback information was received within a preset time based on the feedback information. If the director terminal does not receive the host terminal's feedback information within the preset time, or the received feedback information indicates that there is an abnormality in the host terminal's processing of the layer configuration, the director terminal can re-upload the layer configuration or send a resend instruction to push the layer configuration to the corresponding host terminal again. In this way, this embodiment implements monitoring and management of the layer configuration push process, ensuring that the layer configuration is correctly received and processed by each host terminal, thereby improving the collaborative efficiency of the live broadcast and the audience's viewing experience. At the same time, the reliability and stability of the live broadcast processing method are also enhanced.

[0090] Optionally, the third embodiment of the live broadcast processing method is applied to the server.

[0091] In this optional embodiment, the server is implemented using specific server equipment, such as high-performance computer hardware and a professional operating system, and is used to receive, process, and distribute data from the director and host terminals, and connect to the audience terminals to provide live content to the audience terminals. By applying the third embodiment of the live broadcast processing method described above, the server can achieve unified processing and management of live broadcast images in a multi-person live broadcast scenario, improving the collaborative efficiency of the live broadcast and the audience's viewing experience. In a specific implementation, the server will receive layer configurations uploaded by the director terminal. These layer configurations are processed by the director terminal based on the live broadcast scene corresponding to the current live broadcast link, including the relative position and relative resolution of each layer object in the corresponding live broadcast scene, as well as the material information of the layer objects. The server will then push the layer configurations to the multiple host terminals corresponding to the multi-person live broadcast, so that each host terminal can adapt the live broadcast images based on the layer configurations and generate the target live broadcast images. In this way, it can ensure that the live broadcast images output by each host terminal in the multi-person live broadcast have a unified visual effect and element layout. After receiving the target live broadcast images generated by each host terminal, the server will further process and optimize these target live broadcast images and then push them to the audience terminal for viewing. In this way, the server can effectively resolve issues such as inconsistent live video and poor visual quality during multi-person live broadcasts, providing viewers with a high-quality live viewing experience. Furthermore, the server can receive low-resolution video streams uploaded by each host, as well as monitoring lists uploaded by the director. By processing and analyzing this data, the server can achieve real-time monitoring and management of multi-person live broadcasts, promptly identifying and addressing potential issues such as live screen freezes and host disconnections, ensuring a smooth live broadcast.

[0092] This embodiment, through the third embodiment of the above-mentioned live broadcast processing method, receives the layer configuration uploaded by the director and adapts to the anchor devices with different resolutions through unified ratio storage, ensuring the consistency of the images of different anchor terminals; pushes the configuration to each anchor terminal, and adopts a message response mechanism to ensure reliable transmission to avoid scene loss due to message loss; at the same time, pulls the low-resolution direct connection stream of the anchor terminal to build a low-latency, low-bandwidth multi-live broadcast room same-screen monitoring system, and synchronizes the director and anchor screens in real time. The live broadcast processing method can achieve low-latency, high-efficiency unified processing of scene materials in the live broadcast screen of multiple anchors through picture ratio parameterization and lightweight transmission of configuration packages, avoiding the problems of position misalignment and resolution adaptation distortion of traditional multi-live broadcast room materials. By synchronously receiving the target picture streams of all anchor terminals, real-time quality inspection of multi-view images is achieved. The corresponding server can provide underlying technical support for scenes that require strong visual regularity, such as variety show live broadcast and e-commerce product promotion, ensuring the visual consistency of multi-view images in the corresponding scenes, and also reducing the operation complexity of the server, the difficulty of adapting to the live broadcast processing method and the hardware performance consumption.

[0093] Please refer to Figure 7 , Figure 7 This is a functional module diagram of an embodiment of a broadcast director device according to an embodiment of the present invention. The broadcast director device 400 includes a first memory 410 and at least one first processor 420. The first memory 410 stores instructions. The at least one first processor 420 invokes the instructions in the first memory 410 to cause the broadcast director to execute the first embodiment of the live broadcast processing method described above.

[0094] In this embodiment, the broadcast director device 400 can specifically be a hardware device that implements the first embodiment of the live broadcast processing method applied to the broadcast director end. It efficiently executes the various tasks in the first embodiment of the live broadcast processing method through the integrated first memory 410 and first processor 420. Since some embodiments of the broadcast director device 400 correspond to the first embodiment of the live broadcast processing method, please refer to the above-mentioned method embodiment for the introduction of the broadcast director device 400 provided by the embodiment of the present invention. The embodiment of the present invention will not be repeated here. It has the same beneficial effects as the first embodiment of the live broadcast processing method.

[0095] Please refer to Figure 8 , Figure 8 This is a functional module diagram of an embodiment of a live broadcast device according to an embodiment of the present invention. The live broadcast device 500 includes a second memory 510 and at least one second processor 520. The second memory 510 stores instructions. The at least one second processor 520 invokes the instructions in the second memory 510 to cause the host to execute the second or third embodiment of the live broadcast processing method described above.

[0096] In this embodiment, the anchor device 500 can specifically be a hardware device that implements the second embodiment of the live broadcast processing method of the aforementioned application anchor end. It efficiently executes the various tasks in the second embodiment of the live broadcast processing method through the integrated second memory 510 and second processor 520.

[0097] Optionally, in some embodiments, the anchor device 500 includes a broadcast platform module 530, a live broadcast processing module 540, a memory module, and a graphics card module; the broadcast platform module 530 and the live broadcast processing module 540 are connected to the same memory module, and the memory module is used to access received data. The push stream scene and the original live broadcast screen are both stored in the memory module; the graphics card module is connected to the broadcast platform module 530 and is used to render the received scene; the broadcast platform module 530 is used to: read the push stream scene from the memory module and load the push stream scene into the graphics card module; The graphics card module is used to render the streaming scene and obtain the scene texture; the broadcast platform module 530 is also used to read the scene texture from the graphics card module and store the scene texture in the memory module; the live broadcast processing module 540 is used to read the scene texture from the memory module and restore the streaming scene based on the scene texture; add the streaming scene to the original live broadcast screen to generate the target live broadcast screen; store the generated target live broadcast screen in the memory module; the broadcast platform module 530 is also used to read the target live broadcast screen from the memory module and stream the target live broadcast screen to the server.

[0098] In this optional embodiment, the anchor device 500 is the carrier for realizing the functions of the anchor end, and the broadcast platform module 530, the live broadcast processing module 540, the memory module 550 and the graphics card module 560 correspond to the broadcast platform, live broadcast processing software, memory unit and graphics card unit in the second embodiment of the aforementioned live broadcast processing method, and are key components for realizing the various functions of the anchor end. The broadcast platform module 530 serves as the entrance for the anchor to perform live broadcast operations. It is responsible for reading the push stream scene from the memory module 550 and loading it into the graphics card module 560 for rendering to obtain the scene texture. Subsequently, the broadcast platform module 530 reads the rendered scene texture from the graphics card module 560 and stores it back in the memory module 550 for use by the live broadcast processing module 540. The live broadcast processing module 540 is responsible for reading the scene texture from the memory module 550, and restoring the push stream scene based on the scene texture, and then adding the push stream scene to the original live broadcast picture to generate the target live broadcast picture. The generated target live video is stored in the memory module 550. The live broadcast platform module 530 then reads the live video from the memory module 550 and streams it to the server. This allows the host device 500 to efficiently process the live video, ensuring a smooth live broadcast. Furthermore, the use of the memory module 550 and graphics card module 560 for data access and rendering improves the processing speed and quality of the live video, providing viewers with a better viewing experience.

[0099] Since the embodiments of the anchor device 500 correspond to the second embodiment of the live broadcast processing method described above, please refer to the above method embodiment for the introduction of the anchor device 500 provided by the embodiment of the present invention. The embodiment of the present invention will not be described in detail here. It has the same beneficial effects as the second embodiment of the live broadcast processing method described above.

[0100] Please refer to Figure 9 , Figure 9 This is a functional module diagram of an embodiment of a service device according to an embodiment of the present invention. The service device 600 includes a third memory 610 and at least one third processor 620. The third memory 610 stores instructions. The at least one third processor 620 invokes the instructions in the third memory 610 to cause the service device 600 to execute the live broadcast processing method according to the third aspect described above.

[0101] In this embodiment, the broadcast director device 400 can specifically be a hardware device that implements the third embodiment of the live broadcast processing method applied to the server. Through its integrated third memory 610 and third processor 620, it efficiently executes the various tasks in the third embodiment of the live broadcast processing method. Since some embodiments of the broadcast director device 400 correspond to the first embodiment of the live broadcast processing method, please refer to the aforementioned method embodiment for the introduction of the broadcast director device 400 provided in this embodiment of the present invention. This embodiment of the present invention will not be repeated here. It has the same beneficial effects as the third embodiment of the live broadcast processing method.

[0102] Please refer to Figure 10 , Figure 10 This is a functional module diagram of an embodiment of a live broadcast system according to an embodiment of the present invention. The live broadcast system 700 includes at least one viewer device 710; at least one broadcast director device 400 as described above; at least one anchor device 500 as described above; and a service device 600 as described above. The service device 600 is connected to each viewer device 710, each broadcast director device 400, and each anchor device 500.

[0103] In this embodiment, the live broadcast system 700 is a system architecture that implements the various live broadcast processing methods described above. The system can specifically be a live broadcast system 700 for different application scenarios and different video platforms, and this application does not impose specific restrictions on this. The illustration takes a director device 400, three anchor devices 500, a service device 600, and four audience devices 710 as an example. By integrating the director device 400, the anchor device 500, the service device 600, and the audience device 710, the live broadcast system 700 realizes unified processing and management of live broadcast images in a multi-person live broadcast scenario. The director device 400 serves as the control center during the live broadcast process, responsible for receiving and processing data from the anchor end, generating layer configurations, and pushing them to each anchor end. The anchor device 500 is responsible for receiving the layer configuration, performing layer adaptation on the live broadcast image, generating the target live broadcast image, and pushing it to the service device 600. The service device 600 serves as the hub of the system and is responsible for receiving data from the director device 400 and the anchor device 500, performing further processing and optimization, and then pushing the processed live broadcast images to the audience device 710 for the audience to watch. The audience device 710 can be various smart terminals, such as smart phones, tablet computers, personal computers, etc. This application does not impose specific restrictions on this. The audience can watch the live content in real time through the audience device 710. In this way, the live broadcast system 700 can effectively solve the problems of inconsistent live broadcast images and poor visual effects in multi-person live broadcasts, providing the audience with a high-quality live viewing experience. In addition, the live broadcast system 700 can also be expanded and optimized according to actual needs, such as adding more anchor devices 500, improving the processing power of the service device 600, etc., to meet the needs of different application scenarios.

[0104] Since some embodiments of the live broadcast system 700 correspond to the aforementioned director device 400, anchor device 500 and service device 600, as well as the corresponding embodiments of various live broadcast processing methods, please refer to the above-mentioned method embodiments for the introduction of the live broadcast system 700 provided by the embodiment of the present invention, and the embodiment of the present invention will not be repeated here. The live broadcast system 700 realizes real-time monitoring, management and push of live broadcast images in multi-person live broadcast scenes through the above-mentioned live broadcast processing method, thereby improving the collaborative efficiency of live broadcast and the audience's viewing experience. At the same time, the live broadcast system 700 also reduces bandwidth pressure and storage costs by adopting low-resolution video streams for monitoring, making the live broadcast processing process more efficient and convenient. In addition, the live broadcast system 700 can also be expanded and optimized according to actual needs to meet the needs of different application scenarios, and has broad application prospects.

[0105] The present invention also provides a computer-readable storage medium, which may be a non-volatile computer-readable storage medium or a volatile computer-readable storage medium. Instructions are stored in the computer-readable storage medium. When the instructions are executed on a computer, the computer executes the various live broadcast processing methods described above.

[0106] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, the specific working process of the device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. If the integrated module or unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program code, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0107] As described above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that the technical solutions described in the above embodiments can still be modified, or some of the technical features thereof can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A live broadcast processing method, characterized in that: include: Obtain a live broadcast scene corresponding to each live broadcast link in a multi-person live broadcast, wherein the live broadcast scene includes at least one layer object; Determining a layer configuration for each of the live broadcast links based on the layer objects, wherein the layer configuration includes a relative position and relative resolution of each of the layer objects in the corresponding live broadcast scene, and material information of the layer objects; When it is detected that the multi-person live broadcast enters a new live broadcast session, obtaining the layer configuration corresponding to the new live broadcast session; The layer configuration corresponding to the new live broadcast link is uploaded to the server, so that the server can push the layer configuration to multiple anchor terminals corresponding to the multi-person live broadcast, so that each anchor terminal can perform layer adaptation on the live broadcast screen based on the layer configuration to generate the target live broadcast screen.

2. The live broadcast processing method according to claim 1, characterized in that: The live broadcast processing method further includes: Generate a monitoring list based on the anchor identification information of the plurality of anchor terminals corresponding to the multi-person live broadcast; Uploading the monitoring list to the server, so as to pull from the server the low-resolution video streams uploaded to the server by the anchor terminals corresponding to the monitoring list; The low-resolution video streams are rendered into different sub-windows of the same monitoring window.

3. The live broadcast processing method according to claim 1 or 2, characterized in that: After uploading the layer configuration corresponding to the new live broadcast link to the server, the method further includes: Monitoring whether feedback information forwarded by the server to the host terminal is received within a preset time, wherein the feedback information is generated after the host terminal confirms receipt of the layer configuration; If no feedback information from the server forwarding the anchor terminal is received within the preset time, the layer configuration is uploaded to the server again, or a resend instruction is sent to the server so that the server can push the layer configuration to the corresponding anchor terminal again.

4. A live broadcast processing method, characterized in that: include: Obtaining the original live broadcast picture and generating a blank scene with the same resolution and size as the original live broadcast picture; Receiving a layer configuration pushed by a server, wherein the layer configuration is processed by the director for the live broadcast scene corresponding to the current live broadcast segment in the multi-person live broadcast and uploaded to the server, the live broadcast scene including at least one layer object, and the layer configuration including the relative position and relative resolution of each layer object in the corresponding live broadcast scene, as well as material information of the layer object; Based on the relative position and relative resolution of the layer objects, the material information is loaded into the blank scene to generate a streaming scene adapted to the original live broadcast screen; Adding the streaming scene to the original live broadcast screen to generate a target live broadcast screen; The target live broadcast picture is pushed to the server so that the server can push the target live broadcast picture to the audience end.

5. A live broadcast processing method, characterized in that: include: Receive a layer configuration uploaded by a director, the layer configuration being obtained by the director by processing a live broadcast scene corresponding to a current live broadcast segment in a multi-person live broadcast, the live broadcast scene including at least one layer object, the layer configuration including a relative position and relative resolution of each layer object in the corresponding live broadcast scene, and material information of the layer object; Pushing the layer configuration to multiple anchor terminals corresponding to the multi-person live broadcast, so that each anchor terminal can perform layer adaptation on the live broadcast screen based on the layer configuration to generate a target live broadcast screen; Receive the target live broadcast picture generated by each anchor terminal, and push the target live broadcast picture to the audience terminal.

6. The live broadcast processing method according to claim 5, characterized in that: The live broadcast processing method further includes: Receive the low-resolution video stream uploaded by each anchor terminal, and receive the monitoring list uploaded by the director terminal, wherein the monitoring list is determined based on the anchor identification information of the plurality of anchor terminals corresponding to the multi-person live broadcast; Determine the corresponding plurality of anchor terminals based on the anchor identification information in the monitoring list; Pushing the low-resolution video streams uploaded by the anchor terminals corresponding to the monitoring list to the director terminal, so that the director terminal can render the low-resolution video streams into different sub-windows of the same monitoring window; Determine that a selection instruction for the sub-window is received from the director end, receive the target live broadcast screen from the anchor end corresponding to the selection instruction, and push the target live broadcast screen to the audience end.

7. A broadcast director device, characterized in that: The broadcast director device includes a first memory and at least one first processor, wherein the first memory stores instructions; The at least one first processor calls the instructions in the first memory so that the broadcast director device executes the live broadcast processing method as described in any one of claims 1-3.

8. A broadcasting device, characterized in that: The anchor device includes a second memory and at least one second processor, wherein the second memory stores instructions; The at least one second processor calls the instruction in the second memory to enable the anchor device to execute the live broadcast processing method according to claim 4.

9. The anchor device according to claim 8, characterized in that: The anchor device includes a broadcast platform module, a live broadcast processing module, a memory module and a graphics card module; The broadcast platform module and the live broadcast processing module are connected to the same memory module, and the memory module is used to access the received data. The streaming scene and the original live broadcast picture are both stored in the memory module; The graphics card module is connected to the broadcast platform module and is used to render the received scene; The broadcast platform module is used to: read the streaming scene from the memory module and load the streaming scene into the graphics card module; The graphics card module is used to render the streaming scene to obtain scene texture; The broadcast platform module is further configured to: read the scene texture from the graphics card module and store the scene texture in the memory module; The live broadcast processing module is used to: read the scene texture from the memory module and restore the streaming scene based on the scene texture; Adding the streaming scene to the original live broadcast screen to generate the target live broadcast screen; storing the generated target live broadcast screen in the memory module; The broadcast platform module is further used to: read the target live broadcast picture from the memory module, and push the target live broadcast picture to the server.

10. A service device, characterized in that: The service device includes a third memory and at least one third processor, wherein the third memory stores instructions; The at least one third processor calls the instructions in the third memory so that the service device executes the live broadcast processing method as described in any one of claims 5-6.

11. A live broadcast system, characterized in that: The live broadcast system includes: at least one spectator device; At least one broadcast director device according to claim 7; At least one anchor device according to any one of claims 8 to 9; The service device according to claim 10, wherein the service device is connected to each of the viewer devices, each of the director devices and the anchor device respectively.

12. A computer-readable storage medium having instructions stored thereon, characterized in that: When the instructions are executed by the processor, the live broadcast processing method according to any one of claims 1 to 6 is implemented.

Images