A method, system, terminal and storage medium for pushing a live picture to a remote fusion

CN116389827BActive Publication Date: 2026-09-22GUANGZHOU BOYA TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202310407492.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-04-14
Publication Date
2026-09-22
Estimated Expiration
2043-04-14

AI Technical Summary

Benefits of technology

[0031]本发明实施例中,首先头部主播在总部通过视频拍摄设备进行直播,以生成第一视频画面,视频拍摄设备将第一视频画面直接上传至云服务器中,云服务器根据需要推送的异地的直播一体机推送地址,将第一视频画面推送至直播一体机中,门店主播进行直播生成第二视频画面,通过直播一体机进行抠像或画中画的形式,将头部主播与不同网点的门店主播的画面融合在一起形成虚拟视频画面,再将虚拟视频画面推流至直播平台上。本发明能够实现单个头部主播画面同时推送到多个网点的效果,每个网点的直播画面中仅有头部主播以及当地网点的门店主播,在同时与多个网点进行互动的同时,避免了过多主播同屏造成观感不佳的问题,便捷的实现了单主播多网点推送的效果。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116389827B_ABST
    Figure CN116389827B_ABST
Patent Text Reader

Abstract

The application discloses a method for pushing live picture to remote fusion, which comprises collecting signals of video shooting equipment, obtaining first video picture, uploading the first video picture to cloud server, obtaining at least one live streaming address of remote live integrated machine by the cloud server, distributing the first video picture to the remote live integrated machine based on the live streaming address, obtaining second video picture by the remote live integrated machine, fusing the first video picture and the second video picture to generate virtual video picture, assigning at least one live platform to the remote live integrated machine, and pushing the virtual video picture to the live platform. The application can realize the effect of synchronously pushing remote picture to several local pictures and fusing, reduce the live hardware cost of multi-live platform and multi-anchor fusion live of merchants, and conveniently realize the effect of matrix live.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of live streaming technology, and in particular to a method, system, terminal, and storage medium for pushing live stream footage to remote locations for fusion. Background Technology

[0002] Live streaming utilizes computer networks to transmit multimedia data from the broadcaster's device to online viewers in real time, allowing for real-time information interaction between the broadcaster and viewers. Due to factors such as continuously improving internet speeds and the richness of content available in live streaming programs, it has become increasingly popular.

[0003] In existing online live streaming, the influence of the streamer is significant. Typically, top streamers bring far more traffic than store streamers. Therefore, merchants need to use methods such as live streaming with top streamers and store streamers interacting on the same screen to drive traffic. However, in traditional live streaming with the same screen, top streamers and store streamers must be on the same screen. Top streamers cannot be in two places at the same time to stream with multiple store streamers. Therefore, the number of streamers that top streamers can interact with at the same time is limited. They cannot fully cater to store streamers in different locations. In addition, there are many store streamers with varying levels of skill, resulting in a poor viewing experience for viewers. Store streamers cannot drive better traffic through professionalism by streaming independently.

[0004] Therefore, a method is needed that can achieve single-anchor-to-multiple-network-point push and realize live interaction at a low cost. Summary of the Invention

[0005] To address the aforementioned technical problems, the first aspect of this invention discloses a method for pushing live stream footage to a remote fusion location, the method comprising:

[0006] The signal from the video shooting device is collected, the first video frame is obtained, and the first video frame is uploaded to the cloud server;

[0007] The cloud server obtains the streaming address of at least one remote live streaming device, and the cloud server distributes the first video image to the remote live streaming device based on the streaming address.

[0008] The remote live streaming all-in-one machine acquires the second video frame and merges the first video frame with the second video frame to generate a virtual video frame.

[0009] At least one live streaming platform is designated for the remote live streaming all-in-one machine, and the virtual video screen is pushed to the live streaming platform.

[0010] Furthermore, the video shooting device includes a local live streaming all-in-one machine or a mobile phone.

[0011] Furthermore, the fusion of the first video frame and the second video frame includes:

[0012] The first and second video frames are simultaneously displayed in the virtual video frame using a picture-in-picture format; or the human figures in the first and second video frames are extracted and placed in the virtual video frame using a lens-based keying technique.

[0013] Furthermore, the cloud server can enable or disable the push of the first video frame.

[0014] Furthermore, the video recording device is configured as a local live streaming all-in-one machine. When uploading the remote video footage to the cloud server, the following steps are also included:

[0015] At least one of the streaming addresses is bound to the local live streaming device via a WeChat mini program;

[0016] The cloud server pushes the first video frame to the remote live streaming machine according to the push address.

[0017] Preferably, the video shooting device is configured as a mobile phone, and when uploading the remote video footage to the cloud server, the following steps are also included: binding at least one of the streaming addresses through a built-in streaming app;

[0018] The cloud server pushes the first video frame to the remote live streaming machine according to the push address.

[0019] Preferably, when generating the virtual video frame, adjustments can also be made through interactive commands, including adjusting the proportion of the first or second video frame in the virtual video frame and adjusting the stacking order of the first and second video frames in the virtual video frame.

[0020] A second aspect of the present invention discloses a system for pushing live broadcast footage to a remote fusion location, the system comprising:

[0021] The acquisition module is used to acquire signals from the video shooting device and obtain the first video frame.

[0022] An upload module, which is used to upload the first video frame to a cloud server;

[0023] The cloud server is used to obtain the streaming address of at least one remote live streaming all-in-one machine and distribute the first video image to the remote live streaming all-in-one machine based on the streaming address.

[0024] The live streaming all-in-one machine is used to acquire a second video frame, merge the first video frame and the second video frame to generate a virtual video frame, and push the virtual video frame to the live streaming platform.

[0025] A third aspect of this invention discloses a terminal for pushing live stream footage to a remote location fusion platform, the terminal comprising:

[0026] Memory containing executable program code;

[0027] A processor coupled to the memory;

[0028] The processor calls the executable program code stored in the memory to execute the method for pushing live broadcast footage to a remote location for fusion as disclosed in the first aspect of the present invention.

[0029] The fourth aspect of the present invention discloses a computer storage medium storing computer instructions, which, when invoked, are used to execute some or all of the steps in the method for pushing live broadcast images to remote fusion disclosed in the first aspect of the present invention.

[0030] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0031] In this embodiment of the invention, the top anchor first conducts a live broadcast from headquarters using video recording equipment to generate a first video frame. The video recording equipment directly uploads the first video frame to a cloud server. The cloud server, based on the required push address of the remote live broadcast all-in-one machine, pushes the first video frame to the live broadcast all-in-one machine. Store anchors then conduct live broadcasts to generate a second video frame. The live broadcast all-in-one machine uses keying or picture-in-picture techniques to merge the images of the top anchor and the store anchors from different locations into a virtual video frame, which is then streamed to the live broadcast platform. This invention enables the simultaneous push of a single top anchor's image to multiple locations. Each location's live broadcast only contains the top anchor and the local store anchor, allowing for simultaneous interaction with multiple locations while avoiding the poor viewing experience caused by too many anchors on screen. This conveniently achieves the effect of single anchor pushing to multiple locations. Attached Figure Description

[0032] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0033] Figure 1This is a flowchart illustrating a method for pushing live video feeds to a remote location for fusion, as disclosed in an embodiment of the present invention.

[0034] Figure 2 This is an information flow diagram of a method for pushing live broadcast footage to a remote fusion location, as disclosed in an embodiment of the present invention.

[0035] Figure 3 This is a schematic diagram of the structure of a system for pushing live broadcast footage to a remote fusion location, as disclosed in an embodiment of the present invention.

[0036] Figure 4 This is a schematic diagram of the structure of a terminal that pushes live broadcast footage to a remote fusion terminal, as disclosed in an embodiment of the present invention.

[0037] Figure 5 This is a schematic diagram of the structure of a computer storage medium disclosed in an embodiment of the present invention. Detailed Implementation

[0038] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0039] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this invention are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product, or end that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or ends.

[0040] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of the invention. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0041] This invention discloses a method, system, terminal, and storage medium for pushing live stream footage to multiple locations for fusion. First, a top anchor conducts a live stream from headquarters using video recording equipment to generate a first video frame. The video recording equipment directly uploads the first video frame to a cloud server. The cloud server, based on the required push address of the remote live streaming all-in-one machine, pushes the first video frame to the live streaming all-in-one machine. Store anchors then conduct their live streams, generating a second video frame. The live streaming all-in-one machine uses keying or picture-in-picture techniques to fuse the footage of the top anchor with that of anchors from different locations, forming a virtual video frame. This virtual video frame is then streamed to a live streaming platform. This invention enables the simultaneous push of a single top anchor's footage to multiple locations. Each location's live stream only shows the top anchor and the local store anchors, allowing for simultaneous interaction with multiple locations while avoiding the poor viewing experience caused by too many anchors on screen. It conveniently achieves the effect of single-anchor, multi-location push. Detailed explanations follow.

[0042] Example 1

[0043] Please see Figure 1 , Figure 1 This is a flowchart illustrating a method for pushing live stream footage to a remote location for fusion, as disclosed in an embodiment of the present invention. Figure 1 As shown, the method for pushing live stream footage to a remote location fusion site may include the following operations:

[0044] 101. Collect the signal from the video shooting device, acquire the first video frame, and upload the first video frame to the cloud server;

[0045] The video shooting device can be a live streaming all-in-one machine or a mobile phone, etc., capable of video shooting, software downloading, and information streaming. It is understood that this video shooting device is mainly used to shoot videos and stream them to a cloud server. Optionally, if the video shooting device is configured as a mobile phone, when uploading video footage from a different location to the cloud server, the following steps are also included: binding at least one streaming address through a built-in streaming app; the cloud server pushes the first video frame to the live streaming all-in-one machine in the different location according to the streaming address. In another optional embodiment, if the video shooting device is configured as a local live streaming all-in-one machine, when uploading video footage from a different location to the cloud server, the following steps are also included: binding at least one streaming address through a WeChat mini-program in the local live streaming all-in-one machine; the cloud server pushes the first video frame to the live streaming all-in-one machine in the different location according to the streaming address. Multiple live streaming methods facilitate top streamers to conduct live streaming in a richer and more diverse live streaming environment.

[0046] The 102 cloud server obtains the streaming address of at least one remote live streaming device. Based on the streaming address, the cloud server distributes the first video image to the remote live streaming device. The input of the streaming address is mainly selected by the video shooting device. After the streaming address is bound, it will be saved in the corresponding streaming path. The broadcaster can choose to turn the media stream push on or off through the video shooting device.

[0047] 103 remote live streaming all-in-one machines acquire the second video frame and merge the first video frame with the second video frame to generate a virtual video frame;

[0048] In this embodiment, the fusion of the first and second video frames mainly involves displaying the first and second video frames simultaneously in a virtual video frame using a picture-in-picture format. Under this fusion method, a video call-like frame is generated in the virtual video frame, and the portraits and backgrounds in both the first and second video frames are preserved, improving the flexibility of the live broadcast and helping the host to conduct interactive segments such as environmental demonstrations.

[0049] In another preferred embodiment, the human figures in the first and second video frames are extracted using lens cutout and placed within a virtual video frame. It is understood that the human figures in the first video frame can be extracted separately and overlaid on the original background of the second video frame, or vice versa.

[0050] 104 specifies at least one live streaming platform for the remote live streaming all-in-one machine and pushes the virtual video screen to the live streaming platform.

[0051] Preferably, when generating virtual video frames, adjustments can also be made through interactive commands. These interactive commands include adjusting the proportion of the first or second video frame in the virtual video frame and adjusting the stacking order of the first and second video frames in the virtual video frame.

[0052] like Figure 2 As shown, Figure 2 This is a more detailed flowchart of the method for pushing live broadcast footage to a remote location for fusion in this embodiment.

[0053] The embodiments of the present invention have at least the following beneficial effects:

[0054] (1) It has enabled a top anchor to interact with anchors from multiple locations, effectively increasing the traffic of anchors from different locations.

[0055] (2) It fully integrates the images of top anchors and store anchors, avoiding the traditional situation of multiple anchors on the same screen, and improving the audience experience.

[0056] It is evident that implementation Figure 1The described method for pushing and merging live stream footage across different locations involves the following steps: First, a top anchor conducts a live stream from headquarters using video recording equipment to generate a first video frame. This first video frame is then directly uploaded to a cloud server. The cloud server, based on the required push address of the live streaming all-in-one machine in a different location, pushes the first video frame to the live streaming all-in-one machine. Store anchors then conduct their own live streams, generating a second video frame. The live streaming all-in-one machine uses keying or picture-in-picture techniques to merge the footage of the top anchor with that of anchors from different locations, creating a virtual video frame. This virtual video frame is then streamed to the live streaming platform. This invention enables the simultaneous push of a single top anchor's footage to multiple locations. Each location's live stream only features the top anchor and the local store anchors, allowing for simultaneous interaction with multiple locations while avoiding the poor viewing experience caused by too many anchors on screen. This conveniently achieves the effect of pushing a single anchor to multiple locations.

[0057] Example 2

[0058] Please see Figure 3 , Figure 3 This is a schematic diagram of a system for pushing live broadcast footage to a remote fusion location, as disclosed in an embodiment of the present invention. Figure 3 As shown, the system for pushing live stream footage to a remote converged network may include:

[0059] Acquisition module 201 is used to acquire signals from video shooting equipment and obtain a first video frame;

[0060] Upload module 202 is used to upload the first video frame to the cloud server;

[0061] Cloud server 203 is used to obtain the push address of at least one remote live streaming all-in-one machine and distribute the first video image to the remote live streaming all-in-one machine based on the push address.

[0062] The live streaming all-in-one machine 204 is used to acquire a second video frame, merge the first video frame with the second video frame to generate a virtual video frame, and push the virtual video frame to the live streaming platform.

[0063] For a detailed description of the system that pushes the live stream to the remote location integration, please refer to the detailed description of the method for pushing the live stream to the remote location integration, which will not be repeated here.

[0064] Example 3

[0065] Please see Figure 4 , Figure 4 This is a schematic diagram of the structure of a terminal for pushing live broadcast footage to a remote fusion system, as disclosed in an embodiment of the present invention. Figure 4 As shown, the terminal that pushes the live stream to the remote convergence terminal may include:

[0066] Memory 301 storing executable program code;

[0067] Processor 302 coupled to memory 301;

[0068] The processor 302 calls the executable program code stored in the memory 301 to execute the steps of the method for pushing live broadcast images to remote fusion disclosed in Embodiment 1 of the present invention.

[0069] Example 4

[0070] Please see Figure 5 , Figure 5 This is a schematic diagram of the structure of a computer storage medium disclosed in an embodiment of the present invention. Figure 5 As shown, an embodiment of the present invention discloses a computer storage medium 401, which stores computer instructions. When the computer instructions are invoked, they are used to execute the steps in the method for pushing live broadcast images to remote fusion disclosed in Embodiment 1 of the present invention.

[0071] The device embodiments described above are merely illustrative. The modules described as separate components may or may not be physically separate, and the components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0072] Through the detailed description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, including read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0073] Finally, it should be noted that the text recall method, apparatus, terminal, and storage medium disclosed in the embodiments of the present invention are merely preferred embodiments of the present invention and are only used to illustrate the technical solutions of the present invention, not to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for pushing live stream footage to a remote location for fusion, characterized in that, The method includes: The signal from the video shooting device is collected, the first video frame is obtained, and the first video frame is uploaded to the cloud server; The cloud server obtains the streaming address of at least one remote live streaming device, and the cloud server distributes the first video image to the remote live streaming device based on the streaming address. The remote live streaming all-in-one machine acquires the second video frame and merges the first video frame with the second video frame to generate a virtual video frame. Designate at least one live streaming platform for the remote live streaming all-in-one machine, and push the virtual video image to the live streaming platform; The fusion of the first video frame and the second video frame includes: By using a picture-in-picture format, the first video frame and the second video frame are simultaneously displayed in the virtual video frame; or The human figures in the first and second video frames are extracted by using lens cutout and then placed in the virtual video frame; The video recording device is configured as a local live streaming all-in-one machine. When uploading the remote video footage to the cloud server, the following steps are also included: At least one of the streaming addresses is bound to the local live streaming device via a WeChat mini program; The cloud server pushes the first video frame to the remote live streaming machine according to the push address.

2. The method according to claim 1, characterized in that, The video shooting equipment includes a local live streaming all-in-one machine or a mobile phone.

3. The method according to claim 1, characterized in that, The cloud server can enable or disable the push of the first video frame.

4. The method according to claim 1, characterized in that, When generating the virtual video frame, adjustments can also be made through interactive commands, including adjusting the proportion of the first or second video frame in the virtual video frame and adjusting the stacking order of the first and second video frames in the virtual video frame.

5. A system for pushing live stream footage to a remote fusion location, characterized in that, The system includes: The acquisition module is used to acquire signals from the video shooting device and obtain the first video frame. An upload module, which is used to upload the first video frame to a cloud server; The cloud server is used to obtain the streaming address of at least one remote live streaming all-in-one machine, and distribute the first video image to the remote live streaming all-in-one machine based on the streaming address. The live streaming all-in-one machine is used to acquire a second video frame, merge the first video frame and the second video frame to generate a virtual video frame, and push the virtual video frame to the live streaming platform; The fusion of the first video frame and the second video frame includes: By using a picture-in-picture format, the first video frame and the second video frame are simultaneously displayed in the virtual video frame; or The human figures in the first and second video frames are extracted by using lens cutout and then placed in the virtual video frame; The video recording device is configured as a local live streaming all-in-one machine. When uploading the remote video footage to the cloud server, the following steps are also included: At least one of the streaming addresses is bound to the local live streaming device via a WeChat mini program; The cloud server pushes the first video frame to the remote live streaming machine according to the push address.

6. A terminal for pushing live stream footage to a remotely integrated terminal, characterized in that, The terminal includes: Memory containing executable program code; A processor coupled to the memory; The processor invokes the executable program code stored in the memory to execute the method as described in any one of claims 1 to 4.

7. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1 to 4.

Citation Information

Patent Citations

  • Method and device for implementing video conference, computer equipment and storage medium

    CN108833823A

  • Live broadcast and configuration method based on cloud mobile phone and related device and system

    CN113497945A

  • Video livestreaming method and video livestreaming apparatus

    WO2022247293A1