Virtual-real mixed digital live broadcast method and system

Through the digital live broadcast method mixed with virtual and real, the real-time switching of live broadcast background and goals is achieved using multi-terminal design and intelligent software, which solves the problem of lag in the live broadcast background switching and digital display in the existing technology, and improves the user experience and viewing of live broadcasts .

CN119011897APending Publication Date: 2024-11-22SHANGHAI FENGPU CULTURAL & CREATIVE DEVELOPMENT CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411225816.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-02
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

The existing technology cannot realize real-time switching of live broadcast backgrounds. The switching process is prone to lag and time-consuming, which affects the consistency of live broadcasts and cannot realize the digital display of live broadcast content, resulting in poor user experience.

Method used

Design a digital live broadcast method that mixes virtual and real, controls multiple terminals to enable live broadcast screens, integrates the third live broadcast screen, and realizes real-time switching of backgrounds and goals during the live broadcast process, and uses multi-terminal design and intelligent software to achieve dynamic backgrounds and Fusion display of goals.

Benefits of technology

It has achieved rapid and continuous switching of live broadcast background and goals, improved user experience and viewing, enhanced the interactivity and authenticity of live broadcasts, and increased the enthusiasm of users to participate.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119011897A_ABST
    Figure CN119011897A_ABST
Patent Text Reader

Abstract

The invention discloses a virtual-real mixed digital live broadcast method and system, and belongs to the technical field of digital live broadcast platforms, and the method comprises the steps: controlling a first terminal to start a first live broadcast picture and controlling a second terminal to start a second live broadcast picture based on a first live broadcast target in response to a debugging request, and carrying out the debugging of the first live broadcast picture and the second live broadcast picture; fusing into a third live broadcast picture; and in response to the live broadcast request, performing live broadcast through the first terminal and the second terminal according to the third live broadcast picture. According to the invention, through a multi-device digital live broadcast design, according to a virtual-real combined background and target switching technology, digital display of the live broadcast process is realized, the ornamental value of the live broadcast process is improved, the audience experience is enhanced, and a new technical basis is provided for an existing digital live broadcast technology.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of digital live broadcast platform, and in particular to a virtual-real hybrid digital live broadcast method and system. Background Art

[0002] Live streaming refers to setting up an independent signal acquisition device (audio + video) on site to import it into the director end (director device or platform), and then uploading it to the server through the Internet, and publishing it to the website for people to watch. Live streaming absorbs and continues the advantages of the Internet, using video to conduct live online broadcasts. Product presentations, related meetings, background introductions, program evaluations, online surveys, dialogue interviews, online training and other content can be published on the Internet on site, and the Internet's intuitive and fast features, good presentation forms, rich content, strong interactivity, no geographical restrictions, and audience division are used to enhance the promotion effect of the event site.

[0003] Virtual-reality hybrid technology is a technical design that combines the virtual and real worlds. It has been gradually applied to online live broadcasts, bringing more interactive content to the live broadcast process. However, the existing technology cannot achieve real-time switching of the live broadcast background, and the switching process is prone to freezes and takes too long, which affects the continuity of the live broadcast process. At the same time, it is also impossible to digitally display the live broadcast content during the live broadcast. Therefore, there is an urgent need to design a new digital live broadcast technology to bring a better experience to viewers and live broadcast users. Summary of the invention

[0004] In order to solve the above problems, the purpose of the present invention is to enhance user experience and increase user participation enthusiasm by designing a virtual-real hybrid digital live broadcast technology.

[0005] In order to achieve the above technical objectives, the present application provides a virtual-real hybrid digital live broadcast method, comprising the following steps: In response to the debugging request, based on the first live target, control the first terminal to start the first live screen, control the second terminal to start the second live screen, and merge the first live screen and the second live screen into a third live screen; In response to the live broadcast request, live broadcast is performed through the first terminal and the second terminal according to the third live broadcast picture.

[0006] Preferably, in the process of generating the third live broadcast picture, a first background of the first live broadcast picture and a second background of the second live broadcast picture are obtained; According to the first background or the second background, the first live broadcast picture and the second live broadcast picture are merged into a third live broadcast picture.

[0007] Preferably, in the process of generating the first live broadcast screen, a first image of the first live broadcast target is acquired through the first terminal, and a second image of the first live broadcast target is acquired through the second terminal; Based on the first background, a first live broadcast picture is generated by fusing the first image and the second image.

[0008] Preferably, in the process of generating the second live broadcast picture, the second live broadcast picture is generated by fusing the first image and the second image based on the second background.

[0009] Preferably, in response to the live broadcast through the first terminal and the second terminal, the third live broadcast picture is live broadcast based on the first terminal and according to the first background; Based on the second terminal, broadcasting the third live picture live according to the second background; By selecting the first terminal or the second terminal, the live broadcast background is switched.

[0010] Preferably, in the process of switching the live broadcast background, the live broadcast background is switched according to the first background or the second background by selecting the first terminal or the second terminal.

[0011] Preferably, in the process of switching the live broadcast background, after the background is switched according to the unselected first terminal or the second terminal, the third live broadcast picture is broadcast live through the first terminal or the second terminal after the background switching.

[0012] Preferably, in the process of live broadcasting the third live broadcast picture, a second live broadcast target is acquired based on the first live broadcast picture or the second live broadcast picture; According to the position of the live broadcast screen where the second live broadcast target appears, the third live broadcast screen is switched to the first terminal or the second terminal, the second live broadcast target is broadcast live, or the second live broadcast target is shielded.

[0013] Preferably, during the live broadcast of the second live broadcast target, the second live broadcast target is integrated into the first live broadcast screen or the second live broadcast screen according to the position of the live broadcast screen where the second live broadcast target appears, and the background of the third live broadcast screen is switched through the background of the integrated first live broadcast screen or the second live broadcast screen, and the second live broadcast target is displayed according to the selected display requirements.

[0014] The present invention discloses a virtual-real hybrid digital live broadcast system, comprising: A debugging module, configured to respond to a debugging request, control the first terminal to start a first live broadcast screen, control the second terminal to start a second live broadcast screen based on a first live broadcast target, and merge the first live broadcast screen and the second live broadcast screen into a third live broadcast screen; The live broadcast module is used to respond to the live broadcast request and broadcast live through the first terminal and the second terminal according to the third live broadcast picture.

[0015] The present invention discloses the following technical effects: The present invention realizes the digital experience of users in live broadcasting and enhances the interest of users in live broadcasting. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0017] Figure 1 It is a schematic diagram of the method flow of the present invention. DETAILED DESCRIPTION

[0018] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0019] like Figure 1 As shown, the present invention provides a virtual-real hybrid digital live broadcast method, comprising the following steps: In response to the debugging request, based on the first live target, control the first terminal to start the first live screen, control the second terminal to start the second live screen, and merge the first live screen and the second live screen into a third live screen; In response to the live broadcast request, live broadcast is performed through the first terminal and the second terminal according to the third live broadcast picture.

[0020] Further preferably, in the digital live broadcast method mentioned in the present invention, in the process of generating the third live broadcast picture, a first background of the first live broadcast picture and a second background of the second live broadcast picture are obtained; According to the first background or the second background, the first live broadcast picture and the second live broadcast picture are merged into a third live broadcast picture.

[0021] Further preferably, in the digital live broadcast method mentioned in the present invention, in the process of generating the first live broadcast picture, a first image of the first live broadcast target is obtained through the first terminal, and a second image of the first live broadcast target is obtained through the second terminal; Based on the first background, a first live broadcast picture is generated by fusing the first image and the second image.

[0022] Further preferably, in the digital live broadcast method mentioned in the present invention, in the process of generating the second live broadcast picture, the second live broadcast picture is generated by fusing the first image and the second image based on the second background.

[0023] During debugging, the first terminal and the second terminal mentioned in the present invention are general terms, and the terminal positions are not limited, and can be on the same side or on the opposite side (at least two framing devices are arranged relatively to each other). When the terminals are broadcasting live on the same side, the current live target will be fused according to the position of the current live target (the first live target) and the angle of the terminal relative to the position to form a live picture with a wider viewing angle, so that the picture of the current live target is more complete and the picture deformation is prevented. At the same time, the background of the live broadcast is richer, and the difficulty in positioning the target in the background during the live broadcast is reduced. When the terminal is broadcasting live at the opposite side, that is, when the pictures collected by different terminals are quite different, the live target is fused to make the live target more three-dimensional, and during the live broadcast, the fused live target is broadcast live according to the live broadcast terminal (the terminal selected as the live broadcast terminal), and other terminals broadcast live according to the live picture of the live broadcast terminal.

[0024] Further preferably, in response to the live broadcast through the first terminal and the second terminal, the third live broadcast picture is live broadcast based on the first terminal and according to the first background; Based on the second terminal, broadcasting the third live picture live according to the second background; By selecting the first terminal or the second terminal, the live broadcast background is switched.

[0025] Further preferably, in the digital live broadcast method mentioned in the present invention, in the process of switching the live broadcast background, the live broadcast background is switched according to the first background or the second background by selecting the first terminal or the second terminal.

[0026] Further preferably, in the digital live broadcast method mentioned in the present invention, during the process of switching the live broadcast background, after switching the background according to the unselected first terminal or the second terminal, the third live broadcast screen is broadcast live through the first terminal or the second terminal after the background switching.

[0027] When switching the live broadcast background, in order to avoid the lag caused by switching the current live broadcast background, the background is switched through other terminals that are not live broadcast terminals, and then the background is quickly switched by switching the live broadcast terminal. At the same time, through the continuous switching of multiple terminals, the continuous switching of the background and even the generation of dynamic background can be achieved. That is, during the live broadcast, the dynamic background is sent to the terminals participating in the live broadcast through the background program, and the switching frequency is set, so that the live broadcast of the dynamic background can be completely generated, which improves the viewing experience of the live broadcast.

[0028] Further preferably, the digital live broadcast method mentioned in the present invention obtains the second live broadcast target based on the first live broadcast picture or the second live broadcast picture during the process of live broadcasting the third live broadcast picture; According to the position of the live broadcast screen where the second live broadcast target appears, the third live broadcast screen is switched to the first terminal or the second terminal, the second live broadcast target is broadcast live, or the second live broadcast target is shielded.

[0029] Further preferably, in the digital live broadcast method mentioned in the present invention, during the process of live broadcasting of the second live broadcast target, the second live broadcast target is integrated into the first live broadcast screen or the second live broadcast screen according to the position of the live broadcast screen where the second live broadcast target appears, and the background of the third live broadcast screen is switched through the background of the integrated first live broadcast screen or the second live broadcast screen, and the second live broadcast target is displayed according to the selected display requirement.

[0030] During the live broadcast process, when the second live broadcast target appears, it is usually necessary to place the second live broadcast target in front of the live broadcast terminal, that is, to appear in the current live broadcast screen. Under the setting of multiple terminal devices, it is easy for the second live broadcast target to fail to appear in the screens of all terminal devices. At this time, it is only necessary to present the second live broadcast target in any terminal device (which can be a non-live broadcast terminal), and by switching the live broadcast screen, the second live broadcast target is integrated into the current live broadcast scene to improve the rapid switching of the live broadcast target. At the same time, in order to avoid the appearance of the second live broadcast target in the current live broadcast screen, the second live broadcast target can be shielded by switching the terminal device without affecting the effect of the current live broadcast, such as manual switching of the live broadcast background, etc., which will effectively improve the audience experience.

[0031] When the second live target is broadcast live, if the second live target is an object, virtual and real fusion is performed according to the mobile terminal where the second live target is located, and information such as the target size and purpose are integrated into the second live target, thereby improving authenticity. For example, for the display of a pendant, the length, width, and height of the pendant are displayed, as well as samples of existing objects relative to the size of the pendant, so that the audience can know the actual size of the pendant more clearly and avoid image deformation caused by the distance between the object and the lens screen. It should be emphasized here that the displayed content can be displayed according to the selection, and the second target being an object is only a special embodiment and does not represent the only choice for the second live target.

[0032] The present invention discloses a virtual-real hybrid digital live broadcast system, which is used to implement the above-mentioned digital live broadcast method, including: A debugging module, configured to respond to a debugging request, control the first terminal to start a first live broadcast screen, control the second terminal to start a second live broadcast screen based on a first live broadcast target, and merge the first live broadcast screen and the second live broadcast screen into a third live broadcast screen; The live broadcast module is used to respond to the live broadcast request and broadcast live through the first terminal and the second terminal according to the third live broadcast picture.

[0033] The present invention also designs an intelligent software, which is developed through a program to form a computer program, which is installed in at least two removable storage devices respectively to realize the logical process of the digital live broadcast method.

[0034] The present invention also develops a set of removable storage devices for carrying the digital live broadcast system, which is then deployed in a live broadcast room to achieve digital live broadcast of the live broadcast target, thereby realizing the logical functions of the digital live broadcast system.

[0035] The present invention realizes the digital display of the live broadcast process through the live broadcast design of multiple devices and the switching design of the background and target based on the combination of virtual and real, improves the viewing experience of the live broadcast process, and enhances the audience experience.

[0036] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0037] In the description of the present invention, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0038] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A digital live broadcast method that mixes virtuality and reality, characterized in that: The following steps are involved: In response to the debugging request, based on the first live target, controlling the first terminal to start a first live screen, controlling the second terminal to start a second live screen, and merging the first live screen and the second live screen into a third live screen; In response to the live broadcast request, live broadcast is performed through the first terminal and the second terminal according to the third live broadcast picture.

2. According to claim 1, a mixed virtual and real digital live broadcast method is characterized by: In the process of generating the third live broadcast picture, obtaining a first background of the first live broadcast picture and a second background of the second live broadcast picture; According to the first background or the second background, the first live broadcast picture and the second live broadcast picture are merged into a third live broadcast picture.

3. According to claim 2, a mixed virtual and real digital live broadcast method is characterized by: In the process of generating the first live broadcast screen, a first image of the first live broadcast target is acquired through the first terminal, and a second image of the first live broadcast target is acquired through the second terminal; Based on the first background, the first live broadcast screen is generated by fusing the first image and the second image.

4. According to claim 3, a mixed virtual and real digital live broadcast method is characterized by: In the process of generating the second live broadcast picture, based on the second background, the first image and the second image are fused to generate the second live broadcast picture.

5. A virtual-real hybrid digital live broadcast method according to claim 4, characterized in that: In response to live broadcasting through the first terminal and the second terminal, live broadcasting the third live broadcast picture based on the first terminal and according to the first background; Based on the second terminal, broadcasting the third live picture live according to the second background; By selecting the first terminal or the second terminal, the live broadcast background is switched.

6. A virtual-real hybrid digital live broadcast method according to claim 5, characterized in that: In the process of switching the live broadcast background, the live broadcast background is switched according to the first background or the second background by selecting the first terminal or the second terminal.

7. The method for digital live broadcasting with mixed virtual and real elements according to claim 5, characterized in that: During the live broadcast background switching process, after the background switching is performed according to the first terminal or the second terminal that is not selected, the third live broadcast screen is broadcast live through the first terminal or the second terminal after the background switching.

8. The method for digital live broadcasting with mixed virtual and real elements according to claim 5, characterized in that: In the process of live broadcasting the third live broadcast picture, based on the first live broadcast picture or the second live broadcast picture, obtaining a second live broadcast target; According to the position of the live broadcast screen where the second live broadcast target appears, the third live broadcast screen is switched to the first terminal or the second terminal, the second live broadcast target is broadcast live, or the second live broadcast target is shielded.

9. A virtual-real hybrid digital live broadcast method according to claim 8, characterized in that: During the live broadcast of the second live broadcast target, the second live broadcast target is integrated into the first live broadcast screen or the second live broadcast screen according to the position of the live broadcast screen where the second live broadcast target appears. The background of the third live broadcast screen is switched through the background of the integrated first live broadcast screen or the second live broadcast screen. At the same time, the second live broadcast target is displayed according to the selected display requirements.

10. A virtual-real hybrid digital live broadcast system, characterized in that: include: A debugging module, configured to respond to a debugging request, control the first terminal to start a first live broadcast screen, control the second terminal to start a second live broadcast screen based on a first live broadcast target, and merge the first live broadcast screen and the second live broadcast screen into a third live broadcast screen; The live broadcast module is used to respond to the live broadcast request and broadcast live through the first terminal and the second terminal according to the third live broadcast picture.

Citation Information

Patent Citations

  • Picture synthesis method and apparatus

    CN106385614A

  • Video acquisition processing method and device, electronic equipment and storage medium

    CN113329230A

  • Remote live broadcast virtual background cloud synthesis system based on VR technology

    CN113395527A

  • Live broadcast picture display method and device, electronic equipment and storage medium

    CN114584797A

  • Method and system for pushing live broadcast picture to different places for fusion, terminal and storage medium

    CN116389827A