Interactive live broadcast room interacting with virtual scene

Abstract

The invention relates to the technical field of live broadcast, and provides an interactive live broadcast room interacting with a virtual scene, which comprises a green screen, a blue screen, an operation table, a pan-tilt camera and live broadcast processing equipment, according to the invention, the blue screen moves on the green screen, the patterns of the blue screen and the green screen are replaced by the live broadcast processing equipment, and common live broadcast equipment is used, so that a low-cost virtual scene interaction effect is realized, and meanwhile, the image processing pressure of the live broadcast processing equipment is relieved by performing targeted adjustment on the shape and the size of the blue screen, and the user experience is improved. The interactive live broadcast process of the virtual scene is further simplified; and the interaction cooling time is set and the blue screen is added, so that audiences have certain confusion during interaction, and the number of people who can interact in the live broadcast room at the same time is greatly increased.

Description

Technical Field

[0001] The present invention relates to the field of live broadcast technology, in particular to an interactive live broadcast room that interacts with a virtual scene. Background Art

[0002] Live broadcast, now usually refers to interactive live broadcast on the Internet, which is a social and business method. The host uses a camera to upload images to the Internet platform in real time, and the audience watches them through the website or APP to achieve entertainment or teaching purposes.

[0003] The live broadcast room can refer to the room where the live broadcast program is broadcast to the audience, which has good sound insulation and noise reduction functions. It can also refer to the interface of the live broadcast on the Internet, and its interface is usually used to display images, provide interaction, etc.

[0004] Existing live broadcasts can be roughly classified into two types: one is interactive live broadcast, and the other is non-interactive live broadcast. Interactive live broadcast adds interactive functions to the live video application, allowing viewers to interact with the host through voice, video, games, etc.

[0005] The original meaning of virtual scene refers to the virtual humanistic environment, which generally refers to the fictional scenes in literary works such as novels, dramas, film and television dramas, and various games. However, with the development of science and technology, the current virtual scene usually refers to the digital scene outlined by computers through digital communication technology.

[0006] An interactive live broadcast room that interacts with virtual scenes refers to a live broadcast room where viewers can interact with the virtual environment and scenes of the live broadcast room in real time. It mainly involves three technical issues: live broadcast transmission and playback, virtual scene construction, and real-time interactive program design.

[0007] The Chinese patent announcement number is: CN112804547A, an interactive live broadcast system based on drone VR camera, the above invention includes a drone shooting terminal, a live broadcast cloud server, an immersive VR terminal and a remote control terminal, and the drone shooting terminal, the immersive VR terminal and the remote control terminal are all connected to the live broadcast cloud server in communication; the above invention forwards the live picture to the viewer through the live broadcast cloud server, and the viewer can watch the live picture in a more three-dimensional and vivid way through the immersive VR terminal, and the viewing effect is better. At the same time, the viewer can also control the shooting angle of the drone shooting terminal through the remote control terminal, so as to watch the live picture that meets his needs. The control process improves the fun and interactivity of the live viewing process. The above invention not only has more complete functions, but also improves the humanized design, which can meet the viewing needs and interactive experience effects of different viewers; however, the above invention uses a variety of high-tech technologies including immersive VR equipment and drone panoramic shooting, which generates extremely high live broadcast costs but is only used to serve a very small number of viewers, which is inconsistent with the current mainstream live broadcast format and cannot well adapt to the needs of the mainstream live broadcast market.

[0008] In summary, the present invention provides an interactive live broadcast room that interacts with a virtual scene to solve the above problems. Summary of the invention

[0009] The present invention provides an interactive live broadcast room that interacts with a virtual scene. By using a blue screen to move on a green screen and using a live broadcast processing device to replace the patterns of the blue screen and the green screen, the problem of the prior art that high-cost interactive services can only be provided to a small number of viewers is solved.

[0010] An interactive live broadcast room for interacting with a virtual scene comprises: a green screen, a blue screen, an operation table, a pan-tilt camera and a live broadcast processing device, wherein the pan-tilt camera is mounted on the ground, the live broadcast processing device is arranged on the side of the pan-tilt camera and is electrically connected to the pan-tilt camera, the operation table is arranged in front of the pan-tilt camera, the green screen is arranged on a side of the operation table away from the pan-tilt camera, the top of the green screen is detachably connected to a connecting column, the side of the connecting column is rotatably connected to a fixing lock, the bottom end of the fixing lock is buckled and connected to an adjustable bracket, the bottom end of the green screen is detachably connected to a base, and one side of the base is provided with a servo motor. Servo motor one, a conveyor belt is arranged on the side of the servo motor one close to the green screen, the output end of the servo motor one is fixedly connected to the rotating shaft of the conveyor belt, a rotating column is rotatably connected to the middle upper part of the base, a servo motor two is arranged on one side of the rotating column, a three-axis conveyor belt is arranged on one side of the servo motor two, the output end of the servo motor two is fixedly connected to the rotating shaft of the three-axis conveyor belt, the blue curtain is buckled and connected to the outside of the conveyor belt and the three-axis conveyor belt, the green curtain is used to block the complex color background of the live broadcast room and change the background of the live broadcast room to green, and the blue curtain is used to block the green background of the green curtain.

[0011] A preferred technical solution is that the conveyor belt and the three-axis conveyor belt are green in color, the conveyor belt uses the connecting column as the guide axis, the three-axis conveyor belt uses the rotating column and the connecting column as the guide axis, and the distance between the conveyor belt and the three-axis conveyor belt and the green screen is small.

[0012] A preferred technical solution is that the operating console is provided with a microphone for converting sound signals in the live broadcast room into electrical signals, and the operating console is provided with operation buttons for quickly controlling the virtual scene of the live broadcast room and the lens effects of the pan-tilt camera, and the operation buttons enable the anchor to flexibly adjust the viewing angle and background during the live broadcast.

[0013] A preferred technical solution is that the live broadcast processing device includes a computer and a display, the computer includes a memory and a processor, the memory stores a computer program, and the processor is used to execute the computer program.

[0014] A preferred technical solution, the computer program includes: An audio and video acquisition module, which is used to collect original images and sound data in the live studio, mainly through a pan-tilt camera and a microphone; An audio and video processing module, which is used to process the original audio and video data to obtain usable audio and video data, wherein the audio and video processing includes echo cancellation, noise suppression, beautification, adding watermarks, etc.; An image recognition module, which is used to recognize images in the video and to select and mark specific images; A virtual image construction module, wherein the virtual image construction module is used to design and construct a virtual image, and perform 3D visual effect optimization processing on the virtual image; An image synthesis module, which is used to replace the marked image with a virtual image and perform image transition processing such as fading, stretching and filling the edge of the virtual image; The audio and video encoding module is used to encode the original digital video data. The audio and video encoding is mainly used to solve the problem of large amount of original video data. A streaming module, which is used to push video content to a network server. The network server is generally built by a live broadcast platform. A streaming module, which is used to obtain audio and video data from a network server; An audio and video decoding module, which is used to decode the encoded audio and video, because the encoded audio and video cannot be directly presented; An audio and video playback module, which is used to present the decoded video on a display and monitor the live broadcast screen in real time; A remote interaction module, the remote interaction module is used to obtain control instructions from a network server and convert the control instructions into corresponding electrical signals, the electrical signals are used to control the pan-tilt camera, servo motor one and servo motor two, and the control instructions correspond to the audience interaction data received by the network server.

[0015] The effect generation module is used to generate visual and auditory special effects of virtual image movement to enhance the authenticity of the virtual image.

[0016] In a preferred technical solution, the image recognition module is provided with a submodule for recognizing a green image of a green screen and a blue image of a blue screen.

[0017] According to a preferred technical solution, the servo motor 1 and the servo motor 2 are provided with a motor controller for receiving electrical signals.

[0018] A preferred technical solution is that fill lights for reducing shadows are arranged on both sides of the green screen and the blue screen, and the fill lights can make the surface colors of the green screen and the blue screen smoother.

[0019] Compared with the prior art, the present invention has the following beneficial effects: The present invention uses a blue screen to move on a green screen, and uses a live broadcast processing device to replace the patterns of the blue screen and the green screen, and uses common live broadcast equipment to achieve a low-cost virtual scene interactive effect. At the same time, by making targeted adjustments to the shape and size of the blue screen, the image processing pressure of the live broadcast processing equipment is reduced, and the process of virtual scene interactive live broadcast is further simplified; and by setting an interactive cooling time and adding a blue screen, the audience has a certain degree of confusion when interacting, which greatly increases the number of people who can interact simultaneously in the live broadcast room. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 It is a schematic diagram of the live broadcast process of the present invention.

[0021] Figure 2 It is a schematic diagram of the interactive process of the present invention.

[0022] Figure 3 It is a schematic diagram of the main structure of the present invention.

[0023] Figure 4 It is a rear view schematic diagram of the green screen of the present invention.

[0024] Figure 5 It is a schematic diagram of a conveyor belt of the present invention.

[0025] In the figure: 1. Green screen; 2. Blue screen; 3. Operating table; 4. PTZ camera; 11. Connecting column; 12. Fixing lock; 13. Adjustable bracket; 14. Base; 21. Conveyor belt; 22. Servo motor 1; 23. Three-axis conveyor belt; 24. Rotating column; 25. Servo motor 2. DETAILED DESCRIPTION

[0026] The following embodiments of the present invention are described in further detail in conjunction with the accompanying drawings and examples. The following examples are used to illustrate the present invention, but are not intended to limit the scope of the present invention.

[0027] like Figure 1-5As shown, the present invention provides an interactive live broadcast room for interacting with a virtual scene, comprising: a green screen 1, a blue screen 2, an operating table 3, a pan-tilt camera 4 and a live broadcast processing device, wherein the pan-tilt camera 4 is mounted on the ground, the live broadcast processing device is arranged on the side of the pan-tilt camera 4 and is electrically connected to the pan-tilt camera 4, the operating table 3 is arranged in front of the pan-tilt camera 4, the green screen 1 is arranged on a side of the operating table 3 away from the pan-tilt camera 4, the top of the green screen 1 is detachably connected to a connecting column 11, the side of the connecting column 11 is rotatably connected to a fixing lock 12, the bottom end of the fixing lock 12 is buckled and connected to an adjustable bracket 13, the bottom end of the green screen 1 is detachably connected to a base 14, one side of the base 14 is provided with a servo motor 22, the A conveyor belt 21 is provided on the side of the servo motor 22 close to the green screen 1, and the output end of the servo motor 22 is fixedly connected to the rotating shaft of the conveyor belt 21. A rotating column 24 is rotatably connected to the middle upper part of the base 14, and a servo motor 25 is provided on one side of the rotating column 24. A three-axis conveyor belt 23 is provided on one side of the servo motor 25, and the output end of the servo motor 25 is fixedly connected to the rotating shaft of the three-axis conveyor belt 23. The blue screen 2 is snap-connected to the outside of the conveyor belt 21 and the three-axis conveyor belt 23. The green screen 1 is used to block the complex color background of the live broadcast room and change the background of the live broadcast room to green. The blue screen 2 is used to block the green background of the green screen 1 and divide a blue area on the green background.

[0028] As an embodiment of the present invention, the conveyor belt 21 and the three-axis conveyor belt 23 are green in color, the conveyor belt 21 uses the connecting column 11 as a guide axis, and the three-axis conveyor belt 23 uses the rotating column 24 and the connecting column 11 as guide axes. The distance between the conveyor belt 21 and the three-axis conveyor belt 23 and the green screen 1 is small, so that the color on the green screen 1 is as smooth as possible.

[0029] As an embodiment of the present invention, the operating console 3 is provided with a microphone for converting sound signals in the live broadcast room into electrical signals, and the operating console 3 is provided with operation buttons for quickly controlling the virtual scene of the live broadcast room and the lens effects of the pan-tilt camera 4. The operation buttons enable the anchor to flexibly adjust the viewing angle and background during the live broadcast, thereby enhancing the viewing experience of the live broadcast.

[0030] As an embodiment of the present invention, the live broadcast processing device includes a computer and a display, the computer includes a memory and a processor, the memory stores a computer program, and the processor is used to execute the computer program.

[0031] As an embodiment of the present invention, the computer program includes: An audio and video acquisition module, which is used to collect original images and sound data in the live studio, mainly through a pan-tilt camera 4 and a microphone; An audio and video processing module, which is used to process the original audio and video data to obtain usable audio and video data, wherein the audio and video processing includes echo cancellation, noise suppression, beautification, adding watermarks, etc.; An image recognition module, which is used to recognize images in the video and to select and mark specific images; A virtual image construction module, wherein the virtual image construction module is used to design and construct a virtual image, and perform 3D visual effect optimization processing on the virtual image; An image synthesis module, which is used to replace the marked image with a virtual image and perform image transition processing such as fading, stretching and filling the edge of the virtual image; The audio and video encoding module is used to encode the original digital video data. The audio and video encoding is mainly used to solve the problem of large amount of original video data. A streaming module, which is used to push video content to a network server. The network server is generally built by a live broadcast platform. A streaming module, which is used to obtain audio and video data from a network server; An audio and video decoding module, which is used to decode the encoded audio and video, because the encoded audio and video cannot be directly presented; An audio and video playback module, which is used to present the decoded video on a display and monitor the live broadcast screen in real time; The remote interaction module is used to obtain control instructions from the network server and convert the control instructions into corresponding electrical signals. The electrical signals are used to control the pan-tilt camera 4, servo motor 1 22 and servo motor 2 25. The control instructions correspond to the audience interaction data received by the network server.

[0032] The effect generation module is used to generate visual and auditory special effects of virtual image movement to enhance the authenticity of the virtual image.

[0033] As an implementation manner of the present invention, the image recognition module is provided with a submodule for recognizing the green image of the green screen 1 and the blue image of the blue screen 2 .

[0034] As an embodiment of the present invention, the servo motor 1 22 and the servo motor 2 25 are provided with a motor controller for receiving electrical signals.

[0035] As an implementation manner of the present invention, fill lights for reducing shadows are arranged on both sides of the green screen 1 and the blue screen 2, and the fill lights can make the surface colors of the green screen 1 and the blue screen 2 smoother.

[0036] Specific working principle: Taking the starry sky as the virtual scene of the present invention and the Kongming lantern as the virtual interactive prop of the present invention as an example, the shape and size of the Kongming lantern are designed before the live broadcast starts, and the relevant motion effects of the Kongming lantern are designed. At the same time, the shape and size of the blue screen 2 are adjusted according to the shape and size of the Kongming lantern.

[0037] First, the pan-tilt camera 4 is used to collect video data, and then the green pattern of the green screen 1 is removed using the live broadcast processing equipment. Then, a starry sky pattern is designed according to the size of the blank area after removal, and then the starry sky pattern is filled into the blank area of ​​the video; then, the 3D visual effect of the starry sky pattern is optimized, and the edge of the starry sky pattern is transitionally processed to make the starry sky pattern appear more realistic in the video.

[0038] Similarly, use the live broadcast processing equipment to remove the blue pattern of the blue curtain 2, and fill the designed Kongming lantern pattern into the blank area of ​​the video, so that the starry sky background and Kongming lantern props can be realized in the live broadcast room.

[0039] When the audience watches the live broadcast through the network live broadcast platform, the network live broadcast platform provides the audience with an interactive button; when the audience presses the interactive button, the network live broadcast platform uploads the audience's interactive data to the network server in real time, and the network server generates a control instruction; then the live broadcast processing device obtains the control instruction from the network server, converts the control instruction into an electrical signal and sends it out, so that the servo motor 1 22 and the servo motor 2 25 start working after receiving the signal, driving the conveyor belt 21 and the three-axis conveyor belt 23 to rotate, so that the blue screen 2 moves upward along the green screen 1 until the blue screen 2 moves from the top of the green screen 1 to the back of the green screen 1; during this process, the live broadcast processing device still maintains the image conversion of the green screen 1 and the blue screen 2, and replaces the image of the blue screen 2 with a moving Kongming lantern pattern, and at the same time, the live broadcast processing device plays the movement sound effect of the Kongming lantern to achieve the effect of releasing the Kongming lantern.

[0040] At the same time, since there is a certain delay between the audience pressing the interactive button and the live broadcast processing device receiving the control command, the audience cannot clearly observe whether a certain Kongming lantern is released by themselves. Therefore, by setting the cooling time of the interactive button and centrally processing the control command, and the online live broadcast platform providing a guiding screen, when a large number of viewers press the interactive button at the same time, they all think that a certain Kongming lantern is released by themselves, and at the same time avoid the continuous release of Kongming lanterns so that the blue screen 2 has no time to move back and forth; similarly, when there are a large number of people interacting, the number of blue screens 2 can be increased so that more Kongming lanterns can be released at the same time, thereby improving the audience's interactive experience.

[0041] Compared with the prior art which can only provide high-cost interactive services to a small number of viewers, the present invention realizes low-cost virtual scene interactive effects by using a blue screen 2 to move on a green screen 1 and using a live broadcast processing device to replace the patterns of the blue screen 2 and the green screen 1, and uses common live broadcast equipment. At the same time, by making targeted adjustments to the shape and size of the blue screen 2, the image processing pressure of the live broadcast processing equipment is reduced, and the process of virtual scene interactive live broadcast is further simplified; and by setting an interactive cooling time and adding a blue screen 2, there is a certain degree of confusion when the audience interacts, which greatly increases the number of people who can interact simultaneously in the live broadcast room.

[0042] The embodiments of the present invention are provided for the purpose of illustration and description. Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations of the present invention. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present invention.

Claims

1. An interactive live broadcast room that interacts with a virtual scene, characterized in that: include: A green screen (1), a blue screen (2), an operating table (3), a pan-tilt camera (4) and a live broadcast processing device, wherein the pan-tilt camera (4) is mounted on the ground, the live broadcast processing device is arranged on the side of the pan-tilt camera (4) and is electrically connected to the pan-tilt camera (4), the operating table (3) is arranged in front of the pan-tilt camera (4), the green screen (1) is arranged on a side of the operating table (3) away from the pan-tilt camera (4), the top of the green screen (1) is detachably connected to a connecting column (11), the side of the connecting column (11) is rotatably connected to a fixing lock (12), the bottom end of the fixing lock (12) is buckled and connected to an adjustable bracket (13), and the bottom end of the green screen (1) is detachably connected to a base ( 14), a servo motor 1 (22) is arranged on one side of the base (14), a conveyor belt (21) is arranged on the side of the servo motor 1 (22) close to the green screen (1), an output end of the servo motor 1 (22) is fixedly connected to the rotating shaft of the conveyor belt (21), a rotating column (24) is rotatably connected to the middle upper part of the base (14), a servo motor 2 (25) is arranged on one side of the rotating column (24), a three-axis conveyor belt (23) is arranged on one side of the servo motor 2 (25), an output end of the servo motor 2 (25) is fixedly connected to the rotating shaft of the three-axis conveyor belt (23), and the blue screen (2) is buckled and connected to the outer sides of the conveyor belt (21) and the three-axis conveyor belt (23).

2. An interactive live broadcast room that interacts with a virtual scene as claimed in claim 1, characterized in that: The conveyor belt (21) and the three-axis conveyor belt (23) are green in color; the conveyor belt (21) uses the connecting column (11) as a guide axis; and the three-axis conveyor belt (23) uses the rotating column (24) and the connecting column (11) as guide axes.

3. An interactive live broadcast room that interacts with a virtual scene as claimed in claim 1, characterized in that: The operating console (3) is provided with a microphone for converting sound signals in the live broadcast room into electrical signals, and the operating console (3) is provided with operating buttons for quickly controlling the virtual scene in the live broadcast room and the lens effects of the pan / tilt camera (4).

4. An interactive live broadcast room for interacting with a virtual scene as claimed in claim 1, characterized in that: The live broadcast processing device includes a computer and a display, the computer includes a memory and a processor, and the memory stores a computer program.

5. An interactive live broadcast room that interacts with a virtual scene as claimed in claim 4, characterized in that: The computer program comprises: An audio and video acquisition module, which is used to collect original images and sound data in the live broadcast room; An audio and video processing module, which is used to process the original audio and video data to obtain usable audio and video data; An image recognition module, which is used to recognize images in the video and to select and mark specific images; A virtual image construction module, wherein the virtual image construction module is used to design and construct a virtual image, and perform 3D visual effect optimization processing on the virtual image; An image synthesis module, which is used to replace the marked image with a virtual image and perform image transition processing such as fading, stretching and filling the edge of the virtual image; The audio and video encoding module is used to encode the original digital video data; A streaming module, which is used to push video content to a network server; A streaming module, which is used to obtain audio and video data from a network server; An audio and video decoding module, wherein the audio and video decoding module is used to decode the encoded audio and video; An audio and video playback module, which is used to present the decoded video on a display; A remote interaction module, which is used to obtain control instructions from a network server and convert the control instructions into corresponding electrical signals; The effect generation module is used to generate visual and auditory special effects of virtual image movement to enhance the authenticity of the virtual image.

6. An interactive live broadcast room that interacts with a virtual scene as claimed in claim 5, characterized in that: The image recognition module is provided with a submodule for recognizing a green image of a green screen (1) and a blue image of a blue screen (2).

7. An interactive live broadcast room for interacting with a virtual scene as claimed in claim 1, characterized in that: The servo motor 1 (22) and the servo motor 2 (25) are provided with a motor controller for receiving an electrical signal.

8. An interactive live broadcast room for interacting with a virtual scene as claimed in claim 1, characterized in that: Filling lights for reducing shadows are arranged on both sides of the green screen (1) and the blue screen (2).

Images