Video live broadcast method for realizing real-time playing of virtual animation video on clothes of live anchor

Through the combination of green screen scenes and video acquisition equipment, the integration of virtual background and character pictures is achieved, the problem of monotonous anchor clothes is solved, real-time playback of virtual animation videos is realized, and the visual effect and viewability of live broadcasts are improved.

CN118972635AInactive Publication Date: 2024-11-15王建国
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411258760.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-09
Publication Date
2024-11-15
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The anchor's clothes appear monotonous and boring in live broadcasts, lacking viewability, and the existing technology is difficult to realize real-time transformation of virtual animation videos, affecting the visual effect of live broadcasts.

Method used

Through green screen scenes, video acquisition devices and computer programs, the virtual background and character pictures are integrated, and the video processor in the virtual scene is used to process the streaming media data, generate a new virtual background, and live broadcast the anchor's clothes in real time.

Benefits of technology

Realize the real-time playback of virtual animation videos of anchor clothes, enhance the viewability and visual effects of live broadcasts, without changing clothes or post-hand processing, and is suitable for live broadcasts and filming.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118972635A_ABST
    Figure CN118972635A_ABST
Patent Text Reader

Abstract

The invention discloses a live video method for realizing real-time playing of a virtual animation video on clothes of a real anchor, and belongs to the field of video image processing technology and video playing. The method comprises the following steps: arranging a video acquisition device (camera) in front of a real person for acquiring a portrait picture, arranging a green screen behind the real person, and connecting the video acquisition device with a computer 1 and then a computer 2; a video acquisition device (camera) acquires a figure picture, and takes the picture or video as a background to perform virtual-real fusion with the figure picture to form streaming media data; and performing secondary processing on the media data, taking the clothes of the anchor as a virtual background, performing virtual-real fusion on the virtual background and a video fused by a figure and a green screen virtual background again to generate new streaming media data, and sending the new streaming media data to a corresponding video server so as to implement video live broadcast. According to the method, the real-time conversion of videos and animations on the clothes of the live broadcast can be seen in real time without manual and post-processing, and the method can also be applied to film and television shooting, so that the quality of the live broadcast and the watching effect and experience are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of video image processing technology and video playback, and in particular to the aspect of implementing real-time live broadcast and playback of virtual animation videos on the clothing of real anchors (or actors). Background Art

[0002] With the continuous advancement of Internet technology and the growth of user demand, live streaming has become a common form of entertainment and has appeared in people's daily lives. In live streaming, virtual background is a common and common form of scene expression. It allows the anchor to create various virtual scenes and atmospheres without changing the real environment, realize the fusion of background and foreground layers, generate video streams, and enhance the visual effects and viewing experience of live streaming.

[0003] However, the host's clothes, as an important part of the foreground, appear monotonous, dull, and lack watchability. Summary of the invention

[0004] The technical problem to be solved by the present invention is to provide a method for watching the host's clothes changing in real time in a virtual animation video during a live broadcast, thereby providing a better live broadcast viewing effect and overcoming the shortcomings of the prior art.

[0005] The present invention achieves the above-mentioned purpose through the following technical scheme, and implements a live broadcast method for real-time playback of virtual animation video on the clothes of a real anchor. The method comprises the following steps:

[0006] In the first aspect, the equipment required by the present invention includes a green screen scene, a video acquisition device (camera), and computers 1 and 2 to realize the live broadcast of the virtual scene.

[0007] The green screen scene is a green background curtain commonly used in filming. The host or actor can perform in front of the green screen and be filmed by a video acquisition device (camera). After the green background is removed from the screen, other backgrounds can be replaced.

[0008] Computer 1 and computer 2 are both equipped with a memory, a processor, and a computer program for processing the above-mentioned related video data in the memory, and the program includes Unreal Engine, a background service system, and other existing image processing software.

[0009] Secondly, the orientation setting is to set a video acquisition device (camera) in front of the real person to capture the portrait image, and set a green screen behind the real person. The video acquisition device is connected to computer 1 and then to computer 2.

[0010] Thirdly, the video acquisition device (camera) captures the image of the person, and uses the prepared picture or video as the background to merge the virtual and real images with the image of the person.

[0011] Preferably, the collected human image is matted with a green screen, and the matting effect is adjusted to achieve virtual and real fusion of the background and the human, so as to increase the visual effect of the image.

[0012] Preferably, the portrait image is displayed in a virtual scene, and the portrait image and the virtual scene are generated as streaming media data with the background removed; and the streaming media data is sent to a video processor.

[0013] The streaming media data of

[0012] is processed twice, that is, the clothes of the anchor are processed, and the clothes are used as a virtual background in a similar way to background removal. The prepared pictures or videos are used as the virtual background of the character's clothes and are integrated with the character and the green screen virtual background to generate new streaming media data, which is sent to the corresponding video server for live broadcast.

[0014] Preferably, the method for displaying the portrait image in the virtual scene is: establishing a transparent play window in the virtual scene, setting the play window to be connected to the video server, so that the play window receives the streaming media data.

[0015] Send the processed video streaming data connection to the video server.

[0016] Live broadcast or playback through video server.

[0017] To summarize the fourth aspect, the present invention has a wide range of applications. It does not require actual clothing changes or manual beautification processing at a later stage, and can realize a live broadcast method for real-time playback of virtual animation videos on the clothes of real anchors. The method can not only be implemented in live broadcasts, but also can be used in video processing demand scenarios such as film and television shooting. Compared with the prior art, it is better that: the front virtual background (the host's clothes) and the rear virtual background appear at the same time, which solves the problem of realizing real-time live broadcast of virtual animation videos on the clothes of the above-mentioned real anchors (or actors), and proposes a display method that not only projects real people into virtual scenes, but also realizes real-time live broadcast of virtual animation videos on the clothes of real anchors (or actors) to show better watchability and display effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 This is an overall flow chart of the present invention: "A live broadcast method for realizing real-time broadcast of virtual animation video on clothes of a real anchor".

[0019] Figure 2 This is a schematic diagram of the distribution of green cloth, real people, video acquisition equipment and computers of the present invention: "A live broadcast method for realizing real-time broadcast of virtual animation video on the clothes of a real anchor".

[0020] Figure 3This is a schematic diagram of the display system composition of the present invention: "A live broadcast method for realizing real-time broadcast of virtual animation video on clothes of a real anchor". DETAILED DESCRIPTION

[0021] The following will be combined with the accompanying drawings of the invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0022] Example 1 Figure 1 As shown, a live broadcast method for realizing real-time broadcast of virtual animation video on clothes of a real anchor, the method comprises the following steps: Step S1, a video acquisition device (camera) acquires a person's image. Step S2: Use the prepared picture or video as a virtual background to merge the virtual and real with the character picture. Display the portrait picture in the virtual scene, and the portrait picture is the streaming media data with the background removed. Specifically: Step S21: When collecting the portrait picture, set a green screen, and the real person performs actions in front of the green screen. The video acquisition device (camera) shoots the video in front of the real person, and the green screen is used to remove the background, so that the video content only contains the real person image in front of the green screen; Step S22, the method for displaying the portrait image in the virtual scene is: establishing a play window with a transparent frame in the virtual scene; Step S23: The transparent framed playback window is integrated with the pre-made picture or video as a virtual background and character image to generate streaming media data.

[0023] In step S1, the camera is a matte camera or a camera with a built-in matte program. The matte camera or the camera with a built-in matte program can be used with a green screen to easily remove the background pattern of real people in the video, which is convenient for direct use by the video server. The matte algorithm is a relatively mature technology in the existing image algorithms. Of course, there are many ways to remove the background, and the principles will not be repeated here.

[0024] Step S3, reprocess the streaming media data generated in step S2, that is, process the host's clothes, use the clothes as a virtual background similar to the background removal method, and use the prepared pictures or videos as the virtual background of the character's clothes to integrate the virtual and real aspects with the character and the green screen virtual background (the steps are similar to step S2 and will not be elaborated on here), generate new streaming media data, and send it to the corresponding video server to implement live broadcast.

[0025] Example 2 Figure 3As shown, a system for realizing real-time playback of virtual animation videos on clothes of real anchors includes: a video acquisition system, a computer (and video server) 1, and a computer (and video server) 2. The portrait image is captured by the video acquisition system (camera), and the captured portrait image is displayed in a virtual scene in the computer (and video server) 1. The method for displaying the portrait image in the virtual scene is: a playback window with a transparent border is established in the virtual scene, the playback window is connected to the video server, and streaming media data is received in the playback window; the streaming media data processed in the computer (and video server) 1 is sent to the computer (and video server) 2, and the clothes of the anchor are processed in the same way, which has been mentioned before and will not be elaborated here.

[0026] Embodiment 2 is essentially the same as Embodiment 1, so the specific working principles of each unit will not be described in detail.

[0027] It is obvious to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the present invention can be implemented in other specific forms without departing from the spirit or essential features of the present invention. Therefore, from any point of view, the embodiments should be regarded as exemplary and non-restrictive, and the scope of the present invention is defined by the appended claims rather than the above description, and it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims are included in the present invention. In addition, it should be understood that although this specification is described in accordance with the implementation methods, not each implementation method contains only one independent technical solution. This narrative method of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole, and the technical solutions in each embodiment can also be appropriately combined to form other implementation methods that can be understood by those skilled in the art.

Claims

1. A video live broadcast method for realizing real-time playback of virtual animation videos on the clothes of a real anchor, characterized in that: The method includes: A video acquisition device (camera) is set in front of the real person to capture the portrait image, and a green screen is set behind the real person. The video acquisition device is connected to computer 1 and then to computer 2. The video acquisition device (camera) captures the character image, and the prepared picture or video is used as a virtual background to merge the virtual and real with the character image, that is, the character image is displayed in a virtual scene, and the character image is the streaming media data with the background removed. The clothes on the anchor are used as a virtual background, and the streaming media data formed by the character and the green screen virtual background are merged for the second time to generate new streaming media data, which is sent to the corresponding video server, and then the video live broadcast is implemented.

2. The video live broadcast method for realizing real-time playback of virtual animation video on the clothes of a real anchor according to claim 1, characterized in that: The method for displaying the character image in the virtual scene is: performing green screen matting on the collected character image, and adjusting the matting effect to achieve virtual and real fusion of the virtual background and the character.

3. The video live broadcast method for realizing real-time playback of virtual animation video on the clothes of a real anchor according to claim 1, characterized in that: The camera is a matte camera or a camera with a built-in matte program, a matte camera or a camera with a built-in matte program.

4. The video live broadcast method for realizing real-time playback of virtual animation video on clothes of a real anchor according to claim 1, characterized in that: A transparent play window is established in the virtual scene, and the play window is connected to the video server so that the play window receives the streaming media data.

5. The video live broadcast method for realizing real-time playback of virtual animation video on the clothes of a real anchor according to claim 1, characterized in that: A transparent playback window is established in the virtual scene, and the playback window is connected to the video server so that the streaming media data received by the playback window is processed twice. The clothes on the host are used as the virtual background in a similar way to background removal. The prepared pictures or videos are used as the virtual background of the character's clothes and the streaming media data video of the character and the green screen virtual background are merged twice to generate new streaming media data, which is sent to the corresponding video server for live broadcast.

6. The video live broadcast method for realizing real-time playback of virtual animation video on clothes of a real anchor according to claim 1, characterized in that: To realize claims 1-9, a green screen must be used as a virtual background and then a secondary virtual background fusion must be performed.

7. A video live broadcast method for realizing real-time playback of virtual animation videos on the clothes of a real anchor. The system comprises: Video acquisition system, computer (and video server) 1, computer (and video server) 2.

8. The video live broadcast method system for realizing real-time playback of virtual animation video on the clothes of a real anchor according to claim 6 is characterized in that: The portrait image is captured by a video capture system (camera), and the captured portrait image is displayed in a virtual scene in a computer (and video server) 1.

9. The video live broadcast method system for realizing real-time playback of virtual animation video on the clothes of a real anchor according to claim 6 is characterized in that: The method for displaying a portrait image in a virtual scene is as follows: establishing a play window with a transparent frame in the virtual scene, setting the play window to be connected to a video server, and receiving streaming media data in the play window.

10. The video live broadcast method system for realizing real-time playback of virtual animation video on the clothes of a real anchor according to claim 6, characterized in that: The processed streaming media data in computer (and video server) 1 is sent to computer (and video server) 2, the clothes on the anchor are used as the virtual background, and the prepared pictures or videos are used as the virtual background of the character's clothes to merge the streaming media data video of the character and the green screen virtual background to generate new streaming media data.

11. A storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor, a video live broadcast method for realizing real-time playback of a virtual animation video on clothes of a real anchor as described in any one of claims 1-9 is implemented.

Citation Information

Patent Citations

  • Visual special effect processing method and device, storage medium and terminal

    CN110298327A

  • Video processing model state adjusting method and device, electronic equipment and storage medium

    CN111954075A

  • Image processing method and device, storage medium and computer system

    CN113920167A

  • Video virtual dressing and background processing method and device based on IOS system

    CN115119054A

  • Display method and system for projecting real person to virtual scene, and storage medium

    CN118210381A