A method and terminal for a virtual implanted object to shuttle in a real scene

Abstract

The embodiment of the invention discloses a method for virtual implantation object shuttle in a real scene and a terminal. The method comprises: extracting the information of each real scene object from each frame depth image obtained by a depth sensor, wherein the information of each real scene includes the position and the size of the contour in a depth sensor coordinate system; extracting the image of each real scene object in the corresponding color image obtained the depth sensor; converting the depth sensor coordinate system to the virtual depth sensor coordinate system in the virtual scene, generating a mask the same as each real scene object contour at the corresponding position of the virtual scene, and performing mapping of the mask according to the extracted image of each real scene object; and projecting the virtual scene and then covering the virtual scene to a synchronous real image. The method for virtual implantation object shuttle in the real scene and the terminal can realize that the virtual implantation object shuttle the real scene object back and forth in the real scene according to the real scene object depth value without any goof phenomenon.

Description

technical field [0001] The invention relates to the field of virtual technology, in particular to a method and a terminal for a virtual implanted object to shuttle in a real scene. Background technique [0002] At present, in the application of the virtual implant system, for various real-scene stages, studios, etc., various real-scene objects such as hosts, guests, real props, etc. can only be mapped to one layer of video after being shot by the camera. All kinds of 3D virtual implants, 3D special effects, etc. can only be placed in front or side of the real object (video), but cannot shuttle in the real object (for example, the moving 3D virtual implant should be blocked behind the host. , in front of the host, should be displayed), which brings great restrictions to program recording, and it is difficult to realize the real interaction and seamless integration of virtual implanted objects and scenes such as live studios. Contents of the invention [0003] The invention...

AI Technical Summary

Problems solved by technology

[0002] At present, in the application of the virtual implant system, for various real-scene stages, studios, etc., various real-scene objects such as hosts, guests, real props, etc., can only be mapped to one layer of video after being photographed by cameras. Therefore, replanting All kinds of 3D virtual implants and 3D special effects can only be placed in front or side of the real object (video), but cannot shuttle in the real object (for example, the moving 3D virtual implant should be blocked behind the host. , in front of the host, should be displayed), which brings great restrictions to program recording, and it is difficult to realize the real interaction and seamless integration of virtual implanted objects and live studio scenes

Images