A real-time virtual scene LED shooting system and method

Abstract

The invention discloses a real-time virtual scene LED shooting system and method, belonging to the field of film and television shooting. According to the content that needs to be presented in the shooting scene, the present invention calls digital assets to construct a virtual scene, reconstructs a virtual LED screen and a virtual camera in the virtual engine module, collects the real environment lighting information in the studio and synchronizes it to the virtual engine in real time, through The virtual engine module performs distributed real-time rendering of the virtual scene and presents it on the virtual LED screen; the virtual engine also superimposes the picture with the depth channel rendered by the virtual engine in real time based on the real-time camera position and lens distortion information outside the virtual LED screen, and the physical LED The screen displays a virtual LED screen, the real-time camera completes the shooting, the XR module acquires the picture with the depth channel and the picture taken by the real-time camera, and synthesizes the final picture. The invention can replace the green screen matting to achieve the effect of direct filming in most environments, optimizes the production process, and saves the cost of complicated visual special effects.

Description

technical field [0001] The invention belongs to the field of film and television drama shooting, and in particular relates to a real-time virtual scene LED shooting system and method. Background technique [0002] At present, the production process of many film and television dramas is extremely complicated, and the production schedule is highly compact, and there are many uncertain links. This process is often linear, challenging and costly with uneven distribution of resources in the process of continuously improving to achieve the desired outcome. During the on-site shooting, due to visual fragmentation, all the professional knowledge related to film and television drama production of the main creators may not be fully utilized. [0003] In the traditional green screen virtual shooting process, the digital assets produced by artists neither have the best image quality nor real-time plasticity. Costly. The existing virtual shooting technology has the disadvantages of po...

AI Technical Summary

Problems solved by technology

[0002] At present, the production process of many film and television dramas is extremely complicated, and the production schedule is highly compact, and there are many uncertain links

The process is often linear, challenging and costly with uneven distribution of resources in the process of continuously improving to achieve the desired outcome

During the on-site shooting, due to visual fragmentation, all the professional knowledge related to film and television drama production of the creators may not be fully utilized

[0003] In the traditional green screen virtual shooting process, the digital assets produced by artists neither have the best image quality nor real-time plasticity. high cost

The existing virtual shooting technology has the disadvantages of poor green screen keying effect, mismatched lighting, and high picture delay

Images