An image rendering and synthesis system for virtual production

Abstract

An image rendering and synthesis system for virtual production includes an LED box, a main shooting device, a dynamic positioning shooting device, a virtual object control server, a rendering server and a synthesis server. A group of dynamic positioning shooting devices is added to the virtual production equipment to synchronously shoot a group of positioning video data from a different perspective from the main shooting device. This group of positioning video data is specifically used to more accurately determine the spatial position of the physical object in conjunction with the main video data, so that when the virtual object is inserted in the later rendering, more spatial position information can be obtained to ensure that the spatial position relationship between the inserted virtual object and the physical object is more accurate.

Description

Technical Field

[0001] The present application relates to the field of virtual production, and in particular to an image rendering and synthesis system for virtual production. Background Art

[0002] With the development of film production technology, more and more movie special effects content is synthesized into real-life shooting videos by post-production image rendering. In particular, the current live broadcast industry has become an emerging business model. More and more business entities use professional or non-professional live broadcast rooms to conduct real-time shooting, and at the same time output videos with virtual scenes, virtual objects, virtual special effects and other content. Virtual live broadcasting requires real-time performance, and the real-time video content needs to be processed. For example, inserting virtual objects into images is a common processing method. However, when inserting virtual objects, there are often errors in the spatial position relationship between virtual objects and physical objects. For example, a virtual object that should be blocked by a physical object appears in front of the physical object. This makes the final output image unrealistic, and the traces of post-processing are very obvious. Summary of the invention

[0003] The present application provides an image rendering and synthesis system for virtual production, which solves the problem of incorrect spatial position relationship between physical objects and virtual objects in images output by virtual production in the prior art.

[0004] The present application provides an image rendering and synthesis system for virtual production, comprising:

[0005] An LED box including an LED screen for displaying a virtual image;

[0006] A main shooting device, used for tracking and shooting a physical object to output main video data of the physical object;

[0007] A dynamic positioning shooting device, which can be moved on the side where all the LED screens of the LED box are located, and has a different shooting angle of view for the physical object than the main shooting device; the dynamic positioning shooting device is used to output positioning video data of the physical object with a shooting angle different from that of the main shooting device;

[0008] A virtual object control server, the virtual object control server comprising a virtual object asset library; the virtual object control server is used to determine a virtual object to be inserted from the virtual object asset library based on an operation instruction of a user;

[0009] A rendering server, configured to determine position data of a virtual camera according to position data of a physical camera in the main shooting device;

[0010] The rendering server is further used to determine the spatial position information of the entity object according to the positioning video data and the main video data, and render virtual image data according to the spatial position information and the position data of the virtual camera; the virtual image data is fused with the virtual object;

[0011] The synthesis server is used to obtain the main video data and the virtual image data integrated with the virtual object, and synthesize the two to output the synthesized image data for display.

[0012] In one embodiment, the virtual object control server is also used to obtain an instruction input by a user indicating whether to refer to the positioning video data provided by the dynamic positioning shooting device to insert the virtual object; the rendering server is used to determine the spatial position information of the physical object according to the positioning video data and the main video data when it is determined that the instruction indicates that it is necessary to refer to the positioning video data provided by the dynamic positioning shooting device to insert the virtual object, and render the virtual image data according to the spatial position information and the position data of the virtual camera; otherwise, the rendering server is used to render the virtual image data according to the position data of the virtual camera.

[0013] In one embodiment, the virtual object asset library includes feature information of each virtual object; the rendering server is further used to render virtual image data according to the spatial position information, the position data of the virtual camera and the feature information of the virtual object.

[0014] In one embodiment, the LED box includes a ground curtain, a left curtain, a right curtain and a background curtain, and the dynamic positioning shooting device includes a track arranged along the top edge of the left curtain, the right curtain and the background curtain, and the camera of the dynamic positioning shooting device can move along the track to obtain the positioning video data from different perspectives.

[0015] In one embodiment, the rendering server is used to determine the spatial position information of the physical object according to the positioning video data and the main video data; including:

[0016] The rendering server is used to determine the coordinate data of the entity object relative to the first three-dimensional coordinate system according to the positioning video data, and determine the coordinate data of the entity object relative to the second three-dimensional coordinate system according to the main video data;

[0017] The rendering server is further used to determine the spatial position information of the entity object according to the coordinate data of the entity object relative to the first three-dimensional coordinate system and the coordinate data of the entity object relative to the second three-dimensional coordinate system;

[0018] The origins of the first three-dimensional coordinate system and the second three-dimensional coordinate system are different, the first three-dimensional coordinate system is predefined based on the position of the dynamic positioning shooting device, and the second three-dimensional coordinate system is predefined based on the position of the main shooting device.

[0019] In one embodiment, the first three-dimensional coordinate system includes a first three-dimensional sub-coordinate system, a second three-dimensional sub-coordinate system, and a third three-dimensional sub-coordinate system whose origins are located on the planes where the left curtain, the right curtain, and the background curtain are located respectively;

[0020] The rendering server is used to determine the coordinate data of the entity object relative to the first three-dimensional coordinate system according to the positioning video data, including:

[0021] The rendering server is used to determine the coordinate data of the entity object relative to the first sub-three-dimensional coordinate system, the second sub-three-dimensional coordinate system, and the third sub-three-dimensional coordinate system respectively according to the positioning video data.

[0022] In one embodiment, the rendering server is used to determine the coordinate data of the entity object relative to the first sub-three-dimensional coordinate system, the second sub-three-dimensional coordinate system, and the third sub-three-dimensional coordinate system respectively according to the positioning video data, including:

[0023] The rendering server is used to determine the coordinate data of the entity object relative to the first sub-three-dimensional coordinate system according to the positioning video data obtained by the dynamic positioning shooting device located at the left screen top edge track;

[0024] The rendering server is used to determine the coordinate data of the entity object relative to the second sub-three-dimensional coordinate system according to the positioning video data obtained by the dynamic positioning shooting device located at the right screen top edge track;

[0025] The rendering server is used to determine the coordinate data of the entity object relative to the third sub-three-dimensional coordinate system based on the positioning video data obtained by the dynamic positioning shooting device located at the top edge track of the background curtain.

[0026] In one embodiment, the virtual object control server includes an electronic device that can run a software application and provide an interactive interface for a user after running the software application.

[0027] In one embodiment, the image rendering and synthesis system for virtual production further includes:

[0028] The viewing angle linkage control device is used to determine the viewing angle position of the dynamic positioning shooting device based on the viewing angle position of the main shooting device, and control the dynamic positioning shooting device to move to the corresponding viewing angle position.

[0029] In one embodiment, the viewing angle linkage control device is used to move the dynamic positioning shooting device to a maximum angle position where the angle between the main shooting device position and the line connecting the physical object is close to 180 degrees.

[0030] The beneficial effect of the present application is that a group of dynamic positioning shooting devices is added to the virtual production equipment to synchronously shoot a group of positioning video data from a perspective different from that of the main shooting device. This group of positioning video data is specifically used in conjunction with the main video data to more accurately determine the spatial position of the physical object, so that when the virtual object is inserted during later rendering, more spatial position information can be obtained to ensure that the spatial position relationship between the inserted virtual object and the physical object is more accurate. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 is a schematic diagram of the architecture of an image rendering and synthesis system for virtual production in one embodiment;

[0032] Figure 2 An interface diagram of a software application on a virtual object control server in one embodiment;

[0033] Figure 3 This is a schematic diagram of the arrangement of four screen groups in one embodiment;

[0034] Figure 4 This is a schematic diagram of the arrangement of three screen groups in one embodiment;

[0035] Figure 5 A schematic diagram of the definition of a three-dimensional coordinate system in one embodiment;

[0036] Figure 6 A schematic diagram of determining the position of a dynamic positioning camera device in an embodiment. DETAILED DESCRIPTION

[0037] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer and more understandable, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0038] Chinese patent application 2021111 80171.3 (Document 1) discloses an LED ring screen virtual production system, which mainly discloses the linkage mechanism between the real camera and the virtual camera in the LED ring screen virtual production process.

[0039] Chinese Patent 202010934566.7 (Document 2) discloses a real-time virtual scene LED shooting system and method, which mainly discloses the image rendering mechanism of the Unreal Engine in the virtual production process.

[0040] Chinese Patent 202210132553.7 (Document 3) discloses a virtual broadcasting method and system based on high-definition multi-screen, which mainly discloses the image processing mechanism of the Unreal Engine during the virtual broadcasting process.

[0041] The working principles of some devices in the image rendering and synthesis system for virtual production provided in the embodiments of the present application are similar to those of some devices disclosed in references 1-3, and can be used for reference. This embodiment does not provide too much detailed description of these devices.

[0042] like Figure 1 As shown, an embodiment of the present application provides an image rendering and synthesis system for virtual production, including an LED box 101, a main shooting device 102, a dynamic positioning shooting device 103, a virtual object control server 104, a rendering server 105 and a synthesis server 106.

[0043] The LED cabinet 101 includes an LED screen for displaying a virtual image.

[0044] The main shooting device 102 is used to track and shoot the physical object to output the main video data of the physical object.

[0045] The dynamic positioning shooting device 103 can move to the side of the LED box 101 where all the LED screens are located, and has a different shooting angle for the physical object than the main shooting device 102; the dynamic positioning shooting device 103 is used to output the positioning video data of the physical object with a different shooting angle from the main shooting device 102.

[0046] The virtual object control server 104 includes a virtual object asset library; the virtual object control server 104 is used to determine the virtual object to be inserted from the virtual object asset library based on the user's operation instruction.

[0047] The rendering server 105 is used to determine the position data of the virtual camera according to the position data of the physical camera in the main shooting device 102 .

[0048] The rendering server 105 is also used to determine the spatial position information of the entity object based on the positioning video data and the main video data, and render virtual image data based on the spatial position information and the position data of the virtual camera; the virtual image data is integrated with the virtual object selected by the user.

[0049] The synthesis server 106 is used to obtain the main video data and the virtual image data integrated with the virtual object, and synthesize the two to output the synthesized image data for display.

[0050] The image rendering and synthesis system for virtual production provided by this embodiment adds a dynamic positioning shooting device 103 to obtain positioning video data of physical objects under different viewing angles from the main shooting device 102. When inserting virtual objects in the later image rendering, the positioning video data can be further referenced to determine the spatial position information of the physical object, thereby making the spatial position relationship between the inserted virtual object and the physical object more accurate. This avoids the problem of incorrect spatial position relationship between virtual objects and physical objects in the final output image and obvious traces of post-processing.

[0051] Figure 1 The image rendering and synthesis system for virtual production shown also includes a switch 107 , an LED screen video processor 108 and a director system 109 .

[0052] The switch 107 is used for data transmission between devices such as the rendering server 105 and the synthesis server 106. Usually, in order to ensure the speed of data transmission, the switch 107 can be a 10 Gigabit switch.

[0053] The LED screen video processor 108 is used to process the generated partial virtual image so as to display it on each LED screen in the LED box 101 .

[0054] The director system 109 is used to display the final output composite image data so as to direct the broadcast according to the on-site requirements, and further, it can also be used for video recording.

[0055] It should be noted that Figure 1 Only some of the devices involved in the image rendering and synthesis system for virtual production provided in the embodiments of the present application are shown. In other embodiments, more devices may also be included.

[0056] In one embodiment, the virtual object control server 104 includes an electronic device that can run a software application and provide an interactive interface for the user after running the software application. Figure 2 As shown, it shows an interface diagram of the software application, which can be used to select a virtual object to be inserted.

[0057] In this embodiment, the virtual object control server 104 can realize the corresponding functions by installing the software application of the object, which provides a more flexible choice for realizing a customized virtual production system in real life. The software application realizing the virtual object control server 104 can be traded through a proprietary commercial software application to commercialize the practical product.

[0058] In one embodiment, the virtual object control server 104 is also used to obtain an instruction input by a user indicating whether to refer to the positioning video data provided by the dynamic positioning shooting device 103 for virtual object insertion; the rendering server 105 is used to determine the spatial position information of the physical object according to the positioning video data and the main video data when it is determined that the instruction indicates that it is necessary to refer to the positioning video data provided by the dynamic positioning shooting device 103 for virtual object insertion, and render the virtual image data according to the spatial position information and the position data of the virtual camera; otherwise, the rendering server 105 is used to render the virtual image data according to the position data of the virtual camera.

[0059] In this embodiment, when determining the spatial position information of the physical object, the user can choose whether to refer to the positioning video data obtained by the dynamic positioning shooting device 103. On the one hand, considering that the corresponding dynamic positioning shooting device 103 and other hardware may not be installed at the shooting site, when there are no hardware conditions, the function of referring to the positioning video data can be turned off when determining the spatial position information of the physical object to avoid affecting the normal image processing function; on the other hand, for some shooting environments that have little impact on the spatial position, the dynamic positioning shooting device 103 can be selectively turned off to increase the image rendering speed. Under the premise that the spatial information can meet the requirements, the rendering speed can be increased as much as possible to better meet the real-time requirements.

[0060] In one embodiment, the virtual object asset library includes feature information of each virtual object; the rendering server 105 is further used to render and obtain virtual image data according to the spatial position information, the position data of the virtual camera and the feature information of the virtual object.

[0061] In this embodiment, in order to further obtain a more accurate spatial position relationship between the virtual object and the physical object, each virtual object in the virtual object asset library itself has corresponding feature information, such as the virtual object name. When the rendering server 105 performs image fusion, the feature information can be referred to to obtain a more accurate spatial position relationship between the virtual object and the physical object.

[0062] Specifically, when performing image fusion according to the feature information of the virtual object, the rendering server 105 can perform image processing based on a configured machine learning model. The machine learning model is trained based on a sample database, and the samples in the database include different feature information of the virtual object as labels.

[0063] In one embodiment, if Figure 3As shown, the LED box 101 includes a ground curtain 201, a left curtain 202, a right curtain 203 and a background curtain 204, and the dynamic positioning shooting device 103 includes a track 205 set along the top edges of the left curtain 202, the right curtain 203 and the background curtain 204. The camera of the dynamic positioning shooting device 103 can move along the track to obtain positioning video data from different perspectives.

[0064] This embodiment provides a scheme for arranging the dynamic positioning shooting device 103 for a four-sided screen group. In other embodiments, corresponding dynamic positioning shooting devices 103 may also be arranged according to different screen groups.

[0065] For example, in another embodiment, Figure 4 As shown, a three-screen group dynamic positioning shooting device 103 arrangement solution is provided.

[0066] exist Figure 3 In the four-screen group embodiment shown, the rendering server 105 is used to determine the spatial position information of the entity object according to the positioning video data and the main video data; including:

[0067] The rendering server 105 is used to determine the coordinate data of the entity object relative to the first three-dimensional coordinate system according to the positioning video data, and to determine the coordinate data of the entity object relative to the second three-dimensional coordinate system according to the main video data.

[0068] The rendering server 105 is further configured to determine spatial position information of the entity object according to the coordinate data of the entity object relative to the first three-dimensional coordinate system and the coordinate data of the entity object relative to the second three-dimensional coordinate system.

[0069] The origins of the first three-dimensional coordinate system and the second three-dimensional coordinate system are different. The first three-dimensional coordinate system is predefined based on the position of the dynamic positioning shooting device 103 , and the second three-dimensional coordinate system is predefined based on the position of the main shooting device 102 .

[0070] It should be noted that the first three-dimensional coordinate system of the dynamic positioning shooting device 103 and the second three-dimensional coordinate system of the main shooting device 102 can be defined according to actual conditions. Their function is to obtain the coordinate data of the entity objects at least two different perspectives through the three-dimensional coordinates obtained by the dynamic positioning shooting device 103 and the main shooting device 102 at different perspectives, and then to obtain more accurate coordinate data for reference.

[0071] like Figure 5 As shown, in one embodiment, the first three-dimensional coordinate system includes a first sub-three-dimensional coordinate system, a second sub-three-dimensional coordinate system, and a third sub-three-dimensional coordinate system, whose origins are located on the planes where the left curtain 202, the right curtain 203, and the background curtain 204 are located.

[0072] The rendering server 105 is used to determine the coordinate data of the entity object relative to the first three-dimensional coordinate system according to the positioning video data, including:

[0073] The rendering server 105 is used to determine the coordinate data of the entity object relative to the first sub-three-dimensional coordinate system, the second sub-three-dimensional coordinate system, and the third sub-three-dimensional coordinate system respectively according to the positioning video data.

[0074] In this embodiment, the left curtain 202, the right curtain 203, and the background curtain 204 correspond to a sub-three-dimensional coordinate system. Since the positioning video data provided by the dynamic positioning shooting device 103 is only used to obtain the spatial coordinate data of the physical object, different three-dimensional coordinate systems are defined for the screens on different sides, so that the positioning video data can be fully utilized as much as possible without affecting the amount of data, so as to obtain coordinate data of different dimensions, and further improve the accuracy of spatial positioning.

[0075] It should be noted that the three-dimensional coordinate system can be defined according to the image processing algorithm actually used. In the embodiment of the present application, only a basic definition scheme is provided to illustrate its principle.

[0076] Usually, after the LED screen is built, it is necessary to debug the stroboscopic, moiré, frame rate and synchronization lock issues, and only after setting the appropriate parameters can the environment foundation be provided for the subsequent processes. At this time, it is also necessary to arrange the corresponding hardware facilities according to the software application settings in the virtual object control server 104. In addition, during the rendering debugging, the matte debugging should also be focused on to ensure the accuracy of the fusion of the virtual image and the physical object.

[0077] In one embodiment, the rendering server 105 is used to determine the coordinate data of the entity object relative to the first sub-three-dimensional coordinate system, the second sub-three-dimensional coordinate system, and the third sub-three-dimensional coordinate system respectively according to the positioning video data, including:

[0078] The rendering server 105 is used to determine the coordinate data of the entity object relative to the first sub-three-dimensional coordinate system according to the positioning video data obtained by the dynamic positioning shooting device 103 located at the top track of the left curtain 202;

[0079] The rendering server 105 is used to determine the coordinate data of the entity object relative to the second sub-three-dimensional coordinate system according to the positioning video data obtained by the dynamic positioning shooting device 103 located at the top track of the right curtain 203;

[0080] The rendering server 105 is used to determine the coordinate data of the entity object relative to the third sub-three-dimensional coordinate system according to the positioning video data obtained by the dynamic positioning shooting device 103 located at the top edge track of the background curtain 204.

[0081] In this embodiment, since three sub-three-dimensional coordinate systems are defined, when determining the coordinate data of the entity object relative to the sub-three-dimensional coordinate system by positioning video data, it is necessary to select the image data collected by the dynamic positioning shooting device 103 located at the corresponding screen sides (left curtain, right curtain, background curtain).

[0082] In one embodiment, the image rendering and synthesis system for virtual production also includes a perspective linkage control device, which is used to determine the perspective position of the dynamic positioning shooting device 103 based on the perspective position of the main shooting device 102, and control the dynamic positioning shooting device 103 to move to the corresponding perspective position.

[0083] In one embodiment, the view-angle linkage control device is used to move the dynamic positioning shooting device 103 to a maximum angle position where the angle between the position of the main shooting device 102 and the line connecting the physical object is close to 180 degrees.

[0084] like Figure 6 As shown, it shows a schematic diagram of determining the position of the dynamic positioning shooting device 103. The angle θ is the maximum angle at which the dynamic positioning shooting device 103 moves to the position of the main shooting device 102 and the angle between the physical object is close to 180 degrees. Correspondingly, the position of the dynamic positioning shooting device 103 can be determined at this angle. Since the dynamic positioning shooting device 103 moves on a preset track, the angle θ can be determined.

[0085] In this embodiment, by determining the angle θ to determine the physical position of the camera of the dynamic positioning shooting device 103, it can be ensured as much as possible that the viewing angle information of the main video data and the positioning video data has a greater difference, so that the spatial position information of the obtained entity object is more accurate.

[0086] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. An image rendering and synthesis system for virtual film production, characterized in that: include: An LED box including an LED screen for displaying a virtual image; A main shooting device, used for tracking and shooting a physical object to output main video data of the physical object; A dynamic positioning shooting device, which can be moved on the side where all the LED screens of the LED box are located, and has a different shooting angle of view for the physical object than the main shooting device; the dynamic positioning shooting device is used to output positioning video data of the physical object with a shooting angle different from that of the main shooting device; A virtual object control server, the virtual object control server comprising a virtual object asset library; the virtual object control server is used to determine a virtual object to be inserted from the virtual object asset library based on an operation instruction of a user; A rendering server, configured to determine position data of a virtual camera according to position data of a physical camera in the main shooting device; The rendering server is further used to determine the spatial position information of the entity object according to the positioning video data and the main video data, and render virtual image data according to the spatial position information and the position data of the virtual camera; the virtual image data is fused with the virtual object; A synthesis server, used for acquiring the main video data and the virtual image data integrated with the virtual object, and synthesizing the two to output synthesized image data for display; The image rendering and synthesis system for virtual film production also includes: A viewing angle linkage control device, used to determine the viewing angle position of the dynamic positioning shooting device based on the viewing angle position of the main shooting device, and control the dynamic positioning shooting device to move to the corresponding viewing angle position; The viewing angle linkage control device is used to move the dynamic positioning shooting device to a maximum angle position where the angle between the main shooting device position and the line connecting the physical object is close to 180 degrees.

2. The image rendering and synthesis system for virtual production according to claim 1, characterized in that: The virtual object control server is also used to obtain an instruction input by a user indicating whether to refer to the positioning video data provided by the dynamic positioning shooting device to insert a virtual object; the rendering server is used to determine the spatial position information of the physical object according to the positioning video data and the main video data when it is determined that the instruction indicates that it is necessary to refer to the positioning video data provided by the dynamic positioning shooting device to insert the virtual object, and render the virtual image data according to the spatial position information and the position data of the virtual camera; otherwise, the rendering server is used to render the virtual image data according to the position data of the virtual camera.

3. The image rendering and synthesis system for virtual production according to claim 2, characterized in that: The virtual object asset library includes feature information of each virtual object; the rendering server is also used to render and obtain virtual image data according to the spatial position information, the position data of the virtual camera and the feature information of the virtual object.

4. The image rendering and synthesis system for virtual production according to any one of claims 1 to 3, characterized in that: The LED box includes a ground curtain, a left curtain, a right curtain and a background curtain. The dynamic positioning shooting device includes a track arranged along the top edge of the left curtain, the right curtain and the background curtain. The camera of the dynamic positioning shooting device can move along the track to obtain the positioning video data from different perspectives.

5. The image rendering and synthesis system for virtual production according to claim 4, characterized in that: The rendering server is used to determine the spatial position information of the entity object according to the positioning video data and the main video data; including: The rendering server is used to determine the coordinate data of the entity object relative to the first three-dimensional coordinate system according to the positioning video data, and determine the coordinate data of the entity object relative to the second three-dimensional coordinate system according to the main video data; The rendering server is further used to determine the spatial position information of the entity object according to the coordinate data of the entity object relative to the first three-dimensional coordinate system and the coordinate data of the entity object relative to the second three-dimensional coordinate system; The origins of the first three-dimensional coordinate system and the second three-dimensional coordinate system are different, the first three-dimensional coordinate system is predefined based on the position of the dynamic positioning shooting device, and the second three-dimensional coordinate system is predefined based on the position of the main shooting device.

6. The image rendering and synthesis system for virtual production according to claim 5, characterized in that: The first three-dimensional coordinate system includes a first three-dimensional sub-coordinate system, a second three-dimensional sub-coordinate system, and a third three-dimensional sub-coordinate system whose origins are located on the planes where the left curtain, the right curtain, and the background curtain are located respectively; The rendering server is used to determine the coordinate data of the entity object relative to the first three-dimensional coordinate system according to the positioning video data, including: The rendering server is used to determine the coordinate data of the entity object relative to the first sub-three-dimensional coordinate system, the second sub-three-dimensional coordinate system, and the third sub-three-dimensional coordinate system respectively according to the positioning video data.

7. The image rendering and synthesis system for virtual production according to claim 6, characterized in that: The rendering server is used to determine the coordinate data of the entity object respectively relative to the first sub-three-dimensional coordinate system, the second sub-three-dimensional coordinate system, and the third sub-three-dimensional coordinate system according to the positioning video data, including: The rendering server is used to determine the coordinate data of the entity object relative to the first sub-three-dimensional coordinate system according to the positioning video data obtained by the dynamic positioning shooting device located at the left screen top edge track; The rendering server is used to determine the coordinate data of the entity object relative to the second sub-three-dimensional coordinate system according to the positioning video data obtained by the dynamic positioning shooting device located at the right screen top edge track; The rendering server is used to determine the coordinate data of the entity object relative to the third sub-three-dimensional coordinate system based on the positioning video data obtained by the dynamic positioning shooting device located at the top edge track of the background curtain.

8. The image rendering and synthesis system for virtual production according to claim 1, characterized in that: The virtual object control server includes an electronic device that can run a software application and provide an interactive interface for a user after running the software application.

Images