A camera tracking method and system for LED virtual backdrops

Abstract

The embodiment of the present application provides a kind of camera tracking method and system for LED virtual shooting screen, it is related to the field of movie virtual production, the method comprises: through the data collector fixed on real camera, the specific wavelength invisible light emitted by three lamp beads on non-linear on LED virtual shooting screen is received in real time, the distance and the attitude of real camera relative to LED virtual shooting screen are collected in real time according to the position of three the lamp beads emitting specific wavelength invisible light;The distance and the attitude of real camera relative to LED virtual shooting screen collected are transmitted to virtual camera system in real time;Virtual shooting system adjusts the position and attitude of virtual camera in real time according to the distance and the attitude.By the lamp bead of specific position and specific wavelength spectrum on LED virtual shooting screen, the light-emitting of lamp bead is automatically controlled, and manual arrangement mark point on LED virtual shooting screen is not needed, and the position calculation accuracy is improved.

Description

Technical Field

[0001] This invention relates to the field of virtual film production, and specifically to a camera tracking method and system for LED virtual shooting screens. Background Technology

[0002] In film virtualization production, camera tracking systems need to provide the position and pose of the virtual camera in the on-set virtual rendering engine. Camera tracking systems can be divided into two main categories based on their tracking principles: optical and non-optical. Optical camera tracking systems include binocular optical, monocular optical, active marker, and passive marker tracking technologies; non-optical camera tracking systems include acoustic, inertial, electromagnetic, and mechanical tracking technologies. Optical camera tracking systems have advantages such as wide tracking range, low system latency, high tracking accuracy, and strong anti-interference capabilities. However, their biggest problem is that the use of active and passive markers can lead to camera obstruction or unfavorable ambient lighting conditions, resulting in lost tracking information. Non-optical tracking systems, on the other hand, have lower accuracy and weaker anti-interference capabilities. Summary of the Invention

[0003] This invention provides a camera tracking method and system for LED virtual shooting screens, which can solve the technical problems existing in the prior art.

[0004] To achieve the above objectives, in one aspect, embodiments of the present invention provide a camera tracking method for an LED virtual shooting screen, comprising:

[0005] By using a data acquisition device fixed to a real camera, the invisible light of a specific wavelength emitted by three LED beads that are not in a straight line on the LED virtual shooting screen is received in real time. The distance and orientation of the real camera relative to the LED virtual shooting screen are collected in real time based on the positions of the three LED beads that emit the invisible light of the specific wavelength.

[0006] The distance and posture of the real camera relative to the LED virtual shooting screen are transmitted to the virtual camera system in real time;

[0007] The virtual shooting system adjusts the position and posture of the virtual camera in real time based on the distance and posture.

[0008] On the other hand, embodiments of the present invention provide a camera tracking system for an LED virtual shooting screen, comprising:

[0009] The data acquisition device, fixed on the real camera, is used to receive invisible light of a specific wavelength emitted by three LED beads on the LED virtual shooting screen that are not in a straight line in real time. Based on the positions of the three LED beads that emit invisible light of a specific wavelength, the distance and orientation of the real camera relative to the LED virtual shooting screen are collected in real time. The collected distance and orientation of the real camera relative to the LED virtual shooting screen are then transmitted to the virtual camera system in real time.

[0010] A virtual shooting system is used to adjust the position and posture of a virtual camera in real time based on the distance and the posture.

[0011] The above technical solution has the following beneficial effects: By using LED beads with specific positions and wavelengths on the LED virtual shooting screen, the illumination of the LED beads is automatically controlled, ensuring timely and accurate transmission of position and orientation without loss. It eliminates the need for manual placement of markers on the LED virtual shooting screen, simplifying implementation and reducing deployment complexity. Furthermore, the new position calculation algorithm is simple and reliable, improving the accuracy of position calculation. Attached Figure Description

[0012] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0013] Figure 1 This is a flowchart of a camera tracking method for an LED virtual shooting screen according to an embodiment of the present invention;

[0014] Figure 2 This is a structural diagram of a camera tracking system for an LED virtual shooting screen according to an embodiment of the present invention;

[0015] Figure 3 This is a demonstration diagram of a real camera positioning and tracking LED virtual shooting screen according to an embodiment of the present invention;

[0016] Figure 4 This is a diagram showing the framework and logic of the LED virtual shooting screen used for real camera positioning and tracking in an embodiment of the present invention. Detailed Implementation

[0017] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0018] like Figure 1 As shown, in conjunction with embodiments of the present invention, a camera tracking method for an LED virtual shooting screen is provided, comprising:

[0019] S101: A data acquisition device fixed to a real camera receives in real time the invisible light of a specific wavelength emitted by three LED beads on a non-linear position on the LED virtual shooting screen. Based on the positions of the three LED beads emitting the invisible light of the specific wavelength, the distance and orientation of the real camera relative to the LED virtual shooting screen are acquired in real time. The phrase "on the LED virtual shooting screen" among the three LED beads on a non-linear position includes at least one of the following: front, left side, right side, top side, and bottom side of the LED virtual shooting screen.

[0020] S102: Transmit the distance and posture of the real camera relative to the LED virtual shooting screen to the virtual camera system in real time;

[0021] S103: The virtual shooting system adjusts the position and posture of the virtual camera in real time according to the distance and the posture.

[0022] By using LED beads positioned at specific locations and with specific wavelengths on an LED virtual shooting screen, the system automatically controls the emission of these beads, ensuring timely and accurate transmission of their position and orientation without loss. This eliminates the need for manual placement of markers on the LED virtual shooting screen, simplifying implementation and reducing deployment complexity. Furthermore, the new position calculation algorithm is simple and reliable, improving the accuracy of position calculations.

[0023] Preferably, the camera tracking method for the LED virtual shooting screen further includes:

[0024] S104: An LED virtual shooting screen is formed by splicing together multiple LED boxes. This LED virtual shooting screen is composed of multiple LED boxes. The position of each LED box is fixed and its number can be set in the software system.

[0025] Each LED housing contains LED beads of a certain resolution: multiple second LED beads with preset resolutions and a first LED bead positioned at a specific location. Preferably, the second LED beads in each LED housing can be positioned at the same location. The first LED bead emits invisible light of a specific wavelength (i.e., a specific frequency) and is manufactured using semiconductor technology, resulting in a very high refresh rate, commonly 3840Hz. The invisible light is infrared light. The second LED beads are generally composed of red, green, and blue chips. The first LED bead is a 4-chip infrared LED bead that emits invisible light of a specific wavelength (i.e., a specific frequency), which can be captured. Therefore, based on the infrared light, the position of the first LED bead emitting infrared light can be determined for positioning calculations of the real camera.

[0026] Preferably, the data acquisition unit includes a controller MCU;

[0027] The camera tracking method for LED virtual shooting screen further includes:

[0028] S105: Each LED box is equipped with an LED controller, and the MCU is connected to the LED controller; that is, each LED box is controlled by an LED controller, which controls the light emission of any one LED in the LED box. The LED controller receives image signals or other instructions from the video transmitter and displays the image signal through the first LED.

[0029] S106: The controller MCU sends a light-emitting command to the LED controller corresponding to the LED housing at preset time intervals according to the identification information of the first LED beads and the light-emitting order of the first LED beads. The instruction carries the identification information of the first LED beads. The three adjacent first LED beads emitting light in sequence are not on the same straight line; for example, they emit an infrared wavelength with a duration of 1 / 3840 seconds once per second, and the LEDs display normal images for the rest of the time. The images displayed on the LED virtual shooting screen are rendered by the virtual shooting system and sent to the receiving card for display. Sending a light-emitting command to the LED controller corresponding to the LED housing at preset time intervals according to the light-emitting order of the first LED beads causes the first LED beads to emit invisible light of a specific wavelength at preset time intervals, enabling the data acquisition device to collect the invisible light in real time, thereby acquiring the distance and orientation of the real camera relative to the LED virtual shooting screen.

[0030] S107: At the same time, the controller MCU sends the label information of the first LED to the virtual shooting system; it can obtain the position of the invisible light emitting a specific wavelength.

[0031] S108: The LED controller causes the second LED in each LED box to emit infrared light of a specific wavelength according to the instruction. Specifically, the transmitting card in each LED controller receives the light emission instruction and sends the light emission instruction to the receiving card in the LED controller; the receiving card in the LED controller receives the light emission instruction and controls the first LED in the corresponding LED box to emit invisible light of a specific wavelength.

[0032] When the controller MCU sends a light-emitting command to the LED controller, it carries label information, which refers to the label of the LED infrared light bead. The LED controller receives the label information and controls the first LED bead according to the label information. In this invention, a single controller MCU is used, avoiding the problem in the prior art where "two controller MCUs are used, and the first MCU sends the label information and then notifies the second MCU." Combining the two MCUs into one reduces the interaction and communication with the second MCU and improves real-time performance.

[0033] Preferably, the data acquisition device includes a laser rangefinder, a gyroscope, and a controller MCU;

[0034] S101: The data acquisition device fixed to the real camera receives in real time the invisible light of a specific wavelength emitted by three LED beads on the LED virtual shooting screen that are not in a straight line, and collects in real time the distance and orientation of the real camera relative to the LED virtual shooting screen based on the positions of the three LED beads emitting the invisible light of the specific wavelength, specifically including:

[0035] S1011: The laser rangefinder receives in real time the invisible light of a specific wavelength emitted by three LED beads that are not in a straight line on the LED virtual shooting screen; identifies the position of the three LED beads that emit the invisible light of the specific wavelength, and calculates in real time the distance between each of the three LED beads and the real camera based on the position of the three LED beads.

[0036] The controller controls three first LED beads (preferably arranged in a triangular pattern) on the LED virtual shooting screen to emit invisible light of a specific wavelength. The laser rangefinder also includes a controller MCU. The laser rangefinder synchronously receives this specific wavelength of invisible light and, by calculating the distances between the three first LED beads and the laser rangefinder in real time, can determine the real-time position of the laser rangefinder relative to the LED virtual shooting screen. This position is the same as the position of the real camera relative to the LED screen. Position parameters include the x, y, and z coordinates of the spatial coordinate system, which is based on the LED virtual shooting screen, whose position is fixed. Figure 3 As shown, when the first LED bead forms six sides of length a, b, c, d, e, and f with the real camera P (whose coordinates are known), the position of the real camera relative to the LED screen can be calculated based on these six side lengths. In virtual shooting systems, the LED virtual shooting screen is usually set to a fixed position, and its size is known.

[0037] S1012: The gyroscope receives in real-time invisible light of five specific wavelengths emitted by three LED beads positioned non-linearly on the LED virtual shooting screen; the position of the real camera relative to the LED virtual shooting screen is determined based on the positions of the three LED beads.

[0038] The camera's posture; the gyroscope integrated with the laser rangefinder provides real-time posture information from the laser rangefinder, and the gyroscope's posture information is the actual camera's posture information.

[0039] S1013: The controller MCU will determine the distance between each of the three LEDs and the real camera, and the distance between the real camera and the real camera.

[0040] The camera's posture relative to the LED virtual shooting screen, preferably, for example, when combined, is transmitted to the virtual shooting system (e.g., Unreal Engine) via API. The virtual shooting system adjusts the virtual camera position in real time according to the received positioning information.

[0041] Position and posture. This allows for real-time matching of the virtual environment with the movement of real cameras on site, enabling real-time rendering and compositing of virtual pre-show footage.

[0042] Preferably, the camera tracking method for the LED virtual shooting screen further includes:

[0043] S109: The transmitting card in the LED controller receives the control command from the video source and sends the control command from the video source to the receiving card in the LED controller; the receiving card in the LED controller controls the LED virtual shooting.

[0044] The video source is played back via a screen capture; the video refers to the video rendered by the virtual shooting system. In other words, the LED controller sending card can receive control commands from the video source and the MCU, and send them to the receiving card inside the LED cabinet. The receiving card inside the LED cabinet controls the LED beads displayed in each LED cabinet.

[0045] Preferably, the camera tracking method for the LED virtual shooting screen further includes: 0. Real-time reception of invisible light of a specific wavelength emitted by three LED beads on an object (excluding the LED virtual shooting screen) that are not in a straight line and have a fixed positional relationship with the LED virtual shooting screen, via a data acquisition device fixed to a real camera; or, real-time reception of invisible light of a specific wavelength emitted by three LED beads on an object (excluding the LED virtual shooting screen) that are not in a straight line and have a fixed positional relationship with the LED virtual shooting screen; wherein, the LED virtual shooting screen...

[0046] Objects with fixed positional relationships to the screen include at least one of the following: the area surrounding the LED virtual shooting screen, the roof 5 units away from the LED virtual shooting screen, and the ground next to the LED virtual shooting screen; since there are many different ways to position the LED beads, there will always be some beads that are not obstructed, therefore...

[0047] In any situation, three LEDs on a non-linear path can be used.

[0048] The distance and orientation of the real camera relative to the LED virtual shooting screen are acquired in real time based on the positions of the three LED beads that emit invisible light of a specific wavelength.

[0049] In summary, this embodiment of the invention utilizes a laser rangefinder, a gyroscope, a controller, and an LED virtual shooting screen for virtual filming. The laser rangefinder is mounted on the real camera and can be fixed above it. The controller (MCU) transmits position and attitude information to the virtual camera system in real time. The virtual shooting system adjusts the position and attitude of the virtual camera in real time based on the distance and attitude, thereby achieving real-time matching with the movement of the real camera in the virtual environment and completing the real-time rendering and compositing of the virtual pre-production footage.

[0050] like Figure 2 and Figure 4 As shown, in conjunction with an embodiment of the present invention, a camera tracking system for an LED virtual shooting screen is provided, comprising:

[0051] Data acquisition unit 21, fixed on the real camera, is used to receive invisible light of a specific wavelength emitted by three LED beads on the LED virtual shooting screen that are not in a straight line in real time, and to collect the distance and attitude of the real camera relative to the LED virtual shooting screen in real time according to the position of the three LED beads that emit invisible light of a specific wavelength; and to transmit the collected distance and attitude of the real camera relative to the LED virtual shooting screen to the virtual camera system in real time.

[0052] The virtual shooting system 22 is used to adjust the position and posture of the virtual camera in real time according to the distance and the posture.

[0053] Preferably, the camera tracking system for the LED virtual shooting screen further includes:

[0054] The LED virtual shooting screen is formed by splicing together multiple LED boxes. Each LED box is equipped with multiple second LED beads with preset resolution and a first LED bead at a specific position. The first LED bead emits invisible light of a specific wavelength and is made based on semiconductor technology. The invisible light is infrared light.

[0055] Preferably, the data acquisition unit includes a controller MCU;

[0056] like Figure 4 As shown, the camera tracking system for the LED virtual shooting screen further includes:

[0057] An LED controller is located inside each of the LED boxes and is connected to the controller MCU;

[0058] The controller MCU is used to send a light-emitting command to the LED controller corresponding to the LED box at a preset time interval according to the label information of the first LED beads and the light-emitting order of the first LED beads. The instruction carries the label information of the first LED beads; wherein, the three adjacent first LED beads that emit light in sequence are not on the same straight line.

[0059] At the same time, the label information of the first LED bead is sent to the virtual shooting system;

[0060] The LED controller has a transmitting card that receives the light-emitting command and sends the light-emitting command to a receiving card within the LED controller.

[0061] The receiving card inside receives the light emission command and controls the first LED bead in the corresponding LED box to emit invisible light of a specific wavelength.

[0062] Preferably, the data acquisition device includes a laser rangefinder, a gyroscope, and a controller MCU; wherein:

[0063] The process involves a data acquisition device fixed to a real camera, which receives in real-time invisible light of a specific wavelength emitted by three LED beads positioned on a non-linear path on an LED virtual shooting screen. Based on the positions of these three LED beads emitting the specific wavelength of invisible light, the distance and orientation of the real camera relative to the LED virtual shooting screen are acquired in real-time. Specifically, this includes:

[0064] The laser rangefinder is used to receive invisible light of a specific wavelength emitted by three LED beads that are not in a straight line on the LED virtual shooting screen in real time; identify the positions of the three LED beads that emit invisible light of a specific wavelength, and calculate the distance between each of the three LED beads and the real camera in real time based on the positions of the three LED beads;

[0065] The gyroscope is used to receive invisible light of a specific wavelength emitted by three LED beads that are not in a straight line on the LED virtual shooting screen in real time; and to determine the attitude of the real camera relative to the LED virtual shooting screen based on the position of the three LED beads.

[0066] The controller MCU is used to transmit the distance between each of the three LED beads and the real camera, and the posture of the real camera relative to the LED virtual shooting screen, to the virtual shooting system.

[0067] Preferably, the camera tracking system for the LED virtual shooting screen further includes:

[0068] The LED controller has a sending card that receives control commands from a video source and sends these commands to a receiving card. The receiving card controls the LED virtual shooting screen to play the video from the video source. The video refers to the video rendered by the virtual shooting system.

[0069] The data acquisition device is also used to receive, in real time, invisible light of a specific wavelength emitted by three LED beads on an object that is not in a straight line and has a fixed positional relationship with the LED virtual shooting screen, or to receive, in real time, invisible light of a specific wavelength emitted by three LED beads on an object that is not in a straight line and has a fixed positional relationship with the LED virtual shooting screen.

[0070] The distance and orientation of the real camera relative to the LED virtual shooting screen are acquired in real time based on the positions of the three LED beads that emit invisible light of a specific wavelength. The beneficial effects achieved by this embodiment of the invention are as follows:

[0071] This invention uses a chip display array of LED beads at specific positions and with specific spectra on an LED virtual shooting screen to automatically control the display of LED beads. It eliminates the need for manual placement of marker points on the LED virtual shooting screen, making it simple and easy to implement and reducing the complexity of deployment operations. At the same time, the new position calculation algorithm is simple and reliable, which can improve the accuracy of position calculation.

[0072] It should be understood that the specific order or hierarchy of steps in the disclosed process is an example of an exemplary method. Based on design preferences, it should be understood that the specific order or hierarchy of steps in the process may be rearranged without departing from the scope of this disclosure. The appended method claims provide elements of various steps in an exemplary order and are not intended to limit the scope to the specific order or hierarchy described.

[0073] In the above detailed description, various features are combined together in a single embodiment to simplify this disclosure. This approach to disclosure should not be construed as reflecting an intention that embodiments of the claimed subject matter require more features than are explicitly stated in each claim. Rather, as reflected in the appended claims, the invention is presented with fewer features than all of the features of the single disclosed embodiment. Therefore, the appended claims are hereby explicitly incorporated into the detailed description, wherein each claim stands alone as a preferred embodiment of the invention.

[0074] The disclosed embodiments have been described above to enable any person skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be applied to other embodiments without departing from the spirit and scope of this disclosure. Therefore, this disclosure is not limited to the embodiments given herein, but is consistent with the broadest scope of the principles and novel features disclosed in this application.

[0075] The foregoing description includes examples of one or more embodiments. It is certainly impossible to describe all possible combinations of components or methods in order to describe the above embodiments, but those skilled in the art will recognize that further combinations and arrangements of the various embodiments are possible. Therefore, the embodiments described herein are intended to cover all such changes, modifications, and variations that fall within the scope of the appended claims. Furthermore, the term "comprising" as used in the specification or claims is interpreted in a manner similar to the term "including," as interpreted when used as a conjunction in the claims. Additionally, the use of any term "or" in the specification of the claims is intended to mean "non-exclusive or."

[0076] Those skilled in the art will also understand that the various illustrative logical blocks, units, and steps listed in the embodiments of the present invention can be implemented by electronic hardware, computer software, or a combination of both. To clearly demonstrate the interchangeability of hardware and software, the functions of the various illustrative components, units, and steps described above have been generally described. Whether such functionality is implemented through hardware or software depends on the specific application and the overall system design requirements. Those skilled in the art can implement the described functions using various methods for each specific application, but such implementation should not be construed as exceeding the scope of protection of the embodiments of the present invention.

[0077] The various illustrative logic blocks or units described in the embodiments of this invention can be implemented or operate the described functions using a general-purpose processor, digital signal processor, application-specific integrated circuit (ASIC), field-programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof. The general-purpose processor can be a microprocessor; alternatively, it can be any conventional processor, controller, microcontroller, or state machine. The processor can also be implemented using a combination of computing devices, such as a digital signal processor and a microprocessor, multiple microprocessors, one or more microprocessors combined with a digital signal processor core, or any other similar configuration.

[0078] The steps of the methods or algorithms described in the embodiments of this invention can be directly embedded in hardware, a software module executed by a processor, or a combination of both. The software module can be stored in RAM, flash memory, ROM, EPROM, EEPROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium in the art. Exemplarily, the storage medium can be connected to the processor so that the processor can read information from and write information to the storage medium. Optionally, the storage medium can also be integrated into the processor. The processor and storage medium can be housed in an ASIC, which can be housed in a user terminal. Optionally, the processor and storage medium can also be housed in different components of the user terminal.

[0079] In one or more exemplary designs, the functions described in the embodiments of the present invention can be implemented in hardware, software, firmware, or any combination of these three. If implemented in software, these functions can be stored on a computer-readable medium or transmitted on a computer-readable medium in the form of one or more instructions or code. Computer-readable media include computer storage media and communication media that facilitate the transfer of computer programs from one place to another. Storage media can be any available media that can be accessed by a general-purpose or special-purpose computer. For example, such computer-readable media can include, but is not limited to, RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store program code in the form of instructions or data structures and other forms that can be read by a general-purpose or special-purpose computer, or a general-purpose or special-purpose processor. Furthermore, any connection can be suitably defined as a computer-readable medium, for example, if the software is transmitted from a website, server or other remote resource via a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL) or wirelessly, such as infrared, wireless and microwave, it is also included in the defined computer-readable medium. The disks and discs mentioned include compressed disks, laser discs, optical discs, DVDs, floppy disks, and Blu-ray discs. Disks typically copy data magnetically, while disks typically copy data optically using lasers. Combinations of the above can also be contained in computer-readable media.

[0080] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A camera tracking method for an LED virtual shooting screen, characterized in that, include: Multiple LED boxes are spliced ​​together to form an LED virtual shooting screen. Each LED box contains multiple second LED beads with preset resolution, and a first LED bead is placed at a specific position. Each LED enclosure is equipped with a corresponding LED controller; By using a data acquisition device fixed to a real camera, the invisible light of a specific wavelength emitted by three LED beads that are not in a straight line on the LED virtual shooting screen is received in real time. The distance and orientation of the real camera relative to the LED virtual shooting screen are collected in real time based on the positions of the three LED beads that emit the invisible light of the specific wavelength. The data acquisition unit includes a controller MCU, which is connected to the LED controller; The distance and posture of the real camera relative to the LED virtual shooting screen are transmitted to the virtual camera system in real time; The virtual shooting system adjusts the position and posture of the virtual camera in real time based on the distance and posture. The steps involving the emission of invisible light of a specific wavelength from three non-linearly positioned LED beads on the LED virtual shooting screen include the following: The controller MCU sends a light-emitting command to the LED controller corresponding to the LED box at preset time intervals according to the label information of the first LED beads and the light-emitting order of the first LED beads. The light-emitting command carries the label information of the first LED beads; wherein, the three adjacent first LED beads that light up in sequence are not on the same straight line. Each LED controller's transmitting card receives the light-emitting command and sends the light-emitting command to the receiving card within the LED controller; The receiver card in the LED controller receives the light emission command and controls the first LED bead in the corresponding LED box to emit invisible light of a specific wavelength.

2. The camera tracking method for an LED virtual shooting screen according to claim 1, characterized in that, Also includes: The first LED emits invisible light of a specific wavelength, and the first LED is made based on semiconductor technology, with the invisible light being infrared light.

3. The camera tracking method for an LED virtual shooting screen according to claim 1, characterized in that, According to the label information of the first LED, the controller MCU sends a light-up command to the LED controller of the corresponding LED box at preset time intervals according to the light-up order of the first LED. At the same time, the controller MCU sends the label information of the first LED to the virtual shooting system.

4. The camera tracking method for an LED virtual shooting screen according to claim 1, characterized in that, The data acquisition device includes a laser rangefinder, a gyroscope, and a controller MCU; The process involves a data acquisition device fixed to a real camera, which receives in real-time invisible light of a specific wavelength emitted by three LED beads positioned on a non-linear path on an LED virtual shooting screen. Based on the positions of these three LED beads emitting the specific wavelength of invisible light, the distance and orientation of the real camera relative to the LED virtual shooting screen are acquired in real-time. Specifically, this includes: The laser rangefinder receives in real time the invisible light of a specific wavelength emitted by three LED beads that are not in a straight line on the LED virtual shooting screen; identifies the position of the three LED beads that emit the invisible light of a specific wavelength, and calculates in real time the distance between each of the three LED beads and the real camera based on the position of the three LED beads; The gyroscope receives in real time the invisible light of a specific wavelength emitted by three LED beads that are not in a straight line on the LED virtual shooting screen; the attitude of the real camera relative to the LED virtual shooting screen is determined based on the position of the three LED beads. The controller MCU transmits the distance between each of the three LED beads and the real camera, as well as the posture of the real camera relative to the LED virtual shooting screen, to the virtual shooting system.

5. The camera tracking method for an LED virtual shooting screen according to claim 3, characterized in that, Also includes: The transmitting card in the LED controller receives control commands from the video source and sends the control commands from the video source to the receiving card in the LED controller. The receiving card within the LED controller controls the LED virtual shooting screen to play video from a video source; wherein, the video refers to the video rendered by the virtual shooting system. The camera tracking method for LED virtual shooting screen further includes: The data acquisition device is fixed on the real camera to receive in real time the invisible light of a specific wavelength emitted by three LED beads on an object that is not in a straight line and has a fixed positional relationship with the LED virtual shooting screen. Alternatively, it can receive in real time the invisible light of a specific wavelength emitted by three LED beads on an object that is not in a straight line and has a fixed positional relationship with the LED virtual shooting screen. The distance and orientation of the real camera relative to the LED virtual shooting screen are acquired in real time based on the positions of the three LED beads that emit invisible light of a specific wavelength.

6. A camera tracking system for an LED virtual shooting screen, characterized in that, include: The LED virtual shooting screen is formed by splicing together multiple LED boxes. Each LED box contains multiple second LED beads with preset resolution and a first LED bead at a specific position. The data acquisition device, fixed on the real camera, is used to receive invisible light of a specific wavelength emitted by three LED beads that are not in a straight line on the LED virtual shooting screen in real time, and to collect the distance and attitude of the real camera relative to the LED virtual shooting screen in real time according to the position of the three LED beads that emit invisible light of a specific wavelength. The distance and posture of the real camera relative to the LED virtual shooting screen are transmitted to the virtual camera system in real time; the data acquisition device includes a controller MCU; An LED controller is located inside each of the LED boxes and is connected to the controller MCU; The controller MCU is used to send a light-emitting command to the LED controller corresponding to the LED box at a preset time interval according to the label information of the first LED beads and the light-emitting order of the first LED beads. The light-emitting command carries the label information of the first LED beads; wherein, the three adjacent first LED beads that light up in sequence are not on the same straight line. The LED controller has a transmitting card that receives the light-emitting command and sends the light-emitting command to a receiving card within the LED controller. The receiving card inside receives the light emission command and controls the first LED bead in the corresponding LED box to emit invisible light of a specific wavelength; A virtual shooting system is used to adjust the position and posture of a virtual camera in real time based on the distance and the posture.

7. The camera tracking system for an LED virtual shooting screen according to claim 6, characterized in that, In the LED virtual shooting screen, the first LED emits invisible light of a specific wavelength, and the first LED is made based on semiconductor technology, with the invisible light being infrared light.

8. The camera tracking system for an LED virtual shooting screen according to claim 6, characterized in that, The controller MCU is also used to send a light-emitting command to the LED controller corresponding to the LED box at a preset time interval according to the label information of the first LED beads and in the order of light emission of the first LED beads, while sending the label information of the first LED beads to the virtual shooting system.

9. The camera tracking system for an LED virtual shooting screen according to claim 6, characterized in that, The data acquisition unit includes a laser rangefinder, a gyroscope, and a controller MCU; wherein: A data acquisition device fixed to a real camera receives in real-time invisible light of a specific wavelength emitted by three LED beads positioned non-linearly on an LED virtual shooting screen. Based on the positions of these three LED beads emitting the specific wavelength of invisible light, the distance and orientation of the real camera relative to the LED virtual shooting screen are acquired in real-time, specifically including: The laser rangefinder is used to receive invisible light of a specific wavelength emitted by three LED beads that are not in a straight line on the LED virtual shooting screen in real time; identify the positions of the three LED beads that emit invisible light of a specific wavelength, and calculate the distance between each of the three LED beads and the real camera in real time based on the positions of the three LED beads; The gyroscope is used to receive invisible light of a specific wavelength emitted by three LED beads that are not in a straight line on the LED virtual shooting screen in real time; and to determine the attitude of the real camera relative to the LED virtual shooting screen based on the position of the three LED beads. The controller MCU is used to transmit the distance between each of the three LED beads and the real camera, and the posture of the real camera relative to the LED virtual shooting screen, to the virtual shooting system.

10. The camera tracking system for an LED virtual shooting screen according to claim 8, characterized in that, Also includes: The LED controller has a transmitting card that receives control commands from a video source and sends the control commands from the video source to a receiving card within it. The receiving card controls the LED virtual shooting screen to play the video source; wherein, the video refers to the video rendered by the virtual shooting system; The data acquisition device is also used to receive, in real time, invisible light of a specific wavelength emitted by three LED beads on an object that is not in a straight line and has a fixed positional relationship with the LED virtual shooting screen, or to receive, in real time, invisible light of a specific wavelength emitted by three LED beads on an object that is not in a straight line and has a fixed positional relationship with the LED virtual shooting screen. The distance and orientation of the real camera relative to the LED virtual shooting screen are acquired in real time based on the positions of the three LED beads that emit invisible light of a specific wavelength.

Images