Display control device and method, shooting equipment and shooting system

Abstract

The invention relates to a display control device and method, shooting equipment and a shooting system. A display control device of the present disclosure includes a camera and a controller. Wherein the controller is configured to generate a control signal of an ith frame of image according to ith frame of image data, and send the control signal of the ith frame of image to the display screen, so that the display screen displays an ith frame of background picture; i is a positive integer greater than or equal to 1. The camera is configured to shoot the ith frame of background picture and a target object located on the light emitting side of the display screen to obtain a first target picture and send the first target picture to the controller. And the controller is further configured to compare the first target picture with a preset target picture to obtain correction information, generate a control signal of the (i + 1) th frame of image according to the correction information and the (i + 1) th frame of image data, and send the control signal of the (i + 1) th frame of image to the display screen, so that the display screen displays the (i + 1) th frame of background picture. According to the invention, real-time correction can be realized.

Description

Technical Field

[0001] The present disclosure relates to the field of virtual photography, and in particular to a display control device and method, a photography device, and a photography system. Background Art

[0002] During video shooting, in order to achieve realistic real-scene shooting effects without being restricted by real scenes, people will choose virtual shooting technology for shooting.

[0003] Virtual shooting technology can form a real-time interactive virtual shooting production environment, which is suitable for space simulation shooting. Specifically, when the target object to be shot is in front of the large display screen, the background image and the target object displayed on the display screen can be shot by a camera to obtain the target image, and the target image can be rendered and expanded using real-time rendering technology to obtain the output image, so that the spatial relationship between the virtual background image and the target object can be displayed in real time, creating an infinite sense of space. Summary of the invention

[0004] The present disclosure aims to solve at least one of the technical problems existing in the prior art, and proposes a display control device and method, a shooting device, and a shooting system.

[0005] In order to achieve the above-mentioned object, the present disclosure provides a display control device, comprising: a camera and a controller; wherein:

[0006] The controller is configured to generate a control signal for the i-th frame of image according to the i-th frame of image data, and send the control signal for the i-th frame of image to the display screen, so that the display screen displays the i-th frame of background picture; i is a positive integer greater than or equal to 1;

[0007] The camera is configured to shoot the i-th background image and the target object located at the light-emitting side of the display screen to obtain a first target image, and send the first target image to the controller;

[0008] The controller is also configured to compare the first target image with a preset target image to obtain correction information, generate a control signal for the i+1th frame image based on the correction information and the i+1th frame image data, and send the control signal for the i+1th frame image to the display screen so that the display screen displays the i+1th frame background image.

[0009] In some embodiments, the display control device further includes a signal synchronizer;

[0010] The signal synchronizer is configured to send synchronization signals to the camera and the controller respectively, so that the controller sends a control signal of the i-th frame image to the display screen in response to the synchronization signal, and at the same time, the camera responds to the synchronization signal to shoot the i-th frame background image and the target object located on the light-emitting side of the display screen.

[0011] In some embodiments, the signal synchronizer is further configured to send the first target image generated by the camera to the controller after sending synchronization signals to the camera and the controller respectively.

[0012] In some embodiments, the i-th frame image data and the i+1-th frame image data are sent to the controller by a video server;

[0013] The camera is also configured to shoot the background picture of the i+1th frame and the target object on the light-emitting side of the display screen to obtain a second target picture, and send the second target picture to the video server so that the video server can obtain standard image information corresponding to the background picture and / or the target object in the second target picture from the database, and generate a standard picture based on the standard image information and the second target picture.

[0014] In some embodiments, the photographing device further includes a positioning tracker;

[0015] The positioning tracker is configured to position and track the camera, at least generate the position information of the camera, and transmit the position information to the video server, so that the video server expands the standard picture according to the position information to obtain output picture information, and outputs the corresponding picture according to the output picture information in response to the picture output instruction.

[0016] The present disclosure provides a photographing device, comprising: a display screen, and a display control device as described in any one of the above.

[0017] The present disclosure provides a shooting system, comprising:

[0018] The photographing device as described above;

[0019] The video server is configured to send image data of each frame of the original background video to the controller according to the original background video.

[0020] In some embodiments, the camera is further configured to shoot the background picture of the (i+1)th frame and the target object located on the light-emitting side of the display screen to obtain a second target picture, and send the second target picture to the video server;

[0021] The video server is further configured to obtain standard image information corresponding to the background image and / or the target object in the second target image from a database, and generate a standard image according to the standard image information and the second target image.

[0022] In some embodiments, the photographing device further includes a positioning tracker;

[0023] The positioning tracker is configured to perform positioning tracking on the camera, generate position information of the camera, and transmit the position information to the video server;

[0024] The video server includes: a main control module and a rendering module.

[0025] The rendering module is configured to generate extended picture information according to the information of the standard picture and the position information of the camera;

[0026] The main control module is configured to generate output screen information according to the extended screen information.

[0027] The present disclosure provides a display control method, comprising:

[0028] Generate a control signal for the i-th frame of image according to the i-th frame of image data, and send the control signal for the i-th frame of image to a display screen, so that the display screen displays the i-th frame of background image; i is a positive integer greater than or equal to 1;

[0029] Shooting the i-th background image and the target object located on the light-emitting side of the display screen to obtain a first target image;

[0030] The first target picture is compared with the preset target picture to obtain correction information, and the correction information and the i+1th frame image data are used to generate a control signal for the i+1th frame image, and the control signal for the i+1th frame image is sent to the display screen so that the display screen displays the i+1th frame background picture. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] The accompanying drawings are used to provide a further understanding of the present disclosure and constitute a part of the specification. Together with the following specific embodiments, they are used to explain the present disclosure but do not constitute a limitation of the present disclosure. In the accompanying drawings:

[0032] Figure 1 is a schematic diagram of the composition structure of a shooting system in some embodiments;

[0033] Figure 2 is a schematic diagram of the composition structure of a shooting system in some embodiments of the present disclosure;

[0034] Figure 3 It is a processing flow chart in the controller in some embodiments of the present disclosure.

[0035] 10. Display control device; 11. Positioning tracker; 12. Camera; 13. Signal synchronizer; 14. Controller; 15. Display screen; 20. Video server; 21. Main control module; 22. Rendering module; 30. Shooting equipment. DETAILED DESCRIPTION

[0036] The specific implementation of the present disclosure is described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation described herein is only used to illustrate and explain the present disclosure, and is not used to limit the present disclosure.

[0037] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution of the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings of the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the described embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0038] Unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present disclosure should be understood by people with ordinary skills in the field to which the present disclosure belongs. The "first", "second" and similar words used in the present disclosure do not represent any order, quantity or importance, but are only used to distinguish different components. Similarly, "including" or "comprising" and similar words mean that the elements or objects appearing in front of the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0039] With the booming development of LED (light emitting diode) technology, its application scenarios are becoming more and more diverse. For example, LED display screens are increasingly widely used in the field of display technology. Among them, LED display screens are a type of display screen that can reflect an immersive sense of space and create an immersive sense of space, which is widely popular in the field of XR virtual shooting.

[0040] In one example, XR virtual shooting technology is applied to the field of film and television production. The so-called "virtual shooting" means that in the filming of film and television dramas, all shots are performed in a virtual scene in the computer according to the shooting action required by the director. In some specific embodiments, the background of virtual shooting usually uses a green screen, and a shooting device is used in front of the green screen to capture human body movements, and then the green screen is replaced with the background picture according to the setting software to synthesize the human body movements. At present, relevant synthesis software is very common, for example, it can be used on mobile devices such as mobile phones. But in fact, no matter how sophisticated the synthesis software is, it cannot replace the impact of the natural environment on the shooting effect. For example, the shadow changes caused by factors such as ambient light on the subject are difficult to simulate realistically. During the shooting process, due to the fixed effects of lighting and other effects, the image effect synthesized by the later shooting is not good. In addition, the above process from the beginning of shooting to the end of shooting is also relatively cumbersome. If visitors are allowed to handle the above process by themselves, it will obviously reduce the experience and participation enthusiasm of visitors. Therefore, a more intelligent virtual shooting experience system is needed.

[0041] In addition, in order to meet the shooting needs, film and television production needs to spend a lot of time and manpower to select shooting locations, make props, build shooting scenes, etc.

[0042] Therefore, virtual shooting technology came into being by using visual effects images rendered on the screen of the constructed LED display as background images to replace real scenes. This type of shooting can not only reduce the dependence of film and television shooting on locations and sets, but also reduce the cost and production cycle of film and television shooting.

[0043] Specifically, in related technologies, the implementation of XR virtual shooting requires a complete shooting system. Figure 1 Schematic diagram of the composition of the shooting system in some embodiments. Figure 1As shown, in some embodiments, the shooting system includes a display screen 15, a controller 14, a video server 20, a camera 12, a positioning tracker 11, and a signal synchronizer 13. Among them, the display screen 15 can be understood as a background wall, which is a carrier of a virtual picture. Specifically, it receives an image signal from the controller 14 and displays a virtual background picture corresponding to the image signal. The controller 14 has powerful processing functions such as color adjustment, image frame processing, and low latency. The image signal output by the controller 14 can output a highly realistic virtual background picture through the display screen 15. The camera 12 is used to shoot the target object on the light-emitting side of the display screen 15 and send the shot picture to the video server 20. For example, the camera 12 shoots the real state of a human body or an object under the virtual background picture to the video server 20. The positioning tracker 11 can be, for example, a sensor that can sense changes in the shooting angle of the camera 12. The video server 20 can provide the controller 14 with the picture information of the image signal for the controller 14 to output the image signal. At the same time, the video server 20 can also expand the picture shot by the camera 12 into a virtual picture to fill a wider space to obtain output picture information.

[0044] Through the close cooperation between the display screen 15, the controller 14, the video server 20, the camera 12, the positioning tracker 11, and the signal synchronizer 13, the shooting system can interact the virtual scene with the real task or physical environment during the shooting process. However, during the shooting process, it is often found that there is a large gap between the picture effect taken and the preset picture effect, resulting in a poor interactive experience. Therefore, sometimes in order to improve the interactive experience, people will choose to reshoot, which will greatly increase the time, manpower and cost of shooting. Moreover, there will be a problem that the picture effect of the shot is still quite different from the preset picture effect when reshooting, which will further cause a waste of time, manpower and cost.

[0045] In order to at least alleviate or solve one of the above-mentioned technical problems, the present disclosure provides a display control device and method, a shooting device, and a shooting system.

[0046] Figure 1 Schematic diagram of the composition structure of the shooting system in some embodiments.

[0047] In some embodiments, Figure 1 As shown, the present disclosure provides a display control device 10, comprising: a camera 12 and a controller 14.

[0048] The controller 14 is configured to generate a control signal for the i-th frame image according to the i-th frame image data, and send the control signal for the i-th frame image to the display screen 15 so that the display screen 15 displays the i-th frame background picture; i is a positive integer greater than or equal to 1.

[0049] The camera 12 is configured to shoot the i-th frame background image and the target object on the light-emitting side of the display screen 15 to obtain a first target image, and send the first target image to the controller 14 .

[0050] The controller 14 is also configured to compare the first target image with the preset target image to obtain correction information, generate a control signal for the i+1th frame image based on the correction information and the i+1th frame image data, and send the control signal for the i+1th frame image to the display screen 15 so that the display screen 15 displays the i+1th frame background image.

[0051] Optionally, the display screen 15 may be, for example, an LED display screen.

[0052] Optionally, the display screen 15 can be one or more. For example, in one example, an immersive LED display screen is used to display the background image. The immersive LED display screen includes LED display screens installed in different locations.

[0053] In the disclosed embodiment, the position of the camera 12 may be fixed or not. For example, in one example, the camera 12 may be moved and rotated according to the needs of the shooting angle to change the position to meet the shooting in different scenarios. In addition, during the shooting process, the background image displayed on the LED display screen is also output synchronously with the movement of the camera position and the lens.

[0054] The embodiment of the present disclosure can obtain correction information by comparing the first target image taken by the camera 12 with the preset target image, and generate a control signal of the i+1th frame image by the correction information and the i+1th frame image data through the controller 14, and transmit it to the display screen 15 so that the display screen 15 displays the i+1th frame background image. Therefore, the embodiment of the present disclosure can use the previous frame image taken by the camera 12 to perform real-time correction on the background image of the next frame to be displayed on the display screen 15 to ensure the overall shooting effect.

[0055] Optionally, in the controller 14, the specific process of comparing the first target picture with the preset target picture to obtain the correction information includes:

[0056] Pixel information of the first target picture and the preset target picture is obtained respectively, and the pixel information may include color information of each sub-pixel (such as chromaticity coordinates, color gamut, etc.), and the pixel information of the first target picture is compared with the pixel information of the preset target picture to obtain the difference in pixel information between the first target picture and the preset target picture, and correction information is generated according to the difference in pixel information between the two pictures.

[0057] In some embodiments, Figure 2As shown, the display control device 10 further includes a signal synchronizer 13. The signal synchronizer 13 is configured to send synchronization signals to the camera 12 and the controller 14 respectively, so that the controller 14 sends a control signal of the i-th frame image to the display screen 15 in response to the synchronization signal, and the camera 12 shoots the i-th frame background image and the target object located on the light-emitting side of the display screen 15 in response to the synchronization signal.

[0058] The disclosed embodiment can realize that, through the synchronization signals sent by the signal synchronizer 13 to the camera 12 and the controller 14 respectively, the display screen 15 displays the i-th frame of the background image, and the camera 12 starts shooting the target object on the light-emitting side of the display screen 15 and the i-th frame of the background image displayed on the display screen 15, so as to ensure the synchronization between the display of the display screen 15 and the shooting of the camera 12.

[0059] In some embodiments, Figure 2 As shown, after the signal synchronizer 13 sends synchronization signals to the camera 12 and the controller 14 respectively, the signal synchronizer 13 is further configured to acquire a first target picture from the camera 12 and send the first target picture to the controller 14 .

[0060] After the signal synchronizer 13 sends synchronization signals to the camera 12 and the controller 14 respectively, the controller 14 generates a control signal for the i-th frame image according to the i-th frame image data, and sends the control signal for the i-th frame image to the display screen 15, and the display screen 15 starts to display the i-th frame background picture. At the same time, the camera 12 starts to shoot the i-th frame background picture and the target object to obtain the first target picture. In the embodiment of the present disclosure, after the camera 12 starts to shoot the i-th frame background picture and the target object to obtain the first target picture, the signal synchronizer 13 is used to obtain the first target picture from the camera 12, and the first target picture is transmitted to the controller 14, so that the controller 14 compares the first target picture with the preset target picture to obtain correction information, and generates a control signal for the i+1-th frame image according to the correction information and the i+1-th frame image data, and transmits the control signal for the i+1-th frame image to the display screen 15 so that the display screen 15 displays the i+1-th frame background picture. Therefore, the embodiment of the present disclosure can ensure that the background picture of the next frame is adjusted using the first target picture of the previous frame so that the background picture of the next frame meets the preset requirements, thereby realizing real-time correction of the background picture of each frame to ensure that the shooting effect meets the shooting requirements.

[0061] In some embodiments, Figure 2As shown, the i-th frame image data and the i+1-th frame image data are sent by the video server 20 to the controller 14. The camera 12 is also used to shoot the i+1-th frame background picture and the target object on the light-emitting side of the display screen 15 to obtain a second target picture, and send it to the video server 20, so that the video server 20 can obtain the standard image information corresponding to the background picture and / or the target object in the second target picture from the database, and generate a standard picture according to the standard image information and the second target picture.

[0062] In the embodiment of the present disclosure, the database in the video server 20 stores standard image information corresponding to the background picture in the second target picture and standard image information corresponding to the target object in the second target picture. Therefore, the embodiment of the present disclosure can obtain standard image information corresponding to at least one of the background picture and the target object in the second target picture from the database, thereby generating a standard picture based on the obtained standard image information and the original second target picture.

[0063] For example, in one example, standard image information corresponding to the background image in the second target image is obtained from a database, so that the standard image information corresponding to the background image in the second target image and the target object in the original second target image generate a standard image.

[0064] In another example, standard image information corresponding to the target object in the second target picture is obtained from a database, so that the standard image information corresponding to the target object in the second target picture and the original background picture in the second target picture generate a standard picture.

[0065] In another example, standard image information corresponding to the background picture and the target object in the second target picture is respectively obtained from the database, so as to synthesize the standard image information corresponding to the background picture and the target object in the second target picture according to the second target picture to obtain the standard picture.

[0066] Optionally, the first target picture generated by the camera 12 shooting the first frame background picture and the target object can also be sent to the video server 20, so that the video server 20 obtains standard image information corresponding to the background picture and / or the target object in the first target picture from the database, and generates a corresponding standard picture based on the standard image information and the first target picture, thereby ensuring the integrity of the entire shot video.

[0067] Optionally, the first target picture generated by the camera 12 shooting the first frame background picture and the target object may not be sent to the video server 20, but only to the controller 14, so that the controller 14 generates correction information for the second frame background picture according to the first target picture, and further generates a control signal for the second frame image according to the correction information and the second frame image data, thereby correcting the second frame background picture to be displayed on the display screen 15. In this case, the shooting video in the embodiment of the present disclosure starts from the background picture corresponding to the second frame image, and the background pictures corresponding to all frame images are corrected in real time, which can ensure the shooting effect of the entire complete video.

[0068] In some embodiments, Figure 2 As shown, the display control device 10 also includes a positioning tracker 11;

[0069] The positioning tracker 11 is used to locate and track the camera 12, at least generate the position information of the camera 12, and transmit the position information of the camera 12 to the video server 20, so that the video server 20 expands the standard picture according to the position information to obtain output picture information, so that the video server 20 responds to the picture output instruction and outputs the corresponding picture according to the output picture information.

[0070] In the disclosed embodiment, the positioning tracking information obtained by the positioning tracker 11 for positioning and tracking the camera 12 includes not only the position information of the camera 12 but also the shooting angle of the camera 12 and other information. The video server 20 can expand the standard screen according to the positioning tracking information, so as to obtain more complete output screen information that meets different requirements. In addition, the video server 20 can also respond to the screen output instruction and output the corresponding screen according to the output screen information, so as to display the final shooting effect.

[0071] In some embodiments, the positioning tracker 11 is mounted on the camera 12 .

[0072] The disclosed embodiment can facilitate the positioning tracker 11 to track the parameters of the camera 12 by mounting the positioning tracker 11 on the camera 12 , and can further ensure the accuracy of the positioning tracking information obtained by the positioning tracker 11 .

[0073] In some embodiments, Figure 2 As shown, the present disclosure provides a shooting device 30, including: a display screen 15 and a display control device 10 as described in any embodiment of the present disclosure. Specifically, as Figure 2 As shown, the present disclosure provides a photographing device 30 , including: a display screen 15 , a controller 14 and a camera 12 .

[0074] In some embodiments, Figure 2 As shown, a shooting system of the present disclosure includes a shooting device 30 and a video server 20 as described in any embodiment of the present disclosure. The video server 20 is configured to send image data of each frame image in the original background video to the controller 14 according to the original background video. Specifically, the video server 20 is configured to send the image data of the i-th frame image in the original background video to the controller 14 so that the controller 14 generates a control signal for the i-th frame image according to the image data of the i-th frame image.

[0075] In some embodiments, the camera 12 is further configured to shoot the i+1th frame background image and the target object located on the light-emitting side of the display screen 15 to obtain a second target image, and send the second target image to the video server 20 .

[0076] The video server 20 is further configured to obtain standard image information corresponding to the background image and / or the target object in the second target image from the database, and generate a standard image according to the standard image information and the second target image.

[0077] In some embodiments, Figure 2 As shown, the shooting device 30 also includes a positioning tracker 11. The positioning tracker 11 is configured to track the camera 12, and at least generate the position information of the camera 12, and transmit the position information of the camera 12 to the video server 20, so that the video server expands the standard picture according to the position information to obtain output picture information.

[0078] Meanwhile, the video server 20 includes: a main control module 21 and a rendering module 22. The rendering module 22 is configured to generate extended picture information according to the standard picture information and the position information of the camera 12; the main control module 21 is configured to generate output picture information according to the extended picture information.

[0079] In some embodiments, the present disclosure provides a display control method, including: Step S10 to Step S30:

[0080] Step S10, generating a control signal for the i-th frame image according to the i-th frame image data, and sending the control signal for the i-th frame image to the display screen so that the display screen displays the i-th frame background picture; i is a positive integer greater than or equal to 1.

[0081] Step S20: photograph the i-th background frame and the target object located on the light-emitting side of the display screen to obtain a first target frame.

[0082] Step S30: compare the first target image with the preset target image to obtain correction information, generate a control signal for the i+1th frame image based on the correction information and the i+1th frame image data, and send the control signal for the i+1th frame image to the display screen so that the display screen displays the i+1th frame background image.

[0083] In some embodiments, the present disclosure provides a shooting method, which is implemented based on the shooting system described in any embodiment of the present disclosure. The shooting method of the present disclosure includes steps S1 to S3:

[0084] Step S1, the controller generates a control signal of the i-th frame image according to the i-th frame image data, and sends the control signal of the i-th frame image to the display screen, so that the display screen 15 displays the i-th frame background picture, where i is a positive integer greater than or equal to 1.

[0085] Step S2 , the camera 12 shoots the i-th frame background image and the target object located on the light-emitting side of the display screen 15 to obtain a first target image, and sends the first target image to the controller 14 .

[0086] Step S3, the controller 14 compares the first target image with the preset target image to obtain correction information, and generates a control signal for the i+1th frame image using the correction information and the i+1th frame image data, and sends the control signal for the i+1th frame image to the display screen 15, so that the display screen 15 displays the i+1th frame background image.

[0087] Figure 3 is a processing flow chart of a controller in some embodiments of the present disclosure, specifically, Figure 3 In the controller shown, the processing process of the first target picture includes: collecting image information of the first target picture according to the acquired first target picture, and comparing it with the image information of the preset target picture, analyzing the comparison data to generate correction information, and transmitting the correction information to the controller 14 so that the controller 14 generates a control signal of the i+1th frame image according to the correction information and the i+1th frame image data, and sending the control signal of the i+1th frame image to the display screen 15 so that the display screen 15 displays the i+1th frame background picture. The i+1th frame background picture is the corrected background picture.

[0088] In some other embodiments, a photographing method disclosed herein includes, in addition to steps S1 to S3, steps S4 and S5;

[0089] Step S4, the camera 12 shoots the i+1th frame background image and the target object on the light-emitting side of the display screen 15 to obtain a second target image, and sends it to the video server 20;

[0090] Step S5: The video server 20 obtains standard image information corresponding to the background image and / or the target object in the second target image from the database, and generates a standard image according to the standard image information and the second target image.

[0091] To sum up, the embodiment of the present disclosure can obtain correction information through the previous frame background picture and the first target picture of the target object taken by the camera 12, and use the correction information and the image data of the next frame to generate a control signal for the next frame image to adjust the next frame background picture. Therefore, the embodiment of the present disclosure can realize real-time correction of the background picture, improve shooting efficiency, ensure shooting effect, and save shooting costs.

[0092] In some embodiments, the signal synchronizer 13 sends synchronization signals to the video server 20 and the positioning tracker 11 in addition to sending synchronization signals to the camera 12 and the controller 14. After receiving the synchronization signals, the video server 20, the positioning tracker 11, the camera 12 and the controller 14 perform clock synchronization.

[0093] In some embodiments, the shooting system further includes an output picture monitor. The output picture monitor is connected to the video server 20. The output picture monitor is used to display the output picture information generated by the video server 20 after rendering and expansion.

[0094] In some embodiments, the shooting system further includes a field monitor. The field monitor can be any device with a display function, such as an electronic device. The field monitor is connected to the video server 20. The field monitor is used to display the positioning tracking information sent by the positioning tracker 11 to the video server 20. The positioning tracking information includes but is not limited to the position information of the camera 12 and the shooting angle data.

[0095] In other embodiments, the positioning tracker 11 is also used to track the position information and shooting angle data of the shooting target and the position information and angle data of the display screen, and send the above positioning tracking information to the video server 20. In this case, the positioning tracking information also includes but is not limited to the position information and shooting angle data of the camera 12, and the position information and angle data of the display screen.

[0096] In some embodiments, the shooting system further includes a switch. For example, the switch may be a gigabit switch. The switch is respectively connected to the camera 12, the positioning tracker 11, the controller 14, the signal synchronizer 13, and the video server 20. The switch is used to provide a communication link for communication between the camera 12, the positioning tracker 11, the controller 14, the signal synchronizer 13, and the video server 20.

[0097] In some embodiments, the shooting system further includes an output screen display. The output screen display is connected to the video server 20. The output screen display is used to receive output screen information output by the video server 20 and display a screen corresponding to the output screen information.

[0098] As an emerging technology that has developed rapidly in recent years, XR virtual shooting technology, driven by the rapid iteration of future technologies and innovative demand, has become a rising star in the fields of film and television production and has significant advantages in spatial three-dimensional shooting effects.

[0099] The technical field of XR virtual shooting covers digital virtual shooting technology, real-time rendering technology, motion capture, and LED digital virtual shooting mobile control systems.

[0100] Among them, digital virtual shooting technology is a new type of film and television production technology. Its basic principle is to achieve a perfect fusion of real scenes and virtual scenes through computer-generated virtual scenes and digital special effects on the basis of real-scene shooting, so as to achieve a realistic on-site shooting effect. This technology can realize scenes that could not be achieved by real-scene shooting alone before, providing new possibilities for digital virtual shooting production, and has been widely used in film and television dramas and even in the field of pan-entertainment.

[0101] Real-time rendering technology and motion capture are indispensable technologies in virtual filming. Real-time rendering technology can instantly generate high-quality images during filming, while motion capture is used to capture the movements and performances of actors so that they can be accurately replicated in virtual scenes.

[0102] The LED digital virtual shooting motion control system is developed based on the Unreal engine. With its real-time visual method of "what you see is what you get", it has taken a big step forward in the exploration of digital and realistic technology in film and television production. This system achieves the "what you see is what you get" effect through the curved LED display screen wall and real-time rendering technology, enhancing the actors' sense of performance, while also allowing the director and visual effects team and other creative teams to immediately discover problems and deal with and provide feedback at the moment of shooting.

[0103] In addition, the application of virtual shooting technology has also expanded to advertising production, documentary production, education and other fields. For example, in advertising production, virtual shooting technology can more vividly display product features and brand image; in documentary production, this technology can help directors break through the limitations of actual shooting and present some difficult-to-capture natural phenomena and historical events to the audience in a more vivid and vivid way; in the field of education, virtual shooting technology can simulate the occurrence of historical events, the structure and function of organisms and other complex processes, and enhance students' ability to understand knowledge points.

[0104] It will be appreciated by those skilled in the art that all or some of the steps, systems, and modules / units in the disclosed methods above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In hardware implementations, the division between the modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0105] It is to be understood that the above embodiments are merely exemplary embodiments used to illustrate the principles of the present disclosure, but the present disclosure is not limited thereto. For those of ordinary skill in the art, various modifications and improvements can be made without departing from the spirit and substance of the present disclosure, and these modifications and improvements are also considered to be within the scope of protection of the present disclosure.

Claims

1. A display control device, characterized in that: include: A camera and a controller; wherein, The controller is configured to generate a control signal for the i-th frame of image according to the i-th frame of image data, and send the control signal for the i-th frame of image to the display screen, so that the display screen displays the i-th frame of background picture; i is a positive integer greater than or equal to 1; The camera is configured to shoot the i-th background image and the target object located at the light-emitting side of the display screen to obtain a first target image, and send the first target image to the controller; The controller is also configured to compare the first target image with a preset target image to obtain correction information, generate a control signal for the i+1th frame image based on the correction information and the i+1th frame image data, and send the control signal for the i+1th frame image to the display screen so that the display screen displays the i+1th frame background image.

2. The display control device according to claim 1, characterized in that: The display control device also includes a signal synchronizer; The signal synchronizer is configured to send synchronization signals to the camera and the controller respectively, so that the controller sends a control signal of the i-th frame image to the display screen in response to the synchronization signal, and at the same time, the camera responds to the synchronization signal to shoot the i-th frame background image and the target object located on the light-emitting side of the display screen.

3. The display control device according to claim 2, characterized in that: The signal synchronizer is further configured to send the first target image generated by the camera to the controller after sending synchronization signals to the camera and the controller respectively.

4. The display control device according to any one of claims 1 to 3, characterized in that: The i-th frame image data and the i+1-th frame image data are sent to the controller by the video server; The camera is also configured to shoot the background picture of the i+1th frame and the target object on the light-emitting side of the display screen to obtain a second target picture, and send the second target picture to the video server so that the video server can obtain standard image information corresponding to the background picture and / or the target object in the second target picture from the database, and generate a standard picture based on the standard image information and the second target picture.

5. The display control device according to claim 4, characterized in that: The shooting device also includes a positioning tracker; The positioning tracker is configured to position and track the camera, at least generate the position information of the camera, and transmit the position information to the video server, so that the video server expands the standard picture according to the position information to obtain output picture information, and outputs the corresponding picture according to the output picture information in response to the picture output instruction.

6. A photographing device, characterized in that: include: A display screen, a display control device as claimed in any one of claims 1 to 5.

7. A shooting system, characterized in that: include: The photographing device as claimed in claim 6; Video server; The video server is configured to send image data of each frame image in the original background video to the controller according to the original background video.

8. The photographing system according to claim 7, characterized in that: The camera is further configured to shoot the background picture of the (i+1)th frame and the target object located on the light-emitting side of the display screen to obtain a second target picture, and send the second target picture to the video server; The video server is further configured to obtain standard image information corresponding to the background image and / or the target object in the second target image from a database, and generate a standard image according to the standard image information and the second target image.

9. The photographing system according to claim 8, characterized in that: The shooting device also includes a positioning tracker; The positioning tracker is configured to perform positioning tracking on the camera, generate position information of the camera, and transmit the position information to the video server; The video server includes: a main control module and a rendering module. The rendering module is configured to generate extended picture information according to the information of the standard picture and the position information of the camera; The main control module is configured to generate output screen information according to the extended screen information.

10. A display control method, characterized in that: include: Generate a control signal for the i-th frame of image according to the i-th frame of image data, and send the control signal for the i-th frame of image to a display screen, so that the display screen displays the i-th frame of background image; i is a positive integer greater than or equal to 1; Shooting the i-th background image and the target object located on the light-emitting side of the display screen to obtain a first target image; The first target picture is compared with the preset target picture to obtain correction information, and the correction information and the i+1th frame image data are used to generate a control signal for the i+1th frame image, and the control signal for the i+1th frame image is sent to the display screen so that the display screen displays the i+1th frame background picture.

Images