Virtual shooting display methods, devices, systems and software products

Abstract

This application relates to the field of display technology, and more particularly to virtual shooting display methods, devices, systems, and program products. The system includes a background display screen, a simulated light source, a sensing module, and a control module. The simulated light source receives light source control signals from the control module to determine its operating state. The sensing module collects information about foreground objects in the shooting scene. The control module determines the light source information based on the light source control signals, and based on the light source information and foreground object information, determines the brightness information of the shadow area of ​​the foreground object, and controls the background display screen to display the shadow area based on the brightness information. This display system enables the foreground object to reliably produce shadow effects, improving the realism of the captured image and thus increasing the efficiency of film and television production.

Description

Technical Field

[0001] This application relates to the field of display, and more particularly to virtual shooting display methods, devices, systems, and program products. Background Technology

[0002] Virtual filming refers to a process where actors perform within a studio using a computer-generated virtual digital background or environment. The performance is then seamlessly integrated into the final image using camera tracking, real-time rendering, and compositing technologies. LED displays, with their advantages of high brightness and vibrant colors, are increasingly being used in virtual filming.

[0003] In real-world scenes, foreground objects (such as actors) block light, typically casting shadows on the background. However, when using an LED display screen as a background for virtual filming, the LED screen itself is a high-intensity, uniformly emitting surface light source. When the foreground object is illuminated by a separate simulated light source, the shadow it should cast is "diluted" or even completely obscured by the strong light emitted by the LED screen. This results in the foreground object lacking a clear shadow effect, easily causing visual distortion and impacting post-production efficiency in film and television production. Summary of the Invention

[0004] In view of this, embodiments of this application provide a virtual shooting display method, device, system, and program product to solve the problem that in the prior art, the foreground object does not have obvious shadow effects, which easily causes visual distortion and affects the efficiency of film and television creation during post-processing.

[0005] A first aspect of this application provides a virtual shooting display system, the system comprising a background display screen, an analog light source, a sensing module, and a control module, wherein: The simulated light source is used to receive the light source control signal from the control module to determine the working state of the simulated light source; The sensing module is used to collect information about foreground objects in the shooting scene; The control module is used to determine light source information based on the light source control signal, determine the brightness information of the shadow area of ​​the foreground object based on the light source information and the foreground object information, and control the background display screen to display the shadow area based on the brightness information.

[0006] In conjunction with the first aspect, in a first possible implementation of the first aspect, the foreground object information includes the position and shape of the foreground object, and the light source information includes the position, light emission direction, and luminous intensity of the simulated light source. Based on the light source information and the foreground object information, the brightness information of the shadow area of ​​the foreground object is determined, including: Based on the position and shape of the foreground object, and in conjunction with the position and light emission direction of the simulated light source, the shadow area of ​​the foreground object is determined; The brightness information of the shadow area is determined based on the position and shape of the foreground object, the position of the simulated light source, the light emission direction, and the light emission intensity.

[0007] In conjunction with the first possible implementation of the first aspect, in the second possible implementation of the first aspect, the simulated light source includes multiple point light sources; Based on the position and shape of the foreground object, and in conjunction with the position and light emission direction of the simulated light source, the shadow area of ​​the foreground object is determined, including: Based on the position and shape of the foreground object, and combined with the position and light emission direction of multiple point light sources, the umbra area that cannot be reached by all point light sources in the background display screen, and the penumbra area that cannot be reached by some point light sources are determined. The shadow area of ​​the foreground object is determined based on the umbra and the penumbra.

[0008] In conjunction with the first possible implementation of the first aspect, in the third possible implementation of the first aspect, the simulated light source includes multiple point light sources; Based on the position and shape of the foreground object, the position, light emission direction, and luminous intensity of the simulated light source, the brightness information of the shadow area is determined, including: Based on the position and shape of the foreground object, the position of the point light source, the light emission direction and the light emission intensity, determine the first illuminance of the pixels of the background display screen in the shadow area; Determine the second illuminance of the pixel when it is completely unobstructed; The brightness information of the pixels in the shadow area is determined based on the ratio of the first illuminance to the second illuminance.

[0009] In conjunction with the third possible implementation of the first aspect, in the fourth possible implementation of the first aspect, determining the brightness information of the pixels in the shadow region based on the ratio of the first illuminance to the second illuminance includes: Obtain the initial brightness of the pixels of the background display screen in the shadow area; A first adjustment coefficient is determined based on the ratio of the first illuminance to the second illuminance, and a second adjustment coefficient is determined based on the ambient light. The initial brightness is adjusted according to the first adjustment coefficient and the second adjustment coefficient to determine the brightness information of the pixel.

[0010] In conjunction with the third possible implementation of the first aspect, in the fifth possible implementation of the first aspect, determining the first illuminance of the pixels of the background display screen in the shadow area based on the position and shape of the foreground object, the position, light emission direction, and light emission intensity of the point light source includes: Based on the position and shape of the foreground object, the position and light emission direction of the point light source, determine all point light sources that the pixel can receive the illuminating light from; Determine the distances between the pixel and all point light sources capable of receiving illumination light. Based on the distance and the luminous intensity of the point light source, determine the first illuminance of all point light sources capable of receiving illumination light at the pixel point.

[0011] In conjunction with the first aspect, in the sixth possible implementation of the first aspect, the background display screen is an LED display screen, and the pixel pitch of the LED display screen is determined according to the shooting distance of the minimum close-up scene during shooting.

[0012] A second aspect of this application provides a virtual shooting display method, the method being based on the virtual shooting display system described in any of the first aspects, the method comprising: The light source information is determined based on the light source control signal that drives the simulated light source; Information about foreground objects in the shooting scene is obtained through the sensing module; Based on the light source information and the foreground object information, determine the brightness information of the shadow area of ​​the foreground object; The background display screen is controlled to display the shadow area based on the brightness information.

[0013] A third aspect of this application provides a virtual shooting display device, the device being based on the virtual shooting display system according to any one of the first aspects, the device comprising: A light source information determination unit is used to determine light source information based on the light source control signal that drives the simulated light source; The foreground object information determination unit is used to acquire foreground object information in the shooting scene through the sensing module; A brightness information determination unit is used to determine the brightness information of the shadow area of ​​the foreground object based on the light source information and the foreground object information; The display control unit is used to control the background display screen to display the shadow area based on the brightness information.

[0014] A fourth aspect of this application provides a computer program product that, when run on a computer, causes the computer to perform the method described in the second aspect.

[0015] A fifth aspect of this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the method described in the second aspect.

[0016] A sixth aspect of this application provides a chip for implementing the methods in the various implementations of the first aspect described above. Specifically, the chip includes a processor for calling and running a computer program from a memory, causing a device equipped with the chip to perform the methods of the first aspect described above.

[0017] The beneficial effects of this application embodiment compared with the prior art are as follows: The virtual shooting display system in this application embodiment sends a light source control signal to the simulated light source through the control module, determines the light source information based on the light source control signal, collects the foreground object information in the shooting scene through the sensing module, determines the brightness information of the shadow area of ​​the foreground object based on the light source information and the foreground object information, and controls the background display screen to display the shadow area of ​​the foreground object based on the brightness information, thereby enabling the shooting foreground object to reliably produce a shadow effect, improving the realism of the shot, and helping to improve the efficiency of film and television creation. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a schematic diagram of the structure of a virtual shooting display system provided in an embodiment of this application; Figure 2 This is a schematic diagram illustrating the determination of a shaded area according to an embodiment of this application; Figure 3 This is a schematic diagram illustrating the implementation process of determining the brightness information of pixels in a shadow region, provided in an embodiment of this application. Figure 4 This is a schematic diagram illustrating the implementation process of determining the brightness information of pixels in a shadow region, provided in an embodiment of this application. Figure 5 This is a schematic diagram of the structure of a virtual shooting display system provided in an embodiment of this application; Figure 6 This is a schematic diagram illustrating the implementation process of a virtual shooting and display method provided in an embodiment of this application; Figure 7 This is a schematic diagram of a virtual shooting display device provided in an embodiment of this application; Figure 8 This is a schematic diagram of a virtual shooting display system provided in an embodiment of this application. Detailed Implementation

[0020] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0021] To illustrate the technical solution described in this application, specific embodiments are provided below.

[0022] Virtual filming is a production technique implemented in a film studio. Its core involves actors performing in front of a computer-generated virtual digital background. Through camera tracking, real-time rendering, and compositing, the foreground performance is directly blended with the digital background on set, generating the final image in real time.

[0023] In recent years, LED displays, with their advantages of high brightness and high color performance, have begun to be used in virtual filming as a display medium for presenting virtual backgrounds. However, this application also introduces a specific technical challenge: in the real world, when foreground objects (such as actors) are illuminated by a light source, they form natural shadows on the background. But in virtual filming scenes, when an LED display serves as a background, it is itself a high-intensity, uniformly luminous plane. When foreground objects are illuminated by independent simulated light sources (such as studio lights) and cast shadows, the strong light emitted by the LED screen itself can "dilute" or even completely obscure the shadows that should be projected onto its surface. This results in foreground objects appearing to "float" above the background in the captured footage, lacking the proper shadows and causing visual distortion. To solve this problem, complex post-processing is usually required to add shadows, which undoubtedly affects the efficiency of film and television production.

[0024] To address the aforementioned problems, embodiments of this application propose a virtual shooting display system, such as... Figure 1 The diagram shows the structure of the system, which includes a background display screen 1, an analog light source 2, a sensing module 3, and a control module 4. The simulated light source 2 is used to receive light source control signals from the control module 4 to determine the operating state of the simulated light source. The simulated light source may include multiple point light sources. The operating state of the simulated light source 2 includes the operating state of each point light source. The operating state of the simulated light source 2 includes whether the simulated light source is in an on or off state. The operating state of each point light source may include whether the point light source is in an on or off state.

[0025] In possible implementations, when the simulated light source can be adjusted to different light emission directions, the operating state of the simulated light source 2 can also include the light emission direction of the simulated light source 2. By determining the light emission direction of the simulated light source 2, it is possible to accurately determine whether the light emitted by the simulated light source 2 can reach the pixels in the background display screen, which facilitates the identification of foreground objects in the shooting scene, including shadow areas formed by actors or other objects.

[0026] The light source control signal sent by the control module 4 to the simulated light source 2 may include the on / off control signal of the simulated light source 2, or it may include both the on / off control signal and the light emission direction control signal of the simulated light source. The control module 4 can determine the light source control signal based on preset parameters, or it can receive state adjustment commands, such as those triggered by buttons, a touchscreen, or voice commands, to generate the light source control signal. Alternatively, the control module 4 can intelligently generate the light source control signal based on the shooting scene.

[0027] Sensing module 3 is used to collect information about foreground objects in the shooting scene. These foreground objects may include actors, props, and other physical objects entering the shooting area. The collected foreground object information includes the position and shape of the foreground object. The position of the foreground object refers to its three-dimensional spatial location within the shooting scene. The shape of the foreground object includes its form and size. Sensing module 3 can utilize one or more depth cameras, LiDAR, distance sensors, or a conventional camera array incorporating computer vision. Sensing module 3 can transmit this collected information to control module 4 in real time.

[0028] The control module 4 is used to determine the light source information according to the light source control signal, determine the brightness information of the shadow area of ​​the foreground object according to the light source information and the foreground object information, and control the background display screen to display the shadow area according to the brightness information.

[0029] The control module 4 can calculate or analyze the light source information of the simulated light source 2 based on the light source control signal currently sent to the simulated light source 2, including the simulated light source 2 in the open state (or including the point light source in the open state), the light output direction of the simulated light source 2 in the open state, and the light output intensity of the simulated light source 2 in the open state.

[0030] When determining the brightness information of the shadow area of ​​a foreground object based on light source information and foreground object information, the shadow area can be determined by considering the position and shape of the foreground object, combined with the position and light emission direction of the simulated light source. The brightness information of the shadow area can be determined based on the position and shape of the foreground object, the position of the simulated light source, the light emission direction, and the luminous intensity.

[0031] In other words, based on the light source information and foreground object information, the spatial relationship between the simulated light source 2, the foreground object, and the background display screen 1 can be constructed. Based on this spatial relationship, rays originating from the simulated light source and passing through the outline of the foreground object can be generated. The intersection of multiple rays at the background display screen 1 yields the shadow area of ​​the foreground object on the background display screen; that is, the shadow area of ​​the foreground object on the background display screen 1 is determined based on the occlusion information of the simulated light source by the foreground object. The brightness information within the shadow area is determined based on the light intensity received by the simulated light source 2.

[0032] The simulated light source 2 in this embodiment may include one or more point light sources. When the simulated light source includes multiple point light sources, the umbra area that cannot be reached by all point light sources on the background display screen and the penumbra area that some point light sources cannot reach can be determined based on the position and shape of the foreground object and the position and light emission direction of the multiple point light sources. The shadow area of ​​the foreground object can be determined based on the umbra area and the penumbra area.

[0033] The umbra is the intersection of the shadows cast by all point light sources based on the foreground object, while the penumbra is the area outside the intersection of the shadows cast by all point light sources based on the foreground object. Assuming the simulated light source includes N point light sources, the area where none of the N point light sources can reach due to occlusion by the foreground object is the umbra, and the area where one to N-1 point light sources cannot reach is the penumbra.

[0034] for example Figure 2In the schematic diagram illustrating the determination of the shadow area, the simulated light source 2 includes two point sources: a first point source 21 and a second point source 22. Based on the light emission direction of the first point source 21, the first shadow area formed by the foreground object 5 on the background display screen 1 can be determined. Based on the light emission direction of the second point source 22, the second shadow area formed by the foreground object 5 on the background display screen 1 can be determined. Based on the union of the first and second shadow areas, the shadow area of ​​the foreground object 5 on the background display screen 1 can be obtained. This shadow area includes the umbra and the penumbra. The umbra is the area that neither the first nor the second point source 22 can illuminate. The penumbra is the area that only the first point source 21 and only the second point source 22 can illuminate. Based on the light emission intensity of the first and second point sources 21, combined with the distances between the first and second point sources 21 and the pixels in the shadow area of ​​the background display screen 1, the brightness information of each pixel in the shadow area of ​​the background display screen 1 can be determined. Based on the brightness information, each pixel in the background display screen 1 is controlled to emit light, thereby forming a shadow in the shadow area of ​​the background display screen. That is, the shadow can be achieved by adjusting the brightness of the background display screen.

[0035] In this embodiment of the application, when the simulated light source includes multiple point light sources, the control module 4 determines the brightness information of the pixels in the shadow area based on the position and shape of the foreground object, the position of the simulated light source, the light emission direction, and the luminous intensity. This can be achieved as follows: Figure 3 As shown, it includes: In S301, the first illuminance of the pixels of the background display screen in the shadow area is determined based on the position and shape of the foreground object, the position of the point light source, the light emission direction and the light emission intensity.

[0036] Based on the position and shape of the foreground object, and the spatial relationship constructed by combining the light emission direction and position of the point light sources, it is possible to determine all the point light sources that can receive illumination light for each pixel in the shadow area of ​​the background display screen (for LED displays, each pixel corresponds to one LED light). After determining all the point light sources that can receive illumination light, based on the positions of the point light sources and the positions of the pixels in the shadow area, the distances between the pixel and all the point light sources that can receive illumination light are determined. Based on the distances and the luminous intensity of the point light sources, the first illuminance of all the point light sources that can receive illumination light at that pixel can be determined.

[0037] For example, based on the position and direction of the point light source, and the position and shape of the foreground object, the first pixel in the shadow area (the pixel in the background display screen) and multiple point light sources can be determined. For instance, if the distances to M point light sources are d1, d2, ..., dm, then in the absence of obstruction, the illuminance produced by each point light source at the first pixel is: E1 = I / d1 2 E2=I / d2 2 ..., Em = I / dm 2 Where I is the luminous intensity of the point light source, Ei is the illuminance produced by the i-th point light source at the first pixel, and di is the distance between the i-th point light source and the first pixel. First illuminance It can be represented as: Where Ei(P) is the illuminance of the i-th light source at pixel P when there is no occlusion. Let αi be the obstruction factor of pixel P relative to the i-th light source. αi=0 means that pixel P is blocked by the foreground object and cannot receive the light from the i-th light source, while αi=1 means that pixel P can receive the light from the i-th light source.

[0038] In S302, the second illuminance of the pixel when it is completely unobstructed is determined.

[0039] To determine the impact of foreground object occlusion on the brightness of the background display, it is necessary to determine the secondary illuminance produced by multiple point light sources in the shadow area when there is no foreground object. The secondary illuminance of pixel P when it is completely unoccluded. It can be represented as: .

[0040] In S303, the brightness information of the pixel in the shadow area is determined based on the ratio of the first illuminance to the second illuminance.

[0041] The ratio of pixel P under the first illuminance to the second illuminance. , can be represented as: , which represents the ratio of the brightness of pixel P to its normal, unobstructed brightness. When determining the brightness information of pixel P in the shadow area based on this ratio, the brightness information of the pixel can be determined by multiplying the initial brightness of the pixel (the brightness when the background image is displayed normally) by this ratio.

[0042] In possible implementations, to further optimize the brightness information of the adjusted pixels and increase the realism of the adjusted shadows, embodiments of this application may, when determining the brightness information of pixels in the shadow area, also... Figure 4 As shown, it includes: In S401, the initial brightness of the pixels of the background display screen in the shadow area is obtained.

[0043] The initial brightness of the pixels in the shadowed area of ​​the background display screen is the brightness of the pixel when it normally displays the background image. This initial brightness is determined based on the content displayed on the background display screen. When the pixel is not in the shadowed area, displaying the pixel at its normal brightness can effectively provide a realistic display of the background content.

[0044] In S402, a first adjustment coefficient is determined based on the ratio of the first illuminance to the second illuminance, and a second adjustment coefficient is determined based on the ambient light.

[0045] Based on the first adjustment coefficient determined by the ratio of the first illuminance to the second illuminance, a second adjustment coefficient determined by the ambient light is introduced to fully consider the influence of ambient light. The second adjustment coefficient can be a constant or it can vary according to the current ambient brightness. For example, the higher the ambient light brightness, the larger the value of the second adjustment coefficient; conversely, the lower the ambient light brightness, the smaller the value of the second adjustment coefficient.

[0046] In possible implementations, the second adjustment coefficient can be positively correlated with the degree of occlusion of the pixel; the higher the degree of occlusion, the larger the second adjustment coefficient, and the greater the increase in brightness through the second adjustment coefficient. Since the ratio of the first illuminance to the second illuminance is negatively correlated with the degree of occlusion, the second adjustment coefficient is also negatively correlated with this ratio. The larger the ratio of the first illuminance to the second illuminance, the smaller the second adjustment coefficient; and vice versa. This allows for the introduction of more ambient light when a pixel is more occluded, preventing the pixel from being in a completely dark, distorted state.

[0047] In other words, by introducing a second adjustment coefficient corresponding to ambient light factors, even if a pixel is in the umbra, it will not be in a completely dark state, thereby further increasing the realism of shadow display.

[0048] For example, the second adjustment coefficient Kc can be expressed as (1-Krelative)1%, where Krelative represents the first adjustment coefficient.

[0049] In S403, the initial brightness is adjusted according to the first adjustment coefficient and the second adjustment coefficient to determine the brightness information of the pixel.

[0050] When adjusting the initial brightness using a first adjustment coefficient and a second adjustment coefficient, the larger the first adjustment coefficient, the greater the brightness of the pixel; the larger the second adjustment coefficient, the greater the brightness of the pixel.

[0051] Assuming the initial brightness of pixel P is L0, after adjustment using the first adjustment coefficient Krelative and the second adjustment coefficient Kc, the adjusted brightness information L of the pixel is... TIt can be represented as: LT=L0 (K relative + Kc).

[0052] The adjusted brightness information is used to control the brightness display of that pixel. Similarly, the brightness of each pixel in the shadow area is adjusted to regulate the display, enabling the background display to output an image that includes the shadows of foreground objects. This ensures that the captured image includes the shadows of foreground objects, improving visual realism and eliminating the need for post-processing of shadows, thus enhancing the efficiency of film and television production.

[0053] Assume the shooting scene includes two point light sources, namely the first point light source and the second point light source. A pixel P in the scene is d away from each point light source. In the shadow area of ​​the image displayed on the background screen, the initial brightness of pixel P is 600 nits. If only the light from the first point light source to pixel P is blocked by a foreground object, then the first adjustment factor is 0.5, and the second adjustment factor is (1-0.5). 1% = 0.5%, the corrected brightness information is: LT = L0 (K relative + Kc) = 600 (0.5+0.5) 1%) = 303nit.

[0054] In possible implementations, the control module in this application embodiment may include multiple sub-modules. For example... Figure 5 In the system structure diagram shown, the control module may include an analog light source signal output module 41, a display content output module 42, and a signal processor 43. Wherein: The analog light source signal output module 41 can be used to send light source information such as the position, light output direction and light intensity of the analog light source to drive the analog light source 2, and send the light source information to the signal processor 43.

[0055] The sensing module 3 is used to collect information about the foreground object, such as its position and shape, and send it to the signal processor 43.

[0056] The signal processor 43 is used to determine the brightness information of the shadow area of ​​the foreground object based on the light source information and the foreground object information, combined with the initial display signal of the display content output module 42, and to form a final display drive signal based on the brightness information of the shadow area of ​​the foreground object, and send it to the display content output module 42.

[0057] The display content output module 42 is used to receive the brightness information of the shadow area of ​​the foreground object sent by the signal processor 43, and adjust the display brightness of the background display screen 1 in the shadow area.

[0058] It is understood that there may be other ways to divide the functions of the control module, and this application does not make specific limitations.

[0059] In a possible implementation, the background display screen in this embodiment can be an LED display screen, and the pixel pitch of the LED display screen is determined based on the minimum close-up scene shooting distance. For example, assuming the minimum close-up scene shooting distance is L, the pixel pitch P of the LED display screen can be expressed as: minimum shooting distance L / 1000. Assuming the minimum close-up scene shooting distance is 2.5m, then the pixel pitch of the LED display screen is 2.5mm.

[0060] Figure 6 This is a schematic diagram illustrating the implementation process of a virtual shooting and display method provided in an embodiment of this application. The method is based on... Figure 1 The virtual shooting display device shown, the method includes: In S601, light source information is determined based on the light source control signal that drives the analog light source.

[0061] In the S602, information about foreground objects in the shooting scene is obtained through the sensing module.

[0062] In S603, the brightness information of the shadow area of ​​the foreground object is determined based on the light source information and the foreground object information.

[0063] In S604, the background display screen is controlled to display the shadow area based on the brightness information.

[0064] Figure 6 The virtual shooting display method shown corresponds to the virtual shooting display system described above.

[0065] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0066] Figure 7 This is a schematic diagram of a virtual shooting display device provided in an embodiment of this application. The device is based on... Figure 1 The virtual shooting display system shown includes: The light source information determination unit 701 is used to determine light source information based on the light source control signal that drives the simulated light source.

[0067] The foreground object information determination unit 702 is used to obtain foreground object information in the shooting scene through the sensing module.

[0068] The brightness information determination unit 703 is used to determine the brightness information of the shadow area of ​​the foreground object based on the light source information and the foreground object information.

[0069] Display control unit 704 is used to control the background display screen to display the shadow area according to the brightness information.

[0070] Figure 8 This is a schematic diagram of a virtual shooting display system provided in an embodiment of this application. Figure 8 As shown, the virtual shooting display system 8 of this embodiment includes: a processor 80, a memory 81, and a computer program 82, such as a virtual shooting display program, stored in the memory 81 and executable on the processor 80. When the processor 80 executes the computer program 82, it implements the steps in the various virtual shooting display method embodiments described above. Alternatively, when the processor 80 executes the computer program 82, it implements the functions of each module / unit in the various device embodiments described above.

[0071] For example, the computer program 82 can be divided into one or more modules / units, which are stored in the memory 81 and executed by the processor 80 to complete this application. The one or more modules / units can be a series of computer program instruction segments capable of performing specific functions, which describe the execution process of the computer program 82 in the virtual shooting display system 8.

[0072] The virtual shooting display system may include, but is not limited to, a processor 80 and a memory 81. Those skilled in the art will understand that... Figure 8 This is merely an example of a virtual shooting display system 8 and does not constitute a limitation on the virtual shooting display system 8. It may include more or fewer components than shown, or combine certain components, or different components. For example, the virtual shooting display system may also include input / output devices, network access devices, buses, etc.

[0073] The processor 80 may be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.

[0074] The memory 81 can be an internal storage unit of the virtual shooting display system 8, such as a hard disk or memory of the virtual shooting display system 8. The memory 81 can also be an external storage device of the virtual shooting display system 8, such as a plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the virtual shooting display system 8. Furthermore, the memory 81 can include both internal storage units and external storage devices of the virtual shooting display system 8. The memory 81 is used to store the computer program and other programs and data required by the virtual shooting display system. The memory 81 can also be used to temporarily store data that has been output or will be output.

[0075] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0076] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0077] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0078] In the embodiments provided in this application, it should be understood that the disclosed devices / terminal equipment and methods can be implemented in other ways. For example, the device / terminal equipment embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling or direct coupling or communication connection may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0079] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0080] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0081] If the integrated module / unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by hardware related to computer program instructions. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc.

[0082] In addition, this application also provides a computer program product that, when run on a computer, causes the computer to execute the methods in the above-described implementations.

[0083] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A virtual shooting display system, characterized in that, The system includes a background display screen, an analog light source, a sensing module, and a control module, wherein: The simulated light source is used to receive the light source control signal from the control module to determine the working state of the simulated light source; The sensing module is used to collect information about foreground objects in the shooting scene; The control module is used to determine light source information based on the light source control signal, determine the brightness information of the shadow area of ​​the foreground object based on the light source information and the foreground object information, and control the background display screen to display the shadow area based on the brightness information.

2. The virtual shooting display system according to claim 1, characterized in that, The foreground object information includes the position and shape of the foreground object, and the light source information includes the position, light emission direction, and luminous intensity of the simulated light source. Based on the light source information and the foreground object information, the brightness information of the shadow area of ​​the foreground object is determined, including: Based on the position and shape of the foreground object, and in conjunction with the position and light emission direction of the simulated light source, the shadow area of ​​the foreground object is determined; The brightness information of the shadow area is determined based on the position and shape of the foreground object, the position of the simulated light source, the light emission direction, and the light emission intensity.

3. The virtual shooting display system according to claim 2, characterized in that, The simulated light source includes multiple point light sources; Based on the position and shape of the foreground object, and in conjunction with the position and light emission direction of the simulated light source, the shadow area of ​​the foreground object is determined, including: Based on the position and shape of the foreground object, and combined with the position and light emission direction of multiple point light sources, the umbra area that cannot be reached by all point light sources in the background display screen, and the penumbra area that cannot be reached by some point light sources are determined. The shadow area of ​​the foreground object is determined based on the umbra and the penumbra.

4. The virtual shooting display system according to claim 2, characterized in that, The simulated light source includes multiple point light sources; Based on the position and shape of the foreground object, the position, light emission direction, and luminous intensity of the simulated light source, the brightness information of the shadow area is determined, including: Based on the position and shape of the foreground object, the position, light emission direction, and light intensity of the point light source, determine the first illuminance of the pixels of the background display screen in the shadow area; Determine the second illuminance of the pixel when it is completely unobstructed; The brightness information of the pixels in the shadow area is determined based on the ratio of the first illuminance to the second illuminance.

5. The virtual shooting display system according to claim 4, characterized in that, Determining the brightness information of the pixels in the shadow region based on the ratio of the first illuminance to the second illuminance includes: Obtain the initial brightness of the pixels of the background display screen in the shadow area; A first adjustment coefficient is determined based on the ratio of the first illuminance to the second illuminance, and a second adjustment coefficient is determined based on the ambient light. The initial brightness is adjusted according to the first adjustment coefficient and the second adjustment coefficient to determine the brightness information of the pixel.

6. The virtual shooting display system according to claim 4, characterized in that, Based on the position and shape of the foreground object, the position, light emission direction, and luminous intensity of the point light source, the first illuminance of the pixels of the background display screen in the shadow area is determined, including: Based on the position and shape of the foreground object, the position and light emission direction of the point light source, determine all point light sources that the pixel can receive the illuminating light from; Determine the distances between all point light sources capable of receiving illumination light and the pixel; Based on the distance and the luminous intensity of the point light source, determine the first illuminance of all point light sources capable of receiving illumination light at the pixel point.

7. The virtual shooting display system according to claim 1, characterized in that, The background display screen is an LED display screen, and the pixel pitch of the LED display screen is determined according to the shooting distance of the minimum close-up scene during shooting.

8. A virtual shooting display method, characterized in that, The method is based on the virtual shooting display system according to any one of claims 1-7, and the method includes: The light source information is determined based on the light source control signal that drives the simulated light source; Information about foreground objects in the shooting scene is obtained through the sensing module; Based on the light source information and the foreground object information, determine the brightness information of the shadow area of ​​the foreground object; The background display screen is controlled to display the shadow area based on the brightness information.

9. A virtual shooting display device, characterized in that, The device is based on the virtual shooting display system according to any one of claims 1-7, and the device comprises: A light source information determination unit is used to determine light source information based on the light source control signal that drives the simulated light source; The foreground object information determination unit is used to acquire foreground object information in the shooting scene through the sensing module; A brightness information determination unit is used to determine the brightness information of the shadow area of ​​the foreground object based on the light source information and the foreground object information; The display control unit is used to control the background display screen to display the shadow area based on the brightness information.

10. A computer program product comprising computer program instructions, characterized in that, When the computer program is run, the method described in claim 8 is performed.

Images