Lighting control method, device, mobile terminal and storage medium

Abstract

One or more embodiments of the present specification provide a lighting control method, device, mobile terminal and storage medium. The virtual shooting system includes at least one screen, and the screen is used to display a virtual scene; the method includes: in the interactive interface of the mobile terminal, displaying a first adjustment control for adjusting a physical light; in response to the first adjustment control being triggered, obtaining the adjusted lighting parameters of the physical light, and adjusting the physical light according to the adjusted parameters of the physical light; and adjusting the lighting parameters of the first virtual light used to simulate the light and shadow effects of the physical light in the virtual scene according to the adjusted lighting parameters of the physical light, and the adjusted lighting parameters of the first virtual light are used to make the screen display a virtual scene integrated with the adjusted first virtual light. When adjusting the physical light, the first virtual light is automatically linked to improve the authenticity of the virtual scene.

Description

Technical Field

[0001] One or more embodiments of the present specification relate to the field of virtual photography technology, and more particularly, to a lighting control method, device, mobile terminal, and computer-readable storage medium for a virtual photography system. Background Art

[0002] In order to meet the shooting needs, traditional film and television production needs to spend a lot of time and manpower to select shooting locations, make props, and build shooting scenes. Virtual shooting (or virtual production) technology, by rendering visual effects on the LED screen instead of real scenery, reduces the dependence of film and television shooting on locations and scenery, and reduces the cost and production cycle of film and television shooting. Specifically, virtual shooting (or virtual production) technology refers to a series of computer-aided production and visual film production methods. At the shooting site of virtual production, there is at least one screen for displaying virtual scenes, and there are actual scenery props in front of the screen. The camera in virtual shooting will shoot the screen and the scenery in front of the screen at the same time, and obtain a video that combines the screen and the scenery in front of the screen.

[0003] The light and shadow effect in virtual filming is one of the important factors that affect the filming quality. Therefore, it is necessary to provide a lighting control method to control the lighting at the shooting scene of virtual filming. Summary of the invention

[0004] In view of this, one or more embodiments of the present specification provide a lighting control method, device, mobile terminal, and computer-readable storage medium for a virtual shooting system.

[0005] To achieve the above objectives, one or more embodiments of this specification provide the following technical solutions:

[0006] According to a first aspect of one or more embodiments of the present specification, a lighting control method for a virtual shooting system is provided, wherein the virtual shooting system includes at least one screen, and the screen is used to display a virtual scene; the method is applied to a mobile terminal, and the method includes:

[0007] In the interactive interface of the mobile terminal, a first adjustment control for adjusting a physical light in the real scene where the virtual shooting system is located is displayed; the first adjustment control is used to adjust at least one lighting parameter of the physical light;

[0008] In response to the first adjustment control being triggered, acquiring the adjusted light parameters of the physical light, and adjusting the physical light according to the adjusted parameters of the physical light; and

[0009] According to the adjusted lighting parameters of the physical light, the lighting parameters of the first virtual light used to simulate the light and shadow effects of the physical light in the virtual scene are adjusted, and the adjusted lighting parameters of the first virtual light are used to make the screen display a virtual scene that incorporates the adjusted first virtual light.

[0010] In one implementation, the lighting parameter includes at least one of posture information and display attributes;

[0011] The posture information includes the light source position and / or the light source angle; the display attributes include at least one of the light source type, color, light intensity and brightness.

[0012] In one implementation, the interactive interface of the mobile terminal further includes:

[0013] Acquire the position information and display properties of the physical light in the real scene where the virtual shooting system is located;

[0014] According to the posture information of the screen, the posture information and display properties of the physical light, at least one first virtual light is created to simulate the light and shadow effects of the physical light in the virtual scene, and the lighting parameters of the first virtual light are determined. The lighting parameters of the first virtual light are used to make the screen display a virtual scene integrated with the first virtual light.

[0015] In one implementation, the mobile terminal pre-stores a first mapping relationship between different posture information of the camera and the lighting parameters of the physical light, and the first mapping relationship is used to keep the light and shadow effects of different image frames obtained when the camera shoots in different postures consistent;

[0016] The method further comprises:

[0017] In response to a change in the posture of a camera shooting the screen, acquiring a first target light parameter of the entity light according to the changed posture information of the camera and the first mapping relationship;

[0018] adjusting the physical light according to a first target light parameter of the physical light; and

[0019] According to the first target light parameter of the physical light, the light parameter of the first virtual light is adjusted, and the adjusted light parameter of the first virtual light is used to enable the screen to display a virtual scene integrated with the adjusted first virtual light.

[0020] In one implementation, the method further includes:

[0021] In response to a change in the posture of the photographed object, determining the distance and angle between the photographed object and the physical light according to the changed posture information of the photographed object and the posture information of the physical light;

[0022] Acquire a second target light parameter of the physical light according to the distance and angle between the photographed object and the physical light;

[0023] The physical light is adjusted according to the second target light parameter of the physical light; and the light parameter of the first virtual light is adjusted according to the second target light parameter of the physical light, wherein the adjusted light parameter of the first virtual light is used to enable the screen to display a virtual scene integrated with the adjusted first virtual light;

[0024] The second target light parameter is used to ensure that the light and shadow effects of different image frames obtained when the camera shoots objects in different positions remain consistent.

[0025] In one implementation, the mobile terminal pre-stores lighting parameters of physical lights corresponding to different shooting scenes;

[0026] The method further comprises:

[0027] In response to the selection instruction for the different shooting scenes, obtaining a third target light parameter of the physical light corresponding to the selected shooting scene;

[0028] The physical light is adjusted according to the third target light parameter of the physical light; and the light parameters of the first virtual light are adjusted according to the third target light parameter of the physical light, and the adjusted light parameters of the first virtual light are used to make the screen display a virtual scene that integrates the adjusted first virtual light.

[0029] In one implementation, the method further includes:

[0030] In the interactive interface of the mobile terminal, a second adjustment control for adjusting a second virtual light in the virtual scene displayed on the screen is displayed; the second adjustment control is used to adjust at least one light parameter of the second virtual light;

[0031] In response to the adjustment control being triggered, the adjusted light parameters of the second virtual light are obtained, and the adjusted light parameters are used to enable the screen to display a virtual scene integrated with the adjusted second virtual light.

[0032] According to a second aspect of one or more embodiments of the present specification, a lighting control device for a virtual shooting system is provided, wherein the virtual shooting system includes at least one screen, and the screen is used to display a virtual scene; the device is applied to a mobile terminal, and the device includes:

[0033] A control display module, used to display, in the interactive interface of the mobile terminal, a first adjustment control for adjusting a physical light in a real scene where the virtual shooting system is located; the first adjustment control is used to adjust at least one light parameter of the physical light;

[0034] A lighting adjustment module is used to obtain the adjusted lighting parameters of the physical light in response to the first adjustment control being triggered, and adjust the physical light according to the adjusted parameters of the physical light; and adjust the lighting parameters of the first virtual light used to simulate the light and shadow effects of the physical light in the virtual scene according to the adjusted lighting parameters of the physical light, wherein the adjusted lighting parameters of the first virtual light are used to enable the screen to display a virtual scene that incorporates the adjusted first virtual light.

[0035] According to a third aspect of an embodiment of this specification, a mobile terminal is provided, including:

[0036] processor;

[0037] a memory for storing processor-executable instructions;

[0038] When the processor executes the executable instructions, it is used to implement the method described in the first aspect.

[0039] According to a fourth aspect of the embodiments of this specification, there is provided a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of any of the above methods are implemented.

[0040] The technical solutions provided by the embodiments of this specification may have the following beneficial effects:

[0041] In the embodiments of the present specification, a user can control the physical light by operating the first adjustment control in the interactive interface of the mobile terminal. The operation is simple and convenient. The mobile terminal can adjust the physical light based on the adjusted lighting parameters of the physical light. Considering that the physical light will also affect the light and shadow effects in the virtual scene, the lighting parameters of the first virtual light used to simulate the light and shadow effects of the physical light in the virtual scene are adjusted in linkage at the same time, so as to more accurately simulate the real lighting conditions, make the virtual scene better match the actual situation of the on-site scene, thereby enhancing the realism of the virtual scene; the light and shadow changes in the virtual scene are consistent with the physical light in the real scene. This consistency can provide a more natural and coherent visual experience and enhance the sense of immersion.

[0042] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present specification. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1A It is a schematic diagram of a virtual shooting system, physical lights in a real scene where the virtual shooting system is located, and a mobile terminal provided by an exemplary embodiment.

[0044] Figure 1B It is another schematic diagram of a virtual shooting system, physical lights in a real scene where the virtual shooting system is located, and a mobile terminal provided by an exemplary embodiment.

[0045] Figure 2 It is a structural schematic diagram of another virtual shooting system provided by an exemplary embodiment.

[0046] Figure 3 It is a flowchart of a lighting control method provided by an exemplary embodiment.

[0047] Figure 4 It is a schematic diagram of a first interactive interface for a physical light provided by an exemplary embodiment.

[0048] Figure 5 It is a schematic diagram of a second interactive interface for a physical light provided by an exemplary embodiment.

[0049] Figure 6 It is a schematic diagram of a third interactive interface for entity lights provided by an exemplary embodiment.

[0050] Figure 7 It is a schematic diagram of a first interactive interface for a second virtual light provided by an exemplary embodiment.

[0051] Figure 8 It is a schematic diagram of a second interactive interface for a second virtual light provided by an exemplary embodiment.

[0052] Fig. 9 It is a schematic diagram of a third interactive interface for a second virtual light provided by an exemplary embodiment.

[0053] Fig.10 It is a schematic diagram of a fourth interactive interface regarding a second virtual light provided by an exemplary embodiment.

[0054] Fig.11 It is a structural schematic diagram of a mobile terminal provided by an exemplary embodiment.

[0055] Fig.12 It is a block diagram of a lighting control device provided by an exemplary embodiment. DETAILED DESCRIPTION

[0056] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with one or more embodiments of this specification. Instead, they are merely examples of devices and methods consistent with some aspects of one or more embodiments of this specification as detailed in the appended claims.

[0057] It should be noted that: in other embodiments, the steps of the corresponding method are not necessarily performed in the order shown and described in this specification. In some other embodiments, the steps included in the method may be more or less than those described in this specification. In addition, a single step described in this specification may be decomposed into multiple steps for description in other embodiments; and multiple steps described in this specification may be combined into a single step for description in other embodiments.

[0058] Figure 1A A schematic diagram showing an application scenario according to an embodiment of this specification is shown, such as Figure 1A As shown, the virtual shooting system includes at least one screen 02 ( Figure 1A In the figure, three screens 02 are used for example description, and the screen 02 is used to display the virtual scene. The real scene where the virtual shooting system is located will also be equipped with physical lights 03. The mobile terminal 00 can be connected to the screen 02 and the physical lights 03 respectively, and the mobile terminal 00 can execute the lighting control method of the embodiment of this specification to control the physical lights 03 and the virtual lights in the virtual scene displayed by the screen 02.

[0059] For example, see Figure 1B , the virtual shooting system may include a rendering device 01 and at least one screen 02 ( Figure 1B3 screens are used as an example), a communication connection can be established between the mobile terminal 00 and the rendering device 01, and a communication connection can be established between the rendering device 01 and the screen 02. The screen 02 is used to display the virtual scene. The real scene where the virtual shooting system is located will also be equipped with a physical light 03, and the mobile terminal 00 can also establish a communication connection with the physical light 03. The physical light 03 can be a lighting device fixedly set at a certain position (such as Figure 1B The rendering device 01 and the screen 02 may be integrated into one or may be independently provided.

[0060] Among them, the mobile terminal 00 executes the lighting control method of the embodiment of the present specification. When the user operates the first adjustment control in the mobile terminal 00, the adjusted lighting parameters of the physical light 03 are obtained, and the physical light 03 is adjusted according to the adjusted parameters of the physical light 03. Considering that the physical light 03 will also affect the light and shadow effects in the virtual scene, the mobile terminal 00 will also adjust the lighting parameters of the first virtual light used to simulate the light and shadow effects of the physical light 03 in the virtual scene according to the adjusted lighting parameters of the physical light 03, and send the adjusted lighting parameters of the first virtual light to the rendering device 01. The rendering device 01 can render the adjusted first virtual light according to the adjusted lighting parameters of the first virtual light, and control the screen 02 to display the virtual scene integrated with the adjusted first virtual light.

[0061] In the above application scenario, the lighting engineer can hold the mobile terminal 00 and control the physical light 03 in the real scene where the virtual shooting system is located in real time through the mobile terminal 00. The operation is simple and convenient. The mobile terminal 00 can adjust the physical light 03 based on the adjusted lighting parameters of the physical light 03, and at the same time, jointly adjust the first virtual light used to simulate the light and shadow effects of the physical light in the virtual scene. It can more accurately simulate the real lighting conditions, so that the virtual scene can better match the actual situation of the on-site scene, thereby enhancing the realism of the virtual scene; the light and shadow changes in the virtual scene are consistent with the physical light in the real scene. This consistency can provide a more natural and coherent visual experience and enhance the sense of immersion.

[0062] The screen 02 used in the virtual shooting system can be an LED screen, an LCD screen, etc., and can be a curved screen or a flat screen. It should be understood that those skilled in the art can customize the type, quantity, size, resolution, etc. of the screen 02 in the virtual shooting system according to actual needs, and this specification embodiment does not limit this. It should be understood that this specification embodiment does not limit the communication connection method between devices.

[0063] Optionally, when the screen 02 is an LED screen, the embodiment of this specification also provides Figure 2 A virtual shooting system is shown, such as Figure 2 As shown, the virtual shooting system may include an LED screen 101, a server cluster 102 (including a main server 1021 and multiple servers 1022), an LED broadcast control processor 103, a camera 104, a posture tracker 105, a network switch 106, and a synchronization signal generator 107; the rendering device 01 of the embodiment of this specification may include a server cluster 102 and an LED broadcast control processor 103; wherein, the mobile terminal 00 may establish a communication connection with the main server 1021, so that the mobile terminal 00 may send relevant data (such as the adjusted lighting parameters of the first virtual light) to the main server 1021, and the main server 1021 may synchronize the relevant data (such as the adjusted lighting parameters of the first virtual light) to the other multiple servers 1022.

[0064] Among them, each server in the server cluster 102 can render the adjusted first virtual light according to the adjusted light parameters of the first virtual light, and send the rendering result to the corresponding LED broadcast control processor 103. Since the LED screen 101 is composed of multiple LED cabinets, one server can correspond to one or more LED cabinets, that is, one server can render the picture required to be displayed by one or more LED cabinets corresponding to it. The LED broadcast control processor 103 is a hardware device for controlling the LED screen 101. One LED broadcast control processor can correspond to one or more LED cabinets, or one LED broadcast control processor can control one or more LED cabinets corresponding to it to display the picture.

[0065] Among them, the posture tracker 105 is bound to the camera 104, and the posture tracker 105 can track the position and posture of the camera 104 in real time, and broadcast the tracked posture information to the on-site local area network through the network. The network switch 106 can build an on-site local area network to realize communication between various devices in the on-site local area network. For example, the network switch 106 can receive the posture information broadcast by the posture tracker 105, and send the posture information to the server cluster 102. The synchronization signal generator 107 can generate a synchronization signal pulse, and send the synchronization signal to the camera 104, the posture tracker 105, the server cluster 102 and the LED broadcast control processor 103, so that the camera 104, the posture tracker 105, the server cluster 102 and the LED broadcast control processor 103 are synchronized. Among them, the camera 104 will simultaneously shoot the screen and the real scene (that is, the scene in front of the screen), and obtain a video that integrates the screen and the scene in front of the screen.

[0066] The lighting control method for a virtual shooting system in the embodiments of this specification can be deployed on various mobile terminals through software or hardware modification. The mobile terminal involved in the embodiments of this specification may be a mobile terminal that can provide an interactive interface. For example, the mobile terminal may include but is not limited to handheld devices, tablet computers, PDAs, laptop computers, smart phones, wearable devices (for example, watches, glasses, gloves, headwear (for example, hats, helmets, virtual reality headsets, augmented reality headsets, head-mounted devices (HMD), headbands), pendants, armbands, leg rings, shoes, vests), etc. The mobile terminal involved in the embodiments of this specification may refer to a device with a wireless connection function and / or a wired connection function. The wireless connection function refers to the ability to connect to other devices through wireless connection methods such as wifi and Bluetooth. The mobile terminal involved in the embodiments of this specification may also be communicatively connected to other devices through a wired connection function. The mobile terminal involved in the embodiments of this specification may be a touch-screen or non-touch-screen mobile terminal. A touch-screen mobile terminal may be controlled by clicking or sliding on a display with a finger or a stylus, and a non-touch-screen mobile terminal may be connected to an input device such as a mouse, keyboard, or touch panel to control the mobile terminal through the input device, etc. This specification does not limit the embodiments of this specification.

[0067] See also Figure 3 , Figure 3 A flowchart of a lighting control method for a virtual shooting system is shown. The virtual shooting system includes at least one screen, and the screen is used to display a virtual scene; the method is applied to a mobile terminal, and the method includes:

[0068] In S101, a first adjustment control for adjusting a physical light in a real scene where the virtual shooting system is located is displayed in an interactive interface of the mobile terminal; the first adjustment control is used to adjust at least one lighting parameter of the physical light.

[0069] As described above, the lighting control method of the embodiment of the present specification can be deployed in a mobile terminal through software, for example, it can be deployed in a mobile terminal in the form of an application APP. When a user expects to adjust and control the physical light in the real scene where the virtual shooting system is located, the above application can be opened to enter an interactive interface for adjusting the physical light. The interactive interface can display a first adjustment control for adjusting the physical light, so that the user can operate the first adjustment control in the interactive interface according to actual needs to adjust at least one lighting parameter of the physical light.

[0070] Among them, the lighting parameters of the entity light include at least one of posture information and display attributes; the posture information includes the light source position and / or the light source angle; the display attributes include at least one of the light source type, color, light intensity and brightness.

[0071] For example, if the lighting parameters of the physical light include posture information, the physical light may be equipped with a driving device, and the movement of the driving device may be controlled by a mobile terminal to adjust at least one of the light source position and the light source angle of the physical light.

[0072] For example, if the lighting parameters of the physical light include display properties, the physical light can be equipped with a processor for adjusting the display properties, such as a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC) or a field-programmable gate array (FPGA), etc., and relevant adjustment or control instructions can be sent to the processor in the physical light through a mobile terminal, so that the processor can adjust the display properties of the physical light, such as color, light intensity and brightness.

[0073] In S102, in response to the first adjustment control being triggered, the adjusted lighting parameters of the physical light are obtained, and the physical light is adjusted according to the adjusted parameters of the physical light; and according to the adjusted lighting parameters of the physical light, the lighting parameters of the first virtual light used to simulate the light and shadow effects of the physical light in the virtual scene are adjusted, and the adjusted lighting parameters of the first virtual light are used to make the screen display a virtual scene that integrates the adjusted first virtual light.

[0074] For example, in Figure 1B In the application scenario shown, the mobile terminal can send the adjusted lighting parameters of the first virtual light to the rendering device, so that the rendering device renders the adjusted first virtual light according to the adjusted lighting parameters of the first virtual light, and controls the screen to display the virtual scene integrating the adjusted first virtual light.

[0075] It is understandable that the user can adjust the lighting parameters of the physical light once or more than once, and the user can adjust at least one lighting parameter of at least one physical light at a time. The mobile terminal can adjust the physical light according to the adjusted lighting parameters of the physical light obtained by the user each time performing the adjustment operation, and jointly adjust the first virtual light used to simulate the light and shadow effect of the physical light in the virtual scene. Among them, the rendering device can use the rendering technology known in the art to render the adjusted first virtual light according to the adjusted lighting parameters of the first virtual light, which is not limited in the embodiments of this specification.

[0076] In this embodiment, the user can control the physical light by operating the first adjustment control in the interactive interface of the mobile terminal. The operation is simple and convenient. The mobile terminal can adjust the physical light based on the adjusted lighting parameters of the physical light. Considering that the physical light will also affect the light and shadow effects in the virtual scene, the lighting parameters of the first virtual light used to simulate the light and shadow effects of the physical light in the virtual scene are simultaneously adjusted, so as to more accurately simulate the real lighting conditions and make the virtual scene better match the actual situation of the on-site scene, thereby enhancing the realism of the virtual scene. The light and shadow changes in the virtual scene are consistent with the physical light in the real scene. This consistency can provide a more natural and coherent visual experience and enhance the sense of immersion.

[0077] It is understandable that each entity light may have one or more first adjustment controls corresponding to it. For example, there may be more than one first adjustment control corresponding to each entity light, and each first adjustment control is used to adjust one of the lighting parameters of the entity light. This specification does not impose any restrictions on the specific operation form of the first adjustment control, which may be click, slide, drag or long press, but is not limited thereto.

[0078] For example, see Figure 4 , Figure 5 and Figure 6 The interactive interface shown, Figure 4 , Figure 5 and Figure 6 The left side of the interactive interface shows all physical lights in the real scene where the virtual shooting system is located. When the user selects one of the physical lights, the right side of the interactive interface will display a first adjustment control for adjusting the physical light, so as to adjust at least one lighting parameter of the physical light. Different physical lights may correspond to different lighting parameters that need to be adjusted, and accordingly, have different first adjustment controls.

[0079] See also Figure 4 When the user selects "Entity Light-1", the first adjustment control for adjusting "Entity Light-1" is displayed on the right side of the interactive interface. The hue and saturation of the entity light can be adjusted in HSI mode. The HSI (HueSatrationntenst HSI) model uses three parameters H, S, and I to describe color characteristics, where H defines the wavelength of the color, called hue; S represents the depth of the color, called saturation; and I represents intensity or brightness.

[0080] See also Figure 5 When the user selects "Entity Light-2", the first adjustment control for adjusting "Entity Light-2" is displayed on the right side of the interactive interface. The red, green, blue and white intensity levels of the entity light can be adjusted from the RGBW mode. RGBW is a color mode that combines the spectrum of four colors, red, green, blue and white, to form richer colors.

[0081] See also Figure 6 When the user selects "Physical Light - 3", the first adjustment control for adjusting "Physical Light - 3" is displayed on the right side of the interactive interface, which can adjust the color temperature of the physical light. When the color temperature is around 3000K, the light color is yellowish. When the color temperature is above 5000K, the light color is bluish.

[0082] Understandably, Figure 4 , Figure 5 as well as Figure 6The first adjustment control in the figure is used to adjust the lighting parameters for illustrative purposes only and does not constitute a limitation on the lighting parameters.

[0083] In some embodiments, the process of creating a first virtual light for simulating the light and shadow effect of the physical light in the virtual scene is exemplarily described here:

[0084] The mobile terminal can obtain the position information and display properties of the physical light in the real scene where the virtual shooting system is located; then, based on the position information of the screen, the position information and display properties of the physical light, create at least one first virtual light for simulating the light and shadow effects of the physical light in the virtual scene, and determine the light parameters of the first virtual light; the light parameters of the first virtual light are used to make the screen display a virtual scene integrated with the first virtual light. Exemplarily, in Figure 1B In the application scenario shown, the mobile terminal can send the lighting parameters of the first virtual light to the rendering device, so that the rendering device renders the first virtual light according to the lighting parameters of the first virtual light, and controls the screen to display the virtual scene integrated with the first virtual light. In this embodiment, the physical light in the real scene is combined with the light and shadow effects in the virtual scene, which can improve the realism of the image frames captured by the camera in the virtual shooting and enhance the user's immersion. In addition, by communicating with the physical light in the real scene and simulating the light and shadow effects of the physical light in the virtual scene, it is possible to achieve more detailed adjustment and control of the light and shadow effects in the virtual scene, thereby meeting the needs of different users.

[0085] Specifically, after obtaining the posture information and display properties of the physical light in the real scene where the virtual shooting system is located, the mobile terminal first determines the distance between the screen and the physical light and the angle of the physical light relative to the screen based on the difference between the posture information of the screen and the posture information of the physical light, and then determines at least one lighting parameter of the light source type, light source position, light source angle, color, light intensity and brightness of the first virtual light used to simulate the lighting and shadow effects of the physical light in the virtual scene based on the distance between the screen and the physical light, the angle of the physical light relative to the screen, and the display properties of the physical light.

[0086] In some embodiments, one or more lighting parameters of the first virtual light, including the light source type, light source position, light source angle, color, illumination intensity, and brightness, may have a preset correspondence relationship with one or more lighting parameters of the physical light, so that the first virtual light may be constructed based on the lighting parameters of the physical light. When the lighting parameters of the physical light change, the lighting parameters of the first virtual light may also be adjusted accordingly based on the correspondence relationship.

[0087] In some embodiments, considering that the lighting parameters of the physical light are set according to the position and direction of the camera, when the camera's posture changes, the lighting parameters of the physical light originally applicable to the old posture may not be applicable to the new posture, resulting in inconsistent lighting effects of the image frames captured by the camera before and after the posture change.

[0088] Therefore, in order to adapt to changes in the camera's posture, a first mapping relationship between different posture information of the camera and the lighting parameters of the physical light can be pre-stored in the mobile terminal. The first mapping relationship is used to ensure that the light and shadow effects of different image frames obtained when the camera is shooting in different postures remain consistent.

[0089] When the posture (at least one of the position and attitude) of the camera in the virtual shooting changes, the mobile terminal responds to the change in the posture of the imaging device camera shooting the screen, obtains the first target light parameters of the physical light according to the changed posture information of the imaging device camera and the first mapping relationship, and adjusts the physical light according to the first target light parameters of the physical light; and adjusts the light parameters of the first virtual light according to the first target light parameters of the physical light, and the adjusted light parameters of the first virtual light are used to make the screen display a virtual scene that incorporates the adjusted first virtual light. Exemplarily, in Figure 1B In the application scenario shown, the mobile terminal can send the adjusted lighting parameters of the first virtual light to the rendering device, so that the rendering device renders the adjusted first virtual light according to the adjusted lighting parameters of the first virtual light, and controls the screen to display the virtual scene integrating the adjusted first virtual light.

[0090] In this embodiment, through the above-mentioned adjustment method, when the camera shoots at different angles or positions, the brightness, color and projection effect of the physical light can remain consistent, providing a more realistic and uniform lighting effect. In addition, by pre-storing the first mapping relationship and automatically adjusting the physical light, the user's operation process can be simplified. The user does not need to manually adjust the parameters of the physical light, nor does he need to make repeated trial and error adjustments for different postures. The mobile terminal can automatically calculate the target light parameters according to the camera posture change and the first mapping relationship, and directly adjust the physical light, which reduces the user's operating burden and improves the convenience and efficiency of the operation. The first virtual light used to simulate the light and shadow effects of the physical light in the virtual scene is synchronously adjusted so that the light and shadow changes in the virtual scene are consistent with the physical light in the real scene, thereby enhancing the realism and immersion of the virtual scene.

[0091] In some embodiments, considering that the pose of the subject has changed, the lighting parameters of the physical light originally applicable to the old pose of the subject may not be applicable to the new pose of the subject (such as an actor in front of the screen), and may also make the lighting effects of the image frames captured by the camera before and after the pose of the subject change inconsistent.

[0092] Exemplarily, the photographed object may carry a posture sensor for detecting the posture information of the photographed object. The posture sensor is connected to the mobile terminal for communication and sends the detected posture information of the photographed object to the mobile terminal, so that the mobile terminal can know whether the posture of the photographed object changes, and control the physical light and the first virtual light accordingly.

[0093] When the posture (at least one of the position and posture) of the photographed object changes, the mobile terminal can respond to the change in the posture of the photographed object, and determine the distance and relative angle between the photographed object and the physical light according to the changed posture information of the photographed object and the posture information of the physical light; obtain second target light parameters of the physical light according to the distance and relative angle between the photographed object and the physical light, the second target light parameters are used to ensure that the light and shadow effects of different image frames obtained when the camera shoots the object in different postures remain consistent; then adjust the physical light according to the second target light parameters of the physical light; and adjust the light parameters of the first virtual light used to simulate the light and shadow effects of the physical light in the virtual scene according to the second target light parameters of the physical light, the adjusted light parameters of the first virtual light are used to make the screen display a virtual scene that integrates the adjusted first virtual light.

[0094] Among them, a preset corresponding relationship (such as a mapping table or a functional relationship) can be established between the distance and relative angle between the photographed object and the physical light and the second target light parameter, so that the second target light parameter corresponding to the distance and relative angle can be determined based on the corresponding relationship.

[0095] In this embodiment, when the posture of the photographed object changes, the physical light and the first virtual light are adjusted accordingly, so that the light and shadow effects of the photographed objects in different postures in the image frame can be kept consistent, which helps to enhance the viewing experience and make the shooting results more natural and coherent. When the mobile terminal senses the change in the posture of the photographed object, the physical light and the first virtual light are automatically adjusted, which can greatly reduce the workload of manual intervention and adjustment, not only improving the shooting efficiency, but also reducing the burden on the operator.

[0096] In some embodiments, the mobile terminal pre-stores lighting parameters of physical lights corresponding to different shooting scenes. The user can choose according to actual shooting needs. For example, there are three different shooting scenes on the mobile terminal: indoor scene, outdoor daytime scene and night scene. (1) Indoor scene: The lighting parameters of the physical light can be set to soft and uniform light, so that the subject presents a natural and soft light and shadow effect. (2) Outdoor daytime scene: The lighting parameters of the physical light can be set to strong and bright light; the outline of the subject can be highlighted, and the brightness and clarity of the picture can be increased. (3) Night scene: The lighting parameters of the physical light can be set to soft background light and appropriate fill light; while maintaining the night atmosphere, it can ensure that the subject has sufficient brightness to avoid the picture being too dark or generating serious noise.

[0097] In the case where the mobile terminal pre-stores the lighting parameters of the physical lights corresponding to different shooting scenes, a selection control for selecting a shooting scene can be displayed in the interactive interface of the mobile terminal. For example, one shooting scene can correspond to one selection control, and when a certain selection control is triggered, it means that the shooting scene corresponding to the selection control is selected. For example, multiple shooting scenes can correspond to one selection control, and the selection control is an input control, and the user can enter the identification information corresponding to the selected shooting scene according to actual needs, such as a number or a name.

[0098] Then, in response to the selection control being triggered, the mobile terminal obtains the third target light parameter of the physical light corresponding to the selected shooting scene, and adjusts the physical light according to the third target light parameter of the physical light; and, according to the third target light parameter of the physical light, adjusts the light parameter of the first virtual light, and the adjusted light parameter of the first virtual light is used to make the screen display a virtual scene that integrates the adjusted first virtual light. In this embodiment, by pre-storing the light parameters of the physical light corresponding to different shooting scenes, the mobile terminal can automatically select suitable light parameters for adjustment according to the requirements of the shooting environment, so as to obtain better shooting effects. In this way, even in different shooting scenes, users can easily obtain the desired light and shadow effects, improve the quality and experience of shooting, and do not need users to adjust the light parameters of the physical light from scratch, which can greatly reduce the workload of manual adjustment, not only improving shooting efficiency, but also reducing the burden on users.

[0099] In some embodiments, in addition to the first virtual light used to simulate the physical light, there is also a second virtual light that is not affected by the physical light and can be controlled independently in the virtual scene.

[0100] Exemplarily, in order to facilitate the user to control the second virtual light, a second adjustment control for adjusting the second virtual light in the virtual scene displayed on the screen can be displayed in the interactive interface of the mobile terminal; the second adjustment control is used to adjust at least one lighting parameter of the second virtual light. The lighting parameters include but are not limited to at least one of the light source type, light source position, light source angle, color, light intensity and brightness. The light source type includes but is not limited to point light source, parallel light source, spotlight, etc. Different light source types will produce different lighting effects.

[0101] The user can operate the second adjustment controls corresponding to the second virtual lights according to actual needs. In response to the second adjustment controls being triggered, the mobile terminal obtains the adjusted light parameters of the second virtual lights. The adjusted light parameters are used to make the screen display a virtual scene integrated with the adjusted second virtual lights. Figure 1B In the application scenario shown, the mobile terminal can send the adjusted lighting parameters of the second virtual light to the rendering device, so that the rendering device renders the adjusted second virtual light according to the adjusted lighting parameters of the second virtual light, and controls the screen to display the virtual scene integrated with the adjusted second virtual light. In this embodiment, a lighting engineer who does not have knowledge of graphics rendering can also control the second virtual light in real time through the mobile terminal to flexibly adjust the display effect of the virtual scene on the screen. The operation is simple and convenient, and there is no need for the lighting engineer to communicate with the professional responsible for the virtual light and then the professional operates on the computer to control the virtual light. The adjustment flexibility is high, which reduces the communication cost between the lighting engineer and the professional responsible for the virtual light, and is conducive to improving the efficiency of lighting control.

[0102] In some embodiments, in order to further improve the adjustment efficiency, the embodiments of this specification implement that all the second virtual lights in the virtual scene displayed on the screen can be divided into at least two groups. By grouping the second virtual lights, the user can set and control the entire second virtual light group at one time without having to adjust each second virtual light one by one, which can save the user's time and energy and improve work efficiency.

[0103] Exemplarily, the second adjustment control includes a first sub-adjustment control for each second virtual light and a second sub-adjustment control for each group of second virtual lights. The first sub-adjustment control is used to adjust at least one light parameter of a single second virtual light, including the light source type, light source position, light source angle, color, light intensity, and brightness. The second sub-adjustment control is used to batch adjust at least one light parameter of a group of second virtual lights, including the light source type, light source position, light source angle, color, light intensity, and brightness, and display properties.

[0104] Among them, for each group of second virtual lights after grouping, they can be batch adjusted through the second sub-adjustment control corresponding to the group of second virtual lights, and for each second virtual light in the group of second virtual lights, they can also be individually adjusted through the first sub-adjustment control corresponding to the second virtual light.

[0105] It is understandable that each second virtual light may have one or more first sub-adjustment controls corresponding to it, for example, each second virtual light may have more than one first sub-adjustment controls corresponding to it, and each first sub-adjustment control is used to adjust one of the lighting parameters of the second virtual light. Also, each group of second virtual lights may have one or more second sub-adjustment controls corresponding to it, for example, each group of second virtual lights may have more than one second sub-adjustment controls corresponding to it, and each second sub-adjustment control is used to batch adjust one of the lighting parameters of the group of second virtual lights. This specification does not impose any restrictions on the specific operation form of the second adjustment control, which may be click, slide, drag or long press, but is not limited to this.

[0106] In an example, see Figure 7 , Figure 8 as well as Fig. 9 The interactive interface shown, Figure 7 and Figure 8 The left side of the interactive interface displays all the second virtual lights in the virtual scene. It can be seen that some second virtual lights are displayed in the form of light groups, while some second virtual lights are not grouped and are displayed as single second virtual lights.

[0107] See also Figure 7 When the user selects the ungrouped “second virtual light A”, the first sub-adjustment control for adjusting the “second virtual light A” is displayed on the right side of the interactive interface, so that the lighting parameters of the “second virtual light A”, such as the light intensity, light color and light source position, can be adjusted.

[0108] See also Figure 8 , when the user selects "Light Group-1", the right side of the interactive interface displays the second sub-adjustment control for adjusting "Light Group-1", so that the light parameters such as the light intensity, light color and light source position of all the second virtual lights in "Light Group-1" can be adjusted in batches. For example, when the user adjusts Figure 8 When you adjust the light intensity on the right side of the interactive interface, the light intensity of all the second virtual lights in "Light Group-1" is adjusted, which helps to simplify the user's operation steps and improve operation efficiency.

[0109] See also Fig. 9 , Fig. 9The left side of the interactive interface displays all the second virtual lights in the "Light Group -1". When the user selects the "Second Virtual Light -1-c" in the "Light Group -1", the right side of the interactive interface displays the first sub-adjustment control for adjusting the "Second Virtual Light -1-c", so that the lighting parameters such as the light intensity, light color and light source position of the "Second Virtual Light -1-c" can be adjusted.

[0110] Here is an exemplary description of the grouping of the second virtual light:

[0111] In a second possible implementation, the user can group the second virtual lights in the virtual scene currently displayed on the screen according to actual needs, and the mobile terminal can respond to the grouping instruction for the second virtual lights in the virtual scene displayed on the screen and divide the selected at least one second virtual light into a group. This embodiment uses the mobile terminal to group the second virtual lights, which can increase the interactivity and ease of use between the user and the virtual scene. The user can directly select the second virtual lights and divide them into different groups without complicated operation steps or professional skills. In addition, the user can customize the scene effect according to actual needs, and can combine multiple second virtual lights into a specific scene effect; for example, an indoor lighting scene, a stage performance effect or a night scene simulation can be created, and the virtual scene can be more in line with the user's requirements through the setting and adjustment of the second virtual light group.

[0112] For example, see Fig.10 In the interactive interface shown, the user can select the second virtual light in the virtual scene displayed on the screen in the interactive interface. For example, the user can arbitrarily select the optional second virtual light according to the required quantity. The second virtual light selected by the user will display the "√" symbol, and after confirmation, click the grouping control, and then the mobile terminal can generate a grouping instruction based on the grouping control being triggered, and then respond to the grouping instruction for the second virtual light in the virtual scene displayed on the screen, and divide the selected at least one second virtual light into a group.

[0113] In the second possible implementation, see Figure 2In the virtual shooting system shown, the screen can be divided into regions and managed by multiple servers. Therefore, the mobile terminal can automatically group the second virtual lights in the virtual scene currently displayed on the screen according to the at least two display areas after the screen is divided; each group of second virtual lights corresponds to a display area on the screen, and is used to provide light and shadow effects for the virtual scene displayed in the display area. For example, the second virtual lights located in the same display area can be automatically grouped according to the current position of the second virtual lights, or the user can select the second virtual lights to be grouped according to the required number according to the user's selection operation, and associate them with the corresponding display area.

[0114] In this embodiment, by grouping the second virtual lights according to the display areas after the screen is divided, the lighting effect can be better controlled and adjusted. Each group of second virtual lights only needs to focus on a specific display area to provide the best lighting effect for the area, thereby enhancing the visual experience. In addition, the interactivity between the user and the virtual scene can be increased. The user can more intuitively see the scope and effect of each group of second virtual lights, making it easier to adjust and control the second virtual lights, which can improve the user's participation and usage experience. In addition, the user's operation steps and learning costs can be reduced, and the usage threshold can be lowered. There is no need to manually set the lighting parameters of each second virtual light. The mobile terminal can automatically adjust the grouping and properties of the second virtual lights according to the various display areas of the screen, thereby improving the automation of virtual light adjustment.

[0115] It is understandable that if the user subsequently adjusts the posture information of the second virtual light by adjusting the control in the mobile terminal, causing the display area illuminated by the second virtual light to change, the mobile terminal can re-group the adjusted second virtual lights according to the display area illuminated by the adjusted second virtual lights, so that each group of second virtual lights corresponds to a display area on the screen, for providing light and shadow effects for the virtual scene displayed in the display area.

[0116] In a third possible implementation, the virtual scene includes virtual objects, which are objects or entities generated by computers and do not exist in the real world; they may be characters, props, buildings, animals, and landscapes in the virtual world. Considering that the light and shadow requirements for different virtual objects in the virtual scene are also different, the mobile terminal can group the second virtual lights in the virtual scene currently displayed on the screen according to the virtual objects in the virtual scene displayed on the screen; each group of second virtual lights corresponds to a virtual object in the virtual scene, and is used to provide light and shadow effects for the virtual object. For example, the second virtual lights illuminating the same virtual object can be automatically grouped according to the current position and current angle of the second virtual lights, or the user can select the second virtual lights to be grouped according to the required number according to the user's selection operation, and associate them with the corresponding virtual objects.

[0117] In this embodiment, the second virtual lights are grouped according to virtual objects, so that the visual effect and immersion of the virtual scene can be enhanced, and each virtual object can obtain the best lighting effect and light and shadow performance, so that it is more realistic and vivid; it allows users to more intuitively feel the characteristics and features of each virtual object in the virtual scene, which helps to improve user participation and usage experience, and makes it easier for users to understand the information and effects in the virtual scene; refined lighting control can be achieved, and users can more specifically adjust and optimize the lighting effects and light and shadow performance of each virtual object to meet various different needs and scenes; automatically grouping lights and allocating light and shadow effects according to virtual objects can reduce the user's setting burden and improve the convenience and automation of lighting adjustment.

[0118] It is understandable that if the user subsequently adjusts the posture information of the second virtual light by adjusting the control in the mobile terminal, causing the virtual object illuminated by the second virtual light to change, the mobile terminal can re-group the adjusted second virtual lights according to the virtual objects illuminated by the adjusted second virtual lights, so that each group of second virtual lights corresponds to a virtual object in the virtual scene, so as to provide light and shadow effects for the virtual object.

[0119] In some embodiments, when the posture (position and attitude) of the camera in virtual shooting changes, the light and shadow effects of the image frames captured by the camera before and after the posture change may be inconsistent. This is because the light and shadow effects formed by the second virtual light in the virtual scene are calculated and rendered according to the position and direction of the camera. When the posture of the camera changes, the lighting parameters originally applicable to the old posture may not be applicable to the new posture, resulting in inconsistent light and shadow effects.

[0120] In order to adapt to the change of the camera's posture, a second mapping relationship between different posture information of the camera and the lighting parameters of the second virtual light in the virtual scene can be pre-stored in the mobile terminal. The second mapping relationship is used to keep the light and shadow effects of different image frames obtained when the camera is shot in different postures consistent. By establishing the second mapping relationship between the camera posture and the second virtual lighting parameters, it can be ensured that the light and shadow effects of the image frames shot in different postures remain consistent, which can improve the realism and coherence of the virtual scene and enable users to obtain a more consistent visual experience when watching on the mobile terminal.

[0121] Exemplarily, the mobile terminal can be connected to a camera for communication, and the camera is equipped with a posture sensor (such as Figure 2 The pose tracker shown in FIG. 1 is used to detect the pose of the camera and feed it back to the mobile terminal.

[0122] Then, when the position and posture of the camera changes, the mobile terminal can respond to the change in the position and posture of the camera and obtain the target light parameters of the second virtual light in the virtual scene according to the changed position and posture information of the camera and the second mapping relationship; the target light parameters of the second virtual light are used to make the screen display a virtual scene that integrates the second virtual light adapted to the changed position and posture of the camera. Figure 1B In the application scenario shown, the mobile terminal can send the target lighting parameters of the second virtual light to the rendering device, so that the rendering device renders the second virtual light adapted to the changed posture of the camera according to the target lighting parameters of the second virtual light, and controls the screen to display a virtual scene integrated with the second virtual light adapted to the changed posture of the camera. In this embodiment, when the posture of the camera changes, the target parameters of the virtual light can be obtained in real time according to the new posture information and the second mapping relationship, so that the rendering device can adapt the lighting effect according to the new posture, realize the real-time change and adjustment of the light, and the user can obtain the light and shadow rendering result adapted to the new posture without waiting for the light and shadow effect to be recalculated. And by pre-storing the second mapping relationship between the camera posture information and the lighting parameters of the second virtual light, the computational complexity and resource consumption at runtime can be reduced. It is only necessary to obtain the target lighting parameters of the second virtual light according to the posture change and send them to the rendering device, without recalculating the light and shadow information every time, thereby improving the efficiency and performance of the system.

[0123] Among them, the execution order of the steps of "in response to the second adjustment control being triggered, obtaining the adjusted lighting parameters of the second virtual light" and "in response to the change in the posture of the camera, obtaining the target lighting parameters of the second virtual light in the virtual scene according to the changed posture information of the camera and the second mapping relationship" is not restricted. For example, the target lighting parameters of the second virtual light can be determined according to the changed posture information of the camera before, after or at the same time as the user adjusts the lighting parameters of the second virtual light through the interactive interface, and the target lighting parameters can be merged with the lighting parameters adjusted by the user. For example, the target lighting parameters are used to correct or replace the lighting parameters adjusted by the user, or the target lighting parameters are used to correct or replace the target lighting parameters, or the two are used to calculate the merged lighting parameters based on a preset algorithm. The present application does not impose any restrictions on this.

[0124] A rendering device can be used to independently perform rendering based on the lighting parameters of the second virtual light and the lighting parameters of the first virtual light, so that the light and shadow effects brought by the lighting parameters of the second virtual light and the lighting parameters of the first virtual light are superimposed on each other in the virtual scene displayed on the screen.

[0125] The various technical features in the above embodiments can be arbitrarily combined as long as there is no conflict or contradiction between the combinations of features. However, due to space limitations, they are not described one by one. Therefore, any combination of the various technical features in the above embodiments also falls within the scope of this specification.

[0126] Fig.11 is a schematic structural diagram of a mobile terminal provided by an exemplary embodiment. Fig.11 At the hardware level, the mobile terminal includes a processor 202, an internal bus 204, a network interface 206, a memory 208, and a non-volatile memory 210, and may also include hardware required for other services. One or more embodiments of this specification may be implemented based on software, such as the processor 202 reading the corresponding computer program from the non-volatile memory 210 into the memory 208 and then running it. Of course, in addition to the software implementation, one or more embodiments of this specification do not exclude other implementations, such as logic devices or a combination of software and hardware, etc., that is, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.

[0127] Please refer to Fig.12 The lighting control device for the virtual shooting system can be applied to Fig.11 In the mobile terminal shown in the figure, the technical solution of this specification is implemented. Wherein, the virtual shooting system includes at least one screen, and the screen is used to display the virtual scene; the lighting control device may include:

[0128] The control display module 301 is used to display a first adjustment control for adjusting the physical light in the real scene where the virtual shooting system is located in the interactive interface of the mobile terminal; the first adjustment control is used to adjust at least one lighting parameter of the physical light.

[0129] The light adjustment module 302 is used to obtain the adjusted light parameters of the physical light in response to the first adjustment control being triggered, and adjust the physical light according to the adjusted parameters of the physical light; and adjust the light parameters of the first virtual light used to simulate the light and shadow effects of the physical light in the virtual scene according to the adjusted light parameters of the physical light, and the adjusted light parameters of the first virtual light are used to make the screen display a virtual scene that integrates the adjusted first virtual light.

[0130] In some embodiments, the lighting parameters include at least one of posture information and display attributes; the posture information includes the light source position and / or the light source angle; the display attributes include at least one of the light source type, color, light intensity and brightness.

[0131] In some embodiments, the device also includes a first virtual light creation module, which is used to obtain the posture information and display properties of the physical light in the real scene where the virtual shooting system is located; based on the posture information of the screen, the posture information and display properties of the physical light, create at least one first virtual light for simulating the light and shadow effects of the physical light in the virtual scene, and determine the lighting parameters of the first virtual light, and the lighting parameters of the first virtual light are used to make the screen display a virtual scene integrated with the first virtual light.

[0132] In some embodiments, the mobile terminal pre-stores a first mapping relationship between different posture information of the camera and the lighting parameters of the physical light, and the first mapping relationship is used to ensure that the light and shadow effects of different image frames obtained when the camera shoots in different postures remain consistent.

[0133] The light adjustment module 302 is also used for: in response to a change in the posture of the camera shooting the screen, obtaining first target light parameters of the physical light according to the changed posture information of the camera and the first mapping relationship; adjusting the physical light according to the first target light parameters of the physical light; and adjusting the light parameters of the first virtual light according to the target light parameters of the physical light, the adjusted light parameters of the first virtual light being used to enable the screen to display a virtual scene that incorporates the adjusted first virtual light.

[0134] In some embodiments, the light adjustment module 302 is also used to: in response to a change in the posture of the photographed object, determine the distance and relative angle between the photographed object and the physical light according to the changed posture information of the photographed object and the posture information of the physical light; obtain second target light parameters of the physical light according to the distance and relative angle between the photographed object and the physical light, the second target light parameters are used to ensure that the light and shadow effects of different image frames obtained when the camera shoots the photographed object in different postures remain consistent; adjust the physical light according to the second target light parameters of the physical light; and adjust the light parameters of the first virtual light according to the second target light parameters of the physical light, the adjusted light parameters of the first virtual light are used to enable the screen to display a virtual scene that integrates the adjusted first virtual light.

[0135] In some embodiments, the mobile terminal pre-stores lighting parameters of physical lights corresponding to different shooting scenes.

[0136] The light adjustment module 302 is also used to: display a selection control for selecting a shooting scene in an interactive interface of a mobile terminal; obtain a third target light parameter of a physical light corresponding to the selected shooting scene in response to the selection control being triggered; adjust the physical light according to the third target light parameter of the physical light; and adjust the light parameter of the first virtual light according to the third target light parameter of the physical light, wherein the adjusted light parameter of the first virtual light is used to enable the screen to display a virtual scene that incorporates the adjusted first virtual light.

[0137] In some embodiments, the control display module 301 is also used to display a second adjustment control for adjusting a second virtual light in the virtual scene displayed on the screen in the interactive interface of the mobile terminal; the second adjustment control is used to adjust at least one lighting parameter of the second virtual light.

[0138] The light adjustment module 302 is also used to: in response to the adjustment control being triggered, obtain the adjusted light parameters of the second virtual light, and the adjusted light parameters of the second virtual light are used to make the screen display a virtual scene integrating the adjusted second virtual light.

[0139] The implementation process of the functions and effects of each module in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, which will not be repeated here.

[0140] In some embodiments, the embodiments of this specification also provide a mobile terminal, including: a processor; a memory for storing processor executable instructions; wherein the processor implements any of the above methods by running the executable instructions.

[0141] In some embodiments, the embodiments of this specification further provide a computer-readable storage medium on which computer instructions are stored, and when the instructions are executed by a processor, the steps of any of the methods described above are implemented.

[0142] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this manual are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0143] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer, which may be in the form of a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver, a game console, a tablet computer, a wearable device or a combination of any of these devices.

[0144] In a typical configuration, a computer includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0145] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0146] Computer-readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, disk storage, quantum memory, graphene-based storage media or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0147] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0148] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0149] The terms used in one or more embodiments of this specification are only for the purpose of describing specific embodiments, and are not intended to limit one or more embodiments of this specification. The singular forms of "a", "said" and "the" used in one or more embodiments of this specification and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0150] It should be understood that although the terms first, second, third, etc. may be used to describe various information in one or more embodiments of this specification, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of this specification, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0151] The above description is merely a preferred embodiment of one or more embodiments of the present specification and is not intended to limit one or more embodiments of the present specification. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of one or more embodiments of the present specification shall be included in the scope of protection of one or more embodiments of the present specification.

Claims

1. A lighting control method for a virtual shooting system, characterized in that: The virtual shooting system includes at least one screen, and the screen is used to display a virtual scene; the method is applied to a mobile terminal, and the mobile terminal pre-stores a first mapping relationship between different posture information of the camera and the lighting parameters of the physical light, and the first mapping relationship is used to make the light and shadow effects of different image frames obtained when the camera shoots in different postures consistent; the method includes: In the interactive interface of the mobile terminal, a first adjustment control for adjusting a physical light in the real scene where the virtual shooting system is located is displayed; the first adjustment control is used to adjust at least one lighting parameter of the physical light; In response to the first adjustment control being triggered, acquiring the adjusted light parameters of the physical light, and adjusting the physical light according to the adjusted parameters of the physical light; and According to the adjusted light parameters of the physical light, light parameters of a first virtual light used to simulate the light and shadow effect of the physical light in the virtual scene are adjusted, and the adjusted light parameters of the first virtual light are used to enable the screen to display a virtual scene integrated with the adjusted first virtual light; In response to a change in the posture of a camera shooting the screen, acquiring a first target light parameter of the entity light according to the changed posture information of the camera and the first mapping relationship; adjusting the physical light according to a first target light parameter of the physical light; and According to the first target light parameter of the physical light, the light parameter of the first virtual light is adjusted, and the adjusted light parameter of the first virtual light is used to enable the screen to display a virtual scene integrated with the adjusted first virtual light.

2. The method according to claim 1, characterized in that The lighting parameters include at least one of posture information and display attributes; The posture information includes the light source position and / or the light source angle; the display attributes include at least one of the light source type, color, light intensity and brightness.

3. The method according to claim 1 or 2, characterized in that: Also includes: Acquire the position information and display properties of the physical light in the real scene where the virtual shooting system is located; At least one first virtual light is created according to the posture information of the screen, the posture information and display properties of the physical light, and the lighting parameters of the first virtual light are determined. The lighting parameters of the first virtual light are used to enable the screen to display a virtual scene integrated with the first virtual light.

4. The method according to claim 1, characterized in that: The method further comprises: In response to a change in the posture of the photographed object, determining the distance and relative angle between the photographed object and the physical light according to the changed posture information of the photographed object and the posture information of the physical light; According to the distance and relative angle between the photographed object and the physical light, a second target light parameter of the physical light is obtained, wherein the second target light parameter is used to make the light and shadow effects of different image frames obtained when the camera photographs the photographed object in different positions consistent; The physical light is adjusted according to the second target light parameters of the physical light; and the light parameters of the first virtual light are adjusted according to the second target light parameters of the physical light, and the adjusted light parameters of the first virtual light are used to make the screen display a virtual scene that incorporates the adjusted first virtual light.

5. The method according to claim 1, characterized in that The mobile terminal pre-stores lighting parameters of physical lights corresponding to different shooting scenes; The method further comprises: In the interactive interface of the mobile terminal, a selection control for selecting a shooting scene is displayed; In response to the selection control being triggered, obtaining a third target light parameter of the physical light corresponding to the selected shooting scene; The physical light is adjusted according to the third target light parameter of the physical light; and the light parameters of the first virtual light are adjusted according to the third target light parameter of the physical light, and the adjusted light parameters of the first virtual light are used to make the screen display a virtual scene that integrates the adjusted first virtual light.

6. The method according to claim 1, characterized in that Also includes: In the interactive interface of the mobile terminal, displaying a second adjustment control for adjusting a second virtual light in the virtual scene displayed on the screen; The second adjustment control is used to adjust at least one lighting parameter of the second virtual light; In response to the second adjustment control being triggered, the adjusted light parameters of the second virtual light are obtained, and the adjusted light parameters are used to enable the screen to display a virtual scene integrated with the adjusted second virtual light.

7. A lighting control device for a virtual shooting system, characterized in that: The virtual shooting system includes at least one screen, which is used to display a virtual scene; the device is applied to a mobile terminal, and the mobile terminal pre-stores a first mapping relationship between different posture information of the camera and the lighting parameters of the physical light, and the first mapping relationship is used to make the light and shadow effects of different image frames obtained when the camera shoots in different postures consistent; The device comprises: A control display module, used to display, in the interactive interface of the mobile terminal, a first adjustment control for adjusting a physical light in a real scene where the virtual shooting system is located; the first adjustment control is used to adjust at least one light parameter of the physical light; a light adjustment module, configured to obtain the adjusted light parameters of the physical light in response to the first adjustment control being triggered, and adjust the physical light according to the adjusted parameters of the physical light; and to adjust the light parameters of the first virtual light used to simulate the light and shadow effects of the physical light in the virtual scene according to the adjusted light parameters of the physical light, wherein the adjusted light parameters of the first virtual light are used to enable the screen to display a virtual scene integrated with the adjusted first virtual light; The light adjustment module is further used to respond to a change in the posture of the camera shooting the screen, and to obtain first target light parameters of the physical light according to the changed posture information of the camera and the first mapping relationship; to adjust the physical light according to the first target light parameters of the physical light; and to adjust light parameters of the first virtual light according to the first target light parameters of the physical light, wherein the adjusted light parameters of the first virtual light are used to enable the screen to display a virtual scene that incorporates the adjusted first virtual light.

8. A mobile terminal, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor implements the method according to any one of claims 1 to 6 by running the executable instructions.

9. A computer-readable storage medium having computer instructions stored thereon, characterized in that: When the instruction is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images