Light control method and system, and electronic device

By associating lighting equipment with video background mapping points in virtual-reality combined shooting, real-time color parameters are obtained to control the lighting equipment's illumination, solving the problem of lighting effect mismatch and improving video realism.

WO2025208791A1PCT designated stage Publication Date: 2025-10-09GODOX PHOTO EQUIPMENT CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/116851
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-04-02
Filing Date
2024-09-04
Publication Date
2025-10-09

AI Technical Summary

Technical Problem

During the virtual-real combination shooting process, the lighting equipment cannot automatically adjust according to the color parameters of the video background, resulting in a large difference between the lighting effect of the photographed person and the video background, affecting the authenticity of the video.

Method used

By mapping the lighting equipment to the corresponding mapping points in the video background one by one, the real-time color parameters of the mapping points are obtained and sent to control the lighting of the lighting equipment, ensuring that the lighting effect matches the background video.

Benefits of technology

The difference between the light effects on the subjects and the background of the video is reduced, significantly improving the realism of the video.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024116851_09102025_PF_FP_ABST
    Figure CN2024116851_09102025_PF_FP_ABST
Patent Text Reader

Abstract

A light control method and system, and an electronic device and a storage medium. The light control method comprises: acquiring a background video; selecting from the background video a mapping point associated with each light device in a filming site, wherein one mapping point is correspondingly associated with one group of light devices, that is, positions to which the light devices in the filming site are mapped can be specified from the background video; and acquiring a real-time color parameter of each mapping point in the background video, and sending the real-time color parameter to the light device associated with the mapping point, such that the light device can adjust emitted light in real time on the basis of the acquired color parameter of the mapping point, thereby making the light effect produced by the light device matching the background video. In this way, the difference between a light effect on a filmed person and a background in a video can be reduced, thereby improving the realism of the obtained video.
Need to check novelty before this filing date? Find Prior Art

Description

Lighting control method, system and electronic device

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on April 2, 2024, with application number 202410395015.6 and application name “Lighting control method, system and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of lighting control technology, and in particular to a lighting control method, system, electronic device and storage medium. Background Art

[0003] With the advancement of technology, the number of live broadcasts and short videos online is increasing. To save on the cost of live-action filming, some live broadcasts and short videos now use a hybrid virtual-realistic filming method, where the subject broadcasts or performs in front of a virtual video background. However, due to the varying color parameters of each point in the video background, this hybrid virtual-realistic filming method prevents lighting equipment from automatically adjusting to the color parameters of the video background. This results in significant differences in the lighting effects on the subject and the background, resulting in a poorly realistic video.

[0004] Summary of the Invention

[0005] The primary purpose of this disclosure is to provide a lighting control method, system, electronic device, and storage medium. By mapping lighting devices to corresponding mapping points in a video background, the system can illuminate the lighting device based on the color parameters of the corresponding mapping points in the video background. This reduces the difference between the lighting effects on the subject and the video background, significantly improving video realism.

[0006] To achieve the above objectives, a first aspect of an embodiment of the present application provides a lighting control method, the method comprising:

[0007] Get background video;

[0008] Selecting mapping points associated with various lighting devices at the shooting scene in the background video, wherein one mapping point is associated with a group of the lighting devices;

[0009] The real-time color parameters of each mapping point in the background video are obtained and sent to the lighting equipment associated with the mapping point, so that the lighting equipment emits light accordingly according to the color parameters.

[0010] In one embodiment of the present application, obtaining the background video includes:

[0011] The background video is obtained by importing a video file; or by collecting and processing the background image information displayed at the shooting scene in real time to obtain the background video.

[0012] In one embodiment of the present application, selecting mapping points associated with various lighting devices at the shooting scene in the background video includes:

[0013] Select the target lighting equipment that needs to be associated with the shooting scene;

[0014] Based on the position of the target lighting device at the shooting scene, a target mapping point corresponding to the target lighting device is selected at a corresponding position in the background video, and the target lighting device is associated with the target mapping point.

[0015] In one embodiment of the present application, after selecting mapping points associated with respective lighting devices at the shooting scene in the background video, the method further includes:

[0016] The size of the image area corresponding to the mapping point in the background video is adjusted.

[0017] In one embodiment of the present application, obtaining the real-time color parameters of each mapping point in the background video includes:

[0018] Obtaining an image area corresponding to the mapping point in the background video;

[0019] Obtaining the color parameters of each pixel in the image area;

[0020] The color parameters of all pixels in the image area are averaged to obtain the color parameter of the mapping point.

[0021] In one embodiment of the present application, the color parameters include RGB color space parameters, HSV color space parameters, or CMYK color space parameters.

[0022] In one embodiment of the present application, before obtaining the background video, the method includes:

[0023] Establish communication connections with various lighting equipment on the shooting scene;

[0024] Obtain basic information of the lighting device and generate a corresponding lighting icon;

[0025] The light icons are arranged in a preset grid diagram according to the light position layout of each light device at the shooting scene, so that the positions of the light icons in the grid diagram correspond one-to-one to the light positions of the corresponding light devices at the shooting scene.

[0026] In one embodiment of the present application, obtaining basic information of the lighting device and generating a corresponding lighting icon includes:

[0027] Obtaining basic information of the lighting device, the basic information including the lighting type and lighting model of the lighting device;

[0028] According to the light type, calling a preset light icon corresponding to the light type;

[0029] The light icons are associated with the light devices so that there is a one-to-one correspondence between the light icons and the light devices.

[0030] In one embodiment of the present application, after calling a preset light icon corresponding to the light type according to the light type, the method further includes:

[0031] The light type information is entered into the light icon, and the light icon is numbered.

[0032] In one embodiment of the present application, before arranging the light icons in a preset grid diagram according to the light position layout of each of the light devices at the shooting scene, the method further includes:

[0033] According to the light position layout of each lighting device at the shooting scene, a corresponding grid diagram is generated on the control interface or adjusted to a preset corresponding grid diagram.

[0034] To achieve the above objectives, a second aspect of an embodiment of the present application provides a lighting control system, the system comprising:

[0035] at least one lighting device;

[0036] A control device is connected to the lighting device, and the control device is configured to execute the method described in any embodiment of the present application to control the lighting device to emit light.

[0037] In one embodiment of the present application, the system further includes a display device, which is connected to the control device and configured to display a background video.

[0038] In one embodiment of the present application, the control device further includes a camera device, which is configured to capture background video.

[0039] To achieve the above-mentioned purpose, the third aspect of an embodiment of the present application proposes an electronic device, which includes a memory and a processor, wherein the memory stores a computer program, and the processor implements the method proposed in any embodiment of the present application when executing the computer program.

[0040] To achieve the above-mentioned objectives, the fourth aspect of the embodiments of the present application proposes a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, it implements the method proposed in any embodiment of the present application.

[0041] In the technical solution provided in the embodiments of the present application, a background video is obtained, and mapping points associated with the various lighting devices at the shooting scene are selected from the background video, where each mapping point is associated with a group of lighting devices. This allows the locations mapped to the lighting devices at the shooting scene to be specified in the background video. By obtaining the real-time color parameters of each mapping point in the background video and transmitting them to the lighting devices associated with the mapping points, the lighting devices can adjust their emitted light based on the obtained color parameters of the mapping points. This allows the lighting effects produced by the lighting devices to match those of the background video, reducing the difference between the lighting effects on the subject and the background of the video, and improving the realism of the captured video. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] FIG1 is a structural block diagram of a lighting control system provided in an embodiment of the present application.

[0043] FIG2 is a flowchart of the steps of the lighting visualization management method provided in an embodiment of the present application.

[0044] FIG3 is a flowchart of the steps for obtaining basic information of a lighting device and generating a corresponding lighting icon provided in an embodiment of the present application.

[0045] FIG4 is a diagram showing an example of the layout of light icons in a grid diagram according to an embodiment of the present application.

[0046] FIG5 is a flow chart of a lighting control method provided in an embodiment of the present application.

[0047] FIG6 is a flowchart of the steps for selecting mapping points associated with various lighting devices at a shooting scene in a background video, provided by an embodiment of the present application.

[0048] FIG7 is a flowchart of the steps for obtaining the real-time color parameters of each mapping point in the background video provided by an embodiment of the present application.

[0049] FIG8 is another flow chart of the lighting control method provided in an embodiment of the present application.

[0050] FIG9 is a schematic block diagram of the structure of an electronic device provided in an embodiment of the present application.

[0051] Description of reference numerals:

[0052] Control device-100; lighting device-200; display device-300; camera device-110. DETAILED DESCRIPTION

[0053] Typical embodiments that embody the features and advantages of the present disclosure will be described in detail in the following description. It should be understood that the present disclosure can have various variations in different embodiments without departing from the scope of the present disclosure, and the descriptions and illustrations therein are essentially for illustrative purposes and not for limiting the present disclosure.

[0054] In the description of this application, it should be understood that in the embodiments shown in the drawings, indications of directions or positional relationships (such as up, down, left, right, front, and back) are merely for the convenience of describing this application and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be constructed, or operate in a specific orientation. These descriptions are appropriate when these elements are in the positions shown in the drawings. If the descriptions of the positions of these elements change, the indications of these directions will also change accordingly.

[0055] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the described features. In the description of this application, "plurality" means two or more, unless otherwise specifically defined.

[0056] Referring to Figure 1, Figure 1 is a structural block diagram of the lighting control system provided in an embodiment of the present application. As shown in Figure 1, the lighting control system includes a control device 100 and at least one lighting device 200. Among them, the control device 100 is connected to the lighting device 200, so that the control device can control the light emission of the lighting device 200. Specifically, the control device 100 and the lighting device 200 can be connected wirelessly or by wire. For example, the control device 100 can be connected to the lighting device 200 via Bluetooth or CRMX (cognitive radio multiplexer, a radio frequency multiplexer with cognitive function), or the control device 100 can be connected to the lighting device 200 by wire via Ethernet. Exemplarily, the control device 100 can establish a connection with the lighting device 200 via a wireless DMX (Digital Multiple X, multiplexed digital transmission) transceiver with Bluetooth function. The control device 100 can be a terminal device such as a mobile phone, tablet computer, PC, etc. The control device 100 is installed with executable light control software. The control device 100 can configure and control the lighting device 200 by running the light control software. For example, the control device 100 can adjust the lighting parameters of the lighting device 200, such as brightness, hue, color, saturation and color temperature, by running the light control software.

[0057] In one embodiment of the present application, referring to FIG. 1 , the lighting control system further includes a display device 300 connected to the control device 100 and configured to display a background video. The display device 300 and the control device 100 can be connected wirelessly or via a wired connection. Specifically, by importing pre-edited video material into the control device 100, the control device 100 can control the display device 300 to display the corresponding background video. In this case, by running lighting control software on the control device 100, the lighting devices 200 can be configured within the corresponding control interface. Locations in the background video can be mapped to lighting devices 200 at the filming site. This allows mapping points associated with each lighting device 200 at the filming site to be selected in the background video. Each mapping point is associated with a group of lighting devices 200. A group of lighting devices can be a single lighting device or multiple lighting devices installed in the same area at the filming site. Thus, by acquiring the color parameters of each mapping point in the background video and transmitting them to the lighting device 200 associated with the mapping point, the lighting of the lighting device 200 can be adjusted in accordance with the background video. You can use on-site lighting equipment to simulate the lighting effects in the video background, allowing the subject to blend more seamlessly into the overall video background to create a more realistic visual effect.

[0058] In one embodiment of the present application, referring to FIG1 , the control device 100 includes a camera 110 configured to capture a background video. The camera 110 may be a camera. The control device 100 is provided with the camera 110, so that the camera 110 can be aimed at the virtual scene being played to capture the video background in real time. Similarly, by running lighting control software on the control device 100 and configuring the lighting devices 200 on the corresponding control interface, mapping locations in the background video to the lighting devices 200 at the filming site is specified. This means that mapping points associated with each lighting device 200 at the filming site are selected in the background video, where each mapping point is associated with a group of lighting devices 200. Thus, by capturing the video background in real time, the color parameters of each mapping point in the background video can be obtained in real time and sent to the lighting device 200 associated with the mapping point, allowing the lighting of the lighting device 200 to be adjusted in real time based on the background video.

[0059] In the embodiment of the present application, by running the light control software on the control device 100, the lighting device 200 can be configured and its parameters adjusted. By capturing a video background and setting the lighting device 200 to simulate the lighting effects in the background video, the lighting of the lighting device 200 can be adjusted in real time with the video background, so that the on-site lighting matches the virtual scene.

[0060] In today's video shooting scenarios, multiple video lights are often deployed on set to meet lighting requirements. However, existing video lights are all controlled centrally through a console. When there are a large number of video lights, users cannot quickly associate each light with its corresponding control button. Consequently, every time a light adjustment is needed, users must first search for the correct one. This operation is very cumbersome and cannot meet the fast pace of filming.

[0061] Based on this, the embodiment of the present application proposes a lighting visualization management method. Through the visual management of lighting equipment, when it is necessary to adjust and control the lighting equipment at the shooting site, the corresponding lighting icon can be intuitively found and controlled. The operation is simple and can well meet the fast working pace of the shooting site.

[0062] 2 , which is a flowchart of the steps of the lighting visualization management method provided in an embodiment of the present application, is executed by the control device 100 in the lighting control system proposed in any embodiment of the present application, including but not limited to steps S210 to S240 .

[0063] Step S210: establishing a communication connection with each lighting device at the shooting scene.

[0064] In the embodiment of the present application, a communication connection is first established between the control device 100 and the lighting device 200. Specifically, the control device 100 and the lighting device 200 can be connected wirelessly or by wire. For example, the control device 100 can be connected to the lighting device 200 via Bluetooth or DMX, or the control device 100 can be connected to the lighting device 200 by wire via Ethernet. For example, the control device 100 can establish a connection with the lighting device 200 via a wireless DMX transceiver with Bluetooth functionality. The control device 100 can be a terminal device such as a mobile phone, tablet computer, or PC. The control device 100 is installed with executable lighting control software. By running this lighting control software, the control device 100 can achieve visual management of the lighting device 200.

[0065] Step S220: Obtain basic information of the lighting equipment and generate a corresponding lighting icon.

[0066] In the embodiment of the present application, the control device 100, by running the lighting control software, can enter basic information about each lighting device, such as the lighting type, model, and location at the filming location, into the corresponding control interface. After entering the basic information about the lighting device, a corresponding light icon can be generated based on the basic information. For example, if the lighting device entered is a panel light, a rectangular light icon corresponding to the panel light can be generated. If the lighting device entered is a flashlight, a circular light icon corresponding to the flashlight can be generated.

[0067] 3 , which is a flowchart of the steps for obtaining basic information of a lighting device and generating a corresponding lighting icon provided by an embodiment of the present application, including but not limited to steps S310 to S330 .

[0068] Step S310, obtaining basic information of the lighting equipment, including the lighting type and model of the lighting equipment;

[0069] Step S320: According to the light type, calling a preset light icon corresponding to the light type;

[0070] Step S330: Associating the light icon with the light device so that the light icon corresponds to the light device one-to-one.

[0071] In an embodiment of the present application, by pre-setting icons of different shapes corresponding to different types of lighting equipment, the pre-set light icons corresponding to the light types can be directly called after obtaining the light type of the lighting equipment. For example, it is pre-set that light type A corresponds to a rectangular light icon, light type B corresponds to a circular light icon, and light type C corresponds to a triangular light icon. Therefore, when the light type of the lighting equipment is identified as light type A, the rectangular light icon can be directly called out, and an association relationship between the rectangular light icon and the lighting equipment of light type A is established. When the light type of the lighting equipment is identified as light type B, the circular light icon can be directly called out, and an association relationship between the circular light icon and the lighting equipment of light type B is established. When the light type of the lighting equipment is identified as light type C, the triangular light icon can be directly called out, and an association relationship between the triangular light icon and the lighting equipment of light type C is established. In this way, the light icons and lighting equipment can be in one-to-one correspondence.

[0072] In one embodiment of the present application, after calling a preset light icon corresponding to the light type according to the light type, the method further includes:

[0073] Enter the light type information in the light icon and number the light icons.

[0074] In an embodiment of the present application, considering that a filming scene may contain multiple lighting devices with the same lighting type but different lighting models, to distinguish between these devices, the lighting type information can be entered in the light icons and the light icons can be numbered. For example, there are three lighting devices: a first lighting device, a second lighting device, and a third lighting device. They all have the same lighting type, lighting type A. In this case, the rectangular light icon corresponding to the first lighting device can be entered with the lighting type A and numbered ①. The rectangular light icon corresponding to the second lighting device can be entered with the lighting type A and numbered ②. The rectangular light icon corresponding to the third lighting device can be entered with the lighting type A and numbered ③. This allows for differentiating between lighting devices of the same lighting type. Furthermore, by entering the lighting type information in the light icons, it is also easier to identify lighting devices of the same lighting type through text, making it easier to subsequently search for and control lighting devices of the same lighting type.

[0075] In one embodiment of the present application, the location information of the corresponding lighting device at the shooting scene can also be recorded in the light icon. For example, if the first lighting device is located above the subject at the shooting scene, the location of the corresponding lighting device can be recorded as "above" in the light icon corresponding to the first lighting device. In this way, the correspondence between the light icon and the lighting device can be determined based on the location information of the corresponding lighting device marked in the light icon.

[0076] Step S230 , arranging the light icons in a preset grid diagram according to the light positions of the various light devices at the shooting scene, so that the positions of the light icons in the grid diagram correspond one-to-one to the light positions of the corresponding light devices at the shooting scene.

[0077] In the embodiment of the present application, the control device 100 can enter the corresponding light icons of each lighting device at the shooting scene in the corresponding control interface by running the light control software, so that each light icon on the control interface has a corresponding light device. The light control software can pre-store grid diagrams of various specifications (such as: 3*3, 3*4, 4*5, etc.), so that according to the light position layout of each lighting device at the shooting scene, a corresponding grid diagram can be generated on the corresponding control interface or adjusted to a preset corresponding grid diagram. Alternatively, a corresponding grid diagram can be generated according to the user's settings, such as first generating a grid diagram of specified specifications, and then dividing the shooting scene into areas corresponding to the grid diagram. At this time, the light icons are further arranged in a corresponding grid according to the light position layout of each lighting device at the shooting scene, so that the positions of the light icons in the grid diagram correspond one-to-one to the light positions of the corresponding lighting devices at the shooting scene.

[0078] For example, refer to Figure 4, which is an example diagram of the layout of light icons in a grid diagram provided by an embodiment of the present application. Since there is a panel light a1 and a2 on the left and right sides of the subject in the shooting scene, the light icons corresponding to the panel lights a1 and a2 need to be placed in the grids on the left and right sides of the middle (the position of the subject is in the middle position). There is a flash light b2 in front of the left of the subject, and the light icon corresponding to the flash light b2 needs to be placed in the grid in front of the left of the middle position. There is a flash light b3 in front of the right of the subject, and the light icon corresponding to the flash light b3 needs to be placed in the grid in front of the right of the middle position. There is a flash light b1 behind the subject, and the light icon corresponding to the flash light b1 needs to be placed in the grid behind the middle position. There is an auxiliary light c1 behind the left of the subject, and the light icon corresponding to the auxiliary light c1 needs to be placed in the grid in the rear left of the middle position. If there is an auxiliary light C2 behind the subject, the light icon corresponding to the auxiliary light C2 should be placed in the grid at the right rear of the center position. This ensures that the positions of the light icons in the grid map correspond to the positions of the lighting equipment at the shooting scene.

[0079] In an embodiment of the present application, by moving the position of each light icon in the grid map in the generated grid map interface so that it corresponds to the position of the lighting equipment corresponding to the shooting scene, the position of each light icon in the grid map can be made to correspond one-to-one with the light position of each lighting equipment at the shooting scene, so that the lighting equipment information at the shooting scene can be clear at a glance. When it is necessary to adjust and control the lighting equipment at the shooting scene, the corresponding light icon can be intuitively found and controlled.

[0080] Step S240 , triggering the light icon that needs to be adjusted in the grid diagram to input corresponding control parameters, and transmitting the control parameters to the corresponding lighting device, so that the lighting device emits light according to the received control parameters.

[0081] In this embodiment of the present application, by triggering the light image to be adjusted in the grid diagram, control parameters for controlling the corresponding lighting device can be input. Once input, due to the communication connection between the control device 100 and the lighting device 200, the input parameters can be directly transmitted to the corresponding lighting device to control the lighting of the corresponding lighting device. The control parameters are configured to control the lighting parameters of the lighting device, including the brightness, hue, color temperature, and saturation of the light. For example, the input control parameters can control the overall brightness of the lighting device.

[0082] In one embodiment of the present application, triggering the light icon that needs to be adjusted in the grid diagram to input the corresponding control parameters includes:

[0083] Trigger the individual light icon that needs to be adjusted in the grid diagram to input the control parameters of the lighting device corresponding to the individual light icon;

[0084] Alternatively, multiple light icons that need to be adjusted in the grid diagram are triggered in sequence, so as to simultaneously input control parameters for the light devices corresponding to the multiple light icons.

[0085] In this embodiment of the present application, when adjusting and controlling individual lighting devices in a filming scene, the lighting parameters of each lighting device can be adjusted individually by triggering its corresponding lighting icon and entering the corresponding control parameters. For lighting devices of the same type, multiple lighting icons corresponding to the same lighting device can be triggered sequentially to simultaneously enter the control parameters for each lighting device of the same type, thereby improving adjustment efficiency. For example, a filming scene includes lighting device a1, lighting device a2, lighting device b1, lighting device b2, lighting device b3, lighting device c1, and lighting device c2. In this case, the lighting icon corresponding to lighting device a1 can be triggered first, and the corresponding control parameters can be entered to adjust the lighting parameters of lighting device a1. Then, the lighting icon corresponding to lighting device a2 can be triggered, and the corresponding control parameters can be entered to adjust the lighting parameters of lighting device a2. Finally, the lighting icon corresponding to lighting device b1 can be triggered, and the corresponding control parameters can be entered to adjust the lighting parameters of lighting device b1. Then, trigger the light icon corresponding to lighting device b2 and enter the corresponding control parameters to adjust the lighting parameters of lighting device b2. Then, trigger the light icon corresponding to lighting device b3 and enter the corresponding control parameters to adjust the lighting parameters of lighting device b3. Then, trigger the light icon corresponding to lighting device c1 and enter the corresponding control parameters to adjust the lighting parameters of lighting device c1. Then, trigger the light icon corresponding to lighting device c2 and enter the corresponding control parameters to adjust the lighting parameters of lighting device c2. In this way, each lighting device at the shooting scene can be adjusted one by one. Alternatively, since lighting devices a1 and a2 have the same lighting type, lighting devices b1, b2, and b3 have the same lighting type, and lighting devices c1 and c2 have the same lighting type, the light icon corresponding to lighting device a1 and the light icon corresponding to lighting device a2 can be triggered simultaneously, and the corresponding control parameters can be entered to adjust lighting devices a1 and a2 simultaneously. Simultaneously trigger the lighting icons for lighting device b1, lighting device b2, and lighting device b3, and enter the corresponding control parameters to adjust lighting devices b1, b2, and b3 simultaneously. Simultaneously trigger the lighting icons for lighting device c1 and lighting device c2, and enter the corresponding control parameters to adjust lighting devices c1 and c2 simultaneously. This allows lighting devices of the same type to be adjusted simultaneously, improving dimming efficiency.

[0086] In one embodiment of the present application, when a light icon that needs to be adjusted in a grid map is triggered, the method includes:

[0087] In response to the triggering operation of the light icon, the light device corresponding to the light icon is controlled to respond in a lighting or flashing manner.

[0088] In the embodiment of the present application, after a light icon is triggered, the light device corresponding to the light icon will light up or flash. Therefore, by triggering the light icon and observing the light device that lights up or flashes, the light device corresponding to the triggered light device can be determined. Therefore, if it is not clear which light icon corresponds to which light device image in the shooting scene, it can be determined by triggering the light icon and observing the light device that lights up or flashes.

[0089] In the embodiment of the present application, by triggering the light icon that needs to be adjusted in the grid diagram, the corresponding control parameters can be input to control the lighting of the corresponding lighting device. That is, by generating light icons corresponding to the lighting devices and arranging the positions of the light icons to correspond one-to-one with the lighting positions of the corresponding lighting devices at the shooting scene, the lighting equipment information at the shooting scene can be clearly seen. When the lighting equipment at the shooting scene needs to be adjusted or controlled, the corresponding light icon can be intuitively found and controlled. The operation is simple and can well meet the fast working pace of the shooting scene.

[0090] Nowadays, the demand for virtual production is increasing. If you want to capture a realistic sense of presence, it is extremely important to match the on-site lighting with the virtual scene.

[0091] However, during the process of combining virtual and real shooting, since the lighting equipment cannot automatically adjust according to the color parameters of the video background, the lighting effect on the person being photographed is quite different from that in the video background, and the realism of the shot video is poor.

[0092] Based on this, an embodiment of the present application proposes a lighting control method, which maps lighting equipment to corresponding mapping points in the video background one by one, so that the lighting equipment can emit light accordingly according to the color parameters of the corresponding mapping points in the video background, thereby reducing the difference between the light effect on the photographed person and the video background, and greatly improving the realism of the video.

[0093] 5 , which is a flowchart of a lighting control method provided in an embodiment of the present application, is executed by the control device 100 in the lighting control system provided in any embodiment of the present application, including but not limited to steps S510 to S530 .

[0094] Step S510: Obtain background video.

[0095] In the embodiment of the present application, light control software is run in the control device 100, and a background video is input into the light control software. The specific background video can be imported through the software, or the background video can be obtained in real time on site through the camera on the control device 100.

[0096] In one embodiment of the present application, a background video may be obtained by importing a video file into the control device 100 or by using the camera device 110 to collect and process background image information displayed at the shooting scene in real time.

[0097] For example, a pre-edited background video can be directly imported into the control device 100. The pre-edited background video can also be displayed and played by the display device, and the camera of the control device 100 is aimed at the screen of the display device playing the background video to obtain the background video.

[0098] Step S520 : Select mapping points associated with various lighting devices at the shooting scene in the background video, wherein one mapping point is associated with a group of lighting devices.

[0099] In an embodiment of the present application, after obtaining the background video, mapping points associated with various lighting devices at the shooting scene can be selected in the background video, that is, a mapping point is selected in the background video and associated with a lighting device at the shooting scene, so that the lighting device can simulate the light changes at the mapping point in the background video.

[0100] Specifically, the lighting equipment at the shooting location is first added to the control device 100. From there, users can select each mapping point in the background video and associate a corresponding lighting device with each mapping point. This means that each mapping point in the background video has a corresponding lighting device to simulate the lighting changes.

[0101] For example, lighting equipment is typically placed above, in front of, to the left, or to the right of the subject at a filming location. Before selecting a mapping point, the lighting equipment to be mapped (e.g., the upper light) is first selected and added to the control device 100. The mapping point to which the lighting equipment (e.g., the upper light) is to be mapped is then selected in the background video (e.g., the upper portion of the background video), and the mapping point is associated with the selected lighting equipment. During operation, the lighting equipment at each location is selected in sequence. After the lighting equipment is selected, the location to be mapped is triggered from the background video. The triggered location becomes the mapping point; there is a one-to-one correspondence between the lighting equipment and the mapping point.

[0102] 6 , which is a flowchart of the steps of selecting mapping points associated with various lighting devices at a shooting scene in a background video according to an embodiment of the present application, including but not limited to steps S610 to S620 .

[0103] Step S610: Select target lighting equipment that needs to be associated with the shooting scene.

[0104] Step S620 : Based on the position of the target lighting device at the shooting scene, a target mapping point corresponding to the target lighting device is selected at a corresponding position in the background video, and the target lighting device is associated with the target mapping point.

[0105] In the embodiment of the present application, by running the control interface corresponding to the light control software on the control device 100, the target lighting device to be associated with the shooting scene is first selected. Then, based on the location of the target lighting device at the shooting scene, a target mapping point corresponding to the target lighting device is selected at the corresponding location in the background video. For example, if the target lighting device is located above the subject at the shooting scene, a point is correspondingly selected at the upper portion of the image area of ​​the background video as the target mapping point for the target lighting device. In this way, the target lighting device can be associated with the target mapping point, so that each mapping point in the background video has a corresponding mapped lighting device. Thus, the lighting device at the shooting scene can be used to simulate the light changes at the corresponding mapping point in the background video.

[0106] For example, lighting devices 1, 2, 3, and 4 are positioned above, in front of, to the left, and right of a subject at a filming location. Lighting devices 1, 2, 3, and 4 are first connected to control device 100 and added to the corresponding control interface of control device 100. Then, select lighting device 1 and a point in the upper portion of the background video as mapping point A to associate lighting device 1 with mapping point A. Select lighting device 2 and a point in the front portion of the background video as mapping point B to associate lighting device 2 with mapping point B. Select lighting device 3 and a point in the left portion of the background video as mapping point C to associate lighting device 3 with mapping point C. Select lighting device 4 and a point in the right portion of the background video as mapping point D to associate lighting device 4 with mapping point D. In this way, each mapping point in the background video can be mapped and associated with its corresponding lighting device.

[0107] In one embodiment of the present application, after selecting mapping points associated with various lighting devices at the shooting scene in the background video, the method further includes:

[0108] The size of the image area corresponding to the mapping point in the background video is adjusted.

[0109] In the embodiment of the present application, the size of the image area corresponding to the mapping point in the background video is adjustable, thereby adjusting the color recognition accuracy. By increasing the image area corresponding to the mapping point in the background video, the color recognition accuracy can be improved. By decreasing the image area corresponding to the mapping point in the background video, the color recognition accuracy can be reduced.

[0110] Correspondingly, the control device 100 can also adjust the overall brightness of the lighting device so that the light of the lighting device can more accurately match the picture of the background video.

[0111] Step S530: obtaining the real-time color parameters of each mapping point in the background video and sending them to the lighting device associated with the mapping point, so that the lighting device emits light accordingly according to the color parameters.

[0112] In the embodiment of the present application, after selecting mapping points associated with various lighting devices at the shooting scene in the background video, the control device 100 obtains the real-time color parameters of each mapping point in the background video and transmits the color parameters of each mapping point to the lighting device associated with the mapping point. This enables the lighting device to emit light according to the color parameters of the corresponding mapping point, thereby simulating the color changes of the corresponding mapping point in the background video and recreating the light changes at the mapping point in the background video on the scene. Moreover, since the color of each mapping point in the background video changes in real time, the corresponding lighting device can adjust the light emitted in real time according to the changes in the background video, thereby reducing the difference between the lighting effect on the subject and the background of the video, and improving the realism of the captured video.

[0113] 7 , which is a flowchart of the steps for obtaining real-time color parameters of each mapping point in a background video provided by an embodiment of the present application, including but not limited to steps S710 to S730 .

[0114] Step S710, obtaining the image area corresponding to the mapping point in the background video;

[0115] Step S720, obtaining the color parameters of each pixel in the image area;

[0116] Step S730 , averaging the color parameters of all pixels in the image area to obtain the color parameters of the mapping point.

[0117] In an embodiment of the present application, by obtaining the image area corresponding to the mapping point in the background video and obtaining the color parameters of each pixel in the image area, the color parameters of each mapping point in the background video can be calculated. Specifically, by averaging the color parameters of all pixels in the image area corresponding to the mapping point in the background video, the color parameters of the mapping point can be obtained. Thus, by sending the real-time color parameters of the mapping point to the corresponding lighting equipment, the corresponding lighting equipment can make corresponding real-time adjustments to the luminous parameters of the lighting equipment according to the color parameters of the mapping point, so that the light emitted by the lighting equipment can match the picture in the background video. Among them, the color parameters can be expressed in one of the RGB (red, green, blue) color space, CMYK (cyan, magenta, yellow, black) color space, and HSV (hue, saturation, brightness) color space.

[0118] In this embodiment, since the real-time color parameters of each mapping point are captured, the lighting parameters of the lighting device are automatically adjusted based on changes in the real-time color parameters of the mapping point, ensuring that they always match the background video. For example, if lightning suddenly appears in the sky area of ​​the background video, the lighting device mapped above it will also flash accordingly, simulating the lighting effect in the background video.

[0119] 8 , which is another flow chart of a lighting control method provided in an embodiment of the present application, is executed by the lighting device 200 in the lighting control system provided in any embodiment of the present application, including but not limited to steps S810 to S820 .

[0120] Step S810, receiving the real-time color parameters of the corresponding mapping points sent by the control device;

[0121] Step S820: adjusting the light emission parameters according to the real-time color parameters of the corresponding mapping points so that the emitted light matches the image in the background video.

[0122] In the embodiments of the present application, the executing entity is the lighting device 200 in the lighting control system provided in any embodiment of the present application. The lighting device 200 receives the real-time color parameters of the corresponding mapping points sent by the control device 100. Thus, the lighting device 200 can adjust the lighting parameters accordingly based on the real-time color parameters of the corresponding mapping points, so that the emitted light matches the image in the background video. This can reduce the difference between the light effect on the subject and the background of the video, thereby improving the realism of the captured video.

[0123] An embodiment of the present application further provides an electronic device, which includes a memory and a processor, wherein the memory stores a computer program, and the processor implements the above-mentioned light visualization management method and / or light control method when executing the computer program.

[0124] Please refer to FIG9 , which illustrates a hardware structure of an electronic device according to another embodiment. The electronic device includes:

[0125] The processor 901 can be implemented using a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is configured to execute relevant programs to implement the technical solutions provided in the embodiments of the present application;

[0126] The memory 902 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 902 can store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program codes are stored in the memory 902 and are called by the processor 901 to execute the above-mentioned lighting visualization management method and / or lighting control method of the embodiments of this application.

[0127] Input / output interface 903, configured to implement information input and output;

[0128] Communication interface 904 is configured to implement communication interaction between the device and other devices, and communication can be achieved through wired means (such as USB, network cable, etc.) or wireless means (such as mobile network, WiFi, Bluetooth, etc.);

[0129] Bus 905 , which transmits information between various components of the device (e.g., processor 901 , memory 902 , input / output interface 903 , and communication interface 904 );

[0130] The processor 901 , the memory 902 , the input / output interface 903 and the communication interface 904 are connected to each other in communication within the device via a bus 905 .

[0131] An embodiment of the present application further provides a storage medium, which is a computer-readable storage medium and stores a computer program. When the computer program is executed by a processor, the above-mentioned lighting visualization management method and / or lighting control method is implemented.

[0132] The memory, as a non-transient computer-readable storage medium, can be configured to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely located relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0133] The embodiments described in the embodiments of this application are intended to more clearly illustrate the technical solutions of the embodiments of this application and do not constitute a limitation on the technical solutions provided by the embodiments of this application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0134] While the present disclosure has been described with reference to several exemplary embodiments, it should be understood that the terms used are illustrative and exemplary rather than restrictive. Since the present disclosure can be embodied in many forms without departing from the spirit or substance of the disclosure, it should be understood that the above-described embodiments are not limited to any of the foregoing details, but should be interpreted broadly within the spirit and scope of the appended claims. Therefore, all changes and modifications that fall within the scope of the claims or their equivalents are intended to be covered by the appended claims.

Claims

1. A lighting control method, comprising: Get background video; Selecting mapping points associated with various lighting devices at the shooting scene in the background video, wherein one mapping point is associated with a group of the lighting devices; The real-time color parameters of each mapping point in the background video are obtained, and the real-time color parameters of each mapping point are sent to the lighting equipment associated with the mapping point, so that the lighting equipment emits light accordingly according to the color parameters.

2. The method according to claim 1, wherein The obtaining of background video includes: The background video is obtained by importing a video file; or by collecting and processing the background image information displayed at the shooting scene in real time to obtain the background video.

3. The method according to claim 1, wherein The step of selecting mapping points associated with various lighting devices at the shooting scene in the background video includes: Select the target lighting equipment that needs to be associated with the shooting scene; Based on the position of the target lighting device at the shooting scene, a target mapping point corresponding to the target lighting device is selected at a corresponding position in the background video, and the target lighting device is associated with the target mapping point.

4. The method according to claim 1 or 3, wherein After selecting mapping points associated with various lighting devices at the shooting scene in the background video, the method further includes: The size of the image area corresponding to the mapping point in the background video is adjusted.

5. The method according to claim 1, wherein Obtaining the real-time color parameters of each mapping point in the background video includes: Obtaining an image area corresponding to the mapping point in the background video; Obtaining the color parameters of each pixel in the image area; The color parameters of all pixels in the image area are averaged to obtain the color parameter of the mapping point.

6. The method according to claim 1 or 5, wherein: The color parameters include RGB color space parameters, HSV color space parameters or CMYK color space parameters.

7. The method according to claim 1, wherein Before obtaining the background video, the method includes: Establish communication connections with various lighting equipment on the shooting scene; Obtain basic information of the lighting device and generate a corresponding lighting icon; The light icons are arranged in a preset grid diagram according to the light position layout of each light device at the shooting scene, so that the positions of the light icons in the grid diagram correspond one-to-one to the light positions of the corresponding light devices at the shooting scene.

8. The method according to claim 7, wherein: The acquiring of basic information of the lighting device and generating a corresponding lighting icon includes: Obtaining basic information of the lighting device, the basic information including the lighting type and lighting model of the lighting device; According to the light type, calling a preset light icon corresponding to the light type; The light icons are associated with the light devices so that there is a one-to-one correspondence between the light icons and the light devices.

9. The method according to claim 8, wherein After calling a preset light icon corresponding to the light type according to the light type, the method further includes: The light type information is entered into the light icon, and the light icon is numbered.

10. The method according to claim 7, wherein: Before arranging the light icons in a preset grid diagram according to the light position layout of each of the light devices at the shooting scene, the method further includes: According to the light position layout of each lighting device at the shooting scene, a corresponding grid diagram is generated on the control interface or adjusted to a preset corresponding grid diagram.

11. A lighting control system, wherein: The system comprises: at least one lighting device; A control device connected to the lighting device, wherein the control device is configured to execute any one of claims 1 to 10 The method is used to control the lighting device to emit light.

12. The system according to claim 11, wherein The system further includes a display device connected to the control device, and the display device is configured to display a background video.

13. The system according to claim 11 or 12, wherein: The control device further includes a camera device configured to capture background video.

14. An electronic device, wherein: The electronic device includes a memory and a processor, the memory stores a computer program, and the processor implements the method according to any one of claims 1 to 10 when executing the computer program.

15. A computer-readable storage medium storing a computer program, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 10 is implemented.

Citation Information

Patent Citations

  • Ambient lighting

    CN101548551A

  • Light video picture intelligent interaction system, light video picture intelligent interaction control method and television

    CN114126135A

  • Video atmosphere light control method and device, electronic equipment and storage medium

    CN115866308A

  • Light control method and system and electronic equipment

    CN118283432A

  • Light source control method and apparatus for display device

    US20090179851A1