Intelligent light source regulation and control system and method based on AI relighting

Abstract

The invention discloses an intelligent light source regulation and control system and method based on AI relighting, and belongs to the technical field of light source regulation and control, and the method comprises the following steps: 1, carrying out the three-dimensional reconstruction of a site through employing a three-dimensional reconstruction technology, and outputting a three-dimensional environment model; 2, matching the light source parameters with the AI re-lighting model; step 3, simulating a character polishing effect by the AI re-polishing model; 4, judging whether light source setting is completed or not, if not, executing the step 5, and if yes, executing the step 7; 5, detecting and feeding back space coordinates and spectral data; step 6, light source control adjustment and registration; step 7, event setting and light source matching; 8, scene figure detection and registration; step 9, registering light source switching and camera switching events; and 10, judging whether event matching is completed or not. The system can achieve the effects of intelligent dimming, cost reduction, high-precision matching, automatic control and the like, and is suitable for application scenes of studios or stage plays.

Description

Technical Field

[0001] The present invention relates to the technical field of light source control, and in particular to an intelligent light source control system and method based on AI relighting. Background Art

[0002] With the continuous advancement of science and technology, lighting control technology in the fields of stage art, studios, and film and television production is also constantly innovating and developing. Lighting is not just for illumination, but also plays a vital role in stage effects, emotional expression, and audience experience. How to reduce labor costs and accurately, flexibly, and in real time control and adjust light sources to adapt to changes in actors, scenes, and plots has become one of the challenges facing the industry.

[0003] One of the existing technologies is a traditional stage lighting system based on manual control: stage and studio lighting systems mainly rely on manual control. The lighting technician manually adjusts the switch, brightness, color temperature and angle of the light source according to the pre-arranged script and personnel positions, and it takes a lot of time and cost to pre-arrange and design the lighting. During the movement of personnel, the lighting technician manually operates the dimming console or control console to adjust the lighting settings in real time. It has the following disadvantages:

[0004] 1) Slow response: Manual operation has delays and cannot keep up with the fast movements of actors in real time, resulting in poor lighting effects.

[0005] 2) High work intensity: Lighting technicians need to concentrate for a long time, the operation is complicated, and they are prone to fatigue and mistakes.

[0006] 3) Lack of flexibility: Pre-arranged lighting plans are difficult to adapt to temporary changes, and lighting cannot be adjusted in real time to adapt to emergencies.

[0007] 4) Inefficiency: It requires a lot of human resources, has low overall efficiency, and increases operating costs.

[0008] 5) Limited accuracy: It is difficult to achieve high-precision control effects by manually adjusting the position and parameters of the light source.

[0009] Another existing technology is an automatic lighting control system based on preset scene switching: by presetting the lighting parameters of different scenes in the control system, the staff manually or semi-automatically switches the scenes during the performance or recording process to adjust the lighting. It has the following disadvantages:

[0010] 1) Lack of real-time performance: People are still required to perform at a fixed time, and the lighting technician also needs to switch according to the time.

[0011] 2) Lack of intelligence: The initial preparation of light source, camera and personnel arrangement requires demonstration and continuous trial at the actual location, which consumes a lot of resources.

[0012] 3) Reliance on preset processes: Once deviations occur during the performance or recording process, the system cannot adjust adaptively and requires manual intervention.

[0013] Based on this, the present invention designs an intelligent light source control system and method based on AI re-lighting to solve the above problems. Summary of the invention

[0014] In view of the above-mentioned shortcomings of the prior art, the present invention provides an intelligent light source control system and method based on AI re-lighting.

[0015] To achieve the above objectives, the present invention is implemented through the following technical solutions:

[0016] An intelligent light source control method based on AI relighting includes the following steps:

[0017] Step 1: Use 3D reconstruction technology to perform 3D reconstruction of the site and output a 3D environment model;

[0018] Step 2: Match the light source parameters with the AI ​​relighting model;

[0019] Step 3: AI relighting model simulates character lighting effect;

[0020] Step 4: Determine whether the light source setting is completed, if not, proceed to step 5, if yes, proceed to step 7;

[0021] Step 5: spatial coordinate and spectral data detection feedback;

[0022] Step 6: Light source control adjustment and registration;

[0023] Step 7: Event setting and light source matching;

[0024] Step 8: Scene character detection and registration;

[0025] Step 9: Registering light source switching and camera switching events;

[0026] Step 10: Determine whether the event matching is completed. If so, end the process. If not, return to step 7.

[0027] Furthermore, step one is as follows:

[0028] 1.1. Obtain the three-dimensional data of the site;

[0029] 1.2. De-noising, filtering and point cloud registration processing of 3D data;

[0030] 1.3. 3D environment modeling: Generate a high-precision 3D environment model including the light source position, camera position, actor position and audience position.

[0031] Furthermore, the AI ​​relighting model designs the light source style in advance to form a light source library of the AI ​​relighting model.

[0032] Furthermore, step 2 is as follows:

[0033] 2.1. Obtain actual light source parameters;

[0034] 2.2. Use the actual light source parameters and scene requirements to match the light source library of the AI ​​relighting model to obtain the light source setting parameters that best match the current environment and scene.

[0035] Furthermore, step three is as follows:

[0036] 3.1. The original character image, 3D environment model, and matched light source setting parameters are input into the AI ​​relighting model;

[0037] 3.2. The AI ​​relighting model simulates the lighting effect of the characters according to the three-dimensional spatial position of the scene and the characters, the relative position of the light source and the lighting conditions, and uses the neural rendering network to generate high-quality images;

[0038] 3.3. AI lighting simulation matches the actual light source.

[0039] Furthermore, step five is as follows:

[0040] 5.1. The actors wear a spatial calibrator and a multispectral sensor. The spatial calibrator obtains the relative position of the actors, the camera and the light source, and the multispectral sensor obtains the lighting information and feeds it back to the AI ​​relighting model in real time.

[0041] 5.2. The AI ​​relighting model adjusts the light source setting parameters based on real-time data calibration.

[0042] Furthermore, step seven is as follows:

[0043] 7.1、Pre-setting of events;

[0044] 7.2. Enter event markers on the performance timeline;

[0045] 7.3. According to the event and time node, the user registers and matches the corresponding light source setting parameters;

[0046] 7.4. Save the matching results of events and light source setting parameters;

[0047] 7.5. Obtain event type through event detection camera.

[0048] Furthermore, step eight is as follows:

[0049] The event detection camera detects the actor's position information, identifies the actor's movements, determines whether the actor has entered a new scene area, registers the actor's position information, and outputs the actor's position and scene switching information;

[0050] Step nine is as follows:

[0051] According to the actor's position and scene switching information, combined with the matching results of the event and the light source setting parameters, the light source setting parameters are adjusted, and the camera of the corresponding scene is switched to shoot.

[0052] In order to better achieve the purpose of the present invention, the present invention also provides an intelligent light source control system based on AI relighting, comprising:

[0053] The 3D reconstruction module performs 3D reconstruction of the site and outputs a 3D environment model;

[0054] The spatial calibrator obtains the relative position of the actor, camera and light source, and feeds it back to the AI ​​relighting model in real time;

[0055] Multispectral sensor, which obtains lighting information and provides real-time feedback to the AI ​​relighting model;

[0056] AI relighting model, real-time simulation of character lighting effects, matching with actual light source equipment; and calibration and adjustment of light source setting parameters;

[0057] Event setting and light source matching module, according to the event and time node, the user registers and matches the corresponding light source setting parameters;

[0058] Event detection camera, obtains event type;

[0059] The light source switching and camera switching modules adjust the light source setting parameters according to the actor's position and scene switching information, combined with the matching results of events and light source setting parameters, and switch to the camera of the corresponding scene for shooting.

[0060] Compared with the prior art, the present invention has the following beneficial effects: 1) Intelligent dimming: The system can adjust the light source effect intelligently and in real time through the combination of AI re-lighting simulation and three-dimensional environmental model, without the need for human intervention, thus saving a lot of manpower and time costs.

[0061] 2) Reduce costs: Greatly reduce the resource investment in the early stage of the rehearsal. The light source design does not require on-site design to have an intuitive feeling, and the entire system can be designed by only one person.

[0062] 3) High-precision matching: Through the feedback of spatial positioning devices and multi-spectral sensors, high-precision detection and matching of light sources and character positions are achieved to ensure that the effect of each light source is real and natural.

[0063] 4) Automated control: The system can automatically adjust the light source settings according to real-time scene changes and supports complex scene switching to ensure that the light source effects in the performance always match the on-site environment and character movements.

[0064] 5) Enhanced audience experience: By combining high-quality AI simulation with real light source control, the visual effects of stage performances are improved, and the audience's sense of immersion and on-site experience are enhanced.

[0065] 6) Suitable for application scenarios in studios or stage plays. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0067] Figure 1 The present invention is a flow chart of an intelligent light source control method based on AI relighting.

[0068] Figure 2 A schematic diagram of a 3D reconstruction of a stage or studio venue.

[0069] Figure 3 This is a schematic diagram of matching light source parameters with the AI ​​model.

[0070] Figure 4 Schematic diagram of scene character detection and registration.

[0071] Figure 5 Register schematics for light switching and camera switching events. DETAILED DESCRIPTION

[0072] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0073] Embodiment 1: In some embodiments, please refer to the drawings of the specification Figure 1-Figure 5 , an intelligent light source control method based on AI relighting, comprising the following steps:

[0074] Step 1: Use 3D reconstruction technology to perform 3D reconstruction of the stage or studio venue and output a 3D environment model. The specific steps are as follows:

[0075] 1.1. Obtain three-dimensional data of the site through laser scanning, depth camera, structured light scanning, etc.

[0076] 1.2. De-noising, filtering and point cloud registration processing of 3D data;

[0077] 1.3. 3D environment modeling: Use SLAM, SFM, Delaunay triangulation and other algorithms to generate accurate site models, locate the positions of light sources (lights), cameras, actors, audiences (eyes) and other key facilities, and generate a high-precision 3D environment model that includes the positions of light sources, cameras, actors and audiences.

[0078] High-precision 3D reconstruction technology of the environment and characters is the basis of the system. Through precise spatial positioning, it helps to ensure the consistency of the positions of the light source and the actors.

[0079] Step 2: Match the light source parameters with the AI ​​relighting model. The specific steps are as follows:

[0080] The AI ​​relighting model designs the light source style in advance to form a light source library of the AI ​​relighting model, which does not require real-time on-site design and adjustment. The AI ​​relighting model can be implemented using the IC-light algorithm model.

[0081] 2.1. Obtain the actual light source parameters (spatial position, brightness adjustment range, color temperature adjustment range, corresponding color space adjustment range, angle adjustment range, light source focus divergence adjustment range);

[0082] 2.2. Use the actual light source parameters and scene requirements to match the light source library of the AI ​​relighting model to obtain the light source setting parameters that best match the current environment and scene;

[0083] The actual light source parameters refer to: the properties of the real physical light sources in the studio or stage, including spatial position, brightness adjustment range, color temperature adjustment range, angle adjustment range, light source focus divergence and other light source adjustment ranges. The light source setting parameters that best match the current environment and scene refer to: the light source configuration that is matched from the light source library by the AI ​​relighting model and best fits the current scene requirements. These parameters are designed to optimize the lighting effect and ensure that it is consistent with the needs of the environment and characters. The relationship between the two is: the actual light source parameters are the basic conditions, which limit the light source setting parameters generated by the AI ​​relighting model to be within the adjustable range of the actual light source, ensuring that the lighting effect generated by the model is physically feasible.

[0084] Purpose of actual light source parameters: Actual light source parameters are used as constraints for the AI ​​relighting model to ensure that the generated light source setting parameters are within the capabilities of the actual light source device. Actual light source parameters are used to ultimately control the actual light source device to adjust the light source according to the setting parameters generated by the AI ​​relighting model.

[0085] How to obtain the light source setting parameters that best match the current environment and scene:

[0086] Get actual light source parameters: First, collect the parameters of all actual light sources in the studio or stage, including spatial position, brightness adjustment range, color temperature adjustment range, light source focus divergence adjustment range, etc.

[0087] Environment and scene analysis: Obtain the 3D model and scene information of the current environment, including the position of characters, background layout, lighting requirements, etc. Extract the light source effects required in the scene (such as the light and dark contrast of characters, the directionality of light, the tone atmosphere, etc.).

[0088] Light source library matching the AI ​​relighting model: Input the actual light source parameters and scene requirements as constraints into the AI ​​relighting model. The AI ​​model sets the parameters of the light source that best matches the current scene requirements based on the range of actual light source parameters and the constraints of the light source library to simulate the effect.

[0089] Generate optimal light source setting parameters: The AI ​​model generates the light source setting parameters that best match the current environment and scene based on scene requirements and light source library matching results, ensuring that both scene requirements are met and the capabilities of the actual light source are met.

[0090] Method for matching the actual light source parameters and scene requirements with the light source library of the AI ​​relighting model:

[0091] Construction of the light source library: The light source library of the AI ​​relighting model is pre-designed and contains various light source styles and their parameter ranges (such as brightness, color temperature, angle, focus divergence, etc.). Each light source style in the light source library represents a specific lighting effect (such as soft light, hard light, mixed light, etc.).

[0092] Matching conditions: The following factors need to be considered when matching: Limitations of actual light source parameters: The light source style parameters in the light source library must be within the adjustable range of the actual light source. Scene requirements: The matching light source style needs to meet the current scene's requirements for lighting effects (such as character brightness, light and shadow direction, color tone atmosphere, etc.).

[0093] Matching algorithm: The AI ​​relighting model will match the actual light source parameters with the light source library through an algorithm (such as a neural network or optimization algorithm) to find the optimal solution. Specific steps: Enter the actual light source parameters and scene requirements. Filter out light source styles that meet the actual light source parameter range from the light source library. Calculate the adaptability of each light source style based on scene requirements (such as character position, light and shadow effects, etc.). Select the light source style with the highest adaptability as the light source setting parameter that best matches the current environment and scene.

[0094] Output the result.

[0095] Step 3: AI relighting model simulates the lighting effect of characters. The specific steps are as follows:

[0096] 3.1. The original character image, 3D environment model, and matched light source setting parameters are input into the AI ​​relighting model;

[0097] 3.2. The AI ​​re-lighting model simulates the lighting effect of the character according to the three-dimensional spatial position of the scene and the character, the relative position of the light source and the lighting conditions, and uses a neural rendering network (such as NeRF, IC-Light model, etc.) to generate high-quality images; the generated lighting effect includes the brightness, color temperature, color, angle, and light source focus divergence parameters within the adjustable range of the real light source to ensure consistency with the actual light source settings.

[0098] The character image generated by the AI ​​relighting model contains the original character image and the new light source effect, which can be either a single light source or multiple light sources. The generated image contains light source adjustment information, light intensity, chromaticity, color temperature and other data.

[0099] 3.3. AI lighting simulation matches actual light source: The AI ​​re-lighting model can simulate the character lighting effect in real time according to different environments, light sources and character positions, and match it with the actual light source equipment.

[0100] Step 4: Determine whether the light source setting is completed, if not, proceed to step 5, if yes, proceed to step 7;

[0101] The lighting effects generated by the AI ​​re-lighting model and the actual light source equipment are adjusted and recorded. The user adjusts the light source and chooses whether the adjustment has been completed. If the light source effect has reached the preset standard, it enters the event setting and light source matching; if not, it returns to the light source adjustment link.

[0102] Step 5: Detection and feedback of spatial coordinates and spectral data. The specific steps are as follows:

[0103] 5.1. The actors wear a spatial calibrator and a multispectral sensor. The spatial calibrator obtains the relative position of the actor and the camera (or the audience, depending on the specific form of the performance. Because the perspective of the picture displayed by AI relighting needs to be the same as the perspective of the actual observer (camera or audience)) and the light source. The multispectral sensor obtains light intensity, color temperature, chromaticity and other lighting information, and feeds it back to the AI ​​relighting model in real time;

[0104] The spatial calibrator can be a positioning device of the opti-trek system, which relies on reflection to determine the current spatial position.

[0105] 5.2. The AI ​​relighting model adjusts the light source setting parameters according to real-time data calibration, and then adjusts the lighting effect to ensure that the lighting is realistic and consistent;

[0106] The present invention uses a multi-spectral sensor to transmit information such as light intensity, color temperature, chromaticity and spatial position in real time, ensuring a perfect match between the simulated effect and the actual effect.

[0107] Step 6: Light source control adjustment and registration. The specific steps are as follows:

[0108] 6.1. According to the adjusted light source setting parameters, send the light source control signal through DMX512, Art-Net and other protocols to adjust the brightness, color, color temperature and other parameters of the actual light source;

[0109] 6.2. The AI ​​relighting model registers the adjusted light source setting parameters and replaces the previous light source setting parameters;

[0110] Step 7: Event setting and light source matching. The specific steps are as follows:

[0111] 7.1. Event pre-setting: such as scene switching, character appearance, etc.

[0112] 7.2. Enter event markers on the performance timeline;

[0113] For example, characters appear from 10.50 to 11:00;

[0114] Events are set in advance, and the time is flexible. If the person switching is not detected, the scene and lighting will not be switched. Only when the person reaches the corresponding position will the lighting scene switch be triggered. Therefore, there is a lot of room in time to switch the lighting scene according to the event.

[0115] 7.3. According to the event and time node, the user registers and matches the corresponding light source setting parameters;

[0116] Different events can match different light source setting parameters A;

[0117] For example Figure 4, event A has a light source setting for simulating lighting A, and event B has a light source setting for simulating lighting B. When the process of a person moving from scene A to scene B is detected, the switch from event A to event B will occur, so the light source setting will switch from simulating lighting A to B;

[0118] 7.4. Save the matching results of events and light source setting parameters to ensure that the light source changes with the scene during subsequent performances;

[0119] 7.5. Obtain the event type through the event detection camera; the event detection camera is preferably an EVS camera or an RGB monitoring camera;

[0120] Step 8: Scene character detection and registration. The specific steps are as follows:

[0121] The event detection camera detects the actor's position information, identifies the actor's movements, determines whether the actor has entered a new scene area, registers the actor's position information, and outputs the actor's position and scene switching information;

[0122] Step 9: Register light source switching and camera switching events. The specific steps are as follows:

[0123] According to the actor's position and scene switching information, combined with the matching results of the event and the light source setting parameters, the light source setting parameters are adjusted, and the camera of the corresponding scene is switched to shoot;

[0124] The present invention can automatically switch the light source and the camera shooting scene according to the events on the performance timeline and the scene switching events caused by the position change of the actors, so as to ensure the fluency of the performance effect.

[0125] Step 10: Determine whether the event matching is completed. If so, end the process. If not, return to step 7.

[0126] Check whether the event at the current time node on the performance timeline has completed the light source switching and camera switching. If so, complete the control process; if not, readjust to ensure that the event matches the light source and camera.

[0127] The present invention can monitor the actor's movement in real time and automatically control the light source for the next scene (scene change). When an event such as a scene change occurs, the light source and camera settings can be automatically adjusted according to the pre-set event to ensure the best picture quality and visual effect.

[0128] The present invention has the following technical effects:

[0129] 1) Intelligent dimming: The system combines AI relighting simulation with a three-dimensional environmental model to intelligently and in real time adjust the light source effect without manual intervention, saving a lot of manpower and time costs.

[0130] 2) Reduce costs: Greatly reduce the resource investment in the early stage of the rehearsal. The light source design does not require on-site design to have an intuitive feeling, and the entire system can be designed by only one person.

[0131] 3) High-precision matching: Through the feedback of spatial positioning devices and multi-spectral sensors, high-precision detection and matching of light sources and character positions are achieved to ensure that the effect of each light source is real and natural.

[0132] 4) Automated control: The system can automatically adjust the light source settings according to real-time scene changes and supports complex scene switching to ensure that the light source effects in the performance always match the on-site environment and character movements.

[0133] 5) Enhanced audience experience: By combining high-quality AI simulation with real light source control, the visual effects of stage performances are improved, and the audience's sense of immersion and on-site experience are enhanced.

[0134] 6) Suitable for application scenarios in studios or stage plays.

[0135] Embodiment 2: In some embodiments, please refer to the drawings of the specification Figure 1-Figure 5 , an intelligent light source control system based on AI relighting, including:

[0136] The 3D reconstruction module performs 3D reconstruction of the stage or studio venue and outputs a 3D environment model.

[0137] The spatial calibrator obtains the relative position of the actor, camera and light source, and provides real-time feedback to the AI ​​relighting model.

[0138] Multispectral sensors acquire lighting information such as light intensity, color temperature, and chromaticity, and provide real-time feedback to the AI ​​relighting model.

[0139] The AI ​​re-lighting model simulates the lighting effect of the character in real time and matches it with the actual light source equipment; it also calibrates and adjusts the light source setting parameters to adjust the lighting effect.

[0140] The event setting and light source matching module matches the corresponding light source setting parameters according to the event and time node.

[0141] The event detection camera obtains the event type; the event detection camera is preferably an EVS camera or an RGB monitoring camera.

[0142] The light source switching and camera switching modules adjust the light source setting parameters according to the actor's position and scene switching information, combined with the matching results of events and light source setting parameters, and switch to the camera of the corresponding scene for shooting.

[0143] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements will not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An intelligent light source control method based on AI relighting, characterized in that: The following steps are involved: Step 1: Use 3D reconstruction technology to perform 3D reconstruction of the site and output a 3D environment model; Step 2: Match the light source parameters with the AI ​​relighting model; Step 3: AI relighting model simulates character lighting effect; Step 4: Determine whether the light source setting is completed, if not, proceed to step 5, if yes, proceed to step 7; Step 5: spatial coordinate and spectral data detection feedback; Step 6: Light source control adjustment and registration; Step 7: Event setting and light source matching; Step 8: Scene character detection and registration; Step 9: Registering light source switching and camera switching events; Step 10: Determine whether the event matching is completed. If so, end the process. If not, return to step 7.

2. The intelligent light source control method based on AI relighting according to claim 1, characterized in that: Step 1 is as follows: 1.

1. Obtain the three-dimensional data of the site; 1.

2. De-noising, filtering and point cloud registration processing of 3D data; 1.

3. 3D environment modeling: Generate a high-precision 3D environment model including the light source position, camera position, actor position and audience position.

3. The intelligent light source control method based on AI relighting according to claim 2, characterized in that: The AI ​​relighting model designs light source styles in advance to form a light source library of the AI ​​relighting model.

4. The intelligent light source control method based on AI relighting according to claim 3 is characterized in that: Step 2 is as follows: 2.

1. Obtain actual light source parameters; 2.

2. Use the actual light source parameters and scene requirements to match the light source library of the AI ​​relighting model to obtain the light source setting parameters that best match the current environment and scene.

5. The intelligent light source control method based on AI relighting according to claim 4, characterized in that: Step 3 is as follows: 3.

1. The original character image, 3D environment model, and matched light source setting parameters are input into the AI ​​relighting model; 3.

2. The AI ​​relighting model simulates the lighting effect of the characters according to the three-dimensional spatial position of the scene and the characters, the relative position of the light source and the lighting conditions, and uses the neural rendering network to generate high-quality images; 3.

3. AI lighting simulation matches the actual light source.

6. The intelligent light source control method based on AI relighting according to claim 5, characterized in that: Step 5 is as follows: 5.

1. The actors wear a spatial calibrator and a multispectral sensor. The spatial calibrator obtains the relative position of the actors, the camera and the light source, and the multispectral sensor obtains the lighting information and feeds it back to the AI ​​relighting model in real time. 5.

2. The AI ​​relighting model adjusts the light source setting parameters based on real-time data calibration.

7. The intelligent light source control method based on AI relighting according to claim 6, characterized in that: Step 7 is as follows: 7.1、Pre-setting of events; 7.

2. Enter event markers on the performance timeline; 7.

3. According to the event and time node, the user registers and matches the corresponding light source setting parameters; 7.

4. Save the matching results of events and light source setting parameters; 7.

5. Obtain event type through event detection camera.

8. The intelligent light source control method based on AI relighting according to claim 7, characterized in that: Step 8 is as follows: The event detection camera detects the actor's position information, identifies the actor's movements, determines whether the actor has entered a new scene area, registers the actor's position information, and outputs the actor's position and scene switching information; Step nine is as follows: According to the actor's position and scene switching information, combined with the matching results of the event and the light source setting parameters, the light source setting parameters are adjusted, and the camera of the corresponding scene is switched to shoot.

9. An intelligent light source control system based on AI relighting, characterized in that: include: The 3D reconstruction module performs 3D reconstruction of the site and outputs a 3D environment model; The spatial calibrator obtains the relative position of the actor, camera and light source, and feeds it back to the AI ​​relighting model in real time; Multispectral sensor, which obtains lighting information and provides real-time feedback to the AI ​​relighting model; AI relighting model, real-time simulation of character lighting effects, matching with actual light source equipment; and calibration and adjustment of light source setting parameters; Event setting and light source matching module, according to the event and time node, the user registers and matches the corresponding light source setting parameters; Event detection camera, obtains event type; The light source switching and camera switching modules adjust the light source setting parameters according to the actor's position and scene switching information, combined with the matching results of events and light source setting parameters, and switch to the camera of the corresponding scene for shooting.

Images