Visual stage lighting monitoring and adjustment system and network equipment

Abstract

The present application provides a visual stage lighting monitoring and adjustment system and network equipment, which relates to the field of intelligent dimming technology. The system includes: a lighting control module, which performs stage lighting control and continuously monitors and collects stage images, a deviation information acquisition module, which performs illumination deviation identification; a sensitivity analysis module, which performs illumination compensation range analysis and monitoring sensitivity analysis; a trajectory deviation acquisition module, which performs movement trend prediction of the illumination target, an optimized illumination trajectory acquisition module, which performs optimization within the compensation illumination trajectory range to obtain an optimized illumination trajectory; and a lighting control adjustment module, which performs lighting control adjustment. This application can solve the technical problem that the existing technology lacks intelligence and dynamic adjustment capabilities, resulting in inaccurate lighting and inability to respond to stage changes in real time, further affecting stage performance effects and audience experience. Through image recognition technology and intelligent algorithms, the accuracy and dynamic adjustment capabilities of stage lighting control can be significantly improved.

Description

Technical Field

[0001] The present application relates to the field of intelligent dimming technology, and in particular to a visual stage lighting monitoring and adjustment system and network equipment. Background Art

[0002] Stage lighting control technology has gone through several stages of development, from the original manual control switch to analog dimming technology, and then to digital computer technology and intelligent network control. These technological advances have made it possible to intelligently control stage lighting. Stage lighting plays a vital role in performances. It not only illuminates, but also creates atmosphere and sets off the plot, making the performance more vivid and fascinating. With the diversification of art forms and the improvement of audience aesthetics, the requirements for stage lighting are getting higher and higher, and more sophisticated and flexible control methods are needed to meet different artistic expression needs.

[0003] In summary, the existing technology lacks intelligence and dynamic adjustment capabilities, resulting in inaccurate lighting and failure to respond to stage changes in real time, further affecting the stage performance effects and audience experience. Summary of the invention

[0004] The purpose of this application is to provide a visual stage lighting monitoring and adjustment system to solve the technical problems in the prior art due to the lack of intelligence and dynamic adjustment capabilities, resulting in inaccurate lighting and inability to respond to stage changes in real time, further affecting the stage performance effects and audience experience.

[0005] In view of the above problems, the present application provides a visual stage lighting monitoring and adjustment system.

[0006] In a first aspect, the present application also provides a visual stage lighting monitoring and adjustment system, wherein the system includes: a lighting control module, wherein the lighting control module is used to control the stage lighting according to a preset stage lighting control scheme, and continuously monitor and collect stage images, wherein the preset stage lighting control scheme includes a preset illumination trajectory, and the stage image includes images of an illumination target and an illumination area, and the illumination target is the target illuminated in the preset stage lighting control scheme; a deviation information acquisition module, wherein the deviation information acquisition module is used to identify illumination deviations based on the stage image and obtain illumination deviation information; and a sensitivity analysis module, wherein the sensitivity analysis module is used to perform illumination compensation range analysis and monitoring sensitivity analysis based on the illumination deviation information when the illumination deviation information is greater than an illumination deviation threshold, and obtain an illumination compensation range and a monitoring sensitivity. degree; a trajectory deviation acquisition module, the trajectory deviation acquisition module is used to continuously monitor and collect stage images according to the monitoring sensitivity, obtain a stage image sequence, predict the movement trend of the irradiated target, obtain the predicted movement trend information, and analyze and obtain the predicted irradiation trajectory deviation in combination with a preset irradiation trajectory; an optimized irradiation trajectory acquisition module, the optimized irradiation trajectory acquisition module is used to set an optimization step according to the irradiation deviation information, compensate the stage lighting control scheme according to the irradiation compensation range, obtain a compensated irradiation trajectory range, optimize the compensation irradiation trajectory range according to the predicted irradiation trajectory deviation, and obtain an optimized irradiation trajectory; a lighting control adjustment module, the lighting control adjustment module is used to generate an optimized stage lighting control scheme according to the optimized irradiation trajectory, and perform lighting control adjustment.

[0007] In a second aspect, the present application further provides a network device, which includes the visualized stage lighting monitoring and adjustment system described in the first aspect.

[0008] One or more technical solutions provided in this application have at least the following technical effects or advantages:

[0009] Through the lighting control module, the lighting control module is used to control the stage lighting according to the preset stage lighting control scheme, and continuously monitor and collect stage images, wherein the preset stage lighting control scheme includes a preset illumination trajectory, and the stage image includes images of the illumination target and the illumination area, and the illumination target is the target illuminated in the preset stage lighting control scheme; the deviation information acquisition module, the deviation information acquisition module is used to identify the illumination deviation based on the stage image and obtain the illumination deviation information; the sensitivity analysis module, the sensitivity analysis module is used to perform illumination compensation range analysis and monitoring sensitivity analysis based on the illumination deviation information when the illumination deviation information is greater than the illumination deviation threshold, and obtain the illumination compensation range and monitoring sensitivity; the trajectory deviation acquisition module, the trajectory deviation acquisition module is used to continuously monitor and collect the stage image according to the monitoring sensitivity, obtain the stage image sequence, predict the movement trend of the illumination target, and obtain The module obtains the predicted movement trend information, combines the preset illumination trajectory, and analyzes and obtains the predicted illumination trajectory deviation; optimizes the illumination trajectory acquisition module, and the optimized illumination trajectory acquisition module is used to set the optimization step according to the illumination deviation information, and compensates the stage lighting control scheme according to the illumination compensation range to obtain the compensated illumination trajectory range, and optimizes the compensated illumination trajectory range according to the predicted illumination trajectory deviation to obtain the optimized illumination trajectory; and the lighting control adjustment module is used to generate the optimized stage lighting control scheme according to the optimized illumination trajectory, and perform lighting control adjustment, which effectively solves the technical problem that the existing technology lacks intelligence and dynamic adjustment capabilities, resulting in inaccurate lighting illumination and inability to respond to stage changes in real time, further affecting the stage performance effect and the audience experience. The image recognition technology and intelligent algorithm can significantly improve the accuracy and dynamic adjustment capability of stage lighting control.

[0010] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented according to the contents of the specification, and in order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are specifically cited below. It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easy to understand through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the present application or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only exemplary, and for ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0012] Figure 1 This is a schematic diagram of the structure of the visual stage lighting monitoring and adjustment system for this application;

[0013] Figure 2 This is a structural diagram of obtaining predicted movement trend information of an illuminated target in a visual stage lighting monitoring and adjustment system of this application.

[0014] Description of reference numerals:

[0015] Lighting control module 11, deviation information acquisition module 12, sensitivity analysis module 13, trajectory deviation acquisition module 14, optimized illumination trajectory acquisition module 15, lighting control adjustment module 16, first stage image set acquisition module 21, second stage image set acquisition module 22, movement trend information set acquisition module 23, predictor construction module 24, image prediction module 25. DETAILED DESCRIPTION

[0016] This application solves the technical problem that the existing technology lacks intelligence and dynamic adjustment capabilities, resulting in inaccurate lighting and inability to respond to stage changes in real time, further affecting stage performance effects and audience experience, by providing a visual stage lighting monitoring and adjustment system. Through image recognition technology and intelligent algorithms, the accuracy and dynamic adjustment capabilities of stage lighting control can be significantly improved.

[0017] Below, the technical solutions in the present application will be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments of the present application. It should be understood that the present application is not limited to the example embodiments described herein. Based on the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application. It should also be noted that, for the convenience of description, only the parts related to the present application are shown in the accompanying drawings, rather than all of them.

[0018] Embodiment 1

[0019] Please refer to the attached Figure 1 , the present application provides a visual stage lighting monitoring and adjustment system, the system comprising:

[0020] A lighting control module 11, wherein the lighting control module 11 is used to control the stage lighting according to a preset stage lighting control scheme, and continuously monitor and collect stage images, wherein the preset stage lighting control scheme includes a preset illumination trajectory, and the stage image includes an image of an illumination target and an illumination area, and the illumination target is a target illuminated in the preset stage lighting control scheme;

[0021] Specifically, the preset stage lighting control scheme plans the various parameters and movements of the lights in detail, which ensures that the lights can accurately follow the specified path. For example, when dancing on the stage, the spotlight tracks the dancer, and the target of illumination is the dancer. The preset stage lighting control scheme is automatically executed according to the dancer's dance trajectory. When implementing lighting control, the stage images are continuously monitored and collected. These images not only contain the illumination target, that is, the objects or people that need to be illuminated as predetermined in the scheme, but also images of the illumination area, which helps to determine whether the light is accurately projected in the predetermined area. By analyzing these images in real time, any deviations from the preset scheme can be quickly identified and adjusted accordingly.

[0022] A deviation information acquisition module 12, wherein the deviation information acquisition module 12 is used to identify illumination deviation based on the stage image and obtain illumination deviation information;

[0023] Specifically, the collected stage images are preprocessed, such as denoising, enhancement, etc., to improve image quality and highlight key information. Next, computer vision and image processing technology are used to identify and locate the irradiation targets and irradiation areas in the image. Once the irradiation targets and areas are identified, they are compared with the preset irradiation trajectory. This is achieved by calculating the deviation between the actual light position and the preset trajectory. This deviation can be manifested as position deviation, angle deviation, or brightness deviation.

[0024] A sensitivity analysis module 13, wherein the sensitivity analysis module 13 is used to perform an irradiation compensation range analysis and a monitoring sensitivity analysis based on the irradiation deviation information when the irradiation deviation information is greater than the irradiation deviation threshold, so as to obtain an irradiation compensation range and a monitoring sensitivity;

[0025] Specifically, when the detected illumination deviation information exceeds the preset illumination deviation threshold, it means that the actual lighting illumination is significantly different from the expected one. Based on the illumination deviation information, an illumination compensation range analysis is performed. The range of lighting parameters that need to be adjusted, such as the position, angle or brightness of the light, is determined according to the size and direction of the deviation. Through this analysis, it is clear which lighting parameters need to be adjusted, as well as the magnitude and direction of the adjustment, so as to ensure that the light can be realigned to the illumination target or area. A monitoring sensitivity analysis is performed. This analysis mainly determines the system's response speed to the deviation based on the rate and trend of change of the illumination deviation. If the illumination deviation changes rapidly or shows a trend of continuous increase, then the monitoring sensitivity needs to be increased so that the deviation can be detected and responded to more quickly. Conversely, if the illumination deviation changes slowly or shows a stable trend, then the monitoring sensitivity can be appropriately reduced to reduce unnecessary adjustments and interference.

[0026] The trajectory deviation acquisition module 14 is used to continuously monitor and collect stage images according to the monitoring sensitivity, obtain a stage image sequence, predict the movement trend of the irradiated target, obtain predicted movement trend information, and analyze and obtain the predicted irradiation trajectory deviation in combination with a preset irradiation trajectory;

[0027] Specifically, by continuously acquiring a sequence of stage images, the movement of irradiated targets, such as actors and props, can be tracked and analyzed. Image processing and computer vision techniques are used to predict the movement trend of irradiated targets in stage image sequences. This includes target tracking algorithms, such as feature point tracking, optical flow methods, or deep learning methods, to estimate the motion trajectory of the target between consecutive image frames. Once the movement trend of the irradiated target is predicted, the deviation between the predicted movement trajectory and the preset trajectory can be analyzed and calculated in combination with the preset irradiation trajectory. This is because it allows lighting control to make adjustments in advance to ensure that the lighting can accurately follow the dynamic changes on the stage in real time.

[0028] An optimized illumination trajectory acquisition module 15 is used to set an optimization step size according to the illumination deviation information, compensate the stage lighting control scheme according to the illumination compensation range, obtain a compensated illumination trajectory range, and optimize within the compensated illumination trajectory range according to the predicted illumination trajectory deviation to obtain an optimized illumination trajectory;

[0029] Specifically, according to the illumination deviation information, an optimization step size is set. This step size determines the amplitude of each adjustment of the lighting parameters to ensure that the adjustment process is neither too radical to cause system instability nor too conservative to make the adjustment inefficient. The setting of the optimization step size is usually based on historical data to achieve fast and smooth adjustment. Next, the stage lighting control scheme is compensated within the illumination compensation range. According to the illumination compensation range obtained by analysis, the various parameters of the light, such as position, angle, brightness, etc., are gradually adjusted to correct the difference between the actual lighting illumination and the expected. This compensation process is to make the lighting illumination return to the preset trajectory as much as possible under the premise of ensuring the stage effect. After the preliminary compensation, further optimization is carried out within the determined compensation illumination trajectory range according to the predicted illumination trajectory deviation. The goal of this optimization is to find a lighting illumination trajectory that can correct the current deviation and adapt to possible future movement trends. To ensure that the lighting can maintain the best illumination effect in various dynamic changes.

[0030] The lighting control adjustment module 16 is used to generate an optimized stage lighting control scheme according to the optimized illumination trajectory and perform lighting control adjustment.

[0031] Specifically, after obtaining the optimized illumination trajectory, an optimized stage lighting control plan is generated based on this trajectory. This plan will contain detailed parameters of the light, such as position, angle, brightness, color, etc., to ensure that the light can move and illuminate accurately according to the optimized trajectory. Convert the optimized illumination trajectory into specific lighting control instructions. These instructions will be sent to the lighting equipment to guide them to adjust according to the new plan. Make lighting control adjustments. This includes adjusting the position, angle and brightness of the light, as well as possible color changes, to match the optimized illumination trajectory.

[0032] Furthermore, the system further comprises:

[0033] An image set acquisition module is used to acquire a sample stage image set based on stage lighting control historical data;

[0034] A target set acquisition module is used to identify and mark the positions of the irradiation area and the irradiation target in the sample stage image, and acquire a sample irradiation area set and a sample irradiation target set;

[0035] An image recognition module is used to construct a stage image recognizer using the sample stage image set, the sample irradiation area set and the sample irradiation target set, recognize the stage image, and obtain the irradiation area and the irradiation target;

[0036] The deviation acquisition module is used to calculate and obtain the irradiation deviation information according to the central position of the irradiation area and the irradiation target position information.

[0037] Specifically, a large amount of historical data on stage lighting control is collected. These data may include records of stage lighting control at different times and in different scenes, as well as the corresponding stage images. Representative stage images are selected from the historical data to form a sample stage image set. These images should cover various possible stage layouts, lighting effects, and illumination targets. For each image in the sample stage image set, the location of the illumination area and the illumination target needs to be identified and marked. This can be done by manual marking, such as using image annotation tools or automatic recognition algorithms, such as target detection algorithms based on deep learning. Image editing software or specialized annotation tools can be used to draw bounding boxes or outlines of the illumination area and the illumination target on the image. Train a target detection model to automatically identify the illumination area and the illumination target in the image. Use a large amount of labeled data to train the model. Obtain a sample illumination area set and a sample illumination target set. Use the sample stage image set, the sample illumination area set, and the sample illumination target set to train a stage image recognizer. This recognizer can be a deep learning model, such as a convolutional neural network, which can automatically identify the illumination area and the illumination target from the input stage image. Use the labeled sample stage image set as training data. Select a suitable deep learning framework, build and train the model. Use the validation set to evaluate the model and tune it based on the evaluation results. After training, the stage image recognizer can be used to identify the irradiation area and irradiation target in the new stage image. Based on the identified irradiation area center position and irradiation target position information, calculate the deviation between them. This deviation can be a vector representing the distance and direction from the irradiation area center to the irradiation target.

[0038] Furthermore, the system further comprises:

[0039] The sample deviation set acquisition module is used to obtain the sample illumination deviation information set according to the stage lighting control historical data, and obtain the illumination compensation range space and the monitoring sensitivity space;

[0040] A mapping relationship building module, used to build a mapping relationship between the illumination deviation information and the illumination compensation range and the monitoring sensitivity according to the sample illumination deviation information set, the illumination compensation range space and the monitoring sensitivity space, wherein the monitoring sensitivity includes the frame rate of monitoring and collecting the stage image;

[0041] A threshold judgment module, used to judge whether the illumination deviation information is greater than an illumination deviation threshold, and if not, no lighting control adjustment is performed;

[0042] The compensation range acquisition module obtains the illumination compensation range and monitoring sensitivity by indexing the illumination deviation information in the mapping relationship.

[0043] Specifically, a sample illumination deviation information set is extracted from the stage lighting control historical data. This information may include the deviation between the actual lighting position and the expected position recorded at different times, different lighting settings and stage layouts. At the same time, the illumination compensation range space and the monitoring sensitivity space are sorted out from the historical data. The illumination compensation range space refers to the range of lighting parameters that can be adjusted when deviations occur, such as position, angle or brightness. The monitoring sensitivity space defines the system's sensitivity to changes in stage images, including parameters such as the frame rate of monitoring and collecting stage images. A mapping relationship is constructed using the sample illumination deviation information set, the illumination compensation range space and the monitoring sensitivity space. This mapping relationship links specific illumination deviation information with the corresponding illumination compensation range and monitoring sensitivity. For example, when the illumination deviation is large, a larger compensation range and higher monitoring sensitivity may be required. The stage image is monitored in real time and the illumination deviation information is calculated. Next, it is determined whether this deviation information exceeds a preset illumination deviation threshold. If the illumination deviation information does not exceed the illumination deviation threshold, it means that the current lighting control effect is within an acceptable range, so no lighting control adjustment is performed. If the illumination deviation information exceeds the illumination deviation threshold, the deviation information is indexed in the previously constructed mapping relationship to obtain the corresponding illumination compensation range and monitoring sensitivity. According to the obtained illumination compensation range and monitoring sensitivity, the stage lighting is adjusted accordingly to ensure that the lighting can accurately illuminate the predetermined target and improve the effect of the stage performance.

[0044] Furthermore, the system further comprises:

[0045] An image sequence acquisition module, used to continuously monitor and collect stage images according to the monitoring sensitivity to obtain a stage image sequence;

[0046] A prediction trend information acquisition module, used for performing movement trend prediction on the stage image sequence based on a slowfast network to obtain the predicted movement trend information of the irradiation target, wherein the predicted movement trend information includes a predicted movement trajectory;

[0047] According to the preset irradiation trajectory and the predicted movement trend information, the predicted irradiation trajectory deviation is obtained by processing.

[0048] Specifically, according to the determined monitoring sensitivity, the stage images are continuously monitored and collected to obtain a continuous sequence of stage images. This sequence captures the real-time dynamics of the irradiation targets on the stage, such as actors, props, etc. The SlowFast network is a deep learning model for video understanding that can process both fast and slow changing information. The trained SlowFast network model can be used to process the stage image sequence to predict the movement trend of the irradiation target. The stage image sequence is input into the SlowFast network as input data. The SlowFast network processes the fast and slow changing features separately to capture the detailed dynamics of the irradiation target. Based on the features extracted by the network, the model predicts the future movement trend of the irradiation target, including its predicted movement trajectory. Once the predicted movement trend information of the irradiation target, including the predicted movement trajectory, is obtained through the SlowFast network, the predicted trajectory can be compared with the preset irradiation trajectory. The predicted movement trajectory is aligned and compared with the preset irradiation trajectory. By calculating the difference between the predicted trajectory and the preset trajectory, the predicted irradiation trajectory deviation can be obtained. This deviation includes position deviation, speed deviation or direction deviation, etc.

[0049] Further, if Figure 2 As shown, the system also includes:

[0050] A first stage image set acquisition module 21 is used to extract stage images from the stage image sequence according to a first extraction frequency, and perform downsampling processing to obtain a first stage image set;

[0051] A second stage image set acquisition module 22, configured to extract stage images from the stage image sequence according to a second extraction frequency to obtain a second stage image set, wherein the first extraction frequency is greater than the second extraction frequency;

[0052] A movement trend information set acquisition module 23 is used to acquire a sample first stage image set and a sample second stage image set based on the stage lighting control historical data, and acquire a sample movement trend information set;

[0053] A predictor construction module 24 is used to construct a movement trend predictor based on a slowfast network, and train the sample first stage image set, the sample second stage image set and the sample movement trend information set until convergence;

[0054] The image prediction module 25 is used to predict the first stage image set and the second stage image set based on the movement trend predictor to obtain the predicted movement trend information of the irradiation target.

[0055] Specifically, stage images are extracted from a stage image sequence at a higher first extraction frequency. The extracted images are downsampled to reduce the dimension and complexity of the data while retaining key information, thereby obtaining a first stage image set. Another set of stage images is extracted from the same stage image sequence at a lower second extraction frequency, lower than the first extraction frequency. These images constitute a second stage image set, which will be used to capture slower changes on the stage. Based on the historical data of stage lighting control, a sample first stage image set and a sample second stage image set corresponding to the above process are obtained. At the same time, a sample movement trend information set corresponding to these image sets is extracted from these historical data. Using the SlowFast network framework, a movement trend predictor capable of processing dual frame rate input is constructed. The SlowFast network can simultaneously process fast changes, information from the first stage image set and slow changes, information from the second stage image set. The movement trend predictor is trained using the sample first stage image set, the sample second stage image set, and the sample movement trend information set. Through back propagation and optimization algorithms, the network parameters are adjusted to minimize the prediction error until the model converges. The first stage image set and the second stage image set are used as input data, corresponding to the fast and slow paths in the SlowFast network respectively. The first stage image set and the second stage image set are processed by the trained movement trend predictor. The predictor will output the predicted movement trend information of the irradiated target, including the predicted movement trajectory, speed and other related dynamic characteristics.

[0056] Furthermore, the system further comprises:

[0057] An optimization compensation set acquisition module is used to acquire a sample irradiation deviation information set and acquire a sample optimization step length set for adjusting the irradiation trajectory;

[0058] An optimization compensation decision maker building module is used to adopt the sample illumination deviation information set and the sample optimization step length set to build an optimization step length decision maker, make a decision on the illumination deviation information, and obtain the optimization step length;

[0059] The trajectory compensation module is used to compensate the preset irradiation trajectory by using the irradiation compensation range to obtain the compensated irradiation trajectory range.

[0060] Specifically, samples of illumination deviation information are collected from historical data of stage lighting control. These data may include deviations between actual light positions and target positions recorded under different scenes and lighting settings. At the same time, samples of optimization step lengths used when adjusting the illumination trajectory are obtained from historical data. A decision maker is trained using a set of sample illumination deviation information and a set of sample optimization step lengths. For example, a machine learning algorithm such as linear regression, decision tree or neural network can be used to construct the decision maker. The goal of the decision maker is to output a corresponding optimization step length when an illumination deviation information is input. This optimization step length will be used to adjust the illumination trajectory of the light to correct the deviation. When the illumination deviation information is monitored in real time, this information is input into the trained optimization step length decision maker. The decision maker will output an optimization step length based on the input illumination deviation information. The optimization step length output by the decision maker is used in combination with the preset illumination trajectory to perform trajectory compensation calculation. According to the illumination compensation range and the optimization step length, the parameters such as the position, angle or speed of the preset illumination trajectory are adjusted to obtain the compensated illumination trajectory range.

[0061] Furthermore, the system further comprises:

[0062] Function construction module, used to construct the lighting control optimization function for optimizing the illumination trajectory deviation, as shown below:

[0063]

[0064] Among them, SL is the light adaptation, K y To predict the irradiation trajectory deviation, K r The deviation of the optimized irradiation trajectory and the predicted movement trend information;

[0065] A first adjusted irradiation trajectory acquisition module is used to adjust the preset irradiation trajectory within the compensation irradiation trajectory according to the optimization step length to obtain a first adjusted irradiation trajectory, combine the predicted movement trend information, process to obtain a first irradiation trajectory deviation, collect the predicted irradiation trajectory deviation, and calculate to obtain a first light adaptability according to the light control optimization function;

[0066] A second adjusted illumination trajectory acquisition module, configured to adjust the first adjusted illumination trajectory within the compensation illumination trajectory according to the optimization step length, obtain a second adjusted illumination trajectory, and calculate and obtain a second light adaptability;

[0067] a light adaptability judgment module, used to judge whether the second light adaptability is greater than the first light adaptability, and if so, continue to optimize based on the second adjusted illumination trajectory;

[0068] The trajectory continuous optimization module calculates the deviation ratio between the second light fitness and the first light fitness, generates an update probability, and continues to optimize based on the second adjusted irradiation trajectory or the first adjusted irradiation trajectory according to the update probability;

[0069] The irradiation trajectory adjustment output module is used to continue the optimization until convergence, output the final adjusted irradiation trajectory, and obtain the optimized irradiation trajectory.

[0070] Specifically, a lighting control optimization function is constructed to optimize the illumination trajectory deviation, such as Among them, SL is the light adaptation, K y To predict the irradiation trajectory deviation, K r is the deviation between the optimized irradiation trajectory and the predicted movement trend information; according to the optimization step length, the preset irradiation trajectory is adjusted within the compensation irradiation trajectory range to obtain the first adjusted irradiation trajectory. Combined with the predicted movement trend information, the first irradiation trajectory deviation is obtained by processing. Combined with the predicted irradiation trajectory deviation, the first light fitness is calculated according to the light control optimization function. According to the same optimization step length, further adjustments are made on the basis of the first adjusted irradiation trajectory to obtain the second adjusted irradiation trajectory. The second irradiation trajectory deviation is calculated and the second light fitness is obtained. Determine whether the second light fitness is greater than the first light fitness). If so, continue to optimize based on the second adjusted irradiation trajectory. If not, calculate the deviation ratio of the second light fitness to the first light fitness, and generate an update probability. This update probability can be calculated based on the deviation ratio and other factors, such as randomness, historical data, etc. According to the update probability, it is decided whether to continue to optimize based on the second adjusted irradiation trajectory or the first adjusted irradiation trajectory. Repeat the above iterative optimization process until the light fitness converges or reaches the preset number of iterations. Output the final adjusted irradiation trajectory, that is, the optimized irradiation trajectory.

[0071] Embodiment 2

[0072] The present application also provides a network device, the network device comprising the visual stage lighting monitoring and adjustment system described in the above-mentioned embodiment 1;

[0073] The network device also includes a dimming cabinet, a power distribution cabinet, a decoder, a field light control system and RDM lamps to perform other lighting adjustment operations. In addition to executing the contents of the first embodiment through the visual stage lighting monitoring and adjustment system, the network device also includes the following structures and functions.

[0074] Specifically, the network equipment supports Chinese and English display, which can be switched at will; the cabinet body is a touch color LCD display to monitor the parameters of the dimming cabinet, and the LCD display of each drawer unit displays the working status; the touch color LCD display with intelligent display and touch control monitors the operating status of the cabinet in real time, and controls and sets the on-site DMX address and dimming curve at the same time; each drawer has its own LCD display to display parameters such as loop address, load phase, dimming brightness, working mode, switch status, etc.; independent LED working status indication, dimming / through manual switching and the highest priority emergency switch mode; the operating status of the cabinet can be remotely monitored, including cabinet initialization, restoration of factory defaults, working mode, short-circuit protection times, dimming settings, network protocol, preheating value and other main parameters; supports APP application mode on Android and iOS platforms; supports four input control methods: dual-channel DMX-512, RDM, RJ45, and optical fiber, and supports sACN and ART-net for the entire network Standard network protocol, standard DMX-512, two-way RDM protocol, with WIFI wireless remote control dimming function; pre-stored 15 dimming curves and ≥999 custom dimming curve settings; with debugging and finding lights, emergency dimming, "field" editing, backup scene recording, editing, and playback functions, the number of scenes is ≥99; high dimming accuracy is 4096 levels; when all control signals are suddenly interrupted, the system automatically keeps the last scene; with 4 function options: low speed, medium speed, high speed and intelligent; when intelligent is selected, it automatically switches to stop, low speed, medium speed, and high speed mode according to the internal working temperature of the cabinet; with optional equipment startup load automatic test function, which can accurately test the load status such as: open circuit, short circuit, three-phase balance, etc.; the dimming cabinet has 12 circuits and 24 circuits; high-intensity thyristor, direct short circuit times greater than 100 times, and has a preheating value setting function; at the same time, each circuit has a high-performance independent RCD protection device; supports three thyristors and relay outputs. The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

[0075] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application belong to the scope of the present application and its equivalent technology, the present application is also intended to include these modifications and variations.

Claims

1. Visual stage lighting monitoring and adjustment system, It is characterized in that The system comprises: A lighting control module, the lighting control module is used to control the stage lighting according to a preset stage lighting control scheme, and continuously monitor and collect stage images, wherein the preset stage lighting control scheme includes a preset illumination trajectory, and the stage image includes an image of an illumination target and an illumination area, and the illumination target is a target illuminated in the preset stage lighting control scheme; A deviation information acquisition module, the deviation information acquisition module is used to identify the illumination deviation based on the stage image and obtain the illumination deviation information; A sensitivity analysis module, wherein the sensitivity analysis module is used to perform an irradiation compensation range analysis and a monitoring sensitivity analysis based on the irradiation deviation information when the irradiation deviation information is greater than an irradiation deviation threshold, so as to obtain an irradiation compensation range and a monitoring sensitivity; A trajectory deviation acquisition module, wherein the trajectory deviation acquisition module is used to continuously monitor and collect stage images according to the monitoring sensitivity, obtain a stage image sequence, predict the movement trend of the irradiated target, obtain predicted movement trend information, and analyze and obtain the predicted irradiation trajectory deviation in combination with a preset irradiation trajectory; An optimized illumination trajectory acquisition module, the optimized illumination trajectory acquisition module is used to set an optimization step size according to the illumination deviation information, compensate the stage lighting control scheme according to the illumination compensation range, obtain a compensated illumination trajectory range, optimize within the compensated illumination trajectory range according to the predicted illumination trajectory deviation, and obtain an optimized illumination trajectory; A lighting control adjustment module, the lighting control adjustment module is used to generate an optimized stage lighting control scheme according to the optimized illumination trajectory and perform lighting control adjustment; Among them, the sensitivity analysis module includes: The sample deviation set acquisition module is used to obtain the sample illumination deviation information set according to the stage lighting control historical data, and obtain the illumination compensation range space and the monitoring sensitivity space; A mapping relationship building module, used to build a mapping relationship between the illumination deviation information and the illumination compensation range and the monitoring sensitivity according to the sample illumination deviation information set, the illumination compensation range space and the monitoring sensitivity space, wherein the monitoring sensitivity includes the frame rate of monitoring and collecting the stage image; A threshold judgment module, used to judge whether the illumination deviation information is greater than an illumination deviation threshold, and if not, no lighting control adjustment is performed; The compensation range acquisition module is used to obtain the illumination compensation range and monitoring sensitivity by indexing the illumination deviation information in the mapping relationship when the illumination deviation information is greater than an illumination deviation threshold.

2. The system according to claim 1, It is characterized in that The deviation information acquisition module includes: An image set acquisition module is used to acquire a sample stage image set based on stage lighting control historical data; A target set acquisition module is used to identify and mark the positions of the irradiation area and the irradiation target in the sample stage image, and acquire a sample irradiation area set and a sample irradiation target set; An image recognition module is used to construct a stage image recognizer using the sample stage image set, the sample irradiation area set and the sample irradiation target set, recognize the stage image, and obtain the irradiation area and the irradiation target; The deviation acquisition module is used to calculate and obtain the irradiation deviation information according to the central position of the irradiation area and the irradiation target position information.

3. The system according to claim 1, It is characterized in that The trajectory deviation acquisition module includes: An image sequence acquisition module, used to continuously monitor and collect stage images according to the monitoring sensitivity to obtain a stage image sequence; A prediction trend information acquisition module, used for performing movement trend prediction on the stage image sequence based on a slowfast network to obtain the predicted movement trend information of the irradiation target, wherein the predicted movement trend information includes a predicted movement trajectory; According to the preset irradiation trajectory and the predicted movement trend information, the predicted irradiation trajectory deviation is obtained by processing.

4. The system according to claim 3, It is characterized in that The forecast trend information acquisition module includes: A first stage image set acquisition module, used to extract stage images from the stage image sequence according to a first extraction frequency, and perform downsampling processing to obtain a first stage image set; A second stage image set acquisition module, used for extracting stage images from the stage image sequence according to a second extraction frequency to obtain a second stage image set, wherein the first extraction frequency is greater than the second extraction frequency; A movement trend information set acquisition module, used to acquire a sample first stage image set and a sample second stage image set based on stage lighting control historical data, and acquire a sample movement trend information set; A predictor construction module, for constructing a moving trend predictor based on a slowfast network, and training the sample first stage image set, the sample second stage image set and the sample moving trend information set until convergence; An image prediction module is used to predict the first stage image set and the second stage image set based on the movement trend predictor to obtain predicted movement trend information of the irradiation target.

5. The system according to claim 1, It is characterized in that The optimized irradiation trajectory acquisition module includes: An optimization compensation set acquisition module is used to acquire a sample irradiation deviation information set and acquire a sample optimization step length set for adjusting the irradiation trajectory; An optimization compensation decision maker building module is used to adopt the sample illumination deviation information set and the sample optimization step length set to build an optimization step length decision maker, make a decision on the illumination deviation information, and obtain the optimization step length; The trajectory compensation module is used to compensate the preset irradiation trajectory by using the irradiation compensation range to obtain the compensated irradiation trajectory range.

6. The system according to claim 1, It is characterized in that The optimized irradiation trajectory acquisition module includes: Function construction module, used to construct the lighting control optimization function for optimizing the illumination trajectory deviation, as shown below: Among them, SL is the light adaptation, K y To predict the irradiation trajectory deviation, K r The deviation of the optimized irradiation trajectory and the predicted movement trend information; A first adjusted irradiation trajectory acquisition module is used to adjust the preset irradiation trajectory within the compensation irradiation trajectory according to the optimization step length to obtain a first adjusted irradiation trajectory, combine the predicted movement trend information, process to obtain a first irradiation trajectory deviation, collect the predicted irradiation trajectory deviation, and calculate to obtain a first light adaptability according to the light control optimization function; A second adjusted illumination trajectory acquisition module, configured to adjust the first adjusted illumination trajectory within the compensation illumination trajectory according to the optimization step length, obtain a second adjusted illumination trajectory, and calculate and obtain a second light adaptability; a light adaptability judgment module, used to judge whether the second light adaptability is greater than the first light adaptability, and if so, continue to optimize based on the second adjusted illumination trajectory; a trajectory continuous optimization module, configured to calculate a deviation ratio between the second light fitness and the first light fitness when the second light fitness is not greater than the first light fitness, generate an update probability, and continue to optimize based on the second adjusted irradiation trajectory or the first adjusted irradiation trajectory according to the update probability; The irradiation trajectory adjustment output module is used to continue the optimization until convergence, output the final adjusted irradiation trajectory, and obtain the optimized irradiation trajectory.

7. Network equipment, It is characterized in that The network device includes the visualized stage lighting monitoring and adjustment system as described in any one of claims 1 to 6, and includes a dimming cabinet, a power distribution cabinet, a decoder, a field light control system and RDM lamps.

Images