Fault lamp tube positioning method, light effect control method and light control system

Through camera analysis and triangular positioning technology, faulty light tubes are automatically identified and positioned, which solves the problem of low fault positioning and maintenance efficiency of lighting equipment in entertainment venues, achieves stability and consistency of lighting effects, and improves user experience.

CN118973055APending Publication Date: 2024-11-15GUANGZHOU AIMYUNION NETWORK TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410966806.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-18
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

In private entertainment venues, the location and maintenance efficiency of lighting equipment failures is low, resulting in unstable lighting effects and affecting the user experience.

Method used

At least two cameras are used to capture the image of the lighting equipment, identify the location of the fault light tube through fault analysis, solve the camera parameters and perform triangular positioning, and realize automatic fault positioning and lighting effect adjustment.

Benefits of technology

Quickly find and repair faulty light tubes, reduce manual maintenance needs, improve maintenance efficiency, ensure the stability and consistency of lighting effects, and improve user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118973055A_ABST
    Figure CN118973055A_ABST
Patent Text Reader

Abstract

The invention relates to a fault lamp tube positioning method, a light effect control method and a light control system, and the method comprises the steps: employing at least two cameras to shoot light equipment images containing light equipment when the light equipment is in a light-on state; performing fault analysis on the at least two paths of light equipment images to identify a faulted lamp tube and position information of the faulted lamp tube in the light equipment images; solving camera parameters of the camera according to coordinate data of a preset calibration point image in the lighting equipment image; performing triangulation positioning according to the position information of the faulty lamp tube identified by the two lighting equipment images and the corresponding camera parameters to obtain the actual position of the faulty lamp tube; according to the technical scheme, the faulty lamp tube can be quickly found out by detecting the state of the lamp tube, and important technical support is provided for automatic positioning and fault removal of the faulty lamp tube, so that the fault can be quickly removed. Therefore, the requirement for frequent manual maintenance can be reduced, and the maintenance cost is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of lighting equipment, and in particular to a method for locating a faulty lamp tube, a method for controlling lighting effects, and a lighting control system. Background Art

[0002] With the continuous growth of the economy and the diversification of consumer demand, the entertainment industry has ushered in an unprecedented prosperity. In particular, private entertainment venues such as audio-visual rooms, mini KTVs, and mini theaters have been warmly welcomed by the majority of users because they provide a private and comfortable environment where people can freely express themselves and enjoy music and movies.

[0003] In these entertainment venues, in addition to sound effects, lighting effects are another key factor in creating atmosphere and enhancing user experience. Through carefully designed lighting effects, not only can a romantic, tranquil, exciting or other emotional atmosphere be created for users, but it can also be synchronized with the rhythm of music to bring users an immersive experience.

[0004] However, these private entertainment venues are compact and relatively closed. To achieve high-quality lighting effects, the on-site lighting layout is usually complicated, with a large number of lighting equipment. Usually, a large number of lighting units such as lamps or LED lamps need to be installed in a very small space. These lighting equipment are distributed in multiple locations and are very complex. Under long-term, high-intensity use, it is easy to have problems such as lamp damage, brightness reduction or uneven color. When a failure occurs, a lot of manpower and material resources are required to find the faulty lamp, and then arrange staff to repair it, which will not only affect the overall lighting effect, but also reduce the user experience. On-site maintenance and debugging work will become very difficult and time-consuming.

[0005] Based on this, how to quickly locate and maintain faulty lamps, improve the maintenance efficiency of lighting equipment, and ensure that it continuously and stably provides high-quality lighting effects has become an issue that the industry urgently needs to solve. Summary of the invention

[0006] In order to solve one of the above-mentioned defects, the present application provides a method for locating a faulty lamp tube, a lighting effect control method and a lighting control system to improve the maintenance efficiency of the faulty lamp tube and ensure the lighting effect of the lighting equipment.

[0007] A method for locating a faulty lamp tube, comprising:

[0008] When the lighting device is in a lighting state, using at least two cameras to respectively capture lighting device images including the lighting device;

[0009] Performing fault analysis on at least two of the lighting equipment images to identify faulty lamps and their location information in the lighting equipment images;

[0010] Determining the camera parameters of the camera according to the coordinate data of the preset calibration point image in the lighting equipment image;

[0011] The actual position of the faulty lamp is obtained by performing triangulation based on the position information of the faulty lamp identified by the two lighting equipment images and the corresponding camera parameters.

[0012] In one embodiment, solving the camera parameters of the camera according to the coordinate data of the preset calibration point image in the lighting equipment image includes:

[0013] Selecting several position points at the lighting equipment site as calibration points, and determining coordinate parameters of the calibration points in the lighting equipment site coordinate system;

[0014] Determine the two-dimensional coordinates of each calibration point in the lighting device image;

[0015] For each calibration point, establish a set of equations for camera parameters according to its two-dimensional coordinates;

[0016] The camera parameters are obtained by solving the equations established using all the calibrated points using the least squares method.

[0017] In one embodiment, the equation group of the camera parameters corresponding to each calibration point is:

[0018]

[0019] Among them, f is the focal length of the camera, (u,v) is the principal point of the image, and the camera parameters to be solved are:

[0020]

[0021] Among them, p i =(x i ,y i ) are the two-dimensional coordinates of the calibration points, and M represents the matrix.

[0022] In one embodiment, performing triangulation based on the position information of the faulty lamp tube identified by two lighting device images and the corresponding camera parameters to obtain the actual position of the faulty lamp tube includes:

[0023] Acquire a first position of a faulty lamp tube identified by a lighting device image of a first camera, and acquire a second position of a faulty lamp tube identified by a lighting device image of a second camera;

[0024] Respectively obtain the coordinate positions and observation angles of the first camera and the second camera in the lighting equipment on-site coordinate system;

[0025] The three-dimensional coordinates of the faulty lamp in the lighting equipment on-site coordinate system are calculated based on the first position, the coordinate position and the observation angle of the first camera, the second position, the coordinate position and the observation angle of the second camera and the trigonometric rule.

[0026] In one embodiment, the three-dimensional coordinates of the faulty lamp in the lighting equipment on-site coordinate system are calculated using trigonometric rules, including:

[0027]

[0028] Among them, (x A ,y A ) is the first position, (x B ,y B ) is the second position, (X, Y, Z) is the three-dimensional coordinates of the faulty lamp in the lighting equipment on-site coordinate system;

[0029] d A =f×tan(θ A )

[0030] d B =f×tan(θ B )

[0031]

[0032]

[0033] Among them, d A is the distance between the first camera and the faulty lamp, d B is the distance between the second camera and the faulty lamp, θ A and θ B These are the observation angles of the faulty lamp in the first camera and the second camera respectively.

[0034] In one embodiment, the method for locating a faulty lamp further includes:

[0035] The coordinate error between the predicted 2D coordinates and the actual 2D coordinates of each calibration point is calculated using the solved camera parameters;

[0036] If the coordinate error is within the available range, the calibration is successful; otherwise, reselect the calibration points to solve the camera parameters or adjust the camera position and posture.

[0037] In one embodiment, the coordinate error is:

[0038]

[0039] in, To predict the two-dimensional coordinates, p iis the actual two-dimensional coordinate.

[0040] In one embodiment, a method for performing fault analysis on a lighting device image to identify a faulty lamp tube includes:

[0041] Obtaining standard state parameters of a lamp in the lighting device, wherein the standard state parameters represent the brightness and chromaticity corresponding to the normal operation of the lamp;

[0042] Acquire actual state parameters corresponding to the lamp tube in the lighting device; wherein the actual state parameters are the brightness and chromaticity corresponding to the lamp tube in the lighting device image;

[0043] The faulty lamp tube in the fault state is determined by using the preset state parameter threshold to judge the state parameter deviation value of the lamp tube.

[0044] A lighting effect control method, comprising:

[0045] Identify the actual position of each faulty lamp tube in the lighting equipment based on the faulty lamp tube positioning method;

[0046] According to the lighting equipment image captured by the camera, the lighting effect of the scene within a certain range of the faulty lamp is obtained in real time; the lighting effect includes brightness and chromaticity;

[0047] According to the actual position of the faulty lamp tube, a plurality of lamp tubes around the faulty lamp tube are selected as target lamp tubes;

[0048] The brightness and chromaticity of the target lamp are adjusted, and the adjusted lighting effect is observed in real time according to the lighting equipment image captured by the camera until the adjusted lighting effect reaches a preset consistency range.

[0049] A lighting control system, comprising: at least two cameras and a control device; wherein the control device is connected to each lamp tube of the lighting device;

[0050] The camera is used to capture images of lighting equipment;

[0051] The control device is used to receive the lighting device image, and execute the faulty lamp positioning method to locate the faulty lamp or execute the lighting effect control method to control the lighting effect.

[0052] The technical solution of the above embodiment is to use at least two cameras to respectively take images of the lighting equipment when the lighting equipment is in the lighting state, perform fault analysis on it to identify the faulty lamp tube and its position information in the lighting equipment image, solve the camera parameters of the camera according to the preset calibration points, and perform triangulation according to the position information of the faulty lamp tube and its corresponding camera parameters to obtain the actual position of the faulty lamp tube; this technical solution can quickly find the faulty lamp tube by detecting the state of the lamp tube, and automatically locate the faulty lamp tube, providing important technical support for troubleshooting and facilitating rapid troubleshooting. This can reduce the need for frequent manual maintenance and reduce maintenance costs.

[0053] Furthermore, the real-time brightness and chromaticity characteristics of the lighting equipment image are used to detect and determine the fault status of the lighting equipment, thereby achieving automatic and rapid detection of faulty lamps, reducing the time and labor intensity of manual inspection, and thus improving the maintenance efficiency of the lighting equipment.

[0054] Furthermore, by adjusting the lamps around the faulty lamp, the consistency of lighting effects can be achieved, ensuring the stability and consistency of the lighting effects of the lighting equipment, enhancing the user experience, and through automatic detection and adjustment, it can ensure that the lighting effects on site are always in the best state, providing users with a continuous, stable, high-quality entertainment experience.

[0055] Additional aspects and advantages of the present application will be partially given in the following description, which will become apparent from the following description, or will be understood through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0057] Figure 1 This is a schematic diagram of the hardware environment for fault detection of a lighting device;

[0058] Figure 2 is a flow chart of a method for detecting a fault of a lighting device according to an embodiment;

[0059] Figure 3 is a flow chart of a lighting effect control method according to an embodiment;

[0060] Figure 4 is an electrical structure diagram of a lighting control system of an embodiment;

[0061] Figure 5 It is an example of an algorithm module diagram for controlling the operation of a device. DETAILED DESCRIPTION

[0062] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and cannot be interpreted as limiting the present application.

[0063] Those skilled in the art will appreciate that, unless otherwise stated, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of the present application refers to the presence of the features, integers, steps, operations, but does not exclude the presence or addition of one or more other features, integers, steps, operations.

[0064] refer to Figure 1 As shown, Figure 1 This is a hardware environment diagram of an example of fault detection of lighting equipment. At least one camera is used to capture the lighting equipment image of the lighting effect of the lighting equipment. The control system recognizes and analyzes the lighting equipment image and its lighting parameters to automatically detect the faulty lamp tube, and combines the solved camera parameters to perform triangulation to obtain the actual position of the faulty lamp tube, providing important technical support for troubleshooting, reducing the time and labor intensity of manual inspection, facilitating rapid troubleshooting, and thus improving the maintenance efficiency of the lighting equipment.

[0065] The technical solution of the present application can be applied to various entertainment venues where lighting equipment is installed, such as audio-visual rooms, mini KTVs, mini theaters, etc., to solve the common problem of faulty lamps. The following embodiments will be described using an audio-visual room as an example; Figure 2 As shown, Figure 2 The present invention is a flowchart of a method for detecting a fault of a lighting device according to an embodiment of the present invention, comprising:

[0066] S11, when the lighting device is in a lighting state, using at least two cameras to respectively capture lighting device images including the lighting device.

[0067] In this step, if Figure 1 In the present invention, two cameras X1 and X2 are used to respectively capture the lighting equipment images including all the lighting equipment in the audio-visual room.

[0068] S12, performing fault analysis on at least two lighting equipment images to identify faulty lamps and their position information in the lighting equipment images.

[0069] In this step, the faulty lamp in the audio-visual room and its position information in the lighting equipment image are determined by analyzing the lighting equipment image.

[0070] In one embodiment, the method of performing fault analysis on the lighting equipment image to identify the faulty lamp in step S12 may include the following steps:

[0071] S201, obtaining standard state parameters of a lamp in a lighting device, wherein the standard state parameters represent brightness and chromaticity corresponding to a lamp working normally.

[0072] For example, a standard state S can be set, where S represents the brightness and chromaticity of a normally working lamp. ij =|L ij -L 标准 | represents the brightness error of the lamp, the formula is ΔC ij =|C ij -C 标准 |Indicates the chromaticity error of the lamp.

[0073] S202, obtaining actual state parameters corresponding to the lamp tube in the lighting equipment; wherein the actual state parameters are the brightness and chromaticity corresponding to the lamp tube in the lighting equipment image.

[0074] For example, the lighting equipment image acquired by the camera can generate an actual state parameter R, which represents the brightness and chromaticity of the lamp tube in the lighting equipment image. In the brightness detection, the brightness contribution of each pixel in the lighting equipment image can be obtained, and the formula is as follows:

[0075]

[0076] Taking the weight into account, the brightness calculation formula is as follows:

[0077]

[0078] Where L represents the average brightness of the lighting device image, I ij is the pixel value of the lighting device image at position (x, j), W and H are the width and height of the lighting device image respectively, w ij is the weight at position (x, j).

[0079] In one embodiment, before extracting the brightness feature, the following may also be included:

[0080] a. Perform color space conversion on the lighting equipment image.

[0081] Specifically, the color lighting device image can be converted into a grayscale image or other color space suitable for brightness detection, such as YUV; for example, the lighting image is converted into a grayscale image Igray(x,y), where x and y represent the horizontal and vertical coordinates of the lighting device image, respectively.

[0082] b. Perform local contrast enhancement on the converted lighting equipment image.

[0083] Exemplarily, the CLAHE (Contrast Limited Adaptive Histogram Equalization) algorithm is applied to enhance the local contrast of the image so that the brightness feature is more prominent; the local enhancement process may include the following:

[0084] I enhanced =CLAHE (Igray)

[0085] Where Igray(x,y) is the grayscale image of the lighting equipment image, CLAHE is the application of contrast-limited adaptive histogram equalization algorithm to enhance image contrast, and I enhanced represents the enhanced image, x and y represent the horizontal and vertical coordinates of the image respectively.

[0086] c. Extracting brightness features of the lighting equipment image; specifically, extracting brightness features of the enhanced lighting equipment image, for example, the pixel mean μ can be used as the brightness feature.

[0087] For example, the brightness L of each lamp is ij and chromaticity C ij detection, including statistical features such as mean and standard deviation.

[0088] d. Perform equalization processing on the extracted brightness features.

[0089] Exemplarily, it can be achieved by simple linear stretching, and the equalization process may include the following:

[0090]

[0091] Among them, I equalized (x, y) represents the enhanced image of the equalized lighting device image, and x and y represent the horizontal and vertical coordinates of the image respectively.

[0092] In addition, it is also possible to determine whether further processing or extraction of other information is required according to application requirements; for example, a preset brightness threshold T can be set and pixels whose brightness exceeds the threshold T can be marked as brightness abnormal points.

[0093] The technology of the above-mentioned embodiment can realize accurate extraction of brightness features of lighting equipment images, and can accurately obtain the lighting effect details of the lighting equipment, which can be used to judge abnormal lighting brightness and accurately identify brightness fault states in lighting equipment.

[0094] In one embodiment, for chromaticity detection, a color histogram comparison method may be used to calculate the cross entropy of the normalized histogram to evaluate the chromaticity consistency of the light image.

[0095] First, a normalized histogram of the lighting device image is obtained; for example, the preset standard color histogram is P = {p1, p2, ..., p3}, and the normalized histogram of the actual lighting device image is Q = {q1, q2, ..., q3},

[0096] Then, the cross entropy of the normalized histogram of the lighting equipment image is calculated according to the preset standard color histogram, and the chromaticity detection result is obtained by comparing whether the cross entropy is consistent with the preset threshold; wherein, the cross entropy calculation formula is as follows:

[0097]

[0098] S203, determining a faulty lamp tube in a faulty state by using a preset state parameter threshold to determine a state parameter deviation value of the lamp tube.

[0099] Specifically, the brightness and chromaticity of each lamp are detected, and the corresponding brightness error and chromaticity error are calculated. The brightness error and chromaticity error are determined by using a preset recognition threshold to determine the faulty lamp. The formulas for the brightness error and chromaticity error are as follows:

[0100]

[0101] The method of determining a faulty lamp in a faulty state may include the following:

[0102] ΔC=|C R -C S

[0103] ΔL=|L R -L S

[0104] Among them, L ij Indicates brightness and C ij Indicates chromaticity; ΔL ij =|L ij -L 标准 | represents the brightness error of the lamp, ΔC ij =|C ij -C 标准 | represents the chromaticity error of the lamp, ΔL represents the brightness deviation value, ΔC represents the chromaticity deviation value, L R Indicates the brightness of the standard state parameter, L S Indicates the brightness of the actual state parameter; C R Indicates the chromaticity of the standard state parameter, C S Indicates the chromaticity of the actual status parameter. If ΔL or ΔC exceeds the preset status parameter threshold, it is determined that the lamp status is inconsistent with the setting and the lamp is determined to be in a fault state.

[0105] As in the technical solution of the above-mentioned embodiment, by extracting the brightness and chromaticity characteristic information of the lamp from the image of the lighting equipment, the brightness and chromaticity of the lamp are detected for the fault status, so that the fault status of the lamp of the lighting equipment can be accurately detected, so that the faulty lamp in the audio-visual room can be accurately and automatically identified, reducing the time and labor intensity of manual inspection, thereby improving the maintenance efficiency of the lighting equipment.

[0106] In one embodiment, a pre-trained recognition model may be used to detect faulty lamps in the lighting equipment image. This embodiment also provides a variety of model training methods, which can be used in the detection of the above-mentioned faulty lamps.

[0107] (1) The lighting fault detection model includes a binary classification SVM model of a support vector machine. The SVM model training process includes:

[0108]

[0109] subject.to.y i (w·x i +b)≥1-ζ i ,ζ i ≥0

[0110] Among them, w and b are the parameters of the SVM model, C is the penalty term coefficient, and f(·) represents the SVM classification function.

[0111] (2) The lighting fault detection model includes a CNN classifier using a convolutional neural network, and the training process of the CNN classifier includes:

[0112]

[0113] in, Represents the predicted category probability, N represents the number of training samples, and y represents the output category probability; CNN can learn the feature representation of images and perform accurate classification at the image level, which has higher applicability.

[0114] (3) The lighting fault detection model includes a semantic segmentation network based on deep learning, and the melody process of the semantic segmentation network includes:

[0115]

[0116] Among them, L(·) represents the loss function, Represents the category of each pixel predicted by the semantic segmentation network, y i Represents the true label, and N represents the number of training samples. Through the semantic segmentation network, each pixel in the image can be classified as faulty or normal, thereby achieving pixel-level accuracy detection.

[0117] As in the technical solution of the above embodiment, by using the pre-trained recognition model, when performing fault detection of image blocks or lamp tubes in the lighting equipment image, a suitable algorithm and recognition model can be selected according to the specific situation. Fault detection with different accuracy and efficiency can be achieved, and can be selected and adjusted according to needs, which has higher applicability in actual use.

[0118] S30, solving the camera parameters of the camera according to the coordinate data of the preset calibration point image in the lighting equipment image.

[0119] In this step, each camera is calibrated by the lighting equipment image to obtain the corresponding camera parameters; the position of the faulty lamp in the lighting equipment image of the cameras X1 and X2 is (x 1 ,y 1 ), the position on the image of camera X2 is (x 2 ,y 2 ); The positions and angles of cameras X1 and X2 are known, and the actual position of the faulty lamp can be determined using triangulation.

[0120] In one embodiment, the method for solving the camera parameters of the camera in step S13 includes the following steps:

[0121] S301, selecting a number of position points at the lighting equipment site as calibration points, and determining coordinate parameters of the calibration points in the lighting equipment site coordinate system.

[0122] For example, several vertices inside the audio-visual room can be selected as calibration points. The three-dimensional coordinates of these calibration points are known in the audio-visual room coordinate system and are represented by P i =(X i ,Y i ,Z i ,), where i represents the number of the calibration point.

[0123] S302, determining the two-dimensional coordinates of each calibration point in the lighting equipment image; specifically, obtaining the calibration point image inside the audio-visual room captured by the camera through the lighting equipment image, and determining the two-dimensional coordinates of the calibration point on the calibration point image, expressed as p i =(x i ,y i ).

[0124] S303, for each calibration point, establish an equation group of camera parameters according to its two-dimensional coordinates;

[0125] Exemplarily, the equation group of the camera parameters corresponding to each calibration point is:

[0126]

[0127] Where f is the focal length of the camera and (u,v) is the principal point of the image.

[0128] S304, using the equation set established by all the calibrated points and solving it by the least square method to obtain the camera parameters.

[0129] Exemplarily, the camera parameters to be solved are:

[0130]

[0131] Among them, p i =(x i ,y i ) are the two-dimensional coordinates of the calibration points, and M represents the matrix.

[0132] As in the technical solution of the above-mentioned embodiment, the coordinate data of the preset calibration points are used in combination with the lighting equipment image to finally solve the camera parameters of the camera, providing accurate position point data for triangulation positioning, thereby accurately locating the position of the faulty lamp tube.

[0133] Furthermore, after solving the camera parameters, in order to ensure the accuracy of the camera parameters, the present application also provides an error evaluation technical solution, which may specifically include the following.

[0134] Use the solved camera parameters to calculate the coordinate error between the predicted 2D coordinates and the actual 2D coordinates of each calibration point; if the coordinate error is within the available range, the calibration is successful; otherwise, reselect the calibration point to solve the camera parameters or adjust the camera's position and posture.

[0135] For example, the coordinate error can be expressed as:

[0136]

[0137] in, To predict the two-dimensional coordinates, p i is the actual two-dimensional coordinate.

[0138] As in the technical solution of the above-mentioned embodiment, the accuracy of the camera parameters can be ensured through error evaluation processing, thereby ensuring the accuracy of the triangulation position point data.

[0139] In one embodiment, in order to improve the accuracy of calculating camera parameters, other influencing factors need to be considered, such as the distortion of the image taken by the camera, the shape and size of the faulty lamp, etc. Accordingly, the distortion of the image taken by the camera can be corrected before calculation, and then the calculation can be performed in combination with the shape and size of the faulty lamp.

[0140] For example, in the calibration of triangulation positioning, the size of the audio-visual room and the position of the camera are fixed, and there may be a certain error in the observation angle. The observation angle of the camera can be calibrated according to the vertices of the audio-visual room. The camera can be calibrated using the geometric characteristics of the audio-visual room to determine the camera's internal parameters (such as focal length, principal point, etc.) and external parameters (such as the camera's position and posture).

[0141] As in the technical solution of the above-mentioned embodiment, through the calibration scheme of the observation angles in cameras X1 and X2, the intrinsic and extrinsic parameters of the cameras can be accurately determined, providing a more accurate data basis for triangulation positioning, thereby improving the accuracy of detection and positioning of faulty lamps.

[0142] S14, performing triangulation positioning according to the position information of the faulty lamp tube identified by the two lighting equipment images and the corresponding camera parameters to obtain the actual position of the faulty lamp tube.

[0143] Specifically, the camera parameters obtained are used for triangulation positioning. The position of the damaged lamp on the image taken by camera X1 is (x 1 ,y 1 ), the position on the image captured by camera X2 is (x 2 ,y 2 ), and use the trigonometric law to calculate the actual position (X, Y, Z) of the lamp through the position and angle of the camera.

[0144] In one embodiment, the method of obtaining the actual position of the faulty lamp by triangulation in step S14 may include the following steps:

[0145] S401, obtaining a first position of a faulty lamp recognized by a lighting device image of a first camera, and obtaining a second position of a faulty lamp recognized by a lighting device image of a second camera;

[0146] S402, respectively obtaining coordinate positions and observation angles of the first camera and the second camera in a lighting equipment on-site coordinate system;

[0147] S403, calculating the three-dimensional coordinates of the faulty lamp in the lighting equipment on-site coordinate system according to the first position, the coordinate position and the observation angle of the first camera, the second position, the coordinate position and the observation angle of the second camera and using trigonometric rules.

[0148] Specifically, using trigonometric rules to calculate the three-dimensional coordinates of the faulty lamp in the lighting equipment on-site coordinate system may include:

[0149]

[0150] Among them, (x A ,y A) is the first position, (x B ,y B ) is the second position, (X, Y, Z) is the three-dimensional coordinates of the faulty lamp in the lighting equipment on-site coordinate system;

[0151] d A =f×tan(θ A )

[0152] d B =f×tan(θ B )

[0153]

[0154] Among them, d A is the distance between the first camera and the faulty lamp, d B is the distance between the second camera and the faulty lamp, θ A and θ B These are the observation angles of the faulty lamp in the first camera and the second camera respectively.

[0155] An embodiment of the lighting effect control method is described below.

[0156] The lighting effect control method of the present application is based on locating the actual position of each faulty lamp tube, and further ensures the lighting effect by adjusting the lighting effects of lamp tubes around the faulty lamp tube, thereby improving maintenance efficiency.

[0157] like Figure 3 As shown, Figure 3 The present invention is a flow chart of a lighting effect control method according to an embodiment, comprising:

[0158] S21, identifying the actual position of each faulty lamp in the lighting equipment;

[0159] Specifically, the actual position information of the faulty lamp can be determined based on the technical solution of any of the aforementioned embodiments or other technical solutions.

[0160] S22, obtaining in real time the lighting effect of the scene within a certain range of the faulty lamp according to the lighting equipment image captured by the camera; the lighting effect includes brightness and chromaticity.

[0161] S23, selecting a plurality of surrounding lamps as target lamps according to the actual position of the faulty lamp.

[0162] S24, adjusting the brightness and chromaticity of the target lamp tube, and observing the adjusted lighting effect in real time according to the lighting equipment image captured by the camera, until the adjusted lighting effect reaches a preset consistency range.

[0163] As in the technical solution of the above-mentioned embodiment, when a lamp fails, the brightness and chromaticity of the lamp are automatically adjusted to ensure the stability and consistency of the lighting effect, thereby ensuring that the lighting effect on site is always in the best state, providing users with a continuous, stable, high-quality entertainment experience, and improving the maintenance efficiency of lighting equipment.

[0164] An embodiment of the lighting control system is described below.

[0165] refer to Figure 3 As shown, Figure 3 The electrical structure diagram of a lighting control system of an embodiment includes: at least two cameras and a control device; wherein the control device is connected to each lamp tube of the lighting device;

[0166] The camera is used to capture images of the lighting equipment; the control device is used to receive images of the lighting equipment, and to execute the method for locating a faulty lamp tube of any of the foregoing embodiments to locate the faulty lamp tube, or to execute the lighting effect control method of any of the foregoing embodiments to control the lighting effect.

[0167] Exemplarily, a corresponding algorithm module may be configured in the control device, which executes the relevant functions provided in the embodiments of the present application, thereby providing a more convenient use for the user; Figure 4 As shown, Figure 4 This is an example of an algorithm module diagram for controlling the operation of a device, which mainly includes:

[0168] Camera module: used to control the deployed cameras to capture images of lighting equipment and capture details of lighting effects.

[0169] Image processing and analysis module: used to analyze and process the lighting equipment images taken by the camera, analyze the lighting effects of the lighting equipment images, etc.

[0170] Algorithm execution module: used to execute the algorithm for fault detection of faulty areas and faulty lamps and the adjustment of the lighting effects of the lamps.

[0171] Lighting control module: used to control lighting effect parameters such as brightness and chromaticity of each lamp.

[0172] User interface module: provides a friendly operation interface, displays the results of various fault detections and related information for adjusting the lighting effects of the lamps, etc.

[0173] The technical solution of the above-mentioned embodiment automatically detects faults by utilizing the image of the lighting equipment captured by the camera, quickly detects the fault status of the lighting equipment, reduces the time and labor intensity of manual inspection, and thus improves the maintenance efficiency of the lighting equipment; by dividing the image of the lighting equipment into multiple image blocks for detection, the fault area can be quickly and accurately located, thereby providing important technical support for quickly determining the fault location and troubleshooting, and further improving the maintenance efficiency of the lighting equipment; by detecting the status of the lamp tube, the faulty lamp tube can be quickly found, and the faulty lamp tube is automatically located, thereby reducing the frequent manual maintenance needs and reducing maintenance costs; by adjusting the lamp tubes around the faulty lamp tube to achieve consistency of lighting effects, ensure the stability and consistency of the lighting effects of the lighting equipment, enhance user experience, and through automatic detection and adjustment, it can ensure that the lighting effects on site are always in the best state, providing users with a continuous, stable and high-quality entertainment experience.

[0174] The technical solution provided by the embodiments of the present application has the following technical effects:

[0175] Improve maintenance efficiency: It can quickly and accurately detect the fault status of lighting equipment with different brightness and chromaticity, locate the faulty area or faulty lamp, greatly reducing the time and labor intensity of manual inspection, thereby improving the overall maintenance efficiency.

[0176] Enhanced user experience: Automatically detect and adjust solutions to ensure that lighting effects are always optimal, providing users with a continuous, stable, high-quality entertainment experience.

[0177] Extend the service life of equipment: Timely fault detection and maintenance of lighting equipment can effectively avoid equipment damage caused by long-term fault operation, thereby extending the service life of the equipment.

[0178] Save maintenance costs: Automatic detection reduces the need for frequent manual maintenance and reduces maintenance costs. At the same time, timely fault detection and processing can also reduce the cost of replacement or repair caused by equipment failure.

[0179] Improve the stability of lighting effects: Through the function of automatically adjusting lighting effects, when a local faulty lamp is detected, the brightness and chromaticity of the surrounding lamps can be automatically adjusted to ensure the stability and consistency of the overall lighting effect.

[0180] Environmental protection and energy saving: Accurate fault detection and automatic adjustment functions can avoid unnecessary energy waste, bring higher energy efficiency to entertainment venues, and also help reduce carbon footprint and achieve more environmentally friendly operations.

[0181] The above description is only a partial implementation method of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A method for locating a faulty lamp, characterized in that: include: When the lighting device is in a lighting state, using at least two cameras to respectively capture lighting device images including the lighting device; Performing fault analysis on at least two of the lighting equipment images to identify faulty lamps and their location information in the lighting equipment images; Determining the camera parameters of the camera according to the coordinate data of the preset calibration point image in the lighting equipment image; The actual position of the faulty lamp is obtained by performing triangulation based on the position information of the faulty lamp identified by the two lighting equipment images and the corresponding camera parameters.

2. The method for locating a faulty lamp according to claim 1, characterized in that: Solving the camera parameters of the camera according to the coordinate data of the preset calibration point image in the lighting equipment image includes: Selecting several position points at the lighting equipment site as calibration points, and determining coordinate parameters of the calibration points in the lighting equipment site coordinate system; Determine the two-dimensional coordinates of each calibration point in the lighting device image; For each calibration point, establish a set of equations for camera parameters according to its two-dimensional coordinates; The camera parameters are obtained by solving the equations established using all the calibrated points using the least squares method.

3. The method for locating a faulty lamp tube according to claim 2, characterized in that: The equation set of camera parameters corresponding to each calibration point is: Among them, f is the focal length of the camera, (u,v) is the principal point of the image, and the camera parameters to be solved are: Among them, p i =(x i ,y i ) are the two-dimensional coordinates of the calibration points, and M represents the matrix.

4. The method for locating a faulty lamp tube according to claim 1, characterized in that: Performing triangulation based on the position information of the faulty lamp tube identified by the two lighting equipment images and the corresponding camera parameters to obtain the actual position of the faulty lamp tube includes: Acquire a first position of a faulty lamp tube identified by a lighting device image of a first camera, and acquire a second position of a faulty lamp tube identified by a lighting device image of a second camera; Respectively obtain the coordinate positions and observation angles of the first camera and the second camera in the lighting equipment on-site coordinate system; The three-dimensional coordinates of the faulty lamp in the lighting equipment on-site coordinate system are calculated based on the first position, the coordinate position and the observation angle of the first camera, the second position, the coordinate position and the observation angle of the second camera and the trigonometric rule.

5. The method for locating a faulty lamp tube according to claim 4, characterized in that: The three-dimensional coordinates of the faulty lamp in the lighting equipment on-site coordinate system are calculated using trigonometric rules, including: Among them, (x A ,y A ) is the first position, (x B ,y B ) is the second position, (X, Y, Z) is the three-dimensional coordinates of the faulty lamp in the lighting equipment on-site coordinate system; d A =f×tan(θ A ) d B =f×tan(θ B ) Among them, d A is the distance between the first camera and the faulty lamp, d B is the distance between the second camera and the faulty lamp, θ A and θ B These are the observation angles of the faulty lamp in the first camera and the second camera respectively.

6. The method for locating a faulty lamp tube according to claim 1, characterized in that: Also includes: The coordinate error between the predicted 2D coordinates and the actual 2D coordinates of each calibration point is calculated using the solved camera parameters; If the coordinate error is within the available range, the calibration is successful; Otherwise, reselect the calibration points to solve the camera parameters or adjust the position and posture of the camera.

7. The method for locating a faulty lamp tube according to claim 2, characterized in that: The coordinate error is: in, To predict the two-dimensional coordinates, p i is the actual two-dimensional coordinate.

8. The method for locating a faulty lamp according to any one of claims 1 to 7, characterized in that: The method for performing fault analysis on a lighting equipment image to identify a faulty lamp tube comprises: Obtaining standard state parameters of a lamp in the lighting device, wherein the standard state parameters represent the brightness and chromaticity corresponding to the normal operation of the lamp; Acquire actual state parameters corresponding to the lamp tube in the lighting device; wherein the actual state parameters are the brightness and chromaticity corresponding to the lamp tube in the lighting device image; The faulty lamp tube in the fault state is determined by using the preset state parameter threshold to judge the state parameter deviation value of the lamp tube.

9. A lighting effect control method, characterized in that: include: Identify the actual position of each faulty lamp tube in the lighting equipment based on the faulty lamp tube positioning method according to any one of claims 1 to 8; According to the lighting equipment image captured by the camera, the lighting effect of the scene within a certain range of the faulty lamp is obtained in real time; the lighting effect includes brightness and chromaticity; According to the actual position of the faulty lamp tube, a plurality of lamp tubes around the faulty lamp tube are selected as target lamp tubes; The brightness and chromaticity of the target lamp are adjusted, and the adjusted lighting effect is observed in real time according to the lighting equipment image captured by the camera until the adjusted lighting effect reaches a preset consistency range.

10. A lighting control system, characterized in that: include: At least two cameras and a control device; wherein the control device is connected to each lamp tube of the lighting device; The camera is used to capture images of lighting equipment; The control device is used to receive a lighting device image, and execute the method for locating a faulty lamp tube according to any one of claims 1 to 8 to locate the faulty lamp tube, or execute the lighting effect control method according to claim 9 to control the lighting effect.