A method and device for controlling lighting equipment

By screening and identifying the image information and generating control signals associated with the lighting equipment, the problem of single control methods of existing lighting equipment is solved, and rich light effect and high immersion display is achieved.

CN115175412BActive Publication Date: 2025-03-25APUTURE IMAGING IND CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210756673.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-30
Publication Date
2025-03-25
Estimated Expiration
2042-06-30

AI Technical Summary

Technical Problem

The existing lighting equipment control method is single, unable to achieve rich lighting effects, and cannot meet the high-demand stage lighting and scene atmosphere needs.

Method used

By screening and image recognition of image information, a control signal associated with the lighting device is generated to achieve a smooth conversion of image visual effects to lighting visual effects.

Benefits of technology

It improves the flexibility and adaptability of lighting equipment control, enhances the richness of light effect adjustment, improves the display immersion, and achieves diversified control and display effects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115175412B_ABST
    Figure CN115175412B_ABST
Patent Text Reader

Abstract

The present invention discloses a control method and device for lighting equipment, the method comprising: obtaining image information from an image source device; filtering out target image information associated with the lighting equipment from the image information, wherein the target image information is used to identify data information for controlling the lighting equipment; performing image recognition on the target image information to obtain a target recognition result; determining a light control signal of the lighting equipment according to the target recognition result and a preset parameter conversion model; and controlling the lighting equipment to perform a light display according to the light control signal. It can be seen that the present invention can generate a control signal associated with the lighting equipment by filtering and identifying the image information, thereby achieving a smooth conversion from image visual effects to light visual effects, effectively improving the flexibility and adaptability of lighting equipment control, improving the richness of the adjustment of the light effect of the lighting equipment, improving the display immersion of the lighting equipment, and achieving diversified control and display effects.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of lighting control, and in particular to a control method and device for lighting equipment. Background Art

[0002] With the rapid development of lighting control technology, people have higher and higher requirements for lighting effects. For example, during stage performances, stage lights are needed to provide good background light or simulate different scene atmospheres.

[0003] In actual applications, existing lighting equipment usually adjusts the brightness and color of lights in a fixed way through preset light effect parameters, or achieves music rhythm effects according to changes in the rhythm and strength of music. However, practice has found that these control methods are single in control mode and cannot achieve richer light effect effects.

[0004] It can be seen that it is particularly important to provide a control method for lighting equipment to improve the adjustment effect of light efficiency. Summary of the invention

[0005] The present invention provides a method and device for controlling lighting equipment, which can generate a control signal associated with the lighting equipment by screening and identifying image information, thereby achieving a smooth conversion of image visual effects to light visual effects, effectively improving the flexibility and adaptability of lighting equipment control, meeting scene requirements, improving the richness of lighting equipment light effect adjustment, improving the display immersion of the lighting equipment, and achieving diversified control and display effects.

[0006] In order to solve the above technical problems, the first aspect of the present invention discloses a control method for a lighting device, the method comprising:

[0007] Acquiring image information from an image source device, wherein the image information includes at least one frame of image;

[0008] Filtering target image information associated with the lighting device from the image information, wherein the target image information is used to identify data information for controlling the lighting device;

[0009] Performing image recognition on the target image information to obtain a target recognition result;

[0010] Determining a light control signal of the lighting device according to the target recognition result and a preset parameter conversion model;

[0011] According to the light control signal, the lighting device is controlled to perform a light display.

[0012] As an optional implementation manner, in the first aspect of the present invention, after filtering out the target image information associated with the lighting device from the image information, and before performing image recognition on the target image information to obtain a target recognition result, the method further includes:

[0013] Performing grayscale processing on the target image information to obtain grayscale image information corresponding to the target image information;

[0014] Performing a first preprocessing operation and a second preprocessing operation on the grayscale image information to obtain preprocessed image information corresponding to the image information, wherein the first preprocessing operation is used to perform a background denoising operation on the image information, and the second preprocessing operation is used to perform a pixel enhancement operation on the image information;

[0015] A color restoration operation is performed on the pre-processed image information, and the image information obtained after the restoration is determined as the target image information.

[0016] As an optional implementation, in the first aspect of the present invention, performing a first preprocessing operation and a second preprocessing operation on the grayscale image information to obtain preprocessed image information corresponding to the image information includes:

[0017] For any matrix element in the grayscale image information, determine the target number of target matrix elements adjacent to the matrix element whose pixel difference value with the matrix element is less than a first preset threshold; determine whether the target number is greater than or equal to a second preset threshold; when the determination result is yes, set the pixel values ​​of all target matrix elements adjacent to the matrix element to the pixel value of the matrix element;

[0018] For any matrix element after the first preprocessing operation, convolve the matrix element with a preset anchor point to calculate the pixel extreme value of the area covered by the preset anchor point; determine the pixel extreme value as the target pixel value of the matrix element;

[0019] The target pixel values ​​corresponding to all the matrix elements are determined as the pre-processed image information corresponding to the image information.

[0020] As an optional implementation manner, in the first aspect of the present invention, the step of filtering out target image information associated with the lighting device from the image information includes:

[0021] Acquire device information of the lighting device;

[0022] Determining the preset parameter type of the lighting device according to the device information;

[0023] Target image information matching the preset parameter type is determined from the image information.

[0024] As an optional implementation manner, in the first aspect of the present invention, determining the target image information matching the preset parameter type from the image information includes:

[0025] When it is determined that the preset parameter type matches the color information, at least one key frame image is selected from the image information according to the color difference between two adjacent frames of image images in the image information, and all the key frame images are determined as target image information; and / or,

[0026] When it is determined that the pre-adjusted parameter type matches the brightness information, the image information is divided into a plurality of image sub-information according to the picture similarity between two adjacent frames of the image in the image information; at least one target image sub-information is selected from all the image sub-information as the target image information; wherein the picture of each of the target image sub-information contains an object whose motion frequency or amplitude exceeds a third preset threshold.

[0027] As an optional implementation manner, in the first aspect of the present invention, performing image recognition on the target image information to obtain a target recognition result includes:

[0028] Based on a predetermined image recognition model, a first feature extraction is performed on any frame of candidate image information in the target image information to obtain a feature map corresponding to the candidate image information; the feature map is used to represent the object category of the target object in the extracted candidate image information;

[0029] Annotate the feature map according to a predetermined annotation frame to obtain an annotation area of ​​the target object;

[0030] Performing a second feature extraction on the marked area to obtain feature information matching the preset parameters of the lighting device;

[0031] All the feature information in the target image information is determined as a target recognition result.

[0032] As an optional implementation, in the first aspect of the present invention, determining the light control signal of the lighting device according to the target recognition result and a preset parameter conversion model includes:

[0033] For any of the feature information in the target recognition result, input the feature information into a preset parameter conversion model to obtain a control parameter corresponding to the feature information;

[0034] Determine, according to the image information, time information of a control parameter corresponding to each of the feature information;

[0035] The control parameters corresponding to all the characteristic information and the time information of the control parameters are determined as the light control signal of the lighting device.

[0036] As an optional embodiment, in the first aspect of the present invention, the method further comprises:

[0037] Determining a parameter display model of the lighting device according to the preset parameter type of the lighting device, wherein the parameter display model includes a two-dimensional model or a three-dimensional model;

[0038] A parameter display diagram corresponding to the lighting device is generated according to the parameter display model of the lighting device and the light control signal of the lighting device.

[0039] A second aspect of the present invention discloses a control device for a lighting device, the device comprising:

[0040] An acquisition module, used to acquire image information from an image source device, wherein the image information includes at least one frame of image;

[0041] A screening module, used to screen out target image information associated with the lighting device from the image information, wherein the target image information is used to identify data information for controlling the lighting device;

[0042] A recognition module, used to perform image recognition on the target image information to obtain a target recognition result;

[0043] A determination module, used to determine a light control signal of the lighting device according to the target recognition result and a preset parameter conversion model;

[0044] The control module is used to control the lighting device to perform a lighting display according to the lighting control signal.

[0045] As an optional implementation, in the second aspect of the present invention, the device further includes:

[0046] A grayscale processing module, used for performing grayscale processing on the target image information to obtain grayscale image information corresponding to the target image information;

[0047] a preprocessing module, configured to perform a first preprocessing operation and a second preprocessing operation on the grayscale image information to obtain preprocessed image information corresponding to the image information, wherein the first preprocessing operation is used to perform a background denoising operation on the image information, and the second preprocessing operation is used to perform a pixel enhancement operation on the image information;

[0048] The restoration module is used to perform a color restoration operation on the pre-processed image information, and determine the image information obtained after restoration as the target image information.

[0049] As an optional implementation, in the second aspect of the present invention, the preprocessing module performs a first preprocessing operation and a second preprocessing operation on the grayscale image information, and obtains the preprocessed image information corresponding to the image information in a specific manner as follows:

[0050] For any matrix element in the grayscale image information, determine the target number of target matrix elements adjacent to the matrix element whose pixel difference value with the matrix element is less than a first preset threshold; determine whether the target number is greater than or equal to a second preset threshold; when the determination result is yes, set the pixel values ​​of all target matrix elements adjacent to the matrix element to the pixel value of the matrix element;

[0051] For any matrix element after the first preprocessing operation, convolve the matrix element with a preset anchor point to calculate the pixel extreme value of the area covered by the preset anchor point; determine the pixel extreme value as the target pixel value of the matrix element;

[0052] The target pixel values ​​corresponding to all the matrix elements are determined as the pre-processed image information corresponding to the image information.

[0053] As an optional implementation, in the second aspect of the present invention, the screening module includes:

[0054] An acquisition submodule, used to acquire device information of the lighting device;

[0055] A first determination submodule, configured to determine a preset parameter type of the lighting device according to the device information;

[0056] The screening submodule is used to determine target image information matching the preset parameter type from the image information.

[0057] As an optional implementation, in the second aspect of the present invention, the specific manner in which the screening submodule determines the target image information matching the preset parameter type from the image information is:

[0058] When it is determined that the preset parameter type matches the color information, at least one key frame image is selected from the image information according to the color difference between two adjacent frames of image images in the image information, and all the key frame images are determined as target image information; and / or,

[0059] When it is determined that the pre-adjusted parameter type matches the brightness information, the image information is divided into a plurality of image sub-information according to the picture similarity between two adjacent frames of the image in the image information; at least one target image sub-information is selected from all the image sub-information as the target image information; wherein the picture of each of the target image sub-information contains an object whose motion frequency or amplitude exceeds a third preset threshold.

[0060] As an optional implementation, in the second aspect of the present invention, the identification module includes:

[0061] A first feature extraction submodule is used to perform a first feature extraction on any frame of candidate image information in the target image information based on a predetermined image recognition model to obtain a feature map corresponding to the candidate image information; the feature map is used to represent the object category of the target object in the extracted candidate image information;

[0062] A labeling submodule, used to label the feature map according to a predetermined labeling frame to obtain a labeling area of ​​the target object;

[0063] A second feature extraction submodule, used to perform second feature extraction on the marked area to obtain feature information matching the preset parameters of the lighting device;

[0064] The second determination submodule is used to determine all the feature information in the target image information as a target recognition result.

[0065] As an optional implementation, in the second aspect of the present invention, the specific manner in which the determination module determines the light control signal of the lighting device according to the target recognition result and the preset parameter conversion model is:

[0066] For any of the feature information in the target recognition result, input the feature information into a preset parameter conversion model to obtain a control parameter corresponding to the feature information;

[0067] Determine, according to the image information, time information of a control parameter corresponding to each of the feature information;

[0068] The control parameters corresponding to all the characteristic information and the time information of the control parameters are determined as the light control signal of the lighting device.

[0069] As an optional implementation, in the second aspect of the present invention, the device further includes:

[0070] A display module is used to determine a parameter display model of the lighting device according to the preset parameter type of the lighting device, wherein the parameter display model includes a two-dimensional model or a three-dimensional model; and generate a parameter display diagram corresponding to the lighting device according to the parameter display model of the lighting device and the light control signal of the lighting device.

[0071] A third aspect of the present invention discloses another control device for lighting equipment, the device comprising:

[0072] A memory storing executable program code;

[0073] a processor coupled to the memory;

[0074] The processor calls the executable program code stored in the memory to execute part or all of the steps in any one of the lighting device control methods disclosed in the first aspect of the present invention.

[0075] A fourth aspect of the present invention discloses a computer storage medium storing computer instructions, which, when called, are used to execute part or all of the steps in any one of the lighting device control methods disclosed in the first aspect of the present invention.

[0076] Compared with the prior art, the present invention has the following beneficial effects:

[0077] The present invention discloses a control method and device for lighting equipment, the method comprising: obtaining image information from an image source device; filtering out target image information associated with the lighting equipment from the image information, wherein the target image information is used to identify data information for controlling the lighting equipment; performing image recognition on the target image information to obtain a target recognition result; determining a light control signal of the lighting equipment according to the target recognition result and a preset parameter conversion model; and controlling the lighting equipment to perform light display according to the light control signal. It can be seen that the present invention can realize a smooth conversion of image visual effects to light visual effects by filtering and image recognizing the image information, generating a control signal associated with the lighting equipment, effectively improving the flexibility and adaptability of lighting equipment control, improving the richness of the adjustment of the light effect of the lighting equipment, improving the display immersion of the lighting equipment, and realizing diversified control and display effects; it can also perform preliminary pixel denoising, pixel enhancement and other operations on the target image information through grayscale processing, preprocessing and color restoration operations, so as to obtain target image information with higher accuracy, and at the same time reduce the calculation amount of subsequent image processing and recognition, which is conducive to improving the speed and efficiency of subsequent image recognition, and further realizing a smooth conversion of image visual effects to light visual effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0078] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0079] Figure 1 It is a flowchart of a method for controlling a lighting device disclosed in an embodiment of the present invention;

[0080] Figure 2 is a flow chart of another method for controlling a lighting device disclosed in an embodiment of the present invention;

[0081] Figure 3 is a schematic diagram of the structure of a control device for lighting equipment disclosed in an embodiment of the present invention;

[0082] Figure 4 is a schematic structural diagram of another lighting device control device disclosed in an embodiment of the present invention;

[0083] Figure 5 It is a structural schematic diagram of another control device for lighting equipment disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0084] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0085] The terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish different objects rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, device, product or end including a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units inherent to these processes, methods, products or ends.

[0086] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present invention. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0087] The present invention discloses a control method and device for lighting equipment, which can generate a control signal associated with the lighting equipment by screening and identifying image information, realize smooth conversion of image visual effects to light visual effects, effectively improve the flexibility and adaptability of lighting equipment control, meet scene requirements, improve the richness of lighting equipment light effect adjustment, improve the display immersion of lighting equipment, and realize diversified control and display effects. The following is a detailed description.

[0088] Embodiment 1

[0089] See also Figure 1 , Figure 1 1 is a flow chart of a method for controlling a lighting device disclosed in an embodiment of the present invention. Figure 1 The described method may be applied to a control device of a lighting device, and the control device of the lighting device may be an independent device or may be integrated in the lighting device, which is not limited in the embodiments of the present invention. Figure 1 As shown, the control method of the lighting device may include the following operations:

[0090] 101. Obtain image information from an image source device.

[0091] In the embodiment of the present invention, the acquired image information may be image information acquired in real time by an image acquisition device, such as a real-time performance scene during a stage performance; or it may be pre-recorded image information, such as a pre-saved dance video, etc., which is not limited in the embodiment of the present invention. It should be noted that the image information should include at least one frame of image.

[0092] 102. Filter out target image information associated with the lighting device from the image information.

[0093] In the embodiment of the present invention, after the image information is acquired, it is necessary to filter out the target image information that can be used to identify and control the data information of the lighting device. For example, if you want to control the lighting device to adjust the light color according to the color of the dancer's costume on the stage in the video, you need to filter out the image frames containing the dancer on the stage in the image information as the target image information associated with the lighting device.

[0094] 103. Perform image recognition on the target image information to obtain a target recognition result.

[0095] In the embodiment of the present invention, the target image information includes a number of identification objects and a number of pixel points. In order to achieve that the effect of the lighting equipment displaying the light effect is visually consistent with the visual effect of the image information of the image source, the embodiment of the present invention can perform image recognition on the target image information by means of visual recognition to obtain a target recognition result corresponding to the target image information. It should be noted that the image recognition in the embodiment of the present invention is divided into two dimensions: low-dimensional recognition and high-dimensional recognition, wherein the object information in the target image information is recognized from a low dimension, such as object category, object location information, etc.; the detail information of the target object is recognized from a high dimension, such as pixel color, target object contour edge details, etc.

[0096] 104. Determine a lighting control signal of the lighting device according to the target recognition result and a preset parameter conversion model.

[0097] In the embodiment of the present invention, the preset parameter conversion model may include multiple types of models, not limited to only one type. The most matching parameter conversion model can be selected according to the target recognition result, and the above target recognition result can be converted into a light control signal of the lighting device. For example, the dance stick held by the dancer on the stage rotates from 0° to 120°, and the lighting device needs to be controlled to rotate from 0° to 120 degrees. At this time, according to the preset angle conversion model (for example, the angle 0°-180° corresponds to the DMX data 0-255), it can be converted into a DMX value 0-170 that complies with the DMX512 transmission protocol, and transmitted to the lighting device to complete the corresponding angle rotation.

[0098] 105. According to the light control signal, control the lighting equipment to perform light display.

[0099] It should be noted that, optionally, the communication method for outputting light control information to the lighting device can be one or more of Bluetooth communication method, WIFI communication method, NFC communication method, ZigBee communication method, and wired communication method, which is not limited in the embodiments of the present invention.

[0100] It can be seen that the method described in the embodiment of the present invention can generate a control signal associated with the lighting device by screening and identifying image information, thereby realizing a smooth conversion of image visual effects to light visual effects, effectively improving the flexibility and adaptability of lighting device control, being close to scene requirements, improving the richness of adjustment of the lighting effect of the lighting device, improving the display immersion of the lighting device, and realizing diversified control and display effects.

[0101] In an optional embodiment, filtering out target image information associated with the lighting device from the image information may include the following operations:

[0102] Get the equipment information of lighting equipment;

[0103] Determine the preset parameter type of the lighting equipment according to the equipment information;

[0104] Target image information matching the preset parameter type is determined from the image information.

[0105] In an embodiment of the present invention, a communication link with the lighting device is established according to a preset communication protocol to obtain device information of the lighting device, wherein the device information includes device identification ID, device type, device quantity information, device location information, device layout information, etc., which is not limited in the embodiment of the present invention. Furthermore, by determining information such as the type of preset parameters of the lighting device and the adjustable range of the device preset parameters according to a mapping relationship between the device information and the preset parameter mapping table, the target image information matching the preset parameter type can be determined from the image information. It should be noted that the preset parameter type includes color type, angle type, brightness type, frequency type, etc., which is not limited in the embodiment of the present invention. For example, when the preset parameter type is a color type, target image information with a high correlation with color is collected, and when the preset parameter type is an angle type, target image information with a high correlation with angle is collected.

[0106] It can be seen that the method described in the embodiment of the present invention can establish communication with the lighting device to accurately determine the preset parameter type of the device and the target image information that matches the preset parameter type of the device in an interactive manner, and can adaptively adjust the target image information according to the preset parameter type, thereby improving the flexibility and adaptability of the scheme, accurately acquiring target images with a high degree of matching, and is beneficial to improving the response speed and control efficiency of the lighting device.

[0107] In this optional embodiment, further, determining the target image information matching the preset parameter type from the image information may include the following operations:

[0108] When it is determined that the preset parameter type matches the color information, at least one key frame image is selected from the image information according to the color difference between two adjacent frames of image images in the image information, and all the key frame images are determined as target image information; and / or,

[0109] When it is determined that the preset parameter type matches the brightness information, the image information is divided into a plurality of image sub-information according to the picture similarity between two adjacent frames of image images in the image information; at least one target image sub-information is selected from all the image sub-information as the target image information; wherein the picture of each target image sub-information contains an object whose motion frequency or amplitude exceeds a third preset threshold.

[0110] In an embodiment of the present invention, when it is determined that the preset parameter type matches the color information, for any frame of image in the image information and an adjacent frame of image, the distribution data and color proportion data of each color of each frame of image are statistically analyzed, and then the color difference between any frame of image and an adjacent frame of image is calculated based on the color distribution data and the color proportion data. When the difference is less than a preset threshold, the frame of image is determined as an alternative image, and then the color richness of the alternative image is calculated. When the color richness is greater than the preset threshold, the alternative image is determined as a keyword image.

[0111] In the embodiment of the present invention, when it is determined that the preset parameter type matches the brightness information, for any frame of image in the image information and an adjacent frame of image, the screen similarity between the two adjacent frames of image is calculated, and the image information is divided into a plurality of image sub-information according to the screen similarity, wherein each image sub-information includes a plurality of frames of image. At this time, it is determined whether the screen of each image sub-information includes a moving target object, and through the shooting time interval of the frame image and the position change data of the target moving object in the screen, it is determined whether the movement frequency or amplitude of the target object exceeds the third preset threshold value, and when the judgment result is yes, the image sub-information corresponding to the target object is determined as the target image information.

[0112] In this optional embodiment, the pre-adjusted parameter type may also be the layout or relative position information type between multiple lighting devices. For example, there are two dancers performing on the stage of the image information, and the position information of the two chasing lights needs to be adjusted according to the position information of the two dancers on the stage to achieve real-time chasing of the dancers. At this time, it is necessary to determine the image of any dancer in the picture as the target image information, and collect the position information of the two dancers on the stage in the image information in real time.

[0113] It can be seen that the method described in the embodiment of the present invention can match different target image information determination methods through different pre-adjustment parameter types, thereby realizing diversified control of lighting equipment, effectively improving the flexibility and adaptability of lighting equipment control, and being close to scene requirements, which is conducive to improving the richness and complexity of the lighting equipment light effect display, improving the display immersion of the lighting equipment, and realizing diversified control and display effects; at the same time, through the screening operation of image information, only critical or highly relevant image information is processed, which is conducive to improving conversion and control efficiency and reducing processing costs.

[0114] In yet another optional embodiment, performing image recognition on the target image information to obtain a target recognition result may include the following operations:

[0115] Based on a predetermined image recognition model, a first feature extraction is performed on any frame of candidate image information in the target image information to obtain a feature map corresponding to the candidate image information; the feature map is used to represent the object category of the target object in the extracted candidate image information;

[0116] Annotate the feature map according to the predetermined annotation box to obtain the annotation area of ​​the target object;

[0117] Performing a second feature extraction on the marked area to obtain feature information matching the preset parameters of the lighting device;

[0118] All feature information in the target image information is determined as the target recognition result.

[0119] In an embodiment of the present invention, the image recognition model is a predetermined, pre-trained recognition model (e.g., Mask RCNN), which includes a main branch and several image recognition sub-branches. The main branch can use a residual network Resnet50 or Resnet101, or other network models, which are not limited in the embodiment of the present invention. The sub-branch for image recognition can be adaptively selected based on the input target image information and the type of pre-adjusted parameters, and the first feature extraction, that is, coarse-grained recognition, is performed on any frame of candidate image information in the target image information to obtain a feature map corresponding to the candidate image information. It should be noted that the feature map is used to represent the object category type of the object extracted from the candidate image information and the confidence information corresponding to each object category type. In the present invention, the object category with the highest confidence is selected as the object category of the target object.

[0120] Furthermore, according to a predetermined annotation box, the target object in the feature map is identified and located. Preferably, the annotation area of ​​the target object determined by the annotation box should be as small as possible and can include the entirety or outline of the target object to obtain accurate positioning information of the target object.

[0121] Furthermore, a second feature extraction, i.e., fine-grained recognition, is performed on the marked area to obtain feature information matching the preset parameters of the pre-lighting device, such as RGB three-dimensional data of color, two-dimensional or three-dimensional data of position information, etc., which is not limited in the embodiments of the present invention.

[0122] It can be seen that the method described in the embodiment of the present invention can identify the category and locate the position of the target object in the target image information through the image recognition algorithm, and at the same time extract feature information with a high degree of matching with the preset parameters, which is conducive to achieving a smooth conversion of image visual effects to lighting visual effects, effectively improving the flexibility and adaptability of lighting equipment control, being close to scene requirements, and being conducive to improving the display immersion of lighting equipment and achieving diversified control and display effects.

[0123] In yet another optional embodiment, determining the light control signal of the lighting device according to the target recognition result and the preset parameter conversion model may include the following operations:

[0124] For any feature information in the target recognition result, the feature information is input into a preset parameter conversion model to obtain the control parameter corresponding to the feature information;

[0125] Determine the time information of the control parameter corresponding to each feature information according to the image information;

[0126] The control parameters corresponding to all the characteristic information and the time information of the control parameters are determined as the light control signal of the lighting device.

[0127] In the embodiment of the present invention, for any feature information in the target recognition result, it is input into a preset parameter conversion model to obtain the control parameters corresponding to the feature information. For example, if the dance stick held by the dancer on the stage rotates from 0° to 120°, the lighting equipment needs to be controlled to rotate from 0° to 120 degrees. At this time, it can be converted into a DMX value 0-170 that complies with the DMX512 transmission protocol according to the preset angle conversion model (for example, the angle 0°-180° corresponds to DMX data 0-255), and transmitted to the lighting equipment to complete the rotation of the corresponding angle. At the same time, in order to maintain the "light picture synchronization" effect of the lighting equipment and the image information, the time information of the generated control parameter corresponding to the feature information can be determined according to the time position of the target image information corresponding to the feature information in the image information of the image source device. Furthermore, according to the control parameters corresponding to each feature information and the time information of the control parameters, the overall lighting control signal corresponding to the image information of the image source device is generated.

[0128] It can be seen that the method described in the embodiment of the present invention can convert different types of feature information into corresponding control parameters through different parameter conversion models, and at the same time, the time information reversely mapped out by the feature information ensures the "light and picture synchronization" effect of the lighting equipment and the image information, which is conducive to achieving a smooth conversion of image visual effects to lighting visual effects, and is conducive to improving the display immersion of the lighting equipment and achieving diversified control and display effects.

[0129] Embodiment 2

[0130] See also Figure 2 , Figure 2 1 is a schematic diagram of another control process of a lighting device disclosed in an embodiment of the present invention. Figure 2 The described method may be applied to a control device of a lighting device, and the control device of the lighting device may be an independent device or may be integrated in the lighting device, which is not limited in the embodiments of the present invention. Figure 2 As shown, the control method of the lighting device may include the following operations:

[0131] 201. Obtain image information from an image source device.

[0132] 202. Filter out target image information associated with the lighting device from the image information.

[0133] 203. Perform grayscale processing on the target image information to obtain grayscale image information corresponding to the target image information.

[0134] 204. Perform a first preprocessing operation and a second preprocessing operation on the grayscale image information to obtain preprocessed image information corresponding to the image information.

[0135] In the embodiment of the present invention, the first preprocessing operation is used to perform background denoising operation on the image information. For example, the corrosion algorithm in the morphological filtering algorithm can be used to remove the background noise in the grayscale image information. The second preprocessing operation is used to perform pixel enhancement operation on the image information. For example, the dilation algorithm in the morphological filtering algorithm can be used to emphasize the pixels in the image information. It should be noted that only the first preprocessing operation or the second preprocessing operation can be selected to preprocess the grayscale image information. It is preferred to select the first preprocessing operation and the second preprocessing operation at the same time.

[0136] 205. Perform a color restoration operation on the pre-processed image information, and determine the image information obtained after the restoration as the target image information.

[0137] 206. Perform image recognition on the target image information to obtain a target recognition result.

[0138] 207. Determine a lighting control signal of the lighting device according to the target recognition result and a preset parameter conversion model.

[0139] 208. According to the light control signal, control the lighting equipment to perform light display.

[0140] In the embodiment of the present invention, for other descriptions of step 201-step 202 and step 206-step 208, please refer to the detailed description of step 101-step 105 in embodiment 1 respectively, and the embodiment of the present invention will not be repeated here.

[0141] It can be seen that the method described in the embodiment of the present invention can perform preliminary pixel denoising, pixel enhancement and other operations on the target image information through grayscale processing, preprocessing and color restoration operations, and can obtain target image information with higher accuracy. At the same time, it reduces the computational complexity of subsequent image processing and recognition, which is conducive to improving the speed and efficiency of subsequent image recognition, and further realizes the smooth conversion of image visual effects to lighting visual effects, which is conducive to improving the display immersion of lighting equipment and realizing diversified control and display effects.

[0142] In an optional embodiment, performing the first preprocessing operation and the second preprocessing operation on the grayscale image information to obtain preprocessed image information corresponding to the image information may include the following operations:

[0143] For any matrix element in the grayscale image information, determine the number of targets whose pixel difference values ​​with the matrix element are less than a first preset threshold value among target matrix elements adjacent to the matrix element; determine whether the target number is greater than or equal to a second preset threshold value; when the determination result is yes, set the pixel values ​​of all target matrix elements adjacent to the matrix element to the pixel values ​​of the matrix element;

[0144] For any matrix element after the first preprocessing operation, convolution operation is performed on the matrix element and the preset anchor point to calculate the pixel extreme value of the area covered by the preset anchor point; and the pixel extreme value is determined as the target pixel value of the matrix element;

[0145] The target pixel values ​​corresponding to all matrix elements are determined as pre-processed image information corresponding to the image information.

[0146] In the embodiment of the present invention, for any matrix element in the grayscale image information, the target matrix element adjacent to the matrix element is first determined. It should be noted that the target matrix element can be 8 pixels with the matrix element as the center point, or any number of the 8 pixels can be selected to improve the calculation efficiency without excessively affecting the denoising accuracy, which is not limited in the embodiment of the present invention. The target number of pixel difference values ​​between the target matrix element and the matrix element is determined to be less than a first preset threshold. When the target number is greater than or equal to a second preset threshold, the pixel values ​​of all target matrix elements adjacent to the matrix element can be set to the pixel values ​​of the matrix element.

[0147] Furthermore, for any matrix element after the above denoising operation, a convolution calculation is performed with a preset anchor point, wherein the preset anchor point is two-dimensional and its matrix size is adjustable. Then, the pixel extreme value (maximum value or minimum value) of the area covered by the preset anchor point is calculated, and the extreme value is assigned to the matrix element as the target pixel value of the matrix element.

[0148] It can be seen that the method described in the embodiment of the present invention can improve the recognition of key information in the image information through background denoising and pixel enhancement processing, and can obtain target image information with higher accuracy, while reducing the computational complexity of subsequent image processing and recognition, which is beneficial to improving the speed and efficiency of subsequent image recognition, and further realizing the smooth conversion of image visual effects to lighting visual effects, which is beneficial to improving the display immersion of lighting equipment and realizing diversified control and display effects.

[0149] In another optional embodiment, the method may further include the following operations:

[0150] Determine a parameter display model of the lighting device according to the preset parameter type of the lighting device, wherein the parameter display model includes a two-dimensional model or a three-dimensional model;

[0151] According to the parameter display model of the lighting equipment and the light control signal of the lighting equipment, a parameter display diagram corresponding to the lighting equipment is generated.

[0152] In the embodiment of the present invention, according to the determined preset parameter type of the lighting device, a parameter display model related to the preset parameter type can be matched, wherein the parameter display model can be a two-dimensional model or a three-dimensional model. For example, the brightness parameter type can be depicted as a two-dimensional change curve, and the color parameter type can be depicted as a three-dimensional change curve. Then, the light control information of the lighting device is associated with the determined parameter display model to generate a parameter display diagram corresponding to the lighting device.

[0153] For example, when using the DMX512 protocol to communicate with lighting equipment, after determining the brightness control parameters of the lighting equipment and the DMX channel corresponding to the lighting equipment, first draw the coordinate system of the monitor, the x-axis is time, ranging from 0 to 30s, showing the latest 30 data, and data older than 30s will be discarded, the y-axis is the DMX data value converted from the brightness control parameter, ranging from 0 to 255. Then convert the x and y coordinate systems to the coordinate system of the monitor UI and draw it using a Bezier curve, then divide the x-axis into 6 equal parts, draw the points on the x-axis, divide the y-axis into 2 equal parts, and then draw the horizontal line on the y-axis. Suppose the length of the drawn x-axis is x1, the length of the drawn y-axis is y1, the DMX data sends 44 packets per second, and 44*30=1320 packets are sent in 30s. Every time a packet of DMX data is monitored, the current DMX value a is stripped out and then added to the end of a DMX value array arr. The position of the a value in the arr array is i, then the x coordinate and y coordinate of the a value are:

[0154] Xa=x1 / 1320*i;

[0155] Ya=y1-a / 255*y1;

[0156] Based on this (Xa, Ya), the position point of each DMX packet in the channel can be drawn. Connecting each point with a line will produce the waveform of the channel monitor. Every time a new value is added to the arr array and the coordinates are calculated, the waveform is refreshed.

[0157] Furthermore, it is possible to monitor whether the rate of change of the graphics in the display diagram within a preset time interval exceeds a preset threshold. When it is determined that the rate of change of the graphics in the display diagram within the preset time interval exceeds the preset threshold, it means that the change data of this segment of graphics is large. The data group corresponding to the segment of graphics can be determined, and the curve corresponding to the segment data group can be refreshed to a specific color to alert the user to pay attention to whether there is any abnormality in the changes in this segment of the process.

[0158] It can be seen that the method described in the embodiment of the present invention can determine different parameter display models according to different pre-adjusted parameter types, and then display the lighting control signal to the user through the time dimension, and can monitor the changing trend of the lighting control information in real time, which is conducive to the user to discover abnormal changes in time.

[0159] Embodiment 3

[0160] See also Figure 3 , Figure 3 : is a schematic diagram of the structure of a control device for lighting equipment disclosed in an embodiment of the present invention. Figure 3The device described can be an independent device or integrated in a control processing device of a lighting device, which is not limited in the embodiment of the present invention. It should be noted that the control device of the lighting device refers to the steps in a control method of a lighting device described in Embodiment 1 and Embodiment 2, and the detailed description is not repeated in this embodiment. Figure 3 As shown, the control device of the lighting device may include:

[0161] An acquisition module 301 is used to acquire image information from an image source device, wherein the image information includes at least one frame of image;

[0162] A screening module 302 is used to screen out target image information associated with the lighting device from the image information, wherein the target image information is used to identify data information for controlling the lighting device;

[0163] The recognition module 303 is used to perform image recognition on the target image information to obtain a target recognition result;

[0164] A determination module 304 is used to determine a light control signal of the lighting device according to the target recognition result and a preset parameter conversion model;

[0165] The control module 305 is used to control the lighting equipment to perform light display according to the light control signal.

[0166] It can be seen that the device described in the embodiment of the present invention can generate a control signal associated with the lighting device by screening and identifying image information, thereby realizing a smooth conversion of image visual effects to light visual effects, effectively improving the flexibility and adaptability of lighting device control, being close to scene requirements, improving the richness of adjustment of the lighting effect of the lighting device, improving the display immersion of the lighting device, and realizing diversified control and display effects.

[0167] In an optional embodiment, if Figure 4 As shown, the device may also include:

[0168] A grayscale processing module 306 is used to perform grayscale processing on the target image information screened by the screening module 302 to obtain grayscale image information corresponding to the target image information;

[0169] A preprocessing module 307 is used to perform a first preprocessing operation and a second preprocessing operation on the grayscale image information to obtain preprocessed image information corresponding to the image information, wherein the first preprocessing operation is used to perform a background denoising operation on the image information, and the second preprocessing operation is used to perform a pixel enhancement operation on the image information;

[0170] The restoration module 308 is used to perform a color restoration operation on the pre-processed image information, determine the image information obtained after restoration as the target image information, and send it to the recognition module 303 to perform image recognition on the target image information to obtain the target recognition result.

[0171] It can be seen that the device described in the embodiment of the present invention can perform preliminary pixel denoising, pixel enhancement and other operations on the target image information through grayscale processing, preprocessing and color restoration operations, and can obtain target image information with higher accuracy. At the same time, it reduces the computational complexity of subsequent image processing and recognition, which is conducive to improving the speed and efficiency of subsequent image recognition, and further realizes the smooth conversion of image visual effects to lighting visual effects, which is conducive to improving the display immersion of lighting equipment and realizing diversified control and display effects.

[0172] In another optional embodiment, Figure 4 As shown, the preprocessing module 307 performs the first preprocessing operation and the second preprocessing operation on the grayscale image information, and obtains the preprocessed image information corresponding to the image information in the specific manner as follows:

[0173] For any matrix element in the grayscale image information, determine the number of targets whose pixel difference values ​​with the matrix element are less than a first preset threshold value among target matrix elements adjacent to the matrix element; determine whether the target number is greater than or equal to a second preset threshold value; when the determination result is yes, set the pixel values ​​of all target matrix elements adjacent to the matrix element to the pixel values ​​of the matrix element;

[0174] For any matrix element after the first preprocessing operation, convolution operation is performed on the matrix element and the preset anchor point to calculate the pixel extreme value of the area covered by the preset anchor point; and the pixel extreme value is determined as the target pixel value of the matrix element;

[0175] The target pixel values ​​corresponding to all matrix elements are determined as pre-processed image information corresponding to the image information.

[0176] It can be seen that the device described in the embodiment of the present invention can improve the recognition of key information in the image information through background denoising and pixel enhancement processing, and can obtain target image information with higher accuracy, while reducing the computational complexity of subsequent image processing and recognition, which is beneficial to improving the speed and efficiency of subsequent image recognition, and further realizing the smooth conversion of image visual effects to lighting visual effects, which is beneficial to improving the display immersion of lighting equipment and realizing diversified control and display effects.

[0177] In yet another optional embodiment, Figure 4 As shown, the screening module 302 may include:

[0178] The acquisition submodule 3021 is used to acquire device information of the lighting device;

[0179] The first determination submodule 3022 is used to determine the preset parameter type of the lighting device according to the device information;

[0180] The screening submodule 3023 is used to determine target image information matching the preset parameter type from the image information.

[0181] It can be seen that the device described in the embodiment of the present invention can establish communication with the lighting device to accurately determine the preset parameter type of the device and the target image information that matches the preset parameter type of the device in an interactive manner, and can adaptively adjust the target image information according to the preset parameter type, thereby improving the flexibility and adaptability of the scheme, accurately acquiring target image information with a high degree of matching, and is beneficial to improving the response speed and control efficiency of the lighting device.

[0182] In yet another optional embodiment, Figure 4 As shown, the specific method of the screening submodule 3023 to determine the target image information matching the preset parameter type from the image information is:

[0183] When it is determined that the preset parameter type matches the color information, at least one key frame image is selected from the image information according to the color difference between two adjacent frames of image images in the image information, and all the key frame images are determined as target image information; and / or,

[0184] When it is determined that the preset parameter type matches the brightness information, the image information is divided into a plurality of image sub-information according to the picture similarity between two adjacent frames of image images in the image information; at least one target image sub-information is selected from all the image sub-information as the target image information; wherein the picture of each target image sub-information contains an object whose motion frequency or amplitude exceeds a third preset threshold.

[0185] It can be seen that the device described in the embodiment of the present invention can match different target image information determination methods through different pre-adjustment parameter types, thereby realizing diversified control of lighting equipment, effectively improving the flexibility and adaptability of lighting equipment control, and being close to scene requirements, which is conducive to improving the richness and complexity of the lighting equipment light effect display, improving the display immersion of the lighting equipment, and realizing diversified control and display effects; at the same time, through the screening operation of image information, only critical or highly relevant image information is processed, which is conducive to improving conversion and control efficiency and reducing processing costs.

[0186] In yet another optional embodiment, the identification module 303 may include:

[0187] The first feature extraction submodule 3031 is used to perform first feature extraction on any frame of candidate image information in the target image information based on a predetermined image recognition model to obtain a feature map corresponding to the candidate image information; the feature map is used to represent the object category of the target object in the extracted candidate image information;

[0188] The labeling submodule 3032 is used to label the feature map according to the predetermined labeling box to obtain the labeling area of ​​the target object;

[0189] The second feature extraction submodule 3033 is used to perform second feature extraction on the marked area to obtain feature information that matches the preset parameters of the lighting device;

[0190] The second determination submodule 3034 is used to determine all feature information in the target image information as the target recognition result.

[0191] It can be seen that the device described in the embodiment of the present invention can identify the category and locate the target object in the target image information through an image recognition algorithm, and at the same time extract feature information that has a high degree of match with the preset parameters, which is conducive to achieving a smooth conversion of image visual effects to lighting visual effects, effectively improving the flexibility and adaptability of lighting equipment control, being close to scene requirements, and being conducive to improving the display immersion of lighting equipment and achieving diversified control and display effects.

[0192] In another optional embodiment, the specific manner in which the determination module 304 determines the light control signal of the lighting device according to the target recognition result and the preset parameter conversion model is:

[0193] For any feature information in the target recognition result, the feature information is input into a preset parameter conversion model to obtain the control parameter corresponding to the feature information;

[0194] Determine the time information of the control parameter corresponding to each feature information according to the image information;

[0195] The control parameters corresponding to all the characteristic information and the time information of the control parameters are determined as the light control signal of the lighting device.

[0196] It can be seen that the device described in the embodiment of the present invention can convert different types of feature information into corresponding control parameters through different parameter conversion models, and at the same time, the time information reversely mapped out by the feature information ensures the "light and picture synchronization" effect of the lighting equipment and the image information, which is conducive to achieving a smooth conversion of image visual effects to light visual effects, and is conducive to improving the display immersion of the lighting equipment and achieving diversified control and display effects.

[0197] In yet another optional embodiment, the device may further include:

[0198] The display module 309 is used to determine the parameter display model of the lighting device according to the preset parameter type of the lighting device, wherein the parameter display model includes a two-dimensional model or a three-dimensional model; and generate a parameter display diagram corresponding to the lighting device according to the parameter display model of the lighting device and the light control signal of the lighting device.

[0199] It can be seen that the device described in the embodiment of the present invention can determine different parameter display models according to different preset parameter types, and then display the lighting control signal to the user through the time dimension, and can monitor the changing trend of the lighting control information in real time, which is conducive to the user to discover abnormal changes in time.

[0200] Embodiment 4

[0201] See also Figure 5 , Figure 5 is a schematic diagram of the structure of another lighting device control device disclosed in an embodiment of the present invention. Figure 5 The device described may be an independent device or integrated into a lighting device, which is not limited in the embodiments of the present invention. Figure 5 As shown, the control device of the lighting device may include:

[0202] A memory 401 storing executable program codes;

[0203] a processor 402 coupled to the memory 401;

[0204] The processor 402 calls the executable program code stored in the memory 401 to execute part or all of the steps in the method for controlling the lighting device disclosed in the first or second embodiment of the present invention.

[0205] Embodiment 5

[0206] An embodiment of the present invention discloses a computer storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute the steps in the lighting device control method disclosed in the first or second embodiment of the present invention.

[0207] Embodiment 6

[0208] The embodiment of the present invention discloses a lighting device, which is used to implement the control method of the lighting device described in the first embodiment and / or the second embodiment, which is not limited in the embodiment of the present invention. Optionally, the lighting device also includes a control device for the lighting device, which can be the control device for the lighting device described in the third embodiment or the fourth embodiment, which is not limited in the embodiment of the present invention.

[0209] The device embodiments described above are only illustrative, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, i.e., they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative work.

[0210] Through the specific description of the above embodiments, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the above technical solution can be essentially or partly contributed to the prior art in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable rewritable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium that can be used to carry or store data.

[0211] It should be noted that the computer program code required for the operation of each part of this specification can be written in any one or more programming languages, including object-oriented programming languages ​​such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C#, VB.NET, Python, etc., conventional procedural programming languages ​​such as C language, Visual Basic, Fortran2003, Perl, COBOL 2002, PHP, ABAP, dynamic programming languages ​​such as Python, Ruby and Groovy, or other programming languages, etc. The program code can be run completely on a computer (PC, embedded intelligent device, etc.), or run on a user's computer as an independent software package, or run partly on a user's computer and partly on a remote computer, or run completely on a remote computer or server. In the latter case, the remote computer can be connected to the user's computer through any network form, such as a local area network (LAN) or a wide area network (WAN), or connected to an external computer (e.g., via the Internet), or in a cloud computing environment, or used as a service such as software as a service (SaaS).

[0212] Finally, it should be noted that the control method and device for a lighting device disclosed in the embodiment of the present invention disclose only the preferred embodiments of the present invention, which are only used to illustrate the technical solution of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, it should be understood by those skilled in the art that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A method for controlling a lighting device, characterized in that: The method comprises: Acquiring image information from an image source device, wherein the image information includes at least one frame of image; Filtering target image information associated with the lighting device from the image information, wherein the target image information is used to identify data information for controlling the lighting device; Performing image recognition on the target image information to obtain a target recognition result; Determining a light control signal of the lighting device according to the target recognition result and a preset parameter conversion model; According to the light control signal, control the lighting device to perform light display; Wherein, determining the light control signal of the lighting device according to the target recognition result and a preset parameter conversion model includes: For any feature information in the target recognition result, input the feature information into a preset parameter conversion model to obtain a control parameter corresponding to the feature information; Determine the time information of the control parameter corresponding to each piece of the characteristic information according to the time position of the target image information corresponding to each piece of the characteristic information in the image information of the image source device; Determine the control parameters corresponding to all the characteristic information and the time information of the control parameters as the light control signal of the lighting device; The parameter conversion model is determined by the type of feature information in the target recognition result.

2. The method for controlling a lighting device according to claim 1, characterized in that: After filtering out the target image information associated with the lighting device from the image information and before performing image recognition on the target image information to obtain a target recognition result, the method further includes: Performing grayscale processing on the target image information to obtain grayscale image information corresponding to the target image information; Performing a first preprocessing operation and a second preprocessing operation on the grayscale image information to obtain preprocessed image information corresponding to the image information, wherein the first preprocessing operation is used to perform a background denoising operation on the image information, and the second preprocessing operation is used to perform a pixel enhancement operation on the image information; A color restoration operation is performed on the pre-processed image information, and the image information obtained after the restoration is determined as the target image information.

3. The method for controlling a lighting device according to claim 2, characterized in that: The performing a first preprocessing operation and a second preprocessing operation on the grayscale image information to obtain preprocessed image information corresponding to the image information includes: For any matrix element in the grayscale image information, determine the target number of target matrix elements adjacent to the matrix element whose pixel difference value with the matrix element is less than a first preset threshold; determine whether the target number is greater than or equal to a second preset threshold; when the determination result is yes, set the pixel values ​​of all target matrix elements adjacent to the matrix element to the pixel value of the matrix element; For any matrix element after the first preprocessing operation, convolve the matrix element with a preset anchor point to calculate the pixel extreme value of the area covered by the preset anchor point; determine the pixel extreme value as the target pixel value of the matrix element; The target pixel values ​​corresponding to all the matrix elements are determined as the pre-processed image information corresponding to the image information.

4. The method for controlling a lighting device according to any one of claims 1 to 3, characterized in that: The step of filtering out target image information associated with the lighting device from the image information includes: Acquire device information of the lighting device; Determining the preset parameter type of the lighting device according to the device information; Target image information matching the preset parameter type is determined from the image information.

5. The method for controlling a lighting device according to claim 4, characterized in that: The step of determining target image information matching the preset parameter type from the image information includes: When it is determined that the preset parameter type matches the color information, at least one key frame image is selected from the image information according to the color difference between two adjacent frames of image images in the image information, and all the key frame images are determined as target image information; and / or, When it is determined that the pre-adjusted parameter type matches the brightness information, the image information is divided into a plurality of image sub-information according to the picture similarity between two adjacent frames of the image in the image information; at least one target image sub-information is selected from all the image sub-information as the target image information; wherein the picture of each of the target image sub-information contains an object whose motion frequency or amplitude exceeds a third preset threshold.

6. The method for controlling a lighting device according to claim 4 or 5, characterized in that: The performing image recognition on the target image information to obtain a target recognition result includes: Based on a predetermined image recognition model, a first feature extraction is performed on any frame of candidate image information in the target image information to obtain a feature map corresponding to the candidate image information; the feature map is used to represent the object category of the target object in the extracted candidate image information; Annotate the feature map according to a predetermined annotation frame to obtain an annotation area of ​​the target object; Performing a second feature extraction on the marked area to obtain feature information matching the preset parameters of the lighting device; All the feature information in the target image information is determined as a target recognition result.

7. The method for controlling a lighting device according to claim 6, characterized in that: Determining the lighting control signal of the lighting device according to the target recognition result and a preset parameter conversion model includes: For any of the feature information in the target recognition result, input the feature information into a preset parameter conversion model to obtain a control parameter corresponding to the feature information; Determine, according to the image information, time information of a control parameter corresponding to each of the feature information; The control parameters corresponding to all the characteristic information and the time information of the control parameters are determined as the light control signal of the lighting device.

8. The method for controlling a lighting device according to claim 7, characterized in that: The method further comprises: Determining a parameter display model of the lighting device according to the preset parameter type of the lighting device, wherein the parameter display model includes a two-dimensional model or a three-dimensional model; A parameter display diagram corresponding to the lighting device is generated according to the parameter display model of the lighting device and the light control signal of the lighting device.

9. A control device for lighting equipment, characterized in that: The device is used to execute the control method of the lighting device according to any one of claims 1 to 8, and the device includes: An acquisition module, used to acquire image information from an image source device, wherein the image information includes at least one frame of image; A screening module, used to screen out target image information associated with the lighting device from the image information, wherein the target image information is used to identify data information for controlling the lighting device; A recognition module, used to perform image recognition on the target image information to obtain a target recognition result; A determination module, used to determine a light control signal of the lighting device according to the target recognition result and a preset parameter conversion model; The control module is used to control the lighting device to perform a lighting display according to the lighting control signal.

10. A control device for lighting equipment, characterized in that: The device comprises: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the control method of the lighting device according to any one of claims 1-8.

Citation Information

Patent Citations

  • Target object detection method and device

    CN111582100A

  • Stage light control method and device, equipment and storage medium

    CN113993250A