Lighting equipment monitoring method and device, vehicle and storage medium
By analyzing the beam distribution characteristics of the lighting equipment in the vehicle's foreground image, abnormal prompt information is generated, which solves the problem of timely reminding of the position offset or blocking of the lighting equipment during the vehicle's driving, and improves driving safety.
Patent Information
- Application Number
- CN202411041177.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-31
- Publication Date
- 2024-11-22
AI Technical Summary
When the lighting equipment position is offset or blocked during the vehicle, it is difficult to remind the driver in time, which affects driving safety.
By obtaining the vehicle foreground image, extracting the beam distribution characteristics of the lighting equipment, performing feature analysis and processing, determining the lighting status information, generating abnormal prompt information, and controlling the vehicle prompt component to output warnings to ensure that the driver detects and handles lighting equipment abnormalities in a timely manner.
It improves the real-time and accuracy of lighting equipment inspection, reduces the safety risks of manual inspection, improves detection efficiency, and ensures driving safety.
Smart Images

Figure CN118991607A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of vehicles, and in particular to a monitoring method, device, vehicle and storage medium for lighting equipment. Background Art
[0002] As the technology in the automotive field continues to develop, more and more residents choose vehicles as their daily means of transportation. As a safety device, the lighting equipment of the vehicle can provide safety protection for the driver during the driving process of the vehicle. However, in the related art, when the position of the lighting equipment is offset during the driving process of the vehicle, the driver cannot be reminded in time, thereby affecting driving safety. Summary of the invention
[0003] The present application provides a method, device, vehicle and storage medium for monitoring lighting equipment, aiming to perform real-time dynamic control of the vehicle, thereby improving driving safety. The technical solution is as follows:
[0004] In a first aspect, the present application provides a method for monitoring lighting equipment, comprising: acquiring a foreground image of a vehicle, and extracting light beam distribution characteristics of the lighting equipment in the foreground image; performing feature analysis processing on the light beam distribution characteristics to obtain lighting status information of the lighting equipment; determining an abnormal detection result of the lighting equipment based on the lighting status information; generating abnormal prompt information based on the abnormal detection result, and controlling a prompt component of the vehicle to output the abnormal prompt information.
[0005] In the above technical solution, by responding to the start-up command for the vehicle's lighting equipment to obtain the vehicle's foreground image, it is possible to provide necessary data support for subsequent lighting status monitoring, ensuring the real-time and accuracy of the information. Extracting the light beam distribution characteristics of the lighting equipment in the foreground image can accurately capture the actual state of the light, which is beneficial for quickly locating the problem. By performing feature analysis and processing on the light beam distribution characteristics, the working condition of the lighting equipment can be further determined, thereby accurately obtaining the lighting status information. By determining the abnormal detection results of the lighting equipment based on the lighting status information, the abnormal state of the lighting equipment can be quickly discovered, thereby reducing the safety risks of manual inspections and improving detection efficiency. Finally, based on the abnormal detection results, abnormal prompt information is generated, and the vehicle's prompt component is controlled to output the prompt information, which can promptly remind the driver of the abnormal situation of the lighting equipment, helping the driver to take effective measures to ensure driving safety.
[0006] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, a foreground image of a vehicle is obtained, and beam distribution characteristics of a lighting device are extracted from the foreground image, including: obtaining a foreground image of the vehicle, converting the foreground image into a foreground grayscale image; binarizing each pixel in the foreground grayscale image to generate a foreground binary image; and performing feature extraction on the foreground binary image to obtain pixel feature information.
[0007] In the above technical solution, by capturing the foreground image of the vehicle and converting it into a grayscale image, the complexity of image processing can be greatly reduced while retaining key information. By binarizing the pixels in the grayscale image and generating the corresponding binary grayscale image, the data structure can be further simplified, and the key pixel features can be highlighted, which facilitates efficient recognition and processing by the system. Finally, these binarized images are subjected to detailed feature extraction to accurately obtain pixel feature information, thereby providing strong support for subsequent image analysis and application, and ensuring the accuracy and effectiveness of the processing results.
[0008] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, feature analysis processing is performed on the light beam distribution characteristics to obtain lighting status information of the lighting equipment, including: obtaining target pixel point information of the first non-zero pixel point in the light beam distribution characteristics, the first non-zero pixel point being a pixel point having a pixel value greater than a preset pixel threshold; determining the lighting occlusion status information of the lighting equipment based on the target pixel point information.
[0009] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, the illumination occlusion status information of the lighting device is determined based on the target pixel point information, including: obtaining the total number of pixels in the light beam distribution characteristics; determining the target light intensity value of the lighting device based on the ratio of the number of first non-zero pixels and the total number of pixels; determining the abnormality detection result of the lighting device based on the illumination parameters, including: determining the occlusion detection result of the lighting device based on the target light intensity value and the initial light intensity value, the initial light intensity value being the light intensity value determined by the lighting device when there is no occlusion.
[0010] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, the lighting occlusion status information of the lighting device is determined based on the target pixel point information, including: determining the second non-zero pixel point with the largest coordinate value among the coordinate values of the first non-zero pixel point; determining the target lighting distance of the lighting device based on the coordinate value of the second non-zero pixel point; determining the abnormality detection result of the lighting device based on the lighting parameters, including: determining the occlusion detection result of the lighting device based on the target lighting distance and the initial lighting distance, the initial lighting distance being the lighting distance determined by the lighting device when there is no occlusion.
[0011] In the above technical solution, by extracting features from the binarized image and obtaining pixel feature information, the accuracy of key information recognition in the image can be improved. By determining the non-zero pixels from the beam distribution characteristics, the light blocking state can be determined so as to quickly find the blocking problem of the lighting equipment. At the same time, the target light intensity value is determined by calculating the ratio of the number of non-zero pixels to the total number of pixels, so as to timely evaluate the actual lighting effect of the light. In addition, the target light distance is determined by using the coordinate values of the non-zero pixels, which further refines the evaluation of the lighting effect. In this way, it is possible to comprehensively judge whether there is any blocking abnormality in the lighting equipment, so as to provide more accurate and comprehensive abnormality detection results, thereby ensuring the driving safety of the driver.
[0012] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, feature analysis processing is performed on the light beam distribution characteristics to obtain lighting status information of the lighting equipment, including: obtaining the coordinate value of a first non-zero pixel point in the light beam distribution characteristics, the first non-zero pixel point being a pixel point having a pixel value greater than a preset pixel threshold; determining the lighting offset status information of the lighting equipment based on the coordinate value of the first non-zero pixel point and the coordinate value of a third non-zero pixel point of the lighting equipment; the third non-zero pixel point being a pixel point of the lighting equipment when no offset occurs and whose pixel value is greater than the preset pixel threshold.
[0013] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, the lighting offset status information of the lighting device is determined based on the coordinate value of the first non-zero pixel point and the coordinate value of the third non-zero pixel point of the lighting device, including: determining the number of non-zero pixels whose coordinate values overlap based on the coordinate value of the first non-zero pixel point and the coordinate value of the third non-zero pixel point; determining the target offset degree value of the lighting device based on the ratio of the number of non-zero pixels to the number of the first non-zero pixel point; determining the abnormality detection result of the lighting device based on the lighting status information, including: determining the offset detection result of the lighting device based on the target offset degree value and the offset degree threshold.
[0014] In the above technical solution, by accurately locating the non-zero pixel points in the beam distribution characteristics, the coordinates of these key points can be obtained to quickly identify the pixel point distribution in the beam, thereby providing an accurate reference point for analyzing the illumination direction of the light. By comparing the coordinates of the first non-zero pixel point in the current image with the third non-zero pixel point of the lighting device when no offset occurs, the illumination offset state of the lighting device can be determined, and the illumination deviation of the light can be discovered in time. By calculating the number of non-zero pixel points with overlapping coordinate values, and determining the target offset degree value based on the ratio of this number to the total number of the first non-zero pixel points, the offset of the lighting device can be quantified. By combining the illumination state information and the target offset degree value, and comparing it with the preset offset degree threshold, the offset detection result of the lighting device is obtained to further ensure the driving safety of the driver.
[0015] In a second aspect, the present application provides a monitoring device for lighting equipment, comprising:
[0016] A command response unit, used for acquiring a foreground image of the vehicle and extracting a beam distribution feature of the lighting device from the foreground image;
[0017] A feature analysis unit, used to perform feature analysis on the light beam distribution feature to obtain the lighting status information of the lighting equipment;
[0018] An information determination unit, used to determine an abnormality detection result of the lighting device based on the lighting status information;
[0019] The information generating unit is used to generate abnormal prompt information based on the abnormal detection result, and control the prompt component of the vehicle to output the abnormal prompt information.
[0020] In a third aspect, the present application provides a vehicle, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the computer program is executed by the processor, a method for monitoring a lighting device as described in any one of the above items is implemented.
[0021] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed, the method for monitoring a lighting device as described in any one of the above items is implemented. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.
[0023] Figure 1 It is a scene schematic diagram of a method for monitoring lighting equipment provided in an embodiment of the present application;
[0024] Figure 2 It is a flow chart of a method for monitoring lighting equipment provided in an embodiment of the present application;
[0025] Figure 3 It is a flow chart of a method for monitoring lighting equipment provided in an embodiment of the present application;
[0026] Figure 4 It is a flow chart of a method for monitoring lighting equipment provided in an embodiment of the present application;
[0027] Figure 5It is a scene schematic diagram of a method for monitoring lighting equipment provided in an embodiment of the present application;
[0028] Figure 6 It is a flow chart of a method for monitoring lighting equipment provided in an embodiment of the present application;
[0029] Figure 7 It is a scene schematic diagram of a method for monitoring lighting equipment provided in an embodiment of the present application;
[0030] Figure 8 It is a structural schematic diagram of a monitoring device for lighting equipment provided in an embodiment of the present application;
[0031] Fig. 9 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application. DETAILED DESCRIPTION
[0032] In order to make the features and advantages of the present application more obvious and easy to understand, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.
[0033] The technical solution in the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B: "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0034] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features.
[0035] In the related art, vehicles often encounter rough roads during driving, which causes the lighting equipment to be blocked by external materials such as dust, mud and water stains. In addition, long-term driving of the vehicle on bumpy roads may cause the installation position of the lighting equipment to move or deform. However, the related art often requires the driver to actively discover abnormal problems with the lighting equipment, but cannot actively monitor the working environment of the lighting equipment and then issue safety warnings to the driver, thereby affecting the driver's driving safety.
[0036] In order to improve driving safety, the embodiment of the present application provides a method for monitoring lighting equipment, and the execution subject of the method for monitoring lighting equipment is a vehicle. The following are detailed descriptions respectively. It should be noted that the description order of the following embodiments is not intended to limit the preferred order of the embodiments. Figure 1 , Figure 1 1 is a system architecture diagram of a method for monitoring lighting equipment provided by an embodiment of the present application. The specific process of the method for monitoring lighting equipment may be as follows:
[0037] Figure 1 It is a scene schematic diagram of a method for monitoring lighting equipment provided in an embodiment of the present application.
[0038] like Figure 1 As shown, the vehicle is equipped with an image acquisition device, wherein the image acquisition device may be a multi-channel panoramic under-vehicle image acquisition device and a vehicle-mounted camera system, wherein the panoramic under-vehicle image acquisition device can acquire all-round image information of the vehicle, including the front and left and right edge position monitoring of the vehicle. The vehicle-mounted camera system can realize 360° visual perception, which is used for driving records, reversing images, parking surrounds, etc. The vehicle-mounted camera system can capture images of the vehicle's surroundings and provide key information for automatic driving and driving assistance systems. The specific image acquisition device to be used is determined according to the actual scene and is not specifically limited here. When the image acquisition device receives the start-up instruction of the lighting equipment, it obtains the foreground image of the vehicle once at a preset interval, wherein the foreground image is mainly used to collect the beam distribution characteristics of the lighting equipment, and the beam distribution characteristics include pixel points with different pixel values and the coordinate values of each pixel point.
[0039] After acquiring the foreground image, the image acquisition device converts the foreground image into a foreground grayscale image through a pre-trained image processing model, where the foreground image is an unprocessed original color image, that is, each pixel in the foreground image has the values of the three color channels of red, green, and blue (RGB) to describe its color, and the foreground grayscale image is a grayscale image converted from the color foreground image. In the foreground grayscale image, each pixel has only one brightness value, and the brightness value is usually obtained by converting the RGB value into a single brightness value according to a corresponding algorithm, thereby simplifying the image information and facilitating the image processing model to further process and analyze the foreground grayscale image, such as edge detection and feature extraction.
[0040] After the foreground grayscale image is obtained, the foreground grayscale image is binarized to unify the grayscale values of the pixels in the foreground grayscale image and generate a foreground binarized image, wherein the foreground binarized image includes non-zero pixels and zero pixels, wherein the non-zero pixels are pixels whose grayscale values are greater than the grayscale threshold. The target illumination intensity value of the lighting device can be determined by the ratio of the number of non-zero pixels to the total number of pixels, and the target illumination intensity value can be compared with the initial illumination intensity value when the lighting device is in an unobstructed state to determine the occlusion detection result of the lighting device. At the same time, the target illumination distance of the lighting device can be further determined by obtaining the maximum coordinate value of each non-zero pixel, and the target illumination distance can be compared with the initial illumination distance when the lighting device is not offset to determine the occlusion detection result of the lighting device.
[0041] In actual scenarios, since the vehicle may be bumpy during driving, it is necessary to monitor in real time whether the lighting equipment is offset, that is, by obtaining the coordinate value of each non-zero pixel point in the light beam feature and comparing it with the coordinate value of the initial pixel point of the lighting equipment when there is no offset and the pixel value is greater than the preset pixel threshold, the non-zero pixel points with overlapping coordinate values are determined, and the number of non-zero pixel points is ratioed with the number of the first non-zero pixels to obtain the target offset degree value.
[0042] When it is detected that there are abnormal detection results in the above-obstruction detection results and / or offset detection results, corresponding abnormal prompt information is generated and loaded into the prompt device of the vehicle for display so as to prompt the driver of the vehicle in real time.
[0043] based on Figure 1 The system architecture diagram shown below will be combined with Figure 2-Figure 7 , a monitoring method for lighting equipment provided in an embodiment of the present application is introduced in detail.
[0044] Based on the above situation, the present application embodiment proposes a monitoring method for lighting equipment. Figure 2 , Figure 2 FIG. 1 is a flow chart of a method for monitoring lighting equipment provided in an embodiment of the present application. Figure 2 As shown, the method of the embodiment of the present application may include the following steps S101-S104.
[0045] S101, obtaining a foreground image of a vehicle, and extracting light beam distribution features of a lighting device from the foreground image.
[0046] In the embodiment of the present application, the instruction to turn on the lighting equipment can be manually triggered by the driver, or it can be actively triggered by the vehicle according to the surrounding environment information, that is, the vehicle obtains the brightness information of the surrounding environment and then determines whether it is necessary to turn on the lighting equipment for auxiliary lighting. The above two triggering schemes can be executed separately or in combination. The specific execution method is determined according to the actual scene and is not specifically limited here. When the lighting equipment is in the turned-on state, the image acquisition device is further controlled to capture the foreground image of the vehicle in real time or at a preset interval.
[0047] Specifically, when the vehicle detects that the start-up instruction of the lighting equipment is triggered, the image acquisition device is controlled to obtain the foreground image of the vehicle at the current moment. The foreground image includes the light beam characteristics emitted by the lighting equipment, wherein the pixel point in the light beam distribution characteristics represents a separate color or brightness information point in the foreground image. The pixel point is the most basic information unit in the foreground image, and each pixel point contains color and grayscale value information. By analyzing the position distribution and grayscale value size of the pixel points in the image, the direction, intensity and distribution pattern of the light beam of the lighting equipment can be identified.
[0048] After obtaining the foreground image, the foreground image is preprocessed by a pre-trained image processing model, including adjusting the size of the foreground image, converting the foreground image to grayscale, and binarizing the grayscale image. Among them, adjusting the size of the foreground image can ensure that the image adapts to different display or processing requirements, and the image ratio is maintained and the computational complexity is reduced through scaling operations. Secondly, the foreground image is converted into a foreground grayscale image, and each pixel in the foreground grayscale image is further binarized to generate a foreground binary image, thereby simplifying the image data and highlighting the brightness information of the pixel points.
[0049] S102, performing feature analysis processing on the light beam distribution feature to obtain lighting status information of the lighting equipment.
[0050] In an embodiment of the present application, the lighting status information of the lighting equipment includes the lighting obstruction status information and the lighting offset status information of the lighting equipment, wherein the lighting obstruction status information is used to determine whether there are obstructions on the surface of the lighting equipment and to determine the obstruction level of the lighting equipment, and the lighting offset status information is used to determine whether the lighting equipment is offset during driving, that is, whether it is loose.
[0051] Specifically, the lighting occlusion state information and the lighting offset state information of the lighting device are determined by analyzing the ratio and / or coordinate values of the number of pixels in the foreground binary image and the number of pixels in the image of the lighting device in a normal state.
[0052] S103: Determine an abnormality detection result of the lighting device based on the lighting status information.
[0053] Specifically, the total number of pixels and the number of first non-zero pixels in the foreground binary image are obtained from the light beam distribution characteristics, wherein the number of first non-zero pixels is the pixels whose grayscale values are greater than the grayscale threshold. A numerical value reflecting the light intensity is obtained by analyzing the ratio of the number of first non-zero pixels to the total number of pixels. Finally, the ratio is mapped to a predefined light intensity range to determine the target light intensity value of the lighting equipment. The light intensity value is compared with the initial light intensity value when the lighting equipment is in a normal state to obtain the light intensity difference. At the same time, in a predefined light occlusion level value interval, the light occlusion level corresponding to the light intensity difference is searched to determine the occlusion detection result of the lighting equipment.
[0054] By traversing the coordinate values of the first non-zero pixel point, and determining the pixel point with the largest coordinate value as the second non-zero pixel point, the coordinate value of the second non-zero pixel point is converted into the target lighting distance of the lighting device, and the target lighting distance is compared with the initial lighting distance when the lighting device is in a normal state, and then the lighting distance difference of the current lighting device is determined, and at the same time, in a predefined lighting occlusion level value range, the lighting occlusion level corresponding to the lighting distance difference is searched to determine the occlusion detection result of the lighting device.
[0055] Obtain the coordinate value of the third non-zero pixel point when the lighting device is in a normal state, and compare it with the coordinate value of the first non-zero pixel point obtained above to obtain the lighting offset state information, that is, determine the number of non-zero pixel points whose coordinate values coincide with each other, wherein the third non-zero pixel point is the number of pixel points obtained when the lamp device is in a normal state, compare the number of overlapping non-zero pixel points with the number of the third non-zero pixel point, and then determine the target offset degree value of the lighting device, and determine the offset detection result of the lighting device according to the target offset degree value.
[0056] S104, generating abnormal prompt information based on the abnormal detection result, and loading the abnormal prompt information into a prompt component of the vehicle to prompt the driver of the vehicle.
[0057] In an embodiment of the present application, the prompt components of the vehicle include voice, text, icon and light prompt components.
[0058] Specifically, when an abnormal occlusion detection result is detected in the occlusion detection result, and / or an abnormal offset detection result is detected in the offset detection result, the corresponding prompt method is determined according to the occlusion level corresponding to the abnormal occlusion detection result and / or the offset degree value corresponding to the abnormal offset detection result, wherein the prompt method can be a separate prompt for any one of the devices of voice, text, icon and light prompt components, or a combined prompt for multiple devices of voice, text, icon and light prompt components.
[0059] As can be seen from the above, by responding to the start-up command for the vehicle's lighting equipment to obtain the vehicle's foreground image, it is possible to provide necessary data support for subsequent lighting status monitoring and ensure the real-time and accuracy of the information. Extracting the light beam distribution characteristics of the lighting equipment in the foreground image can accurately capture the actual state of the light, which is beneficial for quickly locating the problem. By performing feature analysis and processing on the light beam distribution characteristics, the working condition of the lighting equipment can be further determined, thereby accurately obtaining the lighting status information. Determining the abnormal detection results of the lighting equipment based on the lighting status information can quickly discover the abnormal state of the lighting equipment, thereby reducing the safety risks of manual inspections and improving detection efficiency. Finally, generating abnormal prompt information based on the abnormal detection results and controlling the vehicle's prompt components to output this information can promptly remind the driver of abnormal conditions of the lighting equipment, which helps the driver take effective measures to ensure driving safety.
[0060] To increase the speed of image data processing. Figure 3 , Figure 3 FIG. 1 is a flow chart of a method for monitoring lighting equipment provided in an embodiment of the present application. Figure 3 As shown, the method of the embodiment of the present application may include the following steps S201-S203.
[0061] S201, obtaining a foreground image of a vehicle, and converting the foreground image into a foreground grayscale image.
[0062] S202, performing binarization processing on each pixel in the foreground grayscale image to generate a foreground binary image.
[0063] Specifically, in S201-S202, after acquiring the foreground image, the image acquisition device converts the foreground image into a foreground grayscale image through image analysis technology, wherein the foreground image is an original color image that has not been specially processed, that is, it contains color information. Each pixel in the foreground image has the values of the three color channels of red, green, and blue (RGB) to describe its color. The foreground grayscale image is the result of converting the color foreground image into a grayscale image. In the foreground grayscale image, each pixel has only one brightness value.
[0064] After obtaining the foreground grayscale image, the foreground grayscale image is binarized to unify the grayscale values of the pixels in the foreground grayscale image to generate a foreground binary image. The foreground binary image includes non-zero pixels and zero pixels, wherein the non-zero pixels are pixels whose grayscale values are greater than the grayscale threshold. For example, in the process of converting the foreground image to the foreground grayscale image, the RGB value of each pixel is converted into a single brightness value. For example, the original RGB value of a pixel is (255, 0, 0), which means it is pure red. When converted to grayscale pixels, the RGB value of each pixel is converted into a brightness value. For another example, if the selected grayscale threshold is 100, the pixels with original grayscale values greater than 100 in the binary image are set to non-zero values, indicating white or high brightness areas, and the pixels with original grayscale values less than or equal to 100 are set to zero, indicating black or low brightness areas.
[0065] S203, extracting features from the foreground binary image to obtain beam distribution features.
[0066] Specifically, the foreground binary image is cropped according to a preset ratio through a pre-trained image processing model to remove redundant image areas to improve image quality; then, pixel features related to the beam distribution, such as pixel value, position coordinates or neighborhood information, are selected and the distribution features of the beam are calculated using the pixel features, including the center position, width, shape and intensity distribution.
[0067] As can be seen from the above, by capturing the foreground image of the vehicle and converting it into a grayscale image, the complexity of image processing can be greatly reduced while retaining key information. By binarizing the pixels in the grayscale image and generating the corresponding binary grayscale image, the data structure can be further simplified, and the key pixel features can be highlighted, which facilitates efficient recognition and processing by the system. Finally, these binarized images are carefully feature extracted to accurately obtain pixel feature information, thereby providing strong support for subsequent image analysis and application, and ensuring the accuracy and effectiveness of the processing results.
[0068] To improve the accuracy of the analysis of beam distribution characteristics. Figure 4 , Figure 4 FIG. 1 is a flow chart of a method for monitoring lighting equipment provided in an embodiment of the present application. Figure 4 As shown, the method of the embodiment of the present application may include the following steps S301-S308.
[0069] S301, obtaining target pixel information of the first non-zero pixel in the beam distribution characteristics.
[0070] S302: Determine the illumination shading state information of the lighting device based on the target pixel point information.
[0071] Specifically, in S301-S302, the number of first non-zero pixel points in the beam distribution feature and the coordinate value of the first non-zero pixel point are determined by the image processing model to generate corresponding target pixel point information, wherein the first non-zero pixel point is a pixel point whose grayscale value is greater than a preset grayscale threshold. The target illumination intensity value of the lighting device is determined by determining the ratio of the number of first non-zero pixel points to the total number of pixel points, and the target illumination distance of the lighting device is determined by determining the pixel point with the largest coordinate value among the first non-zero pixel points, and the illumination shielding state information of the lighting device is determined based on the target illumination intensity value and / or the target illumination distance.
[0072] S303, obtaining the total number of pixel points in the light beam distribution characteristics.
[0073] S304: Determine a target light intensity value of the lighting device based on a ratio of the number of the first non-zero pixels to the total number of pixels.
[0074] Specifically, in S303-S304, the total number of pixels and the number of first non-zero pixels in the foreground binary image are obtained from the beam distribution characteristics, wherein the number of first non-zero pixels is the pixel whose grayscale value is greater than the grayscale threshold. By analyzing the ratio of the number of first non-zero pixels to the total number of pixels, a numerical value reflecting the light intensity is obtained. The ratio is mapped to a predefined light intensity range to determine the target light intensity value of the lighting device. For example, if the total number of pixels is 10,000 and the number of first non-zero pixels is 6,000, the ratio is the number of first non-zero pixels / total number of pixels = 6,000 / 10,000 = 0.6, indicating that the light beam covers 60% of the entire area. Based on this ratio, the target light intensity value of the lighting equipment can be determined. For example, in the preset light value comparison table, the light intensity increases by 10% for every 0.1 increase in the ratio. Then the target light intensity value = initial light intensity value * (1 + the increase percentage corresponding to the ratio) = initial light intensity value * (1 + 0.6 * 10%) = initial light intensity value * 1.06, where the initial light intensity value is the light value of the lighting equipment when there is no obstruction.
[0075] S305: Determine an occlusion detection result of the lighting device based on the target light intensity value and the initial light intensity value.
[0076] Specifically, the light intensity value is compared with the initial light intensity value when the lighting device is in a normal state, and then the light intensity difference is obtained. At the same time, the light occlusion level corresponding to the light intensity difference is searched in the predefined light occlusion level value range to determine the occlusion detection result of the lighting device. For example, the initial light intensity value of the lighting device is 1000 lumens, and the target light intensity value is 700 lumens. Then the light intensity difference is the initial light intensity value - target light intensity value = 1000 lumens - 700 lumens = 400 lumens. For example, if the light intensity difference is in the numerical range of 0-100, it means that the occlusion detection result of the lighting device is a mild abnormal occlusion. If the light intensity difference is in the numerical range of 101-500, it means that the occlusion detection result of the lighting device is a moderate abnormal occlusion. If the light intensity difference is in the numerical range of 501-1000, it means that the occlusion detection result of the lighting device is a severe abnormal occlusion. In the above example, since the light intensity difference is 400, it is determined that the occlusion detection result of the lighting device is a moderate occlusion abnormality.
[0077] S306, determining a second non-zero pixel point having a maximum coordinate value among the coordinate values of the first non-zero pixel points.
[0078] S307: Determine the target illumination distance of the lighting device based on the coordinate value of the second non-zero pixel point.
[0079] Specifically, in S306-S307, the coordinate values of each first non-zero pixel point are obtained respectively, and the first non-zero pixel point with the largest coordinate value is determined as the second non-zero pixel point, and the coordinate value of the second non-zero pixel point is converted into the target illumination distance of the lighting device. For example, the coordinate values of the first non-zero pixel point include (2,2), (1,3), (3,1), and (4,4), among which the sum of the x and y coordinates of the pixel point (4,4) is the largest (4+4=8), so we determine the first non-zero pixel point with a coordinate value of (4,4) as the second non-zero pixel point. At the same time, according to the actual scale, it can be known that one pixel in the image corresponds to 10 meters in the actual space, and the lighting device is located at the origin of the image (0,0), then the target illumination distance of the second non-zero pixel point (4,4) from the origin is approximately 40 meters.
[0080] S308: Determine an occlusion detection result of the lighting device based on the target lighting distance and the initial lighting distance.
[0081] Specifically, the target lighting distance is compared with the initial lighting distance when the lighting device is in an unobstructed state, and then the lighting distance difference of the current lighting device is determined. At the same time, the lighting obstruction level corresponding to the lighting distance difference is searched in the predefined lighting obstruction level value range to determine the obstruction detection result of the lighting device. For example, the initial lighting distance is 100 meters and the target lighting distance is 50 meters. At this time, it can be known that the lighting distance difference is 50 meters. For another example, in the preset lighting distance difference comparison table, the lighting distance difference of 0-50 is slightly abnormal obstruction, the lighting distance difference of 51-100 is moderately abnormal obstruction, and the lighting intensity difference of 101-200 is severely abnormal obstruction. In the above example, since the lighting distance difference is 50 meters, it means that the obstruction detection result of the lighting device is slightly abnormal obstruction.
[0082] Please also read Figure 5 Figure 5 Schematic diagram of a scene of a method for monitoring lighting equipment provided in an embodiment of the present application. Figure 5 As shown: there are multiple first non-zero pixel points in the foreground binary grayscale image. By comparing the coordinate values of the multiple first non-zero pixel points on the y-axis, the first non-zero pixel point with the largest y-axis coordinate value is determined as the second non-zero pixel point.
[0083] As can be seen from the above, by extracting features from the binarized image and obtaining pixel feature information, the accuracy of key information recognition in the image can be improved. By determining the non-zero pixels from the beam distribution characteristics, the light blocking state can be determined to quickly find the blocking problem of the lighting equipment. At the same time, the target light intensity value is determined by calculating the ratio of the number of non-zero pixels to the total number of pixels, so as to timely evaluate the actual lighting effect of the light. In addition, the target lighting distance is determined by using the coordinate values of the non-zero pixels, which further refines the evaluation of the lighting effect. In this way, it is possible to comprehensively judge whether there is any blocking abnormality in the lighting equipment, so as to provide more accurate and comprehensive abnormality detection results, thereby ensuring the driving safety of the driver.
[0084] To improve the accuracy of the deviation warning of lighting equipment. Figure 6 , Figure 6 FIG. 1 is a flow chart of a method for monitoring lighting equipment provided in an embodiment of the present application. Figure 6 As shown, the method of the embodiment of the present application may include the following steps S401-S405.
[0085] S401, obtaining the coordinate value of the first non-zero pixel point in the beam distribution feature.
[0086] S402: Determine illumination offset state information of the lighting device based on the coordinate value of the first non-zero pixel point and the coordinate value of the third non-zero pixel point of the lighting device.
[0087] Specifically, in S401-S402, the coordinate value of each first non-zero pixel point is extracted from the light beam distribution characteristics, and the coordinate value of the third pixel point when the lighting equipment is not offset is obtained, the coordinate value of the first non-zero pixel point and the coordinate value of the third non-zero pixel point are compared and analyzed to obtain the number of pixels whose coordinates overlap, and then the lighting offset status information of the lighting equipment is determined.
[0088] S403: Determine the number of non-zero pixel points whose coordinate values overlap based on the coordinate value of the first non-zero pixel point and the coordinate value of the third non-zero pixel point.
[0089] S404: Determine a target offset value of the lighting device based on a ratio of the number of non-zero pixels to the number of the first non-zero pixels.
[0090] Specifically, in S403-S404, the coordinate values of the first non-zero pixel point and the coordinate values of the third non-zero pixel point are compared and analyzed to obtain the number of pixels whose coordinates overlap, and then the lighting offset state information of the lighting equipment is determined. For example, the number of the third non-zero pixel point and the number of the first non-zero pixel point are both 500. After comparing the coordinate values, it is determined that the number of non-zero pixel points whose coordinates overlap is 300. Then, the ratio of the number of non-zero pixels to the number of the first non-zero pixel points is equal to 2. At this time, the target offset degree value corresponding to the ratio is determined according to the preset offset degree comparison table.
[0091] S405: Determine the offset detection result of the lighting device based on the target offset degree value and the offset degree threshold.
[0092] Specifically, the offset degree threshold is used to detect whether the offset degree of the lighting equipment reaches a threshold that affects the normal driving of the vehicle, and the offset degree threshold can be determined according to the actual scenario. For example, the target offset degree value is 10 and the offset degree threshold is 5. At this time, since the target offset degree value is greater than the offset degree threshold, the offset detection result of the lighting equipment is determined to be an abnormal offset.
[0093] Please also read Figure 7 Figure 7 Schematic diagram of a scene of a method for monitoring lighting equipment provided in an embodiment of the present application. Figure 7 In the schematic diagram on the left, the number of the first non-zero pixel points is 23, and the number of the third non-zero pixel points in the schematic diagram on the right is 15. The number of non-zero pixel points with overlapping coordinate values is 15, so the ratio of the number of non-zero pixel points to the number of the first non-zero pixel points is approximately equal to 1.5.
[0094] As can be seen from the above, by accurately locating the non-zero pixel points in the beam distribution characteristics, the coordinates of these key points can be obtained to quickly identify the pixel point distribution in the beam, thereby providing an accurate reference point for analyzing the illumination direction of the light. By comparing the coordinates of the first non-zero pixel point in the current image with the third non-zero pixel point of the lighting device when no offset occurs, the illumination offset state of the lighting device can be determined, and the illumination deviation of the light can be discovered in time. By calculating the number of non-zero pixel points with overlapping coordinate values, and determining the target offset degree value based on the ratio of this number to the total number of the first non-zero pixel points, the offset of the lighting device can be quantified. By combining the illumination state information and the target offset degree value, and comparing it with the preset offset degree threshold, the offset detection result of the lighting device is obtained to further ensure the driving safety of the driver.
[0095] Optionally, in a feasible embodiment, the specific implementation process of the image processing model includes a data preprocessing stage, that is, by collecting a large number of front-view camera images and normalizing these images, such as adjusting the size, color space conversion and normalizing the light intensity value, to ensure the consistency of the input data. At the same time, the collected images are manually annotated to create a data set containing images and corresponding labels to provide a basis for subsequent training. In the neural network processing stage, the preprocessed image data is input into the neural network. Different levels of image features are extracted through multiple convolutional layers to capture important information such as edges and textures. The size of the feature map is reduced through the pooling layer to reduce the computational complexity. The extracted feature map is further processed by the fully connected layer, and finally a vector representing the probability distribution is output. At the same time, in order to enhance the expression ability of the model, activation functions such as ReLU are applied after each convolutional layer and fully connected layer. The output layer uses the Softmax activation function to convert the network output into a multi-category probability distribution, which is used to determine whether the lighting equipment is blocked by foreign objects, soil or water stains, and whether the lighting equipment is offset. The loss function and training phase, that is, the error between the predicted output and the true label is calculated using the loss function, and the error gradient is calculated through the back propagation algorithm, and the network weights are updated to minimize the loss function. At the same time, the gradient descent optimization algorithm or its variants are used to update the weights to improve the training efficiency. In the model evaluation and optimization phase, the model performance is evaluated by using the validation set during the training process, and the hyperparameters are adjusted to improve the accuracy. In addition, data enhancement technology is used to increase the diversity of training data, prevent overfitting, and further improve the generalization ability of the model. Finally, the real-time collected front-view camera image is input into the trained neural network model for forward propagation, and the judgment result of whether the lighting equipment is blocked is output. According to the output results of the model, the corresponding early warning mechanism is triggered to remind the driver to deal with the problem of lighting equipment blocking and / or offset in time to ensure the driving safety of the driver.
[0096] based on Figure 1The system architecture will be combined with Figure 8 , the monitoring device for lighting equipment provided in the embodiment of the present application is introduced in detail. It should be noted that, Figure 8 A monitoring device for lighting equipment in the present application Figure 2-Figure 6 For the convenience of explanation, only the part related to the embodiment of the present application is shown. For the specific technical details not disclosed, please refer to the present application. Figure 2-Figure 6 In the embodiment shown, the monitoring device 500 for lighting equipment may include a command response unit 501, a feature analysis unit 502, an information determination unit 503 and an information generation unit 504, as follows:
[0097] The command response unit 501 is used to obtain a foreground image of the vehicle and extract the beam distribution characteristics of the lighting equipment in the foreground image;
[0098] The feature analysis unit 502 is used to perform feature analysis on the light beam distribution feature to obtain the lighting status information of the lighting device;
[0099] An information determination unit 503 is used to determine an abnormality detection result of the lighting device based on the lighting status information;
[0100] The information generating unit 504 is used to generate abnormal prompt information based on the abnormal detection result, and control the prompt component of the vehicle to output the abnormal prompt information.
[0101] In some embodiments, the instruction response unit 501 also includes an image processing unit, a pixel processing unit, and a feature extraction unit.
[0102] An image processing unit, used for acquiring a foreground image of the vehicle and converting the foreground image into a foreground grayscale image;
[0103] A pixel processing unit, used for performing binarization processing on each pixel in the foreground grayscale image to generate a foreground binary image;
[0104] The feature extraction unit is used to extract features from the foreground binary image to obtain pixel feature information.
[0105] In some embodiments, the feature analysis unit 502 further includes a first pixel point acquisition unit and an information determination unit.
[0106] A first pixel point acquisition unit, used to acquire target pixel point information of a first non-zero pixel point in the beam distribution feature, where the first non-zero pixel point is a pixel point whose pixel value is greater than a preset pixel threshold;
[0107] The information determining unit is used to determine the illumination occlusion state information of the lighting device based on the target pixel point information.
[0108] In some embodiments, the feature analysis unit 502 further includes a second pixel point acquisition unit, a light intensity value determination unit, and a first result determination unit.
[0109] A second pixel point acquisition unit, used to acquire the total number of pixel points in the beam distribution characteristics;
[0110] A light intensity value determining unit, configured to determine a target light intensity value of the lighting device based on a ratio of the number of first non-zero pixels to the total number of pixels;
[0111] The first result determination unit is used to determine the occlusion detection result of the lighting device based on the target illumination intensity value and the initial illumination intensity value, where the initial illumination intensity value is the illumination intensity value determined by the lighting device when there is no occlusion.
[0112] In some embodiments, the feature analysis unit 502 further includes a third pixel point acquisition unit, a light distance acquisition unit, and a second result determination unit.
[0113] A third pixel point acquisition unit, used for determining a second non-zero pixel point with the largest coordinate value among the coordinate values of the first non-zero pixel points;
[0114] An illumination distance acquisition unit, used to determine a target illumination distance of the lighting device based on the coordinate value of the second non-zero pixel point;
[0115] The second result determination unit is used to determine the occlusion detection result of the lighting device based on the target lighting distance and the initial lighting distance, where the initial lighting distance is the lighting distance determined by the lighting device when there is no occlusion.
[0116] In some embodiments, the information determining unit 503 further includes a fourth pixel point acquiring unit and an offset information acquiring unit.
[0117] A fourth pixel point acquisition unit, used to acquire the coordinate value of a first non-zero pixel point in the beam distribution feature, where the first non-zero pixel point is a pixel point whose pixel value is greater than a preset pixel threshold;
[0118] The offset information acquiring unit is used to determine the illumination offset state information of the lighting device based on the coordinate value of the first non-zero pixel point and the coordinate value of the third non-zero pixel point of the lighting device.
[0119] In some embodiments, the information determination unit 503 further includes a fifth pixel point acquisition unit, a shift degree value determination unit, and a shift detection result determination unit.
[0120] a fifth pixel point acquisition unit, configured to determine the number of non-zero pixel points whose coordinate values overlap based on the coordinate value of the first non-zero pixel point and the coordinate value of the third non-zero pixel point;
[0121] An offset value determination unit, configured to determine a target offset value of the lighting device based on a ratio of the number of non-zero pixels to the number of first non-zero pixels;
[0122] The deviation detection result determination unit is used to determine the deviation detection result of the lighting device based on the target deviation degree value and the deviation degree threshold.
[0123] In an embodiment of the present application, by responding to the start-up command for the vehicle's lighting equipment to obtain the vehicle's foreground image, it is possible to provide necessary data support for subsequent lighting status monitoring, ensuring the real-time and accuracy of the information. By extracting the light beam distribution characteristics of the lighting equipment in the foreground image, it is possible to accurately capture the actual state of the light, which is beneficial for quickly locating the problem. By performing feature analysis and processing on the light beam distribution characteristics, the working condition of the lighting equipment can be further determined, thereby accurately obtaining the lighting status information. By determining the abnormal detection results of the lighting equipment based on the lighting status information, the abnormal state of the lighting equipment can be quickly discovered, thereby reducing the safety risks of manual inspections and improving detection efficiency. Finally, based on the abnormal detection results, abnormal prompt information is generated, and the vehicle's prompt component is controlled to output this information, which can promptly remind the driver of abnormal conditions of the lighting equipment, helping the driver to take effective measures to ensure driving safety.
[0124] In addition, the monitoring device for lighting equipment provided in the above embodiment and a monitoring method for lighting equipment are of the same concept, and the implementation process thereof is detailed in the method embodiment, which will not be described in detail here.
[0125] The serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0126] See also Fig. 9 , which is a schematic diagram of the structure of a vehicle provided in the embodiment of the present application. Fig. 9 As shown, the vehicle 600 includes a processor 601 and a memory 602. The processor 601 is electrically connected to the memory 602.
[0127] The processor 601 is the control center of the vehicle 600 and may include one or more processing cores. The processor 601 uses various interfaces and lines to connect various parts of the entire vehicle, and executes various functions of the vehicle and processes data by running or calling computer programs stored in the memory 602, and calling data stored in the memory 602, so as to control the vehicle as a whole. Optionally, the processor 601 can be implemented in at least one hardware form of digital signal processing (DSP), field programmable gate array (FPGA), and programmable logic array (PLA). The processor 601 can integrate one or a combination of CPU, graphics processing unit (GPU), modem, etc. Among them, the CPU mainly processes the operating system, user pages, and applications; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It is understandable that the above-mentioned modem may not be integrated into the processor 601, but may be implemented separately through a communication chip.
[0128] The memory 602 can be used to store software programs and modules, and the processor 601 executes various functional applications and data processing by running the computer programs and modules stored in the memory 602. The memory 602 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, a computer program required for at least one function, etc.; the data storage area can store data created according to the use of the vehicle, etc.
[0129] In addition, the memory 602 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.
[0130] In the embodiment of the present application, the processor 601 in the vehicle 600 loads instructions corresponding to the processes of one or more computer programs into the memory 602 according to the following steps, and the processor 601 runs the computer program stored in the memory 602 to implement various functions, as follows:
[0131] Acquire a foreground image of the vehicle, and extract the beam distribution characteristics of the lighting equipment from the foreground image;
[0132] Perform feature analysis on the beam distribution characteristics to obtain the lighting status information of the lighting equipment;
[0133] Determine abnormal detection results of lighting equipment based on lighting status information;
[0134] Abnormal prompt information is generated based on the abnormality detection result, and a prompt component of the vehicle is controlled to output the abnormal prompt information.
[0135] Optionally, the processor 601 obtains a foreground image of the vehicle and extracts beam distribution characteristics of the lighting equipment in the foreground image. Specifically, the processor 601 performs the following steps: obtains a foreground image of the vehicle and converts the foreground image into a foreground grayscale image; performs binarization processing on each pixel in the foreground grayscale image to generate a foreground binary image; and performs feature extraction on the foreground binary image to obtain pixel feature information.
[0136] Optionally, the processor 601 performs feature analysis processing on the light beam distribution characteristics to obtain the lighting status information of the lighting equipment, specifically performing: obtaining target pixel information of the first non-zero pixel point in the light beam distribution characteristics, the first non-zero pixel point being a pixel point having a pixel value greater than a preset pixel threshold; and determining the lighting occlusion status information of the lighting equipment based on the target pixel point information.
[0137] Optionally, when the processor 601 determines the illumination occlusion status information of the lighting device based on the target pixel information, the processor 601 specifically performs the following steps: obtaining the total number of pixels in the light beam distribution characteristics; determining the target illumination intensity value of the lighting device based on the ratio of the number of the first non-zero pixels to the total number of pixels; and determining an abnormality detection result of the lighting device based on the illumination parameters, including: determining the occlusion detection result of the lighting device based on the target illumination intensity value and the initial illumination intensity value, the initial illumination intensity value being the illumination intensity value determined by the lighting device when there is no occlusion.
[0138] Optionally, when the processor 601 determines the lighting occlusion status information of the lighting device based on the target pixel point information, the processor 601 specifically performs: determining the second non-zero pixel point with the largest coordinate value among the coordinate values of the first non-zero pixel point; determining the target lighting distance of the lighting device based on the coordinate value of the second non-zero pixel point; and determining the abnormality detection result of the lighting device based on the lighting parameters, including: determining the occlusion detection result of the lighting device based on the target lighting distance and the initial lighting distance, the initial lighting distance being the lighting distance determined by the lighting device when there is no occlusion.
[0139] Optionally, the processor 601 performs feature analysis processing on the light beam distribution characteristics to obtain the lighting status information of the lighting device, specifically performing: obtaining the coordinate value of a first non-zero pixel point in the light beam distribution characteristics, the first non-zero pixel point being a pixel point having a pixel value greater than a preset pixel threshold; determining the lighting offset status information of the lighting device based on the coordinate value of the first non-zero pixel point and the coordinate value of a third non-zero pixel point of the lighting device; the third non-zero pixel point being a pixel point of the lighting device when no offset occurs and whose pixel value is greater than the preset pixel threshold.
[0140] Optionally, the processor 601 determines the lighting offset status information of the lighting device based on the coordinate value of the first non-zero pixel point and the coordinate value of the third non-zero pixel point of the lighting device by: determining the number of non-zero pixels whose coordinate values overlap based on the coordinate value of the first non-zero pixel point and the coordinate value of the third non-zero pixel point; determining a target offset degree value of the lighting device based on a ratio of the number of non-zero pixels to the number of the first non-zero pixel point; and determining an abnormality detection result of the lighting device based on the lighting status information, including: determining an offset detection result of the lighting device based on the target offset degree value and an offset degree threshold.
[0141] In the embodiment of the present application, by responding to the start-up command for the vehicle's lighting equipment to obtain the vehicle's foreground image, it is possible to provide necessary data support for subsequent lighting status monitoring, ensuring the real-time and accuracy of the information. By extracting the light beam distribution characteristics of the lighting equipment in the foreground image, it is possible to accurately capture the actual state of the light, which is beneficial for quickly locating the problem. By performing feature analysis and processing on the light beam distribution characteristics, the working condition of the lighting equipment can be further determined, thereby accurately obtaining the lighting status information. By determining the abnormal detection results of the lighting equipment based on the lighting status information, the abnormal state of the lighting equipment can be quickly discovered, thereby reducing the safety risks of manual inspections and improving detection efficiency. Finally, based on the abnormal detection results, abnormal prompt information is generated, and the vehicle's prompt component is controlled to output this information, which can promptly remind the driver of abnormal conditions of the lighting equipment, helping the driver to take effective measures to ensure driving safety.
[0142] In addition, the device provided in the embodiment of the present application can specifically be a chip, a component or a module. The chip may include a connected processor and a memory; wherein the memory is used to store instructions. When the processor calls and executes the instructions, the chip can execute a lighting equipment monitoring method provided in the above embodiment.
[0143] An embodiment of the present application also provides a computer-readable storage medium, in which a computer program code is stored. When the computer program code is executed on a computer, the computer executes the above-mentioned related method steps to implement a monitoring method for a lighting device provided in the above embodiment.
[0144] The embodiment of the present application further provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement a monitoring method for lighting equipment provided in the above-mentioned embodiment.
[0145] Among them, the device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above and will not be repeated here.
[0146] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0147] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the coupling or direct coupling or communication connection between the related ones shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0148] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A method for monitoring lighting equipment, characterized in that: Applied to a vehicle, the method comprises: Acquire a foreground image of the vehicle, and extract the beam distribution characteristics of the lighting device from the foreground image; Performing feature analysis on the light beam distribution feature to obtain lighting status information of the lighting device; Determining an abnormality detection result of the lighting device based on the lighting status information; Abnormality prompt information is generated based on the abnormality detection result, and a prompt component of the vehicle is controlled to output the abnormality prompt information.
2. The method according to claim 1, characterized in that The step of acquiring a foreground image of the vehicle and extracting a beam distribution feature of the lighting device from the foreground image includes: Acquire a foreground image of the vehicle, and convert the foreground image into a foreground grayscale image; Binarizing each pixel in the foreground grayscale image to generate a foreground binary image; Feature extraction is performed on the foreground binary image to obtain the light beam distribution feature.
3. The method according to claim 2, characterized in that The performing feature analysis processing on the light beam distribution feature to obtain the lighting status information of the lighting device includes: Acquire target pixel information of a first non-zero pixel in the beam distribution feature, where the first non-zero pixel is a pixel whose pixel value is greater than a preset pixel threshold; The illumination shading state information of the lighting device is determined based on the target pixel point information.
4. The method according to claim 3, characterized in that The target pixel point information is the number of the first non-zero pixel points; The determining the illumination occlusion state information of the lighting device based on the target pixel point information includes: Obtain the total number of pixels in the beam distribution characteristics; Determining a target light intensity value of the lighting device based on a ratio of the number of the first non-zero pixels to the total number of pixels; The determining the abnormality detection result of the lighting device based on the illumination parameter includes: An occlusion detection result of the lighting device is determined based on the target illumination intensity value and an initial illumination intensity value, wherein the initial illumination intensity value is an illumination intensity value determined by the lighting device when no occlusion occurs.
5. The method according to claim 3, characterized in that: The target pixel point information is the coordinate value of the first non-zero pixel point; The determining the illumination occlusion state information of the lighting device based on the target pixel point information includes: Determine a second non-zero pixel point with the largest coordinate value among the coordinate values of the first non-zero pixel points; Determine the target illumination distance of the lighting device based on the coordinate value of the second non-zero pixel point; The determining the abnormality detection result of the lighting device based on the illumination parameter includes: Based on the target illumination distance and the initial illumination distance, an occlusion detection result of the lighting device is determined, wherein the initial illumination distance is the illumination distance determined by the lighting device when no occlusion exists.
6. The method according to claim 2, characterized in that The performing feature analysis processing on the light beam distribution feature to obtain the lighting status information of the lighting device includes: Acquire a coordinate value of a first non-zero pixel point in the beam distribution feature, where the first non-zero pixel point is a pixel point whose pixel value is greater than a preset pixel threshold; Determine the illumination offset state information of the lighting device based on the coordinate value of the first non-zero pixel point and the coordinate value of the third non-zero pixel point of the lighting device; The third non-zero pixel point is a pixel point of which the lighting device has no offset and whose pixel value is greater than the preset pixel threshold.
7. The method according to claim 6, characterized in that The determining the illumination offset state information of the lighting device based on the coordinate value of the first non-zero pixel point and the coordinate value of the third non-zero pixel point of the lighting device includes: Determine the number of non-zero pixel points whose coordinate values overlap based on the coordinate value of the first non-zero pixel point and the coordinate value of the third non-zero pixel point; Determining a target offset value of the lighting device based on a ratio of the number of the non-zero pixels to the number of the first non-zero pixels; Determining an abnormality detection result of the lighting device based on the lighting status information includes: Based on the target deviation value and the deviation threshold, a deviation detection result of the lighting device is determined.
8. A monitoring device for lighting equipment, characterized in that: include: A command response unit, used for acquiring a foreground image of the vehicle, and extracting a beam distribution feature of the lighting device from the foreground image; A feature analysis unit, used for performing feature analysis on the light beam distribution feature to obtain illumination state information of the lighting device; an information determining unit, configured to determine an abnormality detection result of the lighting device based on the lighting status information; The information generating unit is used to generate abnormal prompt information based on the abnormal detection result, and control the prompt component of the vehicle to output the abnormal prompt information.
9. A vehicle, characterized in that: The vehicle comprises: A memory for storing executable program codes; A processor is used to call and run the executable program code from the memory, so that the vehicle executes the monitoring method of the lighting equipment according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed, the method for monitoring the lighting device according to any one of claims 1 to 7 is implemented.
