A remote street lamp fault monitoring and indication system
By designing a remote street light fault monitoring and indication system, using the monitoring camera to collect the street light lighting area images and compare it with the reference scene image information, the problem of unreal-time street light fault monitoring in the existing technology is solved, and remote real-time monitoring of street light faults is realized and Unified management has improved the level of urban public transportation management.
Patent Information
- Application Number
- CN202210692984.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-17
- Publication Date
- 2025-02-07
- Estimated Expiration
- 2042-06-17
AI Technical Summary
The existing technology is difficult to achieve real-time fault monitoring and unified management of urban street lights, resulting in risks in road safety.
A remote street light fault monitoring and indication system is designed, and the street light illumination area images are collected by the monitoring camera, the image information to be compared, and the reference scene image information is compared to the monitoring results of the street lights.
Remote real-time monitoring of street light faults is realized, the accuracy and convenience of monitoring is improved, the timely maintenance of street lights is ensured, and the level of urban public transportation management is improved.
Smart Images

Figure CN115294446B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the field of municipal road monitoring systems, and in particular to a remote street lamp fault monitoring and indicating system. Background Art
[0002] Street lighting in my country is widely used in urban roads, highways and other scenes, and the number of street lights is very large. The lifespan of the current mainstream urban lighting street lights is generally about 2 to 3 years, and the lifespan of the emerging LED street lights is generally only 3 to 5 years. Therefore, the number of natural failures of street lights in my country every year due to lifespan is very large, and a large number of urban street lights need to be replaced every year. Therefore, timely detection of faulty street lights is very important to improve the level of urban public transportation management.
[0003] The traditional street lighting industry is unable to connect to the Internet, and engineering personnel often only learn about abnormal conditions in street lighting after regular inspections or when the public calls relevant departments, which poses a certain risk to road safety. Through the Internet of Things technology, street lighting conditions can be monitored in real time, and engineering personnel can arrange to deal with street lighting anomalies in an orderly manner.
[0004] Among traditional street lamp equipment, some street lamp equipment cannot be connected to the Internet, and some street lamp equipment comes from different manufacturers, resulting in inconsistent protocols. Therefore, it is impossible to connect all street lamp equipment in a certain area (including street lamp equipment that cannot be connected to the Internet and has inconsistent protocols) to the Internet of Things, making it inconvenient for unified monitoring and management. Summary of the invention
[0005] The present invention is intended to provide a remote street lamp fault monitoring and indicating system, which has the capability of remotely monitoring the fault condition of a single street lamp, with high accuracy and convenient monitoring.
[0006] To achieve the above object, the basic scheme of the present invention is as follows:
[0007] A remote street lamp fault monitoring and indicating system, comprising:
[0008] A control end, used for generating a fault monitoring task, wherein the fault monitoring task is associated with a fault monitoring item;
[0009] A collection end, wherein the collection end is configured with a plurality of collection units, and the collection units are monitoring cameras pre-installed on municipal roads;
[0010] Define a plurality of street lamp installation scene areas corresponding to a monitored road section, each street lamp installation scene area corresponds to a plurality of street lamps, each street lamp is preset with a street lamp number, and the street lamp number corresponds to street lamp location information;
[0011] The monitoring range of the monitoring camera covers the illumination area of all street lamps in the monitored road section, and each monitoring camera can collect an illumination area image of a street lamp in a street lamp installation scene area and generate image information to be compared; the image information to be compared includes a plurality of blocks to be compared, each block to be compared corresponds to the illumination area of each street lamp;
[0012] The acquisition end is connected to the control end and is used to receive a fault monitoring task and generate an image acquisition request according to a fault monitoring item associated with the fault monitoring task;
[0013] A positioning device is installed in the street lamp installation scene area, and the positioning device is configured with a positioning response module. The positioning response module responds to the acquisition end, and the positioning response module is used to receive the image acquisition request from the acquisition end and generate a regional positioning signal at the same time;
[0014] An image database, corresponding to the street lamp installation scene area, is pre-set with reference scene image information and a regional positioning signal corresponding to each reference scene image information, wherein the reference scene image information includes a plurality of reference illumination blocks, and each reference illumination block corresponds to the street lamp position information of a street lamp;
[0015] The processing end is connected to the acquisition end and the image database, and the processing end is capable of receiving the image information to be compared from the acquisition end;
[0016] The processing end is configured with a block comparison module, and the block comparison module is configured with a block comparison strategy, and the block comparison strategy includes a block comparison threshold; when the processing end receives the image information to be compared, the corresponding reference scene image information is screened from the image database according to the corresponding regional positioning signal, and the reference illumination block is retrieved from the reference scene image information, and the block comparison strategy calculates the block similarity value between the reference illumination block and its corresponding block to be compared, and when the block similarity value is less than the block comparison threshold, the monitoring result of the street lamp corresponding to the block to be compared is output as a monitoring fault; when the block similarity value is greater than the block comparison threshold, the monitoring result of the street lamp corresponding to the block to be compared is output as normal monitoring;
[0017] The fault indication terminal is connected to the processing terminal, and is used to receive the monitoring fault results from the processing terminal, generate fault indication information according to the monitoring fault results, and send the fault indication information to the operator, wherein the fault indication information includes the street lamp number, street lamp location information and fault category.
[0018] Furthermore, the image block to be compared includes a plurality of illumination blocks to be compared, and the illumination blocks are respectively a single illumination block to be compared and an overlapping illumination block to be compared, the single illumination block to be compared corresponds to a single illumination area of each street lamp, the overlapping illumination blocks to be compared are set to two and are symmetrically arranged on both sides of the single illumination block to be compared, and the overlapping illumination blocks to be compared correspond to the overlapping illumination areas of two adjacent street lamps;
[0019] Each reference illumination block includes a reference single illumination block and a reference overlapping illumination block. The reference single illumination block corresponds to the single illumination block to be compared, and the reference overlapping illumination block corresponds to the overlapping illumination block to be compared.
[0020] Further, the processing end is configured with a brightness comparison module, the brightness comparison module is configured with a first brightness comparison strategy, the first brightness comparison strategy includes a first brightness comparison threshold and a first reference similarity value; the first brightness comparison strategy is configured with a first brightness comparison step, which includes:
[0021] Step 1: The processing end receives the image information to be compared, selects the corresponding reference scene image information from the image database according to the corresponding regional positioning signal, and retrieves the reference single illumination block in any reference illumination block from the reference scene image information, extracts the brightness value of the pixel in the reference single illumination block, and uses a two-dimensional function g0(i0, j0) to represent the brightness value of each pixel in the reference single illumination block to form a reference brightness first matrix, wherein i0 is the horizontal coordinate of the pixel in the reference single illumination block, and j0 is the vertical coordinate of the pixel in the reference single illumination block;
[0022] Step 2: The first brightness comparison strategy extracts the brightness values of the pixels in the single illumination block to be compared, and uses gx(ix, jx) to represent the brightness values of the pixels in the single illumination block to be compared, forming a first brightness matrix to be compared, wherein ix is the horizontal coordinate of the pixel in the single illumination block to be compared, and jx is the vertical coordinate of the pixel in the single illumination block to be compared;
[0023] Step three: perform a difference operation on the first brightness matrix to be compared and the first reference brightness matrix. When the difference between the first brightness matrix to be compared and the first reference brightness matrix is less than the first brightness comparison threshold, and the brightness values of the pixel points in the single illumination block to be compared of any two street lamps on the same monitored section are greater than the first reference similarity value, the output monitoring result is a monitoring fault, and the fault category in the monitoring fault is the voltage fault of the monitored section.
[0024] Furthermore, the brightness comparison module is configured with a second brightness comparison strategy, the second brightness comparison strategy includes a second brightness comparison threshold and a second reference similarity value; the second brightness comparison strategy is configured with a second brightness comparison step, which includes:
[0025] Step 1: The processing end receives the image information to be compared, selects the corresponding reference scene image information from the image database according to the corresponding regional positioning signal, and retrieves one of the reference illumination blocks from the reference scene image information, respectively extracts the brightness values of the pixels in the reference single illumination block and the reference overlapping illumination block in the reference illumination block, and uses a two-dimensional function g0(i0, j0) to represent the brightness value of each pixel in the reference single illumination block to form a reference brightness first matrix; uses a two-dimensional function gz(iz, jz) to represent the brightness value of each pixel in the reference overlapping illumination block to form a reference brightness second matrix;
[0026] Step 2: The second brightness comparison strategy retrieves the illumination block to be compared corresponding to the target street lamp corresponding to the reference illumination block according to the reference illumination block, extracts the brightness value of the pixel points in the single illumination block to be compared, uses gx(ix, jx) to represent the brightness value of each pixel point in the single illumination block to be compared, and forms a first brightness matrix to be compared, and uses gy-1(iy-1, jy-1) and gy-2(iy-2, jy-2) to represent the brightness value of each pixel point in two overlapping illumination blocks to be compared, respectively, to form a second brightness matrix to be compared;
[0027] Step three: perform a difference operation on the first brightness matrix to be compared and the first reference brightness matrix. When the difference between the first brightness matrix to be compared and the first reference brightness matrix is less than the second brightness comparison threshold, and the similarity value between the two second brightness matrices to be compared in the lighting block to be compared of the target street lamp is greater than the second reference similarity value, the output monitoring result is a monitoring fault, and the fault category in the monitoring fault is the bulb damage fault of the target street lamp.
[0028] Further, the brightness comparison module is configured with a third brightness comparison strategy, the third brightness comparison strategy includes a third reference similarity value, and the third brightness comparison strategy is configured with a third brightness comparison step, which includes:
[0029] Step 1: The monitoring camera continuously obtains the image information to be compared within a preset time period, and retrieves one of the illumination blocks to be compared from the image information to be compared, extracts the brightness value of the pixel points in the single illumination block to be compared in the illumination block to be compared, and uses the function gt(ix, jx, t) to represent the brightness value of each pixel point in the reference single illumination block within the preset time to form a time brightness matrix, where t represents the preset time period;
[0030] Step 2: The third brightness comparison strategy generates a change curve of the brightness value and the preset time for each pixel point according to the time brightness matrix, and compares the similarity between the brightness value and the preset time change curve between each pixel point. When the similarity between each pixel point is greater than the third benchmark similarity value, the output monitoring result is a monitoring fault, and the fault category in the monitoring fault is the abnormal flickering of the bulb of the target street lamp.
[0031] Furthermore, the processing end is configured with an abnormality recognition module, the abnormality recognition module is configured with an abnormality recognition strategy, the abnormality recognition strategy is configured with a first abnormality threshold and a second abnormality threshold, the abnormality recognition strategy selects pixel points with brightness values greater than the first abnormality threshold as abnormal points according to the change curve between the brightness values of each pixel point in the single illumination block to be compared of the illumination block to be compared corresponding to the target street lamp and the preset time, and generates abnormal blocks according to the abnormal points, when the area occupied by the abnormal block in the single illumination block to be compared is greater than the second abnormality threshold, the monitoring camera corresponding to the image information to be compared is determined as the compensation acquisition point according to the illumination block to be compared corresponding to the abnormal block, and multiple compensation monitoring tasks are generated, and the monitoring results when the area occupied by the abnormal block in the single illumination block to be compared is less than the second abnormality threshold are selected as the corrected monitoring results.
[0032] Further, the processing end is configured with a brightness value correction module, and the brightness value correction module is configured with a brightness value correction strategy. When the block similarity value is greater than the block comparison threshold, the brightness value correction strategy generates a brightness value correction parameter according to the block similarity value of the reference illumination block and its corresponding block to be compared. The brightness value correction module can correct the brightness value of the pixel points in the single illumination block to be compared according to the brightness value correction parameter, and use Gx=βgx(ix, jx) to represent the corrected brightness value of each pixel point in the single illumination block to be compared, so as to form a first matrix of corrected brightness to be compared, wherein β is the brightness value correction parameter;
[0033] The brightness value correction module can correct the brightness value of each pixel in the overlapping illumination blocks to be compared according to the brightness value correction parameters, and respectively use Gy-1=βgy-1(iy-1, jy-1) and Gy-2=βgy-2(iy-2, jy-2) to represent the corrected brightness value of each pixel in the two overlapping illumination blocks to be compared, thereby forming a second matrix of corrected brightness to be compared.
[0034] Furthermore, the brightness value correction parameter is configured with a random parameter, and the random parameter is set with a plurality of influencing factors, wherein the influencing factors include the grayscale and resolution of the image block to be compared, night visibility, and the distance and angle of the monitoring camera relative to the target street lamp.
[0035] Furthermore, the acquisition end is configured with a Bluetooth module, and the monitoring camera of the acquisition end can control the on and off of the circuit of the corresponding street lamp installation scene area through the Bluetooth module.
[0036] Furthermore, when the area occupied by the abnormal block in the single lighting block to be compared is greater than the second abnormal threshold, the monitoring camera corresponding to the image information to be compared is determined as the compensation collection point according to the lighting block to be compared corresponding to the abnormal block, and a compensation monitoring task is generated. The monitoring camera controls the circuit on-off state of the corresponding street lamp installation scene area through the Bluetooth module to reset, and performs multiple compensation monitoring tasks, and screens out the monitoring results when the area occupied by the abnormal block in the single lighting block to be compared is less than the second abnormal threshold as the corrected monitoring result.
[0037] Compared with the prior art, the beneficial effects of this solution are:
[0038] 1. The remote control platform generates a fault monitoring task. According to the fault monitoring task, the monitoring camera collects the image of the illuminated area of the street lamp and generates the image information to be compared. The processing end selects the corresponding reference scene image information according to the received image information to be compared, and retrieves the reference illumination block from the reference scene image information. The block comparison strategy calculates the block similarity value between the reference illumination block and its corresponding block to be compared. When the block similarity value is less than the block comparison threshold, the monitoring result of the street lamp corresponding to the block to be compared is output as the monitoring fault; the fault indication end is used to receive the monitoring fault result from the processing end, generate fault indication information according to the monitoring fault result, and send the fault indication information to the operator, so as to timely repair the street lamp at the fault point to ensure the safety of pedestrians and vehicles on the road section corresponding to the street lamp.
[0039] 2. When the monitoring result is a monitoring fault, the processing end is equipped with a brightness comparison module. According to its preset first brightness comparison strategy, second brightness comparison strategy and third brightness comparison strategy, it can further determine that the fault category in the monitoring fault is a voltage fault, a bulb damage fault or an abnormal bulb flickering fault, so that the operator can make faster and more accurate fault handling according to the fault category, thereby ensuring that the target street lamp resumes work as soon as possible and ensuring the safety of pedestrians and vehicles on the corresponding illuminated road section.
[0040] 3. Since the brightness values of the collected pixels are affected by many factors, in order to ensure the accuracy of monitoring, the brightness value correction parameters are configured, and the influencing factors are set as random parameters in the calculation of the brightness value correction parameters, thereby improving the accuracy of monitoring.
[0041] 4. Since the environment range illuminated by the street lamp is dynamic and changeable, in this case, it will affect the brightness value of the pixel points within the range illuminated by the street lamp, and the main factors that affect the brightness value of the pixel points are the impact of the headlights of the vehicle passing through the environment where the street lamp is located; the impact of fallen leaves, road garbage, etc. on the brightness value of the pixel points; the impact of flying insects adhering to the street lamp on the brightness value of some pixels; therefore, an abnormal recognition module is configured at the processing end, which can identify pixels with abnormal brightness values and form abnormal blocks, regenerate compensation monitoring tasks based on the abnormal blocks, and select the monitoring results when the area occupied by the abnormal blocks in the single illumination block to be compared is less than the second abnormal threshold from multiple compensation monitoring tasks as the corrected monitoring results. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] Figure 1 Schematic diagram of the system architecture of the present invention.
[0043] The reference numerals in the drawings of the specification include: control terminal 1, image database 2, acquisition terminal 3, acquisition unit 31, processing terminal 4, block comparison module 41, brightness comparison module 42, abnormality recognition module 43, brightness value correction module 44, fault indication terminal 5. DETAILED DESCRIPTION
[0044] The present invention will be further described in detail below with reference to the accompanying drawings and through specific implementation methods:
[0045] Example:
[0046] A remote street lamp fault monitoring and indication system, such as Figure 1 As shown, including:
[0047] Control terminal 1 is used to generate fault monitoring tasks, which are associated with fault monitoring projects. Control terminal 1 is a remote control platform that can generate fault monitoring tasks based on preset control strategies and human input.
[0048] The collection end 3 is configured with a plurality of collection units 31, and the collection units 31 are monitoring cameras pre-installed on the municipal roads. By using the monitoring cameras pre-installed on the municipal roads as the monitoring sources of the street lamps, the layout cost of the system can be greatly saved compared with the prior art.
[0049] Define a number of street lamp installation scene areas corresponding to a monitored road section, each street lamp installation scene area corresponds to a plurality of street lamps, each street lamp is preset with a street lamp number, and the street lamp number corresponds to the street lamp location information;
[0050] The monitoring range of the monitoring camera covers the illumination area of all street lamps in the monitored road section, and each monitoring camera can collect an illumination area image of a street lamp in a street lamp installation scene area and generate image information to be compared; the image information to be compared includes a plurality of image blocks to be compared, and each image block to be compared corresponds to the illumination area of each street lamp;
[0051] The acquisition terminal 3 is connected to the control terminal 1 and is used to receive the fault monitoring task and generate an image acquisition request according to the fault monitoring item associated with the fault monitoring task;
[0052] A positioning device is installed in the street lamp installation scene area, and the positioning device is configured with a positioning response module, which responds to the acquisition terminal 3 and is used to receive an image acquisition request from the acquisition terminal 3 and generate a regional positioning signal at the same time;
[0053] An image database 2, corresponding to a street lamp installation scene area, is pre-set with reference scene image information and a regional positioning signal corresponding to each reference scene image information, the reference scene image information includes a plurality of reference illumination blocks, each reference illumination block corresponds to street lamp position information of a street lamp; the image database 2 is pre-stored in a server in the cloud;
[0054] The processing end 4 is connected to the acquisition end 3 and the image database 2, and the processing end 4 can receive the image information to be compared from the acquisition end 3; the processing end 4 is configured in a server in the cloud;
[0055] The processing end 4 is configured with a block comparison module 41, and the block comparison module 41 is configured with a block comparison strategy, and the block comparison strategy includes a block comparison threshold; when the processing end 4 receives the image information to be compared, the corresponding reference scene image information is screened from the image database 2 according to the corresponding regional positioning signal, and the reference illumination block is retrieved from the reference scene image information, and the block comparison strategy calculates the block similarity value between the reference illumination block and its corresponding block to be compared, when the block similarity value is less than the block comparison threshold, the monitoring result of the street lamp corresponding to the block to be compared is output as a monitoring fault; when the block similarity value is greater than the block comparison threshold, the monitoring result of the street lamp corresponding to the block to be compared is output as normal monitoring;
[0056] The fault indication terminal 5 is connected to the processing terminal 4. The fault indication terminal 5 is used to receive the monitoring fault results from the processing terminal 4, generate fault indication information according to the monitoring fault results, and send the fault indication information to the operator. The fault indication information includes the street lamp number, street lamp location information and fault category.
[0057] The image block to be compared includes a plurality of illumination blocks to be compared, and the illumination blocks are respectively a single illumination block to be compared and an overlapping illumination block to be compared. The single illumination block to be compared corresponds to a single illumination area of each street lamp, and the overlapping illumination blocks to be compared are set to two and symmetrically arranged on both sides of the single illumination block to be compared, and the overlapping illumination blocks to be compared correspond to the overlapping illumination areas of two adjacent street lamps.
[0058] Each reference illumination block includes a reference single illumination block and a reference overlapping illumination block. The reference single illumination block corresponds to the single illumination block to be compared, and the reference overlapping illumination block corresponds to the overlapping illumination block to be compared.
[0059] The processing end 4 is configured with a brightness comparison module 42, and the brightness comparison module 42 is configured with a first brightness comparison strategy, the first brightness comparison strategy includes a first brightness comparison threshold and a first reference similarity value; the first brightness comparison strategy is configured with a first brightness comparison step, which includes:
[0060] Step 1: The processing end 4 receives the image information to be compared, selects the corresponding reference scene image information from the image database 2 according to the corresponding regional positioning signal, and retrieves the reference single illumination block in any reference illumination block from the reference scene image information, and extracts the brightness value of the pixel point in the reference single illumination block, and uses a two-dimensional function g0(i0, j0) to represent the brightness value of each pixel point in the reference single illumination block to form a reference brightness first matrix, wherein i0 is the horizontal coordinate of the pixel point in the reference single illumination block, and j0 is the vertical coordinate of the pixel point in the reference single illumination block;
[0061] Step 2: The first brightness comparison strategy extracts the brightness values of the pixels in the single illumination block to be compared, and uses gx(ix, jx) to represent the brightness values of each pixel in the single illumination block to be compared, forming a first brightness matrix to be compared, wherein ix is the horizontal coordinate of the pixel in the single illumination block to be compared, and jx is the vertical coordinate of the pixel in the single illumination block to be compared;
[0062] Step three: perform a difference operation on the first brightness matrix to be compared and the first reference brightness matrix. When the difference between the first brightness matrix to be compared and the first reference brightness matrix is less than the first brightness comparison threshold, and the brightness values of the pixel points in the single illumination block to be compared of any two street lamps on the same monitored section are greater than the first reference similarity value, the output monitoring result is a monitoring fault, and the fault category in the monitoring fault is the voltage fault of the monitored section.
[0063] The brightness comparison module 42 is configured with a second brightness comparison strategy, which includes a second brightness comparison threshold and a second reference similarity value; the second brightness comparison strategy is configured with a second brightness comparison step, which includes:
[0064] Step 1: The processing end 4 receives the image information to be compared, selects the corresponding reference scene image information from the image database 2 according to the corresponding regional positioning signal, and retrieves one of the reference illumination blocks from the reference scene image information, respectively extracts the brightness values of the pixels in the reference single illumination block and the reference overlapping illumination block in the reference illumination block, and uses a two-dimensional function g0(i0, j0) to represent the brightness value of each pixel in the reference single illumination block to form a reference brightness first matrix; uses a two-dimensional function gz(iz, jz) to represent the brightness value of each pixel in the reference overlapping illumination block to form a reference brightness second matrix;
[0065] Step 2: The second brightness comparison strategy retrieves the illumination block to be compared corresponding to the target street lamp corresponding to the reference illumination block according to the reference illumination block, extracts the brightness value of the pixel points in the single illumination block to be compared, uses gx(ix, jx) to represent the brightness value of each pixel point in the single illumination block to be compared, and forms a first brightness matrix to be compared, and uses gy-1(iy-1, jy-1) and gy-2(iy-2, jy-2) to represent the brightness value of each pixel point in two overlapping illumination blocks to be compared, respectively, to form a second brightness matrix to be compared;
[0066] Step three: perform a difference operation on the first brightness matrix to be compared and the first reference brightness matrix. When the difference between the first brightness matrix to be compared and the first reference brightness matrix is less than the second brightness comparison threshold, and the similarity value between the two second brightness matrices to be compared in the lighting block to be compared of the target street lamp is greater than the second reference similarity value, the output monitoring result is a monitoring fault, and the fault category in the monitoring fault is a bulb damage fault of the target street lamp.
[0067] The brightness comparison module 42 is configured with a third brightness comparison strategy, the third brightness comparison strategy includes a third reference similarity value, and the third brightness comparison strategy is configured with a third brightness comparison step, which includes:
[0068] Step 1: The monitoring camera continuously obtains the image information to be compared within a preset time period, and retrieves one of the illumination blocks to be compared from the image information to be compared, extracts the brightness value of the pixel points in the single illumination block to be compared in the illumination block to be compared, and uses the function gt(ix, jx, t) to represent the brightness value of each pixel point in the reference single illumination block within the preset time to form a time brightness matrix, where t represents the preset time period;
[0069] Step 2: The third brightness comparison strategy generates a curve of the change of brightness value and preset time for each pixel point according to the time brightness matrix, and compares the similarity between the change curve of brightness value and preset time between each pixel point. When the similarity between each pixel point is greater than the third benchmark similarity value, the output monitoring result is a monitoring fault, and the fault category in the monitoring fault is abnormal flickering of the bulb of the target street lamp.
[0070] The processing end 4 is configured with an abnormality recognition module 43, and the abnormality recognition module 43 is configured with an abnormality recognition strategy. The abnormality recognition strategy is configured with a first abnormality threshold and a second abnormality threshold. The abnormality recognition strategy selects pixels with brightness values greater than the first abnormality threshold as abnormal points according to the change curve between the brightness value of each pixel point in the single illumination block to be compared of the illumination block to be compared corresponding to the target street lamp and the preset time, and generates abnormal blocks according to the abnormal points. When the area occupied by the abnormal block in the single illumination block to be compared is greater than the second abnormality threshold, the monitoring camera corresponding to the image information to be compared is determined as the compensation acquisition point according to the illumination block to be compared corresponding to the abnormal block, and a compensation monitoring task is generated, and the monitoring result is corrected according to the compensation monitoring task.
[0071] The processing end 4 is configured with a brightness value correction module 44, and the brightness value correction module 44 is configured with a brightness value correction strategy. When the block similarity value is greater than the block comparison threshold, the brightness value correction strategy generates a brightness value correction parameter according to the block similarity value between the reference illumination block and its corresponding block to be compared. The brightness value correction module 44 can correct the brightness value of the pixel points in the single illumination block to be compared according to the brightness value correction parameter, and use Gx=βgx(ix, jx) to represent the corrected brightness value of each pixel point in the single illumination block to be compared, forming a first matrix of corrected brightness to be compared, wherein β is the brightness value correction parameter;
[0072] The brightness value correction module 44 can correct the brightness value of each pixel in the overlapping illumination blocks to be compared according to the brightness value correction parameters, and respectively use Gy-1=βgy-1(iy-1, jy-1) and Gy-2=βgy-2(iy-2, jy-2) to represent the corrected brightness value of each pixel in the two overlapping illumination blocks to be compared, thereby forming a second matrix of corrected brightness to be compared.
[0073] The brightness value correction parameters are configured with random parameters, and the random parameters are set with multiple influencing factors, including the grayscale and resolution of the block to be compared, night visibility, and the distance and angle of the monitoring camera relative to the target street lamp.
[0074] The collection terminal 3 is equipped with a Bluetooth module, and the monitoring camera of the collection terminal 3 can control the on and off of the circuit of the corresponding street lamp installation scene area through the Bluetooth module.
[0075] When the area occupied by the abnormal block in the single lighting block to be compared is greater than the second abnormal threshold, the monitoring camera corresponding to the image information to be compared is determined as the compensation collection point according to the lighting block to be compared corresponding to the abnormal block, and a compensation monitoring task is generated. The monitoring camera controls the circuit on-off state of the corresponding street lamp installation scene area through the Bluetooth module, and executes the compensation monitoring task. The corrected monitoring result is obtained by screening according to the monitoring result of the compensation monitoring task.
[0076] The specific implementation of this scheme is as follows:
[0077] The remote control platform generates a fault monitoring task, and determines the monitoring section to be monitored as the monitoring target according to the fault monitoring project associated with the fault monitoring task. The monitoring camera corresponding to the monitoring target collects the illumination area image of a street lamp in the street lamp installation scene area among the street lamps it covers and generates the image information to be compared, and sends the image information to be compared to the processing end 4. When the processing end 4 receives the image information to be compared, it screens the corresponding reference scene image information from the image database 2 according to the corresponding regional positioning signal, and retrieves the reference illumination block from the reference scene image information. The block comparison strategy calculates the block similarity value between the reference illumination block and its corresponding block to be compared. When the block similarity value is less than the block comparison threshold, the monitoring result of the street lamp corresponding to the block to be compared is output as a monitoring fault; when the block similarity value is greater than the block comparison threshold, the monitoring result of the street lamp corresponding to the block to be compared is output as normal monitoring.
[0078] When the monitoring result is a monitoring fault, the processing end 4 is configured with a brightness comparison module 42, which can further determine the fault category in the monitoring fault according to the preset first brightness comparison strategy, the second brightness comparison strategy and the third brightness comparison strategy, and divide the illumination range of each street lamp into two parts, one of which is the range of illumination by itself as a single light source, corresponding to the single illumination block to be compared in the block to be compared, and the other part is the range of illumination by the target street lamp and its two adjacent street lamps as a light source, corresponding to the overlapping illumination block to be compared in the block to be compared;
[0079] When the fault category is a voltage fault, it can be obtained by comparing through the first brightness comparison strategy; the two-dimensional function g0(i0, j0) is used to represent the brightness value of each pixel in the benchmark single illumination block to form a benchmark brightness first matrix, and gx(ix, jx) is used to represent the brightness value of each pixel in the single illumination block to be compared to form a brightness first matrix to be compared, and the brightness values of each pixel in the single illumination block to be compared of each street lamp on the same monitoring section are compared and analyzed. When the difference between the brightness first matrix to be compared and the benchmark brightness first matrix is less than the first brightness comparison threshold, and the brightness values of the pixels in the single illumination block to be compared of any two street lamps on the same monitoring section are greater than the first benchmark similarity value, the output monitoring result is a monitoring fault, and the fault category is a voltage fault on the monitoring section.
[0080] When the fault category is a bulb damage fault, the second brightness comparison strategy is used for comparison; when the difference between the first brightness matrix to be compared and the first reference brightness matrix is less than the second brightness comparison threshold, and the similarity between the two second brightness matrices to be compared in the illumination block to be compared of the target street lamp is greater than the second reference similarity value, the output monitoring result is a monitoring fault, and the fault category is a bulb damage fault of the target street lamp. That is, if the brightness values of the range illuminated by the single light source of the target street lamp and the range illuminated by the two adjacent street lamps as a light source are both lower than a certain preset value, the fault category at this time is determined to be a bulb damage fault.
[0081] When the fault category is abnormal flickering of the bulb, the third brightness comparison strategy is used for comparison; specifically, the brightness values of the pixels in the single illumination block to be compared in the illumination block to be compared are extracted, and the function gt(ix, jx, t) is used to represent the brightness values of each pixel in the benchmark single illumination block within the preset time to form a time brightness matrix, and a change curve of the brightness value and the preset time of each pixel is generated according to the time brightness matrix, and the similarity between the brightness value and the preset time change curve of each pixel is compared. When the similarity between each pixel is greater than the third benchmark similarity value, the output monitoring result is a monitoring fault, and the fault category is the abnormal flickering of the bulb of the target street lamp.
[0082] At the same time, since the brightness values of the collected pixel points are affected by many factors, in order to ensure the accuracy of monitoring, the brightness value correction parameters are configured, and the influencing factors are set as random parameters in the calculation of the brightness value correction parameters, thereby improving the accuracy of monitoring.
[0083] At the same time, since the environmental range illuminated by the street lamp is dynamic and changeable, in this case, it will affect the brightness value of the pixel points within the range illuminated by the street lamp, and the main factors that affect the brightness value of the pixel points are the impact of the headlights of the vehicle passing through the environment where the street lamp is located; the impact of fallen leaves, road garbage, etc. on the brightness value of the pixel points; the impact of flying insects adhering to the street lamp on the brightness value of some pixels; therefore, an abnormal recognition module 43 is configured at the processing end 4, and the abnormal recognition module 43 can identify pixel points with abnormal brightness values and form abnormal blocks, and regenerate compensation monitoring tasks based on the abnormal blocks, and select the monitoring results when the area occupied by the abnormal blocks in the single illumination block to be compared is less than the second abnormal threshold from multiple compensation monitoring tasks as the corrected monitoring results.
[0084] The above is only an embodiment of the present invention, and the common knowledge such as the known specific structure and characteristics in the scheme is not described in detail here. It should be pointed out that for those skilled in the art, several deformations and improvements can be made without departing from the structure of the present invention, which should also be regarded as the protection scope of the present invention, and these will not affect the effect of the implementation of the present invention and the practicality of the patent. The scope of protection required by this application shall be based on the content of its claims, and the specific implementation methods and other records in the specification can be used to interpret the content of the claims.
Claims
1. A remote street lamp fault monitoring and indication system, characterized in that: include: A control end, used for generating a fault monitoring task, wherein the fault monitoring task is associated with a fault monitoring item; A collection end, wherein the collection end is configured with a plurality of collection units, and the collection units are monitoring cameras pre-installed on municipal roads; Define a plurality of street lamp installation scene areas corresponding to a monitored road section, each street lamp installation scene area corresponds to a plurality of street lamps, each street lamp is preset with a street lamp number, and the street lamp number corresponds to street lamp location information; The monitoring range of the monitoring camera covers the illumination area of all street lamps in the monitored road section, and each monitoring camera can collect an illumination area image of a street lamp in a street lamp installation scene area and generate image information to be compared; the image information to be compared includes a plurality of blocks to be compared, each block to be compared corresponds to the illumination area of each street lamp; The acquisition end is connected to the control end and is used to receive a fault monitoring task and generate an image acquisition request according to a fault monitoring item associated with the fault monitoring task; A positioning device is installed in the street lamp installation scene area, and the positioning device is configured with a positioning response module. The positioning response module responds to the acquisition end, and the positioning response module is used to receive the image acquisition request from the acquisition end and generate a regional positioning signal at the same time; An image database, corresponding to the street lamp installation scene area, is pre-set with reference scene image information and a regional positioning signal corresponding to each reference scene image information, wherein the reference scene image information includes a plurality of reference illumination blocks, and each reference illumination block corresponds to the street lamp position information of a street lamp; The processing end is connected to the acquisition end and the image database, and the processing end is capable of receiving the image information to be compared from the acquisition end; The processing end is configured with a block comparison module, and the block comparison module is configured with a block comparison strategy, and the block comparison strategy includes a block comparison threshold; when the processing end receives the image information to be compared, the corresponding reference scene image information is screened from the image database according to the corresponding regional positioning signal, and the reference illumination block is retrieved from the reference scene image information, and the block comparison strategy calculates the block similarity value between the reference illumination block and its corresponding block to be compared, and when the block similarity value is less than the block comparison threshold, the monitoring result of the street lamp corresponding to the block to be compared is output as a monitoring fault; when the block similarity value is greater than the block comparison threshold, the monitoring result of the street lamp corresponding to the block to be compared is output as normal monitoring; The image block to be compared includes a plurality of illumination blocks to be compared, wherein the illumination blocks are a single illumination block to be compared and an overlapping illumination block to be compared, wherein the single illumination block to be compared corresponds to a single illumination area of each street lamp, and the overlapping illumination blocks to be compared are set to two and symmetrically arranged on both sides of the single illumination block to be compared, and the overlapping illumination blocks to be compared correspond to the overlapping illumination areas of two adjacent street lamps; Each reference illumination block includes a reference single illumination block and a reference overlapping illumination block, wherein the reference single illumination block corresponds to the single illumination block to be compared, and the reference overlapping illumination block corresponds to the overlapping illumination block to be compared; The fault indication terminal is connected to the processing terminal, and is used to receive the monitoring fault results from the processing terminal, generate fault indication information according to the monitoring fault results, and send the fault indication information to the operator, wherein the fault indication information includes the street lamp number, street lamp location information and fault category.
2. A remote street lamp fault monitoring and indicating system according to claim 1, characterized in that: The processing end is configured with a brightness comparison module, and the brightness comparison module is configured with a first brightness comparison strategy, and the first brightness comparison strategy includes a first brightness comparison threshold and a first reference similarity value; The first brightness comparison strategy is configured with a first brightness comparison step, which includes: Step 1: The processing end receives the image information to be compared, selects the corresponding reference scene image information from the image database according to the corresponding regional positioning signal, and retrieves the reference single illumination block in any reference illumination block from the reference scene image information, extracts the brightness value of the pixel in the reference single illumination block, and uses a two-dimensional function g0(i0, j0) to represent the brightness value of each pixel in the reference single illumination block to form a reference brightness first matrix, wherein i0 is the horizontal coordinate of the pixel in the reference single illumination block, and j0 is the vertical coordinate of the pixel in the reference single illumination block; Step 2: The first brightness comparison strategy extracts the brightness values of the pixels in the single illumination block to be compared, and uses gx(ix, jx) to represent the brightness values of the pixels in the single illumination block to be compared, forming a first brightness matrix to be compared, wherein ix is the horizontal coordinate of the pixel in the single illumination block to be compared, and jx is the vertical coordinate of the pixel in the single illumination block to be compared; Step three: perform a difference operation on the first brightness matrix to be compared and the first reference brightness matrix. When the difference between the first brightness matrix to be compared and the first reference brightness matrix is less than the first brightness comparison threshold, and the brightness values of the pixel points in the single illumination block to be compared of any two street lamps on the same monitored section are greater than the first reference similarity value, the output monitoring result is a monitoring fault, and the fault category in the monitoring fault is the voltage fault of the monitored section.
3. A remote street lamp fault monitoring and indicating system according to claim 2, characterized in that: The brightness comparison module is configured with a second brightness comparison strategy, wherein the second brightness comparison strategy includes a second brightness comparison threshold and a second reference similarity value; The second brightness comparison strategy is configured with a second brightness comparison step, which includes: Step 1: The processing end receives the image information to be compared, selects the corresponding reference scene image information from the image database according to the corresponding regional positioning signal, and retrieves one of the reference illumination blocks from the reference scene image information, respectively extracts the brightness values of the pixels in the reference single illumination block and the reference overlapping illumination block in the reference illumination block, and uses a two-dimensional function g0(i0, j0) to represent the brightness value of each pixel in the reference single illumination block to form a reference brightness first matrix; uses a two-dimensional function gz(iz, jz) to represent the brightness value of each pixel in the reference overlapping illumination block to form a reference brightness second matrix; Step 2: The second brightness comparison strategy retrieves the illumination block to be compared corresponding to the target street lamp corresponding to the reference illumination block according to the reference illumination block, extracts the brightness value of the pixel points in the single illumination block to be compared, uses gx(ix, jx) to represent the brightness value of each pixel point in the single illumination block to be compared, and forms a first brightness matrix to be compared, and uses gy-1(iy-1, jy-1) and gy-2(iy-2, jy-2) to represent the brightness value of each pixel point in two overlapping illumination blocks to be compared, respectively, to form a second brightness matrix to be compared; Step three: perform a difference operation on the first brightness matrix to be compared and the first reference brightness matrix. When the difference between the first brightness matrix to be compared and the first reference brightness matrix is less than the second brightness comparison threshold, and the similarity value between the two second brightness matrices to be compared in the lighting block to be compared of the target street lamp is greater than the second reference similarity value, the output monitoring result is a monitoring fault, and the fault category in the monitoring fault is the bulb damage fault of the target street lamp.
4. A remote street lamp fault monitoring and indicating system according to claim 3, characterized in that: The brightness comparison module is configured with a third brightness comparison strategy, the third brightness comparison strategy includes a third reference similarity value, and the third brightness comparison strategy is configured with a third brightness comparison step, which includes: Step 1: The monitoring camera continuously obtains the image information to be compared within a preset time period, and retrieves one of the illumination blocks to be compared from the image information to be compared, extracts the brightness value of the pixel points in the single illumination block to be compared in the illumination block to be compared, and uses the function gt(ix, jx, t) to represent the brightness value of each pixel point in the reference single illumination block within the preset time to form a time brightness matrix, where t represents the preset time period; Step 2: The third brightness comparison strategy generates a change curve of the brightness value and the preset time for each pixel point according to the time brightness matrix, and compares the similarity between the brightness value and the preset time change curve between each pixel point. When the similarity between each pixel point is greater than the third benchmark similarity value, the output monitoring result is a monitoring fault, and the fault category in the monitoring fault is the abnormal flickering of the bulb of the target street lamp.
5. A remote street lamp fault monitoring and indicating system according to claim 4, characterized in that: The processing end is configured with an abnormality recognition module, and the abnormality recognition module is configured with an abnormality recognition strategy. The abnormality recognition strategy is configured with a first abnormality threshold and a second abnormality threshold. The abnormality recognition strategy selects pixel points with brightness values greater than the first abnormality threshold as abnormal points according to a change curve between the brightness values of each pixel point in the single illumination block to be compared of the illumination block to be compared corresponding to the target street lamp and the preset time, and generates abnormal blocks according to the abnormal points. When the area occupied by the abnormal block in the single illumination block to be compared is greater than the second abnormality threshold, the monitoring camera corresponding to the image information to be compared is determined as a compensation acquisition point according to the illumination block to be compared corresponding to the abnormal block, and multiple compensation monitoring tasks are generated, and the monitoring result when the area occupied by the abnormal block in the single illumination block to be compared is less than the second abnormality threshold is selected as the corrected monitoring result.
6. A remote street lamp fault monitoring and indicating system according to claim 2 or 3, characterized in that: The processing end is configured with a brightness value correction module, and the brightness value correction module is configured with a brightness value correction strategy. When the block similarity value is greater than the block comparison threshold, the brightness value correction strategy generates a brightness value correction parameter according to the block similarity value of the reference illumination block and its corresponding block to be compared. The brightness value correction module can correct the brightness value of the pixel points in the single illumination block to be compared according to the brightness value correction parameter, and adopts Gx=βgx(ix, jx) to represent the corrected brightness value of each pixel point in the single illumination block to be compared, so as to form a first matrix of corrected brightness to be compared, wherein β is the brightness value correction parameter; The brightness value correction module can correct the brightness value of each pixel in the overlapping illumination blocks to be compared according to the brightness value correction parameters, and respectively use Gy-1=βgy-1(iy-1, jy-1) and Gy-2=βgy-2(iy-2, jy-2) to represent the corrected brightness value of each pixel in the two overlapping illumination blocks to be compared, thereby forming a second matrix of corrected brightness to be compared.
7. A remote street lamp fault monitoring and indicating system according to claim 6, characterized in that: The brightness value correction parameter is configured with a random parameter, and the random parameter is set with multiple influencing factors, and the influencing factors include the grayscale and resolution of the block to be compared, night visibility, and the distance and angle of the monitoring camera relative to the target street lamp.
8. A remote street lamp fault monitoring and indicating system according to claim 5, characterized in that: The acquisition end is configured with a Bluetooth module, and the monitoring camera of the acquisition end can control the on and off of the circuit of the corresponding street lamp installation scene area through the Bluetooth module.
9. A remote street lamp fault monitoring and indicating system according to claim 8, characterized in that: When the area occupied by the abnormal block in the single lighting block to be compared is greater than the second abnormal threshold, the monitoring camera corresponding to the image information to be compared is determined as the compensation collection point according to the lighting block to be compared corresponding to the abnormal block, and a compensation monitoring task is generated. The monitoring camera controls the circuit on-off state of the corresponding street lamp installation scene area through the Bluetooth module to reset, and executes the compensation monitoring task. The corrected monitoring result is obtained by screening according to the monitoring result of the compensation monitoring task.
Citation Information
Patent Citations
Street lamp control method and device
CN103391674A
Urban street light state monitoring method and device
CN107231738A