Video analysis system fusing multi-parameter Internet of Things and artificial intelligence

Abstract

The invention provides a video analysis system fusing multi-parameter Internet of Things and artificial intelligence, and relates to a data processing technology. A control module is used for controlling a mobile acquisition device to acquire a target hidden danger area within a preset acquisition range of a target power transmission line; determining a monitoring point location of the fixed acquisition device based on the target hidden danger area and a fixed object in the target power transmission line; the analysis module is used for responding to the fracture early warning information, analyzing a ponding area in a monitoring video acquired by a fixed acquisition device corresponding to the monitoring point, and generating a ponding external expansion area; the determination module is used for obtaining a hidden danger prohibited area according to the target hidden danger area when determining that the current meteorological data meets the early warning monitoring condition; and the broadcasting module is used for obtaining an early warning area according to the accumulated water external expansion area and the hidden danger prohibition area, and generating and broadcasting a feature matching statement according to an early warning slot position customization strategy and the personnel features of the entering personnel when determining that the entering personnel exist in the early warning area.

Description

Technical Field

[0001] The present invention relates to data processing technology, and in particular to a video analysis system integrating multi-parameter Internet of Things and artificial intelligence. Background Art

[0002] Multiparameter refers to statistical and analytical methods that consider multiple parameters or variables at the same time. By analyzing multiple parameters simultaneously, researchers can gain a deeper understanding of the data and identify patterns that may not be obvious when examining a single variable alone. Therefore, it can be applied to the analysis of hazards during severe weather.

[0003] At present, in typhoon weather, due to excessive wind and rainfall, dangerous areas such as fallen trees and waterlogging that affect personal safety are prone to occur. Due to the lack of appropriate early warning methods, casualties may occur. The traditional early warning method is to identify potential safety hazards through manual inspections or prompt personnel to take emergency avoidance measures. However, manual inspections face risks to personal safety and it is difficult to obtain hidden danger information over a large area in a timely manner, resulting in the inability to issue early warnings and avoid accidents when safety hazards occur.

[0004] Therefore, how to conduct large-scale monitoring in severe weather, provide timely warnings to personnel, reduce personal injuries in typhoon weather, and improve personnel safety has become an urgent problem that needs to be solved. Summary of the invention

[0005] The present invention provides a video analysis system integrating multi-parameter Internet of Things and artificial intelligence, which can perform large-scale monitoring in severe weather, provide early warning prompts to personnel in a timely manner, reduce personal injuries in typhoon weather, and improve personal safety.

[0006] A first aspect of the present invention provides a video analysis system integrating multi-parameter Internet of Things and artificial intelligence, comprising: A control module, used to control the mobile acquisition device to acquire a target hidden danger area within a preset acquisition range of the target transmission line, and determine the monitoring point position of the fixed acquisition device based on the target hidden danger area and the fixed objects in the target transmission line; An analysis module is used to respond to the fracture warning information, analyze the waterlogging area in the monitoring video collected by the fixed collection device corresponding to the monitoring point, and generate the waterlogging expansion area; A determination module, used to determine that when the current meteorological data meets the early warning monitoring conditions, obtain the hidden danger prohibited area according to the target hidden danger area; The broadcast module is used to obtain the warning area based on the water expansion area and the hidden danger prohibited area. When it is determined that there is a person entering the warning area, a feature matching statement is generated and broadcast according to the warning slot customization strategy and the personal characteristics of the entering person.

[0007] Optionally, in a possible implementation manner of the first aspect, controlling the mobile acquisition device to acquire a target hidden danger area within a preset acquisition range of a target transmission line, and determining a monitoring point position of a fixed acquisition device based on the target hidden danger area and a fixed object in the target transmission line, includes: Control the mobile acquisition device to acquire a target hidden danger area within a preset acquisition range of the target transmission line, and determine the geographic information coordinates of the center point of the target hidden danger area as the hidden danger coordinates; Obtaining the geographic information coordinates corresponding to the fixed object in the target transmission line as the fixed coordinates, taking the fixed coordinates as the center of a circle and the preset monitoring distance as the radius, to obtain a fixed monitoring area corresponding to the fixed object; Taking the hidden danger coordinates within the fixed monitoring area as the first hidden danger coordinates, and taking the remaining hidden danger coordinates as the second hidden danger coordinates; When it is determined that the first hidden danger coordinates exist in the fixed monitoring area, the fixed coordinates corresponding to the fixed monitoring area are used as the inherent monitoring point position of the first hidden danger coordinates; Determining an additional monitoring point position of the second hidden danger coordinate according to the preset monitoring distance and the second hidden danger coordinate; The monitoring points of the fixed data collection device are obtained according to the inherent monitoring points and the additional monitoring points.

[0008] Optionally, in a possible implementation manner of the first aspect, determining, according to the preset monitoring distance and the second hidden danger coordinates, an additional monitoring point position of the second hidden danger coordinates includes: Acquire a sub-line between adjacent fixtures in the target transmission line, intercept both sides of the sub-line based on the preset monitoring distance to obtain a sub-line to be divided, and acquire the distance of the sub-line to be divided to obtain a distance to be divided; Retrieving a reference division distance and a reference division number corresponding to the reference division distance, and obtaining a division coefficient corresponding to the sub-line to be divided according to a ratio of the distance to be divided and the reference division distance; Based on the product of the division coefficient and the reference division number, obtaining the sub-division number corresponding to the sub-line to be divided; Evenly divide the sub-circuit to be divided according to the number of sub-divisions to obtain a plurality of divided circuits corresponding to the sub-circuit to be divided; Acquire the second hidden danger coordinates within the preset collection range corresponding to the divided line as the combined hidden danger coordinates; According to the combined hidden danger coordinates and the preset planned distance, the additional monitoring point position corresponding to the second hidden danger coordinates of the divided route is determined.

[0009] Optionally, in a possible implementation manner of the first aspect, determining, according to the combined hidden danger coordinates and the preset planned distance, additional monitoring points corresponding to the second hidden danger coordinates of the divided route includes: Performing mean calculation based on the maximum longitude coordinate and the minimum longitude coordinate in the combined hidden danger coordinates to obtain a fused longitude coordinate, and performing mean calculation based on the maximum latitude coordinate and the minimum latitude coordinate in the combined hidden danger coordinates to obtain a fused latitude coordinate; Obtaining fusion center coordinates according to the fusion longitude coordinates and the fusion latitude coordinates; Based on the maximum longitude coordinate, the maximum latitude coordinate, the minimum longitude coordinate and the minimum latitude coordinate in the combined hidden danger coordinate, construct a hidden danger rectangular area corresponding to the divided line; Obtain any shortest side length in the hidden danger rectangular area as the planned side length, determine the side length center point of the planned side length, connect the side length center point with the coordinate point of the fusion center coordinate, and generate a planned straight line; Determine a direction from the coordinate point of the fusion center coordinates to the center point of the side length along the planning straight line as the planning direction; Taking the center point of the side length as the starting point, based on the planned direction and the preset planned distance, determine the additional monitoring points of the combined hidden danger coordinates.

[0010] Optionally, in a possible implementation manner of the first aspect, the responding to the fracture warning information and analyzing the waterlogged area in the monitoring video collected by the fixed collection device at the monitoring point to generate the waterlogged expansion area includes: Retrieving the line pixel value corresponding to the target power transmission line, and determining the line pixel point in the monitoring video collected by the fixed collection device corresponding to the monitoring point based on the line pixel value; Obtaining the standard number of sub-lines corresponding to the corresponding monitoring points, counting the adjacent line pixel points in the monitoring video to obtain multiple line sets, and obtaining the number of the line sets as the actual number; When it is determined that the actual number is greater than the standard number, the current moment is taken as the fracture moment, and in response to the fracture warning information, the moment before the fracture moment is obtained as the non-fracture moment; Acquire the image of the monitoring video as the fractured image based on the fractured moment, and retrieve the image of the monitoring video as the unfractured image according to the unfractured moment; Acquire the image center points of the broken image and the unbroken image, and perform coordinate processing on the broken image and the unbroken image based on the image center points; Counting the coordinates of the adjacent pixel points of the line in the unbroken image to obtain a plurality of unbroken coordinate sets, and counting the coordinates of the adjacent pixel points of the line in the broken image to obtain a plurality of broken coordinate sets; When it is determined that the broken coordinate set is inconsistent with the unbroken coordinate set, taking the sub-route corresponding to the broken coordinate set as the broken route; Acquire the power transmission direction corresponding to the corresponding monitoring point, determine the corresponding broken line as a conductive line based on the power transmission direction, and determine the remaining broken lines as non-conductive lines; The water accumulation area in the fracture image is analyzed according to the conductive line to generate a water accumulation expansion area.

[0011] Optionally, in a possible implementation manner of the first aspect, analyzing the water accumulation area in the fracture image according to the conductive line to generate the water accumulation outward expansion area includes: Selecting a coordinate point on the boundary line of the broken image in the conductive circuit as a starting coordinate point, selecting a coordinate point on the other side of the conductive circuit as an ending coordinate point, and selecting a coordinate point corresponding to a middle position of the conductive circuit as an intermediate coordinate point; Calculate according to the starting coordinate point, the ending coordinate point and the intermediate coordinate point to obtain the extension center corresponding to the conductive line; Calculate the slope according to the end coordinate point and the center of the extension circle to obtain a first slope of the line connecting the end coordinate point and the center of the extension circle; Determine a second slope perpendicular to the first slope based on the first slope, and perform calculation according to the second slope and the end coordinate point to obtain an extended tangent line; Taking the target hidden danger area with water accumulation as the water accumulation area, determining the water accumulation area where the extended tangent line in the fracture image is located as the predicted impact area, and obtaining the contour of the predicted impact area as the initial contour based on OpenCV; Acquire a transmission voltage corresponding to the target transmission line, and obtain a voltage influence coefficient based on a ratio of the transmission voltage to a reference voltage; Retrieving a reference influence distance corresponding to the reference voltage, and obtaining an actual influence distance corresponding to the transmission voltage according to the product of the reference influence distance and the voltage influence coefficient; Acquire contour pixel points and contour center points of the initial contour, connect the contour center point with each of the contour pixel points in sequence, and obtain a voltage influence positioning line; Determine a direction from the contour center point to the contour pixel point along the voltage impact positioning line as an impact direction; Taking the contour pixel point as a starting point, moving the contour pixel point based on the actual impact distance and the impact direction to obtain an impact pixel point, and connecting adjacent impact pixel points to obtain a voltage impact contour; An area between the voltage impact contour and the initial contour is determined as a water accumulation expansion area.

[0012] Optionally, in a possible implementation manner of the first aspect, when determining that the current meteorological data meets the early warning monitoring condition, obtaining the hidden danger prohibited area according to the target hidden danger area includes: Acquiring current meteorological data, wherein the current meteorological data includes current wind speed and current rainfall; When it is determined that the current meteorological data is greater than or equal to the preset meteorological data, the remaining target hidden danger areas outside the waterlogged area are regarded as hidden danger prohibited areas.

[0013] Optionally, in a possible implementation of the first aspect, obtaining a warning area according to the water expansion area and the hidden danger prohibited area, and determining that a person has entered the warning area, generating a feature matching statement and broadcasting it according to a warning slot customization strategy and the person characteristics of the entering person, including: Obtaining a warning area based on the water expansion area and the hidden danger prohibited area, and identifying the personal characteristics of the entering person when it is determined that there is a person entering the warning area, wherein the personal characteristics include necessary characteristics and non-essential characteristics, the necessary characteristics include clothing color, and the non-essential characteristics include one or more of the gender of the person and the items held by the person; Retrieving a preset number of fixed warning slots, and sequentially filling the preset morphemes in the preset fixed sentences into the fixed warning slots; Acquire the number of descriptive morphemes corresponding to the necessary features as the necessary number, and determine the number of descriptive morphemes corresponding to the non-essential features as the non-essential number; In response to the selection information of the fixed warning slot by the analysis end, the corresponding fixed warning slot is used as the selected slot, and a necessary number of necessary slots and a non-necessary number of non-necessary slots are constructed in front of the selected slot; The description morphemes corresponding to the necessary features are sequentially filled into the necessary slots, and the description morphemes corresponding to the non-essential features are sequentially filled into the non-essential slots, and a feature matching sentence is generated and broadcasted.

[0014] Optionally, in a possible implementation of the first aspect, the method further includes: When it is determined that there is a person in the surveillance video corresponding to the fixed acquisition device, the corresponding person is used as a person to be analyzed, and the current time is obtained as the entry time; Acquire the distance between the person to be analyzed and the warning area in real time, and when it is determined that the distance is less than or equal to the preset analysis distance, acquire the image corresponding to the surveillance video based on the entry moment as the initial position image, and acquire the image corresponding to the surveillance video at the next moment after the entry moment as the walking position image; Acquire the image center points of the initial position image and the walking position image as analysis midpoints, and perform coordinate processing on the initial position image and the walking position image based on the analysis midpoints; Determine a first walking coordinate of the person to be analyzed in the initial position image, and a second walking coordinate of the person to be analyzed in the walking position image; According to the second walking coordinates and the first walking coordinates, a walking vector corresponding to the person to be analyzed is obtained, and the walking vector is decomposed to obtain a lateral walking direction corresponding to a lateral walking line segment and a longitudinal walking direction corresponding to a longitudinal walking line segment; Extending the transverse walking line segment based on the transverse walking direction to obtain an extended transverse walking straight line, and extending the longitudinal walking line segment based on the longitudinal walking direction to obtain an extended longitudinal walking straight line; When it is determined that the extended horizontal walking straight line or the extended vertical walking straight line intersects with the warning area, prediction warning information is generated and broadcasted.

[0015] Optionally, in a possible implementation of the first aspect, the method further includes: In response to the change information of the predicted impact area by the management end, the waterlogged area is determined as the selected impact area.

[0016] According to a third aspect of the present invention, there is provided an electronic device, comprising: a memory, a processor and a computer program, wherein the computer program is stored in the memory, and the processor runs the computer program to execute the first aspect of the present invention and various methods that may be involved in the first aspect.

[0017] According to a fourth aspect of the present invention, a storage medium is provided, in which a computer program is stored. When the computer program is executed by a processor, it is used to implement the first aspect of the present invention and various methods that may be involved in the first aspect.

[0018] The beneficial effects of the present invention are as follows: 1. The present invention can conduct large-scale monitoring in severe weather, provide early warnings to personnel in a timely manner, reduce personnel injuries in typhoon weather, and improve personnel safety. First, the present invention can control the mobile acquisition device to determine the target hidden danger area within the corresponding area, so as to prioritize the monitoring points of the fixed acquisition device according to the target hidden danger area, so that the target hidden danger area can be monitored in real time by the fixed acquisition device at the corresponding position, thereby achieving timely early warning and improving the safety of personnel in extreme weather. Secondly, the present invention can respond to the fracture early warning information and analyze the waterlogged area in the monitoring video to obtain the waterlogged expansion area. At the same time, the hidden danger prohibited area is determined according to the current meteorological data, and the early warning area is obtained, which is convenient for the subsequent identification of whether there are people entering and leaving the early warning area, so that targeted early warning broadcasts can be made in time through the identified personnel characteristics to improve the effectiveness and response speed of the early warning information, so that people can quickly move away from the dangerous area.

[0019] 2. The present invention divides the target transmission line into fine divisions, thereby determining the corresponding monitoring points, so as to improve the coverage and accuracy of monitoring and reduce safety accidents caused by monitoring blind spots. Among them, the mobile acquisition device can be controlled and combined with the geographic information coordinates to identify the hidden danger areas around the transmission line, and the target transmission line can be divided according to the preset monitoring distance. At the same time, the corresponding monitoring points are determined in combination with the target hidden danger areas to ensure that under extreme weather conditions, potential dangerous areas can be dynamically covered and identified. In addition, the present invention can analyze the waterlogged areas in the monitoring video, generate the waterlogged expansion area, and improve the prediction ability of potential electric shock hazards. By calculating the voltage influence range of the broken line, the early warning area can be dynamically adjusted to ensure that personnel in the conductive risk area can receive early warning prompts in time, which greatly improves the safety of personnel in emergency situations.

[0020] 3. The present invention can provide personalized early warnings, so as to provide targeted early warning prompts to personnel and improve their response speed. Among them, the present invention can identify personnel characteristics through monitoring videos, so as to add personnel characteristic information to the broadcast sentence, generate characteristic matching sentences for early warning prompts, and improve the response speed of personnel through customized early warning information, so as to enhance the personnel's response ability under extreme weather conditions. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 A schematic diagram of the structure of a video analysis system integrating multi-parameter Internet of Things and artificial intelligence provided by the present invention; Figure 2 A schematic diagram of determining the standard number of sub-lines corresponding to monitoring points provided by the present invention; Figure 3 A schematic diagram of a conductive circuit and a non-conductive circuit provided by the present invention; Figure 4 A schematic diagram of the hardware structure of an electronic device provided by the present invention. DETAILED DESCRIPTION

[0022] The technical solution of the present invention is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0023] like Figure 1 As shown, the present invention provides a video analysis system integrating multi-parameter Internet of Things and artificial intelligence, comprising: S1, a control module, is used to control a mobile acquisition device to acquire a target hidden danger area within a preset acquisition range of a target transmission line, and determine a monitoring point position of a fixed acquisition device based on the target hidden danger area and fixed objects in the target transmission line.

[0024] It should be noted that in typhoon weather, due to the surge in wind and rainfall, transmission lines are easily broken and fall into water-logged areas. When people enter the electric shock range, electric shock accidents may occur. At the same time, when people are in an emergency to avoid wind and rain, they may hide under trees or transformer boxes with a shielding effect, which may cause tree collapse or transformer leakage causing casualties, increasing the probability of safety accidents. Therefore, in order to reduce casualties in typhoon weather, transmission lines and surrounding areas can be monitored so that early warnings can be issued to personnel in a timely manner to facilitate personnel to avoid dangerous areas, reduce the occurrence of dangerous accidents, and improve safety in typhoon weather.

[0025] It can be understood that the control module controls the mobile collection device to collect data so as to determine the monitoring points corresponding to the fixed collection device, so as to facilitate subsequent large-scale monitoring. The mobile collection device is a data collection device that can be moved, such as a drone. The target transmission line is the target line for data collection. The preset collection range is the pre-set area for data collection, such as a range extending a certain distance to both sides of the transmission line. The target hidden danger area is a hidden danger area where dangerous accidents may occur, such as a waterlogged area, a tree-covered area, etc. The fixed object is an object that fixes the transmission line, such as a telephone pole or a line tower. The fixed collection device is a collection device at a fixed position, such as a camera, and the monitoring point is a location point for video monitoring.

[0026] In some embodiments, the specific implementation of step S1 (the control of the mobile acquisition device to obtain the target hidden danger area within the preset acquisition range of the target transmission line, and the determination of the monitoring point position of the fixed acquisition device based on the target hidden danger area and the fixed objects in the target transmission line) includes: S11, controlling the mobile acquisition device to acquire a target hidden danger area within a preset acquisition range of the target transmission line, and determining the geographic information coordinates of the center point of the target hidden danger area corresponding to the area as the hidden danger coordinates.

[0027] It should be noted that since the target transmission line corresponds to a long distance and the number of target hidden danger areas corresponding to accumulated water or trees is large, but the shooting resolution of the acquisition device is limited, it is necessary to monitor the target transmission line in sections according to the geographical location corresponding to the target hidden danger area, so that the target hidden danger area can be obtained, and the corresponding hidden danger coordinates can be determined, so as to subsequently obtain the monitoring points corresponding to the fixed acquisition device, and realize comprehensive monitoring of the target transmission line and the corresponding acquisition range, so as to improve the efficiency of subsequent early warning prompts.

[0028] It can be understood that the regional center point is the center point position corresponding to the target hidden danger area, the geographic information coordinates are the longitude and latitude coordinates corresponding to the geographic location, and the hidden danger coordinates are the coordinates of the center point position corresponding to the target hidden danger area, such as the geographic coordinates of the accumulated water area and the geographic coordinates of the area where trees are located.

[0029] It is not difficult to understand that the geographic information coordinates corresponding to the target hidden danger area can be directly determined by the geographic positioning system (Beidou positioning system) on the drone to determine the geographical location coordinates corresponding to the trees, accumulated water, and poles.

[0030] S12, obtaining geographic information coordinates corresponding to the fixed object in the target transmission line as fixed coordinates, taking the fixed coordinates as the center of a circle and a preset monitoring distance as the radius, to obtain a fixed monitoring area corresponding to the fixed object.

[0031] It can be understood that since the shooting distance of the fixed collection device is limited, in order to clearly monitor information through the fixed collection device, the position point corresponding to the fixed coordinate can be used as the center of the circle, and the preset monitoring distance can be used as the radius to determine the fixed monitoring area that can be monitored when the fixed collection device is installed corresponding to each fixed object.

[0032] Among them, the fixed coordinates are the geographic information coordinates corresponding to the fixed objects, for example, they can be the geographic longitude and latitude coordinates corresponding to the tower, the preset monitoring distance is the distance that can be monitored by the pre-set fixed collection equipment, and the fixed monitoring area is the monitoring area corresponding to the position of each fixed object.

[0033] S13, taking the hidden danger coordinates within the fixed monitoring area as the first hidden danger coordinates, and taking the remaining hidden danger coordinates as the second hidden danger coordinates.

[0034] It can be understood that the first hidden danger coordinates are the hidden danger coordinates corresponding to the fixed monitoring area, and the second hidden danger coordinates are the coordinates corresponding to the hidden danger area that is not in the fixed monitoring area.

[0035] Through the above implementation, the hidden danger coordinates of the target hidden danger area can be divided according to the relative position with the fixed monitoring area, so as to subsequently determine whether a fixed acquisition device needs to be installed in the corresponding fixed monitoring area for monitoring and early warning.

[0036] S14, when it is determined that the first hidden danger coordinates are within the fixed monitoring area, the fixed coordinates corresponding to the fixed monitoring area are used as the inherent monitoring point positions of the first hidden danger coordinates.

[0037] It is understandable that each fixed object (pole tower) can determine the corresponding fixed monitoring area. However, there may be no target hidden danger areas such as stagnant water or trees in the corresponding fixed monitoring area, that is, there are no areas with safety hazards in the corresponding fixed monitoring area. Therefore, it is not necessary to install a fixed collection device on the corresponding fixed object. The fixed collection device can be installed only on the fixed object corresponding to the target hidden danger area in the fixed monitoring area, so as to select a suitable location to install the monitoring equipment, and at the same time facilitate the subsequent reduction of the data processing amount of the collected data.

[0038] Among them, the inherent monitoring point is a location point in the fixed monitoring area with the first hidden danger coordinates where the fixed collection device is installed, that is, the location corresponding to the geographic information coordinates of the corresponding fixed object.

[0039] Through the above implementation, inherent monitoring points can be determined, so that fixed collection devices can be installed at the determined inherent monitoring points later.

[0040] S15: Determine an additional monitoring point position of the second hidden danger coordinate according to the preset monitoring distance and the second hidden danger coordinate.

[0041] It is understandable that since the distance between two adjacent fixed objects may be long, the remaining lines can be divided according to the preset monitoring distance, and the monitoring points that need to be added in the middle of the transmission line can be determined by the second hidden danger coordinates, so as to achieve comprehensive monitoring of the target transmission line.

[0042] Among them, the additional monitoring points are the monitoring points added in the middle of the transmission lines.

[0043] In some embodiments, a specific implementation of step S15 (determining the additional monitoring point of the second hidden danger coordinate according to the preset monitoring distance and the second hidden danger coordinate) includes: S151, obtaining a sub-line between adjacent fixed objects in the target transmission line, intercepting both sides of the sub-line based on the preset monitoring distance to obtain a sub-line to be divided, and obtaining a distance of the sub-line to be divided to obtain a distance to be divided.

[0044] It should be noted that since the sub-line between adjacent fixed objects has a line length corresponding to the preset monitoring distance corresponding to the fixed object, it is necessary to intercept both sides of the sub-line in order to obtain accurate sub-lines to be divided, and then obtain the corresponding distance to be divided, so as to subsequently calculate the corresponding number of sub-divisions and perform line division.

[0045] It can be understood that a subline is a section of a transmission line between adjacent fixtures in a target transmission line, a subline to be divided is a section of a line to be divided, that is, the remaining line after cutting off both sides of the subline, and a distance to be divided is the distance of the subline to be divided.

[0046] S152, retrieve a reference division distance and a reference division number corresponding to the reference division distance, and obtain a division coefficient corresponding to the sub-line to be divided according to a ratio of the distance to be divided and the reference division distance.

[0047] It can be understood that the benchmark division distance is a preset benchmark distance for line division, which can be preset manually, and the benchmark division number is the number of divisions corresponding to the benchmark division distance, which can be preset manually, for example, it can be divided 3 times every 600 meters, that is, when the benchmark division distance is 600 meters, the corresponding benchmark division number is 3 times.

[0048] The division coefficient is the coefficient value of the number of sub-divisions calculated for the sub-line to be divided, that is, the ratio of the distance to be divided to the reference division distance.

[0049] Through the above implementation, the corresponding division coefficient can be determined, so as to be subsequently multiplied with the reference division number to determine the sub-division number.

[0050] S153, obtaining the sub-division number corresponding to the sub-line to be divided based on the product of the division coefficient and the reference division number.

[0051] It can be understood that the number of sub-divisions is the number of divisions of the sub-circuit to be divided, that is, the product of the division coefficient and the reference division number.

[0052] S154, evenly divide the sub-circuit to be divided according to the number of sub-divisions to obtain a plurality of divided circuits corresponding to the sub-circuit to be divided.

[0053] It can be understood that, after receiving the number of sub-divisions, the sub-circuits to be divided can be evenly divided, thereby obtaining a plurality of divided circuits after segmentation.

[0054] The divided line is the line segment after the sub-line to be divided is divided.

[0055] Through the above implementation, the present invention can obtain multiple divided lines corresponding to the sub-lines to be divided, so as to subsequently determine corresponding additional monitoring points according to the divided lines.

[0056] S155, obtaining the second hidden danger coordinates within the preset collection range corresponding to the divided line as the combined hidden danger coordinates.

[0057] It is understandable that, according to the divided routes, the second hidden danger coordinates within the preset collection range corresponding to each divided route are determined, so as to determine whether there are hidden danger areas requiring early warning in a certain area around each divided route for monitoring.

[0058] The combined hidden danger coordinates are the second hidden danger coordinates within the preset collection range corresponding to the divided line.

[0059] S156, determining the additional monitoring point position corresponding to the second hidden danger coordinate of the divided route according to the combined hidden danger coordinate and the preset planned distance.

[0060] It can be understood that in order to facilitate the installation of fixed collection devices at multiple additional monitoring points, all target hidden danger areas can be clearly monitored, so that the appropriate additional monitoring points corresponding to each divided line can be determined based on the combined hidden danger coordinates and the preset planned distance.

[0061] Among them, the preset planning distance is a pre-set planning distance for determining additional monitoring points.

[0062] In some embodiments, the specific implementation of step S156 (determining the additional monitoring point corresponding to the second hidden danger coordinate of the divided route according to the combined hidden danger coordinate and the preset planned distance) includes: S1561, performing mean calculation based on the maximum longitude coordinate and the minimum longitude coordinate in the combined hidden danger coordinates to obtain fused longitude coordinates, and performing mean calculation based on the maximum latitude coordinate and the minimum latitude coordinate in the combined hidden danger coordinates to obtain fused latitude coordinates.

[0063] It can be understood that by calculating the fused longitude coordinates and the fused latitude coordinates in the combined hidden danger coordinates, the rectangular area corresponding to the combined hidden danger coordinates can be determined based on the fused longitude coordinates and the fused latitude coordinates, thereby facilitating the subsequent determination of appropriate additional monitoring points.

[0064] Among them, the fused longitude coordinate is the coordinate obtained by averaging the maximum longitude coordinate and the minimum longitude coordinate, the fused latitude coordinate is the coordinate obtained by averaging the maximum latitude coordinate and the minimum latitude coordinate, the maximum longitude coordinate is the maximum value corresponding to the longitude coordinate in the combined hidden danger coordinate, the minimum longitude coordinate is the minimum value corresponding to the longitude coordinate in the combined hidden danger coordinate, the maximum latitude coordinate is the maximum value corresponding to the latitude coordinate in the combined hidden danger coordinate, and the minimum latitude coordinate is the minimum value corresponding to the latitude coordinate in the combined hidden danger coordinate.

[0065] S1562: Obtain fusion center coordinates according to the fused longitude coordinates and the fused latitude coordinates.

[0066] It can be understood that the fusion center coordinates are the coordinates of the center position corresponding to the combined hidden danger coordinates, that is, the center coordinates obtained by combining the fused longitude coordinates and the fused latitude coordinates. For example, when the fused longitude coordinate is 10 and the fused latitude coordinate is 20, the corresponding fusion center coordinates are (10, 20).

[0067] S1563: Construct a hidden danger rectangular area corresponding to the divided line based on the maximum longitude coordinate, the maximum latitude coordinate, the minimum longitude coordinate and the minimum latitude coordinate in the combined hidden danger coordinates.

[0068] It should be noted that in order to determine the location areas where multiple hidden danger areas are concentrated, so that the subsequent determination of additional monitoring points is more reasonable, the corresponding fixed collection devices can fully monitor all hidden danger areas corresponding to the corresponding divided lines. Therefore, the corresponding hidden danger rectangular area can be constructed according to the maximum longitude coordinate, maximum latitude coordinate, minimum longitude coordinate and minimum latitude coordinate of the corresponding coordinates of the hidden danger area.

[0069] It can be understood that a straight line parallel to the longitude axis can be drawn according to the maximum longitude coordinate and the minimum longitude coordinate, and a straight line parallel to the latitude axis can be drawn according to the maximum latitude coordinate and the minimum latitude coordinate, that is, the area enclosed by the four straight lines is the hidden danger rectangular area corresponding to the divided line.

[0070] Among them, the hidden danger rectangular area is the largest rectangular area corresponding to the combined hidden danger coordinates.

[0071] S1564, obtaining any shortest side length in the hidden danger rectangular area as the planning side length, and determining the side length center point of the planning side length, connecting the side length center point with the coordinate point of the fusion center coordinate to generate a planning straight line.

[0072] It can be understood that the planned side length is the reference side length for determining the location of the additional monitoring points, that is, the short side corresponding to the hidden danger rectangular area, the side length center point is the center point corresponding to the planned side length, and the planned straight line is the reference straight line corresponding to the planned additional monitoring points, that is, the straight line passing through the side length center point and the fusion center coordinates.

[0073] It is not difficult to understand that when the short side corresponding to the hidden danger rectangular area is selected as the planned side length, the subsequently installed fixed collection device can be on the side of the short side, so that the fixed collection device can shoot and monitor all hidden danger areas at the minimum angle to prevent the fixed collection device from missing the monitoring area due to the large collection angle corresponding to the fixed collection device.

[0074] S1565: Determine the direction along the planning straight line from the coordinate point of the fusion center coordinate to the center point of the side length as the planning direction.

[0075] It can be understood that the planning direction is the determined direction of the planned additional monitoring points, that is, the coordinate point of the fusion center coordinate points to the direction of the center point of the side length.

[0076] S1566, taking the center point of the side length as the starting point, based on the planned direction and the preset planned distance, determine the additional monitoring points of the combined hidden danger coordinates.

[0077] It can be understood that the corresponding additional monitoring points are determined according to the planned direction by moving the preset planned distance along the planned straight line with the center point of the side length as the starting point, so that fixed collection devices can be installed at the corresponding additional monitoring points for monitoring and early warning.

[0078] S16, obtaining the monitoring points of the fixed data collection device according to the inherent monitoring points and the additional monitoring points.

[0079] It can be understood that the monitoring points are the locations where fixed data collection devices monitor the potential hazard areas, including inherent monitoring points and additional monitoring points.

[0080] Through the above implementation, the present invention can determine all monitoring points corresponding to the fixed collection device, so as to subsequently install the fixed collection device at the corresponding point, and monitor and warn the corresponding potential danger areas in real time under severe environments to improve personnel safety.

[0081] S2, an analysis module, is used to respond to the fracture warning information, analyze the waterlogging area in the monitoring video collected by the fixed collection device corresponding to the monitoring point, and generate the waterlogging expansion area.

[0082] It should be noted that when a line breaks and a section of the line falls into a flooded area, due to the conductive effect of the accumulated water, there will be a risk of electric shock in a certain area extending outward from the point of fall. Therefore, in order to improve the safety of people in extreme weather, the flooded area can be analyzed to determine the corresponding area of ​​expanded water and to provide timely warnings to passers-by.

[0083] It can be understood that the analysis module is a module for analyzing data information, the water accumulation area is an area with water accumulation, and the water accumulation outward expansion area is an area that expands outward according to the water accumulation.

[0084] In some embodiments, the specific implementation of step S2 (the step of responding to the fracture warning information, analyzing the waterlogged area in the monitoring video collected by the fixed collection device corresponding to the monitoring point, and generating the waterlogged expansion area) includes: S21, retrieve the line pixel value corresponding to the target power transmission line, and determine the line pixel point in the monitoring video collected by the fixed collection device corresponding to the monitoring point based on the line pixel value.

[0085] It can be understood that in order to determine whether the monitored target transmission line is broken, the line in the monitoring video can be identified and analyzed in real time. Moreover, since the target transmission line has a corresponding color, the position or connection relationship of the corresponding pixel points of the same line pixel values ​​before and after in the video can be used to determine whether the target transmission line is broken.

[0086] The line pixel value is the pixel value corresponding to the target transmission line, for example, it may be black, and the line pixel point is the pixel point corresponding to the target transmission line in the monitoring video.

[0087] S22, obtaining the standard number of sub-lines corresponding to the corresponding monitoring points, counting the adjacent line pixel points in the monitoring video to obtain multiple line sets, and obtaining the number of the line sets as the actual number.

[0088] It should be noted that the number of sub-lines in the line segments corresponding to the target transmission line at different locations may be different. Figure 2 As shown, the number of wires from tower 1 to tower 2 can be 3 in parallel to transmit electric energy, and the standard number of sub-lines at the corresponding monitoring point is 3. The number of wires from tower 2 to tower 3 can be 4 in parallel to transmit electric energy, and the standard number of sub-lines at the corresponding monitoring point is 4. Therefore, in order to improve the accuracy of the analysis results of whether the line is broken at each monitoring point, the standard number of sub-lines corresponding to each monitoring point can be obtained first, which facilitates the subsequent quantitative analysis based on the line set.

[0089] It can be understood that the standard number is the number of sub-lines corresponding to the monitoring point under normal conditions, the line set is the set of adjacent line pixel points, and the actual number is the number of wire segments currently appearing in the monitoring video, that is, the number of corresponding line sets in the monitoring video.

[0090] S23, when it is determined that the actual number is greater than the standard number, the current moment is taken as the fracture moment, and in response to the fracture warning information, the moment before the fracture moment is obtained as the non-fracture moment.

[0091] It can be understood that when a line is broken, the corresponding line becomes two sections. Therefore, if the actual number is greater than the standard number, it can be said that the current sub-line is broken, and the current moment corresponding to the monitoring video can be used as the breaking moment to respond to the fracture warning information, so as to carry out subsequent danger warning through monitoring and improve personnel safety.

[0092] The rupture time is the time when the sub-circuit is ruptured, and the non-rupture time is the time when the sub-circuit is not ruptured, that is, the time before the rupture time.

[0093] S24, acquiring an image of the monitoring video as a fractured image based on the fractured moment, and retrieving an image of the monitoring video as an unfractured image according to the unfractured moment.

[0094] It can be understood that the broken image is a monitoring video image corresponding to when the line is broken, and the unbroken image is a monitoring video image corresponding to when the line is not broken.

[0095] It is not difficult to understand that the present invention can obtain a broken image and an unbroken image, so as to subsequently compare and analyze the information in the broken image and the unbroken image, thereby determining a specific broken sub-circuit.

[0096] S25, acquiring the image center points of the broken image and the unbroken image, and performing coordinate processing on the broken image and the unbroken image based on the image center points.

[0097] It can be understood that the center point corresponding to each image is obtained through the existing technology OpenCV, so that the broken image and the unbroken image can be coordinate processed according to the center point of the image, so that the position of each pixel point can be determined according to the coordinates later, and the coordinate set can be obtained for comparison and analysis.

[0098] The image center point is the center position point corresponding to the image.

[0099] It is not difficult to understand that the image can be coordinate processed by establishing two vertical straight lines with the center point of the image as the origin.

[0100] S26, counting the coordinates of the adjacent line pixel points in the unbroken image to obtain a plurality of unbroken coordinate sets, and counting the coordinates of the adjacent line pixel points in the broken image to obtain a plurality of broken coordinate sets.

[0101] It can be understood that the unbroken coordinate set is a set of adjacent line pixel points in the unbroken image, and the broken coordinate set is a set of coordinates of adjacent line pixel points in the broken image.

[0102] It is not difficult to understand that, since there may be multiple sub-lines, the resulting coordinate sets are also multiple accordingly.

[0103] Through the above implementation, the present invention can obtain an unbroken coordinate set and a broken coordinate set for subsequent comparison, thereby improving the accuracy of determining the sub-line break.

[0104] S27, when it is determined that the broken coordinate set is inconsistent with the unbroken coordinate set, the sub-route corresponding to the broken coordinate set is used as the broken route.

[0105] It can be understood that when the fracture coordinate set is compared with all fracture coordinate sets, it is determined that there is no unbroken coordinate set consistent with the fracture coordinate set, then it can be explained that the corresponding fracture coordinate set is the coordinate set determined after the sub-line is broken, and then the sub-line corresponding to the fracture coordinate set can be used as a fracture line.

[0106] The broken line is a sub-line where a line break occurs.

[0107] It is not difficult to understand that due to the influence of wind in typhoon weather, the line may shake. Therefore, when comparing the coordinate sets, an error within a certain range is allowed. That is, when the difference between the coordinates of the corresponding pixel points in the broken coordinate set and the unbroken coordinate set is less than or equal to the preset difference, it can be judged that the sub-lines are consistent. When the coordinates of the corresponding pixel points exceed the preset difference, it can be determined that the coordinates in the broken coordinate set and the unbroken coordinate set are inconsistent, where the preset difference is a deviation threshold set artificially in advance.

[0108] S28, obtaining the power transmission direction corresponding to the corresponding monitoring point, determining the corresponding broken line as a conductive line based on the power transmission direction, and determining the remaining broken lines as non-conductive lines.

[0109] It should be noted that if Figure 3As shown, when a sub-line breaks, the corresponding sub-line can be divided into two sections. Since the power transmission is unidirectional, only the broken line connected to the power generation has the risk of conductivity. Therefore, in order to improve the accuracy of judging the conductive area, the corresponding conductive line and non-conductive line can be determined according to the transmission direction, so as to facilitate the subsequent identification of the corresponding water accumulation area according to the conductive line for analysis, and obtain the water accumulation expansion area, so as to facilitate the subsequent early warning prompts to personnel.

[0110] It can be understood that the transmission direction is the direction of transmission of the power transmitted by the line, for example, it can be from left to right, the conductive line is a broken line with conductive function, and the non-conductive line is a broken line with no conductive risk.

[0111] S29, analyzing the water accumulation area in the fracture image according to the conductive line to generate a water accumulation expansion area.

[0112] It is understandable that the water accumulation area where the conductive line falls in the fracture image is analyzed to generate the corresponding water accumulation expansion area, so as to improve the timeliness of early warning prompts and enhance the safety of personnel.

[0113] In some embodiments, a specific implementation of step S29 (analyzing the water accumulation area in the fracture image according to the conductive line to generate the water accumulation outward expansion area) includes: S2901, selecting a coordinate point on the boundary line of the broken image in the conductive circuit as a starting coordinate point, a coordinate point on the other side of the conductive circuit as an ending coordinate point, and selecting a coordinate point corresponding to a middle position of the conductive circuit as an intermediate coordinate point.

[0114] It should be noted that when it is windy, the corresponding broken line may swing continuously with the wind. Therefore, the path trend of the line falling can be determined by obtaining the starting coordinate point, ending coordinate point and intermediate coordinate point corresponding to the conductive line in the broken image. In addition, the starting coordinate point, ending coordinate point and intermediate coordinate point are the corresponding position points of the line on the same side, so as to determine the water accumulation area where the broken line may fall, thereby improving the early warning efficiency.

[0115] It can be understood that the starting coordinate point is the coordinate point of the conductive line corresponding to the boundary line in the fracture image, the ending coordinate point is the coordinate point on one side of the conductive line fracture, and the middle coordinate point is the coordinate point corresponding to the middle position of the conductive line.

[0116] S2902, performing calculation according to the starting coordinate point, the ending coordinate point and the intermediate coordinate point to obtain an extension center point corresponding to the conductive line.

[0117] It can be understood that when the conductive line falls, the corresponding path is approximately circular, so the coordinates of the three points can be obtained, and according to the calculation formula of the circle Determining the center of the conductive line corresponding to the falling path facilitates the subsequent determination of the tangent corresponding to the broken line based on the corresponding center of the circle, thereby improving the accuracy of determining the location of the waterlogged area.

[0118] Among them, the center of the extended circle is the center of the falling circular trend path corresponding to the conductive line.

[0119] S2903: Calculate the slope according to the end coordinate point and the center of the extension circle to obtain a first slope of a line connecting the end coordinate point and the center of the extension circle.

[0120] It is understandable that a straight line can be determined between two points, and thus the slope of the corresponding straight line can also be determined according to the coordinates of the two positions. For example, the coordinates of the corresponding two positions are substituted into The corresponding slope value can be calculated.

[0121] The first slope is the slope of the line corresponding to the end coordinate point and the center of the extended circle.

[0122] S2904: Determine a second slope perpendicular to the first slope based on the first slope, and perform calculation according to the second slope and the end coordinate point to obtain an extended tangent.

[0123] It can be understood that the product of the slopes between two mutually perpendicular straight lines is -1, so the second slope of the corresponding perpendicular straight line can be determined based on the first slope, and then the extended tangent can be determined by the second slope and the terminal coordinate point, that is, a straight line passing through the terminal coordinate point is made as the extended tangent based on the second slope, so as to facilitate the subsequent determination of the water accumulation area where the corresponding broken line may fall based on the extended tangent, and timely provide early warning prompts to personnel.

[0124] The second slope is the slope corresponding to the extended tangent line, that is, the slope perpendicular to the straight line with the first slope, and the extended tangent line is the tangent line extended through the terminal coordinate point.

[0125] S2905, taking the target hidden danger area with water accumulation as the water accumulation area, determining the water accumulation area where the extended tangent line in the fracture image is located as the predicted impact area, and obtaining the contour of the predicted impact area as the initial contour based on OpenCV.

[0126] It should be noted that since the broken line is long, the falling path corresponding to the broken line will not form a complete circle. Therefore, the position where one end of the line falls on the ground is likely to be the area passed by the extended tangent. Therefore, the corresponding water accumulation area can be determined as the predicted image area, so that the corresponding water accumulation expansion area can be determined according to the predicted impact area, so that when people may step into the corresponding area, early warning prompts can be given to improve personnel safety.

[0127] It can be understood that the predicted affected area is the area predicted to be affected by the conductivity, that is, the water accumulation area where the extended tangent line is located in the fracture image, and the initial contour is the contour of the predicted affected area.

[0128] S2906: Obtain a transmission voltage corresponding to the target transmission line, and obtain a voltage influence coefficient based on a ratio of the transmission voltage to a reference voltage.

[0129] It is understandable that the voltages corresponding to different transmission lines are different, and the corresponding conductive influence ranges are also inconsistent, that is, the larger the voltage, the larger the conductive range after the drop, and the smaller the voltage, the smaller the conductive range after the drop. Therefore, the transmission voltage can be obtained to subsequently determine the influence range corresponding to the broken line.

[0130] Among them, the transmission voltage is the voltage value transmitted by the target transmission line, such as 220V, 10KV, etc. The reference voltage is the reference voltage value for determining the impact range, which can be preset manually. The voltage impact coefficient is the impact degree coefficient of the transmission voltage corresponding to the target transmission line, that is, the ratio of the transmission voltage to the reference voltage.

[0131] S2907, retrieve a reference influence distance corresponding to the reference voltage, and obtain an actual influence distance corresponding to the transmission voltage according to a product of the reference influence distance and the voltage influence coefficient.

[0132] It can be understood that the reference impact distance is the range distance of the reference voltage, for example, it can be 1 meter, and the actual impact distance is the distance where the corresponding broken line actually produces conductive impact, that is, the product of the reference impact distance and the voltage impact coefficient.

[0133] Through the above implementation mode, the present invention can obtain the actual impact distance, so as to subsequently expand the predicted impact area, thereby obtaining the outward expansion area of ​​the accumulated water, so as to facilitate the subsequent timely early warning reminders to personnel and improve the safety of personnel in extreme weather.

[0134] S2908, obtaining contour pixel points and contour center points of the initial contour, and connecting the contour center point with each of the contour pixel points in sequence to obtain a voltage influence positioning line.

[0135] It can be understood that the contour pixel point is the pixel point corresponding to the initial contour, the contour center point is the center position point of the area corresponding to the initial contour, and the voltage impact positioning line is the position marking line of the corresponding impact range of the transmission voltage.

[0136] It is not difficult to understand that after obtaining the contour pixel points and contour center point of the initial contour, the contour center point and each contour pixel point can be connected to determine the voltage influence positioning line in a radial form, that is, one end of multiple voltage influence positioning lines is connected to the contour center point.

[0137] S2909: Determine a direction from the contour center point to the contour pixel point along the voltage impact positioning line as an impact direction.

[0138] It can be understood that the influence direction is the diffusion direction of the conductive influence generated by the fracture voltage, that is, the direction from the contour center point to the contour pixel point.

[0139] S2910, taking the contour pixel point as a starting point, moving the contour pixel point based on the actual impact distance and the impact direction to obtain an impact pixel point, and connecting adjacent impact pixel points to obtain a voltage impact contour.

[0140] It can be understood that the affected pixel point is the pixel point corresponding to the farthest distance affected by the conductive influence of the line, that is, the pixel point determined after the contour pixel point moves the actual influence distance, and the voltage influence contour is the contour of the area where the transmission voltage can produce a conductive influence, that is, the contour determined after connecting adjacent influenced pixel points.

[0141] It is not difficult to understand that since the influencing pixel points are obtained by moving the contour pixel points corresponding to the initial contour along a certain direction, the contour shape subsequent to connecting adjacent influencing pixel points is consistent with the initial contour shape.

[0142] S2911, determining an area between the voltage impact contour and the initial contour as a water accumulation expansion area.

[0143] It can be understood that the area between the voltage impact contour and the initial contour is a diffusion area corresponding to the water accumulation area with a risk of electric shock, that is, the water accumulation outward expansion area.

[0144] Through the above implementation mode, the present invention can determine the area where the accumulated water expands, so that when a fixed collection device is subsequently used to monitor that a person may pass through the area, a timely warning can be given to avoid electric shock accidents and improve personnel safety.

[0145] S3, a determination module, is used to determine that when the current meteorological data meets the early warning monitoring conditions, a hidden danger prohibited area is obtained according to the target hidden danger area.

[0146] It should be noted that under normal meteorological conditions, dangerous accidents usually do not occur in the corresponding target hidden danger areas. Therefore, only when it is determined that the current meteorological area meets the early warning monitoring conditions, for example, the wind speed is too high and the rainfall exceeds the safe range, it can be said that the probability of dangerous accidents in the current weather is relatively high, and it is necessary to designate the more dangerous areas as hidden danger prohibited areas so that the hidden danger prohibited areas can be monitored in real time, and personnel can be reminded in time to enter or stay away, thereby improving personnel safety.

[0147] It can be understood that the determination module is a calculation module for determining the hidden danger prohibited area, the current meteorological data is the meteorological data corresponding to the current moment, and the early warning monitoring condition is the meteorological condition for turning on early warning monitoring. For example, when the wind speed is greater than the preset wind speed value and the rainfall is greater than the preset rainfall, it can be said that the current meteorological data meets the early warning monitoring conditions, and the hidden danger prohibited area is an area with safety hazards and prohibited from passing.

[0148] In some embodiments, the specific implementation of step S3 (when determining that the current meteorological data meets the early warning monitoring condition, obtaining the hidden danger prohibited area according to the target hidden danger area) includes: S31, obtaining current meteorological data, where the current meteorological data includes current wind speed and current rainfall.

[0149] It can be understood that the current meteorological data includes the current wind speed and the current rainfall, wherein the current wind speed is the wind speed corresponding to the current moment, and the current rainfall is the rainfall corresponding to the current moment.

[0150] It is not difficult to understand that by obtaining the current wind speed and the current rainfall, it is convenient to subsequently determine when the early warning monitoring conditions are met, so as to conduct timely monitoring and analysis and thus issue early warning prompts.

[0151] S32, when it is determined that the current meteorological data is greater than or equal to the preset meteorological data, the remaining target hidden danger areas outside the waterlogged area are regarded as hidden danger prohibited areas.

[0152] It can be understood that when it is determined that the current meteorological data is greater than or equal to the preset meteorological data, it can be said that the current meteorological conditions are relatively bad and safety accidents are prone to occur. For example, trees are prone to collapse. When people go to trees to take shelter from the rain, they are easily hit by trees and cause casualties. Therefore, the remaining target hidden danger areas outside the waterlogged areas can be designated as hidden danger prohibited areas to remind people not to go there, thereby improving personnel safety.

[0153] S4, a broadcast module, is used to obtain a warning area based on the water expansion area and the hidden danger prohibited area, and when it is determined that there is a person entering the warning area, generate a feature matching statement and broadcast it according to the warning slot customization strategy and the personal characteristics of the entering person.

[0154] It should be noted that when monitoring detects that a person has entered the warning area, a report can be made based on the feature matching statement. For example, a report can be made that a man holding a black umbrella should stay away from the tree area, so that the corresponding person can be specifically prompted to stay away, thereby improving the efficiency of personnel responding to the warning report and achieving timely evacuation.

[0155] It can be understood that the broadcast module is a module for monitoring and warning broadcasts, so as to remind people to stay away from dangerous areas. The warning area is an area where there is danger and warning is required, including areas where water accumulation and hidden dangers are prohibited. The feature matching statement is a broadcast statement that matches the personal characteristics of the people entering.

[0156] In some embodiments, the specific implementation method of step S4 (obtaining the warning area according to the water expansion area and the hidden danger prohibited area, and determining that there is a person entering the warning area, generating a feature matching statement and broadcasting it according to the warning slot customization strategy and the personnel characteristics of the entering person) includes: S41, obtaining a warning area based on the water expansion area and the hidden danger prohibited area, and when determining that there is a person entering the warning area, identifying the personal characteristics of the entering person, the personal characteristics include necessary characteristics and non-essential characteristics, the necessary characteristics include clothing color, and the non-essential characteristics include one or more of the person's gender and handheld items.

[0157] It is understandable that areas with potential dangers are all used as warning areas, and the characteristic information of personnel is identified at the same time, so that when personnel are monitored entering the warning area, targeted broadcast prompts can be made based on the characteristics of the personnel, thereby enhancing the response speed of the personnel.

[0158] Among them, personnel characteristics are characteristic information of personnel entering the warning area, including necessary characteristics and non-essential characteristics. Among them, necessary characteristics are characteristics that can be clearly determined, such as the color of personnel's clothes, and non-essential characteristics are characteristic information for auxiliary warning prompts, such as personnel's gender, handheld items, etc.

[0159] S42, calling a preset number of fixed warning slots, and filling the preset morphemes in the preset fixed sentences into the fixed warning slots in sequence.

[0160] It can be understood that the preset number is the preset number of slots, the fixed warning slots are the fixed warning information filling slots, and the preset morphemes are the text elements in the preset broadcast sentences. For example, when the preset broadcast sentence is please leave in time, the corresponding "please", "and", "time", "far" and "leave" are preset morphemes, so that the corresponding preset morphemes can be filled in the corresponding fixed warning slots in sequence for subsequent warning broadcast prompts.

[0161] S43, obtaining the number of description morphemes corresponding to the necessary features as the necessary number, and determining the number of description morphemes corresponding to the non-essential features as the non-essential number.

[0162] It is understandable that when the corresponding personnel characteristics are identified, the determined characteristics need to be described in order to be reported. For example, when the corresponding entering person's pants are blue and he is holding a black umbrella, the description sentence corresponding to the necessary characteristics can be obtained as blue pants, so the necessary number can be obtained as 4. At the same time, the description sentence corresponding to the non-essential characteristics is holding a black umbrella, and the non-essential number can be obtained as 6.

[0163] The description morphemes are text elements in the description sentence of the corresponding features, the necessary number is the number of description morphemes corresponding to the necessary features, and the non-necessary number is the number of description morphemes corresponding to the non-necessary features.

[0164] Through the above implementation, the present invention can determine the corresponding necessary quantity and non-necessary quantity, so as to subsequently add corresponding slots according to the necessary quantity and non-necessary quantity, and then fill in the corresponding description morphemes, so as to generate feature matching sentences and then broadcast prompts.

[0165] S44, in response to the selection information of the fixed warning slot by the analysis end, the corresponding fixed warning slot is used as the selected slot, and a necessary number of necessary slots and a non-necessary number of non-necessary slots are constructed in front of the selected slot.

[0166] It is understandable that in order to make the semantics and word order of the generated feature matching sentence correct, it is possible to respond to the selected information of the analysis end and determine the selected slot so that the corresponding necessary features and non-essential features can be added to the corresponding preset fixed sentence.

[0167] Among them, the analysis end is the information terminal of the personnel who conduct monitoring and analysis, the selected information is the trigger operation information of the selected fixed warning slot, the selected slot is the selected fixed warning slot, the necessary operation is to fill the slot with necessary features, and the non-essential feature is to fill the slot with non-essential features.

[0168] For example, when the morphemes sequentially filled in the fixed warning slots are "Please leave in time", when the analysis end selects the fixed warning slot corresponding to "person", the slot is a selection slot.

[0169] S45, filling the description morphemes corresponding to the necessary features into the necessary slots in sequence, and filling the description morphemes corresponding to the non-essential features into the non-essential slots in sequence, generating a feature matching sentence and broadcasting it.

[0170] It can be understood that the descriptive morphemes of the necessary features are filled in the necessary operations in sequence, and at the same time, the descriptive morphemes corresponding to the non-essential features are filled in the non-essential slots in sequence, so that the feature matching sentences of the early warning broadcast can be generated. For example, blue pants and holding a black umbrella are filled in the corresponding slots to obtain the feature matching sentence of "Please stay away in time if you are wearing blue pants and holding a black umbrella", and the report is made according to the feature matching sentence, so as to prompt people to evacuate in a targeted manner.

[0171] It should be noted that when a person has not yet reached the warning area, a prediction can be made based on the person's walking path so that the person can be warned in advance, thereby keeping the person away from the warning area and improving the safety of the person. Therefore, in some embodiments, the following is also included: A1, when it is determined that there is a person in the surveillance video corresponding to the fixed collection device, the corresponding person is used as the person to be analyzed, and the current time is obtained as the entry time.

[0172] It can be understood that when it is determined that a person appears in the surveillance video of the fixed collection device, it can be said that the corresponding person may pass through the warning area and has a certain probability of danger. Therefore, the corresponding person can be used as the person to be analyzed, and the current time can be obtained as the entry time, so as to predict the walking path of the person and give an early warning.

[0173] The personnel to be analyzed are those who need to undergo path analysis in the monitoring and collection area, and the entry time is the current time when the personnel are being monitored.

[0174] A2, obtaining the distance between the person to be analyzed and the warning area in real time, and when it is determined that the distance is less than or equal to the preset analysis distance, obtaining the image corresponding to the surveillance video based on the entry moment as the initial position image, and obtaining the image corresponding to the surveillance video at the next moment after the entry moment as the walking position image.

[0175] It can be understood that the interval distance is the interval distance between the person to be analyzed and the warning area, the preset analysis distance is a preset benchmark analysis distance, which can be preset manually, the initial position image is the image corresponding to the moment when the person enters in the surveillance video, and the walking position image is the video frame image corresponding to the next moment after the person enters in the surveillance video.

[0176] It is not difficult to understand that when the separation distance is greater than the preset analysis distance, it can indicate that the corresponding person is far away from the warning area and the corresponding walking path changes greatly. When the separation distance is less than or equal to the preset analysis distance, it is possible to enter the warning area. Therefore, when it is determined that the separation distance is less than or equal to the preset analysis distance, the corresponding initial position image and walking position image can be obtained to improve the accuracy of subsequent analysis results.

[0177] A3, obtaining the image center points of the initial position image and the walking position image as analysis midpoints, and performing coordinate processing on the initial position image and the walking position image based on the analysis midpoints.

[0178] It can be understood that the initial position image and the walking position image are both video frame images in the surveillance video, so the corresponding image specifications and sizes are the same. Therefore, the corresponding image center point can be obtained so that the image can be coordinate-processed with the analysis midpoint as the origin of the coordinate system, so that the coordinates of the corresponding positions of the two images are the same, which is convenient for subsequent analysis and comparison.

[0179] The analysis midpoint is the image center point corresponding to the initial position image and the walking position image.

[0180] A4, determining the first walking coordinates of the person to be analyzed in the initial position image and the second walking coordinates of the person to be analyzed in the walking position image.

[0181] It can be understood that the coordinate position of the person in the continuous images can be used to determine the walking direction of the person, so as to facilitate the prediction of the walking path of the person.

[0182] The first walking coordinates are the coordinates corresponding to the person to be analyzed in the initial position image, and the second walking coordinates are the coordinates of the position of the person to be analyzed in the walking position image.

[0183] A5. Obtain a walking vector corresponding to the person to be analyzed according to the second walking coordinates and the first walking coordinates, and decompose the walking vector to obtain a lateral walking direction corresponding to a lateral walking line segment and a longitudinal walking direction corresponding to a longitudinal walking line segment.

[0184] It is understandable that when the person to be analyzed changes his walking path and moves in the process of walking diagonally, he usually moves to both sides of the original walking direction, and there will be no large change in distance in an instant. Therefore, the acquired walking vector can be decomposed to obtain two walking directions, so that the person's path can be predicted based on the horizontal walking direction and the vertical walking direction, so that the person can be warned in time and can quickly move away from the dangerous area.

[0185] The walking vector is a vector in the image corresponding to the walking path of the person to be analyzed, that is, the distance and direction can be determined. The lateral walking direction is the walking direction corresponding to the horizontal direction, and the longitudinal walking direction is the walking direction corresponding to the vertical direction.

[0186] A6, extending the lateral walking line segment based on the lateral walking direction to obtain an extended lateral walking straight line, and extending the longitudinal walking line segment according to the longitudinal walking direction to obtain an extended longitudinal walking straight line.

[0187] It can be understood that the transverse walking line segment is the walking path line segment corresponding to the horizontal direction, the transverse walking straight line is the extended transverse walking line, the longitudinal walking line segment is the walking path line segment corresponding to the vertical direction, and the longitudinal walking straight line is the longitudinal straight line obtained after extension.

[0188] Through the above implementation, the present invention can determine the horizontal walking line and the vertical walking line to determine whether there is a risk of a person passing through the warning area.

[0189] A7, when it is determined that the extended horizontal walking straight line or the extended vertical walking straight line intersects with the warning area, predictive warning information is generated and broadcasted.

[0190] It can be understood that when the horizontal walking line or the vertical walking line intersects with the warning area, it can be said that the corresponding person is at risk of passing through the warning area, and corresponding predictive warning information can be generated and a warning broadcast can be made so that the person can be reminded in advance and stay away from the dangerous area in time to improve personal safety.

[0191] In some embodiments, it also includes: B1, responding to the change information of the predicted impact area by the management end, determining the waterlogged area as the selected impact area.

[0192] It is understandable that personnel can independently analyze and judge the predicted impact area based on experience, and thus change the selection of the waterlogging area to obtain the selected impact area, so as to delete the currently determined predicted impact area, and then subsequently analyze and judge the corresponding selected impact area to determine the corresponding waterlogging expansion area. The implementation method for determining the waterlogging expansion area is the same as the above steps S2906 to S2910, and will not be repeated here.

[0193] See also Figure 4 , is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present invention, the electronic device 40 includes: a processor 41, a memory 42 and a computer program; wherein The memory 42 is used to store the computer program, and the memory may also be a flash memory. The computer program is, for example, an application program, a functional module, etc. for implementing the above method.

[0194] The processor 41 is used to execute the computer program stored in the memory to implement each step performed by the device in the above method. For details, please refer to the relevant description in the above method embodiment.

[0195] Optionally, the memory 42 may be independent or integrated with the processor 41 .

[0196] When the memory 42 is a device independent of the processor 41, the device may further include: The bus 43 is used to connect the memory 42 and the processor 41 .

[0197] The present invention also provides a readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, it is used to implement the methods provided by the various embodiments described above.

[0198] Among them, the readable storage medium can be a computer storage medium or a communication medium. The communication medium includes any medium that facilitates the transmission of a computer program from one place to another. The computer storage medium can be any available medium that can be accessed by a general-purpose or special-purpose computer. For example, a readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application-specific integrated circuit (Application Specific Integrated Circuits, referred to as: ASIC). In addition, the ASIC can be located in a user device. Of course, the processor and the readable storage medium can also exist in a communication device as discrete components. The readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0199] The present invention also provides a program product, which includes an execution instruction, which is stored in a readable storage medium. At least one processor of a device can read the execution instruction from the readable storage medium, and at least one processor executes the execution instruction so that the device implements the methods provided in the above various embodiments.

[0200] In the embodiments of the above-mentioned devices, it should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the present invention may be directly implemented as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.

[0201] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A video analysis system integrating multi-parameter IoT and artificial intelligence, characterized in that: include: A control module, used to control the mobile acquisition device to acquire a target hidden danger area within a preset acquisition range of the target transmission line, and determine a monitoring point position of the fixed acquisition device based on the target hidden danger area and fixed objects in the target transmission line; An analysis module is used to respond to the fracture warning information, analyze the waterlogging area in the monitoring video collected by the fixed collection device corresponding to the monitoring point, and generate the waterlogging expansion area; A determination module, used to determine that when the current meteorological data meets the early warning monitoring conditions, obtain the hidden danger prohibited area according to the target hidden danger area; The broadcast module is used to obtain the warning area based on the water expansion area and the hidden danger prohibited area. When it is determined that there is a person entering the warning area, a feature matching statement is generated and broadcast according to the warning slot customization strategy and the personal characteristics of the entering person.

2. The system according to claim 1, characterized in that The controlling of the mobile acquisition device to acquire a target hidden danger area within a preset acquisition range of the target transmission line, and determining a monitoring point position of the fixed acquisition device based on the target hidden danger area and fixed objects in the target transmission line, comprises: Control the mobile acquisition device to acquire a target hidden danger area within a preset acquisition range of the target transmission line, and determine the geographic information coordinates of the center point of the target hidden danger area as the hidden danger coordinates; Obtaining the geographic information coordinates corresponding to the fixed object in the target transmission line as the fixed coordinates, taking the fixed coordinates as the center of a circle and the preset monitoring distance as the radius, to obtain a fixed monitoring area corresponding to the fixed object; Taking the hidden danger coordinates within the fixed monitoring area as the first hidden danger coordinates, and taking the remaining hidden danger coordinates as the second hidden danger coordinates; When it is determined that the first hidden danger coordinates exist in the fixed monitoring area, the fixed coordinates corresponding to the fixed monitoring area are used as the inherent monitoring point positions of the first hidden danger coordinates; Determining an additional monitoring point position of the second hidden danger coordinate according to the preset monitoring distance and the second hidden danger coordinate; The monitoring points of the fixed data collection device are obtained according to the inherent monitoring points and the additional monitoring points.

3. The system according to claim 2, characterized in that The step of determining the additional monitoring point position of the second hidden danger coordinate according to the preset monitoring distance and the second hidden danger coordinate includes: Acquire a sub-line between adjacent fixtures in the target transmission line, intercept both sides of the sub-line based on the preset monitoring distance to obtain a sub-line to be divided, and acquire the distance of the sub-line to be divided to obtain a distance to be divided; Retrieving a reference division distance and a reference division number corresponding to the reference division distance, and obtaining a division coefficient corresponding to the sub-line to be divided according to a ratio of the distance to be divided and the reference division distance; Based on the product of the division coefficient and the reference division number, obtaining the sub-division number corresponding to the sub-line to be divided; Evenly divide the sub-circuit to be divided according to the number of sub-divisions to obtain a plurality of divided circuits corresponding to the sub-circuit to be divided; Acquire the second hidden danger coordinates within the preset collection range corresponding to the divided line as the combined hidden danger coordinates; According to the combined hidden danger coordinates and the preset planned distance, the additional monitoring point position corresponding to the second hidden danger coordinates of the divided route is determined.

4. The system according to claim 3, characterized in that The step of determining the additional monitoring point corresponding to the second hidden danger coordinate of the divided route according to the combined hidden danger coordinate and the preset planned distance includes: Performing mean calculation based on the maximum longitude coordinate and the minimum longitude coordinate in the combined hidden danger coordinates to obtain a fused longitude coordinate, and performing mean calculation based on the maximum latitude coordinate and the minimum latitude coordinate in the combined hidden danger coordinates to obtain a fused latitude coordinate; Obtaining fusion center coordinates according to the fusion longitude coordinates and the fusion latitude coordinates; Based on the maximum longitude coordinate, the maximum latitude coordinate, the minimum longitude coordinate and the minimum latitude coordinate in the combined hidden danger coordinate, construct a hidden danger rectangular area corresponding to the divided line; Obtain any shortest side length in the hidden danger rectangular area as the planned side length, determine the side length center point of the planned side length, connect the side length center point with the coordinate point of the fusion center coordinate, and generate a planned straight line; Determine a direction from the coordinate point of the fusion center coordinates to the center point of the side length along the planning straight line as the planning direction; Taking the center point of the side length as the starting point, based on the planned direction and the preset planned distance, determine the additional monitoring points of the combined hidden danger coordinates.

5. The system according to claim 1, characterized in that The responding to the fracture warning information, analyzing the waterlogged area in the monitoring video collected by the fixed collection device corresponding to the monitoring point, and generating the waterlogged expansion area, includes: Retrieving the line pixel value corresponding to the target power transmission line, and determining the line pixel point in the monitoring video collected by the fixed collection device corresponding to the monitoring point based on the line pixel value; Obtaining the standard number of sub-lines corresponding to the corresponding monitoring points, counting the adjacent line pixel points in the monitoring video to obtain multiple line sets, and obtaining the number of the line sets as the actual number; When it is determined that the actual number is greater than the standard number, the current moment is taken as the fracture moment, and in response to the fracture warning information, the moment before the fracture moment is obtained as the non-fracture moment; Acquire the image of the monitoring video as the fractured image based on the fractured moment, and retrieve the image of the monitoring video as the unfractured image according to the unfractured moment; Acquire the image center points of the broken image and the unbroken image, and perform coordinate processing on the broken image and the unbroken image based on the image center points; Counting the coordinates of the adjacent pixel points of the line in the unbroken image to obtain a plurality of unbroken coordinate sets, and counting the coordinates of the adjacent pixel points of the line in the broken image to obtain a plurality of broken coordinate sets; When it is determined that the broken coordinate set is inconsistent with the unbroken coordinate set, taking the sub-route corresponding to the broken coordinate set as the broken route; Acquire the power transmission direction corresponding to the corresponding monitoring point, determine the corresponding broken line as a conductive line based on the power transmission direction, and determine the remaining broken lines as non-conductive lines; The water accumulation area in the fracture image is analyzed according to the conductive line to generate a water accumulation expansion area.

6. The system according to claim 5, characterized in that The step of analyzing the water accumulation area in the fracture image according to the conductive line to generate the water accumulation expansion area includes: Selecting a coordinate point on the boundary line of the broken image in the conductive circuit as a starting coordinate point, selecting a coordinate point on the other side of the conductive circuit as an ending coordinate point, and selecting a coordinate point corresponding to a middle position of the conductive circuit as an intermediate coordinate point; Calculate according to the starting coordinate point, the ending coordinate point and the intermediate coordinate point to obtain the extension center corresponding to the conductive line; Calculate the slope according to the end coordinate point and the center of the extension circle to obtain a first slope of the line connecting the end coordinate point and the center of the extension circle; Determine a second slope perpendicular to the first slope based on the first slope, and perform calculation according to the second slope and the end coordinate point to obtain an extended tangent line; Taking the target hidden danger area with water accumulation as the water accumulation area, determining the water accumulation area where the extended tangent line in the fracture image is located as the predicted impact area, and obtaining the contour of the predicted impact area as the initial contour based on OpenCV; Acquire a transmission voltage corresponding to the target transmission line, and obtain a voltage influence coefficient based on a ratio of the transmission voltage to a reference voltage; Retrieving a reference influence distance corresponding to the reference voltage, and obtaining an actual influence distance corresponding to the transmission voltage according to a product of the reference influence distance and the voltage influence coefficient; Acquire contour pixel points and contour center points of the initial contour, connect the contour center point with each of the contour pixel points in sequence, and obtain a voltage influence positioning line; Determine a direction from the contour center point to the contour pixel point along the voltage impact positioning line as an impact direction; Taking the contour pixel point as a starting point, moving the contour pixel point based on the actual impact distance and the impact direction to obtain an impact pixel point, and connecting adjacent impact pixel points to obtain a voltage impact contour; An area between the voltage impact contour and the initial contour is determined as a water accumulation expansion area.

7. The system according to claim 6, characterized in that When it is determined that the current meteorological data meets the early warning monitoring conditions, the hidden danger prohibited area is obtained according to the target hidden danger area, including: Acquiring current meteorological data, wherein the current meteorological data includes current wind speed and current rainfall; When it is determined that the current meteorological data is greater than or equal to the preset meteorological data, the remaining target hidden danger areas outside the waterlogged area are regarded as hidden danger prohibited areas.

8. The system according to claim 7, characterized in that The method of obtaining a warning area based on the water expansion area and the hidden danger prohibited area, and determining that a person has entered the warning area, generating a feature matching statement and broadcasting it based on the warning slot customization strategy and the person characteristics of the person entering, includes: Obtaining a warning area based on the water expansion area and the hidden danger prohibited area, and identifying the personal characteristics of the entering person when it is determined that there is a person entering the warning area, wherein the personal characteristics include necessary characteristics and non-essential characteristics, the necessary characteristics include clothing color, and the non-essential characteristics include one or more of the gender of the person and the items held by the person; Retrieving a preset number of fixed warning slots, and sequentially filling the preset morphemes in the preset fixed sentences into the fixed warning slots; Acquire the number of descriptive morphemes corresponding to the necessary features as the necessary number, and determine the number of descriptive morphemes corresponding to the non-essential features as the non-essential number; In response to the selection information of the fixed warning slot by the analysis end, the corresponding fixed warning slot is used as the selected slot, and a necessary number of necessary slots and a non-necessary number of non-necessary slots are constructed in front of the selected slot; The description morphemes corresponding to the necessary features are sequentially filled into the necessary slots, and the description morphemes corresponding to the non-essential features are sequentially filled into the non-essential slots, and a feature matching sentence is generated and broadcasted.

9. The system according to claim 1, characterized in that Also includes: When it is determined that there is a person in the surveillance video corresponding to the fixed acquisition device, the corresponding person is used as a person to be analyzed, and the current time is obtained as the entry time; Acquire the distance between the person to be analyzed and the warning area in real time, and when it is determined that the distance is less than or equal to the preset analysis distance, acquire the image corresponding to the surveillance video based on the entry moment as the initial position image, and acquire the image corresponding to the surveillance video at the next moment after the entry moment as the walking position image; Acquire the image center points of the initial position image and the walking position image as analysis midpoints, and perform coordinate processing on the initial position image and the walking position image based on the analysis midpoints; Determine a first walking coordinate of the person to be analyzed in the initial position image, and a second walking coordinate of the person to be analyzed in the walking position image; According to the second walking coordinates and the first walking coordinates, a walking vector corresponding to the person to be analyzed is obtained, and the walking vector is decomposed to obtain a lateral walking direction corresponding to a lateral walking line segment and a longitudinal walking direction corresponding to a longitudinal walking line segment; Extending the transverse walking line segment based on the transverse walking direction to obtain an extended transverse walking straight line, and extending the longitudinal walking line segment based on the longitudinal walking direction to obtain an extended longitudinal walking straight line; When it is determined that the extended horizontal walking straight line or the extended vertical walking straight line intersects with the warning area, prediction warning information is generated and broadcasted.

10. The system according to claim 6, characterized in that Also includes: In response to the change information of the predicted impact area by the management end, the waterlogged area is determined as the selected impact area.

Images