Audio and video monitoring and alarm system for construction activities near pipelines under roads

Abstract

The present invention discloses an audio and video monitoring and alarm system for construction activities near pipelines under roads, including a monitoring device unit, a data server unit, a user end unit and a power supply unit. By simultaneously monitoring video and sound signals, two independent technical routes are used to identify construction activities, and the identification results are mutually verified, which can reduce the false alarm rate and the missed alarm rate. A two-stage identification strategy is adopted to perform a relatively simple preliminary pre-judgment on the on-site monitoring equipment, and then trigger the data acquisition and transmission module when there is a potential threat, which can save monitoring and transmission costs and improve efficiency; in addition, a secondary discrimination is performed on the data center server, which can improve the recognition accuracy and reduce the false alarm rate and the missed alarm rate. The monitoring equipment has a simple structure, low cost and power consumption, and is convenient for on-site installation.

Description

Technical Field

[0001] The invention relates to the technical field of under-road pipeline monitoring, and in particular to an audio and video monitoring and alarm system for construction activities near under-road pipelines. Background Art

[0002] Pipeline third-party damage refers to damage to the pipeline caused by the actions of people other than the owner and contractor, mainly manifested in construction behavior, especially damage and perforation of the outer anti-corrosion layer or even the pipe wall caused by mechanical drilling. The scope of "third party" is relatively broad, including enterprises, individuals, etc., and there is no direct and effective contractual constraint with the pipeline operator. Their behavior is extremely hidden, arbitrary and widespread, and it is extremely difficult for pipeline maintenance personnel to predict and control it. In recent years, the problem of pipeline third-party damage has become more serious. There are insufficient ground markings on the pipeline. Third parties cannot determine the exact direction and location of the pipeline through ground markings. The buried depth of the pipeline is less than 800mm, and there is no warning belt. In addition, the inspection personnel are all temporarily hired. After the incident, it was found that they knew almost nothing about the basic situation of the pipeline and the consequences of the accident.

[0003] The reason is that the design position of some newly built pipelines deviates greatly from the actual position, especially in some sections where the optical cables are not laid in the same trench as the pipelines, resulting in large position deviations, making pipeline operation and maintenance management difficult. Second, patrol work is not implemented properly. Some patrol personnel do not have a strong sense of responsibility for their work and do not carry out patrol work as required, resulting in failure to promptly discover third-party construction that endangers pipeline safety. Third, some patrol personnel do not identify the risks of third-party construction projects properly, especially for construction projects using horizontal directional drilling. Although they are constructed outside the pipeline protection area, pipeline damage accidents are most likely to occur. Fourth, the construction party lacks awareness of the serious consequences of damaging the pipeline, has a weak legal awareness, and has a fluke mentality. Fifth, technical protection measures are not advanced enough and have certain limitations. Summary of the invention

[0004] The purpose of this section is to summarize some aspects of embodiments of the present invention and briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section and the specification abstract and the invention title of this application to avoid blurring the purpose of this section, the specification abstract and the invention title, and such simplifications or omissions cannot be used to limit the scope of the present invention.

[0005] In view of the above existing problems, the present invention is proposed.

[0006] Therefore, the present invention provides an audio and video monitoring and alarm system for construction activities near pipelines under roads, which can solve the problems of difficult operation and maintenance management and pipelines being threatened by third parties.

[0007] In order to solve the above technical problems, the present invention provides the following technical solutions: an audio and video monitoring and alarm system for construction activities near pipelines under roads, comprising: a monitoring device unit 100, a data server unit 200, a user end unit 300 and a power supply unit 400, wherein:

[0008] The monitoring device unit 100 is used to collect the ambient sound and video information of the system and make preliminary feature judgments;

[0009] The data server unit 200 is used to perform further judgment and processing based on the data collected by the monitoring device unit 100, and perform complex feature judgment;

[0010] The user terminal unit 300 is used to notify the user to process the alarm from the data server unit 200;

[0011] The power supply unit 400 is used to supply power to the monitoring device unit 100 .

[0012] As a preferred solution of the audio and video monitoring and alarm system for pipeline construction activities under the road described in the present invention, the monitoring device unit 100 includes an audio acquisition module 101, a video acquisition module 102, a data processing module 103, a first video recognition module 104, a first sound recognition module 105, a first judgment alarm module 106 and a data transmission module 107.

[0013] The audio acquisition module 101 collects audio signals through a microphone and a sound card, and the video acquisition module 102 collects video signals through a camera. The data collected by the two modules enter the data processing module 103 for simple data processing, and the processed data are respectively transmitted to the first video recognition module 104 and the first sound recognition module 105. The data obtained by the recognition module is then transmitted to the first judgment alarm module 106. The first judgment alarm module 106 performs an alarm judgment. When the alarm condition is met, the first judgment alarm module 106 transmits the data to the data transmission module 107. When the alarm condition is not met, the system continues to perform a new step of data collection.

[0014] As a preferred solution of the audio and video monitoring and alarm system for pipeline construction activities under the road of the present invention, the data server unit 200 includes a data receiving module 201, a manual review module 202, a second sound recognition module 203, a second video recognition module 204 and a second judgment alarm module 205.

[0015] The data receiving module 201 receives data from the data transmission module 107, and transmits the data to the manual review module 202, the second sound recognition module 203 and the second video recognition module 204. The manual review module 202, the second sound recognition module 203 and the second video recognition module 204 respectively judge the obtained data and transmit the judgment results to the second judgment alarm module 205. The second judgment alarm module 205 judges the obtained alarm data. When the alarm conditions are met, the second judgment alarm module 205 transmits the data to the user end unit 300. When the alarm conditions are not met, the system continues to perform a new step of data collection.

[0016] As a preferred solution of the audio and video monitoring and alarm system for pipeline construction activities under the road of the present invention, the user end unit 300 includes a pipeline inspection personnel notification module 301 and a pipeline operation and maintenance department notification module 302.

[0017] The pipeline inspection personnel notification module 301 is used to handle alarm situations, and can notify nearby pipeline inspection personnel of the alarm situation as soon as possible. The pipeline operation and maintenance department notification module 302 is also used to handle alarm situations, and can notify the pipeline operation and maintenance department of the alarm situation as soon as possible. The pipeline inspection personnel notification module 301 communicates with the pipeline operation and maintenance department notification module 302 in full-duplex. When the notified pipeline inspection personnel cannot go to handle the alarm situation in time, the pipeline operation and maintenance department can be notified, and the pipeline operation and maintenance department will reallocate the inspection personnel.

[0018] As a preferred solution of the audio and video monitoring and alarm system for construction activities near pipelines under roads described in the present invention, when the first alarm judgment module 106 makes an alarm judgment, the condition for satisfying the alarm is that one or more of the first video recognition module 104 and the first sound recognition module 105 output signals are yes.

[0019] As a preferred solution of the audio and video monitoring and alarm system for construction activities near under-road pipelines described in the present invention, when the second alarm judgment module 205 makes an alarm judgment, the alarm condition is met when the output signals of the second sound recognition module 203, the second video recognition module 204 and the manual review module 202 are all yes.

[0020] As a preferred solution of the audio and video monitoring and alarm system for construction activities near pipelines under roads described in the present invention, the first video recognition module 104 is designed using a target recognition algorithm.

[0021] As a preferred solution of the audio and video monitoring and alarm system for construction activities near pipelines under roads described in the present invention, the target recognition algorithm adopts a convolutional neural network, and the image samples of the data processing module 103 are input into the target recognition algorithm to obtain a 1×2 output layer after running. The value range of the two numbers in the output layer is 0 to 1. The value of the first number is greater than the second number and greater than the threshold value 0.5, which determines that there is construction equipment.

[0022] As a preferred solution of the audio and video monitoring and alarm system for construction activities near pipelines under roads described in the present invention, the second video recognition module 204 is designed using a target detection algorithm.

[0023] As a preferred solution of the audio and video monitoring and alarm system for construction activities near pipelines under roads described in the present invention, the target detection algorithm adopts the yolo-v5 model, including:

[0024] An image input module, used to input the original image obtained from the data receiving module 201;

[0025] The positioning module uses the target detection algorithm to calculate the probability that the image contains construction machinery and the position coordinates of the construction machinery in the image;

[0026] The classification module uses the target detection algorithm to classify and retrieve the construction machine images and find the construction machine with the largest feature matching degree;

[0027] The proximity determination module calibrates the danger zone and obtains the position coordinates of the construction equipment in the image based on the positioning module. It determines whether the rectangular center point of the construction equipment is within the danger zone, or whether 50% or more of the rectangular area overlaps with the danger zone. If any of these conditions is met, it indicates that the construction equipment has entered the danger zone and an alarm is issued.

[0028] Beneficial effects of the present invention: The present invention proposes an audio and video monitoring and alarm system for construction activities near pipelines under roads. The present invention simultaneously monitors video and sound signals, and adopts two independent technical routes to identify construction activities. The identification results are mutually verified, which can reduce the false alarm rate and missed alarm rate. In addition, the two-stage recognition strategy can achieve a balance between the monitoring efficiency and recognition accuracy of on-site equipment. On the one hand, the on-site monitoring equipment performs a relatively simple preliminary pre-judgment, and then triggers the data acquisition and transmission module when there is a potential threat, which can save monitoring and transmission costs and improve efficiency; on the other hand, a secondary discrimination is performed on the data center server, which can improve the recognition accuracy and reduce the false alarm rate and missed alarm rate. The monitoring equipment has a simple structure, low cost and power consumption, and is convenient for on-site installation. The construction activities of buried pipes under roads are relatively typical, mainly breaking roads with excavator impact drills or manual electric hammers, so the recognition model trained by collecting data in the early stage has a high accuracy. In addition, the two-stage recognition algorithm that simultaneously adopts two types of recognition technologies not only ensures monitoring efficiency but also improves recognition accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor. Among them:

[0030] Figure 1 A conceptual diagram of an audio and video monitoring and alarm system for construction activities near pipelines under roads provided by one embodiment of the present invention;

[0031] Figure 2 An overall flow chart of an audio and video monitoring and alarm system for construction activities near pipelines under roads provided by one embodiment of the present invention;

[0032] Figure 3 A distribution diagram of monitoring equipment units of an audio and video monitoring and alarm system for construction activities near pipelines under roads provided by one embodiment of the present invention;

[0033] Figure 4 A distribution diagram of data server units of an audio and video monitoring and alarm system for construction activities near pipelines under roads provided by an embodiment of the present invention;

[0034] Figure 5 A distribution diagram of user end units of an audio and video monitoring and alarm system for construction activities near pipelines under roads provided by an embodiment of the present invention;

[0035] Figure 6 A flowchart of the overall method of an audio and video monitoring and alarm system for construction activities near pipelines under roads provided by one embodiment of the present invention;

[0036] Figure 7 An audio data recognition effect diagram of an audio and video monitoring and alarm system for construction activities near pipelines under roads provided by an embodiment of the present invention;

[0037] Figure 8 A video data recognition effect diagram of an audio and video monitoring and alarm system for construction activities near pipelines under roads provided by an embodiment of the present invention;

[0038] Fig. 9 A construction detection image collected by a video module of an audio and video monitoring and alarm system for construction activities near pipelines under roads provided by an embodiment of the present invention;

[0039] Fig.10 A non-construction detection image collected by a video module of an audio and video monitoring and alarm system for construction activities near pipelines under roads provided by an embodiment of the present invention; DETAILED DESCRIPTION

[0040] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the drawings of the specification. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in the art without creative work should fall within the scope of protection of the present invention.

[0041] In the following description, many specific details are set forth to facilitate a full understanding of the present invention, but the present invention may also be implemented in other ways different from those described herein, and those skilled in the art may make similar generalizations without violating the connotation of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0042] Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The term "in one embodiment" that appears in different places in this specification does not necessarily refer to the same embodiment, nor does it refer to a separate or selective embodiment that is mutually exclusive with other embodiments.

[0043] The present invention is described in detail with reference to schematic diagrams. When describing the embodiments of the present invention, for the sake of convenience, the cross-sectional diagrams showing the device structure will not be partially enlarged according to the general scale, and the schematic diagrams are only examples, which should not limit the scope of protection of the present invention. In addition, in actual production, the three-dimensional dimensions of length, width and depth should be included.

[0044] At the same time, in the description of the present invention, it should be noted that the directions or positional relationships indicated by the terms "upper, lower, inner and outer" are based on the directions or positional relationships shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific direction, be constructed and operated in a specific direction, and therefore cannot be understood as limiting the present invention. In addition, the terms "first, second or third" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0045] In the present invention, unless otherwise clearly specified and limited, the terms "install, connect, connect" should be understood in a broad sense, for example: it can be a fixed connection, a detachable connection or an integral connection; it can also be a mechanical connection, an electrical connection or a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0046] Example 1

[0047] Reference Figure 1-6 , which is the first embodiment of the present invention, provides an audio and video monitoring and alarm system for construction activities near pipelines under roads, including: a monitoring device unit 100, a data server unit 200, a user terminal unit 300 and a power supply unit 400, wherein:

[0048] The monitoring device unit 100 is used to collect the ambient sound and frequency information of the system and make preliminary feature judgments;

[0049] The data server unit 200 is used to perform further judgment and processing based on the data collected by the monitoring device unit 100, and perform complex feature judgment;

[0050] The user terminal unit 300 is used to notify the user to process the alarm from the data server unit 200;

[0051] The power supply unit 400 is used to supply power to the monitoring device unit 100 .

[0052] Furthermore, the monitoring device unit 100 includes an audio acquisition module 101 , a video acquisition module 102 , a data processing module 103 , a first video recognition module 104 , a first sound recognition module 105 , a first judgment alarm module 106 and a data transmission module 107 .

[0053] It should be noted that the audio acquisition module 101 collects audio signals through a microphone and a sound card, and the video acquisition module 102 collects video signals through a camera. The data collected by the two modules enter the data processing module 103 for simple data processing, and the processed data are respectively transmitted to the first video recognition module 104 and the first sound recognition module 105. The data obtained by the recognition module is then transmitted to the first judgment alarm module 106. The first judgment alarm module 106 performs an alarm judgment. When the alarm conditions are met, the first judgment alarm module 106 transmits the data to the data transmission module 107. When the alarm conditions are not met, the system continues to perform a new step of data collection.

[0054] It should also be noted that when the first alarm judgment module 106 makes an alarm judgment, the alarm condition is that one or more of the first video recognition module 104 and the first sound recognition module 105 output a yes signal. Only then will the data be transmitted to the next unit, otherwise data collection will be performed again.

[0055] Furthermore, the data server unit 200 includes a data receiving module 201, a manual review module 202, a second sound recognition module 203, a second video recognition module 204 and a second judgment alarm module 205.

[0056] It should be noted that the data receiving module 201 receives data from the data transmission module 107, and transmits the data to the manual review module 202, the second sound recognition module 203 and the second video recognition module 204. The manual review module 202, the second sound recognition module 203 and the second video recognition module 204 respectively judge the obtained data and transmit the judgment results to the second judgment alarm module 205. The second judgment alarm module 205 judges the obtained alarm data. When the alarm conditions are met, the second judgment alarm module 205 transmits the data to the user end unit 300. When the alarm conditions are not met, the system continues to perform a new step of data collection.

[0057] It should also be noted that when the second alarm judgment module 205 makes an alarm judgment, the alarm condition is satisfied when the output signals of the manual review module (202), the second sound recognition module 203 and the second video recognition module 204 are all "yes". If and only if the judgment of whether it is construction noise and whether construction equipment is present outputs "yes" at the same time, the data is transmitted to the next unit, otherwise the data is collected again.

[0058] Furthermore, only when the second alarm determination module 205 issues an alarm, the user terminal will receive an alarm notification.

[0059] Furthermore, the user end unit 300 includes a pipeline inspection personnel notification module 301 and a pipeline operation and maintenance department notification module 302.

[0060] It should be noted that the pipeline inspection personnel notification module 301 is used to handle alarm situations, and can notify nearby pipeline inspection personnel of the alarm situation as soon as possible. The pipeline operation and maintenance department notification module 302 is also used to handle alarm situations, and can notify the pipeline operation and maintenance department of the alarm situation as soon as possible. The pipeline inspection personnel notification module 301 and the pipeline operation and maintenance department notification module 302 communicate in full-duplex.

[0061] It should also be noted that when the pipeline inspection personnel are notified and cannot go to handle the alarm in time, the pipeline operation and maintenance department can be notified, and the pipeline operation and maintenance department will reallocate the inspection personnel.

[0062] Furthermore, the first video recognition module 104 is designed using a target recognition algorithm.

[0063] Furthermore, the target recognition algorithm adopts a convolutional neural network. After the image sample of the data processing module 103 is input into the target recognition algorithm, a 1×2 output layer is obtained. The value range of the two numbers in the output layer is 0 to 1. The value of the first number is greater than the second number and greater than the threshold value 0.5, which determines that there is construction equipment.

[0064] Furthermore, the second video recognition module 204 is designed using a target detection algorithm.

[0065] Furthermore, the target detection algorithm adopts the yolo-v5 model, including:

[0066] An image input module, used to input the original image obtained from the data receiving module 201;

[0067] The positioning module uses the target detection algorithm to calculate the probability that the image contains construction machinery and the position coordinates of the construction machinery in the image;

[0068] The classification module uses the target detection algorithm to classify and retrieve the construction machine images and find the construction machine with the largest feature matching degree;

[0069] The proximity determination module calibrates the danger zone and obtains the position coordinates of the construction equipment in the image based on the positioning module. It determines whether the rectangular center point of the construction equipment is within the danger zone, or whether 50% or more of the rectangular area overlaps with the danger zone. If any of these conditions is met, it indicates that the construction equipment has entered the danger zone and an alarm is issued.

[0070] Example 2

[0071] Reference Figure 7-9, which is an embodiment of the present invention, provides an audio and video monitoring and alarm system for construction activities near pipelines under roads. In order to verify the beneficial effects of the present invention, scientific demonstration is carried out through experiments.

[0072] It can be seen from Table 1 that the relevant values ​​of the YOLO-V5 model for each category are basically higher than those of the original YOLO-V4. This shows that the new model proposed by this method can improve the detection effect and accuracy.

[0073] Table 1 Performance analysis of three different algorithm models

[0074]

[0075] The present invention combines monitoring with alarm. When construction equipment, such as excavator impact drills, manual electric hammers and road cutters, are within the monitoring range, the three modules work together to accurately identify the construction equipment. When it is not within the monitoring range, the construction equipment will not affect the pipelines under the road, and no alarm will be sounded.

[0076] Figure 7 and 8 The acquisition cycle is 0-60s, and 1400 frames of image information are collected within 60s. During 0-15s in this 60s, the sound recognition module recognizes the sound, but the video recognition module does not recognize the relevant construction equipment. During 16-30s, both the sound recognition module and the video recognition module do not respond. During 31-45s, the sound recognition module does not respond to the situation, while the video recognition module begins to respond. During 46-60s, the sound recognition module responds to the situation, and the video recognition module also responds. When both modules respond, the manual review module will make the final judgment.

[0077] Fig. 9 This is a screenshot of the system when monitoring the operation of construction equipment in the embodiment. It can be seen that the system's recognition confidence in the excavator impact drill is as high as 99%. At this time, based on manual review, it can correctly judge the current construction situation and determine whether it is necessary to issue an alarm to notify the operation and maintenance department or inspection personnel to go to the site to handle related matters. Fig.10 This is a screenshot of the system when it is detected that the construction equipment is not working in the embodiment. At this time, the system can still identify the excavator impact drill with a confidence level of up to 98%. However, when manual review is added at this time, the system misjudgment will be reduced. It can be seen that the construction equipment is not working at this time, so there is no need to notify the operation and maintenance department and patrol personnel of the relevant alarm. The cooperation of the three modules can make the system run more efficiently.

[0078] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

[0079] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

[0080] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of complete hardware embodiments, complete software embodiments, or embodiments in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code. The scheme in the embodiments of the present application can be implemented in various computer languages, for example, object-oriented programming language Java and literal scripting language JavaScript, etc.

[0081] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0082] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0083] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0084] Although the preferred embodiments of the present application have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.

[0085] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. Audio and video monitoring and alarm system for construction activities near pipelines under roads, characterized by: It comprises a monitoring device unit (100), a data server unit (200), a user terminal unit (300) and a power supply unit (400), wherein: A monitoring device unit (100) is used to collect ambient sound and frequency information of the system and perform preliminary feature determination; A data server unit (200) is used to perform further judgment processing based on the data collected by the monitoring device unit (100) and perform complex feature judgment; A user terminal unit (300) for notifying a user to process an alarm from the data server unit (200); A power supply unit (400), used to supply power to the monitoring device unit (100); The monitoring device unit (100) comprises an audio acquisition module (101), a video acquisition module (102), a data processing module (103), a first video recognition module (104), a first sound recognition module (105), a first judgment alarm module (106) and a data transmission module (107). The audio acquisition module (101) collects audio signals through a microphone and a sound card, and the video acquisition module (102) collects video signals through a camera. The data collected by the two modules enter the data processing module (103) for simple data processing, and the processed data are respectively transmitted to the first video recognition module (104) and the first sound recognition module (105). The data obtained by the recognition module is then transmitted to the first judgment alarm module (106). The first judgment alarm module (106) makes an alarm judgment. If the alarm condition is met, the first judgment alarm module (106) transmits the data to the data transmission module (107). If the alarm condition is not met, the system continues to perform a new step of data collection. When the first alarm judgment module (106) makes an alarm judgment, the alarm condition is satisfied when one or more of the first video recognition module (104) and the first sound recognition module (105) outputs a signal that is yes, and only then will the data be transmitted to the next unit, otherwise data collection will be performed again; The data server unit (200) comprises a data receiving module (201), a manual review module (202), a second sound recognition module (203), a second video recognition module (204) and a second judgment alarm module (205). The data receiving module (201) receives data from the data transmission module (107), and transmits the data to the manual review module (202), the second sound recognition module (203) and the second video recognition module (204); the manual review module (202), the second sound recognition module (203) and the second video recognition module (204) respectively judge the obtained data, and transmit the judgment result to the second judgment alarm module (205); the second judgment alarm module (205) judges the obtained alarm data; if the alarm condition is met, the second judgment alarm module (205) transmits the data to the user terminal unit (300); if the alarm condition is not met, the system continues to collect data in a new step; When the second sound recognition module (203) and the second video recognition module (204) determine that an alarm situation exists, the manual review module (202) makes the final judgment; The manual review module (202) determines the current construction situation and determines whether an alarm needs to be issued to notify the operation and maintenance department or inspection personnel to go to the site to handle related matters; The user end unit (300) comprises a pipeline inspection personnel notification module (301) and a pipeline operation and maintenance department notification module (302). The pipeline inspection personnel notification module (301) is used to handle the alarm situation and notify the nearby pipeline inspection personnel of the alarm situation as soon as possible. The pipeline operation and maintenance department notification module (302) is also used to handle the alarm situation and notify the pipeline operation and maintenance department of the alarm situation as soon as possible. The pipeline inspection personnel notification module (301) and the pipeline operation and maintenance department notification module (302) communicate in full duplex. If the notified pipeline inspection personnel cannot go to handle the alarm situation in time, the pipeline operation and maintenance department is notified, and the pipeline operation and maintenance department reallocates the inspection personnel. When the first alarm judgment module (106) performs alarm judgment, the alarm condition is satisfied when one or more of the first video recognition module (104) and the first sound recognition module (105) outputs a signal that is yes; When the second alarm judgment module (205) performs alarm judgment, the alarm condition is satisfied when the output signals of the second sound recognition module (203), the second video recognition module (204) and the manual review module (202) are all "yes", and the data is transmitted to the next unit only when and only when the output results of judging whether it is construction noise and whether construction equipment is present are both "yes", otherwise the data is collected again; When the second judgment alarm module (205) issues an alarm, the user terminal will receive an alarm notification; The first video recognition module (104) is designed using a target recognition algorithm; The target recognition algorithm adopts a convolutional neural network, and after the image sample of the data processing module (103) is input into the target recognition algorithm, a 1×2 output layer is obtained, and the value range of the two numbers in the output layer is 0 to 1. If the value of the first number is greater than the second number and greater than the threshold value 0.5, it is judged that there is a construction machine; The second video recognition module (204) is designed using a target detection algorithm; The target detection algorithm adopts the yolo-v5 model, including: An image input module, used for inputting the original image obtained from the data receiving module (201); The positioning module uses the target detection algorithm to calculate the probability that the image contains construction machinery and the location coordinates of the construction machinery in the image; The classification module uses the target detection algorithm to classify and retrieve the construction machine images and find the construction machine with the largest feature matching degree; The proximity determination module calibrates the danger zone and obtains the position coordinates of the construction equipment in the image based on the positioning module. It determines whether the rectangular center point of the construction equipment is within the danger zone, or whether 50% or more of the rectangular area overlaps with the danger zone. If any of these conditions is met, it indicates that the construction equipment has entered the danger zone and an alarm is issued.

Images