Intelligent prevention and control monitoring system for blind plate status based on the Internet of Things

Abstract

The present invention relates to the field of data transmission technology, and specifically, to an intelligent prevention and control monitoring system for blind plate status based on the Internet of Things. It includes a terminal, an intelligent prevention and control unit and an Internet of Things transmission unit, and the intelligent prevention and control unit includes a process unification module, an operation feedback module, an assembly detection module and an area selection module. The present invention enables the two terminals to communicate with each other through the Internet of Things transmission unit, which not only controls the work content of both parties globally, but also facilitates the estimation of the time for subsequent operations according to the replacement progress, thereby alleviating the fatigue of users who do not know how long to wait for subsequent operations, and only transmits feedback signals when the standard reaches the standard threshold, avoiding the possibility of dangerous accidents caused by non-standard assembly and improving safety; the assembly detection module detects the completion of the replacement of the blind plate, automatically triggers the transmission of feedback signals, improves the informatization of the management and control process, and realizes the digitization, informatization and intelligence of blind plates and valves.

Description

Technical Field

[0001] The present invention relates to the technical field of data transmission, and in particular to an intelligent prevention and control monitoring system for blind plate status based on the Internet of Things. Background Art

[0002] There have been many lessons learned from the repeated accidents caused by improper management of blind plates and valves during the inspection, maintenance, and start-up and shutdown of refining and chemical enterprises, which have led to fires, explosions, poisoning, suffocation, etc. In the past 10 years, 16% of the fatal accidents at Sinopec were caused by improper energy isolation, of which 10% could have been avoided through energy isolation.

[0003] Energy isolation management in refining and chemical enterprises is characterized by being multi-faceted and scattered, which brings certain difficulties to safety management, especially during equipment maintenance, where there are great risks. In response to the call of the country's 14th Five-Year Plan, petrochemical companies across the country are actively promoting the digital, information-based, and intelligent management of blind plates and valves. Therefore, effective management of the energy isolation process and real-time monitoring of the isolation status make the energy isolation process and operation process more standardized, and reduce the probability of safety accidents caused by misoperation of energy isolation. In response to the problems existing in traditional energy isolation management and control, the mainstream solution on the market is a solution based on Bluetooth key locks. This solution standardizes the lock and tag management procedures and realizes the control of logical permissions in the isolation locking process, that is, authorization to unlock and release permissions according to the isolation locking process, and effective recording of the isolation process. When problems occur, the execution process information can be traced and responsibility determined;

[0004] Although the Bluetooth solution can record the entire isolation and locking operation process based on the mobile terminal and transmit the operation process information online to the system, when the mobile terminal leaves the site, the communication link is immediately disconnected, and the real-time online perception of the isolation status of the blind plate and valve cannot be achieved. Management personnel cannot have a global control over the isolation point status at any time. The existing information in the system is only the historical information sent back during the isolation operation at the time, and it does not have the real-time rapid alarm function in case of an erroneous operation on site;

[0005] Therefore, in order to better solve the above pain points, it is necessary to carry out intelligent monitoring and management of blind plates and valves. Through intelligent Internet of Things and intelligent monitoring technology, real-time data collection and upload of whether the blind plates and valves are in place and the switch status can be realized, unified management can be achieved, and intelligent energy isolation can be realized. In view of this, we propose an intelligent prevention and control monitoring system for blind plate status based on the Internet of Things. Summary of the invention

[0006] The purpose of the present invention is to provide an intelligent prevention and control monitoring system for blind plate status based on the Internet of Things to solve the problems raised in the above-mentioned background technology.

[0007] To achieve the above-mentioned purpose, the present invention provides an intelligent prevention and control monitoring system for blind plate status based on the Internet of Things, including a terminal, an intelligent prevention and control unit and an Internet of Things transmission unit. The terminal is used to provide a software platform for replacement personnel and operating personnel to view prevention and control data, and establish a link between the replacement personnel and the operating personnel through the Internet of Things transmission unit to realize the input of information and the output of processing results. The intelligent prevention and control unit is used to monitor the replacement personnel's replacement of blind plates in real time, and feed back the monitoring data to the operator through the Internet of Things transmission unit;

[0008] The intelligent prevention and control unit includes a process unification module, an operation feedback module, an assembly detection module and an area selection module. The process unification module is used to unify the sequence of blind plate replacement steps, and at the same time create a data set of standard assembly images of blind plates and installation points, and transmit the data set and multiple replacement steps to the terminals of replacement personnel and operators with the help of an Internet of Things transmission unit;

[0009] The operation feedback module is used to send a feedback signal of completing one of the replacement steps, so that the Internet of Things transmission unit transmits the feedback signal to the two terminals. The assembly detection module is used to collect the actual image of the blind plate replaced in each replacement step in real time, and compare it with the standard assembly image, and output the standard degree and completion degree. The area selection module is used to select the installation area in the actual image of the replacement blind plate, and mark the non-standard area detected by the assembly detection module that does not meet the standard degree. When one of the terminals leaves the installation area and comes back, the non-standard area signal is transmitted to remind the replacement personnel, wherein:

[0010] When one of the replacement steps is completed, a feedback signal is manually sent by operating the feedback module. If the collection standard degree of the assembly detection module does not reach the standard threshold, the feedback signal is intercepted and a reminder signal is sent to the terminal of the replacement personnel. If the collection standard degree of the assembly detection module reaches the standard threshold, the feedback signal is transmitted;

[0011] When the assembly detection module outputs that the degree of completion of one of the replacement steps reaches the completion threshold, the operation feedback module is automatically triggered to transmit a feedback signal.

[0012] As a further improvement of the technical solution, the blind plate replacement steps are as follows:

[0013] Step 1: Close the valve;

[0014] Step 2: Clean and inspect;

[0015] Step 3: Install the blind plate;

[0016] Step 4: Open the valve.

[0017] As a further improvement of the technical solution, the operation feedback module includes an interface interaction module and a feedback prompt module;

[0018] The interface interaction module is used to provide an "operation completed" button corresponding to each blind plate replacement step on the software platform interface of the terminal, for the replacement personnel and the operator to manually click after completing each replacement step, and send a feedback signal when manually clicking; the feedback prompt module is used to pop up a prompt signal on the software platform interface of another terminal when one of the terminals sends and transmits a feedback signal, and the feedback prompt module is connected to the output end of the positioning perception module, and when the positioning perception module sends a departure signal, it triggers the feedback prompt module to pop up a prompt signal.

[0019] As a further improvement of the technical solution, the assembly detection module includes a closing detection module, an opening detection module and a standard degree detection module;

[0020] The closing detection module is used to receive that the cable is in a locked state in the valve intelligent sensing tool at the valve, and the lock tongue is in a pop-up state in the blind plate intelligent sensing tool at the blind plate, and output that the closing valve step reaches the completion threshold;

[0021] The opening detection module is used to receive that the cable is in an unlocked state in the valve intelligent sensing tool at the valve, and the lock tongue is in a pressed state in the blind plate intelligent sensing tool at the blind plate, and output that the valve opening step reaches the completion threshold;

[0022] The standard detection module is used to use a structural similarity algorithm to measure the similarity between the actual image of the replaced blind plate and the standard assembly image, and set a standard threshold. When the similarity is ≥ the standard threshold, the current replacement step reaches the standard threshold and reaches the completion threshold at the same time. When the similarity is < the standard threshold, the current replacement step does not reach the standard threshold.

[0023] As a further improvement of the technical solution, the structural similarity algorithm expression is:

[0024]

[0025] in, and are the average values ​​of the actual image of the replaced blind plate and the standard assembly image, and are the variances of the actual image of the replaced blind plate and the standard assembly image, is the covariance, and is a constant.

[0026] As a further improvement of the present technical solution, the standardization detection module also includes an image acquisition module, which is used to capture the replacement video through the terminal of the replacement personnel as a camera device, intercept the actual image of the replacement blind plate at the time node, and transmit it to the standardization detection module to measure the similarity between the actual image of the replacement blind plate and the standard assembly image, and transmit the replacement video in real time to the operator's terminal through the Internet of Things transmission unit.

[0027] As a further improvement of the present technical solution, the region selection module includes a positioning perception module and a refinement marking module;

[0028] The positioning perception module is used to decompose the frame of the replacement video in the image acquisition module, use the semantic segmentation algorithm to process each frame, obtain the mask of the installation area, and use the target detection algorithm within the mask range to identify the staff situation. When there is no one in the installation area, the unmanned signal is triggered, so that the refinement marking module is used to use the difference highlighting algorithm to mark the non-standard area corresponding to the difference point between the actual image of the replacement blind plate and the standard assembly image when the similarity degree detected by the standard detection module is less than the standard threshold.

[0029] As a further improvement of the technical solution, when the positioning perception module triggers the unmanned signal, it includes an initial stage, an unmanned stage and a manned stage. The initial stage is when the staff has not left the installation area, the unmanned stage is when the staff has left the installation area, and the manned stage is when other people enter the installation area after the staff has left the installation area. The face recognition algorithm is used to extract the facial features of the initial stage and the manned stage in the installation area, including the following postures:

[0030] Posture 1: If the facial features extracted in the presence stage match the stored facial features of the staff member, and the facial features in the initial stage match the facial features in the presence stage, the non-standard area marked by the refinement marking module is transmitted to the terminal through the link established by the Internet of Things transmission unit;

[0031] Posture 2: If the facial features extracted in the presence stage match the stored facial features of the staff member, and the facial features in the initial stage do not match the facial features in the presence stage, the link between the two established terminals is disconnected through the Internet of Things transmission unit, and the link between the two new terminals is re-established, and the non-standard area marked by the refinement marking module is transmitted to the new terminal;

[0032] Posture three: if the facial features extracted from the human presence stage do not match the stored facial features of the staff member, a warning signal is transmitted to the feedback prompt module, so that the feedback prompt module transmits it to the terminal.

[0033] As a further improvement of the present technical solution, the assembly detection module also includes a light reminder module, which is used to configure four groups of red indicator lights and green indicator lights in the workplace respectively, so that the four groups of red indicator lights and green indicator lights correspond to the blind plate replacement steps respectively, and when the assembly detection module detects each blind plate replacement step, if the output reaches the standard threshold and the completion threshold signal, the green indicator light is controlled to work and the red indicator light is off; if the output does not reach the standard threshold signal, the green indicator light is controlled to go out and the red indicator light is working.

[0034] Compared with the prior art, the present invention has the following beneficial effects:

[0035] 1. In the intelligent prevention and control monitoring system for blind plate status based on the Internet of Things, feedback signals are transmitted through the operation feedback module, so that the two terminals can communicate with each other through the Internet of Things transmission unit, and the whole process of blind plate and valve isolation and locking can be controlled. Feedback is given once with the completion of each step, so that the terminal replacement personnel and operators can understand the replacement progress of both parties, which not only further ensures that the replacement personnel and operators have an overall control over the work content of both parties, but also facilitates the estimation of the time for subsequent operations according to the replacement progress, reducing the fatigue of users who do not know the waiting time for subsequent operations, and the assembly detection module is used to detect the standard degree of replacement of blind plates in real time. When the standard degree reaches the standard threshold, the feedback signal will be transmitted, otherwise the feedback signal will be intercepted, and the replacement personnel will be reminded to make adjustments, so as to avoid the possibility of dangerous accidents caused by non-standard assembly and improve safety;

[0036] When the assembly inspection module detects the completion of replacing the blind plate, it can automatically send out a feedback signal to enable the assembly inspection module to detect the standard degree, so as to avoid that the replacement personnel have no time to feedback to the operator through the operation feedback module when completing the replacement steps, thereby improving the informatization level of the management and control process and realizing the digitization, informatization and intelligence of blind plates and valves.

[0037] 2. In the intelligent prevention and control monitoring system for blind plate status based on the Internet of Things, a link is established between two terminals through the Internet of Things transmission unit, the installation area is divided in the positioning perception module, and the departure of the replacement personnel from the mask range is detected, so that the operating personnel can timely understand the departure situation, so as to realize dynamic monitoring and management of the personnel. When the replacement personnel comes back, the non-standard area detected by the standard detection module is marked by the refinement marking module, so that when they come back later, they can quickly continue the replacement steps. When replacing the replacement personnel, the link between the two established terminals is disconnected through the Internet of Things transmission unit, and the link between the two new terminals is re-established, and the non-standard area marked by the refinement marking module is transmitted to the new terminal, so that the replacement personnel can understand the replacement steps and realize information exchange. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1It is the overall structural principle block diagram of the present invention;

[0039] Figure 2 is a principle block diagram of a terminal of the present invention;

[0040] Figure 3 This is a principle block diagram of the intelligent prevention and control unit of the present invention.

[0041] The meaning of each number in the figure is:

[0042] 100. Terminal;

[0043] 200, intelligent prevention and control unit; 210, process unification module; 220, operation feedback module; 230, assembly detection module; 240, area selection module;

[0044] 300. Internet of Things transmission unit. DETAILED DESCRIPTION

[0045] The following will be combined with the accompanying drawings in the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention. Example 1

[0046] See also Figure 1-Figure 3 As shown, this embodiment provides an intelligent prevention and control monitoring system for blind plate status based on the Internet of Things, including a terminal 100, an intelligent prevention and control unit 200 and an Internet of Things transmission unit 300. The terminal is used to provide a software platform for viewing prevention and control data for replacement personnel (responsible for replacing blind plate operations) and operating personnel (responsible for valve opening and closing), and establish a link between replacement personnel and operating personnel through the Internet of Things transmission unit to realize information input and output of processing results. The intelligent prevention and control unit is used to monitor the replacement personnel's replacement of blind plates in real time, and feed back monitoring data to the operator through the Internet of Things transmission unit;

[0047] When setting up the terminal, it is necessary to develop an Internet-based software platform, including a website or mobile application, to display the prevention and control data and provide an operation interface, design and deploy an IoT transmission unit, which can be a sensor, smart device or other IoT device, to collect the prevention and control data and transmit it to the software platform, and provide a data input interface on the software platform so that the replacement personnel can enter the information that needs to be replaced, which will be sent to the background database for storage and processing;

[0048] When the replacement personnel or the operator logs in to the software platform at the terminal 100 to receive or process data, if the software platform does not authenticate the identity of the login personnel, other people can also log in to the terminal at any time, resulting in mistransmitted data and valve opening and closing errors. Therefore, the terminal 100 also includes a user identity authentication module;

[0049] The user authentication module is used to allow replacement personnel and operators to access the software platform using a single credential. The basic principle is that the user authenticates at the central identity provider, and the central identity provider issues an access token containing the user's (replacement personnel, operator) identity information. The token is provided to the service provider (software platform), and the service provider verifies the token and grants the user access rights.

[0050] The intelligent prevention and control unit 200 includes a process unification module 210, an operation feedback module 220, an assembly detection module 230 and an area selection module 240. The process unification module 210 is used to unify the sequence of blind plate replacement steps, and at the same time create a data set of standard assembly images of blind plates and installation points, and transmit the data set and multiple replacement steps to the terminals 100 of replacement personnel and operators by means of the Internet of Things transmission unit 300;

[0051] The operation feedback module 220 is used to send a feedback signal of completing one of the replacement steps, so that the Internet of Things transmission unit 300 transmits the feedback signal to the two terminals 100. The assembly detection module 230 is used to collect the actual image of the blind plate replaced in each replacement step in real time, and compare it with the standard assembly image, and output the standard degree and completion degree. The area selection module 240 is used to select the installation area in the actual image of the replacement blind plate, and mark the non-standard area detected by the assembly detection module 230 that does not meet the standard degree. When one of the terminals 100 leaves the installation area and comes back, the non-standard area signal is transmitted to remind the replacement personnel, wherein:

[0052] When one of the replacement steps is completed, a feedback signal is manually sent by operating the feedback module 220. If the standard degree collected by the assembly detection module 230 does not reach the standard threshold, the feedback signal is intercepted and a reminder signal is sent to the terminal of the replacement personnel. If the standard degree collected by the assembly detection module 230 reaches the standard threshold, the feedback signal is transmitted, so that the standard degree of the replacement is detected every time a replacement step is completed, thereby improving safety.

[0053] When the assembly detection module 230 outputs that the completion degree of one of the replacement steps reaches the completion threshold, the operation feedback module 220 is automatically triggered to send a feedback signal, so that the assembly detection module 230 can detect the standard degree to achieve automation.

[0054] Therefore, the present invention transmits feedback signals through the operation feedback module 220, so that the two terminals 100 can communicate with each other through the Internet of Things transmission unit 300, and the whole process of the blind plate and valve isolation and locking process is controlled. Feedback is given once as each step is completed, so that the terminal replacement personnel and the operating personnel can understand the replacement progress of both parties, which not only further ensures that the replacement personnel and the operating personnel have a global control over the work content of both parties, but also facilitates the estimation of the time of subsequent operations according to the replacement progress, thereby reducing the fatigue of users who do not know the waiting time for subsequent operations.

[0055] At the same time, considering that the replacement personnel cannot determine whether the installation meets the standards when performing the replacement operation steps, and transmit the feedback signal, resulting in the valve being opened when the blind plate assembly part meets the standards, which is prone to dangerous accidents, therefore, the standard degree of the replacement blind plate is detected in real time through the assembly detection module 230. When the standard degree reaches the standard threshold, the feedback signal is transmitted, otherwise the feedback signal is intercepted, and the replacement personnel are reminded to make adjustments, so as to avoid the possibility of dangerous accidents caused by non-standard assembly and improve safety;

[0056] In addition, when the assembly detection module 230 detects the completion of the replacement of the blind plate, it can automatically trigger a feedback signal to avoid the replacement personnel having no time to feedback to the operator through the operation feedback module 220 when completing the replacement steps, thereby improving the informatization level of the management and control process and realizing the digitization, informatization and intelligence of the blind plate and valve.

[0057] It is worth noting that the sequence of steps for replacing the blind plate is:

[0058] Step 1, close the valve: Before replacing the blind plate, the operator needs to close the valve on the pipeline isolated by the blind plate to ensure that there is no fluid or pressure in the pipeline, and use the picture of the cable in the valve intelligent sensing tool at the valve being unlocked and the lock tongue in the blind plate intelligent sensing tool at the blind plate being pressed as the standard assembly image for step 1;

[0059] Step 2: Cleaning and inspection: Replace personnel to clean the blind plate installation location and surrounding areas to ensure that there is no debris, rust or other dirt on the surface. In addition, pictures of the previous installation location and surrounding areas that meet the cleanliness threshold are used as standard assembly images for step 2.

[0060] Step 3: Install the blind plate: The replacement personnel align the screw holes on the blind plate with the installation points on the pipeline, and fix the blind plate on the pipeline with the help of bolts, nuts, etc. to ensure that it is stable and reliable, and ensure that it is tightly sealed at the interface with the pipeline to prevent water leakage or leakage. In addition, the image of the overlap of the screw holes and installation points of the blind plate in the past is used as the standard assembly image for step 3;

[0061] Step 4. Open the valve: After the replacement personnel confirm that the new blind plate has been installed and is firmly fixed, the operator gradually opens the valve on the pipeline to restore the normal operation of the pipeline. In addition, the picture of the cable being locked in the previous valve intelligent sensing tool at the valve and the lock tongue being popped out in the blind plate intelligent sensing tool at the blind plate is used as the standard assembly drawing for step 4.

[0062] Further, to realize that the two terminals 100 can transmit signals to each other and manually send feedback signals when a certain step is completed, the operation feedback module 220 includes an interface interaction module and a feedback prompt module;

[0063] The interface interaction module is used to provide an "operation completed" button corresponding to each blind plate replacement step on the software platform interface of the terminal 100, for the replacement personnel and the operator to manually click after completing each replacement step, and send a feedback signal when manually clicking; the feedback prompt module is used to pop up a prompt signal on the software platform interface of another terminal 100 when one of the terminals 100 sends a feedback signal and transmits it, and the feedback prompt module is connected to the output end of the positioning sensing module 120. When the positioning sensing module 120 sends a departure signal, the feedback prompt module is triggered to pop up a prompt signal to remind the replacement personnel to understand the replacement progress;

[0064] For example: after the replacement personnel completes the above step one and closes the valve, they manually click on the "operation completed" corresponding to step one to send a feedback signal, so that the operator receives the prompt signal through the feedback prompt module; when the replacement personnel complete the above steps two and three, feedback signals are sent respectively, and when the standard degree meets the standard threshold through the assembly detection module 230, the operator receives the prompt signal through the feedback prompt module, and then, after the operator receives the prompt signal of step three, step four is completed to open the valve, thereby realizing the entire process of blind plate replacement;

[0065] At the same time, the cooperation between the feedback prompt module and the interface interaction module can remind the replacement personnel (operator) to leave, avoiding the operator (replacement personnel) waiting for the operator's operation and reducing work efficiency.

[0066] Then, it is necessary to realize that the assembly detection module 230 can perform detection for each replacement step, determine the standard degree and completion degree corresponding to each replacement step, and make the assembly detection module 230 include a closing detection module, an opening detection module and a standard degree detection module;

[0067] The closing detection module is used to receive that the cable is in a locked state in the valve intelligent sensing tool at the valve, and the lock tongue is in a pop-up state in the blind plate intelligent sensing tool at the blind plate, and output that the closing valve step reaches the completion threshold;

[0068] The opening detection module is used to receive that the cable is in an unlocked state in the valve intelligent sensing tool at the valve, and the lock tongue is in a pressed state in the blind plate intelligent sensing tool at the blind plate, and output that the valve opening step reaches the completion threshold;

[0069] A cable is provided in the valve intelligent sensing tool, and one of the driving parts drives the cable to switch between a locked state and an unlocked state. When the valve is closed, it is sensed that one of the driving parts drives the cable to be in a locked state to prevent the valve from opening at will. On the contrary, when the valve is opened, it is sensed that one of the driving parts drives the cable to be in an unlocked state, and the valve is not restricted at this time; and a lock tongue is provided in the blind plate intelligent sensing tool, and another driving part drives the lock tongue to switch between a pop-up state and a pressed state. When the valve is closed, it is sensed that another driving part drives the lock tongue to pop up, which is convenient for replacing and assembling the blind plate. On the contrary, when the valve is opened, it is sensed that another driving part drives the lock tongue to be pressed, and the blind plate assembled on the pipeline is restricted to avoid accidental opening and causing dangerous accidents. This is common knowledge of personnel in this technical field and will not be repeated again;

[0070] The standard detection module is used to measure the similarity between the actual image of the replacement blind plate and the standard assembly image using a structural similarity algorithm, and set a standard threshold. When the similarity is ≥ the standard threshold, the current replacement step reaches the standard threshold and reaches the completion threshold at the same time. When the similarity is < the standard threshold, the current replacement step does not reach the standard threshold.

[0071] The structural similarity algorithm expression is:

[0072]

[0073] in, and are the average values ​​of the actual image of the replaced blind plate and the standard assembly image, and are the variances of the actual image of the replaced blind plate and the standard assembly image, is the covariance, and is a constant. Example 2

[0074] In order to determine whether the completion degree and standard degree of step two and step three meet the completion threshold and standard threshold respectively more accurately, facilitate automatic triggering of feedback signals, and collect actual images of replaced blind plates, the standard degree detection module also includes an image acquisition module, which is used to collect replacement videos through the terminal 100 of the replacement personnel as a camera device, capture the actual image of replaced blind plates at the time node, and transmit it to the standard degree detection module to measure the similarity between the actual image of replaced blind plates and the standard assembly image, and transmit the replacement video to the operator's terminal 100 in real time through the Internet of Things transmission unit 300, so that the camera device can collect the replacement video, and can capture the actual image of replaced blind plates from the replacement video within the time node, so as to meet the standard degree measurement of the actual image of replaced blind plates and the standard assembly image, and ensure the integrity of automatic detection, and the operator can view the replacement video in real time on the software platform of the terminal 100, which is conducive to the operator to view the assembly scene with the naked eye and understand the overall situation more accurately.

[0075] Since the time required to complete each replacement step can be preliminarily determined based on past experience, when the replacement personnel (operator) needs to do other work and leave the installation area, the operator (replacement personnel) is not clear, which affects the estimation of the replacement work time. In addition, when the replacement personnel leaves the installation area for a long time or other colleagues continue the replacement steps, it is not convenient to clarify the progress in time. If it is time-consuming and laborious to check from the beginning, therefore, the area selection module 240 includes a positioning perception module and a refinement marking module;

[0076] The positioning perception module is used to decompose the replacement video in the image acquisition module, use the semantic segmentation algorithm to process each frame, obtain the mask of the installation area, and use the target detection algorithm within the mask range to identify the staff situation. When there is no one in the installation area, the unmanned signal is triggered, so that the refinement marking module is used to use the difference highlighting algorithm to mark the non-standard area corresponding to the difference point between the actual image of the replacement blind plate and the standard assembly image when the similarity degree detected by the standard detection module is less than the standard threshold. The installation area, that is, the mask range, is divided by the positioning perception module to detect the replacement personnel (operator) leaving the mask range. Not only can the departure from the installation area be discovered in time, so that the operator (replacement personnel) can be informed of the departure in time to realize dynamic monitoring and management of personnel, but also the non-standard area detected by the standard detection module is marked by the refinement marking module, which is convenient and intuitive to determine the installation progress, so that when you come back later, you can quickly continue the replacement steps;

[0077] Among them, the semantic segmentation algorithm uses a pre-trained semantic segmentation model (such as U-Net, DeepLab, etc.) to process each frame to obtain the mask of the installation area; the target detection algorithm uses the target detection algorithm (such as YOLO, SSD, etc.) within the mask range of the installation area to identify the staff; the difference highlighting algorithm uses the structural similarity (SSIM) algorithm to compare the actual image with the standard image and mark the difference area.

[0078] Specifically, considering that the replacement personnel leave for other things, but the current blind plate needs to be replaced urgently, other colleagues are needed to replace and complete the subsequent replacement steps. At this time, the terminal 100 in the initial stage is not the same as the terminal 100 in the manned stage. Therefore, when the positioning perception module triggers the unmanned signal, it includes the initial stage, the unmanned stage and the manned stage. The initial stage is when the staff has not left the installation area, the unmanned stage is when the staff leaves the installation area, and the manned stage is when it is perceived that other people enter the installation area after the staff leaves the installation area. The face recognition algorithm is used to extract the facial features of the initial stage and the manned stage in the installation area, including the following postures:

[0079] Posture 1: If the facial features extracted in the presence stage match the stored facial features of the staff member, and the facial features in the initial stage match the facial features in the presence stage, the non-standard area marked by the refinement marking module is transmitted to the terminal 100 through the link established by the Internet of Things transmission unit 300;

[0080] Posture 2: If the facial features extracted in the presence stage match the stored facial features of the staff, and the facial features in the initial stage do not match the facial features in the presence stage, the connection between the two established terminals 100 is disconnected through the Internet of Things transmission unit 300, and the connection between the two new terminals 100 is re-established, and the non-standard area marked by the refinement marking module is transmitted to the new terminal 100;

[0081] Posture three: if the facial features extracted from the human stage do not match the stored facial features of the staff, a warning signal is transmitted to the feedback prompt module, so that the feedback prompt module transmits it to the terminal;

[0082] Detailed description, assuming that M and N are two terminals 100 in the initial stage, a link between the two terminals 100 is established through the Internet of Things transmission unit 300, which is convenient for direct transmission of prevention and control data. On the basis of the above-mentioned posture one, the non-standard area can be directly transmitted to the terminal 100, which is beneficial for the staff (this staff is not any of the replacement personnel and the operator) to determine the previous progress through the non-standard area, and facilitate quick recall of the replacement steps. On the basis of the above-mentioned posture two, the P terminal 100, as the new terminal 100, enters the installation area to replace the M terminal 100 to continue the replacement steps. At this time, the link between M and N is disconnected, and a new link is established between P and N through the Internet of Things transmission unit 300, so that P can understand the replacement steps and realize information exchange. On the basis of the above-mentioned posture three, it indicates that irrelevant personnel have entered the installation area to avoid misoperation, and a reminder signal is issued to facilitate the staff to respond. Example 3

[0083] When the operator or replacement personnel leave for other reasons, if other irrelevant staff members do not understand the valve situation and mistakenly open the valve, dangerous accidents may easily occur. Therefore, in order to further improve safety, the assembly detection module 230 also includes a light reminder module, which is used to configure four groups of red indicator lights and green indicator lights in the workplace, so that the four groups of red indicator lights and green indicator lights correspond to the blind plate replacement steps respectively. When the assembly detection module 230 detects each blind plate replacement step, the output reaches the standard threshold and the completion threshold signal, then the green indicator light is controlled to work and the red indicator light is turned off. When the output does not reach the standard threshold signal, the green indicator light is controlled to turn off and the red indicator light is controlled to work. A microcontroller can be connected to the output ends of the green indicator light and the red indicator light to control the switch of the indicator light. The microcontroller can control the voltage of the output pin according to the preset logic or sensor input, thereby controlling the on and off of the indicator light, so that the staff can intuitively judge the replacement and assembly status of the blind plate through the indicator light. At the same time, the replacement personnel (operator) can also determine the assembly status of the blind plate when checking without opening the software platform of the terminal 100, thereby improving the scope of application.

[0084] The above shows and describes the basic principles, main features and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited by the above embodiments. The above embodiments and descriptions are only preferred examples of the present invention and are not intended to limit the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention. The scope of protection of the present invention is defined by the attached claims and their equivalents.

Claims

1. The intelligent prevention and control monitoring system for blind plate status based on the Internet of Things is characterized by: It comprises a terminal (100), an intelligent prevention and control unit (200) and an Internet of Things transmission unit (300), wherein the terminal is used to provide a software platform for replacement personnel and operating personnel to view prevention and control data, and to establish a link between the replacement personnel and the operating personnel through the Internet of Things transmission unit; The intelligent prevention and control unit (200) comprises a process unification module (210), an operation feedback module (220), an assembly detection module (230) and an area selection module (240), wherein the process unification module (210) is used to unify the sequence of blind plate replacement steps, and simultaneously create a data set of standard assembly images of blind plates and installation points, and transmit the data set and multiple replacement steps to the terminals (100) of replacement personnel and operators via an Internet of Things transmission unit (300); The operation feedback module (220) is used to send a feedback signal of completing one of the replacement steps, so that the Internet of Things transmission unit (300) transmits the feedback signal to the two terminals (100); the assembly detection module (230) is used to collect the actual image of the replacement blind plate in each replacement step in real time, and compare it with the standard assembly image, and output the control data of the standard degree and the degree of completion; the area selection module (240) is used to select the installation area in the actual image of the replacement blind plate, and mark the non-standard area detected by the assembly detection module (230) that does not meet the standard degree; when one of the terminals (100) leaves the installation area and comes back, the non-standard area signal is transmitted, and the replacement personnel are reminded, wherein: When one of the replacement steps is completed, a feedback signal is manually sent by operating the feedback module (220); if the standard degree collected by the assembly detection module (230) does not reach the standard threshold, the feedback signal is intercepted, and a reminder signal is sent to the terminal of the replacement personnel, so that the non-standard area marked by the area selection module (240) is transmitted to the replacement personnel; if the standard degree collected by the assembly detection module (230) reaches the standard threshold, the feedback signal is transmitted; When the assembly detection module (230) outputs that the degree of completion of one of the replacement steps reaches a completion threshold, the operation feedback module (220) is automatically triggered to send a feedback signal, causing the assembly detection module (230) to detect the standard degree again.

2. According to the Internet of Things-based blind plate status intelligent prevention and control monitoring system according to claim 1, it is characterized by: The blind plate replacement steps are as follows: Step 1: Close the valve; Step 2: Clean and inspect; Step 3: Install the blind plate; Step 4: Open the valve.

3. The intelligent prevention and control monitoring system for blind plate status based on the Internet of Things according to claim 2 is characterized in that: The operation feedback module (220) comprises an interface interaction module and a feedback prompt module; The interface interaction module is used to provide an "operation completed" button corresponding to each blind plate replacement step on the software platform interface of the terminal (100), for the replacement personnel and the operator to manually click after completing each replacement step, and to send a feedback signal when manually clicking; the feedback prompt module is used to pop up a prompt signal on the software platform interface of another terminal (100) when one of the terminals (100) sends and transmits a feedback signal, and the feedback prompt module is connected to the output end of the positioning sensing module (120), and when the positioning sensing module (120) sends a departure signal, the feedback prompt module is triggered to pop up a prompt signal.

4. According to claim 3, the intelligent prevention and control monitoring system for blind plate status based on the Internet of Things is characterized by: The assembly detection module (230) comprises a closing detection module, an opening detection module, an installation detection module and a standard degree detection module; The closing detection module is used to receive that the cable is in a locked state in the valve intelligent sensing tool at the valve, and the lock tongue is in a pop-up state in the blind plate intelligent sensing tool at the blind plate, and output that the closing valve step reaches the completion threshold; The opening detection module is used to receive that the cable is in an unlocked state in the valve intelligent sensing tool at the valve, and the lock tongue is in a pressed state in the blind plate intelligent sensing tool at the blind plate, and output that the valve opening step reaches the completion threshold; The standard detection module is used to use a structural similarity algorithm to measure the similarity between the actual image of the replaced blind plate and the standard assembly image, and set a standard threshold. When the similarity is ≥ the standard threshold, the current replacement step reaches the standard threshold and reaches the completion threshold at the same time. When the similarity is < the standard threshold, the current replacement step does not reach the standard threshold.

5. According to claim 4, the intelligent prevention and control monitoring system for blind plate status based on the Internet of Things is characterized by: The structural similarity algorithm expression is: ； in, and are the average values ​​of the actual image of the replaced blind plate and the standard assembly image, and are the variances of the actual image of the replaced blind plate and the standard assembly image, is the covariance, and is a constant.

6. The intelligent prevention and control monitoring system for blind plate status based on the Internet of Things according to claim 5 is characterized in that: The standard degree detection module also includes an image acquisition module, which is used to capture the replacement video through a camera device, intercept the actual image of the replaced blind plate at a time node, and transmit it to the standard degree detection module to measure the similarity between the actual image of the replaced blind plate and the standard assembly image, and transmit the replacement video in real time to the operator's terminal (100) through the Internet of Things transmission unit (300).

7. The intelligent prevention and control monitoring system for blind plate status based on the Internet of Things according to claim 6 is characterized by: The area selection module (240) includes a positioning perception module and a refinement marking module; The positioning perception module is used to decompose the frame of the replacement video in the image acquisition module, use the semantic segmentation algorithm to process each frame, obtain the mask of the installation area, and use the target detection algorithm within the mask range to identify the staff situation. When there is no one in the installation area, the unmanned signal is triggered, so that the refinement marking module is used to use the difference highlighting algorithm to mark the non-standard area corresponding to the difference point between the actual image of the replacement blind plate and the standard assembly image when the similarity degree detected by the standard detection module is less than the standard threshold.

8. The intelligent prevention and control monitoring system for blind plate status based on the Internet of Things according to claim 7 is characterized in that: When the positioning perception module triggers the unmanned signal, it includes the initial stage, the unmanned stage and the manned stage. The initial stage is when the staff has not left the installation area, the unmanned stage is when the staff has left the installation area, and the manned stage is when other people enter the installation area after the staff has left the installation area. The face recognition algorithm is used to extract the facial features of the initial stage and the manned stage in the installation area, including the following postures: Posture 1: if the facial features extracted from the human presence stage match the stored facial features of the staff member, and the facial features from the initial stage match the facial features from the human presence stage, the non-standard area marked by the refinement marking module is transmitted to the terminal (100) via the link established by the Internet of Things transmission unit (300); Posture 2: if the facial features extracted in the presence stage match the stored facial features of the staff member, and the facial features in the initial stage do not match the facial features in the presence stage, the connection between the two established terminals (100) is disconnected through the Internet of Things transmission unit (300), and the connection between the two new terminals (100) is re-established, and the non-standard area marked by the refinement marking module is transmitted to the new terminal (100); Posture three: if the facial features extracted from the human presence stage do not match the stored facial features of the staff member, a warning signal is transmitted to the feedback prompt module, so that the feedback prompt module transmits it to the terminal.

9. The intelligent prevention and control monitoring system for blind plate status based on the Internet of Things according to claim 7 is characterized in that: The assembly detection module (230) further comprises a light reminder module, the light reminder module being used to respectively configure four groups of red indicator lights and green indicator lights in the work area, so that the four groups of red indicator lights and green indicator lights respectively correspond to blind plate replacement steps, and when the assembly detection module (230) detects each blind plate replacement step, if the output reaches the standard threshold value and the completion threshold value signal, the green indicator light is controlled to work and the red indicator light is turned off; if the output does not reach the standard threshold value signal, the green indicator light is controlled to turn off and the red indicator light is controlled to work.

Images