A monitoring system and method for the inspection operation of high-altitude lifting machinery

Abstract

The present invention discloses a monitoring system and method for the inspection operation of high-altitude lifting machinery. The system includes an RFID electronic tag, a drone, a remote controller, a mobile client, a background system client, and a background cloud system. The background system client creates an inspection monitoring task and transmits it to the mobile client. The high-altitude inspection personnel select and execute the task on the mobile client. The RFID electronic tag installed in the safety helmet of the inspection personnel assists the drone in positioning. At the same time, the drone takes relevant videos and images, detects the posture of the inspection personnel, conducts analysis and early warning, and the videos and images are transmitted to the background system client for viewing. The present invention provides the original operation materials for the monitoring of the entire maintenance operation, enhancing the credibility of both parties; by integrating the entire process of the monitoring operation into a complete traceable system, it is convenient for the quick preservation and search of task-related information; without the direct participation of the operation personnel in the operation of the monitoring operation, the safety of the high-altitude operation personnel is ensured.

Description

Technical Field

[0001] The present invention belongs to the technical field of monitoring of construction inspections, and in particular relates to a monitoring system and method for inspection operations of high-altitude lifting machinery. Background Art

[0002] Tower cranes and gantry cranes are large-scale lifting machinery that are indispensable for construction sites, especially high-rise buildings. At the same time, due to the high risks involved in the installation and use of this equipment, there are major safety hazards. Accidents involving this type of lifting machinery often occur because the tower cranes are not regularly inspected and maintained as required. Some accidents are also caused by human operational errors. Therefore, inspection and maintenance processes are essential. At present, this type of construction machinery has basically achieved regular inspection and maintenance operations. However, how to ensure the quality and reliability of such high-altitude maintenance inspections, while ensuring the safety of inspection personnel, so that inspection and maintenance are reflected not only in quantity but also in quality, is a problem currently faced by equipment owners and maintenance parties. As the work content of the maintenance party cannot be recorded in real time, the equipment owner cannot know whether the maintenance party has actually carried out the maintenance work and the maintenance situation, nor can the safety of the maintenance personnel be guaranteed. Some inspection and maintenance units are currently installing similar equipment to monitor their operations. However, high-altitude inspection and maintenance operations typically require limited operating areas. Workers often rely on unhitched traction ropes or hanging baskets to reach the objects being inspected, limiting their range of movement. Furthermore, while holding the equipment, they lack the hands to use handheld recording devices to record real-time on-site operations. Existing portable recording devices (shoulder-clip or head-mounted) are typically fixed to a specific part of the body. While the operator is working, the recording device can only focus on a limited field of view and lacks flexibility, making it impossible to capture real-time video from all angles of on-site inspection and maintenance operations. Existing recording devices are mostly offline and lack data linkage to the lifting machinery, operator, recording device, or operational video. This makes it difficult for the client to verify the authenticity of the video. Furthermore, when an on-site safety incident occurs, accurate responsibility tracking is impossible, and any issues with on-site maintenance personnel cannot be promptly identified. Summary of the invention

[0003] In view of the above problems, the object of the present invention is to provide a monitoring system and method for inspection operations of high-altitude lifting machinery.

[0004] In order to achieve the above objectives, the following technical solutions are proposed:

[0005] A monitoring system for inspection of high-altitude lifting machinery, including

[0006] RFID electronic tags are installed in the safety helmets of high-altitude inspection workers. The tags contain a unique TID code for identification and positioning.

[0007] The unmanned aerial vehicle (UAV) is equipped with an RFID reader / writer to identify and locate RFID tags, and is also used to capture the working conditions and postures of the inspection personnel.

[0008] The remote controller is used to control the UAV.

[0009] The mobile client, whose program is installed on a mobile device, realizes the selection of inspection tasks and displays the real-time captured images and UAV flight status information.

[0010] The background system client, whose program is installed on a computer, realizes task setting, historical video record query, and RFID reader / writer parameter setting.

[0011] The background cloud system provides a program server and a database server, realizes online data live broadcast and recording, and provides object OSS storage services.

[0012] The background cloud system is divided into a cloud system foundation and functional modules. The system program runs on the program server in the cloud, and the newly created task data, real-time map data, videos and picture data generated during the monitoring task execution are stored in the database server.

[0013] Furthermore, the RFID electronic tag uses passive RFID in the ultra-high frequency band, and the range of the ultra-high frequency band is 920 - 924.5 MHz.

[0014] Furthermore, the remote controller and the UAV perform flight control and image transmission through the free radio frequency protocol, and perform docking of action control instructions and various image modes with the mobile client through the Type-C interface. The network mode of the mobile client is 5G NR.

[0015] Furthermore, the background system client is a B / S architecture program, which runs through the browser of the computer. The user selects a suitable map and mode according to the on-site monitoring needs, creates a new task on the page, selects the planned execution time, sets the following distance, lens angle and flight actions of the flight, uploads it to the cloud after saving for the mobile client to download. After the task is completed, the videos and photos during the task execution can be viewed in the image module. The hardware settings include reader / writer power, mode and frequency band settings, and can also be used for resource management.

[0016] A method for monitoring using the above-mentioned system includes the following steps:

[0017] 1) The background system client creates a new task and establishes the basic information of the monitoring task.

[0018] 2) Forms a task work order list, and uploads the task to the cloud server through the cloud http service for the mobile client to download the task in a timely manner.

[0019] 3) Before the high-altitude inspection staff starts the maintenance inspection operation, open the mobile client, select the inspection monitoring task dispatched by the mobile client, and after verifying the task information, start the drone aerial photography follow-up and execute relevant instructions;

[0020] 4) The high-altitude inspection staff is performing the maintenance inspection task at high altitude. The RFID reader on the drone captures the RFID tag RSSI and phase angle in real time and sends it to the drone positioning main control board. After processing, the real-time position of the operator is fed back to the background system client. At the same time, the drone camera transmits the captured video to the positioning main control board in real time, calculates and feeds the result back to the drone attitude control system to achieve real-time fixed-distance shooting of the staff by the drone;

[0021] 5) The high-altitude inspection staff is performing the maintenance inspection task at high altitude. The drone camera conducts machine vision detection of the human body posture, judges whether the posture of the high-altitude inspection personnel is reasonable and whether there are dangerous operations, can give real-time warnings, and gives warning reminders through the drone remote dialogue module;

[0022] 6) During the maintenance task, the background management personnel or the equipment owner can log in to the background system client, select the corresponding monitoring task, view the RFID information and inspection task description, click on the video, and view the live maintenance inspection live broadcast screen in real time. After the maintenance task is completed, the background management personnel or the equipment owner can log in to the background system client, select the task, and view the saved maintenance inspection videos and photos.

[0023] Further, the basic information in step 1) includes the personal information of the high-altitude inspection personnel being monitored, the RFID unique identifier, the drone model, the endurance time, the GPS positioning information of the inspection location, the operation height, the work content of the inspection task, the equipment party information, the task information of the inspection monitoring operation point, the key actions and detailed precautions for inspection monitoring shooting.

[0024] Further, the specific operation process of step 5) is as follows: The drone captures the video of the operator's posture, displays the video on the background system client, imports the video into the pre-trained deep learning network model through the background system client, judges the right or wrong of the human posture in the video through the deep learning network, and feeds the judgment result back to the background system client. For the result, communicate with the maintenance personnel in the way of drone dialogue. Before using the deep learning network model, perform video dynamic image recognition training on the deep learning. When the accuracy rate reaches more than 70%, it can be put into use.

[0025] The beneficial effects of the present invention are as follows:

[0026] 1) It provides the original operation materials for the monitoring of the entire maintenance operation and enhances the credibility of both parties;

[0027] 2) By integrating the whole process of the monitoring operation into a complete traceable system, it is convenient to quickly save and search for task-related information;

[0028] 3) There is no need for the operators to directly participate in the operation of the monitoring task, ensuring the safety of the high-altitude operators. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 It is the system architecture diagram of the present invention;

[0030] Figure 2 It is the schematic diagram of the monitoring method of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0031] The present invention will be further described below in conjunction with the accompanying drawings of the specification, but the protection scope of the present invention is not limited thereto.

[0032] As Figure 1As shown in the figure, a monitoring system for the inspection operation of high-altitude lifting machinery includes an RFID electronic tag installed inside the safety helmet of high-altitude inspection staff. The tag contains a unique TID code for identity recognition and positioning. The RFID electronic tag is connected to a drone through the ultra-high frequency band of 920 - 924.5 MHz. The drone includes a flight control module, an imaging module, a dialogue module, and an RFID reader. The RFID reader installed inside the drone identifies and locates the RFID tag to determine the position of high-altitude inspection personnel, and is also used to capture the working conditions and postures of the inspection personnel. The drone captures video of the operator's posture and displays the video on the client of the background system. The video is imported into a pre-trained deep learning network model through the client of the background system. The deep learning network judges the correctness of the human posture in the video and feeds back the judgment result to the client of the background system. For the result, communicate with maintenance personnel by means of drone dialogue. Before using the deep learning network model, video dynamic image recognition training should be carried out on the deep learning. When the accuracy rate reaches more than 70%, it can be put into use. The remote controller includes a wireless flight control, an image receiver, and a power supply module. The remote controller and the drone perform flight control and image transmission through a free radio frequency protocol and dock with the mobile client through a Type-C interface for action control instructions and various image modes. The mobile client includes a map module, a task module, and an image module. Its program is installed on a mobile device such as a mobile phone or a tablet computer to realize the selection of inspection tasks, display real-time captured images and drone flight status information. The client of the background system, whose program is installed on a computer, includes a map module, a planned task, an image module, hardware settings, and resource management. The client of the background system is a B / S architecture program and runs through the browser of the computer. Users can select a suitable map and mode according to the on-site monitoring needs, create a new task on the page, select the planned execution time, set the follow-up distance, lens angle, and flight actions of the flight, and upload it to the cloud after saving for the mobile client to download. After completing the task, the video and photos during the task execution can be viewed in the image module. The hardware settings include the power, mode, and frequency band settings of the reader, and can also be used for resource management. The background cloud system is divided into a cloud system foundation and a function module. The system program runs on the program server in the cloud. The newly created task data, real-time map data, video and picture data generated during the execution of the monitoring task are saved in the database server to realize online data live broadcast and recording, and provide object OSS storage services.

[0033] As Figure 2 shown, a method for monitoring using the above-mentioned system includes the following steps:

[0034] 1) The back-end system client creates a task and establishes the basic information of the monitoring task. The basic information includes the personal information of the high-altitude inspection personnel to be monitored, the unique RFID identifier, the UAV model, the endurance time, the GPS positioning information of the inspection location, the operation altitude, the work content of the inspection task, the equipment party information, the task information of the inspection monitoring operation point, the key actions captured by the inspection monitoring, and the details and precautions.

[0035] 2) A task work order list is formed, and the task is uploaded to the cloud server through the cloud http service for the mobile client to download the task in a timely manner.

[0036] 3) Before the high-altitude inspection staff starts the maintenance inspection operation, open the mobile client, select the inspection monitoring task assigned by the mobile client, and start the UAV aerial photography follow-up and execute relevant instructions after verifying the task information.

[0037] 4) When the high-altitude inspection staff is performing the maintenance inspection task at high altitude, the RFID reader on the UAV captures the RFID tag RSSI and phase angle in real time and sends it to the UAV positioning main control board. After processing, the real-time position of the operator is fed back to the back-end system client. At the same time, the UAV camera transmits the captured video to the positioning main control board in real time, calculates and feeds the result back to the UAV attitude control system to achieve real-time fixed-distance shooting of the staff by the UAV.

[0038] 5) When the high-altitude inspection staff is performing the maintenance inspection task at high altitude, the UAV camera performs machine vision to detect the human body posture, judges whether the posture of the high-altitude inspection personnel is reasonable and whether there are dangerous operations, can give a real-time warning, and gives a warning reminder through the UAV remote dialogue module.

[0039] 6) During the maintenance task, the back-end management personnel or the equipment party owner can log in to the back-end system client, select the corresponding monitoring task, view the RFID information and the inspection task description, click on the video, and view the live maintenance inspection live broadcast screen in real time. After the maintenance task is completed, the back-end management personnel or the equipment party owner can log in to the back-end system client, select the task, and view the saved maintenance inspection videos and photos.

Claims

1. A monitoring system for the inspection operation of high-altitude lifting machinery, characterized in that including an RFID electronic tag installed inside the safety helmet of high-altitude inspection staff. The tag contains a unique TID code for identity recognition and positioning; a drone equipped with an RFID reader / writer to identify and locate the RFID tag, and also used to capture the working conditions and postures of the inspection staff; a remote controller for controlling the drone; a mobile client, whose program is installed on a mobile device to implement the selection of inspection tasks, display real-time captured images and drone flight status information; a background system client, whose program is installed on a computer to implement task setting, historical video record query and RFID reader / writer parameter setting; a background cloud system providing a program server and a database server to implement online data live broadcast and recording, and providing object OSS storage services; A method for monitoring using the above system, including the following steps: 1) The background system client creates a task and establishes the basic information of the monitoring task; 2) Form a task work order list and upload the task to the cloud server through the cloud http service for the mobile client to download the task in a timely manner; 3) Before the high-altitude inspection staff starts the maintenance inspection operation, open the mobile client, select the inspection monitoring task dispatched by the mobile client, and after querying the task information is correct, start the drone aerial photography follow-up and execute relevant instructions; 4) When the high-altitude inspection staff is performing the maintenance inspection task at high altitude, the RFID reader / writer on the drone captures the RFID tag RSSI and phase angle in real time and sends it to the drone positioning main control board. After processing, the real-time position of the operator is fed back to the background system client. At the same time, the drone camera transmits the captured video to the positioning main control board in real time, calculates and feeds the result back to the drone attitude control system to achieve real-time fixed-distance shooting of the staff by the drone; 5) When the high-altitude inspection staff is performing the maintenance inspection task at high altitude, the drone camera performs machine vision to detect the human body posture, judges whether the posture of the high-altitude inspection personnel is reasonable and whether there are dangerous operations, can give a real-time warning, and gives a warning reminder through the drone remote dialogue module; 6) During the maintenance task, the background management personnel or the equipment owner can log in to the background system client, select the corresponding monitoring task, view the RFID information and inspection task description, click on the video to view the live maintenance inspection video in real time. After the maintenance task is completed, the background management personnel or the equipment owner can log in to the background system client, select the task, and view the saved maintenance inspection videos and photos; 7) The specific operation process of step 5) is as follows: The drone captures the posture video of the operator, displays the video on the background system client, imports the video into the pre-trained deep learning network model through the background system client, judges the right or wrong of the human posture in the video through the deep learning network, and feeds the judgment result back to the background system client. For the result, communicate with the maintenance personnel in the way of drone dialogue. Before using the deep learning network model, perform video dynamic image recognition training on the deep learning. When the accuracy rate reaches more than 70%, it can be put into use.

2. The monitoring system according to claim 1, wherein, The RFID electronic tag uses passive RFID in the ultra-high frequency band, and the range of the ultra-high frequency band is 920 - 924.5 MHz.

3. The monitoring system according to claim 1, characterized in that, The remote controller and the drone perform flight control and image transmission through the free radio frequency protocol, and dock with the mobile client for action control instructions and various image modes through the Type-C interface. The network mode of the mobile client is 5G NR.

4. The monitoring system according to claim 1, characterized in that The background system client is a B / S architecture program and runs through the browser of the computer.

5. The monitoring system according to claim 1, characterized in that, The basic information in step 1) includes the personal information of the high-altitude inspection personnel being monitored, the RFID unique identifier, the drone model, the endurance time, the GPS positioning information of the inspection location, the operation altitude, the work content of the inspection task, the equipment party information, the inspection monitoring operation point task information, the key actions captured during the inspection monitoring, and the details and precautions.

Images