Factory safety inspection method and device based on digital twinning and medium

Abstract

The invention belongs to the technical field of factory safety, and particularly relates to a factory safety inspection method and equipment based on digital twinning and a medium. The method comprises the steps that laser point cloud and oblique photography information of a factory are collected, and a factory digital twin system is built; calibrating all to-be-inspected point locations in a factory digital twin system, and dividing the to-be-inspected point locations into an indoor inspection queue and an outdoor inspection queue; the factory digital twin system sends the indoor and outdoor inspection queues to a four-footed inspection robot and an unmanned aerial vehicle; the four-footed inspection robot and the unmanned aerial vehicle arrive at a place provided by the inspection queue to carry out inspection work and send data back to the factory digital twin system; the factory digital twin system hitches inspection point positions, inspection equipment information and inspection information, and inspection history and inspection detailed information can be checked. The problems that manual factory safety inspection is high in dangerousness, not easy to supervise, difficult to check inspection history, incapable of comprehensively covering all areas inside and outside a factory and the like are solved.

Description

Technical Field

[0001] The present invention belongs to the technical field of factory safety, and more specifically, relates to a factory safety inspection method, equipment and medium based on digital twins. Background Art

[0002] Factory safety inspections are mainly conducted through regular inspections by security inspectors and irregular spot checks by superior inspection departments. A dial is placed at the inspection site or equipment. When the security inspector arrives at a place, he or she turns the dial to point to the inspection time. Another method is to record the inspection situation by throwing a slip of paper. The security inspector puts the slip of paper with the inspection time written on it into a cardboard box. The superior department then conducts spot checks on the inspection situation of the security inspector. This traditional industrial safety inspection method is dangerous, difficult to supervise, and difficult to leave traces.

[0003] Digital twins are based on models and data, and through methods such as multidisciplinary coupled simulation, they complete the precise mapping of physical entities in the real world to mirrored digital models in the virtual world, so as to achieve the synchronous presentation of the state of physical entities in the digital space.

[0004] Chinese patent document CN114815757A discloses a virtual inspection method for digital twins of cement plants, which includes the following steps: (1) 3D modeling: using 3D modeling software, a virtual plant model is constructed at a 1:1 ratio; (2) operation and maintenance system construction: an operation and maintenance system with a good interactive interface is constructed. The hardware required for the operation and maintenance system construction is an interactive terminal, a server, and an operating system, and the software is a platform for realizing virtual inspection; (3) interface development: the data involved in the virtual inspection comes from multiple business modules in the operation stage of the cement plant, including video surveillance, DCS, and digital assets. Relevant data is obtained from each business module through the interface; (4) data processing: the data obtained from each business module through the interface is processed; Classify the various types of data obtained by the business module; (5) Data association: Based on the equipment number as the basis for data association, integrate the data pointing to the same equipment number; (6) Inspection route drawing: In the three-dimensional virtual scene, draw the inspection route according to the pre-set equipment to be inspected and the inspection order, and bind the equipment and equipment data to be inspected in the route; (7) Data binding: Specify the equipment to be inspected along the route and the inspection items to be checked; (8) Inspection start: After the inspection is started, roam along the specified route in the virtual three-dimensional scene from a first-person perspective; (9) Generate report: When the inspection reaches the end of the route, click "Generate inspection report" and the system will automatically generate an inspection report. Although this method realizes virtual inspection based on digital twins, its core is to collect real-time data in business systems such as DCS and display it in the form of digital twins. In fact, it only transfers the traditional data dashboard to the digital twin system, and cannot detect real-time images, temperatures, and gas concentrations inside and outside the factory, especially at high altitudes outside.

[0005] Chinese patent document CN116311023A discloses a method and system for equipment inspection based on 5G communication and virtual reality, which includes: collecting RGB-D image data; using YOLOv3 for target detection and tracking and positioning according to the ASMS algorithm to generate targets with semantic information; using the generative adversarial network GAN algorithm to repair the depth image; optimizing the pose of the three-dimensional scene model through the three-dimensional reconstruction BundleFusion algorithm; combining the target with semantic information with the three-dimensional scene model into a three-dimensional digital factory model through coordinate position conversion. The invention realizes the digital twin factory based on 5G communication and virtual reality technology, uses 5G communication technology to provide real-time data transmission, and uses virtual reality technology to reflect equipment monitoring and inspection work in a three-dimensional intuitive form, establishes a knowledge base of equipment faults, conducts intelligent technology research and judgment, and realizes intelligent equipment management and fault inspection. Although this method includes digital twins, its core points and focus are: based on technologies such as 5G communication machine YOLOv3, the data generated by the inspection is processed into a digital twin model. It is impossible to achieve unmanned, automated, and intelligent real-time multi-factor detection inside and outside the factory based on the completed digital twin model.

[0006] In view of this, the present invention designs a factory safety inspection method based on digital twins. Summary of the invention

[0007] The present invention aims to overcome the defects of the above-mentioned prior art and provide a factory safety inspection method based on digital twins to solve the problems of existing manual factory safety inspections, which are dangerous, difficult to supervise, difficult to view inspection history, and unable to fully cover all areas inside and outside the factory by relying on a single device.

[0008] The invention also discloses a device loaded with the inspection method.

[0009] The invention also discloses a computer storage medium for realizing the inspection method.

[0010] The detailed technical scheme of the present invention is as follows:

[0011] A factory safety inspection method based on digital twins, the method comprising:

[0012] S1. Collect the laser point cloud and oblique photography information of the factory and build a factory digital twin system;

[0013] S2. All inspection points are calibrated in the factory digital twin system. The factory digital twin system divides the inspection points into indoor inspection queues and outdoor inspection queues according to whether the inspection points are distributed indoors or outdoors.

[0014] S3, the factory digital twin system sends the indoor inspection queue to the four-legged inspection robot;

[0015] S4, the factory digital twin system sends the outdoor inspection queue to the drone;

[0016] S5: The four-legged inspection robot arrives at the location provided by the indoor inspection team, takes photos, measures temperature, and performs gas detection inspections, and generates inspection information based on the data and sends it back to the factory digital twin system.

[0017] S6: The drone arrives at the location provided by the outdoor inspection team, takes photos, measures temperature, and performs gas detection inspections, and generates inspection information based on the data and sends it back to the factory digital twin system.

[0018] S7. The factory digital twin system links the inspection points, inspection equipment information, and inspection information, and can view the inspection history and detailed inspection information.

[0019] Preferably, according to the present invention, the equipment carried by the quadruped inspection robot includes a visible light camera, a thermal imaging camera and a gas detector.

[0020] Preferably, according to the present invention, the quadruped inspection robot includes a sensor system for autonomous navigation and obstacle avoidance.

[0021] Preferably, according to the present invention, the equipment carried by the drone includes a visible light camera, a thermal imaging camera and a gas detector.

[0022] Preferably according to the present invention, the UAV comprises a GPS system for automatic flight control and position positioning.

[0023] Preferably, according to the present invention, the four-legged inspection robot and the drone are both equipped with wireless communication modules to realize data transmission with the digital twin system.

[0024] Preferably, according to the present invention, the digital twin system includes a user interface for displaying inspection results and historical records.

[0025] In another aspect of the present invention, a factory safety inspection device based on digital twin is provided, the device comprising:

[0026] at least one processor; and,

[0027] a memory communicatively connected to the at least one processor; wherein,

[0028] The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to:

[0029] Collect the factory's laser point cloud and oblique photography information to build a factory digital twin system;

[0030] All inspection points are calibrated in the factory digital twin system. The factory digital twin system divides the inspection points into indoor inspection queues and outdoor inspection queues according to whether the inspection points are distributed indoors or outdoors.

[0031] The factory digital twin system sends indoor inspection queue information to the four-legged inspection robot;

[0032] The factory digital twin system sends outdoor inspection queue information to drones;

[0033] The four-legged inspection robot arrives at the location provided by the indoor inspection team, performs inspections such as taking photos, measuring temperature, and detecting gas, and sends the data back to the factory digital twin system;

[0034] The drone arrives at the location provided by the outdoor inspection team, takes photos, measures temperature, and performs gas detection inspections, and sends the data back to the factory digital twin system;

[0035] The factory digital twin system connects inspection points, inspection equipment information, and inspection information, and can view inspection history and detailed inspection information.

[0036] In another aspect of the present invention, a computer storage medium is provided, storing computer executable instructions, wherein the computer executable instructions are configured to:

[0037] Collect the factory's laser point cloud and oblique photography information to build a factory digital twin system;

[0038] All inspection points are calibrated in the factory digital twin system. The factory digital twin system divides the inspection points into indoor inspection queues and outdoor inspection queues according to whether the inspection points are distributed indoors or outdoors.

[0039] The factory digital twin system sends indoor inspection queue information to the four-legged inspection robot;

[0040] The factory digital twin system sends outdoor inspection queue information to drones;

[0041] The four-legged inspection robot arrives at the location provided by the indoor inspection team, performs inspections such as taking photos, measuring temperature, and detecting gas, and sends the data back to the factory digital twin system;

[0042] The drone arrives at the location provided by the outdoor inspection team, takes photos, measures temperature, and performs gas detection inspections, and sends the data back to the factory digital twin system;

[0043] The factory digital twin system connects inspection points, inspection equipment information, and inspection information, and can view inspection history and detailed inspection information.

[0044] Compared with the prior art, the present invention has the following beneficial effects:

[0045] (1) Compared with traditional manual inspections of factory safety, this invention uses quadruped inspection robots and drones, which eliminates the need for on-site inspection personnel, saves labor costs, and ensures personal safety;

[0046] (2) The invention can leave traces of inspection events to ensure that the inspection work is 100% executed;

[0047] (3) The invention can cover all locations including indoors and outside the factory, and can conduct inspections of the entire factory without blind spots;

[0048] (4) The historical records of the invention can archive the inspection work in an informationized manner, realize the tracing back of the inspection work, and solve the problems of the traditional manual inspection paper archives that are inconvenient to view and easy to falsify. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 is a flow chart of the method of the present invention. DETAILED DESCRIPTION

[0050] The present disclosure is further described below in conjunction with the accompanying drawings and embodiments.

[0051] Embodiment 1,

[0052] like Figure 1 As shown, a factory safety inspection method based on digital twins, the method comprising:

[0053] S1. Collect the laser point cloud and oblique photography information of the factory and build a factory digital twin system;

[0054] S2. All inspection points are calibrated in the factory digital twin system. The factory digital twin system divides the inspection points into indoor inspection queues and outdoor inspection queues according to whether the inspection points are distributed indoors or outdoors.

[0055] S3, the factory digital twin system sends the indoor inspection queue to the four-legged inspection robot;

[0056] S4, the factory digital twin system sends the outdoor inspection queue to the drone;

[0057] S5: The four-legged inspection robot arrives at the location provided by the indoor inspection team, takes photos, measures temperature, and performs gas detection inspections, and generates inspection information based on the data and sends it back to the factory digital twin system.

[0058] S6: The drone arrives at the location provided by the outdoor inspection team, takes photos, measures temperature, and performs gas detection inspections, and generates inspection information based on the data and sends it back to the factory digital twin system.

[0059] S7. The factory digital twin system links the inspection points, inspection equipment information, and inspection information, and can view the inspection history and detailed inspection information.

[0060] The equipment carried by the four-legged inspection robot includes a visible light camera, a thermal imaging camera and a gas detector.

[0061] The quadruped inspection robot includes a sensor system for autonomous navigation and obstacle avoidance.

[0062] The equipment carried by the drone includes a visible light camera, a thermal imaging camera and a gas detector.

[0063] The drone includes a GPS system for automatic flight control and position determination.

[0064] The four-legged inspection robot and the drone are both equipped with wireless communication modules to realize data transmission with the digital twin system.

[0065] The digital twin system includes a user interface for displaying inspection results and historical records.

[0066] Embodiment 2,

[0067] This embodiment also provides a factory safety inspection device based on digital twins, the device comprising:

[0068] at least one processor; and,

[0069] a memory communicatively connected to the at least one processor; wherein,

[0070] The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to:

[0071] Collect the factory's laser point cloud and oblique photography information to build a factory digital twin system;

[0072] All inspection points are calibrated in the factory digital twin system. The factory digital twin system divides the inspection points into indoor inspection queues and outdoor inspection queues according to whether the inspection points are distributed indoors or outdoors.

[0073] The factory digital twin system sends indoor inspection queue information to the four-legged inspection robot;

[0074] The factory digital twin system sends outdoor inspection queue information to drones;

[0075] The four-legged inspection robot arrives at the location provided by the indoor inspection team, performs inspections such as taking photos, measuring temperature, and detecting gas, and sends the data back to the factory digital twin system;

[0076] The drone arrives at the location provided by the outdoor inspection team, takes photos, measures temperature, and performs gas detection inspections, and sends the data back to the factory digital twin system;

[0077] The factory digital twin system connects inspection points, inspection equipment information, and inspection information, and can view inspection history and detailed inspection information.

[0078] In this embodiment, the electronic device may include, but is not limited to: personal computers, server computers, workstations, desktop computers, laptop computers, notebook computers, mobile computing devices, smart phones, tablet computers, cellular phones, personal digital assistants (PDAs), handheld devices, messaging devices, wearable computing devices, consumer electronic devices, and the like.

[0079] Embodiment 3,

[0080] This embodiment further provides a computer storage medium storing computer executable instructions, wherein the computer executable instructions are configured as follows:

[0081] Collect the factory's laser point cloud and oblique photography information to build a factory digital twin system;

[0082] All inspection points are calibrated in the factory digital twin system. The factory digital twin system divides the inspection points into indoor inspection queues and outdoor inspection queues according to whether the inspection points are distributed indoors or outdoors.

[0083] The factory digital twin system sends indoor inspection queue information to the four-legged inspection robot;

[0084] The factory digital twin system sends outdoor inspection queue information to drones;

[0085] The four-legged inspection robot arrives at the location provided by the indoor inspection team, performs inspections such as taking photos, measuring temperature, and detecting gas, and sends the data back to the factory digital twin system;

[0086] The drone arrives at the location provided by the outdoor inspection team, takes photos, measures temperature, and performs gas detection inspections, and sends the data back to the factory digital twin system;

[0087] The factory digital twin system connects inspection points, inspection equipment information, and inspection information, and can view inspection history and detailed inspection information.

Claims

1. A factory safety inspection method based on digital twins, characterized in that: The method comprises: S1. Collect the laser point cloud and oblique photography information of the factory and build a factory digital twin system; S2. All inspection points are calibrated in the factory digital twin system. The factory digital twin system divides the inspection points into indoor inspection queues and outdoor inspection queues according to whether the inspection points are distributed indoors or outdoors. S3, the factory digital twin system sends the indoor inspection queue to the four-legged inspection robot; S4, the factory digital twin system sends the outdoor inspection queue to the drone; S5: The four-legged inspection robot arrives at the location provided by the indoor inspection team, takes photos, measures temperature, and performs gas detection inspections, and generates inspection information based on the data and sends it back to the factory digital twin system. S6: The drone arrives at the location provided by the outdoor inspection team, takes photos, measures temperature, and performs gas detection inspections, and generates inspection information based on the data and sends it back to the factory digital twin system. S7. The factory digital twin system links the inspection points, inspection equipment information, and inspection information, and can view the inspection history and detailed inspection information.

2. A factory safety inspection method based on digital twins according to claim 1, characterized in that: The equipment carried by the four-legged inspection robot includes a visible light camera, a thermal imaging camera and a gas detector.

3. The factory safety inspection method based on digital twin according to claim 1 is characterized in that: The quadruped inspection robot includes a sensor system for autonomous navigation and obstacle avoidance.

4. The factory safety inspection method based on digital twin according to claim 1 is characterized in that: The equipment carried by the drone includes a visible light camera, a thermal imaging camera and a gas detector.

5. The factory safety inspection method based on digital twin according to claim 1 is characterized in that: The drone includes a GPS system for automatic flight control and position determination.

6. A factory safety inspection method based on digital twins according to claim 1, characterized in that: The four-legged inspection robot and the drone are both equipped with wireless communication modules for realizing data transmission with the digital twin system.

7. A factory safety inspection method based on digital twins according to claim 1, characterized in that: The digital twin system includes a user interface for displaying inspection results and historical records.

8. A factory safety inspection device based on digital twins, characterized in that: The device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to: Collect the factory's laser point cloud and oblique photography information to build a factory digital twin system; All inspection points are calibrated in the factory digital twin system. The factory digital twin system divides the inspection points into indoor inspection queues and outdoor inspection queues according to whether the inspection points are distributed indoors or outdoors. The factory digital twin system sends indoor inspection queue information to the four-legged inspection robot; The factory digital twin system sends outdoor inspection queue information to drones; The four-legged inspection robot arrives at the location provided by the indoor inspection team, performs inspections such as taking photos, measuring temperature, and detecting gas, and sends the data back to the factory digital twin system; The drone arrives at the location provided by the outdoor inspection team, takes photos, measures temperature, and performs gas detection inspections, and sends the data back to the factory digital twin system; The factory digital twin system connects inspection points, inspection equipment information, and inspection information, and can view inspection history and detailed inspection information.

9. A computer storage medium storing computer executable instructions, characterized in that: The computer executable instructions are configured to: Collect the factory's laser point cloud and oblique photography information to build a factory digital twin system; All inspection points are calibrated in the factory digital twin system. The factory digital twin system divides the inspection points into indoor inspection queues and outdoor inspection queues according to whether the inspection points are distributed indoors or outdoors. The factory digital twin system sends indoor inspection queue information to the four-legged inspection robot; The factory digital twin system sends outdoor inspection queue information to drones; The four-legged inspection robot arrives at the location provided by the indoor inspection team, performs inspections such as taking photos, measuring temperature, and detecting gas, and sends the data back to the factory digital twin system; The drone arrives at the location provided by the outdoor inspection team, takes photos, measures temperature, and performs gas detection inspections, and sends the data back to the factory digital twin system; The factory digital twin system connects inspection points, inspection equipment information, and inspection information, and can view inspection history and detailed inspection information.

Images