Safety monitoring and equipment remote approval method and system based on depth camera and two-dimensional code

Abstract

The invention relates to the technical field of remote approval, in particular to a safety monitoring and equipment remote approval method and system based on a depth camera and a two-dimensional code. The depth camera obtains depth information, and the distance between the worker and the electrified body is deduced through one-time calculation; performing judgment according to a primary calculation result, and performing alarm prompt according to a judgment result; and a depth camera is used to carry out two-dimensional code image identification, and the two-dimensional code image is judged. Misoperation caused by the fact that an operation object does not conform to the actual requirement of the bill in the working process is prevented; life safety accidents caused by insufficient safety distance between the field staff and the power equipment are prevented; therefore, the method has a certain benefit for standardizing field operation behaviors. And the information collected by the depth camera can be reutilized, for example, the information can be used for restoring a three-dimensional scene on site and is convenient for equipment installation or engineering transformation.

Description

Technical Field

[0001] The present invention relates to the field of remote verification technology, and in particular to a method and system for security monitoring and remote verification of equipment based on a depth camera and a QR code. Background Art

[0002] A depth camera is a device that can obtain the distance information between an object in a scene and the camera. It is also called a depth camera. As an emerging distance measurement hardware facility. In recent years, the application fields of depth camera technology have involved all aspects of our lives, such as computer vision, urban scene reconstruction, human-computer interaction, medicine, robot positioning and navigation. However, there are not many applications of this technology in the field of power systems.

[0003] At present, in the power system, real-time video monitoring of the work site has become a norm. The distance between the operator and the live equipment is very important. When the distance between the two is less than the safe distance, the operator will face a greater operating risk. At present, the distance between the two can only be measured manually before work, and real-time monitoring is not possible during the work process. Similarly, the height of the operator from the ground when climbing is also very important, and it is currently impossible to monitor in real time. However, based on the technical characteristics of the depth camera itself, it is applied to the power system. Preliminary observation shows that it can not only monitor the work behavior of the on-site personnel, but also monitor the distance between the on-site personnel and the live equipment or the ground in real time. It has the advantages of high precision and good real-time performance. It is a technology that combines monitoring, data acquisition and measurement.

[0004] A QR code, also known as a two-dimensional barcode, is a type of code that uses specific geometric shapes and is distributed in two dimensions in black and white. It is used to record data information and is widely used in identity recognition, logistics, transportation, manufacturing and other fields. It can achieve the uniqueness of a one-object-one-code QR code label, so it can be used to identify various types of power equipment in the power field, ensure the uniqueness of the operated object, and avoid misoperation or misoperation of equipment.

[0005] In the power system, accidents with adverse effects caused by mismeasurement, misoperation, non-real-time distance monitoring, and single early warning methods often occur, and more effective supervision methods need to be explored. After preliminary analysis and research, this patent based on depth camera and QR code technology can reduce the occurrence of such situations to a certain extent. Summary of the invention

[0006] In view of the problems existing in the above-mentioned prior art, the present invention is proposed.

[0007] Therefore, the present invention provides a safety monitoring and equipment remote verification method based on a depth camera and a QR code. In view of the need for monitoring the distance between the human body and live equipment, the traditional method estimates it through the eyes of oneself or others, or limits the safe working range by pre-measurement. However, during the work process, the head, feet, hands and other parts of the staff will be uncertain due to work, which poses a great safety hazard. The present invention uses a depth camera to monitor in real time and in all directions, which increases safety.

[0008] At the same time, when the staff verifies the operation object on site, the traditional method is to verify it through on-site personnel. This method only verifies it once, which may cause the problem that the required work object does not match the actual work object, and also brings greater safety risks. The present invention increases the accuracy of equipment operation and reduces the risk of misoperation.

[0009] In order to solve the above technical problems, the present invention provides the following technical solutions, a safety monitoring and equipment remote verification method based on a depth camera and a QR code, comprising: the depth camera acquires depth information, and the distance between the worker and the charged object is derived through a calculation;

[0010] Make a judgment based on a calculation result and issue an alarm based on the judgment result;

[0011] Use the depth camera to recognize and judge the QR code image.

[0012] As a preferred solution of the method for security monitoring and remote device verification based on a depth camera and a QR code according to the present invention, the depth camera acquires depth information including:

[0013] The depth camera obtains the distance between the object in the scene and the camera, and calculates the depth information based on the principle of similar triangles.

[0014] As a preferred solution of the method for security monitoring and remote device verification based on depth camera and QR code of the present invention, wherein: the one-time calculation includes:

[0015] In the three-dimensional coordinate system, the distance between the worker and the charged object is calculated, and based on the real-time measurement of the distance value, on-site operations are monitored, prompted and warned.

[0016] As a preferred solution of the method for security monitoring and remote device verification based on depth camera and QR code of the present invention, wherein: the judgment of the calculation result once includes:

[0017] When the distance value is compared with the preset threshold, corresponding sound, light, and vibration prompts are given according to different comparison results.

[0018] As a preferred solution of the method for security monitoring and remote equipment verification based on a depth camera and a QR code described in the present invention, the preset threshold is set at different distance levels according to the voltage level.

[0019] As a preferred solution of the method for safety monitoring and remote equipment verification based on depth camera and QR code described in the present invention, the use of depth camera for QR code image recognition includes: the depth camera collects the two-dimensional image of the power equipment, identifies the QR code affixed to the equipment in the picture, and the identified result matches the actual required work object. If there is a match, it is agreed to be executed; if there is no match, it is not executed.

[0020] As a preferred solution of the method for security monitoring and remote device verification based on a depth camera and a two-dimensional code according to the present invention, wherein: the judging of the two-dimensional code image includes:

[0021] The camera obtains the QR code image, shoots or scans it through the depth camera, and performs image preprocessing on the QR code to confirm the QR code area and orientation. The QR code is divided into multiple blocks, and each block is identified and decoded to obtain the content of each block. The error correction mechanism of the QR code is used to detect and repair possible errors, ensure the integrity and accuracy of the information, and extract the real data content.

[0022] As a preferred solution of the security monitoring and equipment remote verification system based on depth camera and QR code described in the present invention, it includes: a background management module, an integration module, and power equipment.

[0023] A computer device comprises a memory and a processor, wherein the memory stores a computer program, and wherein when the processor executes the computer program, the steps of any one of the methods for security monitoring and remote device verification based on a depth camera and a QR code are implemented.

[0024] A computer-readable storage medium having a computer program stored thereon, characterized in that when the computer program is executed by a processor, the steps of any one of the methods for security monitoring and remote device verification based on a depth camera and a QR code are implemented.

[0025] The beneficial effects of the present invention include: preventing misoperation caused by the inconsistency between the operation object and the actual requirements of the bill during the work process; preventing life safety accidents caused by insufficient safety distance between on-site workers and power equipment; forming a supervisory role, which is beneficial to standardizing on-site operation behaviors. The information collected by the depth camera can be reused, for example, it can restore the on-site three-dimensional scene, which is useful for equipment installation or engineering renovation. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0027] Figure 1 A schematic flow chart of a method for security monitoring and remote device verification based on a depth camera and a QR code provided in accordance with an embodiment of the present invention.

[0028] Figure 2 A schematic diagram of calculating the distance between a depth camera and a point on the surface of a device based on data known and acquired by the depth camera, in a method for security monitoring and remote device verification based on a depth camera and a QR code provided by an embodiment of the present invention.

[0029] Figure 3 A structural diagram of a security monitoring and equipment remote verification system based on a depth camera and a QR code provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0030] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the drawings of the specification. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in the art without creative work should fall within the scope of protection of the present invention.

[0031] Example 1

[0032] Reference Figure 1-Figure 2 , which is the first embodiment of the present invention, provides a security monitoring and equipment remote verification method based on a depth camera and a QR code, including:

[0033] S1: The depth camera obtains the depth information and derives the distance between the worker and the charged object through a calculation.

[0034] The depth camera acquires depth information including:

[0035] The depth camera obtains the distance between the object in the scene and the camera, and calculates the depth information based on the principle of similar triangles.

[0036] In response to the above problems, a real-time monitoring method based on depth camera is proposed;

[0037] The depth camera can obtain depth information and deduce the distance between the worker and the charged object through calculation. When the distance is less than the safety threshold, a reminder will be given, including a remote alarm prompt.

[0038] A depth camera is a device that can obtain the distance information between objects in the scene and the camera. Take a binocular stereo depth camera as an example. Figure 2 As shown:

[0039] exist Figure 2 In the figure, the coordinate axis is perpendicular to the paper and points outward, indicating the vertical distance from the surface point (target point) P of the object to be measured to the center point of the camera, that is, the depth information of the image; the focal length f and the left and right camera baselines b are known parameters, x l and x r are the pixel coordinates of the target point in the left and right camera images respectively. According to the principle of similar triangles, we can get:

[0040]

[0041] The depth information z can be calculated from formula (1):

[0042]

[0043] z1 and z2 are two pieces of depth information obtained. Obviously, in a three-dimensional coordinate system, the distance p between p1 and p2 (i.e., the distance between the worker and the charged object) can be calculated. Based on the real-time measurement of the distance p value, the on-site operation situation can be monitored, prompted and warned.

[0044] In an optional embodiment, the importance of obtaining depth information includes safety monitoring: in a live working environment, obtaining depth information can ensure that workers maintain a safe distance from live objects to avoid electric shock accidents. Real-time distance monitoring is crucial to improving the safety of the work site.

[0045] Depth information makes it possible to accurately measure the actual distance between workers and charged objects, which is of great significance for formulating reasonable work plans and risk assessments.

[0046] The acquisition of in-depth information provides basic data for automated control, which can realize remote monitoring and automatic early warning, reduce human intervention and improve operational efficiency.

[0047] In an optional embodiment, after obtaining the depth information, other possible solutions include using a depth camera to obtain the distance information between the worker and the charged object. The depth information is transmitted to the automatic control system. The system automatically adjusts the working state of the operating equipment according to the distance information, such as deceleration, stop, etc. Combined with the actual situation on site, the system optimizes the operation process to ensure that the operation is carried out efficiently and safely. Through real-time monitoring and automatic control, the risk of accidents is reduced and the overall safety of the operation site is improved.

[0048] Smart wearable devices use depth cameras to monitor the distance between workers and charged objects in real time. Once the distance approaches the safety threshold, a warning is immediately issued, thereby reducing the occurrence of electric shock accidents. The sound and vibration reminders of wearable devices can improve the vigilance of workers in complex environments, making them more aware of their location and surrounding environment. Automatic acquisition and reminder of distance information reduces the possibility of human calculation and judgment errors, and improves the accuracy and reliability of operations. The movement trajectory and distance information recorded by the device can be used for post-accident analysis to help understand the cause of the accident and provide data support for improving safety measures. Smart wearable devices with integrated depth cameras are lightweight and will not bring additional burden to workers, improving the comfort and convenience of operations. Smart wearable devices can be used in a variety of different working environments, such as indoors, outdoors, and high-altitude operations, and have a wide range of applicability.

[0049] In an optional embodiment, after acquiring the depth information, other possible solutions include:

[0050] Smart wearable devices based on depth cameras integrate depth cameras into workers' smart wearable devices, such as helmets and watches. The device obtains distance information through the depth camera and reminds workers in real time of the distance between them and charged objects. It also records the movement trajectory of workers and provides data support for accident analysis.

[0051] The system automatically adjusts the working status of the operating equipment according to the depth information, realizes the automatic control of the operating process, and improves the operating efficiency. Through real-time monitoring and automatic adjustment, the system can effectively prevent potential risks caused by too close distance and ensure the safety of operators. The system optimizes the operation process based on the actual situation on site to ensure that the operation is carried out in the safest and most efficient way. Automated control reduces unnecessary downtime caused by safety considerations and improves production efficiency. The system allows remote monitoring of the operation site, and can remotely operate and command dangerous or inconvenient areas for personnel to enter, which improves management efficiency. When a safety hazard is detected, the system can respond quickly and take measures, such as automatically stopping the operation of the equipment, to quickly control the development of the accident.

[0052] S2: Make a judgment based on the result of the first calculation and give an alarm prompt according to the judgment result;

[0053] The first calculation includes:

[0054] In a three-dimensional coordinate system, calculate the distance between the worker and the live body. Based on the real-time measurement of the distance value, monitor, prompt and give early warnings for on-site operations.

[0055] When p ≥ a, the value of a is set according to different voltage levels in Table 1. It indicates that the distance between the worker and the live body is safe. At this time, there will be certain prompts from the on-site sound and light unit. For example, the indicator light is green (always on or flashing), the speaker does not emit sound, and the vibration device does not vibrate to give a reminder;

[0056] When b ≥ p < a, the values of a and b are set according to different voltage levels in Table 1. At this time, it shows that the distance between the worker and the live body is worthy of attention. At this time, the on-site indicator light is on or flashing yellow, the speaker emits reminder sounds such as "Please pay attention to your distance from the live body!" at the scene, and the vibration device gives a low-frequency vibration reminder.

[0057] When p < b, at this time, it shows that the distance between the worker and the live body is unsafe. At this time, the on-site indicator light is always on or flashing red, the speaker emits warning sounds such as "Danger! Danger! Danger!" at the scene, and the vibration device gives a high-frequency vibration reminder. For example, in Table 1, when the working distance between the on-site worker and the 110 kV live equipment is less than 1.5 m, it belongs to an unsafe working distance, and the worker should immediately stay away from the live equipment and always keep a distance of more than 1.5 m.

[0058] Making a judgment based on the result of the first calculation includes:

[0059] When comparing the distance value with the preset threshold, give corresponding sound, light and vibration prompts according to different comparison results.

[0060] The preset threshold is set with different distance levels according to the voltage level.

[0061] Table 1. Safe distances between personnel, tools and materials and the live parts of equipment

[0062]

[0063] S3: Use a depth camera to perform two-dimensional code image recognition and make a first-state judgment on the image.

[0064] The depth camera captures a two-dimensional image of the power equipment, identifies the two-dimensional code pasted on the equipment in the picture, and the identified result matches the actual required working object. If it matches, execute; if it does not match, do not execute.

[0065] In the embodiment of the present application, the first state judgment includes QR code judgment and remote verification of power equipment information.

[0066] In an optional embodiment, the two-dimensional code determination includes that the specific steps of the two-dimensional code recognition of the power equipment mainly include:

[0067] 1. The camera obtains the QR code image. The QR code is attached to the power equipment (such as the grounding switch), and the depth camera is used to shoot or scan it (similar to the principle of scanning the payment code we usually do)

[0068] 2. Image preprocessing, including filtering and thresholding.

[0069] 3. Detection, positioning and recognition to confirm the QR code area and orientation.

[0070] 4. Block recognition and decoding: divide the QR code into multiple blocks, recognize and decode each block one by one, and obtain the content of each block.

[0071] 5. Error correction and information extraction: Use the error correction mechanism of the QR code to detect and repair possible errors, ensure the integrity and accuracy of the information, and finally extract the real data content.

[0072] In an optional embodiment, the specific working steps of remote verification of power equipment information are as follows:

[0073] 1. Use the depth camera to scan the QR code of the object A to be operated and identify the QR code information;

[0074] 2. Transmit the QR code information communication wireless transmission channel to the background management terminal;

[0075] 3. The backend management receives the QR code information and compares it with the operation object B required by the operation ticket or work ticket;

[0076] 4. When the QR code information A of the object to be operated is consistent with the information of the actual object B to be operated, the operation will be allowed to be performed; otherwise, the operation will not be allowed on site.

[0077] Example 2

[0078] like Figure 3 As shown, the second embodiment of the present invention provides a security monitoring and equipment remote verification system based on a depth camera and a QR code, which is characterized by including a background management module, an integration module, and power equipment.

[0079] The background management module includes an acoustic and optical unit, a signal processing unit, and a management unit;

[0080] The integrated module includes a signal processing unit, an acoustic and optical unit, a control unit, a depth camera unit, and a vibration unit;

[0081] The power equipment includes all power generation, transmission, transformation and distribution equipment in AC and DC systems, such as conductors, transformers, circuit breakers and disconnectors.

[0082] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc., which can store program codes.

[0083] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in conjunction with such instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in conjunction with such instruction execution systems, devices or apparatuses.

[0084] More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk case (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be a paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering or, if necessary, processing in another suitable manner, and then stored in a computer memory.

[0085] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0086] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

[0087] Example 3

[0088] As a second embodiment of the present invention, a security monitoring and equipment remote verification method based on a depth camera and a QR code is provided. In order to verify the beneficial effects of the present invention, scientific demonstration is carried out through experiments.

[0089] Depth camera + QR code technology. The depth camera has the functions of recording, shooting and obtaining pictures. Based on the information collected by the depth camera, it has high precision and can be restored into a three-dimensional scene. The data can be recycled, for example, reducing the number of on-site surveys and saving manpower and material resources. The equipment is affixed with a QR code. When necessary, the depth camera can actively scan the QR code on the equipment to obtain the information of the power equipment. Only when the equipment information is consistent with the required operation object information on the ticket can the on-site personnel operate. That is, only when the results of the double confirmation mechanism of "on-site confirmation + system scanning confirmation" are consistent, the on-site staff can be allowed to operate. This can avoid incorrect on-site operations and solve a series of problems that may be caused by personnel misoperation in the power system.

[0090] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. A security monitoring and equipment remote verification method based on a depth camera and a QR code, characterized in that: include, The depth camera obtains the depth information and derives the distance between the worker and the charged object through a calculation. Make a judgment based on a calculation result and issue an alarm based on the judgment result; A depth camera is used to perform QR code image recognition and perform a first state judgment on the image.

2. The method for security monitoring and remote device verification based on a depth camera and a QR code as claimed in claim 1, characterized in that: The depth camera acquires depth information including: The depth camera obtains the distance between the object in the scene and the camera, and calculates the depth information based on the principle of similar triangles.

3. The method for security monitoring and remote device verification based on a depth camera and a QR code as claimed in claim 2, characterized in that: The one-time calculation includes: In the three-dimensional coordinate system, the distance between the worker and the charged object is calculated, and based on the real-time measurement of the distance value, on-site operations are monitored, prompted and warned.

4. The method for security monitoring and remote device verification based on a depth camera and a two-dimensional code as claimed in claim 3, characterized in that: The judgment of the calculation result includes: When the distance value is compared with a preset threshold, corresponding sound, light and / or vibration prompts are given according to different comparison results.

5. The method for security monitoring and remote device verification based on a depth camera and a QR code as claimed in claim 4, characterized in that: The preset threshold is set at different distance levels according to the voltage level.

6. The method for security monitoring and remote device verification based on a depth camera and a QR code as claimed in claim 1, characterized in that: The use of a depth camera to perform first-state recognition of a QR code includes the depth camera capturing a two-dimensional image of the power equipment, recognizing the QR code attached to the equipment in the image, and matching the recognition result with the actual required work object. If there is a match, execution is agreed; if there is no match, execution is not performed.

7. The method for security monitoring and remote device verification based on a depth camera and a QR code as claimed in claim 6, characterized in that: Said and judged include, The camera obtains the QR code image, shoots or scans it through the depth camera, and performs image preprocessing on the QR code to confirm the QR code area and orientation. The QR code is divided into multiple blocks, and each block is identified and decoded to obtain the content of each block. The error correction mechanism of the QR code is used to detect and repair possible errors, ensure the integrity and accuracy of the information, and extract the real data content.

8. A system based on the method for security monitoring and remote device verification based on a depth camera and a QR code according to any one of claims 1 to 7, characterized in that: Including background management module, integration module, and power equipment.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images