Intelligent inspection point verification method based on multi-mode identification and Internet of Things driving

Abstract

The invention belongs to the technical field of intelligent inspection software, and discloses an intelligent inspection point verification method based on multi-modal identification and Internet of Things driving, the intelligent inspection point verification method is realized based on an APP terminal inspection system, and the verification method comprises the following specific steps: step 1, inspection point information initialization; step 4, judging a verification result; step 5, reading equipment state data in real time; and step 6, uploading and monitoring the data. According to the inspection point verification method based on multi-mode identification and Internet of Things driving, inspection point positions can be verified by combining multiple technical means such as a two-dimensional code, a GPS, Bluetooth and NFC, meanwhile, real-time connection with Internet of Things equipment is achieved, monitoring and data collection of the equipment are achieved, and especially for Bluetooth equipment, the inspection point positions can be verified through multiple technical means such as the two-dimensional code, the GPS, the Bluetooth and the NFC. And the latest state data of the equipment can be directly read in the inspection process, so that the inspection accuracy is ensured.

Description

Technical Field

[0001] The present invention belongs to the technical field of intelligent inspection software, and specifically is a smart inspection point verification method based on multimodal recognition and Internet of Things drive. Background Art

[0002] Traditional inspection methods face the following shortcomings: single verification method, lack of accurate confirmation and identification of inspection points, and inability to adapt to complex inspection environments. Inability to obtain the real-time operating status of the equipment affects the accuracy of the inspection process. Data lag or manual input affects the timeliness and accuracy of inspection reports. The development of IoT technology makes it possible to obtain device data in real time. Therefore, combining multimodal verification technology with real-time monitoring of IoT devices can significantly improve the intelligence level of the inspection system and the accuracy of inspections. Summary of the invention

[0003] The purpose of the present invention is to provide a smart inspection point verification method based on multimodal recognition and Internet of Things drive to solve the problems raised in the above background technology.

[0004] In order to achieve the above-mentioned purpose, the present invention provides the following technical solutions: a smart inspection point verification method based on multimodal recognition and IoT-driven, the smart inspection point verification method is implemented based on the APP-side inspection system, and the specific steps of the verification method are:

[0005] Step 1: Initialize the inspection point information: pre-enter the inspection point information in the system and generate a unique QR code and NFC tag for each inspection point.

[0006] Step 2: Configure device information: bind the inspection point device in step 1 to the GPS coordinates of the inspection point and the Bluetooth ID data of the inspection point device; at the same time, bind the Bluetooth module, GPS positioning module, and NFC module of the inspection device to the corresponding inspection point information;

[0007] Step 3: The inspector arrives at the inspection point: The inspector carries an inspection device equipped with an inspection system. When arriving at the designated inspection point, the inspector uses the camera of the inspection device to scan the QR code of the inspection point and verifies whether the inspection point is correct through three verification methods;

[0008] Step 4: Determine the verification result; the inspection personnel arrive at the inspection position to conduct verification;

[0009] If the verification fails, re-execute the third step to re-scan the inspection point QR code for secondary verification;

[0010] If the verification is successful, proceed to the next step;

[0011] Step 5: Real-time reading of equipment status data: After successfully verifying the inspection point, the system starts to read data in real time through the Bluetooth module;

[0012] If the inspection device does not have a Bluetooth module, the status data of the inspection device can be read in real time through the API interface;

[0013] If the inspection device has a Bluetooth module, the system directly obtains the latest status data of the inspection device from the Bluetooth module;

[0014] Step 6: Data upload and monitoring: All inspection data and real-time data of inspection equipment will be uploaded to the background management platform synchronously. The background system will monitor the equipment status, analyze the data and generate inspection reports; if the equipment operates abnormally, the system will automatically trigger an alarm.

[0015] Preferably, the three verification methods in step 3 are: GPS positioning verification, NFC verification and Bluetooth verification;

[0016] GPS positioning verification: refers to confirming whether the inspection personnel have arrived within the predetermined inspection point range through GPS positioning;

[0017] Bluetooth verification: The system automatically searches for Bluetooth signals and matches the inspection point information for verification;

[0018] NFC verification: The system automatically searches for NFC signals and matches the inspection point information for verification.

[0019] Preferably, the verification method in step three at least includes GPS positioning verification, and is verified by using two auxiliary GPS positioning verifications in combination with Bluetooth verification and NFC verification.

[0020] Preferably, the status data of the inspection equipment includes but is not limited to temperature, pressure, and operation time information.

[0021] Preferably, the Bluetooth module establishes a stable Bluetooth connection channel and utilizes a specific Bluetooth communication protocol to continuously detect signals emitted by IoT devices and devices with Bluetooth functions in a periodic scanning or event-triggered manner.

[0022] Preferably, the inspection device is a common mobile device, including but not limited to: a smart phone, a tablet, and a PDA.

[0023] Preferably, the Bluetooth module adopts low-power Bluetooth technology, which further enhances the signal stability and data transmission reliability during the inspection process.

[0024] Preferably, the GPS positioning module also includes a system algorithm that uses a comprehensive and in-depth comparison and verification of the GPS position data collected by the current inspection equipment with the known coordinates pre-marked in the returned inspection point data, strictly requiring that the current GPS position is accurately within the specific position interval marked on the point.

[0025] The beneficial effects of the present invention are as follows:

[0026] The present invention innovatively proposes a smart inspection point verification method based on multimodal recognition and IoT-driven. The method deeply integrates multiple verification methods such as QR code, GPS, Bluetooth and NFC, and constructs a multi-dimensional and high-precision inspection verification system. Through the real-time data reading function of the Bluetooth module, the system can detect IoT devices and Bluetooth devices periodically or event-triggered to ensure that the latest status data of the device is obtained during the inspection process. In addition, the NFC module realizes fast data interaction and identity authentication at close range, while the Bluetooth verification module uses low-power Bluetooth technology to enhance signal stability and data transmission reliability. Combined with GPS positioning and coordinate comparison, this system greatly improves the accuracy and efficiency of inspections in complex scenarios. At the same time, the system automatically collects equipment operation data, and managers can grasp the equipment status in real time and generate inspection reports, realizing comprehensive monitoring and precise management of the inspection process; it can verify the inspection points by combining multiple technical means such as QR code, GPS, Bluetooth and NFC, and connect to IoT devices in real time to realize equipment monitoring and data collection, especially for Bluetooth devices, the latest status data of the device can be directly read during the inspection process to ensure the accuracy of the inspection. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 This is a flowchart of the smart inspection point verification method of the present invention. DETAILED DESCRIPTION

[0028] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0029] like Figure 1 As shown, the embodiment of the present invention provides a smart inspection point verification method based on multimodal recognition and IoT drive. The smart inspection point verification method is implemented based on the APP-side inspection system. The specific steps of the verification method are:

[0030] Step 1: Initialize the inspection point information: pre-enter the inspection point information in the system and generate a unique QR code and NFC tag for each inspection point.

[0031] Step 2: Configure device information: bind the inspection point device in step 1 to the GPS coordinates of the inspection point and the Bluetooth ID data of the inspection point device; at the same time, bind the Bluetooth module, GPS positioning module, and NFC module of the inspection device to the corresponding inspection point information;

[0032] Step 3: The inspector arrives at the inspection point: The inspector carries an inspection device (such as a mobile phone terminal) equipped with an inspection system. When arriving at the designated inspection point, the inspector uses the camera of the inspection device to scan the QR code of the inspection point and verifies whether the inspection point is correct through three verification methods;

[0033] This method has a high-precision positioning algorithm system. A point code with a unique coding feature is generated through the management system, and the QR code of the point is scanned and analyzed with the help of the inspection equipment (mobile terminal). In this process, the APP first obtains the location and verification method of the current point through the API interface based on the point code obtained by scanning and parsing. If GPS positioning verification is included, the algorithm will conduct a comprehensive and in-depth comparison and verification of the GPS positioning location data collected by the current inspection equipment with the known coordinates pre-marked in the returned point data, and strictly require that the current GPS position is accurately within the specific position range marked on the point. At the same time, the APP also has a powerful function of accurately defining and judging the marking range, and ensures that the accuracy and reliability of the inspection position reach an extremely high level through complex mathematical models and multi-dimensional data analysis algorithms.

[0034] In addition, near-field communication (NFC) and Bluetooth verification modules are introduced to the inspection points. The NFC module can achieve fast data interaction and identity authentication at close range, ensuring that the inspectors can accurately connect and identify the points within a specific range. The Bluetooth verification module further enhances the signal stability and data transmission reliability during the inspection process through low-power Bluetooth technology. These two modules work together with GPS positioning and coordinate comparison functions to form a multi-dimensional, high-precision inspection verification system, which greatly improves the inspection accuracy and efficiency of complex scenes.

[0035]

[0036]

[0037]

[0038]

[0039]

[0040]

[0041]

[0042]

[0043] Step 4: Determine the verification result; the inspection personnel arrive at the inspection position to conduct verification;

[0044] If the verification fails, re-execute the third step to re-scan the inspection point QR code for secondary verification;

[0045] If the verification is successful, proceed to the next step;

[0046] Step 5: Real-time reading of equipment status data: After successfully verifying the inspection point, the system starts to read data in real time through the Bluetooth module;

[0047] If the inspection device does not have a Bluetooth module, the status data of the inspection device can be read in real time through the API interface;

[0048] If the inspection device has a Bluetooth module, the system directly obtains the latest status data of the inspection device from the Bluetooth module;

[0049]

[0050]

[0051]

[0052] Step 6: Data upload and monitoring: All inspection data and real-time data of inspection equipment will be uploaded to the background management platform synchronously. The background system will monitor the equipment status, analyze the data and generate inspection reports; if the equipment operates abnormally, the system will automatically trigger an alarm.

[0053] Among them, the three verification methods in step three are: GPS positioning verification, NFC verification and Bluetooth verification;

[0054] GPS positioning verification: refers to confirming whether the inspection personnel have arrived within the predetermined inspection point range through GPS positioning;

[0055] Bluetooth verification: The system automatically searches for Bluetooth signals and matches the inspection point information for verification;

[0056] NFC verification: The system automatically searches for NFC signals and matches the inspection point information for verification.

[0057] The verification method in step three at least includes GPS positioning verification, and is verified by using one of Bluetooth verification and NFC verification or two auxiliary GPS positioning verifications.

[0058] The status data of the inspection equipment includes, but is not limited to, temperature, pressure, and operating time information.

[0059] Among them, the Bluetooth module establishes a stable Bluetooth connection channel and uses a specific Bluetooth communication protocol to continuously detect signals sent by IoT devices and devices with Bluetooth functions in a periodic scanning or event-triggered manner.

[0060] Once the connection is established, the APP will send a specific data reading instruction to trigger the device to respond and send back data. By parsing and processing the returned data, the latest information contained in it is extracted to ensure that the most timely and accurate data content is obtained.

[0061] Among them, the inspection equipment is a common mobile device, including but not limited to: smart phones, tablets, and PDAs.

[0062] Among them, the Bluetooth module adopts low-power Bluetooth technology, which further enhances the signal stability and data transmission reliability during the inspection process.

[0063] Among them, the GPS positioning module also includes a comprehensive and in-depth comparison and verification of the GPS location data collected by the current inspection equipment with the known coordinates pre-marked in the returned inspection point data through a system algorithm, strictly requiring that the current GPS position is accurately within the specific position range marked on the point.

[0064] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0065] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A smart inspection point verification method based on multimodal recognition and IoT drive, characterized by: The smart inspection point verification method is implemented based on the APP inspection system. The specific steps of the verification method are as follows: Step 1: Initialize inspection point information: pre-enter the inspection point information into the system and generate a unique QR code and NFC tag for each inspection point; Step 2: Configure device information: bind the inspection point device in step 1 to the GPS coordinates of the inspection point and the Bluetooth ID data of the inspection point device; at the same time, bind the Bluetooth module, GPS positioning module, and NFC module of the inspection device to the corresponding inspection point information; Step 3: The inspector arrives at the inspection point: The inspector carries an inspection device equipped with an inspection system. When arriving at the designated inspection point, the inspector uses the camera of the inspection device to scan the QR code of the inspection point and verifies whether the inspection point is correct through three verification methods; Step 4: Determine the verification result; The inspector arrives at the inspection location to conduct verification; If the verification fails, re-execute the third step to re-scan the inspection point QR code for secondary verification; If the verification is successful, proceed to the next step; Step 5: Real-time reading of equipment status data: After successfully verifying the inspection point, the system starts to read data in real time through the Bluetooth module; If the inspection device does not have a Bluetooth module, the status data of the inspection device can be read in real time through the API interface; If the inspection device has a Bluetooth module, the system directly obtains the latest status data of the inspection device from the Bluetooth module; Step 6: Data upload and monitoring: All inspection data and real-time data of inspection equipment will be uploaded to the backend management platform synchronously. The backend system will monitor the equipment status, analyze the data and generate inspection reports; If the equipment operates abnormally, the system will automatically trigger an alarm.

2. The intelligent inspection point verification method based on multimodal recognition and Internet of Things drive according to claim 1 is characterized by: The three verification methods in step 3 are: GPS positioning verification, NFC verification and Bluetooth verification; GPS positioning verification: refers to confirming whether the inspection personnel have arrived within the predetermined inspection point range through GPS positioning; Bluetooth verification: The system automatically searches for Bluetooth signals and matches the inspection point information for verification; NFC verification: The system automatically searches for NFC signals and matches the inspection point information for verification.

3. The intelligent inspection point verification method based on multimodal recognition and Internet of Things drive according to claim 1 is characterized in that: The verification method in step three at least includes GPS positioning verification, and is verified by using two auxiliary GPS positioning verifications, namely, Bluetooth verification and NFC verification.

4. The intelligent inspection point verification method based on multimodal recognition and Internet of Things drive according to claim 1 is characterized in that: The status data of the inspection equipment includes but is not limited to temperature, pressure, and operation time information.

5. The intelligent inspection point verification method based on multimodal recognition and Internet of Things drive according to claim 1 is characterized in that: The Bluetooth module establishes a stable Bluetooth connection channel and uses a specific Bluetooth communication protocol to continuously detect signals sent by IoT devices and devices with Bluetooth functions in a periodic scanning or event-triggered manner.

6. The intelligent inspection point verification method based on multimodal recognition and Internet of Things drive according to claim 1 is characterized in that: The inspection device is a common mobile device, including but not limited to: a smart phone, a tablet, and a PDA.

7. The intelligent inspection point verification method based on multimodal recognition and Internet of Things drive according to claim 1 is characterized in that: The Bluetooth module adopts low-power Bluetooth technology, which further enhances the signal stability and data transmission reliability during the inspection process.

8. The intelligent inspection point verification method based on multimodal recognition and Internet of Things drive according to claim 1 is characterized in that: The GPS positioning module also includes a comprehensive and in-depth comparison and verification of the GPS position data collected by the current inspection equipment with the known coordinates pre-marked in the returned inspection point data through a system algorithm, strictly requiring that the current GPS position is accurately within the specific position range marked on the point.

Images