AR inspection method and system for industrial park

Abstract

The invention provides an AR inspection method and system for an industrial park. The AR inspection method for the industrial park comprises the following steps: establishing a three-dimensional virtual scene of a park to be inspected; in the inspection process, ID information of AR equipment and ID information of to-be-inspected equipment aligned with the AR equipment are obtained; acquiring an equipment operation database; obtaining operation interval time information according to the equipment operation database; judging whether the operation interval time information is greater than or equal to the preset time period or not, if so, generating AR test information and sending the AR test information to AR equipment worn by the inspection personnel so as to obtain a test score; and when the test score exceeds a preset score threshold, judging that the inspection of the to-be-inspected equipment is completed. According to the AR inspection method for the industrial park, the corresponding test of the corresponding to-be-inspected equipment can be carried out in the inspection process, so that the problem that in the prior art, inspection personnel only carry out inspection under the normal condition and ignores how to carry out emergency disposal under the sudden condition can be solved.

Description

Technical Field

[0001] The present invention belongs to the field of AR inspection technology, and specifically relates to an AR inspection method for industrial parks and an AR inspection system for industrial parks. Background Art

[0002] In the existing AR inspection methods, usually only the basic information of the equipment to be inspected is displayed through AR assistance during the inspection process. That is to say, when a person walks to the corresponding equipment to be inspected, some basic information of the equipment can be displayed through the AR device, such as the power of the equipment, the time of the previous inspection, etc. However, in most inspections, the equipment to be inspected is usually operating normally, which leads to the fact that even if the inspectors inspect for one year or many years, it is difficult for them to encounter equipment failures. Under this situation, the inspectors neglect to train the emergency measures for the equipment. That is to say, once a sudden situation occurs, the inspectors may not be able to handle it correctly because they have never actually performed the operations for emergencies during the inspection. Summary of the invention

[0003] In view of the deficiencies in the prior art, the present invention provides an AR inspection method for industrial parks to solve the above technical problems.

[0004] To achieve the above object, the present invention provides the following technical solution: an AR inspection method for industrial parks, the AR inspection method for industrial parks comprising:

[0005] The data center establishes a three-dimensional virtual scene of the park to be inspected, wherein the three-dimensional virtual scene includes at least one device to be inspected;

[0006] The data center transmits the three-dimensional virtual scene to the AR device, so that the inspection personnel can locate the three-dimensional virtual scene and the park to be inspected when wearing the AR device;

[0007] When the AR device worn by the inspector is aimed at the device to be inspected during the inspection process, the data center obtains the ID information of the AR device and the ID information of the device to be inspected that the AR device is aimed at;

[0008] The data center obtains a device operation database, wherein the device operation database includes a plurality of triplets, each of which includes a preset device ID information, a preset ID information of a device to be inspected, and operation interval time information;

[0009] The data center obtains operation interval time information in triplet in which the preset device ID information is the same as the AR device ID information and the preset ID information of the device to be inspected is the same as the ID information of the device to be inspected;

[0010] The data center obtains a preset time period;

[0011] The data center determines whether the operation interval information is greater than or equal to the preset time period, and if so,

[0012] The data center generates AR test information and sends it to the AR device worn by the inspector, so that the AR device generates an AR test according to the AR test information and obtains a test score according to the operation of the inspector;

[0013] The data center obtains the test score obtained by the inspector after performing the AR test, and when the test score exceeds a preset score threshold, it is determined that the inspection of the equipment to be inspected is completed.

[0014] Optionally, the data center generates AR test information including:

[0015] The data center obtains the number of operation types of the device to be inspected according to the ID information of the device to be inspected. If the number of operation types exceeds one,

[0016] The AR test information sent by the data center includes test quantity information.

[0017] Optionally, when the AR test information includes test quantity information, the AR device generating the AR test according to the AR test information includes:

[0018] The AR device obtains the facial image information of the inspection personnel;

[0019] The AR device obtains basic information of the inspector based on the acquired facial image information and sends the basic information of the inspector to the data center;

[0020] The data center selects test content based on the acquired facial image information and sends the test content to the AR device;

[0021] The AR device generates an AR test according to the test content.

[0022] Optionally, the data center selects test content according to the acquired facial image information and sends the test content to the AR device, including:

[0023] Acquire a scoring database, wherein the scoring database includes a plurality of scoring data sub-databases, one scoring data sub-database corresponds to a preset face image information, and each scoring data sub-database includes at least one test content and the latest scoring information corresponding to each test content;

[0024] Acquire a scoring data sub-library corresponding to preset facial image information whose similarity with the facial image information exceeds a preset threshold, the scoring data sub-library being referred to as the scoring data sub-library to be selected;

[0025] Obtaining the latest scoring information corresponding to the test content that can be performed on the current device to be inspected in the scoring data word library to be selected;

[0026] Determine whether one or more of the most recent rating information obtained is less than the preset rating. If so,

[0027] The test content corresponding to the most recent score information that is less than the preset score is selected and sent to the AR device.

[0028] Optionally, the data center selects test content according to the acquired facial image information and sends the test content to the AR device further includes:

[0029] Determine whether one or more of the recently obtained rating information is less than the preset rating. If not,

[0030] The test content corresponding to the one with the smallest recent score information is selected and sent to the AR device.

[0031] Optionally, the data center selects test content according to the acquired facial image information and sends the test content to the AR device further includes:

[0032] Determine whether one or more of the recently obtained rating information is less than the preset rating. If not,

[0033] Randomly select a test content and send it to the AR device.

[0034] Optionally, the AR device includes:

[0035] A camera device, which is used to obtain the movement trajectory of the inspection personnel;

[0036] A head-mounted AR body, wherein the head-mounted AR body is used to display images and play sounds, and wherein a plurality of test programs are stored in the head-mounted AR body, and one test program corresponds to one test content.

[0037] Optionally, the AR device generating an AR test according to the test content includes:

[0038] Selecting a test program corresponding to the test content, and when there are multiple test contents, randomly selecting one of the test contents;

[0039] When the inspector performs hand operations according to the test content, obtaining the hand movement trajectory of the inspector;

[0040] The test score of the inspector is obtained according to the hand movement trajectory of the inspector.

[0041] Optionally, the AR inspection method for industrial parks further includes:

[0042] After the inspection of the device to be inspected is completed, the data center generates a next position inspection signal and transmits it to the AR device;

[0043] The AR device generates a prompt voice according to the next position inspection signal, so that the inspection personnel go to the location of the next device to be inspected after receiving the prompt voice.

[0044] The present application also provides an AR inspection system for industrial parks, characterized in that: the AR inspection system for industrial parks includes a data center and an AR device, and the data center and the AR device cooperate to implement the AR inspection method for industrial parks as described above.

[0045] The AR inspection method for industrial parks of the present application can perform corresponding tests on the equipment to be inspected during the inspection process, thereby solving the problem in the prior art that inspection personnel only conduct inspections under normal circumstances, while ignoring how to handle emergencies in sudden situations. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 A flowchart of an AR inspection method for industrial parks according to an embodiment of the present application. DETAILED DESCRIPTION

[0047] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0048] like Figure 1 The AR inspection method for industrial parks shown includes:

[0049] Step 1: The data center establishes a three-dimensional virtual scene of the park to be inspected, wherein the three-dimensional virtual scene includes at least one device to be inspected;

[0050] Step 2: The data center transmits the three-dimensional virtual scene to the AR device, so that the inspection personnel can locate the three-dimensional virtual scene and the park to be inspected when wearing the AR device;

[0051] Step 3: When the AR device worn by the inspector is aimed at the device to be inspected during the inspection process, the data center obtains the ID information of the AR device and the ID information of the device to be inspected that the AR device is aimed at;

[0052] Step 4: The data center obtains a device operation database, which includes a plurality of triplets, each of which includes a preset device ID information, a preset ID information of a device to be inspected, and operation interval time information;

[0053] Step 5: The data center obtains the operation interval time information in the triplet in which the preset device ID information in each triplet is the same as the AR device ID information and the preset ID information of the device to be inspected is the same as the ID information of the device to be inspected;

[0054] Step 6: The data center obtains a preset time period;

[0055] Step 7: The data center determines whether the operation interval information is greater than or equal to the preset time period. If so,

[0056] Step 8: The data center generates AR test information and sends it to the AR device worn by the inspector, so that the AR device generates an AR test according to the AR test information and obtains a test score according to the inspector's operation;

[0057] Step 9: The data center obtains the test score obtained by the inspector after performing the AR test. When the test score exceeds a preset score threshold, it is determined that the inspection of the device to be inspected is completed.

[0058] The AR inspection method for industrial parks of the present application can perform corresponding tests on the equipment to be inspected during the inspection process, thereby solving the problem in the prior art that inspection personnel only conduct inspections under normal circumstances, while ignoring how to handle emergencies in sudden situations.

[0059] In this embodiment, when modeling the target scene, some objects that are not inspection targets, such as trees, flowers and plants, etc., may be deleted.

[0060] In this embodiment, the data center generates AR test information including:

[0061] The data center obtains the number of operation types of the device to be inspected according to the ID information of the device to be inspected. If the number of operation types exceeds one,

[0062] The AR test information sent by the data center includes test quantity information.

[0063] For example, different devices to be inspected may have different operation requirements when problems occur, and for the same device to be inspected, different problems may have different operation requirements. Therefore, one operation requirement corresponds to one operation type quantity, and one operation type quantity corresponds to one test content.

[0064] For example, if it is an electrical device such as a street lamp, when the street lamp does not light up, you may first restart it to see if it is a system problem. If it is not a system problem, then check whether it is a bulb problem.

[0065] If it is other machinery, the processing procedures may be different.

[0066] In this embodiment, when the AR test information includes test quantity information, the AR device generating an AR test according to the AR test information includes:

[0067] The AR device obtains the facial image information of the inspection personnel;

[0068] The AR device obtains basic information of the inspector based on the acquired facial image information and sends the basic information of the inspector to the data center;

[0069] The data center selects test content based on the acquired facial image information and sends the test content to the AR device;

[0070] The AR device generates an AR test according to the test content.

[0071] In this embodiment, the data center selects test content according to the acquired facial image information and sends the test content to the AR device, including:

[0072] Acquire a scoring database, wherein the scoring database includes a plurality of scoring data sub-databases, one scoring data sub-database corresponds to a preset face image information, and each scoring data sub-database includes at least one test content and the latest scoring information corresponding to each test content;

[0073] Acquire a scoring data sub-library corresponding to preset facial image information whose similarity with the facial image information exceeds a preset threshold, the scoring data sub-library being referred to as the scoring data sub-library to be selected;

[0074] Obtaining the latest scoring information corresponding to the test content that can be performed on the current device to be inspected in the scoring data word library to be selected;

[0075] Determine whether one or more of the most recent rating information obtained is less than the preset rating. If so,

[0076] The test content corresponding to the most recent score information that is less than the preset score is selected and sent to the AR device.

[0077] In this embodiment, the data center selects test content according to the acquired facial image information and sends the test content to the AR device further includes:

[0078] Determine whether one or more of the recently obtained rating information is less than the preset rating. If not,

[0079] The test content corresponding to the one with the smallest recent score information is selected and sent to the AR device.

[0080] In this embodiment, the data center selects test content according to the acquired facial image information and sends the test content to the AR device further includes:

[0081] Determine whether one or more of the recently obtained rating information is less than the preset rating. If not,

[0082] Randomly select a test content and send it to the AR device.

[0083] In this embodiment, the AR device includes:

[0084] A camera device, which is used to obtain the movement trajectory of the inspection personnel;

[0085] A head-mounted AR body, wherein the head-mounted AR body is used to display images and play sounds, and wherein a plurality of test programs are stored in the head-mounted AR body, and one test program corresponds to one test content.

[0086] The above-mentioned facial image information can also be obtained through a camera device.

[0087] In this embodiment, the camera device can be a mobile phone, which can be connected to the head-mounted AR body through WIFI or Bluetooth, so that the mobile phone can be used flexibly and can shoot videos from different angles. In addition, the mobile phone can also be mounted on the work clothes to shoot the hand movement in front.

[0088] In this embodiment, the AR device generates an AR test according to the test content, including:

[0089] Selecting a test program corresponding to the test content, and when there are multiple test contents, randomly selecting one of the test contents;

[0090] When the inspector performs hand operations according to the test content, obtaining the hand movement trajectory of the inspector;

[0091] The test score of the inspector is obtained according to the hand movement trajectory of the inspector.

[0092] In this embodiment, obtaining the test score of the inspector according to the hand movement trajectory of the inspector includes:

[0093] Acquire information of a hand motion trajectory, wherein the information of the hand motion trajectory includes a position of a user gesture and a displacement of the user gesture;

[0094] Determine whether the position of the user's gesture is on the device to be inspected in the three-dimensional virtual scene;

[0095] When the position of the user gesture is on the device to be inspected, the position of the device to be inspected is recorded.

[0096] A test scoring database is obtained, wherein the test scoring database includes a plurality of test scoring data sub-databases, each of which includes a test content and a gesture position sequence corresponding to the test content, wherein the gesture position sequence includes a plurality of gesture positions sorted in sequence.

[0097] Get the gesture position sequence corresponding to the current test content.

[0098] The information of the hand motion trajectory of the inspector is compared with the gesture position sequence. If all gesture positions in the gesture position sequence appear in the information of the hand motion trajectory and the order of appearance is the same, full marks will be obtained. If one position is different or the order is different, one point will be deducted.

[0099] In this embodiment, the AR inspection method for industrial parks further includes:

[0100] After the inspection of the device to be inspected is completed, the data center generates a next position inspection signal and transmits it to the AR device;

[0101] The AR device generates a prompt voice according to the next position inspection signal, so that the inspection personnel go to the location of the next device to be inspected after receiving the prompt voice.

[0102] The present application also provides an AR inspection system for industrial parks, which includes a data center and an AR device. The data center and the AR device cooperate to implement the AR inspection method for industrial parks as described above.

[0103] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0104] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. An AR inspection method for industrial parks, characterized in that: The AR inspection method for industrial parks includes: The data center establishes a three-dimensional virtual scene of the park to be inspected, wherein the three-dimensional virtual scene includes at least one device to be inspected; The data center transmits the three-dimensional virtual scene to the AR device, so that the inspection personnel can locate the three-dimensional virtual scene and the park to be inspected when wearing the AR device; When the AR device worn by the inspector is aimed at the device to be inspected during the inspection process, the data center obtains the ID information of the AR device and the ID information of the device to be inspected that the AR device is aimed at; The data center obtains a device operation database, wherein the device operation database includes a plurality of triplets, each of which includes a preset device ID information, a preset ID information of a device to be inspected, and operation interval time information; The data center obtains operation interval time information in triplet in which the preset device ID information is the same as the AR device ID information and the preset ID information of the device to be inspected is the same as the ID information of the device to be inspected; The data center obtains a preset time period; The data center determines whether the operation interval information is greater than or equal to the preset time period, and if so, The data center generates AR test information and sends it to the AR device worn by the inspector, so that the AR device generates an AR test according to the AR test information and obtains a test score according to the operation of the inspector; The data center obtains the test score obtained by the inspector after performing the AR test, and when the test score exceeds a preset score threshold, it is determined that the inspection of the equipment to be inspected is completed.

2. The AR inspection method for industrial parks according to claim 1 is characterized in that: The data center generates AR test information including: The data center obtains the number of operation types of the device to be inspected according to the ID information of the device to be inspected. If the number of operation types exceeds one, The AR test information sent by the data center includes test quantity information.

3. The AR inspection method for industrial parks as claimed in claim 2, characterized in that: When the AR test information includes test quantity information, the AR device generating the AR test according to the AR test information includes: The AR device obtains the facial image information of the inspection personnel; The AR device obtains basic information of the inspector based on the acquired facial image information and sends the basic information of the inspector to the data center; The data center selects test content based on the acquired facial image information and sends the test content to the AR device; The AR device generates an AR test according to the test content.

4. The AR inspection method for industrial parks according to claim 3 is characterized in that: The data center selects test content according to the acquired face image information and sends the test content to the AR device, including: Acquire a scoring database, wherein the scoring database includes a plurality of scoring data sub-databases, one scoring data sub-database corresponds to a preset face image information, and each scoring data sub-database includes at least one test content and the latest scoring information corresponding to each test content; Acquire a scoring data sub-library corresponding to preset face image information whose similarity with the face image information exceeds a preset threshold, the scoring data sub-library being referred to as the scoring data sub-library to be selected; Obtaining the latest scoring information corresponding to the test content that can be performed on the current device to be inspected in the scoring data word library to be selected; Determine whether one or more of the most recent rating information obtained is less than the preset rating. If so, The test content corresponding to the most recent score information that is less than the preset score is selected and sent to the AR device.

5. The AR inspection method for industrial parks as claimed in claim 4, characterized in that: The data center selects test content according to the acquired face image information and sends the test content to the AR device further comprising: Determine whether one or more of the recently obtained rating information is less than the preset rating. If not, The test content corresponding to the one with the smallest recent score information is selected and sent to the AR device.

6. The AR inspection method for industrial parks as claimed in claim 4, characterized in that: The data center selects test content according to the acquired face image information and sends the test content to the AR device further comprising: Determine whether one or more of the recently obtained rating information is less than the preset rating. If not, Randomly select a test content and send it to the AR device.

7. The AR inspection method for industrial parks according to claim 5 or 6, characterized in that: AR devices include: A camera device, which is used to obtain the movement trajectory of the inspection personnel; A head-mounted AR body, wherein the head-mounted AR body is used to display images and play sounds, and wherein a plurality of test programs are stored in the head-mounted AR body, and one test program corresponds to one test content.

8. The AR inspection method for industrial parks as claimed in claim 7, characterized in that: The AR device generating an AR test according to the test content includes: Selecting a test program corresponding to the test content, and when there are multiple test contents, randomly selecting one of the test contents; When the inspector performs hand operations according to the test content, obtaining the hand movement trajectory of the inspector; The test score of the inspector is obtained according to the hand movement trajectory of the inspector.

9. The AR inspection method for industrial parks as claimed in claim 8, characterized in that: The AR inspection method for industrial parks further includes: After the inspection of the device to be inspected is completed, the data center generates a next position inspection signal and transmits it to the AR device; The AR device generates a prompt voice according to the next position inspection signal, so that the inspection personnel go to the location of the next device to be inspected after receiving the prompt voice.

10. An AR inspection system for industrial parks, characterized by: The AR inspection system for industrial parks includes a data center and an AR device. The data center and the AR device cooperate to implement the AR inspection method for industrial parks as described in any one of claims 1 to 9.

Images