Intelligent device control method and system based on ar glasses inspection technology

Abstract

The application discloses an intelligent equipment control method based on AR glasses inspection technology, which comprises the following steps: acquiring a digital inspection work order corresponding to a current inspection operation of AR glasses, wherein the digital inspection work order comprises an inspection target and a task list; determining an inspection area of the inspection target and the task list corresponding to the current inspection operation according to the digital inspection work order; and controlling the display system to image inspection information corresponding to the inspection area in a preset mode, so that the AR glasses can be used to realize real-time operation guidance for the inspection target.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of inspection, and particularly to an intelligent device control method and system based on AR glasses inspection technology. BACKGROUND

[0002] At present, there are many inspection business applications on the market, such as power grids, agricultural insurance, bridges and pipelines, which all need to be regularly inspected to ensure the safety and normal operation of these facilities. However, current inspection is mostly achieved through manual inspection or machine inspection, but some special scenarios must be completed by manual operation. If manual operation makes mistakes, it may cause property loss, and even cause life-threatening to workers. At present, there is a lack of effective auxiliary equipment to support the inspection of workers. SUMMARY

[0003] To solve the above-mentioned problems, the present application provides an intelligent device control method based on AR glasses inspection technology, which comprises: acquiring a digital inspection work order corresponding to a current inspection operation of AR glasses, wherein the digital inspection work order includes an inspection target and a task list; determining an inspection area of the inspection target and the task list corresponding to the current inspection operation according to the digital inspection work order; and controlling the display system to image the inspection information corresponding to the inspection area in a preset mode.

[0004] In some embodiments, after determining the inspection area of the inspection target and the task list corresponding to the current inspection operation according to the digital inspection work order, the method comprises: determining the position information of each inspection area; adjusting the display system to focus on each inspection area according to the position information of each inspection area; and controlling the display system to image the inspection information corresponding to each inspection area in a preset mode.

[0005] After focusing on each inspection area, the display system is controlled to image the inspection information corresponding to each inspection area in a preset mode.

[0006] In some embodiments, the display system is a glasses-type display system, and after focusing on each inspection area, the display system is controlled to image the inspection information corresponding to each inspection area in a preset mode, which comprises: after focusing on each inspection area, adjusting the display system to direct the operation to the target task list corresponding to each inspection area, so as to image each inspection area in a dynamic operation directing mode by using the display system, and controlling the display system to image the inspection information in a preset mode according to the target task list corresponding to each inspection area.

[0007] In some embodiments, before adjusting the guidance operation of the display system to the target task list corresponding to each of the inspection areas, the method further comprises: adjusting the head pose of the display system so that each of the inspection areas is located at the center of the display system screen.

[0008] In some embodiments, before adjusting the guidance operation of the display system to the target task list corresponding to each of the inspection areas, the method further comprises: determining the target task list corresponding to each of the inspection areas according to the area of each of the inspection areas on the display system screen.

[0009] In some embodiments, before adjusting the guidance operation of the display system to the target task list corresponding to each of the inspection areas, the method further comprises: determining whether each of the inspection areas has a preset knowledge base with the display system; and determining the target task list corresponding to each of the inspection areas according to whether each of the inspection areas has a preset knowledge base with the display system.

[0010] In some embodiments, the determining whether each of the inspection areas has a preset knowledge base with the display system comprises: obtaining whether the inspection target and task list has a preset knowledge base with the display system, and obtaining the function module of each of the inspection areas relative to the inspection target and task list; and determining the auxiliary guidance of each of the inspection areas with the display system according to whether the inspection target and task list has a preset knowledge base with the display system, and the function module of each of the inspection areas relative to the inspection target and task list.

[0011] In some embodiments, the obtaining the function module of each of the inspection areas relative to the inspection target and task list comprises: determining the function module of each of the inspection areas relative to the inspection target and task list according to the template information of the inspection target and task list in the digital inspection work order.

[0012] In some embodiments, the obtaining the digital inspection work order corresponding to the current inspection operation of the AR glasses comprises: receiving an area image sent by a remote assistance device, the area image being selected by a worker based on an imaging image displayed by the remote assistance device in a preset mode; and selecting a digital inspection work order matching the area image from a plurality of preset digital inspection work orders based on the area image to determine the digital inspection work order corresponding to the current inspection operation.

[0013] The application also discloses an intelligent device control system based on an AR glasses inspection technology, which comprises a client and a network end; the client comprises AR glasses and a mobile terminal, the AR glasses specifically comprise an inspection module, a remote assistance module, a knowledge base module and a report module, and the mobile terminal comprises the remote assistance module; the network end comprises the inspection module, the remote assistance module, the knowledge base module and the report module; the system realizes the following steps: obtaining a digital inspection work order corresponding to a current inspection operation of the AR glasses, wherein the digital inspection work order comprises an inspection target and a task list; determining an inspection area of the inspection target and the task list corresponding to the current inspection operation according to the digital inspection work order; and controlling the display system to image inspection information corresponding to the inspection area in a preset mode.

[0014] From the above technical solutions, the application has the following advantages:

[0015] The AR glasses are adopted to realize real-time operation guidance for the inspection target, which can greatly reduce the errors and non-standard operation in the operation process, and the device can quickly train new people, so that the inspection quality of some special features is further improved, the safety factor of the inspection workers is increased, the training time of the workers is saved, and the inspection quality is ensured.

[0016] Additional aspects and advantages of the application will be in part apparent and in part pointed out hereinafter. BRIEF DESCRIPTION OF DRAWINGS

[0017] The above and / or additional aspects and advantages of the application will become apparent and be readily appreciated from the following description, including the appended drawings, wherein:

[0018] Figure 1 A flowchart of an embodiment of the application is provided;

[0019] Figure 2 A flowchart of another embodiment of the application is provided;

[0020] Figure 3 A flowchart of another embodiment of the application is provided;

[0021] Figure 4 A system diagram of an embodiment of the application is provided. DETAILED DESCRIPTION

[0022] Embodiments of the present application are described below in detail with reference to the accompanying drawings, wherein the same or similar components or elements are denoted throughout the drawings by the same or similar reference numerals. The embodiments described below with reference to the accompanying drawings are exemplary and are for the purpose of explanation only, and are not to be understood as limiting the present application.

[0023] In the description of the present application, it should be understood that the terms "first", "second" are used only for the purpose of description, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the technical features indicated. Therefore, the features defined as "first", "second" can explicitly or implicitly include one or more of the features. In the description of the present application, the meaning of "a plurality of" is two or more, unless otherwise specifically limited.

[0024] The following disclosure provides many different embodiments or examples for implementing different structures of the present application. In order to simplify the disclosure of the present application, the components and settings of specific examples are described below. Of course, they are only examples, and the purpose is not to limit the present application. In addition, the present application can repeatedly refer to numbers and / or letters in different examples, and such repetition is for the purpose of simplification and clarity, which itself does not indicate the relationship between the various embodiments and / or settings discussed. In addition, the present application provides various specific examples of processes and materials, but those of ordinary skill in the art can realize the application of other processes and / or the use of other materials.

[0025] In order to make the purpose, technical solutions and advantages of the present application clearer, the embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

[0026] In order to facilitate a detailed description of the embodiments of the present application, the following takes the inspection system of the method applied to AR glasses as an example to explain how to improve the inspection efficiency of AR glasses when using AR glasses for inspection.

[0027] Specifically, as shown in Figure 1 The intelligent device control method based on AR glasses inspection technology specifically includes steps S101-S103.

[0028] S101: Obtain a digital inspection work order corresponding to the current inspection operation of the AR glasses, wherein the digital inspection work order includes an inspection target and a task list.

[0029] For the inspection with AR glasses, in order to save the manual inspection of the inspector, various different inspection operations corresponding to the digital inspection work order are pre-configured, wherein the digital inspection work order includes the template information such as the inspection target and task list, the shape corresponding to the inspection target and task list, the material corresponding to the inspection target and task list, one or more inspection areas corresponding to the inspection target and task list, and the relative position of the inspection area relative to the inspection target and task list.

[0030] For example, the digital inspection work order corresponding to various different inspection operations is generated by multiple sample images through an algorithm, or the digital inspection work order is generated according to historical record information of manual inspection of the staff, or the inspection target and task list of the digital inspection work order is pre-calibrated by the inspection system of the AR glasses.

[0031] In another embodiment, the inspection system of the AR glasses opens a knowledge base function, similar to the operation of the staff's memory. After the staff opens this function and performs the inspection, the inspection system of the AR glasses records the historical record information such as the image imaged in the preset mode during the manual inspection of the staff, the guiding operation used when each inspection area is imaged in the preset mode, and the relative position of each inspection area relative to the overall inspection target, and generates the inspection target template according to the historical record information.

[0032] In another embodiment, in combination with the above-mentioned method of generating a digital inspection work order, a basic version of the inspection template is generated through an algorithm, and the staff can manually adjust the inspection template according to their own needs, such as adding or reducing the inspection area, and the like. The inspection system of the AR glasses records and learns the operation of the staff, adds and / or deletes the operation of the inspection area performed by the staff, and updates the digital inspection work order.

[0033] In the inspection with the AR glasses, the digital inspection work order corresponding to the current inspection operation is first acquired. The digital inspection work order corresponding to the current inspection operation can be automatically matched from the pre-configured multiple digital inspection work orders, or can be determined based on the selection operation of the staff.

[0034] In an embodiment, acquiring the digital inspection work order corresponding to the current inspection operation of the AR glasses can include: acquiring a real-time image imaged by the display system in a preset mode; and selecting a digital inspection work order matching the real-time image from the pre-stored multiple digital inspection work orders based on the real-time image imaged by the display system in the preset mode, and determining the digital inspection work order as the digital inspection work order corresponding to the current inspection operation. That is, the operation of acquiring the digital inspection work order does not depend on the staff, that is, it does not need to be intervened by the staff, and is automatically matched.

[0035] In one embodiment, obtaining the digital inspection work order corresponding to the current inspection operation of the AR glasses may include: receiving a region image sent by a remote assistance device, wherein the region image is selected by the staff based on an image displayed by the remote assistance device in a preset mode; and selecting a digital inspection work order that matches the region image from a preset variety of digital inspection work orders based on the region image, and determining it as the digital inspection work order corresponding to the current inspection operation.

[0036] Staff select objects to be inspected from images displayed in a preset mode on the remote assistance device of the AR glasses. For example, staff can select the target from the image displayed on the remote assistance device's control interface. Based on the staff's selection, the remote assistance device obtains the selected area image in the preset mode, along with the corresponding coordinate information. The remote assistance device then transmits the area image and its coordinates to the AR glasses' inspection system via wired or wireless means. Based on the received area image, the system intelligently matches it with various preset digital inspection work orders, selects the one that matches the area image, and records the position coordinates of the object in the preset mode image within the preset mode image.

[0037] S102. Based on the digital inspection work order, determine the inspection target and the inspection area of ​​the task list corresponding to the current inspection operation.

[0038] Taking the inspection target template as an example, for the same type of inspection target, the position of its inspection area on the inspection target framework is often relatively fixed. Once the inspection target template is determined, the types of inspection areas under that template, and the position of each inspection area on the inspection target, are also determined. That is, based on the digital inspection work order corresponding to the current inspection operation, one or more inspection areas corresponding to the inspection target and task list in that digital inspection work order can be determined.

[0039] S103. Control the display system to image the inspection information corresponding to the inspection area in a preset mode.

[0040] Based on one or more identified inspection areas, the control display system images the inspection information corresponding to those inspection areas in a preset mode.

[0041] In one embodiment, such as Figure 2 As shown, step S102 may be followed by steps S104 and S105.

[0042] S104. Determine the location information of each of the inspection areas.

[0043] S105, adjust the display system to focus on each of the inspection areas according to the position information of each of the inspection areas.

[0044] Step S103 can include sub-step S1031.

[0045] S1031, after focusing on each of the inspection areas, control the display system to image the inspection information corresponding to each of the inspection areas in a preset mode.

[0046] In order to image clear inspection information in a preset mode, after determining one or more inspection areas corresponding to the inspection target and the task list, the position information of each inspection area is determined first. For example, taking one or more inspection areas of the inspection target as an example, according to the position coordinates of the inspection target and the position of the inspection area relative to the inspection target, the position of each inspection area in the imaging picture in the preset mode is calculated, so as to obtain the position information of each inspection area.

[0047] In an embodiment, after focusing on each of the inspection areas, controlling the display system to image the inspection information corresponding to each of the inspection areas in a preset mode can include: after focusing on each of the inspection areas, adjusting the guiding operation of the display system to the target task list corresponding to each of the inspection areas, so as to image each of the inspection areas in a dynamic operation guiding mode by using the display system.

[0048] Among them, the display system includes a glasses type display system, can image in a dynamic operation guiding mode, the display system determines the target task list corresponding to the currently focused inspection area before imaging the inspection information of the currently focused inspection area in a preset mode each time, adjusts the guiding operation of the display system to the target task list corresponding to the currently focused inspection area, and then images the inspection information corresponding to the currently focused inspection area in a preset mode by using the adjusted target task list. That is, the display system is used to image the inspection area of the inspection target and the task list in a dynamic operation guiding mode.

[0049] In an embodiment, before adjusting the guiding operation of the display system to the target task list corresponding to each of the inspection areas, it can include: adjusting the head posture of the display system, so that each of the inspection areas is located at the center position of the picture of the display system.

[0050] Since the inspection target and the task list of the inspection area do not exactly locate at the center of the display system, before imaging the inspection information corresponding to each inspection area in the preset mode, the head pose of the display system is adjusted to change the screen of the display system so that each inspection area is located at the center of the screen of the display system, and then the pointing operation of the display system is adjusted to the target task list corresponding to each inspection area to image in the preset mode. It should be noted that the pointing operation of the display system can be adjusted first, and then the head pose of the display system is adjusted, or the head pose of the display system and the pointing operation are adjusted at the same time, and the specific mode is not limited here.

[0051] In an embodiment, before adjusting the pointing operation of the display system to the target task list corresponding to each inspection area, the target task list corresponding to each inspection area can be determined according to the area of each inspection area on the screen of the display system.

[0052] In an embodiment, before adjusting the pointing operation of the display system to the target task list corresponding to each inspection area, it can be determined whether each inspection area has a preset knowledge base with the display system, and the target task list corresponding to each inspection area can be determined according to whether each inspection area has a preset knowledge base with the display system.

[0053] By determining whether each inspection area has a preset knowledge base with the display system, the target task list corresponding to each inspection area can be determined according to whether each inspection area has a preset knowledge base with the display system. Alternatively, a mapping relationship between whether each inspection area has a preset knowledge base with the display system and the corresponding target task list can be set in advance, and after it is determined whether each inspection area has a preset knowledge base with the display system, the target task list corresponding to each inspection area can be obtained by querying the mapping relationship.

[0054] In order to accurately determine whether each inspection area has a preset knowledge base with the display system, whether the inspection target and the task list have a preset knowledge base with the display system can be obtained, such as whether the overall inspection target has a preset knowledge base with the display system.

[0055] Further, a function module of each inspection area relative to the inspection target and the task list is obtained. For example, the function module of each inspection area relative to the inspection target can be determined according to the template information of the inspection target and the task list in the digital inspection work order. For example, the function module of each inspection area relative to the inspection target is determined according to the relative position of one or more inspection areas of the inspection target relative to the inspection target. The target task list corresponding to each inspection area is determined according to whether the inspection target and the task list have a preset knowledge base of the display system and the function module of each inspection area relative to the inspection target and the task list.

[0056] In an embodiment, as shown in FIG. 1, step S102 can further include step S106. Figure 3

[0057] S106, sending the confirmation request information corresponding to the inspection area to the remote assistance device.

[0058] Step S104 can include sub-step S1041.

[0059] S1041, when receiving the confirmation information fed back by the remote assistance device based on the confirmation request information, determining the position information of each inspection area.

[0060] In order to further improve the experience of the staff and the accuracy of the detected inspection area, after determining one or more inspection areas of the inspection target and the task list corresponding to the current inspection operation, the corresponding confirmation request information of the inspection area is sent to the remote assistance device of the AR glasses. Optionally, the confirmation request information includes coordinate information or image information of the inspection area.

[0061] For example, before sending the confirmation request information of the inspection area to the remote assistance device, the coordinate information of the inspection area can be obtained, and the confirmation request information can be generated according to the coordinate information of the inspection area.

[0062] Based on the coordinate information of each inspection area, the confirmation request information containing the coordinate information of each inspection area is generated, and then the confirmation request information containing the coordinate information and / or image information of each inspection area is sent to the remote assistance device of the AR glasses.

[0063] After the remote assistance device receives the confirmation request information, the remote assistance device displays the confirmation interface corresponding to the inspection area according to the coordinate information and / or image information of the inspection area contained in the confirmation request information. The inspection area is marked on the displayed confirmation interface. For example, the inspection area is marked on the display interface of the remote assistance device by marking, shading, etc.

[0064] ​In an embodiment, the determining of the position information of each inspection area can comprise: determining, according to the coordinate information of each inspection area, second relative coordinate information of each inspection area relative to a picture center of the display system, and determining the second relative coordinate information as the position information of each inspection area.

[0065] The above embodiment can greatly reduce the errors and non-standard operations in the operation process, and the device can quickly train new people, so that the inspection quality of certain characteristic occasions is further improved, the safety factor of the inspection personnel is increased, the training time of the personnel is saved, and the inspection quality is ensured.

[0066] Please refer to Figure 4 , Figure 4 is a schematic block diagram of an intelligent device control system based on the AR glass inspection technology provided in the embodiment of the present application.

[0067] The system comprises a client 400 and a network end 500;

[0068] The client 400 comprises an AR glass 410 and a mobile terminal 420, wherein the AR glass specifically comprises an inspection module 411, a remote assistance module 412, a knowledge base module 413, and a report module 414, and the mobile terminal comprises a remote assistance module 421;

[0069] The network end 500 comprises an inspection module 510, a remote assistance module 520, a knowledge base module 530, and a report module 540, and the system implements the following steps:

[0070] The processor is configured to run a computer program stored in the memory, and when the computer program is executed, the following steps are implemented:

[0071] An AR glass current inspection operation corresponding digital inspection work order is acquired, wherein the digital inspection work order comprises an inspection target and a task list;

[0072] According to the digital inspection work order, an inspection area corresponding to the inspection target and the task list of the current inspection operation is determined;

[0073] The display system is controlled to image the inspection information corresponding to the inspection area in a preset mode.

[0074] In some embodiments, the processor, after implementing the determining, according to the digital inspection work order, a target of inspection and a list of tasks corresponding to a region of inspection of a current inspection operation, further implements:

[0075] determining position information of each of the regions of inspection;

[0076] adjusting the display system to focus on each of the regions of inspection according to the position information of each of the regions of inspection;

[0077] The processor, when implementing the controlling the display system to image the inspection information corresponding to each of the regions of inspection in a preset mode, specifically implements:

[0078] controlling the display system to image the inspection information corresponding to each of the regions of inspection in a preset mode after focusing on each of the regions of inspection.

[0079] In some embodiments, the display system is a glasses-type display system, and the processor, when implementing the controlling the display system to image the inspection information corresponding to each of the regions of inspection in a preset mode after focusing on each of the regions of inspection, specifically implements:

[0080] adjusting a pointing operation of the display system to a target task list corresponding to each of the regions of inspection to image each of the regions of inspection in a dynamic operation pointing mode by using the display system after focusing on each of the regions of inspection;

[0081] controlling the display system to image the inspection information in a preset mode according to the target task list corresponding to each of the regions of inspection.

[0082] In some embodiments, the processor, before implementing the adjusting the pointing operation of the display system to the target task list corresponding to each of the regions of inspection, further implements:

[0083] adjusting a head pose of the display system so that each of the regions of inspection is located at a center position of a picture area of the display system.

[0084] In some embodiments, the processor, before implementing the adjusting the pointing operation of the display system to the target task list corresponding to each of the regions of inspection, further implements:

[0085] determining the target task list corresponding to each of the regions of inspection according to a picture area of the display system occupied by each of the regions of inspection.

[0086] In some embodiments, the processor, before implementing the adjusting the pointing operation of the display system to the target task list corresponding to each of the regions of inspection, further implements:

[0087] determine whether each of the inspection areas has preset knowledge base with the display system;

[0088] determine the target task list corresponding to each of the inspection areas according to whether each of the inspection areas has preset knowledge base with the display system.

[0089] In some embodiments, the processor, in determining whether each of the inspection areas has preset knowledge base with the display system, specifically implements:

[0090] obtains whether the inspection target and task list has preset knowledge base with the display system, and obtains the functional module of each of the inspection areas relative to the inspection target and task list;

[0091] In some embodiments, the processor, in obtaining the functional module of each of the inspection areas relative to the inspection target and task list, specifically implements:

[0092] determines the functional module of each of the inspection areas relative to the inspection target and task list according to the template information of the inspection target and task list in the digital inspection work order.

[0093] In some embodiments, the processor, in obtaining the digital inspection work order corresponding to the current inspection operation of the AR glasses, specifically implements:

[0094] receives the area image sent by the remote assistance device, the area image being selected by the worker based on the imaging image displayed by the remote assistance device in a preset mode;

[0095] determines the digital inspection work order corresponding to the current inspection operation based on the area image, selects the digital inspection work order matching the area image from the preset plurality of digital inspection work orders.

[0096] In some embodiments, the processor, in obtaining the digital inspection work order corresponding to the current inspection operation of the AR glasses, specifically implements:

[0097] obtains the real-time image imaged by the display system in a preset mode;

[0098] determines the digital inspection work order corresponding to the current inspection operation based on the real-time image, selects the digital inspection work order matching the real-time image from the preset plurality of digital inspection work orders.

[0099] In some embodiments, after the processor determines the inspection area of the inspection target and task list corresponding to the current inspection operation according to the digital inspection work order, the processor further implements:

[0100] sending, by a transceiver, a confirmation request information corresponding to the inspection area to a remote assistance device;

[0101] determining position information of each of the inspection areas when receiving, by the transceiver, a confirmation information fed back by the remote assistance device based on the confirmation request information.

[0102] In some embodiments, the processor, before implementing the sending of the confirmation request information corresponding to the inspection area to the remote assistance device, further implements:

[0103] obtaining coordinate information of the inspection area;

[0104] generating the confirmation request information according to the coordinate information of the inspection area;

[0105] In some embodiments, the processor, when implementing the obtaining of the coordinate information of the inspection area, specifically implements:

[0106] obtaining coordinate information of the inspection target and the task list, and first relative coordinate information of each of the inspection areas relative to the inspection target and the task list;

[0107] determining coordinate information of each of the inspection areas according to the coordinate information of the inspection target and the task list, and the first relative coordinate information of each of the inspection areas relative to the inspection target and the task list.

[0108] In some embodiments, the processor, when implementing the determining of the position information of each of the inspection areas, specifically implements:

[0109] determining second relative coordinate information of each of the inspection areas relative to a picture center of the display system according to the coordinate information of each of the inspection areas, and determining the second relative coordinate information as the position information of each of the inspection areas.

[0110] In some embodiments, the digital inspection work order is generated by an algorithm through multiple sample images, or the digital inspection work order is generated according to historical record information of manual inspection by a worker, or the inspection target and the task list are pre-calibrated by a system.

[0111] In some embodiments, the processor, when executing the computer program, further implements:

[0112] updating the digital inspection work order according to an inspection area addition and / or deletion operation performed by a worker.

[0113] In some embodiments, the processor further implements, after implementing the control of the display system to image the inspection information corresponding to the inspection area in the preset mode:

[0114] saving the inspection information corresponding to the inspection area.

[0115] In the description of the present specification, the description of the terms "one embodiment", "certain embodiments", "exemplary embodiment", "example", "specific example", or "some examples" and the like means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In the present specification, the exemplary description of the above terms does not necessarily mean the same embodiment or example. Also, the specific features, structures, materials or characteristics described can be appropriately combined in any one or more embodiments or examples.

[0116] Although the embodiments of the present application have been shown and described, it will be understood by those having ordinary skill in the art that various changes, modifications, substitutions and alterations can be made hereto without departing from the principles and spirit of the present application, and the scope of the present application is defined by the claims and their equivalents.

Claims

1. A method for controlling an intelligent device based on an AR glasses inspection technology, wherein an AR glasses is loaded with a display system, characterized in that, The method comprises the following steps: acquiring a digital inspection work order corresponding to a current inspection operation of an AR glasses, wherein the digital inspection work order comprises an inspection target and a task list; determining an inspection area of the inspection target and the task list corresponding to the current inspection operation according to the digital inspection work order; controlling the display system to image the inspection information corresponding to the inspection area in a preset mode; after determining the inspection area of the inspection target and the task list corresponding to the current inspection operation, the method comprises the following steps: determining position information of each inspection area; adjusting the display system to focus on each inspection area according to the position information of each inspection area; the step of controlling the display system to image the inspection information corresponding to the inspection area in a preset mode comprises the following steps: after focusing on each inspection area, controlling the display system to image the inspection information corresponding to each inspection area in a preset mode; the display system is a glasses display system, and the step of controlling the display system to image the inspection information corresponding to each inspection area in a preset mode after focusing on each inspection area comprises the following steps: after focusing on each inspection area, adjusting the guiding operation of the display system to the target task list corresponding to each inspection area to image each inspection area in a dynamic operation guiding mode by using the display system, and controlling the display system to image the inspection information in a preset mode according to the target task list corresponding to each inspection area; before adjusting the guiding operation of the display system to the target task list corresponding to each inspection area, the method comprises the following steps: determining the target task list corresponding to each inspection area according to the area of each inspection area in the display system.

2. The method of claim 1, wherein, before adjusting the guiding operation of the display system to the target task list corresponding to each inspection area, the method comprises the following steps: adjusting the head posture of the display system to make each inspection area located at the center of the display system.

3. The method of claim 2, wherein, before adjusting the guiding operation of the display system to the target task list corresponding to each inspection area, the method comprises the following steps: determining whether each inspection area has a preset knowledge base with the display system; determining the target task list corresponding to each inspection area according to whether each inspection area has a preset knowledge base with the display system.

4. The method of claim 3, wherein, the step of determining whether each inspection area has a preset knowledge base with the display system comprises the following steps: acquiring whether the inspection target and the task list have a preset knowledge base with the display system, and acquiring a function module of each inspection area relative to the inspection target and the task list; determining the auxiliary guidance of each inspection area to the display system according to whether the inspection target and the task list have a preset knowledge base with the display system and the function module of each inspection area relative to the inspection target and the task list.

5. The method of claim 4, wherein, the step of acquiring the function module of each inspection area relative to the inspection target and the task list comprises the following steps: According to the template information of the inspection target and the task list in the digital inspection work order, the function module of each inspection area relative to the inspection target and the task list is determined.

6. The method of claim 5, wherein, The digital inspection work order corresponding to the current inspection operation of the AR glasses is obtained, and the digital inspection work order includes an inspection target and a task list. The system receives an area image sent by the remote assistance device, and the area image is selected by the staff based on the imaging image displayed by the remote assistance device in a preset mode; Based on the area image, a digital inspection work order matching the area image is selected from a plurality of preset digital inspection work orders, and the digital inspection work order corresponding to the current inspection operation is determined.

7. The intelligent device control system based on the AR glasses patrol technology, using the intelligent device control method based on the AR glasses patrol technology according to claim 6, characterized in that, The system includes a client and a network end; The client includes AR glasses and a mobile terminal, the AR glasses specifically include an inspection module, a remote assistance module, a knowledge base module, and a report module, and the mobile terminal includes a remote assistance module; The network end includes an inspection module, a remote assistance module, a knowledge base module, and a report module, and the system realizes the following steps: A digital inspection work order corresponding to the current inspection operation of the AR glasses is obtained, and the digital inspection work order includes an inspection target and a task list; According to the digital inspection work order, the inspection target and the task list corresponding to the current inspection operation are determined. The display system is controlled to image the inspection information corresponding to the inspection area in a preset mode.

Images