Method and device for executing inspection task, and medium

Abstract

The present application aims to provide a method and device for executing an inspection task, and a medium. In the method of the present application, each item of an inspection task is assigned to one or more of three 'terminals', i.e., inspection personnel performing execution on site by using an augmented reality device, an inspection robot automatically performing execution on site, and / or a data analysis platform generating an analysis result on the basis of a rule engine as an execution result for invocation and feedback. The inspection personnel, the robot, and the data analysis platform are organically combined to jointly perform the inspection task, thereby greatly improving inspection efficiency, accelerating the execution speed of inspection tasks, and reducing the time for remote communication and confirmation of anomaly issues. Therefore, a collaborative mode can be achieved, in which the data analysis platform, the robot, and the inspection personnel jointly support device inspection; and by empowering humans with augmented reality to enhance efficiency, and by intelligently executing spot inspection and scheduled maintenance takes, a complete closed loop of inspection operations is established.

Description

Method, device and medium for performing inspection tasks

[0001] This application is based on the application with CN application number 202410607216.8, application date 2024.05.15, and claims priority thereto, the disclosure of which is hereby incorporated by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the field of communication, in particular to a technology for performing an inspection task. BACKGROUND

[0003] With the advent of the fourth industrial revolution, information technology and manufacturing industry are deeply integrated. With the rapid development of technologies such as Internet of Things, big data and analysis, cloud computing and edge computing, artificial intelligence, automation and robots, virtual reality and augmented reality, they are jointly promoting the industry to move towards information and intelligence.

[0004] In the prior art, the maintenance of equipment in an industrial scene still mainly relies on people to the scene to perform, and the prediction discovery, judgment basis and processing method of equipment problems still mainly rely on management system and experience. On this basis, how to use intelligent means to empower people and explore the equipment maintenance mode combining man and machine is the research direction of equipment maintenance in an industrial scene.

[0005] SUMMARY

[0006] An object of the present application is to provide a method, device and medium for performing an inspection task.

[0007] According to one aspect of the present application, a method for performing an inspection task is provided, the method comprising:

[0008] obtaining one or more inspection item information to be executed corresponding to a target inspection task, determining at least one first inspection item information allocated to a data analysis platform, at least one second inspection item information allocated to an augmented reality device, and at least one third inspection item information allocated to a robot in the one or more inspection item information;

[0009] sending the at least one first inspection item information to the data analysis platform, and obtaining first execution result information corresponding to the at least one first inspection item information returned by the data analysis platform, wherein the data analysis platform analyzes the field data of the inspection site through a rule engine and generates a corresponding analysis result, and determines the first execution result according to the analysis result;

[0010] sending the at least one second inspection item information to the augmented reality device, and obtaining a second execution result corresponding to the at least one second inspection item information returned by the augmented reality device, wherein the second execution result is obtained by a person performing the at least one second inspection item information using the augmented reality device at the inspection site;

[0011] sending the at least one third inspection item information to the robot, and obtaining a third execution result corresponding to the at least one third inspection item information returned by the robot, wherein the third execution result is obtained by the robot executing a control command corresponding to the at least one third inspection item information at the inspection site;

[0012] determining a task execution result corresponding to the target inspection task according to the first execution result, the second execution result, and the third execution result.

[0013] According to an aspect of the present application, a computer device for performing an inspection task is provided, which comprises:

[0014] a processor; and

[0015] a memory arranged to store computer executable instructions which, when executed, cause the processor to perform the following operations:

[0016] obtaining one or more inspection item information to be executed corresponding to a target inspection task, and determining at least one first inspection item information allocated to a data analysis platform, at least one second inspection item information allocated to an augmented reality device, and at least one third inspection item information allocated to a robot in the one or more inspection item information;

[0017] sending the at least one first inspection item information to the data analysis platform, and obtaining a first execution result corresponding to the at least one first inspection item information returned by the data analysis platform, wherein the data analysis platform analyzes site data of the inspection site by a rule engine and generates a corresponding analysis result, and determines the first execution result according to the analysis result;

[0018] sending the at least one second inspection item information to the augmented reality device, and obtaining a second execution result corresponding to the at least one second inspection item information returned by the augmented reality device, wherein the second execution result is obtained by a person performing the at least one second inspection item information using the augmented reality device at the inspection site;

[0019] sending the at least one third inspection item information to the robot, and obtaining a third execution result corresponding to the at least one third inspection item information returned by the robot, wherein the robot executes a control command corresponding to the at least one third inspection item information in the inspection site to obtain the third execution result;

[0020] determining a task execution result corresponding to the target inspection task according to the first execution result, the second execution result and the third execution result.

[0021] According to an aspect of the present application, a computer readable medium storing instructions is provided, the instructions, when executed, causing a system to perform the following operations:

[0022] obtaining one or more inspection item information to be executed corresponding to a target inspection task, determining at least one first inspection item information allocated to a data analysis platform, at least one second inspection item information allocated to an augmented reality device, and at least one third inspection item information allocated to a robot in the one or more inspection item information;

[0023] sending the at least one first inspection item information to the data analysis platform, and obtaining a first execution result corresponding to the at least one first inspection item information returned by the data analysis platform, wherein the data analysis platform analyzes site data of the inspection site through a rule engine and generates a corresponding analysis result, and determines the first execution result according to the analysis result;

[0024] sending the at least one second inspection item information to the augmented reality device, and obtaining a second execution result corresponding to the at least one second inspection item information returned by the augmented reality device, wherein an inspection personnel executes the at least one second inspection item information by using the augmented reality device in the inspection site to obtain the second execution result;

[0025] sending the at least one third inspection item information to the robot, and obtaining a third execution result corresponding to the at least one third inspection item information returned by the robot, wherein the robot executes a control command corresponding to the at least one third inspection item information in the inspection site to obtain the third execution result;

[0026] determining a task execution result corresponding to the target inspection task according to the first execution result, the second execution result and the third execution result.

[0027] According to an aspect of the present application, a computer device for executing an inspection task is provided, the device comprising:

[0028] a first module configured to acquire one or more inspection items corresponding to a target inspection task, determine at least one first inspection item assigned to a data analysis platform, at least one second inspection item assigned to an augmented reality device, and at least one third inspection item assigned to a robot from the one or more inspection items;

[0029] a second module configured to send the at least one first inspection item to the data analysis platform, and acquire first execution result information corresponding to the at least one first inspection item returned by the data analysis platform, wherein the data analysis platform analyzes field data of the inspection field by using a rule engine and generates corresponding analysis results, and determines the first execution result according to the analysis results;

[0030] a third module configured to send the at least one second inspection item to the augmented reality device, and acquire second execution result information corresponding to the at least one second inspection item returned by the augmented reality device, wherein an inspection personnel executes the at least one second inspection item by using the augmented reality device to obtain the second execution result at the inspection field;

[0031] a fourth module configured to send the at least one third inspection item to the robot, and acquire third execution result information corresponding to the at least one third inspection item returned by the robot, wherein the robot executes a control command corresponding to the at least one third inspection item to obtain the third execution result at the inspection field;

[0032] a fifth module configured to determine a task execution result corresponding to the target inspection task according to the first execution result, the second execution result, and the third execution result.

[0033] Compared with the prior art, one or more inspection items corresponding to the target inspection task are obtained, at least one first inspection item information allocated to the data analysis platform, at least one second inspection item information allocated to the augmented reality device, and at least one third inspection item information allocated to the robot are determined in the one or more inspection items; the at least one first inspection item information is sent to the data analysis platform, and first execution result information corresponding to the at least one first inspection item information returned by the data analysis platform is obtained, wherein the data analysis platform analyzes the on-site data of the inspection site through a rule engine and generates a corresponding analysis result, and the first execution result is determined according to the analysis result; the at least one second inspection item information is sent to the augmented reality device, and a second execution result corresponding to the at least one second inspection item information returned by the augmented reality device is obtained, wherein the inspection personnel executes the at least one second inspection item information by using the augmented reality device in the inspection site to obtain the second execution result; the at least one third inspection item information is sent to the robot, and a third execution result corresponding to the at least one third inspection item information returned by the robot is obtained, wherein the robot executes a control command corresponding to the at least one third inspection item information in the inspection site to obtain the third execution result; the task execution result corresponding to the target inspection task is determined according to the first execution result, the second execution result and the third execution result, so that each item of the inspection task is allocated to one or more of the three "terminals" for execution, that is, the inspection personnel uses the augmented reality device to execute on site, the inspection robot automatically executes on site, and / or the data analysis platform generates an analysis result based on the rule engine as an execution result to call feedback, which organically combines the inspection personnel, the robot and the data analysis platform together to mix the inspection task, can greatly improve the inspection efficiency, speed up the execution speed of the inspection task, reduce the time of remote communication and confirmation of abnormal problems, can realize the linkage mode of the data analysis platform, the robot and the inspection personnel supporting equipment inspection together, enhance the efficiency of people through augmented reality, intelligently execute the point inspection and repair task, and create a complete working closed loop of the inspection business. BRIEF DESCRIPTION OF DRAWINGS

[0034] Other features, objects, and advantages of the application will become more apparent from the following detailed description of non-limiting embodiments made with reference to the drawings:

[0035] FIG. 1 shows a flowchart of a method for executing an inspection task according to an embodiment of the application;

[0036] FIG. 2 shows a computer device structure diagram for executing an inspection task according to an embodiment of the application;

[0037] FIG. 3 illustrates an exemplary system that can be used to implement various embodiments described in the present application.

[0038] The same or similar reference numerals in the drawings denote the same or similar components. DETAILED DESCRIPTION

[0039] The present application is further described in detail by way of reference to the accompanying drawings.

[0040] In one exemplary configuration of the present application, the terminal, the device of the service network and the trusted party each include one or more processors (e.g., central processing units (CPUs)), input / output interfaces, network interfaces, and memories.

[0041] The memory can include non-persistent memory, Random Access Memory (RAM), and / or non-volatile memory, such as Read Only Memory (ROM) or Flash memory, in a computer readable medium. The memory is an example of computer readable media.

[0042] Computer readable media includes permanent and non-permanent, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PCM), programmable random access memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic tape disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to a computing device.

[0043] The device referred to in the present application includes but is not limited to a user device, a network device, or a device formed by integrating a user device and a network device through a network. The user device includes but is not limited to any kind of mobile electronic product capable of human-computer interaction (for example, human-computer interaction through a touch panel), such as a smart phone, a tablet computer, etc. The mobile electronic product can adopt any operating system, such as an Android operating system, an iOS operating system, etc. The network device includes an electronic device capable of automatically performing numerical calculation and information processing according to a pre-set or stored instruction. The hardware of the network device includes but is not limited to a microprocessor, an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), a digital signal processor (DSP), an embedded device, etc. The network device includes but is not limited to a computer, a network host, a single network server, a plurality of network servers, or a cloud formed by a plurality of servers. The cloud is formed by a large number of computers or network servers based on cloud computing. The cloud computing is a kind of distributed computing, which is a virtual supercomputer formed by a group of loosely coupled computer clusters. The network includes but is not limited to the Internet, a wide area network, a metropolitan area network, a local area network, a VPN network, a wireless Ad Hoc network, etc. Preferably, the device can also be a program running on the user device, the network device, or a device formed by integrating a user device and a network device, a network device, a touch terminal, or a device formed by integrating a network device and a touch terminal through a network.

[0044] Of course, those skilled in the art should understand that the above device is only an example, and other existing or future devices, such as devices that can be applicable to the present application, should also be included in the protection scope of the present application, and are hereby included by reference.

[0045] In the description of the present application, the meaning of "a plurality of" is two or more, unless otherwise explicitly and specifically limited.

[0046] FIG. 1 shows a flowchart of a method for performing an inspection task according to an embodiment of the present application, which includes steps S11, S12, S13, S14 and S15. In step S11, the computer device obtains one or more pieces of inspection item information to be executed corresponding to a target inspection task, determines at least one first piece of inspection item information allocated to a data analysis platform, at least one second piece of inspection item information allocated to an augmented reality device, and at least one third piece of inspection item information allocated to a robot in the one or more pieces of inspection item information. In step S12, the computer device sends the at least one first piece of inspection item information to the data analysis platform and obtains first execution result information corresponding to the at least one first piece of inspection item information returned by the data analysis platform, wherein the data analysis platform analyzes field data of the inspection site through a rule engine and generates a corresponding analysis result, and determines the first execution result according to the analysis result. In step S13, the computer device sends the at least one second piece of inspection item information to the augmented reality device and obtains a second execution result corresponding to the at least one second piece of inspection item information returned by the augmented reality device, wherein an inspection personnel executes the at least one second piece of inspection item information by using the augmented reality device at the inspection site to obtain the second execution result. In step S14, the computer device sends the at least one third piece of inspection item information to the robot and obtains a third execution result corresponding to the at least one third piece of inspection item information returned by the robot, wherein the robot executes a control command corresponding to the at least one third piece of inspection item information at the inspection site to obtain the third execution result. In step S15, the computer device determines a task execution result corresponding to the target inspection task according to the first execution result, the second execution result and the third execution result.

[0047] In step S11, the computer device obtains one or more inspection item information to be executed corresponding to the target inspection task, determines at least one first inspection item information allocated to the data analysis platform, at least one second inspection item information allocated to the augmented reality device, and at least one third inspection item information allocated to the robot in the one or more inspection item information. In some embodiments, the target inspection task refers to a task for inspecting an industrial scene (the industrial scene includes at least one industrial equipment), which includes but is not limited to a workshop scene, a factory scene, an industrial production line scene, etc. A user can first create a target inspection task, and the target inspection task corresponds to one or more inspection item information to be executed. The one or more inspection item information can be set by the user for the target inspection task (for example, the user creates the one or more inspection item information for the target inspection task, or the user selects the one or more inspection item information from the created inspection item information for the target inspection task), or the one or more inspection item information can be automatically decomposed into one or more inspection item information by content recognition of the task information of the target inspection task. For example, a certain inspection item information is engine abnormal sound, and the corresponding target inspection task is belt engine maintenance task. For example, the inspection item information can also include reduction machine oil level inspection and reduction machine oil leakage inspection, and the corresponding target inspection task is belt reduction machine maintenance task. In some embodiments, at least one first inspection item information allocated to the data analysis platform, at least one second inspection item information allocated to the augmented reality device, and at least one third inspection item information allocated to the robot are determined in the one or more inspection item information. The first inspection item information, the second inspection item information, and the third inspection item information can have intersections. A certain inspection item information can belong to one of the first inspection item information, the second inspection item information, and the third inspection item information, or can belong to two or three of the first inspection item information, the second inspection item information, and the third inspection item information. That is, a certain inspection item information can be allocated to one of the data analysis platform, the augmented reality device, and the robot, or can be allocated to two or three of the data analysis platform, the augmented reality device, and the robot. In some embodiments, a user can specify to whom a certain inspection item information is allocated, or content recognition of a certain inspection item information can be performed to automatically determine whether the inspection item information is suitable for being executed by the data analysis platform, the augmented reality device, or the robot.

[0048] In step S12, the computer device sends the at least one first inspection item information to the data analysis platform, and obtains first execution result information corresponding to the at least one first inspection item information returned by the data analysis platform, wherein the data analysis platform analyzes the field data of the inspection site through a rule engine and generates a corresponding analysis result, and determines the first execution result according to the analysis result. In some embodiments, the field data of the inspection site includes but is not limited to one or more of the data of the industrial equipment in the inspection site, the data of the field environment of the inspection site (for example, environmental temperature, personnel behavior (such as crossing the boundary, staying, static timeout, illegal action, etc.) and the like), etc., wherein the data types include but are not limited to one or more of the robot collected data, the augmented reality device collected data, the inspection personnel collected data, the production line sensor collected data, the IoT system data, the equipment management system data, the IT system data, the fixed position monitoring data, etc. The field data can be obtained by the robot in the inspection process or the daily work (the daily work refers to the work of the robot according to the background preset business logic every day when there is no inspection task dispatched) of the inspection site and sent to the data analysis platform, or can also be obtained by the augmented reality device in the process of the inspection personnel using the augmented reality device to inspect the inspection site and sent to the data analysis platform, or input or edited by the inspection personnel on the augmented reality device and sent to the data analysis platform, or can also be generated by the industrial equipment or other sensor equipment in the inspection site and sent to the data analysis platform, or can also be input or edited by the staff of the inspection site on the terminal device used by the staff and sent to the data analysis platform, etc.In some embodiments, the data analysis platform analyzes the field data of the inspection site based on a pre-set rule engine according to the at least one first inspection item information, generates one or more analysis results about the at least one first inspection item information, and then determines the first execution result information corresponding to the at least one first inspection item information returned to the computer device according to the one or more analysis results, for example, directly taking the analysis result as the first execution result, or generating the first execution result by summarizing the analysis result, or screening out the content associated with the first inspection item information in the analysis result as the first execution result, wherein the rule engine is an automatic decision system based on conditional expressions, which can judge whether the field data of the inspection site meets a specific condition according to a pre-defined alarm triggering rule (for example: IF condition THEN result), and can further automatically trigger the corresponding alarm content. Through the analysis of the field data, the corresponding analysis result can be obtained, which includes but is not limited to one or more of the following: the industrial equipment (or environmental factors of the inspection site, workers, etc.) associated with the at least one first inspection item information is normal, the identification information of the industrial equipment (or environmental factors, workers, etc.) with abnormality, the specific abnormality content of the industrial equipment (or environmental factors, workers, etc.) with abnormality, the abnormality reason, the abnormality type, etc. In some embodiments, the data analysis platform supports user to customize the alarm triggering rule in the rule engine to achieve the purpose of automatically detecting the field data of the inspection site and automatically triggering the alarm by the rule engine according to the user's own demand, for example, the running state of the belt machine equipment can be monitored in real time by setting the alarm triggering rule, and the corresponding alarm content is automatically triggered when the equipment is abnormal.

[0049] In step S13, the computer device sends the at least one second inspection item information to the augmented reality device, and obtains a second execution result corresponding to the at least one second inspection item information returned by the augmented reality device, wherein the second execution result is obtained by the inspection personnel performing the at least one second inspection item information by using the augmented reality device at the inspection site. In some embodiments, the inspection personnel performs the inspection on the inspection site by using the augmented reality device (for example, wearing AR glasses), and the augmented reality device superimposes and presents augmented reality content (AR content) corresponding to the at least one second inspection item information in a real scene image during the inspection process. The augmented reality content can be superimposed and presented in the real scene image in the following manners: the display device of the augmented reality device displays a real scene image captured by a camera of the augmented reality device, and superimposes and presents the augmented reality content on the real scene image displayed by the display device (corresponding to a video see-through mode); or the display device of the augmented reality device does not display a real scene image captured by a camera of the augmented reality device, and the display device only presents the augmented reality content, so that the inspection personnel can see the real scene image through the display device, thereby superimposing and presenting the augmented reality content in the real scene image (corresponding to an optical see-through mode). The augmented reality device includes but is not limited to an AR smart wearable device (for example, AR glasses), a mobile phone, an iPad / Pad, or other devices with a display device and a camera. The augmented reality content includes but is not limited to one or more of item content, item precautions, item reference materials, task data, and the like of the second inspection item information. In some embodiments, the inspection personnel performs a corresponding inspection operation at the inspection site based on the prompt of the augmented reality content, and the corresponding second execution result can be obtained by the inspection personnel based on the inspection operation, and input to the augmented reality device (for example, the inspection personnel frames, checks, or inputs text, captures a site video, and the like in an interface of the augmented reality device), or can be obtained by the augmented reality device during the inspection operation of the inspection personnel (for example, obtained by a sensor module (such as a camera) on the augmented reality device, or obtained by an industrial device or other sensor device located at the inspection site and sent to the augmented reality device).

[0050] In step S14, the computer device sends the at least one third inspection item information to the robot, and obtains a third execution result corresponding to the at least one third inspection item information returned by the robot, wherein the robot executes a control command corresponding to the at least one third inspection item information in the inspection site to obtain the third execution result. In some embodiments, the robot includes one or more of a quadruped inspection robot, a biped robot, a cleaning robot, etc., and a part of the inspection items in a narrow space and harsh environment can be assigned to the inspection robot for execution. In some embodiments, the at least one third inspection item information is composed of one or more control commands recognizable by the robot, and the robot automatically executes the one or more control commands (for example, direction control, stop, head up, take a picture, etc.) in the inspection site to complete automatic inspection of the inspection site. The corresponding third execution result is obtained by the robot during the automatic inspection, for example, obtained by a sensor module on the robot, or obtained by an industrial device or other sensor device located in the inspection site and sent to the robot. In some embodiments, the third inspection item information can also be sent to the transfer server first, and the transfer server can decompose and convert the third inspection item information into control commands recognizable by the robot before sending the control commands to the robot.

[0051] In step S15, the computer device determines the task execution result corresponding to the target inspection task according to the first execution result, the second execution result and the third execution result. In some embodiments, for a certain inspection item information, if the inspection item information is assigned to only one execution object (i.e., the inspection item information belongs to one of the first inspection item information, the second inspection item information and the third inspection item information) among the data analysis platform, the augmented reality device and the robot, the execution result returned by the execution object (one of the first execution result, the second execution result and the third execution result) is directly taken as the item execution result corresponding to the inspection item information, for example, the execution result is normal, abnormal or default (e.g., the execution result returned by the execution object is not received). In some embodiments, for a certain inspection item information, if the inspection item information is assigned to multiple execution objects (i.e., the inspection item information belongs to multiple of the first inspection item information, the second inspection item information and the third inspection item information) among the data analysis platform, the augmented reality device and the robot, the item execution result corresponding to the inspection item information is determined based on a default result strategy or a result strategy set by a user for the inspection item information (the result strategy is used to represent how to determine the item execution result corresponding to the inspection item information according to the execution results returned by the multiple execution objects), according to the execution result returned by at least one of the multiple execution objects, for example, if the inspection item information is assigned to the data analysis platform, the augmented reality device and the robot, the set of the three execution results (the first execution result, the second execution result and the third execution result) returned by the three execution objects can be taken as the item execution result corresponding to the inspection item information, or the intersection of the three execution results can be taken as the item execution result corresponding to the inspection item information, or one of the three execution results (e.g., one of the three execution results is selected according to the priority weight corresponding to each execution result) is selected as the item execution result corresponding to the inspection item information, or the item execution result corresponding to the inspection item information is generated by performing content recognition, semantic analysis, summarization, etc. on the three execution results, or if only the first execution result and the second execution result returned by the data analysis platform and the augmented reality device are received, and the third execution result returned by the robot is not received within a timeout period, the item execution result corresponding to the inspection item information is determined according to the first execution result and the second execution result (e.g., the set, the intersection or one of the two execution results is selected, or the item execution result corresponding to the inspection item information is generated by performing content recognition, semantic analysis, summarization, etc. on the two execution results).In some embodiments, the task execution result corresponding to the target inspection task is determined according to the execution result of each item information, for example, the task execution result of the target inspection task is a set of the execution result of each item information, for example, the task execution result of the target inspection task is generated by performing content recognition, semantic analysis, summarization, and aggregation on the execution result of each item information, etc., which are only examples and are not limited.

[0052] In some embodiments, the method further includes: determining, by the computer device, at least one standard information corresponding to the target inspection task in response to a standard configuration operation performed by the user on the target inspection task; and determining one or more item information to be executed corresponding to the target inspection task in response to an item configuration operation performed by the user on the at least one standard information. In some embodiments, the user can manage the standard and the item of the inspection. The standard (job standard) refers to various provisions for ensuring the worker to complete the work quality required by the user at the work position, and the item is a subset of the standard. One or more items jointly constitute a standard, and each item specifies the requirements and methods of the inspection site execution work. The user can set at least one standard for the target inspection task, and then set at least one item information to be executed corresponding to each standard in the at least one standard, so as to determine the one or more item information to be executed corresponding to the at least one standard information, and determine the one or more item information to be executed corresponding to the target inspection task.

[0053] In some embodiments, the method further comprises: in response to the user performing an execution object setting operation for each piece of inspection item information, the computer device determines the execution object corresponding to each piece of inspection item information; wherein the determining, from the one or more pieces of inspection item information, at least one first piece of inspection item information allocated to the data analysis platform, at least one second piece of inspection item information allocated to the augmented reality device, and at least one third piece of inspection item information allocated to the robot, comprises: determining, from the one or more pieces of inspection item information, the piece of inspection item information corresponding to the execution object including the data analysis platform as the at least one first piece of inspection item information allocated to the data analysis platform, the piece of inspection item information corresponding to the execution object including the augmented reality device as the at least one second piece of inspection item information allocated to the augmented reality device, and the piece of inspection item information corresponding to the execution object including the robot as the at least one third piece of inspection item information allocated to the robot. In some embodiments, the user can set the execution object corresponding to each piece of the at least one piece of inspection item information, the execution object including at least one of the data analysis platform, the augmented reality device, and the robot, and then according to the execution object, determine the piece of inspection item information as at least one of the first piece of inspection item information allocated to the data analysis platform, the second piece of inspection item information allocated to the augmented reality device, and the third piece of inspection item information allocated to the robot.

[0054] In some embodiments, the method further comprises: in response to the result strategy setting operation performed by the user for each inspection item information, the computer device determines the result strategy corresponding to the each inspection item information; and wherein the determining the task execution result corresponding to the target inspection task according to the first execution result, the second execution result and the third execution result comprises: based on the result strategy corresponding to the one or more inspection item information, determining the task execution result corresponding to the target inspection task according to the first execution result, the second execution result and the third execution result. In some embodiments, for each inspection item information, if the user sets the execution object corresponding to the inspection item information as multiple items (two or three) among the data analysis platform, the augmented reality device and the robot, the user can also set the result strategy corresponding to the inspection item information for the inspection item information, and the result strategy is used to represent how to determine the item execution result corresponding to the inspection item information according to the execution results returned by the multiple execution objects. For example, the result strategy can be that the item execution result is the set of the multiple execution results returned by the execution objects, or the item execution result is the intersection of the multiple execution results returned by the execution objects, or the item execution result is one of the multiple execution results returned by the execution objects (for example, the user specifies to select one of them, or randomly selects one execution result, or automatically selects one execution result according to the priority weight of each execution object, or selects the earliest or latest returned execution result), or the item execution result is generated by performing content recognition, semantic analysis, summarization, aggregation and other operations on the multiple execution results returned by the execution objects. In some embodiments, based on the result strategy corresponding to each of the at least one inspection item information, the task execution result corresponding to the target inspection task can be determined according to the first execution result corresponding to the at least one first inspection item information, the second execution result corresponding to the at least one second inspection item information, and the third execution result corresponding to the at least one third inspection item information, and the task execution result includes the item execution result corresponding to the at least one inspection item information.

[0055] In some embodiments, the determining the task execution result corresponding to the target inspection task according to the first execution result, the second execution result and the third execution result based on the result strategy corresponding to the one or more inspection item information comprises: for each inspection item information in the one or more inspection item information, determining an item execution result corresponding to the inspection item information based on the result strategy corresponding to the inspection item information and at least one of the first execution result, the second execution result and the third execution result corresponding to the inspection item information; and determining the task execution result corresponding to the target inspection task according to the item execution result corresponding to each inspection item information. In some embodiments, for each inspection item information, the item execution result corresponding to the inspection item information is determined based on the result strategy corresponding to the inspection item information and at least one of the first execution result, the second execution result and the third execution result corresponding to the inspection item information, for example, if the execution object corresponding to the inspection item information comprises at least one of a data analysis platform, an augmented reality device and a robot, the item execution result corresponding to the inspection item information is determined based on the result strategy and the execution result returned by the at least one execution object (at least one of the first execution result, the second execution result and the third execution result). In some embodiments, the execution object corresponding to the inspection item information comprises all of the data analysis platform, the augmented reality device and the robot, if only one or two execution results (one or two of the first execution result, the second execution result and the third execution result) returned by the one or two execution objects are received, or the execution object corresponding to the inspection item information comprises two of the data analysis platform, the augmented reality device and the robot, if only one execution result (one of the first execution result, the second execution result and the third execution result) returned by the one execution object is received, the item execution result corresponding to the inspection item information can be determined based on the received execution result, or the item execution result corresponding to the inspection item information is determined based on the received execution result and the result strategy without considering the execution result corresponding to the other execution object which is not received, for example, the other execution object returns the execution result beyond the timeout, wherein the result strategy further sets the policy of the item execution result corresponding to the case.

[0056] In some embodiments, the result strategy includes a result selection object; wherein, for each of the one or more inspection item information, based on the result strategy corresponding to the inspection item information, the item information corresponding execution result is determined according to at least one of the first execution result, the second execution result and the third execution result corresponding to the inspection item information, including: for each of the one or more inspection item information, based on the result selection object corresponding to the inspection item information, the item information corresponding execution result is determined in at least one of the first execution result, the second execution result and the third execution result corresponding to the inspection item information. In some embodiments, the result strategy includes a result selection object, which is used to represent the selection of at least one execution result returned by a specific execution object for determining the item information corresponding execution result. For example, if the execution object corresponding to the inspection item information includes at least one of a data analysis platform, an augmented reality device and a robot, based on the result selection object, the execution result returned by the result selection object is determined as the item information corresponding execution result according to the execution result returned by the at least one execution object (at least one of the first execution result, the second execution result and the third execution result), or the item information corresponding execution result is determined by the execution result returned by the result selection object and other strategies in the result strategy (for example, the other strategies in the result strategy can be a set of execution results returned by the result selection object, or can be an intersection of execution results returned by the result selection object, can also be one of the execution results returned by the result selection object, or can also be the item information corresponding execution result generated by content recognition, semantic analysis, summarization, aggregation and other operations on the execution results returned by each result selection object).For example, the user sets the execution object corresponding to the inspection item information as all of the data analysis platform, the augmented reality device and the robot, and the user sets the result selection object corresponding to the inspection item information as the data analysis platform and the augmented reality device, then the first execution result and the second execution result returned by the data analysis platform, the augmented reality device and the robot respectively are selected, the intersection of the first execution result and the second execution result is selected, the first execution result is selected, or the result generated by content recognition, semantic analysis, summarization, etc. on the first execution result is selected, and the result is generated as the item execution result corresponding to the inspection item information. For another example, the user sets the execution object corresponding to the inspection item information as the data analysis platform and the augmented reality device, and the user sets the result selection object corresponding to the inspection item information as the data analysis platform, then the first execution result returned by the data analysis platform and the augmented reality device respectively is selected, the first execution result (or the result generated by content recognition, semantic analysis, summarization, etc. on the first execution result) is selected, and the result is generated as the item execution result corresponding to the inspection item information.

[0057] In some embodiments, the rule engine comprises at least one alarm triggering rule, and the rule engine analyzes the field data of the inspection site based on the at least one alarm triggering rule and generates a corresponding analysis result. In some embodiments, a user can create at least one alarm triggering rule in the data analysis platform, and the alarm triggering rule comprises one or more of the following: monitored data (used to represent what field data is monitored and analyzed), triggering rule (including triggering condition and calculation rule, and the calculation rule provides simple operation components such as or, and, greater than or equal to, count, sum, etc.), alarm content (abnormal content), alarm level, alarm classification, monitoring object (specific object associated when the alarm is triggered, such as which device is abnormal or which personnel operation is in violation), etc. For example, the triggering rule can be “the number of point inspections of the device in the past 7 days < 1 time” or “the temperature > 48.5°C for 3 times in the past 8 hours”, the alarm content can be “belt machine rubber surface deviation” or “abnormal alarm of bearing temperature monitoring”, the alarm level comprises but is not limited to low risk, medium risk, high risk, major high risk, etc. The rule engine will monitor and analyze the specific field data of the inspection site based on the alarm triggering rule to obtain a corresponding analysis result, analyze whether the specific field data meets the pre-set triggering rule, if so, the corresponding alarm content will be triggered, and the analysis result comprises one or more of the following: no alarm content is triggered (normal), which alarm content is triggered (abnormal), which triggering rule is triggered based on the alarm content, etc. In some embodiments, the data analysis platform will provide the triggered alarm content to the computer device in real time to present to the user. In some embodiments, the triggered alarm content will also be presented to the user on the data analysis platform, for example, the triggered alarm content is graphically displayed through the web3D interface module, or the triggered alarm content is pushed to the augmented reality device to be superimposed on the real scene picture. In some embodiments, the user needs to set one or more alarm triggering rules associated with each first inspection item information for the first inspection item information, and then the rule engine in the data analysis platform analyzes the field data of the inspection site based on the one or more alarm triggering rules after the data analysis platform receives the first inspection item information, or the data analysis platform identifies the content through the first inspection item information, automatically determines one or more alarm triggering rules suitable for the first inspection item information, and then the rule engine analyzes the field data of the inspection site based on the one or more alarm triggering rules.

[0058] In some embodiments, the rule engine further comprises one or more rule scenarios, and there is a corresponding relationship between the one or more rule scenarios and the at least one alarm triggering rule; wherein the method further comprises: for each inspection item information, the computer device determines whether to support the user setting the data analysis platform as the execution object corresponding to the inspection item information according to whether there is a rule scenario associated with the inspection item information. In some embodiments, the user can create one or more rule scenarios (for example, a belt machine temperature monitoring scenario, a camera operation abnormality alarm scenario, a feeding port operation abnormality alarm scenario, etc.) in advance in the data analysis platform, and then establish a corresponding relationship between the rule scenarios and the alarm triggering rules. One rule scenario can include one or more alarm triggering rules, so that the rule engine automatically detects and analyzes the field data of the inspection site based on the alarm triggering rules corresponding to the created rule scenarios. In some embodiments, the user can also set monitoring objects (for example, the field environment of the inspection site, the staff of the inspection site, the industrial equipment of the inspection site, etc.) in the rule scenario, so that the rule engine automatically detects and analyzes the data related to the monitoring objects corresponding to the rule scenario in the inspection site based on the alarm triggering rules corresponding to the created rule scenario. In some embodiments, for each inspection item information, it is determined whether to support the user setting the data analysis platform as the execution object corresponding to the inspection item information according to whether there is a rule scenario associated with the inspection item information. If there is, the user is supported (allowed) to set the data analysis platform as the execution object corresponding to the inspection item information. Otherwise, the user is not supported (prohibited) to set the data analysis platform as the execution object corresponding to the inspection item information. The association relationship between the inspection item information and the rule scenario can be set by the user, or the rule scenario suitable for the inspection item information can be automatically determined through content recognition of the inspection item information and the association relationship between the two is automatically established. Through the association relationship between the inspection item information and the rule scenario and the corresponding relationship between the rule scenario and the alarm triggering rule, the alarm triggering rule associated with the inspection item information can be determined.

[0059] In some embodiments, the method further comprises: for each first inspection item information, the computer device determines a rule scene associated with the first inspection item information in the one or more rule scenes in response to a scene association operation performed by the user on the first inspection item information, so that the data analysis platform determines a first execution result corresponding to the first inspection item information according to an analysis result generated by an alarm triggering rule corresponding to the rule scene associated with the first inspection item information. In some embodiments, for each first inspection item information, the user can select at least one rule scene in the one or more rule scenes created in the data analysis platform as the rule scene associated with the first inspection item information, and subsequently, the rule engine in the data analysis platform will automatically analyze the scene data of the inspection scene based on the alarm triggering rule corresponding to the rule scene associated with the first inspection item information to generate a corresponding analysis result, and determine the first execution result corresponding to the first inspection item information according to the analysis result.

[0060] In some embodiments, the augmented reality device superimposes and presents the augmented reality content corresponding to the at least one second inspection item information in the real scene picture during the inspection process of the inspection personnel. In some embodiments, the inspection personnel uses the augmented reality device to inspect the inspection scene, and the augmented reality device superimposes and presents the augmented reality content (AR content) corresponding to the at least one second inspection item information in the real scene picture during the inspection process. The AR content includes but is not limited to item content, item notes, item reference materials of the second inspection item information, and digital information such as materials, real-time status, history, and standard methods of the industrial equipment associated with the second inspection item information, so that the inspection personnel can perform corresponding inspection operations at the inspection scene based on the prompt of the AR content. In some embodiments, the augmented reality device superimposes and presents the alarm information corresponding to the data analysis platform in the real scene picture.

[0061] In some embodiments, the first execution result and / or the third execution result are superimposed and presented in the real scene picture by the augmented reality device during the inspection process of the inspector. In some embodiments, after the second inspection item information is sent to the augmented reality device, if the data analysis platform has obtained a first execution result corresponding to a first inspection item information which belongs to the target inspection task together with the second inspection item information, during the inspection process of the inspection site by the inspector using the augmented reality device, the first inspection item information and the second inspection item information can be the same or different, the data analysis platform provides the first execution result to the augmented reality device and superimposes and presents it in the real scene picture of the augmented reality device for the inspector to refer, or the data analysis platform also provides the first execution result to the robot for reference when the robot executes a control command corresponding to a third inspection item information which belongs to the target inspection task together with the second inspection item information, the first inspection item information, the second inspection item information and the third inspection item information can be the same or different. In some embodiments, after the second inspection item information is sent to the augmented reality device, if the robot has obtained a third execution result corresponding to a third inspection item information which belongs to the target inspection task together with the second inspection item information, during the inspection process of the inspection site by the inspector using the augmented reality device, the robot provides the third execution result to the augmented reality device and superimposes and presents it in the real scene picture of the augmented reality device for the inspector to refer, or the robot also provides the third execution result to the data analysis platform for reference when the data analysis platform executes a first inspection item information which belongs to the target inspection task together with the third inspection item information, the first inspection item information, the second inspection item information and the third inspection item information can be the same or different.

[0062] In some embodiments, the on-site data of the inspection site is generated by the augmented reality device during the inspection process of the inspector and sent to the data analysis platform, and / or the on-site data of the inspection site is generated by the robot during the inspection process or the daily work process and sent to the data analysis platform. In some embodiments, the on-site data of the inspection site can be obtained by the robot during the inspection process or the daily work process of the inspection site and sent to the data analysis platform, for example, generated by the robot, or obtained by the robot, or obtained by the robot from industrial equipment or other sensor equipment located in the inspection site, or can also be obtained by the augmented reality device during the inspection process of the inspection site by the inspector using the augmented reality device and sent to the data analysis platform, for example, generated by the augmented reality device, or obtained by the augmented reality device, or obtained by the augmented reality device from industrial equipment or other sensor equipment located in the inspection site, or input or edited by the inspector on the augmented reality device and sent to the data analysis platform, etc.

[0063] FIG. 2 shows a computer device structure diagram for performing an inspection task according to one embodiment of the present application, which includes a first module 11, a second module 12, a third module 13, a fourth module 14 and a fifth module 15. The first module 11 is configured to obtain one or more inspection item information corresponding to a target inspection task to be performed, determine at least one first inspection item information allocated to a data analysis platform, at least one second inspection item information allocated to an augmented reality device, and at least one third inspection item information allocated to a robot in the one or more inspection item information. The second module 12 is configured to send the at least one first inspection item information to the data analysis platform, and obtain first execution result information corresponding to the at least one first inspection item information returned by the data analysis platform, wherein the data analysis platform analyzes field data of the inspection site through a rule engine and generates a corresponding analysis result, and determines the first execution result according to the analysis result. The third module 13 is configured to send the at least one second inspection item information to the augmented reality device, and obtain a second execution result corresponding to the at least one second inspection item information returned by the augmented reality device, wherein an inspection personnel performs the at least one second inspection item information at the inspection site by using the augmented reality device to obtain the second execution result. The fourth module 14 is configured to send the at least one third inspection item information to the robot, and obtain a third execution result corresponding to the at least one third inspection item information returned by the robot, wherein the robot executes a control command corresponding to the at least one third inspection item information at the inspection site to obtain the third execution result. The fifth module 15 is configured to determine a task execution result corresponding to the target inspection task according to the first execution result, the second execution result and the third execution result.

[0064] The first module 11 is configured to acquire one or more inspection items corresponding to a target inspection task, determine at least one first inspection item assigned to the data analysis platform, at least one second inspection item assigned to the augmented reality device, and at least one third inspection item assigned to the robot in the one or more inspection items. In some embodiments, the target inspection task refers to a task for inspecting an industrial scene (which includes at least one industrial device) and the industrial scene includes but is not limited to a workshop scene, a factory scene, an industrial production line scene, etc. A user can first create a target inspection task, and the target inspection task corresponds to one or more inspection items to be executed. The one or more inspection items can be set by the user for the target inspection task (for example, the user creates the one or more inspection items for the target inspection task, or the user selects the one or more inspection items from the created inspection items for the target inspection task), or the one or more inspection items can be automatically determined by content recognition of the target inspection task. For example, an inspection item is an abnormal engine sound, and the corresponding target inspection task is a belt engine maintenance task. For example, the inspection items can also include a speed reducer oil level inspection and a speed reducer oil leakage inspection, and the corresponding target inspection task is a belt speed reducer maintenance task. In some embodiments, the at least one first inspection item assigned to the data analysis platform, the at least one second inspection item assigned to the augmented reality device, and the at least one third inspection item assigned to the robot can have an intersection, and an inspection item can belong to one of the first inspection item, the second inspection item, and the third inspection item, or belong to two or three of the first inspection item, the second inspection item, and the third inspection item. That is, an inspection item can be assigned to one of the data analysis platform, the augmented reality device, and the robot, or assigned to two or three of the data analysis platform, the augmented reality device, and the robot. In some embodiments, a user can specify to whom an inspection item is assigned, or the content recognition of the inspection item can automatically determine whether the inspection item is suitable for the data analysis platform, the augmented reality device, or the robot.

[0065] A second module 12 is configured to send the at least one first inspection item information to a data analysis platform, and obtain first execution result information corresponding to the at least one first inspection item information returned by the data analysis platform, wherein the data analysis platform analyzes the field data of the inspection site through a rule engine and generates corresponding analysis results, and determines the first execution result according to the analysis results. In some embodiments, the field data of the inspection site includes but is not limited to one or more of the data of the industrial equipment in the inspection site, the data of the field environment of the inspection site (for example, environmental temperature, personnel behavior (such as crossing the boundary, staying, static timeout, illegal action, etc.), etc.), etc., wherein the data types include but are not limited to one or more of the robot collected data, the augmented reality device collected data, the inspection personnel collected data, the production line sensor collected data, the IoT system data, the equipment management system data, the IT system data, the fixed position monitoring data, etc. The field data can be obtained by the robot during the inspection process or the daily work (the daily work refers to the work of the robot according to the background preset business logic every day when there is no inspection task dispatched) in the inspection site and sent to the data analysis platform, or can also be obtained by the augmented reality device during the inspection of the inspection personnel in the inspection site and sent to the data analysis platform, or input or edited by the inspection personnel on the augmented reality device and sent to the data analysis platform, or can also be generated by the industrial equipment or other sensor equipment in the inspection site and sent to the data analysis platform, or can also be input or edited by the staff in the inspection site on the terminal device used by the staff and sent to the data analysis platform, etc.In some embodiments, the data analysis platform analyzes the field data of the inspection site based on a pre-set rule engine according to the at least one first inspection item information, generates one or more analysis results about the at least one first inspection item information, and then determines the first execution result information corresponding to the at least one first inspection item information returned to the computer device according to the one or more analysis results, for example, directly taking the analysis result as the first execution result, or generating the first execution result by summarizing the analysis result, or screening out the content associated with the first inspection item information in the analysis result as the first execution result, wherein the rule engine is an automatic decision system based on conditional expressions, which can judge whether the field data of the inspection site meets a specific condition according to a pre-defined alarm triggering rule (for example: IF condition THEN result), and can further automatically trigger the corresponding alarm content. Through the analysis of the field data, the corresponding analysis result can be obtained, which includes but is not limited to one or more of the following: the industrial equipment (or environmental factors of the inspection site, workers, etc.) associated with the at least one first inspection item information is normal, the identification information of the industrial equipment (or environmental factors, workers, etc.) with abnormality, the specific abnormality content of the industrial equipment (or environmental factors, workers, etc.) with abnormality, the abnormality reason, the abnormality type, etc. In some embodiments, the data analysis platform supports user to customize the alarm triggering rule in the rule engine to achieve the purpose of automatically detecting the field data of the inspection site and automatically triggering the alarm by the rule engine according to the user's own demand, for example, the running state of the belt machine equipment can be monitored in real time by setting the alarm triggering rule, and the corresponding alarm content is automatically triggered when the equipment is abnormal.

[0066] a third module 13 configured to send the at least one second inspection item information to the augmented reality device, and obtain a second execution result corresponding to the at least one second inspection item information returned by the augmented reality device, wherein the second execution result is obtained by the inspection personnel performing the at least one second inspection item information using the augmented reality device at the inspection site. In some embodiments, the inspection personnel performs the inspection at the inspection site using the augmented reality device (e.g., wearing AR glasses), and the augmented reality device presents augmented reality content (AR content) corresponding to the at least one second inspection item information in the real scene during the inspection, wherein the augmented reality content can be presented in the real scene in one of the following modes: (1) the display device of the augmented reality device displays the real scene captured by the camera of the augmented reality device, and the display device presents the augmented reality content on the real scene displayed by the display device (corresponding to a video see-through mode); or (2) the display device of the augmented reality device does not display the real scene captured by the camera of the augmented reality device, and the display device only presents the augmented reality content, and the inspection personnel can see the real scene through the display device, so as to present the augmented reality content in the real scene (corresponding to an optical see-through mode). The augmented reality device includes but is not limited to an AR smart wearable device (e.g., AR glasses), a mobile phone, an iPad / Pad, or other devices with a display device and a camera. The augmented reality content includes but is not limited to one or more of item content, item precautions, item reference materials, task data, etc. of the second inspection item information. In some embodiments, the inspection personnel performs a corresponding inspection operation at the inspection site based on the prompt of the augmented reality content, and the second execution result corresponding to the inspection operation can be obtained by the inspection personnel based on the inspection operation, and input to the augmented reality device (e.g., the inspection personnel selects a normal or abnormal option, or inputs text, captures a site video, etc. in the interface of the augmented reality device), or can be obtained by the augmented reality device during the inspection operation of the inspection personnel (e.g., obtained by a sensor module (such as a camera) on the augmented reality device, or obtained by an industrial device or other sensor device related to the inspection operation and sent to the augmented reality device).

[0067] a fourth module 14 configured to send the at least one third inspection item information to the robot, and obtain a third execution result corresponding to the at least one third inspection item information returned by the robot, wherein the robot executes a control command corresponding to the at least one third inspection item information at the inspection site to obtain the third execution result. In some embodiments, the robot includes one or more of a quadruped inspection robot, a biped robot, a cleaning robot, etc., and a portion of the inspection items in a narrow space and harsh environment can be assigned to the inspection robot for execution. In some embodiments, the at least one third inspection item information is composed of one or more control commands recognizable by the robot, and the robot automatically executes the one or more control commands (e.g., direction control, stop, look up, take a picture, etc.) at the inspection site to complete automatic inspection of the inspection site. The corresponding third execution result is obtained by the robot during the automatic inspection, for example, obtained by a sensor module on the robot, or obtained by an industrial device or other sensor device located at the inspection site and related to the automatic inspection process and sent to the robot. In some embodiments, the third inspection item information can also be sent to the relay server first, and the relay server can decompose and convert the third inspection item information into control commands recognizable by the robot before sending the control commands to the robot.

[0068] a fifth module 15 configured to determine a task execution result corresponding to the target inspection task according to the first execution result, the second execution result and the third execution result. In some embodiments, for a certain inspection item information, if the inspection item information is assigned to only one execution object (i.e., the inspection item information belongs to one of the first inspection item information, the second inspection item information and the third inspection item information) among the data analysis platform, the augmented reality device and the robot, an execution result returned by the execution object (i.e., one of the first execution result, the second execution result and the third execution result) is directly taken as an item execution result corresponding to the inspection item information, for example, the execution result is normal, abnormal or default (e.g., the execution result returned by the execution object is not received). In some embodiments, for a certain inspection item information, if the inspection item information is assigned to multiple execution objects (i.e., the inspection item information belongs to multiple of the first inspection item information, the second inspection item information and the third inspection item information) among the data analysis platform, the augmented reality device and the robot, an item execution result corresponding to the inspection item information is determined based on a default result strategy or a result strategy set by a user for the inspection item information (the result strategy is used to represent how to determine the item execution result corresponding to the inspection item information according to execution results returned by the multiple execution objects), according to an execution result returned by at least one of the multiple execution objects, for example, if the inspection item information is assigned to the data analysis platform, the augmented reality device and the robot, a set of three execution results (i.e., the first execution result, the second execution result and the third execution result) returned by the three execution objects can be taken as the item execution result corresponding to the inspection item information, or an intersection of the three execution results can be taken as the item execution result corresponding to the inspection item information, or one of the three execution results (e.g., one of the three execution results is selected according to a priority weight corresponding to each of the three execution results) can be taken as the item execution result corresponding to the inspection item information, or the item execution result corresponding to the inspection item information is generated by performing content recognition, semantic analysis, summarization, etc. on the three execution results, or if only the first execution result and the second execution result returned by the data analysis platform and the augmented reality device are received, and the third execution result returned by the robot is not received, the item execution result corresponding to the inspection item information is determined according to the first execution result and the second execution result (e.g., a set, an intersection or one of the two execution results, or the item execution result corresponding to the inspection item information is generated by performing content recognition, semantic analysis, summarization, etc. on the two execution results).In some embodiments, the task execution result corresponding to the target inspection task is determined according to the item execution result corresponding to each item information, for example, the task execution result of the target inspection task is a set of the item execution result corresponding to each item information, for example, the task execution result of the target inspection task is generated by performing content recognition, semantic analysis, summarization, and the like on the item execution result corresponding to each item information, and the like, which are only examples and are not limited.

[0069] In some embodiments, the device is further configured to: determine at least one standard information corresponding to the target inspection task in response to a standard configuration operation performed by the user on the target inspection task; and determine one or more item information to be executed corresponding to the target inspection task in response to an item configuration operation performed by the user on the at least one standard information. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described herein by way of reference.

[0070] In some embodiments, the device is further configured to: determine an execution object corresponding to each item information in response to an execution object setting operation performed by the user on each item information; and determine the at least one first item information allocated to the data analysis platform, the at least one second item information allocated to the augmented reality device, and the at least one third item information allocated to the robot in the one or more item information, including: determining the item information corresponding to the execution object including the data analysis platform as the at least one first item information allocated to the data analysis platform, determining the item information corresponding to the execution object including the augmented reality device as the at least one second item information allocated to the augmented reality device, and determining the item information corresponding to the execution object including the robot as the at least one third item information allocated to the robot. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described herein by way of reference.

[0071] In some embodiments, the device is further configured to: determine a result strategy corresponding to each item information in response to a result strategy setting operation performed by the user on each item information; and determine the task execution result corresponding to the target inspection task according to the first execution result, the second execution result, and the third execution result based on the result strategy corresponding to the one or more item information. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described herein by way of reference.

[0072] In some embodiments, the determining, according to the first execution result, the second execution result and the third execution result, the task execution result corresponding to the target inspection task based on the result strategy corresponding to the one or more inspection item information, comprises: for each inspection item information in the one or more inspection item information, determining, according to at least one of the first execution result, the second execution result and the third execution result corresponding to the inspection item information, the item execution result corresponding to the inspection item information based on the result strategy corresponding to the inspection item information; and determining the task execution result corresponding to the target inspection task according to the item execution result corresponding to each inspection item information. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described herein by way of reference.

[0073] In some embodiments, the result strategy comprises a result selection object; wherein the determining, according to at least one of the first execution result, the second execution result and the third execution result corresponding to the inspection item information, the item execution result corresponding to the inspection item information based on the result strategy corresponding to the inspection item information, comprises: for each inspection item information in the one or more inspection item information, determining the item execution result corresponding to the inspection item information in at least one of the first execution result, the second execution result and the third execution result corresponding to the inspection item information based on the result selection object corresponding to the inspection item information. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described herein by way of reference.

[0074] In some embodiments, the rule engine comprises at least one alarm triggering rule, and the rule engine analyzes the field data of the inspection site based on the at least one alarm triggering rule and generates a corresponding analysis result. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described herein by way of reference.

[0075] In some embodiments, the rule engine further comprises one or more rule scenarios, and there is a corresponding relationship between the one or more rule scenarios and the at least one alarm triggering rule; wherein the method further comprises: the computer device determining, for each inspection item information, whether to support the user setting the data analysis platform as the execution object corresponding to the inspection item information according to whether there is a rule scenario associated with the inspection item information. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described herein by way of reference.

[0076] In some embodiments, the device is further configured to: for each first inspection item information, in response to a scene association operation performed by the user on the first inspection item information, determine a rule scene associated with the first inspection item information in the one or more rule scenes, so that the data analysis platform determines a first execution result corresponding to the first inspection item information according to an analysis result generated by an alarm triggering rule corresponding to the rule scene associated with the first inspection item information. In this regard, the related operation is the same as or similar to the embodiment shown in FIG. 1, and thus will not be described herein by way of reference.

[0077] In some embodiments, the augmented reality device superimposes and presents the augmented reality content corresponding to the at least one second inspection item information in a real scene picture during the inspection process of the inspection personnel. In this regard, the related operation is the same as or similar to the embodiment shown in FIG. 1, and thus will not be described herein by way of reference.

[0078] In some embodiments, the augmented reality device superimposes and presents the first execution result and / or the third execution result in a real scene picture during the inspection process of the inspection personnel. In this regard, the related operation is the same as or similar to the embodiment shown in FIG. 1, and thus will not be described herein by way of reference.

[0079] In some embodiments, the on-site data of the inspection site is generated by the augmented reality device during the inspection process of the inspection personnel and sent to the data analysis platform, and / or the on-site data of the inspection site is generated by the robot during the inspection process or the daily work process and sent to the data analysis platform. In this regard, the related operation is the same as or similar to the embodiment shown in FIG. 1, and thus will not be described herein by way of reference.

[0080] In addition to the methods and devices introduced in the above embodiments, the present application further provides a computer readable storage medium storing computer codes, when the computer codes are executed, the method as any one of the preceding embodiments is executed.

[0081] The present application further provides a computer program product, when the computer program product is executed by a computer device, the method as any one of the preceding embodiments is executed.

[0082] The present application further provides a computer device, the computer device comprises:

[0083] one or more processors;

[0084] a memory for storing one or more computer programs;

[0085] When the one or more computer programs are executed by the one or more processors, the one or more processors implement a method as any one of the preceding.

[0086] FIG. 3 illustrates an example system that can be used to implement various embodiments described in this application;

[0087] As shown in FIG. 3, in some embodiments, system 300 can function as any of the devices in various embodiments. In some embodiments, system 300 can include one or more computer-readable media (e.g., system memory or NVM / storage 320) having instructions and one or more processors (e.g., processor(s) 305) coupled with the one or more computer-readable media and configured to execute the instructions to implement modules to perform the actions described in this application.

[0088] For one embodiment, system control module 310 can include any suitable interface controllers to provide for any suitable interface to at least one of processor(s) 305 and / or any suitable device or component in communication with system control module 310.

[0089] System control module 310 can include memory controller module 330 to provide an interface to system memory 315. Memory controller module 330 can be a hardware module, a software module, and / or a firmware module.

[0090] System memory 315 can be used, for example, to load and store data and / or instructions for system 300. For one embodiment, system memory 315 can include any suitable volatile memory, such as suitable DRAM. In some embodiments, system memory 315 can include double data rate type four synchronous dynamic random access memory (DDR4 SDRAM).

[0091] For one embodiment, system control module 310 can include one or more input / output (I / O) controller(s) to provide an interface to NVM / storage 320 and communication interface(s) 325.

[0092] For example, NVM / storage 320 can be used to store data and / or instructions. NVM / storage 320 can include any suitable non-volatile memory (e.g., flash memory) and / or can include any suitable non-volatile storage device(s) (e.g., one or more hard disk drives (HDDs), one or more compact disk (CD) drives, and / or one or more digital versatile disk (DVD) drives).

[0093] The NVM / storage device 320 can include storage resources that are physically part of the device on which the system 300 is installed or it can be accessible by the device without being physically part of the device. For example, the NVM / storage device 320 can be accessed over a network via the communication interface(s) 325.

[0094] The communication interface(s) 325 can provide an interface for the system 300 to communicate with one or more networks and / or any other suitable devices. The system 300 can communicate wirelessly with one or more components of a wireless network according to any of one or more wireless network standards and / or protocols.

[0095] For one embodiment, at least one of the processor(s) 305 can be packaged together with logic of one or more controllers of the system control module 310 (e.g., the memory controller module 330). For one embodiment, at least one of the processor(s) 305 can be packaged together with logic of one or more controllers of the system control module 310 to form a system-in-a-package (SiP). For one embodiment, at least one of the processor(s) 305 can be integrated in the same die with logic of one or more controllers of the system control module 310. For one embodiment, at least one of the processor(s) 305 can be integrated in the same die with logic of one or more controllers of the system control module 310 to form a system-on-a-chip (SoC).

[0096] In various embodiments, the system 300 can be, but is not limited to, a server, a workstation, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet, a netbook, etc.). In various embodiments, the system 300 can have more or less components, and / or different architectures. For example, in some embodiments, the system 300 includes one or more cameras, a keyboard, a liquid crystal display (LCD) screen (including touch screen displays), non- volatile memory port, multiple antennas, a graphics chip, an application specific integrated circuit (ASIC), and speakers.

[0097] In addition to the methods and devices described in the above embodiments, the present application also provides a computer readable storage medium, the computer readable storage medium storing computer code, when the computer code is executed, the method as any one of the preceding is executed.

[0098] The present application also provides a computer program product, when the computer program product is executed by a computer device, the method as any one of the preceding is executed.

[0099] The present application also provides a computer device, the computer device comprising:

[0100] one or more processors;

[0101] a memory for storing one or more computer programs;

[0102] the one or more computer programs, when executed by the one or more processors, cause the one or more processors to implement the method of any preceding claim.

[0103] It should be noted that the present application can be implemented in software and / or a combination of software and hardware, e.g., an application specific integrated circuit (ASIC), a general purpose computer or any other similar hardware devices. In one embodiment, the software program of the present application is implemented by the processor to perform the steps or functions described above. Also, the software program of the present application (including related data structures) can be stored in a computer readable medium, e.g., a RAM memory, a magnetic or optical drive or diskette, and the like. Additionally, some of the steps or functions can be implemented in hardware, e.g., as circuitry which is cooperated with the processor to perform the various steps or functions.

[0104] In addition, a part of the present application can be applied as a computer program product, e.g., computer program instructions, when executed by a computer, through the operation of the computer, can invoke or provide the method and / or technical solutions according to the present application. Those skilled in the art should understand that the form of the computer program instructions in the computer readable medium includes but is not limited to source files, executable files, installation package files, etc., and accordingly, the way of the computer program instructions executed by the computer includes but is not limited to: the computer directly executes the instructions, or the computer executes the corresponding compiled program after compiling the instructions, or the computer reads and executes the instructions, or the computer executes the corresponding installed program after reading and installing the instructions. Here, the computer readable medium can be any available computer readable storage medium or communication medium accessible to the computer.

[0105] Communication media includes any medium through which computer readable instructions, data structures, program modules, or other data can be communicated from one system to another, e.g., according to a communication protocol. Depending on the nature of the communication medium, the communication can be wireless (unguided), e.g., via radio frequency, microwave, infrared, or optical signals, or wired (guided), e.g., via electric conductors, optical fibers, or other communication channels. Computer readable instructions, data structures, program modules, or other data can be embodied in a modulated data signal, e.g., a carrier wave, or other transport mechanism, such as a satellite transmission, a wireless transmission, a wired transmission, a cable transmission, or the like. The term "modulated data signal" means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. The modulated data signal can be analog or digital.

[0106] By way of example, and not limitation, computer-readable storage media can include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. For example, computer-readable storage media includes, but is not limited to, RAM, such as SRAM, DRAM, or other types of random access memory; and non-volatile memory, such as flash memory, ROM, PROM, EPROM, EEPROM, or other types of non-volatile memory. Computer-readable storage media also includes, but is not limited to, a hard disk drive, a magnetic disk drive, a tape drive, a solid state drive, a magnetic cassette drive, an optical disk drive, a CD-ROM drive, a DVD drive, or other types of optical storage drives, a magnetic cassettes or other magnetic storage devices, or other types of storage devices.

[0107] Herein, according to one embodiment of the present application includes an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein when the computer program instructions are executed by the processor, trigger the apparatus to run the method and / or technical solutions based on the foregoing according to the embodiments of the present application.

[0108] It is apparent that a person skilled in the art can make various modifications to the above-described exemplary embodiments without departing from the spirit or essential characteristics of the present application. Therefore, the above-described embodiments are considered in all aspects as illustrative and not restrictive, and the scope of the present application is defined by the appended claims rather than the above description, and all changes derived from the meaning and scope of equivalents of the claims are included in the present application. Any reference signs in the claims should not be construed as limiting the claims. Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. Multiple units or apparatuses stated in the apparatus claims can also be implemented by one unit or apparatus through software or hardware. The words first, second, etc. are used to express names and not to express any particular order.

Claims

1. A method for performing a patrol task, wherein, The method comprises: obtaining one or more to-be-executed inspection items corresponding to a target inspection task, determining at least one first inspection item information allocated to a data analysis platform, at least one second inspection item information allocated to an augmented reality device, and at least one third inspection item information allocated to a robot in the one or more inspection items; sending the at least one first inspection item information to the data analysis platform, and obtaining first execution result information corresponding to the at least one first inspection item information returned by the data analysis platform, wherein the data analysis platform analyzes field data of the inspection field through a rule engine and generates a corresponding analysis result, and determines the first execution result according to the analysis result; sending the at least one second inspection item information to the augmented reality device, and obtaining a second execution result corresponding to the at least one second inspection item information returned by the augmented reality device, wherein an inspection personnel executes the at least one second inspection item information by using the augmented reality device in the inspection field to obtain the second execution result; sending the at least one third inspection item information to the robot, and obtaining a third execution result corresponding to the at least one third inspection item information returned by the robot, wherein the robot executes a control command corresponding to the at least one third inspection item information in the inspection field to obtain the third execution result; determining a task execution result corresponding to the target inspection task according to the first execution result, the second execution result, and the third execution result.

2. The method of claim 1, wherein, The method further comprises: determining at least one standard information corresponding to the target inspection task in response to a standard configuration operation performed by a user on the target inspection task; determining one or more to-be-executed inspection items corresponding to the target inspection task in response to an item configuration operation performed by the user on the at least one standard information.

3. The method of claim 1 or 2, wherein, The method further comprises: determining an execution object corresponding to each inspection item in response to an execution object setting operation performed by the user on each inspection item; wherein the at least one first inspection item information allocated to the data analysis platform, the at least one second inspection item information allocated to the augmented reality device, and the at least one third inspection item information allocated to the robot in the one or more inspection items comprise: determining, in the one or more inspection items, an inspection item information corresponding to an execution object including the data analysis platform as the at least one first inspection item information allocated to the data analysis platform, an inspection item information corresponding to an execution object including the augmented reality device as the at least one second inspection item information allocated to the augmented reality device, and an inspection item information corresponding to an execution object including the robot as the at least one third inspection item information allocated to the robot.

4. The method of claim 1 or 3, wherein, The method further comprises: determining a result strategy corresponding to each inspection item in response to a result strategy setting operation performed by the user on each inspection item; The determining of the task execution result corresponding to the target inspection task according to the first execution result, the second execution result and the third execution result comprises: The determining of the task execution result corresponding to the target inspection task according to the first execution result, the second execution result and the third execution result based on the result strategy corresponding to the one or more inspection item information comprises:

5. The method of claim 4, wherein, The determining of the task execution result corresponding to the target inspection task according to the first execution result, the second execution result and the third execution result based on the result strategy corresponding to the one or more inspection item information comprises: For each inspection item information in the one or more inspection item information, the item execution result corresponding to the inspection item information is determined based on the result strategy corresponding to the inspection item information and at least one of the first execution result, the second execution result and the third execution result corresponding to the inspection item information; The task execution result corresponding to the target inspection task is determined according to the item execution result corresponding to each inspection item information.

6. The method of claim 5, wherein, The result strategy comprises a result selection object. The determining of the item execution result corresponding to the inspection item information based on the result selection object corresponding to the inspection item information and at least one of the first execution result, the second execution result and the third execution result corresponding to the inspection item information comprises: The rule engine comprises at least one alarm triggering rule, and the rule engine analyzes the field data of the inspection field based on the at least one alarm triggering rule and generates a corresponding analysis result.

7. The method of any one of claims 1 to 6, wherein, The rule engine further comprises one or more rule scenarios, and a corresponding relationship exists between the at least one alarm triggering rule and the one or more rule scenarios.

8. The method of claim 7, wherein, The method further comprises: For each inspection item information, it is determined whether the data analysis platform is supported to be set as an execution object corresponding to the inspection item information according to whether there is a rule scenario associated with the inspection item information. The method further comprises:

9. The method of claim 8, wherein, For each first inspection item information, in response to a scenario association operation performed by the user on the first inspection item information, a rule scenario associated with the first inspection item information is determined in the one or more rule scenarios, so that the data analysis platform determines a first execution result corresponding to the first inspection item information according to an analysis result generated by an alarm triggering rule corresponding to the rule scenario associated with the first inspection item information. The augmented reality device superimposes and presents augmented reality content corresponding to the at least one second inspection item information in the real scene picture in the inspection process of the inspection personnel.

10. The method of claim 1, wherein, ​ 11. The method of claim 10, wherein, The first execution result and / or the third execution result is superimposed and presented in a real scene picture by the augmented reality device in a process of inspection by the inspection personnel.

12. The method of claim 1, wherein, The on-site data of the inspection site is generated and sent to the data analysis platform by the augmented reality device in a process of inspection by the inspection personnel, and / or the on-site data of the inspection site is generated and sent to the data analysis platform by the robot in a process of inspection or daily work.

13. A computer device for performing a patrol task, wherein, The device comprises: a first module configured to acquire one or more pieces of inspection item information to be executed corresponding to a target inspection task, determine at least one first piece of inspection item information allocated to a data analysis platform, at least one second piece of inspection item information allocated to an augmented reality device, and at least one third piece of inspection item information allocated to a robot in the one or more pieces of inspection item information; a second module configured to send the at least one first piece of inspection item information to the data analysis platform, and acquire first execution result information corresponding to the at least one first piece of inspection item information returned by the data analysis platform, wherein the data analysis platform analyzes on-site data of an inspection site by a rule engine and generates a corresponding analysis result, and determines the first execution result according to the analysis result; a third module configured to send the at least one second piece of inspection item information to the augmented reality device, and acquire a second execution result corresponding to the at least one second piece of inspection item information returned by the augmented reality device, wherein an inspection personnel executes the at least one second piece of inspection item information by using the augmented reality device to obtain the second execution result at the inspection site; a fourth module configured to send the at least one third piece of inspection item information to the robot, and acquire a third execution result corresponding to the at least one third piece of inspection item information returned by the robot, wherein the robot executes a control command corresponding to the at least one third piece of inspection item information to obtain the third execution result at the inspection site; a fifth module configured to determine a task execution result corresponding to the target inspection task according to the first execution result, the second execution result, and the third execution result.

14. A computer device for performing inspection tasks, comprising a memory, a processor, and a computer program stored in the memory, characterized in that, The processor executes the computer program to implement the steps of the method according to any one of claims 1 to 12.

15. A computer readable storage medium having stored thereon computer programs / instructions, characterized in that, The computer program / instruction is executed by the processor to implement the steps of the method according to any one of claims 1 to 12.

16. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method according to any one of claims 1 to 12.

Images