Automatic inspection method and system and computer readable storage medium

Abstract

The invention discloses an automatic inspection method and system and a computer readable storage medium, and relates to the technical field of inspection. The automatic inspection method comprises the steps that an instance of an inspection task is generated according to a published inspection task, the inspection task is generated by configuring one or more inspection points, and before the inspection task is generated, each inspection point is configured with one or more inspection instructions; determining capability information corresponding to the inspection instructions configured by the one or more inspection points; sending the inspection task instance to the inspection equipment configured with the capability information; generating an inspection path according to the inspection point coordinates corresponding to the inspection task instance; and sending the generated routing inspection path to routing inspection equipment so that the routing inspection equipment executes a routing inspection instruction in the routing inspection task at one or more routing inspection points according to the routing inspection path. The reusability and flexibility of routing inspection task configuration are improved, and the efficiency of automatic routing inspection is also improved.

Description

Technical Field

[0001] The present invention relates to the field of patrol inspection technology, and in particular to an automatic patrol inspection method, system and computer-readable storage medium. Background Art

[0002] In some scenes such as warehouses and sorting centers, staff are usually arranged to conduct regular safety inspections of the entire site facilities to ensure the safety of personnel and property and eliminate hidden dangers. For example, whether fire extinguishers and fire balls are equipped; whether there are too many power strips and messy wires in the charging area, whether the floor is clean and free of cardboard and plastic film, etc.; whether the delivery vehicles and batteries are parked in the specified locations; whether the evacuation signs are clearly located and in good condition; whether the flatbed truck personnel in the platform area wear safety belts and helmets when climbing and unloading, and whether cardboard is piled on the platform; whether the conveyor belt in the packaging area is equipped with a lower baffle or side baffle, whether the conveyor belt is equipped with an emergency stop button, and whether warning signs are posted, etc. Summary of the invention

[0003] After analysis, the inventor found that the related technology adopts the method of manual inspection, which is costly and wastes human resources. There is a situation where personnel cannot detect in place, and the inspection time period is also limited.

[0004] A technical problem to be solved by the embodiments of the present invention is: how to improve the efficiency of inspection.

[0005] According to a first aspect of some embodiments of the present invention, there is provided an automatic inspection method, comprising: generating an instance of an inspection task based on a published inspection task, wherein the inspection task is generated by configuring one or more inspection points, and before the inspection task is generated, each inspection point is configured with one or more inspection instructions; determining capability information corresponding to the inspection instructions configured at one or more inspection points; sending the inspection task instance to an inspection device configured with the capability information; generating an inspection path based on the inspection point coordinates corresponding to the inspection task instance; and sending the generated inspection path to the inspection device, so that the inspection device executes the inspection instructions in the inspection task at one or more inspection points according to the inspection path.

[0006] In some embodiments, the automatic inspection method also includes: creating a new inspection task; configuring attribute information and execution rules for the new inspection task, wherein the execution rules are rules for indicating the generation of an instance of an inspection task; configuring inspection points for the new inspection task; adding one or more inspection instructions configured at the inspection points of the new inspection task to the new inspection task; and publishing the new inspection task.

[0007] In some embodiments, generating an instance of the inspection task includes: generating an instance of the inspection task at a pre-configured execution time of the inspection task after the inspection task is issued.

[0008] In some embodiments, the automatic inspection method further includes: creating a new inspection point; configuring attribute information and coordinates for the new inspection point; and configuring inspection instructions for the new inspection point, wherein the inspection instructions are executable programs.

[0009] In some embodiments, the automatic inspection method further includes: configuring a scene analysis algorithm for a new inspection point, wherein the scene analysis algorithm is used to analyze the inspection result of the inspection point.

[0010] In some embodiments, the automatic inspection method further includes: creating a new inspection device model; and configuring attribute information and capability information for the new inspection device model.

[0011] In some embodiments, the automatic inspection method further includes: configuring a plug-in for a new inspection device model, wherein the plug-in is used for interacting with the inspection device and the network side.

[0012] In some embodiments, the automatic inspection method further includes: creating a new inspection device; configuring attribute information for the new inspection device, and the inspection device model to which the new inspection device belongs.

[0013] In some embodiments, the automatic inspection method also includes: obtaining attribute information configured for the management terminal of the newly added inspection site; obtaining the identification of the inspection equipment configured for the inspection site; storing the attribute information of the inspection site, and the correspondence between the inspection site and the identification of the obtained inspection equipment.

[0014] In some embodiments, sending the inspection task instance to the inspection device includes: in response to obtaining an inspection task pull request sent from an inspection device in an idle state, sending the inspection task instance to the inspection device.

[0015] In some embodiments, the automatic inspection method further includes: determining a status of at least one of the inspection task or the inspection device according to a signal sent by the inspection device.

[0016] In some embodiments, determining the state of the inspection device includes: determining the inspection device to be in working state in response to obtaining a busy signal sent by the inspection device, wherein the busy signal is sent by the inspection device after obtaining the inspection task instance and leaving the parking area of ​​the inspection device.

[0017] In some embodiments, the inspection task includes one or more subtasks, each subtask corresponds to a patrol point and includes patrol instructions executed at the patrol point, and determining the status of the inspection task includes: in response to obtaining a start signal sent by the patrol device, determining the subtask corresponding to the patrol point where the patrol device is currently located as an execution state, wherein the start signal is sent after the patrol device arrives at the patrol point and starts to execute the corresponding patrol instructions; in response to obtaining a completion signal sent by the patrol device, determining the corresponding subtask in the inspection task as a completion state.

[0018] In some embodiments, determining the status of the inspection task includes: if all subtasks of the inspection task are in a completed state, determining the inspection task as being in a completed state.

[0019] In some embodiments, determining the state of the inspection device includes: determining the inspection device to be in an idle state in response to obtaining an idle signal sent by the inspection device, wherein the idle signal is sent by the inspection device when the inspection device completes the inspection task and returns to the parking area of ​​the inspection device.

[0020] In some embodiments, the inspection task includes one or more subtasks, each subtask corresponds to a inspection point and includes an inspection instruction executed at the inspection point.

[0021] In some embodiments, the automatic inspection method also includes: obtaining completed subtasks from a message queue, wherein the subtasks in the message queue are pushed into the message queue in response to the subtasks being in a completed state; using a real-time streaming processing engine to query the scene analysis algorithm and evidence collection results corresponding to the obtained subtasks, wherein the evidence collection results are uploaded by the inspection device corresponding to the subtask after executing the subtask; using a scene analysis algorithm to analyze the evidence collection results; and generating an alarm task if the analysis results are abnormal.

[0022] In some embodiments, the inspection instruction includes at least one of a photo taking instruction, a video shooting instruction, an environmental parameter collection instruction, or an environmental sensing instruction.

[0023] According to a second aspect of some embodiments of the present invention, there is provided an automatic inspection device, comprising: an instance generation module, configured to generate an instance of an inspection task based on a published inspection task, wherein the inspection task is generated by configuring one or more inspection points, and before the inspection task is generated, each inspection point is configured with one or more inspection instructions; a capability information determination module, configured to determine the capability information corresponding to the inspection instructions configured at one or more inspection points; an inspection path generation module, configured to generate an inspection path based on the inspection point coordinates corresponding to the inspection task instance; and a sending module, configured to send the inspection task instance to an inspection device configured with the capability information; and, sending the generated inspection path to the inspection device, so that the inspection device executes the inspection instructions in the inspection task at one or more inspection points according to the inspection path.

[0024] According to a third aspect of some embodiments of the present invention, there is provided an automatic inspection device, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute any one of the aforementioned automatic inspection methods based on instructions stored in the memory.

[0025] According to a fourth aspect of some embodiments of the present invention, there is provided an automatic inspection system, comprising: any one of the aforementioned automatic inspection devices; and an inspection device, configured to, after acquiring an inspection task instance and an inspection path, execute inspection instructions in the inspection task at one or more inspection points according to the inspection path.

[0026] In some embodiments, the inspection device is further configured to: when in the parking area, pull the generated inspection task instance from the automatic inspection device.

[0027] In some embodiments, the inspection device is further configured to: after arriving at the inspection point, execute the inspection instruction corresponding to the inspection point; after the inspection instruction is executed, drive to the next inspection point.

[0028] In some embodiments, the inspection device is further configured to upload the evidence collection results corresponding to the inspection instruction after the inspection instruction is executed.

[0029] In some embodiments, the inspection device is further configured to return to a parking area of ​​the inspection device after the inspection instructions of all subtasks of the inspection task are executed.

[0030] In some embodiments, the inspection equipment is an unmanned vehicle.

[0031] According to a fifth aspect of some embodiments of the present invention, there is provided a computer-readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements any one of the aforementioned automatic inspection methods.

[0032] Some embodiments of the above invention have the following advantages or beneficial effects. The embodiments of the present invention generate inspection tasks based on inspection points pre-configured with inspection instructions, and issue inspection tasks based on the capabilities of inspection devices, so that the inspection devices can automatically perform inspections according to the inspection tasks. This improves the reusability and flexibility of inspection task configuration and the efficiency of automatic inspection.

[0033] Further features and advantages of the present invention will become apparent from the following detailed description of exemplary embodiments of the present invention with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0035] Figure 1 A schematic flow chart of an automatic inspection method according to some embodiments of the present invention is shown.

[0036] Figure 2 A schematic flow chart of a method for configuring inspection tasks according to some embodiments of the present invention is shown.

[0037] Figure 3 A schematic diagram of a flow chart of a method for configuring inspection points according to some embodiments of the present invention is shown.

[0038] Figure 4 A schematic flow chart of a method for configuring a patrol device model according to some embodiments of the present invention is shown.

[0039] Figure 5 A schematic flow chart of a method for configuring a patrol device model according to some embodiments of the present invention is shown.

[0040] Figure 6 A schematic flow chart of a configuration method of a management terminal of an inspection site according to some embodiments of the present invention is shown.

[0041] Figure 7 A schematic flow chart of a state monitoring method according to some embodiments of the present invention is shown.

[0042] Figure 8 A schematic flow chart of an automatic inspection method according to some embodiments of the present invention is shown.

[0043] Fig. 9 A schematic flow chart of a method for analyzing inspection tasks according to some embodiments of the present invention is shown.

[0044] Fig.10 A schematic structural diagram of an automatic inspection device according to some embodiments of the present invention is shown.

[0045] Fig.11 A schematic structural diagram of an automatic inspection system according to some embodiments of the present invention is shown.

[0046] Fig.12 The following is a schematic structural diagram of an automatic inspection device according to some other embodiments of the present invention.

[0047] Fig.13 A schematic structural diagram of an automatic inspection device according to some further embodiments of the present invention is shown. DETAILED DESCRIPTION

[0048] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. The following description of at least one exemplary embodiment is actually only illustrative and is by no means intended to limit the present invention and its application or use. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0049] The relative arrangement of components and steps, the numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.

[0050] At the same time, it should be understood that for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0051] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.

[0052] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0053] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0054] Figure 1The flowchart of the automatic inspection method according to some embodiments of the present invention is shown. Each step of this embodiment can be performed by an automatic inspection device. The automatic inspection device is located on a back-end server and can be implemented in the form of a computer, a computing cluster, etc. Figure 1 As shown, the automatic inspection method of this embodiment includes steps S102 to S110.

[0055] In step S102, an instance of an inspection task is generated according to the published inspection task, wherein the inspection task is generated by configuring one or more inspection points, and before the inspection task is generated, each inspection point is configured with one or more inspection instructions.

[0056] There can be one or more inspection tasks, so that multiple inspection tasks can be executed in parallel from multiple dimensions, improving the flexibility and efficiency of inspection.

[0057] In some embodiments, the inspection task includes one or more subtasks, each subtask corresponds to a inspection point and includes an inspection instruction executed at the inspection point.

[0058] Inspection tasks are generated by configuring inspection points, and inspection points are pre-configured with inspection instructions. This allows for higher efficiency and simpler operations when generating inspection tasks. Task configuration based on inspection points also makes it easier to reuse configured content when generating multiple tasks.

[0059] An instance of an inspection task is used to indicate the execution process of an inspection task, including inspection points and corresponding inspection instructions. For example, if an inspection task A needs to be executed once every hour, 24 instances of inspection task A, a1, a2, a3, etc., can be generated in sequence within one day. Each inspection task instance includes the inspection points and inspection instructions corresponding to inspection task A. These inspection task instances can be executed by the same inspection device or by different inspection devices.

[0060] In some embodiments, after the inspection task is issued, an instance of the inspection task is generated according to a pre-configured execution rule. The execution rule is, for example, the execution time of the inspection task, which can be a specific time point or a periodic value in the case of periodic execution.

[0061] Inspection instructions correspond to specific inspection actions, such as taking two photos, sensing whether there is smoke, etc.

[0062] In step S104, capability information corresponding to the inspection instructions configured at one or more inspection points is determined.

[0063] In some embodiments, the inspection instruction includes at least one of a photo taking instruction, a video shooting instruction, an environmental parameter collection instruction, or an environmental sensing instruction.

[0064] For example, a photo taking instruction requires the inspection equipment to have image acquisition capability (eg, a camera), and a temperature acquisition instruction requires the inspection equipment to have temperature detection capability (eg, a thermometer).

[0065] In step S106, the inspection task instance is sent to the inspection device configured with capability information. The inspection device is, for example, an unmanned vehicle, unmanned aerial vehicle or other unmanned driving device used for automatic inspection.

[0066] In some embodiments, in response to obtaining an inspection task pull request sent from an inspection device in an idle state, an inspection task instance is sent to the inspection device. The inspection device in the idle state is, for example, an inspection device parked in a parking area. Thus, the sent inspection task can be executed as quickly as possible.

[0067] In some embodiments, the inspection device receiving the instance of the inspection task has all capability information corresponding to the inspection task. For example, if the inspection task requires taking photos, the inspection device should have the capability of taking photos.

[0068] Of course, as needed, the inspection device that receives the instance of the inspection task may also have some capability information, for example, when the completion requirement of the inspection task is not high but the task is urgent, or when the resources of the inspection device are insufficient.

[0069] In step S108, an inspection path is generated according to the inspection point coordinates corresponding to the inspection task instance.

[0070] When generating an inspection path, in addition to considering the inspection point coordinates themselves, the traffic conditions in the current inspection site can also be referred to. In addition, factors such as time and historical data can also be considered to comprehensively generate the inspection path. The inspection path includes the visit order of the inspection points corresponding to the inspection task.

[0071] In step S110, the generated inspection path is sent to the inspection device, so that the inspection device executes the inspection instructions in the inspection task at one or more inspection points according to the inspection path.

[0072] In some embodiments, the inspection device determines whether it has reached the inspection point according to the current position. If it has reached the inspection point, the inspection device searches for the inspection instruction corresponding to the inspection point and executes it. For example, the corresponding inspection instruction can be searched according to the identification of the inspection point. For another example, step S106 can be performed after step S108, that is, after the inspection path is generated, the order of the inspection instructions corresponding to each inspection point in the instance of the inspection task is adjusted to arrange the inspection instructions according to the order of the inspection points in the inspection path, so that the inspection device can execute the inspection instructions in order.

[0073] The embodiment of the present invention generates inspection tasks based on inspection points pre-configured with inspection instructions, and issues inspection tasks based on the capabilities of inspection devices, so that the inspection devices can automatically perform inspections according to the inspection tasks. This improves the reusability and flexibility of inspection task configuration and the efficiency of automatic inspection.

[0074] In some embodiments, the inspection tasks, inspection points, inspection equipment models, inspection equipment, and management terminals of inspection sites can be flexibly and reusably configured.

[0075] Figure 2 FIG. 2 is a flow chart showing a method for configuring inspection tasks according to some embodiments of the present invention. Figure 2 As shown, the inspection task configuration method of this embodiment includes steps S202 to S210.

[0076] In step S202, a new inspection task is created.

[0077] For example, a user can trigger the creation process through the creation interface of the front-end inspection task.

[0078] In step S204, attribute information and execution rules are configured for the new inspection task, wherein the execution rule is a rule for instructing to generate an instance of the inspection task.

[0079] The attribute information includes, for example, the target site for performing the inspection task, basic information of the task (such as the task name or task description), and the like.

[0080] The execution rules can be configured to execute a single or periodic inspection task through a scheduled task expression (Cron expression), so that the inspection scheduling time can be flexibly configured.

[0081] In step S206, inspection points are configured for the new inspection task.

[0082] Existing inspection points can be displayed to the user through the front-end page for selection by the user. When the user needs to configure a new inspection point for the inspection task, the inspection point creation process can also be started, which will be further described later.

[0083] In step S208, one or more inspection instructions configured at the inspection point of the new inspection task are added to the new inspection task.

[0084] In step S210, a new inspection task is issued.

[0085] After the inspection task is released, an instance of the inspection task can be generated asynchronously according to the execution rules, and polled and pulled by the inspection device.

[0086] The configuration method of the above inspection task can support inspection tasks of various dimensions and types. The hardware functions of the inspection equipment are provided in the form of services, that is, in the form of software inspection instructions, so that the generation of inspection tasks can be realized by arranging the inspection actions of the inspection points. Since the inspection points are already configured with inspection instructions, when creating new tasks, users do not need to consider the specific instructions for task creation. Thereby, the efficiency and flexibility of task creation are improved, and the reusability of inspection points is also improved.

[0087] Figure 3 FIG. 2 is a flow chart showing a method for configuring inspection points according to some embodiments of the present invention. Figure 3 As shown, the inspection point configuration method of this embodiment includes steps S302 to S306.

[0088] In step S302, a new inspection point is created.

[0089] For example, a user can trigger the creation process through the creation interface of the inspection point on the front end.

[0090] In step S304, attribute information and coordinates are configured for the new inspection point.

[0091] The attribute information includes, for example, the name of the inspection point, inspection description, etc., and the inspection description may be, for example, "check whether cardboard is randomly piled up on the platform."

[0092] The coordinates are selected by the user, for example, based on a site route map displayed on the front page. In addition, the coordinate values ​​can also be manually entered, or the name or logo of a specific location can be entered.

[0093] In step S306, a patrol instruction is configured for the new patrol point, wherein the patrol instruction is an executable program.

[0094] Each inspection point can be configured with one or more inspection instructions (i.e., inspection actions). For example, select the action to be executed and configure the action execution program.

[0095] For example, if you need to execute photo taking, configure the corresponding execution program, set the X-axis offset, Y-axis offset, number of photos, etc. of the lens adjustment.

[0096] In addition, you can also configure the result analysis algorithm for the corresponding scenario. The scenario analysis algorithm is used to analyze the inspection results performed at the inspection point to determine whether the inspection is qualified.

[0097] Through programming configuration, various practical needs can be met.

[0098] The above embodiment provides a method for configuring inspection points, so that basic configuration can be completed with inspection points as units, which is convenient for improving efficiency when creating inspection tasks. Therefore, the above embodiment improves the efficiency and flexibility of task creation and also improves the reusability of inspection points.

[0099] Figure 4 FIG. 1 is a flow chart showing a method for configuring a patrol device model according to some embodiments of the present invention. Figure 4 As shown, the inspection equipment model configuration method of this embodiment includes steps S402 to S404.

[0100] In step S402, a new inspection device model is created.

[0101] For example, the user can trigger the creation process through the creation interface of the inspection equipment model on the front end.

[0102] In step S404, attribute information and capability information are configured for the new inspection device model.

[0103] Attribute information includes, for example, model code, name, or basic description.

[0104] The capabilities of the inspection equipment are displayed to the user in a list on the front end for the user to select. For example, whether it supports photo and video recording, whether it supports smoke alarm function, whether it supports temperature and humidity sensing, etc. If the list does not include the capabilities of all inspection equipment, the developer will expand the capabilities to update the platform's support for the capabilities of new inspection equipment.

[0105] In some embodiments, a plug-in is configured for a new inspection device model, wherein the plug-in is used to interact with the inspection device and the network side to solve the difference problem of the interaction between different models of vehicles and the inspection scheduling system. The plug-in can be uploaded by the user.

[0106] The above embodiment provides a method for configuring the model of the inspection device, thereby expanding the types of inspection devices supported by the system and improving the scalability and compatibility of the system.

[0107] Figure 5 FIG. 1 is a flow chart showing a method for configuring a patrol device model according to some embodiments of the present invention. Figure 5 As shown, the inspection equipment model configuration method of this embodiment includes steps S502 to S504.

[0108] In step S502, a new inspection device is created.

[0109] For example, a user can trigger a creation process through a creation interface of a front-end inspection device.

[0110] In step S504, attribute information and the inspection device model to which the new inspection device belongs are configured for the new inspection device.

[0111] The attribute information includes, for example, the name, basic description and communication address of the inspection device.

[0112] After creating a new inspection device, you can also enable or disable the inspection device and perform a connectivity test on the inspection device. You can also view the basic information and operating status of all inspection devices in the background.

[0113] The enabled inspection device can start to obtain and process inspection tasks.

[0114] Through the above embodiments, the inspection equipment can be managed flexibly, thereby improving the flexibility of the system.

[0115] Figure 6 FIG. 1 is a flow chart showing a configuration method of a management terminal of an inspection site according to some embodiments of the present invention. Figure 6 As shown, the configuration method of the management terminal of the inspection site of this embodiment includes steps S602 to S606.

[0116] In step S602, the attribute information configured for the management terminal of the newly added inspection site is obtained.

[0117] For example, a user can trigger the creation process through the creation interface of the front-end management terminal. The acquired attribute information includes, for example, the terminal name, the area to which the terminal belongs (such as the inspection site), the terminal code, the remarks information, the safety officer information, etc. The safety officer is used to monitor and manage the situation in the area, and the safety officer information includes, for example, the name, email address, phone number, etc.

[0118] In step S604, the identification of the inspection device configured for the inspection site is obtained. The configured inspection device is used to perform the inspection task in the corresponding inspection site.

[0119] In step S606, the attribute information of the inspection site and the corresponding relationship between the inspection site and the obtained identification of the inspection equipment are stored.

[0120] When inspection results are obtained, inspection tasks are started, inspection alarms are obtained, etc., information can be pushed to the corresponding management terminal for timely processing.

[0121] Through the above embodiment, management terminals can be added as needed, thereby improving the flexibility of inspection management.

[0122] The present invention can also monitor the inspection progress during the inspection process. In some embodiments, the state of at least one of the inspection task or the inspection device is determined based on the signal sent by the inspection device. Figure 7 An embodiment of the state monitoring method of the present invention is described.

[0123] Figure 7 FIG. 2 shows a flow chart of a state monitoring method according to some embodiments of the present invention. Figure 7 As shown, the state monitoring method of this embodiment includes steps S702 to S718.

[0124] In step S702, the inspection device sends a busy signal after acquiring the inspection task instance and leaving the parking area of ​​the inspection device.

[0125] In step S704, in response to obtaining a busy signal sent by the inspection device, the inspection device is determined to be in a working state.

[0126] In step S706, after the inspection device reaches the inspection point and starts to execute the corresponding inspection instruction, a start signal is sent.

[0127] In step S708, in response to obtaining a start signal sent by the inspection device, the subtask corresponding to the inspection point in the inspection task is determined to be in an execution state.

[0128] For example, the inspection device reports the inspection point identifier, or the subtask identifier, or the current coordinates to determine the subtask currently being executed.

[0129] In step S710, the inspection device sends a completion signal after completing the subtask.

[0130] In step S712, in response to obtaining a completion signal sent by the inspection device, a corresponding subtask in the inspection task is determined to be in a completed state.

[0131] For example, the inspection point identifier, or the subtask identifier, or the current coordinates are reported by the inspection device to determine the currently completed subtask.

[0132] In step S714, when all subtasks of the inspection task are in the completed state, the inspection task is determined to be in the completed state.

[0133] In step S716, the inspection device sends an idle signal when completing the inspection task and returning to the parking area of ​​the inspection device.

[0134] In step S718 , in response to obtaining the idle signal, the inspection device is determined to be in an idle state.

[0135] Through the above embodiments, the automatic inspection device can interact with the inspection equipment in real time and update the status of the inspection equipment and the inspection task in a timely manner. This is conducive to the monitoring and management of the inspection process. Furthermore, by mastering the status of the inspection equipment, tasks can be accurately and effectively assigned to idle inspection equipment, thereby improving the efficiency of automatic inspection.

[0136] Figure 8 FIG. 2 shows a flow chart of an automatic inspection method according to some embodiments of the present invention. Figure 8 As shown, the automatic inspection method of this embodiment includes S802 to S844. Figure 8 The left column shows the execution steps of the inspection scheduling system in the automatic inspection device, and the right column shows the execution steps of the unmanned vehicle used for inspection.

[0137] In step S802, the inspection scheduling system generates an inspection task instance corresponding to the management terminal according to the time rule configured by the administrator.

[0138] In step S804, when the unmanned vehicle is idle in the charging parking area, it actively accesses the inspection scheduling system to pull tasks. The inspection scheduling system queries the corresponding terminal inspection task according to the vehicle number and returns the task to the unmanned vehicle.

[0139] In step S806, the unmanned vehicle determines whether it has obtained the inspection task. If not (marked as N in the figure), it returns to step S804 to continue to cyclically pull tasks according to the interval time; if yes (marked as Y in the figure), it executes step S806.

[0140] In step S808, the unmanned vehicle accesses the inspection scheduling system, which optimizes the path according to the inspection point coordinate set of the subtasks included in the current inspection task, and then returns the path planning result information and the execution program messages included in all subtasks to the unmanned vehicle.

[0141] In step S810, the unmanned vehicle leaves the parking area and starts to go to the inspection coordinate points in sequence to perform inspection subtasks and sends a busy signal to the inspection scheduling system.

[0142] In step S812, the inspection dispatching system updates the current vehicle working status to "running" and updates the current inspection task status to "inspecting".

[0143] In step S814, the unmanned vehicle arrives at the inspection point and starts to execute the inspection procedure, while sending a start signal to the inspection scheduling system.

[0144] In step S816, the inspection scheduling system updates the execution status of the current subtask according to the signal sent by the unmanned vehicle. For example, based on the start signal sent by the unmanned vehicle, the subtask status is determined to be "executing".

[0145] Then, the unmanned vehicle starts to execute the inspection procedure. For example, the unmanned vehicle sequentially executes the inspection actions included in the current inspection point in a traversal manner.

[0146] In step S818, the unmanned vehicle determines whether it is necessary to take photos for evidence collection. If necessary, step S820 is executed; otherwise, the process jumps to step S824.

[0147] In step S820, according to the execution program corresponding to the inspection instruction, the X-axis and Y-axis offset or angle of the lens, the number of photos, etc. are adjusted.

[0148] In step S822, after taking the photo, the unmanned vehicle uploads the photo to the cloud as a forensic result.

[0149] In step S824, the unmanned vehicle determines whether it is necessary to shoot video for evidence collection. If necessary, step S826 is executed; otherwise, the process jumps to step S830.

[0150] In step S826, according to the execution program corresponding to the inspection instruction, the X-axis and Y-axis offset or angle of the lens, the shooting time, etc. are adjusted.

[0151] In step S828, after the video shooting is completed, the unmanned vehicle uploads the video to the cloud as a forensic result.

[0152] In step S830, the unmanned vehicle determines whether the inspection point also includes other extended inspection actions, such as temperature and humidity sensing, etc. If necessary, step S832 is executed; otherwise, the process jumps to step S834.

[0153] In step S832, the corresponding extended inspection action is performed, and the evidence collection results are uploaded to the cloud.

[0154] In step S834, the unmanned vehicle determines that all instructions of the current inspection point have been executed, and sends a completion signal to the inspection scheduling system. The inspection scheduling system can update the execution status of the current subtask to "inspection completed" in response to the completion signal.

[0155] In step S836, the unmanned vehicle determines whether the current inspection task includes other unexecuted inspection point subtasks. If yes, it goes to the next inspection point and jumps to step S814; if not, it executes step S842.

[0156] In step S838, the inspection scheduling system determines whether all inspection subtasks have been completed. If yes, step S840 is executed.

[0157] In step S840, the inspection scheduling system updates the status of the inspection task (ie, the inspection main task including one or more subtasks) to a completed status.

[0158] In step S842, the unmanned vehicle confirms that the inspection is complete, returns to the parking area, and sends an idle signal to the inspection scheduling system.

[0159] In step S844, the inspection and dispatching system updates the working state of the unmanned vehicle to an idle state.

[0160] The above embodiment is described by taking an unmanned vehicle performing an inspection task as an example. As required, multiple inspection devices can be dispatched by the inspection dispatching system at the same time.

[0161] Through the above embodiments, the inspection equipment can respond to the dispatching of the inspection dispatching system to execute tasks and timely report the status of itself and the tasks, so that the inspection dispatching system can monitor the inspection equipment and inspection tasks in real time, thereby achieving efficient and high-quality automated inspection.

[0162] After the inspection task is completed, you can also analyze the execution results. Fig. 9 An embodiment of the present invention for performing result analysis is described.

[0163] Fig. 9 FIG. 2 is a flow chart showing a method for analyzing inspection tasks according to some embodiments of the present invention. Fig. 9 As shown, the inspection task analysis method of this embodiment includes steps S902 to S910.

[0164] In step S902, the inspection device pushes the subtask in the completed state to the message queue.

[0165] In step S904, the completed subtask is obtained from the message queue.

[0166] In step S906, a real-time streaming processing engine (such as the Flink real-time streaming processing engine) is used to query the scene analysis algorithm and evidence collection results corresponding to the obtained subtask, where the evidence collection results are uploaded by the inspection device corresponding to the subtask after executing the subtask.

[0167] For example, through the subtask identifier, the subtask information, the terminal and inspection point information corresponding to the task are queried from the platform's business database, and the scene analysis algorithm corresponding to the inspection action is obtained.

[0168] In step S908, the evidence collection results are analyzed using a scene analysis algorithm.

[0169] In step S910, if the analysis result is abnormal, an alarm task is generated. The alarm task can be pushed to the corresponding management terminal so that the security officer in charge of management can know and handle it.

[0170] After obtaining the analysis results, you can update the status of the subtasks and the analysis results.

[0171] Through the above embodiments, problems in the inspection process can be discovered in time, so as to improve the availability of the inspection results and enhance safety.

[0172] Reference below Fig.10 An embodiment of the automatic inspection device of the present invention is described.

[0173] Fig.10 FIG. 2 shows a schematic diagram of the structure of an automatic inspection device according to some embodiments of the present invention. Fig.10 As shown, the automatic inspection device 100 of this embodiment includes: an instance generation module 1100, configured to generate an instance of an inspection task based on a published inspection task, wherein the inspection task is generated by configuring one or more inspection points, and before the inspection task is generated, each inspection point is configured with one or more inspection instructions; a capability information determination module 1200, configured to determine the capability information corresponding to the inspection instructions configured at one or more inspection points; an inspection path generation module 1300, configured to generate an inspection path based on the inspection point coordinates corresponding to the inspection task instance; and, a sending module 1400, configured to send the inspection task instance to the inspection device configured with the capability information; and, sending the generated inspection path to the inspection device, so that the inspection device executes the inspection instructions in the inspection task at one or more inspection points according to the inspection path.

[0174] In some embodiments, the automatic inspection device 100 further includes a configuration module 1500 .

[0175] In some embodiments, the configuration module 1500 is further configured to create a new inspection task; configure attribute information and execution rules for the new inspection task, wherein the execution rules are rules for indicating the generation of an instance of an inspection task; configure inspection points for the new inspection task; add one or more inspection instructions configured for the inspection points of the new inspection task to the new inspection task; and publish the new inspection task.

[0176] In some embodiments, the instance generation module 1100 is further configured to generate an instance of the inspection task at a pre-configured execution time of the inspection task after the inspection task is released.

[0177] In some embodiments, the configuration module 1500 is further configured to create a new inspection point; configure attribute information and coordinates for the new inspection point; and configure inspection instructions for the new inspection point, wherein the inspection instructions are executable programs.

[0178] In some embodiments, the configuration module 1500 is further configured to configure a scenario analysis algorithm for a new inspection point, wherein the scenario analysis algorithm is used to analyze the inspection results of the inspection point.

[0179] In some embodiments, the configuration module 1500 is further configured to create a new inspection device model; and configure attribute information and capability information for the new inspection device model.

[0180] In some embodiments, the configuration module 1500 is further configured to configure a plug-in for a new inspection device model, wherein the plug-in is used to interact with the inspection device and the network side.

[0181] In some embodiments, the configuration module 1500 is further configured to create a new inspection device; configure attribute information for the new inspection device, and the inspection device model to which the new inspection device belongs.

[0182] In some embodiments, the configuration module 1500 is further configured to obtain attribute information configured for the management terminal of the newly added inspection site; obtain the identification of the inspection equipment configured for the inspection site; store the attribute information of the inspection site, and the correspondence between the inspection site and the identification of the obtained inspection equipment.

[0183] In some embodiments, the sending module 1400 is further configured to send the inspection task instance to the inspection device in response to obtaining an inspection task pull request sent from the inspection device in an idle state.

[0184] In some embodiments, the automatic inspection device 100 further includes a state determination module 1600 configured to determine the state of at least one of an inspection task or an inspection device according to a signal sent by the inspection device.

[0185] In some embodiments, the state determination module 1600 is further configured to determine the inspection device as being in a working state in response to obtaining a busy signal sent by the inspection device, wherein the busy signal is sent by the inspection device after obtaining an inspection task instance and leaving a parking area of ​​the inspection device.

[0186] In some embodiments, the inspection task includes one or more subtasks, each subtask corresponds to an inspection point and includes inspection instructions executed at the inspection point, and the status determination module 1600 is further configured to determine the subtask corresponding to the inspection point where the inspection device is currently located as an execution state in response to obtaining a start signal sent by the inspection device, wherein the start signal is sent after the inspection device arrives at the inspection point and starts to execute the corresponding inspection instructions; in response to obtaining a completion signal sent by the inspection device, determine the corresponding subtask in the inspection task as a completion state.

[0187] In some embodiments, the state determination module 1600 is further configured to determine the inspection task as being in a completed state when all subtasks of the inspection task are in a completed state.

[0188] In some embodiments, the state determination module 1600 is further configured to determine the inspection device as being in an idle state in response to acquiring an idle signal sent by the inspection device, wherein the idle signal is sent by the inspection device after completing the inspection task and returning to the parking area of ​​the inspection device.

[0189] In some embodiments, the inspection task includes one or more subtasks, each subtask corresponds to a inspection point and includes an inspection instruction executed at the inspection point.

[0190] In some embodiments, the automatic inspection device 100 also includes an analysis module 1700, which is configured to obtain completed subtasks from a message queue, wherein the subtasks in the message queue are pushed into the message queue in response to the subtasks being in a completed state; using a real-time streaming processing engine, querying a scene analysis algorithm and evidence collection results corresponding to the obtained subtasks, wherein the evidence collection results are uploaded by the inspection device corresponding to the subtask after executing the subtask; using a scene analysis algorithm to analyze the evidence collection results; and generating an alarm task when the analysis results are abnormal.

[0191] In some embodiments, the inspection instruction includes at least one of a photo taking instruction, a video shooting instruction, an environmental parameter collection instruction, or an environmental sensing instruction.

[0192] Fig.11 FIG. 2 shows a schematic diagram of the structure of an automatic inspection system according to some embodiments of the present invention. Fig.11 As shown, the automatic inspection system 11 of this embodiment includes: any one of the automatic inspection devices 100 described above; and an inspection device 110, which is configured to execute the inspection instructions in the inspection task at one or more inspection points according to the inspection path after obtaining the inspection task instance and the inspection path.

[0193] In some embodiments, the inspection device 110 is further configured to: when in the parking area, pull the generated inspection task instance from the automatic inspection device.

[0194] In some embodiments, the inspection device 110 is further configured to: after arriving at the inspection point, execute the inspection instruction corresponding to the inspection point; after the inspection instruction is executed, drive to the next inspection point.

[0195] In some embodiments, the inspection device 110 is further configured to upload the evidence collection result corresponding to the inspection instruction after the inspection instruction is executed.

[0196] In some embodiments, the inspection device 110 is further configured to return to the parking area of ​​the inspection device after the inspection instructions of all subtasks of the inspection task are executed.

[0197] In some embodiments, the inspection device 110 is an unmanned vehicle.

[0198] Fig.12 FIG. 2 shows a schematic diagram of the structure of an automatic inspection device according to some other embodiments of the present invention. Fig.12 As shown, the automatic inspection device 120 of this embodiment includes: a memory 1210 and a processor 1220 coupled to the memory 1210 , and the processor 1220 is configured to execute the automatic inspection method in any one of the aforementioned embodiments based on instructions stored in the memory 1210 .

[0199] The memory 1210 may include, for example, a system memory, a fixed non-volatile storage medium, etc. The system memory may store, for example, an operating system, an application program, a boot loader, and other programs.

[0200] Fig.13 FIG. 2 shows a schematic diagram of the structure of an automatic inspection device according to some other embodiments of the present invention. Fig.13 As shown, the automatic inspection device 130 of this embodiment includes: a memory 1310 and a processor 1320, and may also include an input / output interface 1330, a network interface 1340, a storage interface 1350, etc. These interfaces 1330, 1340, 1350 and the memory 1310 and the processor 1320 may be connected, for example, via a bus 1360. Among them, the input / output interface 1330 provides a connection interface for input / output devices such as a display, a mouse, a keyboard, and a touch screen. The network interface 1340 provides a connection interface for various networked devices. The storage interface 1350 provides a connection interface for external storage devices such as SD cards and USB flash drives.

[0201] An embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, wherein the program implements any one of the aforementioned automatic inspection methods when executed by a processor.

[0202] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable non-transient storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0203] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0204] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0205] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0206] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. An automatic inspection method, comprising: An instance of generating an inspection task according to the published inspection task, wherein the inspection task is generated by configuring one or more inspection points, and before generating the inspection task, each inspection point is configured with one or more inspection instructions; Determining capability information corresponding to the inspection instructions configured at the one or more inspection points; Sending the inspection task instance to the inspection device configured with the capability information; Generate an inspection path according to the inspection point coordinates corresponding to the inspection task instance; The generated inspection path is sent to the inspection device, so that the inspection device executes the inspection instructions in the inspection task at the one or more inspection points according to the inspection path.

2. The automatic inspection method according to claim 1, further comprising: Create a new inspection task; Configuring attribute information and execution rules for the new inspection task, wherein the execution rule is a rule for instructing to generate an instance of the inspection task; Configuring inspection points for the new inspection task; Adding one or more inspection instructions configured at the inspection point of the new inspection task to the new inspection task; The new inspection task is published.

3. The automatic inspection method according to claim 1 or 2, wherein: The examples of generating inspection tasks include: After the inspection task is released, an instance of the inspection task is generated at the pre-configured execution time of the inspection task.

4. The automatic inspection method according to claim 1, further comprising: Create a new inspection point; Configuring attribute information and coordinates for the new inspection point; A patrol instruction is configured for the new patrol point, wherein the patrol instruction is an executable program.

5. The automatic inspection method according to claim 4, further comprising: A scene analysis algorithm is configured for the new inspection point, wherein the scene analysis algorithm is used to analyze the inspection result of the inspection point.

6. The automatic inspection method according to claim 1, further comprising: Create new inspection equipment models; Configure attribute information and capability information for the new inspection device model.

7. The automatic inspection method according to claim 6, further comprising: A plug-in is configured for the new inspection device model, wherein the plug-in is used for interaction between the inspection device and the network side.

8. The automatic inspection method according to claim 1 or 6, further comprising: Create new inspection equipment; Attribute information is configured for the new inspection device, as well as the inspection device model to which the new inspection device belongs.

9. The automatic inspection method according to claim 1, further comprising: Obtain the attribute information configured for the management terminal of the newly added inspection site; Obtaining the identification of the inspection equipment configured for the inspection site; The attribute information of the inspection site and the corresponding relationship between the inspection site and the acquired identification of the inspection equipment are stored.

10. The automatic inspection method according to claim 1, wherein: The sending the inspection task instance to the inspection device includes: In response to obtaining an inspection task pull request sent from an inspection device in an idle state, sending the inspection task instance to the inspection device.

11. The automatic inspection method according to claim 1, further comprising: A status of at least one of the inspection task or the inspection device is determined according to a signal sent by the inspection device.

12. The automatic inspection method according to claim 11, wherein: Determining the state of the inspection device includes: In response to obtaining a busy signal sent by the inspection device, the inspection device is determined to be in a working state, wherein the busy signal is sent by the inspection device after obtaining the inspection task instance and leaving a parking area of ​​the inspection device.

13. The automatic inspection method according to claim 11, wherein: The inspection task includes one or more subtasks, each subtask corresponds to a inspection point and includes an inspection instruction executed at the inspection point, and determining the status of the inspection task includes: In response to obtaining a start signal sent by the inspection device, determining the subtask corresponding to the inspection point where the inspection device is currently located as an execution state, wherein the start signal is sent after the inspection device reaches the inspection point and starts to execute the corresponding inspection instruction; In response to acquiring a completion signal sent by the inspection device, a corresponding subtask in the inspection task is determined to be in a completion state.

14. The automatic inspection method according to claim 13, wherein: Determining the status of the inspection task includes: When all subtasks of the inspection task are in a completed state, the inspection task is determined to be in a completed state.

15. The automatic inspection method according to claim 11, wherein: Determining the state of the inspection device includes: In response to acquiring an idle signal sent by the patrol device, the patrol device is determined to be in an idle state, wherein the idle signal is sent by the patrol device after completing the patrol task and returning to a parking area of ​​the patrol device.

16. The automatic inspection method according to claim 1, wherein: The inspection task includes one or more subtasks, each subtask corresponds to a inspection point and includes an inspection instruction executed at the inspection point.

17. The automatic inspection method according to claim 16, further comprising: Acquire a completed subtask from a message queue, wherein the subtask in the message queue is pushed into the message queue in response to the subtask being in a completed state; Using a real-time streaming processing engine, query the scene analysis algorithm and evidence collection results corresponding to the acquired subtask, wherein the evidence collection results are uploaded by the inspection device corresponding to the subtask after executing the subtask; Analyzing the evidence collection results using the scene analysis algorithm; If the analysis result is abnormal, an alarm task is generated.

18. The automatic inspection method according to claim 1, wherein: The inspection instruction includes at least one of a photo taking instruction, a video shooting instruction, an environmental parameter collection instruction or an environmental sensing instruction.

19. An automatic inspection device, comprising: An instance generation module is configured to generate an instance of an inspection task according to a published inspection task, wherein the inspection task is generated by configuring one or more inspection points, and before generating the inspection task, each inspection point is configured with one or more inspection instructions; A capability information determination module, configured to determine capability information corresponding to the inspection instructions configured by the one or more inspection points; An inspection path generation module is configured to generate an inspection path according to the inspection point coordinates corresponding to the inspection task instance; and The sending module is configured to send the inspection task instance to the inspection device configured with the capability information; and send the generated inspection path to the inspection device so that the inspection device executes the inspection instructions in the inspection task at the one or more inspection points according to the inspection path.

20. An automatic inspection device, comprising: Memory; as well as A processor coupled to the memory, wherein the processor is configured to execute the automatic inspection method according to any one of claims 1 to 18 based on instructions stored in the memory.

21. An automatic inspection system, comprising: The automatic inspection device according to claim 19 or 20; as well as The inspection device is configured to, after acquiring the inspection task instance and the inspection path, execute the inspection instructions in the inspection task at one or more inspection points according to the inspection path.

22. The automatic inspection system according to claim 21, wherein: The inspection device is further configured as follows: When in the parking area, the inspection device pulls the generated inspection task instance from the automatic inspection device.

23. The automatic inspection system according to claim 21, wherein: The inspection device is further configured as follows: After arriving at the inspection point, execute the inspection instruction corresponding to the inspection point; After the inspection instruction is executed, the vehicle moves to the next inspection point.

24. The automatic inspection system according to claim 23, wherein: The inspection device is further configured as follows: After the inspection instruction is executed, the evidence collection result corresponding to the inspection instruction is uploaded.

25. The automatic inspection system according to claim 21, wherein: The inspection device is further configured as follows: After the inspection instructions of all subtasks of the inspection task are executed, the inspection device returns to the parking area.

26. The automatic inspection system according to any one of claims 21 to 25, wherein: The inspection equipment is an unmanned vehicle.

27. A computer-readable storage medium having a computer program stored thereon, wherein the program is executed by a processor to implement the automatic inspection method according to any one of claims 1 to 18.

Images