UAV inspection interactive control method and device

Through the interactive control method and device of drone inspection with interactive display technology, the problems of difficult and insufficient inspection accuracy of drone inspection tasks in the existing technology are solved, and efficient task management and accurate inspection results are achieved , reducing user learning costs.

CN118938956BActive Publication Date: 2025-02-07FOSHAN NANHAI DISTRICT BIG DATA INVESTMENT & CONSTR CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411038937.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-07-31
Publication Date
2025-02-07
Estimated Expiration
2044-07-31

AI Technical Summary

Technical Problem

The existing drone inspection technology is difficult to efficiently manage the inspection tasks of multiple drones, and the data management is difficult, the user's professional knowledge requirements are high, and the lack of effective re-inspection control leads to insufficient inspection accuracy.

Method used

Through interactive display technology, it provides interactive control methods and devices for drone inspection, including displaying the main interface of drone inspection, displaying the task management interface and inspection management interface in response to user instructions, and managing the main inspection tasks and sub-customer tasks. , realize the detection and re-inspection of abnormal inspection points.

Benefits of technology

It reduces the management difficulty and user learning cost of drone inspections, improves management efficiency and accuracy, provides more comprehensive inspection details, realizes intuitive, transparent and traceable, and effectively improves the accuracy of drone inspections.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118938956B_ABST
    Figure CN118938956B_ABST
Patent Text Reader

Abstract

The present application discloses an interactive control method and device for unmanned aerial vehicle inspection, and relates to the field of visualization technology. The method includes displaying a main interface, which includes a first main control and a second main control; in response to a trigger instruction to the first main control, displaying a task management interface, through which the main inspection task is acquired and executed; in response to a trigger instruction to the second main control, displaying an inspection management interface, which includes a first new control and an inspection record area; in response to a selection instruction for the main inspection task displayed in the inspection record area, determining a first target task and performing anomaly point detection to obtain an abnormal inspection point of the first target task; in response to a trigger instruction to the first new control, displaying a first new window, through which a sub-inspection task is acquired and executed; when the sub-inspection task is executed, the abnormal type of the abnormal inspection point is determined and marked according to the inspection report of the sub-inspection task. The present application improves the management efficiency and accuracy of unmanned aerial vehicle inspection.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of visualization technology, and in particular to a method and device for interactive control of unmanned aerial vehicle inspection. Background Art

[0002] An Unmanned Aerial Vehicle (UAV) is an aircraft that can fly remotely or autonomously without the need for humans on board. UAV inspection is one of the applications of UAVs. It is often used to inspect areas that are dangerous, difficult to reach, or require frequent monitoring.

[0003] In the related art, drone control stations such as ground control stations and ground control systems are used to control multiple drones and manage the inspection tasks of each drone, thereby realizing drone inspection. However, in actual inspection applications, there are a large number of drones involved in the inspection tasks, and the inspection process of drones will generate a large amount of data. The difficulty of managing drone inspections and data by drone control stations increases, and the use of drone control stations requires high professional knowledge of users, which increases the learning cost of drone control stations and reduces the convenience of using drone control stations. In addition, in actual inspection applications, it is often necessary to add corresponding inspection tasks for re-inspection of abnormal inspection points detected in the previous inspection task, but the related art rarely has a control method for adding inspection tasks for re-inspection of abnormal inspection points, and its inspection accuracy needs to be improved. Summary of the invention

[0004] The purpose of the present invention is to provide an interactive control method and device for drone inspection, which is used to improve the management efficiency and management accuracy of drone inspection and improve the accuracy of drone inspection.

[0005] On the one hand, an embodiment of the present application provides a drone inspection interactive control method, the method comprising the following steps:

[0006] Displaying the drone inspection main interface, wherein the drone inspection main interface includes a first main control and a second main control;

[0007] In response to a trigger instruction to the first main control, a task management interface is displayed, and at least one main inspection task is acquired and executed through the task management interface, where the main inspection task is used to control the drone to inspect the area to be inspected of the main inspection task;

[0008] In response to a trigger instruction to the second main control, an inspection management interface is displayed, wherein the inspection management interface includes an inspection record area and a first new control, wherein the inspection record area is used to display at least one main inspection task that has been executed;

[0009] In response to a selection instruction for any completed main inspection task, a main inspection task corresponding to the selection instruction for the completed main inspection task is determined as a first target task, and abnormal point detection is performed on the first target task to obtain at least one abnormal inspection point of the first target task, wherein the abnormal inspection point is used to characterize an inspection point where a preset violation exists;

[0010] In response to a trigger instruction for the first newly created control, a first newly created window is displayed, and a sub-inspection task is acquired and executed through the first newly created window, where the sub-inspection task is used to control the drone to inspect the abnormal inspection point;

[0011] When the sub-inspection task is completed, the abnormal type of the abnormal inspection point is determined and marked according to the inspection report of the sub-inspection task.

[0012] On the other hand, an embodiment of the present application provides a drone inspection interactive control device, the device comprising:

[0013] A display module, used to display the drone inspection main interface, which includes a first main control and a second main control;

[0014] A first interactive processing module, configured to display a task management interface in response to a trigger instruction to the first main control, and to obtain and execute at least one main inspection task through the task management interface, wherein the main inspection task is used to control the drone to inspect the area to be inspected of the main inspection task;

[0015] A second interactive processing module, configured to display an inspection management interface in response to a trigger instruction to the second main control, wherein the inspection management interface includes an inspection record area and a first new control, wherein the inspection record area is configured to display at least one main inspection task that has been executed;

[0016] A third interactive processing module is used to respond to the selected instruction of any completed main inspection task, determine the main inspection task corresponding to the selected instruction of the completed main inspection task as the first target task, and perform abnormal point detection on the first target task to obtain at least one abnormal inspection point of the first target task, wherein the abnormal inspection point is used to characterize the inspection point where a preset violation exists;

[0017] a fourth interaction processing module, configured to display a first newly created window in response to a trigger instruction for the first newly created control, and to obtain and execute a sub-inspection task through the first newly created window, wherein the sub-inspection task is used to control the drone to inspect the abnormal inspection point;

[0018] The fifth interactive processing module is used to determine and mark the abnormal type of the abnormal inspection point according to the inspection report of the sub-inspection task when the sub-inspection task is completed.

[0019] The beneficial effects of the present invention are: providing an interactive control method and device for drone inspections, realizing drone inspection control and inspection task management through interactive display technology, reducing the management difficulty of drone inspections and the user's learning cost and professional knowledge requirements for drone inspections, improving the convenience of obtaining drone inspection-related data and the management efficiency and accuracy of drone inspections, and can provide more and more comprehensive drone inspection detail data to achieve intuitive, transparent and traceable results; in addition, for abnormal inspection points detected in the previous inspection task, corresponding inspection tasks are added in combination with interactive display technology, thereby realizing re-inspection of abnormal inspection points, effectively improving drone inspection accuracy and achieving better inspection results. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 It is a flow chart of the interactive control method for UAV inspection provided by this application;

[0021] Figure 2 This is an example diagram of the task management interface provided by this application;

[0022] Figure 3 This is an example diagram of the inspection management interface provided by this application;

[0023] Figure 4 is an example diagram of the first new window provided by this application;

[0024] Figure 5 It is an enlarged view of the third map display sub-area provided by the present application;

[0025] Figure 6 It is another enlarged view of the third map display sub-area provided by the present application;

[0026] Figure 7 It is another enlarged view of the third map display sub-area provided by the present application;

[0027] Figure 8 is an example diagram of the inspection status window and image type setting window provided by this application;

[0028] Fig. 9 is an example diagram of the first grid details window provided by this application;

[0029] Fig.10 is an example diagram of the second grid details window provided by this application;

[0030] Fig.11This is an example diagram of the inspection report sub-interface provided by this application;

[0031] Fig.12 This is an example diagram of the basic information sub-interface and acceptance window provided by this application. DETAILED DESCRIPTION

[0032] In response to the defects of related technologies, the embodiments of the present application propose an interactive control method and device for drone inspections, which can be applied to urban construction inspections, such as two violation inspections, etc., aiming to use interactive display technology to improve the management efficiency and accuracy of drone inspections, and to improve the accuracy of drone inspections by re-inspecting abnormal inspection points.

[0033] The following will describe in detail the implementation steps of the drone inspection interactive control method provided by the embodiment of the present application in conjunction with the accompanying drawings.

[0034] The drone inspection interactive control method provided in the embodiment of the present application can be applied to a terminal, a server, or software running in a terminal or a server. The terminal can be a tablet computer, a laptop computer, a desktop computer, etc., but is not limited to this. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and big data and artificial intelligence platforms. In addition, the server can also be a node server in a blockchain network, but is not limited to this. Among them, blockchain is a new application mode of computer technologies such as distributed data storage, point-to-point transmission, consensus mechanism, and encryption algorithm.

[0035] Reference Figure 1 The UAV inspection interactive control method mainly includes the following steps S101-S106:

[0036] S101, displaying the drone inspection main interface, which includes a first main control and a second main control;

[0037] S102, in response to a trigger instruction to the first main control, displaying a task management interface, obtaining and executing at least one main inspection task through the task management interface, where the main inspection task is used to control the drone to inspect the area to be inspected of the main inspection task;

[0038] S103, in response to a trigger instruction to the second main control, displaying an inspection management interface, the inspection management interface including an inspection record area and a first new control, the inspection record area being used to display at least one main inspection task that has been executed;

[0039] S104, in response to a selection instruction for any completed main inspection task, determining the main inspection task corresponding to the selection instruction for the completed main inspection task as a first target task, and performing abnormal point detection on the first target task to obtain at least one abnormal inspection point of the first target task, where the abnormal inspection point is used to characterize an inspection point where a preset violation behavior exists;

[0040] S105, in response to a trigger instruction for the first newly created control, displaying the first newly created window, acquiring and executing a sub-inspection task through the first newly created window, where the sub-inspection task is used to control the drone to inspect the abnormal inspection point;

[0041] S106, when the sub-inspection task is completed, determine the abnormal type of the abnormal inspection point according to the inspection report of the sub-inspection task and mark it.

[0042] The embodiments of the present application use interactive display technology to achieve drone inspection control and inspection task management, reduce the difficulty of drone inspection management and the user's learning cost and professional knowledge requirements for drone inspection, improve the convenience of obtaining drone inspection-related data and the management efficiency and accuracy of drone inspection, and can provide more and more comprehensive drone inspection detail data to achieve intuitive, transparent and traceable results; in addition, for abnormal inspection points detected in the previous inspection task, the embodiments of the present application use interactive display technology to add corresponding inspection tasks, thereby achieving re-inspection of abnormal inspection points, effectively improving drone inspection accuracy, and facilitating better inspection results.

[0043] In the above step S101, the drone inspection main interface is displayed in the terminal, and the terminal can be a tablet computer, a laptop computer, a desktop computer, etc., but is not limited thereto.

[0044] The above-mentioned drone inspection main interface may include but is not limited to a first control and a second control. The above-mentioned first control is used to display a task management interface when triggered, and the above-mentioned second control is used to display an inspection management interface when triggered.

[0045] In the above step S102, the user can obtain at least one main inspection task and control the drone to perform at least one main inspection task by clicking the first control. Specifically, the user clicks the first control, and when the first control is triggered, the following will be displayed: Figure 2 The task management interface shown in the figure Figure 2 The "work order" in the display indicates the first control; Figure 2 After the task management interface is shown, the user can obtain at least one main inspection task through interactive operations with the task management interface, and control the drone to perform at least one main inspection task so that the drone inspects the area to be inspected of the main inspection task.

[0046] The task management interface is mainly used to obtain and execute at least one main inspection task and manage the inspection result data of at least one main inspection task and at least one sub-inspection task, such as inspection reports and inspection images, but is not limited thereto.

[0047] The above main inspection task is mainly used to control the UAV to inspect the inspection area to be inspected of the main inspection task, such as urban construction and illegal inspection. The inspection area to be inspected can be set through interactive operations with the task management interface, but is not limited to this.

[0048] The number of drones and the number of areas to be inspected corresponding to the above-mentioned main inspection task and the number of inspection times of the areas to be inspected can be set according to actual conditions, and the embodiments of the present application do not specifically limit this. For example, the above-mentioned main inspection task can be used to control a drone to inspect an area to be inspected at least once.

[0049] In the above step S103, while the drone is performing the main inspection task or the sub-inspection task, or when the main inspection task or the sub-inspection task is completed, the user can manage the main inspection task, the sub-inspection task and the drone and view the relevant data of the drone inspection by clicking the second control. Figure 2 In the task management interface shown, "Home" represents the second control. When the user clicks the second control, the following will be displayed when the second control is triggered: Figure 3 The inspection management interface shown in the figure is as follows; Figure 3 After the inspection management interface is shown, the user can manage the main inspection tasks, sub-inspection tasks and drones and view the relevant data of drone inspections by interacting with the inspection management interface.

[0050] The above-mentioned inspection management interface may include an inspection record area and a first new control, but is not limited to this, wherein the above-mentioned inspection record area is mainly used to display at least one completed main inspection task; the above-mentioned first new control is mainly used to display a first new window when triggered, and the first new window is used to obtain and execute sub-inspection tasks.

[0051] In the above step S104, when the main inspection task is completed, the user can select any completed main inspection task to perform abnormal inspection point detection on the selected main inspection task. Figure 3 In the case of the inspection management interface shown, if at least one main inspection task has been completed, the inspection record area of ​​the inspection management interface will display at least one main inspection task that has been completed, where Figure 3The area corresponding to "Inspection Record" is the inspection record area. When the user wants to perform abnormal inspection point detection on a completed main inspection task, the user can select the main inspection task in the inspection record area. When the main inspection task is selected, the selected main inspection task is determined as the first target task, and the abnormal inspection point detection is performed on the first target task, thereby obtaining at least one abnormal inspection point of the first target task, so as to re-check at least one abnormal inspection point in the subsequent steps.

[0052] The selection method of the above-mentioned completed main inspection task may include but is not limited to clicking; in the above-mentioned inspection record area, the expression form of the above-mentioned completed main inspection task may be clicking a confirmation button, or other scrolling / sliding selectors, drop-down menu selection units, etc., but is not limited to this.

[0053] The above-mentioned first target task is mainly used to indicate the main inspection task that needs to be performed and completed for abnormal inspection point detection, wherein the abnormal inspection point is used to represent the inspection point where the preset violation behavior exists. The preset violation behavior can be set according to the actual situation, and the embodiment of the present application does not make specific restrictions on this. For example, the preset violation behavior can be an urban construction violation behavior, which can include illegal parking of motor vehicles, illegal parking of non-motor vehicles, illegal construction, dust on the construction site, illegal stacking of materials, occupying the road for business, etc.

[0054] In the above step S105, after completing the abnormal inspection point detection for the first target task, the user can obtain at least one sub-inspection task by clicking the first new control and control the drone to execute at least one sub-inspection task to realize the re-inspection of the abnormal inspection point. Figure 3 In the inspection management interface shown, "New Work Order" indicates the first new control. The user clicks the first new control to trigger the first new control. When the first new control is triggered, the following will be displayed: Figure 4 In the first new window shown, the user can obtain at least one sub-inspection task by interacting with the first new window, and control the drone to execute at least one sub-inspection task, so that the drone inspects abnormal inspection points.

[0055] The first newly created window is mainly used to obtain and execute sub-inspection tasks, wherein the sub-inspection tasks are mainly used to control the UAV to inspect abnormal inspection points.

[0056] The number of drones and the number of abnormal inspection points corresponding to the above sub-inspection tasks and the number of inspections of abnormal inspection points can be set according to actual conditions, and the embodiments of the present application do not specifically limit this. For example, the above sub-inspection tasks can be used to control a drone to inspect an abnormal inspection point at least once.

[0057] In the above step S106, when the sub-inspection task is completed, the inspection report of the sub-inspection task is obtained, and the abnormal type of the abnormal inspection point corresponding to the sub-inspection task is determined and marked according to the inspection report.

[0058] The abnormal types of the above-mentioned abnormal inspection points correspond to the above-mentioned preset violations. For example, the above-mentioned abnormal types may include any one of the abnormal illegal parking of motor vehicles, the abnormal illegal parking of non-motor vehicles, the abnormal illegal construction of buildings, dust on construction sites, the abnormal illegal stacking of materials and the abnormal occupying of the road for business.

[0059] In some implementations, in order to facilitate re-inspection of abnormal inspection points through sub-inspection tasks, refer to Figure 4 The first newly added window may include a first parameter setting sub-area, a first map display sub-area, a first search sub-area and a first publishing control. Figure 4 "Work Order Release" in the figure indicates the first release control, the area above the first release control and displaying the map is the first map display sub-area, the first search sub-area is located in the upper left corner of the first map display sub-area, and the first parameter setting sub-area is located on the left side of the first map display sub-area; the above-mentioned acquisition and execution of the sub-inspection task through the first new window may include:

[0060] In response to an input instruction in the first search sub-area, acquiring an abnormal inspection point corresponding to the input instruction in the first search sub-area and displaying it in the first map display sub-area;

[0061] In response to an input instruction in the first parameter setting sub-area, obtaining a parameter corresponding to the input instruction in the first parameter setting sub-area as a task parameter of the sub-inspection task and displaying the parameter in the first parameter setting sub-area;

[0062] In response to the trigger instruction of the first release control, the sub-inspection task is obtained and executed according to the abnormal inspection point corresponding to the input instruction of the first search sub-area and the task parameters of the sub-inspection task.

[0063] In this embodiment, when displaying Figure 4After the first newly added window is shown, when the user wants to select a certain abnormal inspection point, the user can enter the relevant information of the abnormal inspection point to be searched in the first search sub-area, such as the address of the abnormal inspection point, etc. The first search sub-area will synchronously display the information entered by the user, and the first map display sub-area will synchronously display the corresponding abnormal inspection point; then, when the user wants to edit the task parameters of the sub-inspection task, the user can enter the task parameters of the sub-inspection task in the first parameter setting sub-area, and the first parameter setting sub-area will synchronously display the parameters entered by the user; after the user selects the abnormal inspection point and edits the task parameters of the sub-inspection task, the user can determine the task parameters of the selected abnormal inspection point and the edited sub-inspection task by clicking the first release control. When the first release control is triggered, the sub-inspection task will be generated and the drone will be controlled to execute the sub-inspection task according to the abnormal inspection point selected by the user and the task parameters of the edited sub-inspection task, thereby realizing the re-inspection of the abnormal inspection point. In this way, corresponding inspection tasks are added for the abnormal inspection points detected in the previous inspection tasks, and re-inspection of the abnormal inspection points is achieved, which effectively improves the accuracy of drone inspections and achieves better inspection results. In addition, interactive display technology is used to add sub-inspection tasks, reducing the user's learning cost and professional knowledge requirements for drone inspections, reducing the management difficulty of drone inspections, and improving the management efficiency and accuracy of drone inspections, making them intuitive, transparent and traceable.

[0064] The first search sub-area is mainly used to obtain and display relevant information of abnormal inspection points.

[0065] The related information of the abnormal inspection point may include the address of the abnormal inspection point, but is not limited thereto.

[0066] The first map display sub-area is mainly used to display the abnormal inspection point corresponding to the input instruction of the first search sub-area. The input instruction of the first search sub-area can be understood as the relevant information of the abnormal inspection point.

[0067] The first parameter setting sub-area is mainly used to obtain and display the task parameters of the sub-inspection task.

[0068] The task parameters of the above-mentioned sub-inspection task may include at least one of the name of the sub-inspection task, abnormal inspection point information, task type, task purpose, priority, inspection time and re-inspection information, but are not limited thereto.

[0069] The above re-inspection information is used to indicate whether to generate corresponding clue data, but is not limited to this. The above clue data can be understood as detailed data of abnormal inspection points.

[0070] In one example, referring to Figure 4In the above-mentioned first parameter setting sub-area, obtain the name of the sub-inspection task through the area corresponding to the "Work Order Name", obtain the abnormal inspection point information of the sub-inspection task through the area corresponding to the "Affiliated Unit", obtain the task type of the sub-inspection task through the area corresponding to the "Work Order Type", obtain the task purpose of the sub-inspection task through the area corresponding to the "Work Order Purpose", obtain the priority of the sub-inspection task through the area corresponding to the "Priority Level", obtain the inspection time of the sub-inspection task through the area corresponding to the "Inspection Cycle", and obtain the re-inspection information of the sub-inspection task through the area corresponding to the "Whether to Generate Corresponding Clue Data".

[0071] The first release control is used to generate and execute a sub-inspection task according to the abnormal inspection point and the task parameters of the sub-inspection task corresponding to the input instruction of the first search sub-area when it is triggered, and display the following Figure 3 The inspection management interface shown.

[0072] The above-mentioned execution of the sub-inspection task may include controlling the drone to fly to the abnormal inspection point of the sub-inspection task according to a preset inspection path, and collecting images of the abnormal inspection point, and controlling the drone to return after completing the image collection.

[0073] The first newly added window may further include a first cancel control, which is used to display the following when triggered: Figure 3 The inspection management interface shown.

[0074] In some implementations, to facilitate obtaining and executing the main inspection task, refer to Figure 2 , the task management interface includes a second new control, Figure 2 "New Task Work Order" in the above refers to the second new control; the above-mentioned acquisition and execution of at least one main inspection task through the task management interface may include:

[0075] In response to a trigger instruction for a second newly created control, displaying a second newly added window, the second newly added window may include a second map display sub-area, a second search sub-area, a second parameter setting sub-area and a second publishing control;

[0076] In response to an input instruction of the second search sub-area, acquiring a map area corresponding to the input instruction of the second search sub-area as the area to be inspected and displaying it in the second map display sub-area;

[0077] In response to an input instruction in the second parameter setting sub-area, obtaining a parameter corresponding to the input instruction in the second parameter setting sub-area as a task parameter of the main inspection task and displaying the parameter in the second parameter setting sub-area;

[0078] In response to the trigger instruction of the second release control, the main inspection task is obtained and executed according to the area to be inspected and the task parameters of the main inspection task.

[0079] In this embodiment, when displaying Figure 2 After the task management interface is shown, the user can click the second new control to add at least one main inspection task and control the drone to perform at least one main inspection task. Specifically, the user clicks the second new control to trigger the second new control. When the second new control is triggered, a second new window will be displayed. The second new window is the same as the first new window. After the second newly added window is displayed, when the user wants to select a certain area to be inspected, the user can enter the relevant information of the area to be inspected to be searched in the second search sub-area, such as the address of the area to be inspected, etc. The second search sub-area will synchronously display the information entered by the user, and the second map display sub-area will synchronously display the corresponding area to be inspected; then, when the user wants to edit the task parameters of the main inspection task, the user can enter the task parameters of the main inspection task in the second parameter setting sub-area, and the second parameter setting sub-area will synchronously display the parameters entered by the user; after the user selects the area to be inspected and edits the task parameters of the main inspection task, the user can determine the selected area to be inspected and the task parameters of the edited main inspection task by clicking the second release control. When the second release control is triggered, the main inspection task will be generated and the drone will be controlled to execute the main inspection task according to the area to be inspected selected by the user and the task parameters of the edited main inspection task, thereby realizing the inspection of the area to be inspected. In this way, interactive display technology is used to realize inspection control of the area to be inspected, reduce the user's learning cost and professional knowledge requirements for drone inspections, improve the management efficiency and accuracy of drone inspections, and achieve intuitive, transparent and traceable results.

[0080] The second search sub-area is mainly used to obtain and display relevant information of the area to be inspected.

[0081] The relevant information of the above-mentioned area to be inspected may include the number and address of the area to be inspected, but is not limited thereto.

[0082] The second map display sub-area is mainly used to display the area to be inspected corresponding to the input instruction of the second search sub-area. The input instruction of the second search sub-area can be understood as the relevant information of the area to be inspected.

[0083] The second parameter setting sub-area is mainly used to obtain and display the task parameters of the main inspection task.

[0084] The task parameters of the above-mentioned main inspection task may include at least one of the name of the main inspection task, information of the area to be inspected, task type, task purpose, priority and inspection time, but are not limited thereto.

[0085] The second release control is used to generate and execute the main inspection task according to the inspection area corresponding to the input instruction of the second search sub-area and the task parameters of the main inspection task when it is triggered, and display the following information: Figure 2 The task management interface shown.

[0086] The above-mentioned execution of the main inspection task may include controlling the drone to fly to the area to be inspected of the main inspection task according to a preset inspection path, and collecting images of the area to be inspected, and controlling the drone to return after completing the image collection.

[0087] The second newly added window may further include a second cancel control, which is used to display the following when triggered: Figure 2 The task management interface shown.

[0088] In some implementations, to facilitate detection of abnormal inspection points, refer to Figure 3 The inspection management interface may further include a grid map area, the grid map area may include a third map display sub-area, the third map display sub-area is mainly used to display the area to be inspected of at least one main inspection task, Figure 3 The area corresponding to the map displayed in is the third map display sub-area; the above-mentioned abnormal point detection for the first target task to obtain at least one abnormal inspection point of the first target task may include:

[0089] Obtaining the drone inspection path of the first target task and displaying it in the third map display sub-area, and obtaining the inspection report of the first target task, the drone inspection path consisting of a plurality of inspection points;

[0090] In response to a selection instruction for any inspection point, obtaining inspection point information corresponding to the selection instruction for the inspection point from the inspection report of the first target task and displaying the information in a first pop-up window in the third map display sub-area;

[0091] According to the inspection report of the first target task, an abnormality detection is performed on each inspection point in the inspection path of the drone of the first target task to obtain at least one abnormal inspection point existing in the area to be inspected of the first target task.

[0092] In this embodiment, when displaying Figure 3 After the inspection management interface shown, the UAV inspection path of the first target task is first obtained and the path is displayed in the third map display sub-area. The UAV inspection path consists of several inspection points, such as Figure 5As shown, at the same time, the inspection report of the first target task is obtained; then, when the user wants to query the inspection point information of a certain inspection point in the inspection path of the drone of the first target task, the user can select the inspection point. When the inspection point is selected, the inspection point information of the inspection point is obtained from the inspection report of the first target task and displayed in the first pop-up window of the third map display sub-area, as shown Figure 6 As shown; then, according to the inspection report of the first target task, each inspection point in the drone inspection path of the first target task is detected for abnormalities, and at least one abnormal inspection point existing in the area to be inspected for the first target task is obtained and marked in the third map display sub-area, thereby realizing the detection of abnormal inspection points, so as to facilitate the subsequent re-inspection of abnormal inspection points. In this way, the interactive display technology is used to obtain the execution status of the main inspection task, including the drone inspection path and inspection report, so that more and more comprehensive drone inspection detail data can be obtained, which is conducive to reducing the user's learning cost and professional knowledge requirements for drone inspection, reducing the management difficulty of drone inspection and improving the management efficiency and management accuracy of drone inspection, realizing intuitive, transparent and traceable, what you see is what you get, and realizing the detection of abnormal inspection points on the drone inspection path of the main inspection task, so as to facilitate the re-inspection of abnormal inspection points in subsequent steps, which is conducive to improving the inspection accuracy.

[0093] The above-mentioned drone inspection path is used to characterize the flight path of the drone when the drone inspects the area to be inspected, and it is composed of a number of inspection points, wherein the inspection points are used to characterize the locations where the drone stops and collects images when the drone inspects the area to be inspected.

[0094] The selection method of the above-mentioned inspection point may include but is not limited to clicking; in the above-mentioned third map display sub-area, the above-mentioned inspection point may be expressed by clicking a confirmation button, or other scrolling / sliding selectors, drop-down menu selection units, etc., but is not limited to this.

[0095] The above inspection point information is used to represent information associated with the inspection point, which may be an image, video, etc. For example, Figure 6 As shown, the above inspection point information is image information and is displayed in the first pop-up window of the third map display sub-area.

[0096] The above-mentioned abnormality detection on each inspection point in the drone inspection path of the first target task according to the inspection report of the first target task may include responding to a trigger instruction of the abnormality detection control, and performing abnormality detection on each inspection point in the drone inspection path of the first target task according to the inspection report of the first target task.

[0097] The first pop-up window may include a first close control, and the first close control is used to close the first pop-up window when triggered.

[0098] In some embodiments, to facilitate the management of multiple drones for performing main inspection tasks or sub-inspection tasks, such as Figure 3 As shown, the third map display sub-area is also used to display at least one drone base station, and the drone base station can be displayed in the third map display sub-area in the form of an icon; the method may further include the following steps:

[0099] During the period when at least one drone performs a main inspection task or a sub-inspection task, in response to a selection instruction for any drone base station, determining the drone base station corresponding to the selection instruction for the drone base station as a target base station, obtaining base station information of the target base station and displaying it in a second pop-up window in the third map display sub-area, the base station information is used to characterize the state of the target base station, and the second pop-up window includes an opening control control;

[0100] In response to a trigger instruction for opening a control control, an inspection status window corresponding to the trigger instruction for opening the control control is displayed, the inspection status window comprising a status display area and a return control, the status display area being used to display at least one of the status of the drone belonging to the target base station, the status of the inspection task performed by the drone belonging to the target base station, and the inspection image taken by the drone belonging to the target base station at the current moment;

[0101] In response to the trigger instruction of the return control, the inspection management interface is displayed.

[0102] In this embodiment, if Figure 3 As shown, the drone base station is displayed in the third map display sub-area as an icon; during the period when at least one drone performs a main inspection task or a sub-inspection task, when the user wants to view the inspection status of a certain drone base station, the user can select the drone base station. When the drone base station is selected, the drone base station will be determined as the target base station, and the base station information of the target base station will be obtained. The base station information of the target base station will be displayed in the second pop-up window of the third map display sub-area, as shown in FIG. Figure 7 As shown, the user can view the details of the target base station; then, when the user wants to learn more about the inspection status of the drone belonging to the drone base station, the user can click the open control control of the second pop-up window. When the open control control is triggered, the inspection status window is displayed, such as Figure 8 As shown, the inspection status window includes a status display area and a return control. Figure 8 The "Return" button in the upper left corner is the return control. Users can view the inspection status of the drones belonging to the drone base station through the status display area. When the user has finished viewing, the user can click the return control to return to the previous page. Figure 3 The inspection management interface shown in the figure shows the following when the return control is triggered: Figure 3The inspection management interface shown. In this way, the interactive display technology is used to obtain and manage the situation of the drone base station and the situation of the drones affiliated to the drone base station performing the main inspection task or sub-inspection task, so as to realize the batch management of multiple drones used to perform the main inspection task or sub-inspection task, and obtain more and more comprehensive drone inspection detail data, which is conducive to reducing the user's learning cost and professional knowledge requirements for drone inspection, reducing the management difficulty of drone inspection and improving the management efficiency and accuracy of drone inspection, so as to achieve intuitive, transparent and traceable, and what you see is what you get.

[0103] The base station information of the target base station is used to represent the state of the target base station.

[0104] The base station information of the above-mentioned target base station may include the target base station image, target base station status, drone platform status and drone cabin door status at the current moment, wherein the target base station status is used to characterize the working status of the drone belonging to the target base station, such as executing a mission; the drone platform status is used to indicate the flight status of the drone belonging to the target base station, such as landing or taking off; the drone cabin door status is used to indicate the cabin door status of the target base station, such as closed or open.

[0105] The above-mentioned status display area is mainly used to display at least one of the status of the drone belonging to the target base station, the status of the inspection task performed by the drone belonging to the target base station, and the inspection image taken by the drone belonging to the target base station at the current moment.

[0106] The status of the above-mentioned drone belonging to the target base station may include the door status, platform status, cabin temperature, centering status and basic flight parameters of the drone belonging to the target base station, but is not limited to this, wherein the centering status is used to characterize the landing status of the drone belonging to the target base station.

[0107] The above basic flight parameters may include battery power, nose direction, gimbal angle, horizontal speed, vertical speed, flight altitude, uplink signal status, downlink signal status, number of satellites, flight attitude, magnetic compass status, signal interference speed and image transmission signal status, but are not limited to these.

[0108] The inspection task status performed by the above-mentioned drone belonging to the target base station may include the inspection points that have been completed, the inspection points that are being executed, the inspection points that have not been executed, the ratio of the number of completed inspection points to the total number of inspection points, and the task execution time, etc. in the inspection task performed by the drone belonging to the target base station, but is not limited to this.

[0109] In one example, if Figure 8As shown, the status display area may include a first UAV status area, a second UAV status area, an image display area and a patrol point status area. The first UAV status area is used to display the door status, platform status, cabin temperature and centering status of the UAV belonging to the target base station. The second UAV status area is used to display the basic flight parameters of the UAV belonging to the target base station. The image display area is used to display the inspection image taken by the UAV belonging to the target base station at the current moment. The patrol point status area is used to display the status of the UAV belonging to the target base station.

[0110] In another example, Figure 8 As shown, the image display area may also include a flight termination control, which is used to control the drone to return to its own drone base station when triggered.

[0111] In another example, Figure 8 As shown, the above-mentioned image display area also includes an image switching control. Figure 8 The "monitoring mode" means an image switching control, which is used to display the target base station image at the current moment in the image display area when it is triggered.

[0112] The second pop-up window may further include a second close control, and the second close control is used to close the second pop-up window when triggered.

[0113] In some implementations, in order to improve the richness of the images taken by the drone, refer to Figure 8 The above inspection status window may also include an image type setting control. Figure 8 The "photographing type" is an image type setting control; after the inspection status window corresponding to the trigger instruction of the display and opening control control is displayed, the method may further include the following steps:

[0114] In response to a trigger instruction for an image type setting control, an image type setting window is displayed, wherein the image type setting window includes a wide-angle type control, a zoom type control, a thermal infrared type control, and a confirmation control;

[0115] In response to a trigger instruction for at least one of a wide-angle type control, a zoom type control, and a thermal infrared type control and a trigger instruction for a determination control, the format of the inspection image taken by the drone belonging to the target base station is determined to be at least one of a wide-angle format, a zoom format, and a thermal infrared format.

[0116] In this embodiment, when the inspection status window is displayed, if the user wants to obtain images of different formats, the user can click the image type setting control to trigger the image type setting control. When the image type setting control is triggered, the image type setting window will be displayed, such as Figure 8As shown, the image type setting window may include a wide-angle type control, a zoom type control, a thermal infrared type control, and a determination control. After that, the user can click at least one of the wide-angle type control, the zoom type control, and the thermal infrared type control according to the actual format requirements, and click the determination control to trigger at least one of the wide-angle type control, the zoom type control, and the thermal infrared type control and the determination control. When at least one of the wide-angle type control, the zoom type control, and the thermal infrared type control and the determination control are triggered, the format of the inspection image taken by the drone belonging to the target base station is determined to be at least one of the wide-angle format, the zoom format, and the thermal infrared format. In this way, the inspection image format taken by the drone is diversified, which not only enriches the expression form of the inspection image, but also expands the application scenarios of drone inspection. The wide-angle format can capture a wider field of view and show more and more comprehensive inspection details; the zoom format can capture inspection details at different distances and improve the inspection effect; the thermal infrared format can expand the drone inspection to other applications such as night vision, fire detection, and building energy-saving analysis; thereby improving the usability of drone inspection.

[0117] The above-mentioned determination of the format of the inspection image taken by the drone belonging to the target base station may include determining that the format of the inspection image taken by the drone belonging to the target base station is a format corresponding to the trigger instruction of at least one of the wide-angle type control, the zoom type control and the thermal infrared type control.

[0118] For example, when the user clicks the wide-angle type control and the confirm control, the format of the inspection image taken by the drone belonging to the target base station is determined to be a wide-angle format; for another example, when the user clicks the wide-angle type control, the zoom type control and the confirm control, the format of the inspection image taken by the drone belonging to the target base station is determined to be a wide-angle format and a zoom format.

[0119] The above-mentioned image type setting window may further include a third cancel control, and the third cancel control is used to close the image type setting window when triggered.

[0120] In some implementations, to facilitate viewing and managing at least one sub-inspection task being executed and at least one main inspection task being executed, refer to Figure 3 The above-mentioned inspection management interface may also include a first task display sub-area, which is used to display at least one sub-inspection task being executed and at least one main inspection task being executed, so that users can view the execution status of the main inspection task and the sub-inspection task, thereby improving the management efficiency and accuracy of drone inspections.

[0121] In some implementations, in order to facilitate hierarchical management of multiple areas to be inspected, refer to Figure 3The above inspection management interface may further include a business layer area, and the business layer area may include at least one first-level selected area. Figure 3 The area corresponding to the "business layer" is the business layer area; the above method may also include the following steps:

[0122] In response to a selection instruction for at least one primary selected area, at least one secondary selected area corresponding to the selection instruction for the primary selected area is displayed in the business layer area, and an area to be inspected corresponding to the selection instruction for the primary selected area is displayed in the third map display sub-area;

[0123] In response to a selection instruction for at least one secondary selected area, an area to be inspected corresponding to the selection instruction for the secondary selected area is displayed in the third map display sub-area.

[0124] In this embodiment, when displaying Figure 3 After the inspection management interface shown, a business layer area is set in the inspection management interface, and the business layer area includes at least one first-level selected area and displays at least one first-level selected area. If the user wants to manage multiple areas to be inspected, the user can click at least one first-level selected area to select at least one first-level selected area. When at least one first-level selected area is selected, at least one second-level selected area corresponding to the selected instruction of the first-level selected area is displayed in the business layer area, and the area to be inspected corresponding to the selected instruction of the first-level selected area is displayed in the third map display sub-area; if the user wants to further manage more subdivided areas to be inspected, the user can click at least one second-level selected area to select at least one second-level selected area. When at least one second-level selected area is selected, the area to be inspected corresponding to the selected instruction of the second-level selected area is displayed in the third map display sub-area. In this way, through the hierarchical management of different areas to be inspected, users can manage multiple areas to be inspected more intuitively and conveniently, which not only improves the management efficiency and management accuracy of the areas to be inspected, but also improves the data acquisition efficiency of the areas to be inspected, optimizes the display effect of the areas to be inspected, and thus improves the management accuracy and management efficiency of drone inspections, and achieves what you see is what you get.

[0125] The above-mentioned secondary selected area is obtained by subdividing the above-mentioned primary selected area. For example, if the primary selected area is traffic, then the corresponding secondary selected area is road inspection; for another example, if the primary selected area is traffic police, then the corresponding secondary selected area is emergency rescue and traffic diversion.

[0126] In some implementations, in order to facilitate the management of multiple areas to be inspected and the inspection status of each area to be inspected and improve management efficiency, the grid map area further includes a grid control; the method may include the following steps:

[0127] In response to a trigger instruction for the grid control, gridding the third map display sub-area to obtain at least one area grid;

[0128] In response to a selection instruction for any regional grid, determining the regional grid corresponding to the selection instruction for the regional grid as a target grid, obtaining grid inspection information of the target grid and displaying it in a third pop-up window in a third map display sub-area, wherein the grid inspection information is used to characterize the inspection status of the target grid, and the third pop-up window includes an entry grid control;

[0129] In response to a trigger instruction for entering a grid control, displaying a first grid details window corresponding to the trigger instruction for entering the grid control, the first grid details window including a fourth map display sub-area, the fourth map display sub-area being used to display a target grid and its grid inspection information, the target grid including at least one sub-grid;

[0130] In response to a trigger instruction for any sub-grid, a second grid details window corresponding to the trigger instruction of the sub-grid is displayed, and the second grid details window includes a fifth map display sub-area and a grid comparison area. The fifth map display sub-area is used to display the sub-grid and its grid inspection information, and the grid comparison area is used to display the sub-grid at at least one historical moment. The grid inspection information of the sub-grid is used to characterize the inspection status of the sub-grid.

[0131] In this embodiment, when the user wants to grid the map, first, the user can click the grid control to trigger the grid control. When the grid control is triggered, the third map display sub-area is gridded to obtain at least one regional grid, such as Figure 3 As shown, it is intended to perform data analysis and management more accurately; then, if the user wants to view the brief information of a certain regional grid, the user can click the selection instruction of the regional grid. When the regional grid is selected, the regional grid is determined as the target grid, and the grid inspection information of the target grid is obtained and displayed in the third pop-up window of the third map display sub-area, such as Figure 3 As shown, the third pop-up window may include an enter grid control; thereafter, if the user wants to further view detailed information of the target grid, the user may click the enter grid control to trigger the enter grid control. When the enter grid control is triggered, the first grid details window corresponding to the triggering instruction of the enter grid control will be displayed, such as Fig. 9 As shown, the first grid details window may include a fourth map display sub-area, and the fourth map display sub-area is used to display the target grid and its grid inspection information, and the target grid includes at least one sub-grid; after the first grid details window is displayed, if the user wants to further view the detailed information of a sub-grid, the user can click on the sub-grid to be viewed, and when the sub-grid is triggered, the second grid details window corresponding to the sub-grid will be displayed, such as Fig.10As shown, the second grid details window includes a fifth map display sub-area and a grid comparison area, the fifth map display sub-area is used to display the sub-grid and its grid inspection information, and the grid comparison area is used to display the sub-grid at at least one historical moment. In this way, by gridding the third map display sub-area, it is helpful to refine the data analysis and management of each regional grid, make the spatial information of the drone inspection more intuitive and easy to understand, enhance the information visualization effect of the drone inspection, and improve the management efficiency and management accuracy of the drone inspection.

[0132] The grid inspection information of the target grid is used to characterize the inspection situation of the target grid, such as the discovery clues and the number of inspections of the target grid. The discovery clues refer to the number of abnormal inspection points, but are not limited to this.

[0133] The third pop-up window may further include a third close control, and the third close control is used to close the third pop-up window when triggered.

[0134] The first grid details window may include a fourth map display sub-area, a fourth close control and a clue display control, but is not limited thereto, wherein the fourth map display sub-area is used to display the target grid and its grid inspection information, and the fourth close control is used to close the first grid details window and display the following when triggered. Figure 3 In the inspection management interface shown, the clue display control is used to display abnormal inspection points existing in the target grid in the fourth map display sub-area when triggered.

[0135] In one example, if Fig. 9 As shown, Fig. 9 "Exit Grid" represents the fourth close control. Clicking the fourth close control can close the first grid details window; the area corresponding to "Show" is the clue display control. Clicking the display control can display the abnormal inspection points in the target grid in the fourth map display sub-area.

[0136] The second grid details window may include a fifth map display sub-area, a grid comparison area, and a fifth close control. The fifth map display sub-area is used to display the sub-grid and its grid inspection information. The grid comparison area is used to display the sub-grid at at least one historical moment. The fifth close control is used to close the second grid details window and display the following information when triggered. Figure 3 The inspection management interface shown.

[0137] The grid inspection information of the above-mentioned sub-grid is used to characterize the inspection status of the sub-grid, which can be set according to actual conditions, and this embodiment does not make any specific limitation to this.

[0138] The sub-grid and the target grid may be in image form, but are not limited thereto.

[0139] The triggering method of the above sub-grid may include but is not limited to clicking. The above sub-grid may be a click confirmation button, or other scrolling / sliding selectors, drop-down menu selection units, etc., but is not limited to this.

[0140] The selection method of the above-mentioned area grid can be clicked. In the above-mentioned third map display sub-area, the above-mentioned area grid can be a click confirmation button, or other scrolling / sliding selectors, drop-down menu selection units, etc., but it is not limited to this.

[0141] In some implementations, to facilitate traversal of different subgrids and improve the efficiency of data acquisition, refer to Fig.10 , the second grid details window further includes a first direction control, a second direction control, a third direction control and a fourth direction control; after the second grid details window corresponding to the trigger instruction of the sub-grid is displayed, the method may further include the following steps:

[0142] In response to a trigger instruction for the first direction control, displaying a subgrid located in the first direction of the current subgrid in the fifth map display sub-area;

[0143] Alternatively, in response to a trigger instruction for the second direction control, a subgrid located in the second direction of the current subgrid is displayed in the fifth map display sub-area;

[0144] Alternatively, in response to a trigger instruction for a third direction control, a subgrid located in a third direction of the current subgrid is displayed in the fifth map display sub-area;

[0145] Alternatively, in response to a trigger instruction for the fourth direction control, a sub-grid located in the fourth direction of the current sub-grid is displayed in the fifth map display sub-area.

[0146] In this embodiment, when displaying Fig.10After the second grid details window shown, if the user wants to view the sub-grid located in the first direction of the current sub-grid, the user can click the first direction control. When the first direction control is triggered, the fifth map display sub-area will display the sub-grid located in the first direction of the current sub-grid; if the user wants to view the sub-grid located in the second direction of the current sub-grid, the user can click the second direction control. When the second direction control is triggered, the fifth map display sub-area will display the sub-grid located in the second direction of the current sub-grid; if the user wants to view the sub-grid located in the third direction of the current sub-grid, the user can click the third direction control. When the third direction control is triggered, the fifth map display sub-area will display the sub-grid located in the third direction of the current sub-grid; if the user wants to view the sub-grid located in the fourth direction of the current sub-grid, the user can click the fourth direction control. When the fourth direction control is triggered, the fifth map display sub-area will display the sub-grid located in the fourth direction of the current sub-grid. In this way, the data acquisition efficiency is improved by displaying direction controls representing different directions in the second grid details window. When the user wants to view other sub-grids, the user only needs to interact with the direction controls in the corresponding directions to obtain the sub-grids they want to view, effectively reducing the number of page jumps and improving the data acquisition efficiency of the sub-grids, thereby effectively improving the efficiency and accuracy of drone inspection management.

[0147] The first direction, the second direction, the third direction and the fourth direction can be set according to actual conditions, and this embodiment does not specifically limit this. For example, the first direction is upward, the second direction is downward, the third direction is left, and the fourth direction is right.

[0148] In some embodiments, reference Figure 2 The task management interface may further include a task list area, a task data control, an inspection report control, and a basic information control, wherein the task list area may include a second task display sub-area, the second task display sub-area is mainly used to display at least one completed inspection task, the inspection task includes a main inspection task or a sub-inspection task, Figure 2 The "task data" is the task data control, the "inspection report" is the inspection report control, the "basic information" is the basic information control, and the area corresponding to the "task work order" is the task list area; the above method may also include the following steps:

[0149] In the case where at least one inspection task is completed, in response to a selection instruction for any inspection task that has been completed, determining the inspection task corresponding to the selection instruction for the inspection task that has been completed as the second target task;

[0150] In response to a trigger instruction to the task data control, acquiring at least one inspection point image of the second target task and displaying it on the task data sub-interface;

[0151] In response to a trigger instruction for the inspection report control, an inspection report of the second target task is obtained according to at least one inspection point image of the second target task and displayed on the inspection report sub-interface, the inspection report of the second target task includes an inspection report of the main inspection task or an inspection report of the sub-inspection task, the inspection report of the main inspection task is used to characterize whether there is at least one abnormal inspection point in the area to be inspected, and the inspection report of the sub-inspection task is used to indicate the abnormal type of at least one abnormal inspection point;

[0152] In response to a trigger instruction for the basic information control, a basic information sub-interface is displayed, the basic information sub-interface includes an acceptance control and a basic information display sub-area, and the basic information display sub-area is used to display basic information of the second target task;

[0153] In response to a trigger instruction for the acceptance control, an acceptance window is displayed, wherein the acceptance window includes an acceptance pass control and a confirmation control;

[0154] In response to the selection instruction of the acceptance pass control and the trigger instruction of the confirmation control, the second target task is ended and the inspection report of the second target task is output.

[0155] In this embodiment, when displaying Figure 2 After the task management interface is shown, if at least one inspection task is completed, the completed inspection task will be displayed in the second task display sub-area of ​​the task list area, such as Figure 2 When the user wants to view the inspection result data (e.g. inspection point image) of a certain inspection task, the user can select the inspection task in the second task display sub-area. When the inspection task is selected, the inspection task is determined as the second target task. The user can click the task data control. When the task data control is triggered, at least one inspection point image of the second target task will be obtained and displayed in the task data sub-interface, as shown in FIG. Figure 2 As shown; afterwards, if the user wants to view the inspection report of the second target task, the user can click the inspection report control. When the inspection report control is triggered, the inspection report of the second target task will be obtained according to at least one inspection point image of the second target task and displayed in the inspection report sub-interface, such as Fig.11As shown; Finally, if the user wants to view the basic information of the second target task and accept the inspection result data of the second target task, the user can click the basic information control to realize information viewing and task acceptance. Specifically, the user clicks the basic information control. When the basic information control is triggered, it enters the basic information sub-interface. The basic information sub-interface includes an acceptance control and a basic information display sub-area. The basic information display sub-area is used to display the basic information of the second target task. Then the user can click the acceptance control to accept it. When the acceptance control is triggered, the acceptance window will be displayed, as shown in the figure below. Fig.12 As shown, the acceptance window may include an acceptance control and a confirmation control, and then the user may click the acceptance control and the confirmation control to confirm the acceptance of the second target task. When the acceptance control and the confirmation control are triggered, the second target task will be terminated and the inspection report of the second target task will be output, and the following will be displayed at the same time: Figure 2 The task management interface shown. In this way, when the sub-inspection task or the main inspection task is completed, the inspection result data of the main inspection task or the sub-inspection task, including the inspection report and the inspection point image, can be viewed through the interactive display technology, and the acceptance of the main inspection task or the sub-inspection task can be completed through the interactive display technology. This not only provides users with more and more detailed inspection result data, facilitates users to quickly understand the inspection situation, improves the convenience of obtaining inspection result data, and realizes intuitive, transparent and traceable. It also reduces the user's learning cost and professional knowledge requirements for drone inspection, thereby improving the management accuracy and efficiency of drone inspection.

[0156] The above-mentioned completed inspection tasks can be selected by clicking; in the above-mentioned task list area, the above-mentioned completed inspection tasks can be selected by clicking a confirmation button, or other scrolling / sliding selectors, drop-down menu selection units, etc., but are not limited to this.

[0157] The inspection report of the second target task may include the inspection report of the main inspection task or the inspection report of the sub-inspection task. The inspection report of the main inspection task is used to characterize whether there is at least one abnormal inspection point in the area to be inspected, and the inspection report of the sub-inspection task is used to indicate the abnormal type of at least one abnormal inspection point.

[0158] The basic information of the above-mentioned second target task may include the number of the second target task, the affiliated unit, the task type, the task purpose, the creator and his / her contact information, the priority, the inspection cycle, the inspection frequency and the review information, etc., but is not limited to this.

[0159] In some implementations, the above-mentioned determining the abnormal type of the abnormal inspection point according to the inspection report of the sub-inspection task and marking it may include:

[0160] Obtain the inspection report of the sub-inspection task, and determine the abnormal type of the abnormal inspection point through the inspection report of the sub-inspection task;

[0161] The abnormal type of the abnormal inspection point is marked in a preset form in the third map display sub-area.

[0162] In this embodiment, in order to more intuitively reflect the abnormal type of the abnormal inspection point, first, the inspection report of the sub-inspection task is obtained, and the inspection report of the sub-inspection task is used to indicate the abnormal type of at least one abnormal inspection point, and the abnormal type of the abnormal inspection point is determined by the inspection report of the sub-inspection task; then, the abnormal type of the abnormal inspection point is marked in a preset form in the third map display sub-area. In this way, by marking the abnormal type, the user can more intuitively understand the abnormal type of the abnormal inspection point, which is conducive to the management of drone inspections.

[0163] The above preset form can be set according to actual conditions, and this embodiment does not make any specific limitation to this.

[0164] It should be noted that the triggering method of each control in the above implementation manner may include but is not limited to clicking. Each control may be a click-confirm button, or other scrolling / sliding selectors, drop-down menu selection units, etc., but is not limited to this.

[0165] In addition, the embodiment of the present application also proposes a drone inspection interactive control device, which may include:

[0166] A display module, used to display the main interface of the drone inspection, which includes a first main control and a second main control;

[0167] A first interactive processing module, configured to display a task management interface in response to a trigger instruction to the first main control, and to obtain and execute at least one main inspection task through the task management interface, wherein the main inspection task is used to control the drone to inspect the area to be inspected of the main inspection task;

[0168] A second interactive processing module, configured to display an inspection management interface in response to a trigger instruction to the second main control, wherein the inspection management interface includes an inspection record area and a first new control, wherein the inspection record area is configured to display at least one main inspection task that has been executed;

[0169] A third interactive processing module is used to respond to the selected instruction of any completed main inspection task, determine the main inspection task corresponding to the selected instruction of the completed main inspection task as the first target task, and perform abnormal point detection on the first target task to obtain at least one abnormal inspection point of the first target task, and the abnormal inspection point is used to characterize the inspection point where the preset violation behavior exists;

[0170] A fourth interactive processing module is used to respond to a trigger instruction for the first newly created control, display the first newly created window, obtain and execute a sub-inspection task through the first newly created window, and the sub-inspection task is used to control the drone to inspect the abnormal inspection point;

[0171] The fifth interactive processing module is used to determine and mark the abnormal type of the abnormal inspection point according to the inspection report of the sub-inspection task when the sub-inspection task is completed.

[0172] The contents of the above method embodiments are all applicable to the present device embodiments. The functions specifically implemented by the present device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0173] Although the embodiments of the present application have been shown and described, those skilled in the art will appreciate that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present application, and that the scope of the present application is defined by the claims and their equivalents.

[0174] The above is a specific description of the preferred implementation of the present application, but the present application is not limited to the described embodiments. Technical personnel familiar with the field may make various equivalent modifications or substitutions without violating the spirit of the present application. These equivalent modifications or substitutions are all included in the scope defined by the claims of the present application.

Claims

1. The interactive control method for UAV inspection is characterized by: The following steps are involved: Displaying the drone inspection main interface, wherein the drone inspection main interface includes a first main control and a second main control; In response to a trigger instruction to the first main control, a task management interface is displayed, and at least one main inspection task is acquired and executed through the task management interface, where the main inspection task is used to control the drone to inspect the area to be inspected of the main inspection task; In response to a trigger instruction to the second main control, an inspection management interface is displayed, wherein the inspection management interface includes an inspection record area and a first new control, wherein the inspection record area is used to display at least one main inspection task that has been executed; In response to a selection instruction for any completed main inspection task, a main inspection task corresponding to the selection instruction for the completed main inspection task is determined as a first target task, and abnormal point detection is performed on the first target task to obtain at least one abnormal inspection point of the first target task, wherein the abnormal inspection point is used to characterize an inspection point where a preset violation exists; In response to a trigger instruction for the first newly created control, a first newly created window is displayed, and a sub-inspection task is acquired and executed through the first newly created window, where the sub-inspection task is used to control the drone to inspect the abnormal inspection point; When the sub-inspection task is completed, determining the abnormal type of the abnormal inspection point according to the inspection report of the sub-inspection task and marking it; The first new window includes a first parameter setting sub-area, a first map display sub-area, a first search sub-area and a first release control; the obtaining and executing the sub-inspection task through the first new window includes: In response to an input instruction of the first search sub-area, acquiring an abnormal inspection point corresponding to the input instruction of the first search sub-area and displaying the abnormal inspection point in the first map display sub-area; In response to an input instruction in the first parameter setting sub-area, obtaining a parameter corresponding to the input instruction in the first parameter setting sub-area as a task parameter of the sub-inspection task and displaying the parameter in the first parameter setting sub-area; In response to a trigger instruction for the first release control, according to the abnormal inspection point corresponding to the input instruction of the first search sub-area and the task parameters of the sub-inspection task, the sub-inspection task is obtained and executed; The inspection management interface further includes a grid map area, the grid map area includes a third map display sub-area, and the third map display sub-area is used to display the to-be-inspected area of ​​at least one main inspection task; the abnormal point detection of the first target task to obtain at least one abnormal inspection point of the first target task includes: Obtaining a drone inspection path for the first target task and displaying it in the third map display sub-area, and obtaining an inspection report for the first target task, wherein the drone inspection path is composed of a plurality of inspection points; In response to a selection instruction for any of the inspection points, obtaining inspection point information corresponding to the selection instruction for the inspection point from the inspection report of the first target task and displaying the information in a first pop-up window of the third map display sub-area; According to the inspection report of the first target task, an abnormality detection is performed on each inspection point in the inspection path of the drone of the first target task to obtain at least one abnormal inspection point existing in the area to be inspected of the first target task; The task management interface includes a task list area, a task data control, an inspection report control, and a basic information control. The task list area includes a second task display sub-area, and the second task display sub-area is used to display at least one completed inspection task, and the inspection task includes a main inspection task or a sub-inspection task. The method also includes the following steps: In the case where at least one inspection task is completed, in response to a selection instruction for any inspection task that has been completed, determining the inspection task corresponding to the selection instruction for the inspection task that has been completed as the second target task; In response to a trigger instruction to the task data control, acquiring at least one inspection point image of the second target task and displaying it on the task data sub-interface; In response to a trigger instruction for the inspection report control, an inspection report of the second target task is obtained according to at least one inspection point image of the second target task and displayed on an inspection report sub-interface, wherein the inspection report of the second target task includes an inspection report of the main inspection task or an inspection report of the sub-inspection task, wherein the inspection report of the main inspection task is used to characterize whether there is at least one abnormal inspection point in the area to be inspected, and the inspection report of the sub-inspection task is used to indicate an abnormal type of at least one abnormal inspection point; In response to a trigger instruction for the basic information control, a basic information sub-interface is displayed, wherein the basic information sub-interface includes an acceptance control and a basic information display sub-area, and the basic information display sub-area is used to display basic information of the second target task; In response to a trigger instruction for the acceptance control, an acceptance window is displayed, wherein the acceptance window includes an acceptance pass control and a confirmation control; In response to the selection instruction of the acceptance pass control and the trigger instruction of the confirmation control, the second target task is ended and an inspection report of the second target task is output.

2. The UAV inspection interactive control method according to claim 1 is characterized in that: The third map display sub-area is also used to display at least one drone base station; the method further includes the following steps: During the period when at least one drone performs the main inspection task or the sub-inspection task, in response to a selection instruction for any of the drone base stations, determining the drone base station corresponding to the selection instruction of the drone base station as a target base station, acquiring base station information of the target base station and displaying it in a second pop-up window of the third map display sub-area, wherein the base station information is used to characterize the state of the target base station, and the second pop-up window includes an opening control control; In response to a trigger instruction for opening the control control, an inspection status window corresponding to the trigger instruction for opening the control control is displayed, the inspection status window comprising a status display area and a return control, the status display area being used to display at least one of the status of the drone belonging to the target base station, the status of the inspection task performed by the drone belonging to the target base station, and the inspection image taken by the drone belonging to the target base station at the current moment; In response to a trigger instruction for the return control, the inspection management interface is displayed.

3. The UAV inspection interactive control method according to claim 2 is characterized in that: The inspection status window further includes an image type setting control; after displaying the inspection status window corresponding to the trigger instruction of the opening control control, the method further includes the following steps: In response to a trigger instruction for the image type setting control, an image type setting window is displayed, wherein the image type setting window includes a wide-angle type control, a zoom type control, a thermal infrared type control, and a confirmation control; In response to a trigger instruction for at least one of the wide-angle type control, the zoom type control, and the thermal infrared type control and a trigger instruction for the determination control, the format of the inspection image taken by the drone belonging to the target base station is determined to be at least one of the wide-angle format, the zoom format, and the thermal infrared format.

4. The interactive control method for unmanned aerial vehicle inspection according to claim 1, characterized in that: The inspection management interface also includes a business layer area, and the business layer area includes at least one first-level selected area; the method also includes the following steps: In response to a selection instruction for at least one primary selected area, at least one secondary selected area corresponding to the selection instruction for the primary selected area is displayed in the business layer area, and an area to be inspected corresponding to the selection instruction for the primary selected area is displayed in the third map display sub-area; wherein the secondary selected area is obtained by subdividing the primary selected area; In response to a selection instruction for at least one secondary selected area, an area to be inspected corresponding to the selection instruction for the secondary selected area is displayed in the third map display sub-area.

5. The UAV inspection interactive control method according to claim 1 is characterized in that: The grid map area also includes a grid control; the method also includes the following steps: In response to a trigger instruction for the grid control, gridding the third map display sub-area to obtain at least one area grid; In response to a selection instruction for any of the regional grids, determining the regional grid corresponding to the selection instruction for the regional grid as a target grid, acquiring grid inspection information of the target grid and displaying it in a third pop-up window of the third map display sub-area, wherein the grid inspection information of the target grid is used to characterize the inspection status of the target grid, and the third pop-up window includes an entry grid control; In response to a trigger instruction for the enter-grid control, displaying a first grid details window corresponding to the trigger instruction for the enter-grid control, wherein the first grid details window includes a fourth map display sub-area, and the fourth map display sub-area is used to display the target grid and its grid inspection information, wherein the target grid includes at least one sub-grid; In response to a trigger instruction for any of the sub-grids, a second grid details window corresponding to the trigger instruction of the sub-grid is displayed, the second grid details window including a fifth map display sub-area and a grid comparison area, the fifth map display sub-area being used to display the sub-grid and its grid inspection information, the grid comparison area being used to display the sub-grid at at least one historical moment, and the grid inspection information of the sub-grid being used to characterize the inspection status of the sub-grid.

6. The UAV inspection interactive control method according to claim 5 is characterized in that: The second grid details window further includes a first direction control, a second direction control, a third direction control, and a fourth direction control; after displaying the second grid details window corresponding to the trigger instruction of the sub-grid, the method further includes the following steps: In response to a trigger instruction for the first direction control, displaying a subgrid located in the first direction of the current subgrid in the fifth map display sub-area; Alternatively, in response to a trigger instruction for the second direction control, a subgrid located in the second direction of the current subgrid is displayed in the fifth map display sub-area; Alternatively, in response to a trigger instruction for the third direction control, a subgrid located in the third direction of the current subgrid is displayed in the fifth map display sub-area; Alternatively, in response to a trigger instruction for the fourth direction control, a sub-grid located in the fourth direction of the current sub-grid is displayed in the fifth map display sub-area.

7. The interactive control device for drone inspection is characterized by: Applied to the UAV inspection interactive control method according to any one of claims 1 to 6, the device comprises: A display module, used to display a drone inspection main interface, wherein the drone inspection main interface includes a first main control and a second main control; A first interactive processing module, configured to display a task management interface in response to a trigger instruction to the first main control, and to obtain and execute at least one main inspection task through the task management interface, wherein the main inspection task is used to control the drone to inspect the area to be inspected of the main inspection task; A second interactive processing module, configured to display an inspection management interface in response to a trigger instruction to the second main control, wherein the inspection management interface includes an inspection record area and a first new control, wherein the inspection record area is configured to display at least one main inspection task that has been executed; A third interactive processing module is used to respond to the selected instruction of any completed main inspection task, determine the main inspection task corresponding to the selected instruction of the completed main inspection task as the first target task, and perform abnormal point detection on the first target task to obtain at least one abnormal inspection point of the first target task, wherein the abnormal inspection point is used to characterize the inspection point where a preset violation exists; a fourth interaction processing module, configured to display a first newly created window in response to a trigger instruction for the first newly created control, and to obtain and execute a sub-inspection task through the first newly created window, wherein the sub-inspection task is used to control the drone to inspect the abnormal inspection point; The fifth interactive processing module is used to determine and mark the abnormal type of the abnormal inspection point according to the inspection report of the sub-inspection task when the sub-inspection task is completed.

Citation Information

Patent Citations

  • Unmanned aerial vehicle inspection system and unmanned aerial vehicle inspection method

    CN112214032A

  • Unmanned aerial vehicle inspection method and device, equipment and storage medium

    CN116860004A