Power transmission line unmanned aerial vehicle inspection method and related device

Abstract

The invention provides a power transmission line unmanned aerial vehicle inspection method and a related device. The method comprises the following steps: firstly, receiving interaction information issued by a target user to a virtual digital person; wherein the interaction information comprises voice information, gesture information or text information; and then analyzing the interaction information through the virtual digital human, and controlling a target unmanned aerial vehicle to perform inspection operation of the power transmission line based on a result of analyzing the interaction information. And finally, the inspection prompt information is fed back to the target user through the virtual digital human, so that the virtual digital human interacts with the user, the operation instruction is more visual, the feedback is more timely, the operation threshold of the user for controlling the unmanned aerial vehicle to inspect the power transmission line is greatly reduced, and the user experience is improved. And the operation efficiency and practicability of unmanned aerial vehicle inspection are improved.

Description

Technical Field

[0001] The present application relates to the technical field of transmission line drone inspection, and in particular to a transmission line drone inspection method and related devices. Background Art

[0002] Traditional power transmission line inspections are mainly done manually, requiring inspectors to climb towers and inspect line equipment, which is labor-intensive, inefficient, and risky. In addition, manual inspections have certain limitations, such as the inability to detect hidden faults in a timely manner and the inability to conduct a comprehensive inspection of the lines. With the continuous advancement of science and technology, drone technology has been applied in the field of power inspections. However, the drone inspection system in the current related technologies has certain limitations in terms of human-computer interaction and intelligent processing capabilities in complex environments. Summary of the invention

[0003] In view of this, the purpose of this application is to propose a transmission line drone inspection method and related devices to solve or partially solve the above-mentioned technical problems.

[0004] Based on the above purpose, the present application provides a transmission line drone inspection method, which displays a virtual digital human through a terminal device, including:

[0005] Receiving interactive information sent by a target user to the virtual digital human; wherein the interactive information includes voice information, gesture information or text information;

[0006] Analyzing the interaction information by the virtual digital human, and controlling the target drone to perform a transmission line inspection operation based on the result of analyzing the interaction information;

[0007] Inspection prompt information is fed back to the target user through the virtual digital human.

[0008] Based on the same concept, the present application also proposes a transmission line drone inspection device, which displays a virtual digital human through a terminal device, and the device includes:

[0009] A receiving module, receiving interaction information sent by a target user to the virtual digital human; wherein the interaction information includes voice information, gesture information or text information;

[0010] An analysis module, which analyzes the interaction information through the virtual digital human, and controls the target UAV to perform an inspection operation of the power transmission line based on the result of analyzing the interaction information;

[0011] A feedback module feeds back inspection prompt information to the target user through the virtual digital human.

[0012] Based on the same concept, the present application also proposes an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the transmission line drone inspection method as described above is implemented.

[0013] Based on the same concept, the present application also proposes a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable a computer to execute the transmission line drone inspection method as described above.

[0014] Based on the same concept, the present application also proposes a computer program product, which includes a computer program, and the computer program is executed by one or more processors so that the processor executes the transmission line drone inspection method as described above.

[0015] From the above, it can be seen that the transmission line drone inspection method and related devices provided by the present application display a virtual digital human through a terminal device, first receive the interactive information issued by the target user to the virtual digital human; wherein the interactive information includes voice information, gesture information or text information; then the virtual digital human analyzes the interactive information, and controls the target drone to perform transmission line inspection operations based on the result of analyzing the interactive information; finally, the virtual digital human feeds back inspection prompt information to the target user, thereby interacting with the user through the virtual digital human, making the operation instructions more intuitive and the feedback more timely, which greatly reduces the operation threshold for users to control drones to inspect transmission lines and improves the operation efficiency and practicality of drone inspections. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the present application or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0017] Figure 1 A schematic diagram of an application scenario of an embodiment of the present application;

[0018] Figure 2 A schematic diagram of a process of a transmission line drone inspection method according to an embodiment of the present application;

[0019] Figure 3 A schematic diagram of a process of interaction between a user and a virtual numerical person according to an embodiment of the present application;

[0020] Figure 4This is a schematic diagram of the structure of a transmission line drone inspection device according to an embodiment of the present application;

[0021] Figure 5 A schematic diagram of a specific electronic device hardware structure of an embodiment of the present application. DETAILED DESCRIPTION

[0022] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0023] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application should be the usual meanings understood by people with general skills in the field to which the present application belongs. The "first", "second" and similar words used in the present application do not represent any order, quantity or importance, but are only used to distinguish different components. "Including" or "comprising" and similar words mean that the elements or objects appearing in front of the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connecting" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, which can be direct connections, indirect connections, wired connections, and wireless connections. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly. In addition, in the description of the present application, unless otherwise specified, the term "multiple" refers to two or more. The term "and / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0024] The principles and spirit of the present application will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are provided only to enable those skilled in the art to better understand and implement the present application, and are not intended to limit the scope of the present application in any way. On the contrary, these embodiments are provided to make the present application more thorough and complete, and to fully convey the scope of the present application to those skilled in the art.

[0025] It is understandable that before using the technical solutions of each embodiment of the present application, the type, scope of use, usage scenarios, etc. of the personal information involved will be informed to the user in an appropriate manner, and the user's authorization will be obtained.

[0026] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly remind the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can independently choose whether to provide personal information to the electronic device, application, server, storage medium or other software or hardware that performs the operation of the technical solution of the present application according to the prompt message.

[0027] As an optional but non-limiting implementation, in response to receiving the user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0028] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation method of this application. Other methods that meet relevant laws and regulations may also be applied to the implementation method of this application.

[0029] It should be understood herein that any number of elements in the drawings is for illustration rather than limitation, and any naming is only for distinction rather than having any limiting meaning.

[0030] As mentioned in the background technology section, the current drone inspection system in related technologies has certain limitations in terms of human-machine interaction and intelligent processing capabilities in complex environments. For example, the current drone inspection system has certain limitations in terms of operation interaction, and the operation interface is complex and non-intuitive, which makes it difficult for operators to quickly master the system operation, affecting the inspection efficiency.

[0031] In summary, in order to solve the above problems, the present application embodiment proposes a transmission line drone inspection method, including:

[0032] First, the interactive information issued by the target user to the virtual digital human is received; wherein the interactive information includes voice information, gesture information or text information; then the interactive information is analyzed by the virtual digital human, and based on the result of analyzing the interactive information, the target UAV is controlled to perform transmission line inspection operations; finally, the inspection prompt information is fed back to the target user through the virtual digital human, so that the virtual digital human interacts with the user, making the operation instructions more intuitive and the feedback more timely, which greatly reduces the operation threshold for users to control the UAV to inspect the transmission lines and improves the operation efficiency and practicality of the UAV inspection.

[0033] In some specific application scenarios, the transmission line drone inspection method of the present application can be applied to various platforms or systems involving transmission line inspection. As an example, the application scenario includes at least one server and at least one terminal. Figure 1 , which is a schematic diagram of an application scenario of a transmission line drone inspection method provided by an exemplary embodiment of the present disclosure. The application scenario includes a terminal device 101, a server 102, and a data storage system 103. Among them, the terminal device 101, the server 102 and the data storage system 103 can be connected through a wired or wireless communication network. The terminal device includes but is not limited to a desktop computer, a mobile phone, a mobile computer, a tablet computer, a media player, a smart wearable device, a personal digital assistant (PDA) or other electronic devices capable of realizing the above functions. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. The server and the terminal can communicate through the network to realize data transmission. Among them, the network can be a wired network or a wireless network, which is not specifically limited in this application.

[0034] The server may be a server that provides various services. Specifically, the server may be used to provide background services for applications running on the terminal. Optionally, in some implementations, the transmission line drone inspection method provided in the embodiment of the present application may be executed by the server. Optionally, in some implementations, the transmission line drone inspection method provided in the embodiment of the present application may be directly executed by the terminal device.

[0035] Optionally, the server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server is software, it can be implemented as multiple software or software modules (for example, software or software modules for providing distributed services), or it can be implemented as a single software or software module. This embodiment of the application does not specifically limit this.

[0036] Optionally, the wireless network or wired network uses standard communication technology and / or protocol. The network is usually the Internet, but it can also be any network, including but not limited to a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), a mobile, wired or wireless network, a dedicated network or any combination of a virtual private network). In some embodiments, the data exchanged through the network is represented by technologies and / or formats including hypertext mark-up language (HTML), extensible markup language (XML), etc. In addition, conventional encryption technologies such as secure socket layer (SSL), transport layer security (TLS), virtual private network (VPN), and Internet protocol security (IPsec) can be used to encrypt all or some links. In other embodiments, customized and / or dedicated data communication technologies can also be used to replace or supplement the above data communication technologies.

[0037] The data storage system stores a large amount of data. Optionally, the data storage system can partition the data according to different uses and data types. The source of the data includes but is not limited to an existing database, data crawled from the Internet, or data uploaded by the user when using the client.

[0038] The following describes the transmission line drone inspection method according to the exemplary embodiment of the present application in combination with specific application scenarios. It should be noted that the above application scenarios are only shown to facilitate understanding of the spirit and principles of the present application, and the implementation of the present application is not limited in this regard. On the contrary, the implementation of the present application can be applied to any applicable scenario.

[0039] refer to Figure 2 , is a flow chart of a transmission line drone inspection method according to an embodiment of the present application, the method comprising the following steps:

[0040] S101, receiving interaction information sent by a target user to the virtual digital human; wherein the interaction information includes voice information, gesture information or text information.

[0041] During specific implementation, the embodiment of the present application displays a virtual digital human through a terminal device. Optionally, the terminal device may be a mobile phone, tablet computer, PC or other terminal device. In some embodiments, the terminal device may also be a virtual reality device such as VR or MR. Through virtual reality technology, the virtual digital human can be displayed more realistically. Optionally, the virtual digital human in the embodiment of the present application may be a digital human with a human image, which can interact with the operator through voice, gestures and facial expressions. In some embodiments, the virtual digital human may also use cartoon characters or animals as the image of the digital human, without limitation. When the user issues interactive information to the virtual digital human, multiple methods such as voice, gesture or text may be used, and the interactive information received by the corresponding virtual digital human includes voice information, gesture information or text information. It should be noted that the target user is the user currently performing the operation.

[0042] In order to accurately obtain a virtual digital human, in some embodiments, a large AI model can be trained through historical inspection data to obtain a virtual digital human. The specific training process can refer to the training process of the large AI model in the relevant technology, and there is no limitation on this.

[0043] refer to Figure 3 , is a flow chart of the interaction between a user and a virtual digital person in an embodiment of the present application. The virtual digital person in this embodiment mainly includes a large model and an intelligent voice. When a user (Users) sends an input voice to the virtual digital person, the input voice is first converted into text information, and then the text information is input into the trained large model. The large model performs text analysis and generates a reply message, and then sends the reply message to the intelligent voice, which converts the reply message into audio information and returns the audio information. At the same time, the virtual digital person's mouth shape is driven and an interactive animation of the virtual digital person is generated, and the audio information is played to the user, that is, the user can receive the virtual digital person's voice reply with action.

[0044] S102, analyzing the interaction information by the virtual digital human, and controlling the target UAV to perform an inspection operation of the power transmission line based on the result of analyzing the interaction information.

[0045] During specific implementation, after receiving the interactive information issued by the target user, the interactive information is analyzed by a virtual digital human to obtain the inspection instructions contained in the interactive information. Then, according to the inspection instructions (i.e., the result of analyzing the interactive information), the target UAV is controlled to perform the inspection of the transmission line. Optionally, the above inspection instructions include: inspection route, inspection target, inspection time, etc. It should be noted that the virtual digital human has learned to analyze and identify the interactive information during the large model training stage, and can accurately obtain the inspection instructions therefrom, so as to accurately control the target UAV to perform the inspection of the transmission line according to the inspection instructions. Among them, the target UAV is the UAV that is currently controlled to perform the transmission line inspection.

[0046] In some embodiments, the target drone includes a high-definition camera and a thermal imaging camera, as well as other necessary sensors to collect visual and thermal imaging data of the line. Optionally, when selecting a target drone, a drone model suitable for power inspection can be selected to ensure that it has sufficient flight stability, endurance, and load capacity.

[0047] S103, feeding back inspection prompt information to the target user through the virtual digital human.

[0048] In specific implementation, in order to further help users better complete inspection tasks, during the inspection of the power transmission line by the target UAV, the virtual digital human will feedback inspection prompt information to the target user, and the user can make more accurate inspection control based on the prompt information.

[0049] In some embodiments, the display interface where the virtual digital human is located also includes the real-time status of the drone, inspection data, and warning information, so that the user can understand the inspection situation in real time.

[0050] In order to ensure the smooth progress of the inspection task, the virtual digital human can provide intelligent feedback and guidance functions to help users complete complex tasks, for example. In some embodiments, the inspection prompt information includes: one or more of navigation prompt information, safety warning information, and operation suggestion information.

[0051] In some embodiments, the method further comprises:

[0052] Obtaining skill level information corresponding to the target user;

[0053] The active help level of the virtual digital person is determined based on the level information; wherein the skill level information is inversely proportional to the active help level.

[0054] In specific implementation, in order to enable the virtual digital human to automatically adjust the displayed information and functions and the degree of intervention of active help according to the user's skill level and experience, the embodiment of the present application will obtain the skill level information corresponding to the target user, and determine the active help level of the virtual digital human according to the skill level information, wherein the higher the level corresponding to the skill level information, the lower the active help level of the virtual digital human, that is, the lower the degree of intervention of active help, giving high-skilled users more free operating space, so as to provide more guidance and help for novice users; and for experienced users, more customized options and advanced functions. Optionally, in some embodiments, the information and functions of the virtual digital human display interface can also be adjusted according to the skill level information corresponding to the target user.

[0055] In some embodiments, the method further comprises:

[0056] Get the real-time inspection data collected by the target drone:

[0057] Determine inspection decision recommendation information of the target UAV based on the real-time inspection data;

[0058] The inspection decision suggestion information is fed back to the user through the virtual digital human.

[0059] In specific implementation, in order to better guide users to control drones to perform inspection operations and optimize users' initial decisions, the embodiment of the present application can generate inspection decision recommendation information of the target drone through the real-time inspection data collected by the target drone, and feedback the inspection decision recommendation information to the user through the virtual digital human for the user's reference. Optionally, the processing process of the embodiment of the present application can be completed by a background processing center, which is responsible for receiving, storing, processing and analyzing data transmitted by drones. The background processing center uses cloud computing and big data technology to process inspection data in real time, including image recognition, fault detection and data analysis.

[0060] In order to accurately generate inspection decision recommendation information, in some embodiments, the inspection decision recommendation information of the target UAV is determined based on the real-time inspection data, specifically including:

[0061] Inputting the real-time inspection data into the inspection decision model obtained through training to obtain the inspection decision suggestion information;

[0062] Or, the inspection decision suggestion information is determined by using preset decision rules and the real-time inspection data.

[0063] In specific implementation, the process of training the inspection decision model can refer to the training process of the AI ​​model in the relevant technology, which is not limited to this. Optionally, the specific preset decision rules can be set as needed, which is not limited to this. In some embodiments, the inspection decision recommendation information can also be obtained through an expert system.

[0064] In some embodiments, the transmission line drone inspection method of the present application also includes fusing multi-source data collected by the target drone, wherein the multi-source data includes visual, thermal imaging, sensor data, etc., so as to more accurately determine the inspection decision recommendation information of the target drone through the fused multi-source data.

[0065] In some embodiments, the method further comprises:

[0066] Acquire historical personalized information of the target user;

[0067] The attribute information of the virtual digital human is set based on the historical personalized information; wherein the attribute information includes language information, interface subject information, interaction habit information and virtual character image information.

[0068] In specific implementation, in order to meet the preferences of different users, in the embodiment of the present application, the attribute information of the virtual digital human is set according to the different historical personalized information of the target user, that is, different virtual digital humans can be provided for different users. Among them, the attribute information that can be set and changed for the virtual digital human includes language information, interface main body information, interaction habit information and virtual character image information, etc. This can improve user satisfaction and work efficiency.

[0069] The transmission line drone inspection method provided by the present application first receives the interactive information issued by the target user to the virtual digital human; wherein the interactive information includes voice information, gesture information or text information; then the interactive information is analyzed by the virtual digital human, and the target drone is controlled to perform the transmission line inspection operation based on the result of analyzing the interactive information; finally, the inspection prompt information is fed back to the target user by the virtual digital human, and by constructing a virtual character with a human image and intelligent behavior, it is possible to interact intelligently with the drone, providing a more friendly and intuitive human-computer interaction interface, making the operation instructions more intuitive and the feedback more timely, greatly reducing the user's control of the drone to inspect the transmission line, and improving the operational efficiency and practicality of the drone inspection. In addition, the virtual digital human can also intelligently control and process the drone according to the requirements of the inspection task, thereby improving the efficiency and accuracy of the inspection operation.

[0070] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a transmission line drone inspection device that displays a virtual digital human through a terminal device.

[0071] refer to Figure 4 , the transmission line drone inspection device comprises:

[0072] The receiving module 201 receives the interaction information sent by the target user to the virtual digital human; wherein the interaction information includes voice information, gesture information or text information;

[0073] The analysis module 202 analyzes the interaction information through the virtual digital human, and controls the target drone to perform the inspection operation of the power transmission line based on the result of analyzing the interaction information;

[0074] The feedback module 203 feeds back inspection prompt information to the target user through the virtual digital human.

[0075] In some embodiments, the inspection prompt information includes: one or more of navigation prompt information, safety warning information, and operation suggestion information.

[0076] In some embodiments, the device further comprises a help level adjustment module, which is used to:

[0077] Obtaining skill level information corresponding to the target user;

[0078] The active help level of the virtual digital person is determined based on the level information; wherein the skill level information is inversely proportional to the active help level.

[0079] In some embodiments, the target drone includes a high-definition camera and a thermal imaging camera.

[0080] In some embodiments, the apparatus further comprises a decision module, configured to:

[0081] Get the real-time inspection data collected by the target drone:

[0082] Determine inspection decision recommendation information of the target UAV based on the real-time inspection data;

[0083] The inspection decision suggestion information is fed back to the user through the virtual digital human.

[0084] In some embodiments, the decision module is specifically used to:

[0085] Inputting the real-time inspection data into the inspection decision model obtained through training to obtain the inspection decision suggestion information;

[0086] Or, the inspection decision suggestion information is determined by using preset decision rules and the real-time inspection data.

[0087] In some embodiments, the device further comprises a personalization setting module, configured to:

[0088] Acquire historical personalized information of the target user;

[0089] The attribute information of the virtual digital human is set based on the historical personalized information; wherein the attribute information includes language information, interface subject information, interaction habit information and virtual character image information.

[0090] For the convenience of description, the above device is described in terms of functions divided into various modules. Of course, when implementing the present application, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0091] The transmission line drone inspection device of the above-mentioned embodiment is used to implement the corresponding transmission line drone inspection method in any of the above-mentioned embodiments, and has the beneficial effects of the corresponding transmission line drone inspection method embodiment, which will not be repeated here.

[0092] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present disclosure also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the transmission line drone inspection method described in any of the above embodiments is implemented.

[0093] It should be noted that the method of the embodiment of the present application can be performed by a single device, such as a computer or server. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present application, and the multiple devices will interact with each other to complete the described method.

[0094] It should be noted that the above describes some embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0095] Figure 5A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown. The device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040 and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030 and the communication interface 1040 are connected to each other in communication within the device through the bus 1050.

[0096] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.

[0097] The memory 1020 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.

[0098] The input / output interface 1030 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.

[0099] The communication interface 1040 is used to connect a communication module (not shown) to realize communication interaction between the device and the power equipment. The communication module can realize communication through a wired method (such as USB, network cable, etc.) or a wireless method (such as mobile network, WIFI, Bluetooth, etc.).

[0100] The bus 1050 includes a path that transmits information between the various components of the device (eg, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).

[0101] It should be noted that, although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.

[0102] The electronic device of the above-mentioned embodiment is used to implement the corresponding transmission line drone inspection method in any of the above-mentioned embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.

[0103] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present disclosure also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the transmission line drone inspection method as described in any of the above embodiments.

[0104] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0105] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the transmission line drone inspection method described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0106] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present application also provides a computer program product, which includes a computer program. In some embodiments, the computer program instructions can be executed by one or more processors of a computer so that the computer and / or the processor execute the transmission line drone inspection method described in the above-mentioned embodiment. Corresponding to the execution subject corresponding to each step in each embodiment of the transmission line drone inspection method, the processor that executes the corresponding step may belong to the corresponding execution subject.

[0107] To simplify the description and discussion, and in order not to make the embodiments of the present application difficult to understand, the known power supply / ground connection with the integrated circuit (IC) chip and other components may or may not be shown in the provided drawings. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present application difficult to understand, and this also takes into account the following fact, that is, the details of the implementation of these block diagram devices are highly dependent on the platform to be implemented in the embodiments of the present application (that is, these details should be fully within the scope of understanding of those skilled in the art). In the case of elaborating specific details (e.g., circuit) to describe exemplary embodiments of the present application, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details or when these specific details are changed. Therefore, these descriptions should be considered to be illustrative rather than restrictive.

[0108] Although the present application has been described in conjunction with specific embodiments of the present application, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.

[0109] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application (including the claims) is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the present application as described above, which are not provided in detail for the sake of simplicity.

[0110] The embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the scope of protection of the present application.

Claims

1. A transmission line drone inspection method, characterized in that: Displaying a virtual digital human through a terminal device, the method comprises: Receiving interactive information sent by a target user to the virtual digital human; wherein the interactive information includes voice information, gesture information or text information; Analyzing the interaction information by the virtual digital human, and controlling the target drone to perform a transmission line inspection operation based on the result of analyzing the interaction information; Inspection prompt information is fed back to the target user through the virtual digital human.

2. The method according to claim 1, characterized in that The inspection prompt information includes: one or more of navigation prompt information, safety warning information, and operation suggestion information.

3. The method according to claim 1, characterized in that: The method further comprises: Obtaining skill level information corresponding to the target user; The active help level of the virtual digital person is determined based on the level information; wherein the skill level information is inversely proportional to the active help level.

4. The method according to claim 1, characterized in that The target drone includes a high-definition camera and a thermal imaging camera.

5. The method according to claim 1, characterized in that The method further comprises: Get the real-time inspection data collected by the target drone: Determine inspection decision recommendation information of the target UAV based on the real-time inspection data; The inspection decision suggestion information is fed back to the user through the virtual digital human.

6. The method according to claim 5, characterized in that Determining inspection decision suggestion information of the target UAV based on the real-time inspection data specifically includes: Inputting the real-time inspection data into the inspection decision model obtained through training to obtain the inspection decision suggestion information; Or, the inspection decision suggestion information is determined by using preset decision rules and the real-time inspection data.

7. The method according to claim 1, characterized in that The method further comprises: Acquire historical personalized information of the target user; The attribute information of the virtual digital human is set based on the historical personalized information; wherein the attribute information includes language information, interface subject information, interaction habit information and virtual character image information.

8. A transmission line drone inspection device, characterized in that: The device for displaying a virtual digital human through a terminal device comprises: A receiving module, receiving interaction information sent by a target user to the virtual digital human; wherein the interaction information includes voice information, gesture information or text information; An analysis module, which analyzes the interaction information through the virtual digital human, and controls the target UAV to perform an inspection operation of the power transmission line based on the result of analyzing the interaction information; A feedback module feeds back inspection prompt information to the target user through the virtual digital human.

9. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method according to any one of claims 1 to 7 is implemented.

10. A non-transitory computer-readable storage medium, characterized in that: The non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the method according to any one of claims 1 to 7.

Images