Unmanned aerial vehicle intelligent management and control system

Abstract

The invention relates to the technical field of unmanned aerial vehicle intelligent management and control systems, and discloses an unmanned aerial vehicle intelligent management and control system, which comprises an equipment layer, a data transmission layer, a management and control platform layer and an application layer, and is characterized in that the equipment layer is in signal connection with the data transmission layer, and the data transmission layer is in signal connection with the management and control platform layer. And the management and control platform layer is in signal connection with the application layer. The intelligent management and control system for the unmanned aerial vehicle integrates multiple functions of equipment access management, project full-life-cycle management, three-dimensional visualization, AI intelligent algorithm enabling, airport unattended management, data safety guarantee and the like, realizes one-stop centralized, automatic and intelligent management of the operation process of the unmanned aerial vehicle, and is close in cooperation of all functional modules, smooth in data interaction, high in reliability and high in reliability. The working efficiency and the management efficiency are improved, an advanced AI intelligent identification technology and a customizable algorithm are applied, an exclusive analysis model is developed for different industry characteristics and service requirements, and various complex service scene problems can be accurately identified.

Description

Technical Field

[0001] The present invention relates to the technical field of unmanned aerial vehicle intelligent management and control systems, and in particular to an unmanned aerial vehicle intelligent management and control system. Background Art

[0002] As a cutting-edge achievement of modern science and technology, the UAV intelligent control system is a comprehensive management platform that deeply integrates cloud computing, big data, artificial intelligence, digital twins, and advanced communication technologies. Its core goal is to build an all-round, intelligent ecosystem to achieve refined and efficient control of UAV operations and deep mining and intelligent application of massive data, thereby providing strong support for the digital transformation and upgrading of many industries.

[0003] At present, the drone control system used adopts multiple systems for interactive use during use. During use, data interaction is slow, and users need to switch operations among multiple system components, which has low work efficiency. At the same time, the existing drone control system has a low degree of intelligence and cannot realize three-dimensional function display. It is not perfect during use. Therefore, it is necessary to invent a drone intelligent control system to solve the above problems. Summary of the invention

[0004] The purpose of the present invention is to provide a drone intelligent management and control system to solve the problems raised in the above background technology.

[0005] To achieve the above-mentioned objectives, the present invention provides the following technical solutions: an intelligent management and control system for unmanned aerial vehicles, comprising a device layer, a data transmission layer, a management and control platform layer and an application layer, wherein the device layer is signal connected to the data transmission layer, the data transmission layer is signal connected to the management and control platform layer, and the management and control platform layer is signal connected to the application layer.

[0006] The management and control platform layer includes equipment access and management module, project life cycle management module, three-dimensional visualization module, AI intelligent algorithm empowerment module, airport unmanned management module, and data security management module.

[0007] The application layer includes a city comprehensive aerial inspection management module, a highway automatic inspection module, an emergency rescue support module, a power grid drone inspection management module, an urban management drone comprehensive inspection module, a drone water affairs intelligent inspection module, and a photovoltaic intelligent inspection module.

[0008] Preferably, the input end signal of the equipment layer is connected to the drone and the automatic airport equipment, which is used to provide take-off and landing, charging and storage for the drone. The drone is equipped with a multi-functional gimbal camera, a laser radar, a gas detector and a searchlight.

[0009] Preferably, the data transmission layer is responsible for data interaction between the UAV and the control platform, sampling wireless communication for data transmission, and using encryption protocols to encrypt flight data, mission data, and collected data.

[0010] Preferably, the device access and management module is used to connect the drone to the automatic airport equipment, and is also used to allocate an account on the remote control terminal login platform to achieve automatic registration and access of the drone equipment.

[0011] The project life cycle management module is used for basic project information maintenance, milestone setting, execution plan formulation, operation monitoring, achievement management and post-processing analysis.

[0012] The three-dimensional visualization module is used to adopt three-dimensional digital twin technology and GIS visualization engine to integrate high-definition images, terrain, and real-life three-dimensional model scene elements to construct a three-dimensional scene.

[0013] The AI ​​intelligent algorithm enabling module adopts a visual recognition engine and an AI recognition algorithm library to configure corresponding intelligent analysis algorithms according to the needs of different industries such as urban comprehensive management, environmental protection, agriculture and forestry, transportation, and energy.

[0014] The airport unmanned management module includes three sub-modules: online operation and maintenance, planned tasks, and command control. The online operation and maintenance sub-module is used to collect sensor signals and image transmission images of airport equipment in real time, and remotely monitor the operating status of equipment and the surrounding environment. The planned task sub-module is used to support refined timing strategy configuration, set tasks to be executed immediately, at a scheduled time, or repeatedly, and flexibly plan UAV automated flight operation tasks. The command control sub-module is used to realize flight action control, gimbal operation, point-to-point flight, and surround flight shooting functions.

[0015] The data security management module is used to provide two modes: cloud computing service and pure offline private deployment.

[0016] Preferably, the three-dimensional visualization module uses a GIS visualization engine to provide a geographic space framework, and the three-dimensional digital twin technology embeds a detailed model of the drone and related facilities in the framework to achieve deep integration of geographic information and equipment entity information, and the fusion mechanism uses a spatial coordinate conversion algorithm formula. The coordinates of a point in the source geographic coordinate system are (X, Y, Z), and the corresponding coordinates in the target geographic coordinate system are (X', Y', Z'). The seven parameters are respectively the X-axis translation ∆X0, the Y-axis translation ∆Y0, the Z-axis translation ∆Z0, the rotation angle around the X-axis ω x , rotation angle ω around the Y axis y , rotation angle ω around the Z axis z And the scale factor m, the conversion formula is: ; ; .

[0017] Preferably, the AI ​​intelligent algorithm enabling module adopts a convolutional neural network algorithm, and its formula is: ;

[0018] Among them, x is the feature vector obtained after the feature extraction layer, W is the weight matrix of the fully connected layer, b is the bias vector, and y is the classification prediction result.

[0019] Preferably, the city comprehensive aerial inspection management module includes integrated road traffic, environment, facilities, and engineering construction inspection functions.

[0020] The highway automatic inspection module is used to realize remote centralized control of automatic airports along the highway and fully automatic dispatching of drones.

[0021] The emergency rescue support module is used to utilize the live broadcast images transmitted back by the drone in real time to provide on-site information to ground rescue personnel and assist in formulating rescue plans.

[0022] The power grid drone inspection management module is used to combine power equipment image recognition and point cloud analysis algorithms to conduct refined inspections of power lines, towers, substations and other equipment.

[0023] The urban management drone comprehensive inspection module is used to automatically check urban traffic violations, urban appearance and environmental protection, illegal construction, and sewage problems based on the urban grid dispatching management system and intelligent visual recognition algorithm.

[0024] The drone water affairs intelligent inspection module is used to utilize the unmanned capabilities of drones and automatic airports to conduct periodic inspections of urban water networks and navigable rivers.

[0025] The photovoltaic intelligent inspection module is used to realize the automatic control of the whole process of photovoltaic power station inspection flight, including one-key autonomous flight, visible light / thermal infrared image acquisition, and automatic release, recovery and charging functions.

[0026] Compared with the prior art, the present invention provides a drone intelligent management and control system, which has the following beneficial effects: The drone intelligent management and control system integrates multiple functions such as equipment access management, project life cycle management, 3D visualization, AI intelligent algorithm empowerment, airport unmanned management, and data security assurance, realizing one-stop centralized, automated, and intelligent management of drone operation processes. The functional modules work closely together and data interaction is smooth, avoiding users switching operations between multiple systems and improving work efficiency and management effectiveness.

[0027] The drone intelligent management and control system uses advanced AI intelligent recognition technology and customizable algorithms to develop exclusive analysis models based on the characteristics of different industries and business needs. It can accurately identify various complex business scenario problems, such as small illegal buildings in urban management, subtle defects in power grid equipment, and hidden pollution sources in the environmental protection field. By continuously training and iterating models, it continuously improves recognition accuracy and analysis capabilities, providing users with high-quality intelligent analysis services to assist in decision-making.

[0028] The UAV intelligent control system is based on a business visualization fusion system built with 3D digital twins and GIS visualization engines, providing all-round, multi-level visualization and interactive operation functions. Through applications such as one map for operation status, one map for route management, and one map for command and dispatch, it realizes real-time dynamic monitoring of the UAV operation process, efficient route planning, and convenient command and dispatch. The 3D scene personalized configuration function meets the user's customized visualization needs and improves the user experience and business understanding depth. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative labor: Figure 1 It is a schematic diagram of the system structure of the present invention. DETAILED DESCRIPTION

[0030] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0031] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0032] See also Figure 1The present invention provides a technical solution: an intelligent management and control system for unmanned aerial vehicles, including a device layer, a data transmission layer, a management and control platform layer and an application layer, a signal connection between the device layer and the data transmission layer, a signal connection between the data transmission layer and the management and control platform layer, and a signal connection between the management and control platform layer and the application layer.

[0033] The management and control platform layer includes equipment access and management module, project life cycle management module, three-dimensional visualization module, AI intelligent algorithm empowerment module, airport unmanned management module, and data security management module.

[0034] The application layer includes the city comprehensive aerial inspection management module, the highway automatic inspection module, the emergency rescue support module, the power grid drone inspection management module, the urban management drone comprehensive inspection module, the drone water affairs intelligent inspection module, and the photovoltaic intelligent inspection module.

[0035] Furthermore, the input signal of the equipment layer connects the drone with the automatic airport equipment to provide take-off and landing, charging, and storage for the drone. The drone is equipped with a multi-functional gimbal camera, laser radar, gas detector, and searchlight.

[0036] Furthermore, the data transmission layer is responsible for data interaction between the drone and the control platform, sampling wireless communications for data transmission, and using encryption protocols to encrypt flight data, mission data, and collected data.

[0037] Furthermore, the device access and management module is used to connect the drone to the automatic airport equipment, and is also used to allocate an account on the remote control terminal login platform to achieve automatic registration and access of the drone equipment.

[0038] The project life cycle management module is used for basic project information maintenance, milestone setting, execution plan formulation, operation monitoring, achievement management and post-processing analysis.

[0039] The 3D visualization module is used to construct a 3D scene by using 3D digital twin technology and GIS visualization engine, integrating high-definition images, terrain, and real-life 3D model scene elements.

[0040] The AI ​​intelligent algorithm empowerment module uses a visual recognition engine and AI recognition algorithm library to configure corresponding intelligent analysis algorithms to meet the needs of different industries such as urban comprehensive management, environmental protection, agriculture and forestry, transportation, and energy.

[0041] The airport unmanned management module includes three sub-modules: online operation and maintenance, planned tasks, and command control. The online operation and maintenance sub-module is used to collect the sensor signals and image transmission images of airport equipment in real time, and remotely monitor the equipment operation status and surrounding environment. The planned task sub-module is used to support refined timing strategy configuration, set tasks to be executed immediately, at a scheduled time, or repeatedly, and flexibly plan UAV automated flight operation tasks. The command control sub-module is used to realize flight action control, gimbal operation, point-to-point flight, and surround flight shooting functions.

[0042] The data security management module is used to provide two modes: cloud computing service and pure offline private deployment.

[0043] Furthermore, the 3D visualization module uses a GIS visualization engine to provide a geographic space framework. The 3D digital twin technology embeds a detailed model of the drone and related facilities in the framework to achieve deep integration of geographic information and equipment entity information. The fusion mechanism uses a spatial coordinate conversion algorithm formula. The coordinates of a point in the source geographic coordinate system are (X, Y, Z), and the corresponding coordinates in the target geographic coordinate system are (X', Y', Z'). The seven parameters are the X-axis translation ∆X0, the Y-axis translation ∆Y0, the Z-axis translation ∆Z0, and the rotation angle around the X-axis ω. x , rotation angle ω around the Y axis y , rotation angle ω around the Z axis z And the scale factor m, the conversion formula is: ; ; .

[0044] Furthermore, the AI ​​intelligent algorithm empowerment module adopts a convolutional neural network algorithm, and its formula is: ;

[0045] Among them, x is the feature vector obtained after the feature extraction layer, W is the weight matrix of the fully connected layer, b is the bias vector, and y is the classification prediction result.

[0046] Furthermore, the city's comprehensive aerial inspection management module includes integrated road traffic, environment, facilities, and engineering construction inspection functions.

[0047] The highway automatic inspection module is used to realize remote centralized control of automatic airports along the highway and fully automatic dispatch of drones.

[0048] The emergency rescue support module is used to utilize the live broadcast images transmitted back by drones in real time to provide on-site information to ground rescue personnel and assist in formulating rescue plans.

[0049] The power grid drone inspection management module is used to combine power equipment image recognition and point cloud analysis algorithms to conduct refined inspections of power lines, towers, substations and other equipment.

[0050] The comprehensive inspection module of the urban management drone is used to automatically check urban traffic violations, urban appearance and environmental protection, illegal construction, and sewage problems based on the urban grid dispatching management system and intelligent visual recognition algorithms.

[0051] The UAV water intelligent inspection module is used to utilize the unmanned capabilities of drones and automatic airports to conduct periodic inspections of urban water networks and navigable rivers.

[0052] The photovoltaic intelligent inspection module is used to realize the automated control of the entire inspection flight process of photovoltaic power stations, including one-key autonomous flight, visible light / thermal infrared image acquisition, and automatic release, recovery and charging functions.

[0053] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

Claims

1. An intelligent control system for unmanned aerial vehicles, comprising a device layer, a data transmission layer, a control platform layer and an application layer, characterized in that: The device layer is connected to the data transmission layer by signals, the data transmission layer is connected to the control platform layer by signals, and the control platform layer is connected to the application layer by signals; The control platform layer includes equipment access and management module, project life cycle management module, 3D visualization module, AI intelligent algorithm empowerment module, airport unmanned management module, and data security management module; The application layer includes a city comprehensive aerial inspection management module, a highway automatic inspection module, an emergency rescue support module, a power grid drone inspection management module, an urban management drone comprehensive inspection module, a drone water affairs intelligent inspection module, and a photovoltaic intelligent inspection module.

2. The intelligent control system for unmanned aerial vehicles according to claim 1, characterized in that: The input signal of the equipment layer is connected to the drone and the automatic airport equipment, which is used to provide take-off and landing, charging and storage for the drone. The drone is equipped with a multi-functional gimbal camera, a laser radar, a gas detector and a searchlight.

3. The intelligent control system for unmanned aerial vehicles according to claim 1, characterized in that: The data transmission layer is responsible for data interaction between the UAV and the control platform, sampling wireless communication for data transmission, and using encryption protocols to encrypt flight data, mission data, and collected data.

4. The intelligent control system for unmanned aerial vehicles according to claim 1, characterized in that: The device access and management module is used to connect the drone to the automatic airport equipment, and is also used to assign an account on the remote control terminal login platform to achieve automatic registration and access of the drone equipment; The project life cycle management module is used for basic project information maintenance, milestone setting, execution plan formulation, operation monitoring, achievement management and post-processing analysis; The three-dimensional visualization module is used to use three-dimensional digital twin technology and GIS visualization engine to integrate high-definition images, terrain, and real-life three-dimensional model scene elements to construct a three-dimensional scene; The AI ​​intelligent algorithm empowerment module uses a visual recognition engine and an AI recognition algorithm library to configure corresponding intelligent analysis algorithms for the needs of different industries such as urban comprehensive management, environmental protection, agriculture and forestry, transportation, and energy; The airport unmanned management module includes three submodules: online operation and maintenance, planned tasks, and command control. The online operation and maintenance submodule is used to collect sensor signals and image transmission images of airport equipment in real time, and remotely monitor the operating status of equipment and the surrounding environment. The planned task submodule is used to support refined timing strategy configuration, set tasks to be executed immediately, scheduled, or repeatedly, and flexibly plan UAV automated flight operation tasks. The command control submodule is used to realize flight action control, gimbal operation, pointing flight, and surround flight shooting functions; The data security management module is used to provide two modes: cloud computing service and pure offline private deployment.

5. The intelligent control system for unmanned aerial vehicles according to claim 1, characterized in that: The three-dimensional visualization module uses a GIS visualization engine to provide a geographic space framework. The three-dimensional digital twin technology embeds a detailed model of the drone and related facilities in the framework to achieve deep integration of geographic information and equipment entity information. The fusion mechanism uses a spatial coordinate conversion algorithm formula. The coordinates of a point in the source geographic coordinate system are (X, Y, Z), and the corresponding coordinates in the target geographic coordinate system are (X', Y', Z'). The seven parameters are the X-axis translation ∆X0, the Y-axis translation ∆Y0, the Z-axis translation ∆Z0, and the rotation angle ω around the X-axis. x , rotation angle ω around the Y axis y , rotation angle ω around the Z axis z And the scale factor m, the conversion formula is: ； ； 。 6. The intelligent control system for unmanned aerial vehicles according to claim 1, characterized in that: The AI ​​intelligent algorithm enabling module adopts a convolutional neural network algorithm, and its formula is: ； Among them, x is the feature vector obtained after the feature extraction layer, W is the weight matrix of the fully connected layer, b is the bias vector, and y is the classification prediction result.

7. The intelligent control system for unmanned aerial vehicles according to claim 1, characterized in that: The urban comprehensive aerial inspection management module includes integrated road traffic, environment, facilities, and engineering construction inspection functions; The highway automatic inspection module is used to realize remote centralized control of automatic airports along the highway and fully automatic dispatch of drones; The emergency rescue support module is used to use the live broadcast images sent back by the drone in real time to provide on-site information to ground rescue personnel and assist in formulating rescue plans; The power grid drone inspection management module is used to combine power equipment image recognition and point cloud analysis algorithms to conduct refined inspections of power lines, towers, substations and other equipment; The urban management drone comprehensive inspection module is used to automatically check urban traffic violations, urban appearance and environmental protection, illegal construction, and sewage problems based on the urban grid dispatching management system and intelligent visual recognition algorithm; The UAV water affairs intelligent inspection module is used to utilize the unmanned capabilities of UAVs and automated airports to conduct periodic inspections of urban water networks and navigable rivers; The photovoltaic intelligent inspection module is used to realize the automatic control of the whole process of photovoltaic power station inspection flight, including one-key autonomous flight, visible light / thermal infrared image acquisition, and automatic release, recovery and charging functions.

Images