Data collection method and device based on unmanned aerial vehicle, medium and product
Through instruction-level data service bus technology, the management and control problems of drone data collection systems in high concurrency, cross-manufacturers and out-of-control scenarios are solved, the sensitivity and accuracy of data collection are improved, and the security and timeliness of data are ensured. It adapts to the data collection needs in complex environments and realizes efficient, safe and reliable control and management of drone data collection.
Patent Information
- Application Number
- CN202411268376.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-11
- Publication Date
- 2024-12-13
AI Technical Summary
The existing drone data collection system is difficult to achieve effective control and management in high concurrency, cross-factory control and out-of-control scenarios. The performance of the data collection module is not sensitive and accurate enough, the storage module capacity is insufficient, the system integration and testing are complex, and data compatibility and security are data. There are problems with sexual intercourse, and traditional ground control stations have high deployment costs and unstable signals, making it difficult to adapt to data collection needs in long distances or special environments.
Using the instruction-level data service bus method, the multi-source heterogeneous system access control module, instruction/data transmission logic channel and data processing and analysis module can realize real-time adaptive access and full-duplex communication monitoring of the UAV system. , automatically allocate logical channels, perform data processing and application service gateway packaging and release, ensuring the accurate transmission and processing of data packets.
Realize real-time, effective, safe and reliable control and management of drone data collection, improve data collection efficiency and quality, reduce costs, adapt to data collection needs in multiple manufacturers and complex environments, and ensure the timeliness of data and Security.
Smart Images

Figure CN119135784A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of drone data collection, and in particular to a drone-based data collection method, device, medium and product. Background Art
[0002] With the rapid development of drone technology and the widespread application of drones of various manufacturers and brands in various fields, the use of drones to replace traditional manual methods or technical means for data collection has become increasingly popular. Especially when drones are fully used for data collection, higher and higher requirements are put forward for the accuracy of data collection, the effectiveness and real-time nature of data collection control and management. Traditional use of drones for data collection and control mainly focuses on the communication guarantee of drone data collection, the data collection and control of drone mission payload equipment, and the data collection and control of a single system or a few drones. At present, with the large-scale application of drones, the access control of drone systems is guaranteed, and the rapid access of drone systems is realized; the communication of drone data collection tasks, the real-time release of drone data collection tasks; the data processing of drone data collection, the safe, effective and real-time transmission of the collected drone data to the data processing center, puts forward higher data collection control and management requirements for drone end users.
[0003] A real-time data collection system in the prior art (application publication number CN113859559A) discloses that four flying paddle mechanisms are arranged on the outside of the fuselage, and the four flying paddle mechanisms are arranged on the outside of the four flying paddle mechanisms, and the four flying paddle mechanisms are fixedly connected to the fuselage. A control module is arranged on the inside of the fuselage, and the control module is connected to the flying paddle mechanism signal, which has the characteristics of good fuselage protection effect and ensuring the stable data collection of the drone; however, the above technology has the following problems: 1. UAV data collection problem: Although the system provides a solution based on remote data collection and local data analysis and processing, it does not verify remote control management based on data processing results, and does not provide technical response solutions for high-concurrency control, cross-manufacturer control and control in out-of-control scenarios of drones. 2. Data collection module performance problem: The data collection module does not have high sensitivity and accuracy, and cannot ensure that the collected data is reliable. 3. Storage module stability and capacity problem: The first storage module and the second storage module do not have sufficient storage capacity to save data, and cannot guarantee that the data will not be lost when impacted. 4. System integration and testing issues: The components described in the solution are multi-disciplinary and need to be integrated into a system for adequate testing; otherwise, their effectiveness and reliability in the actual environment cannot be ensured.
[0004] The prior art UAV cloud data exchange system and method (application publication number CN108536847A) discloses a server and a database, wherein the server includes a UAV real-time data collection and sharing unit and a UAV fence management unit; the UAV real-time data collection and sharing unit is used to collect data of UAVs in the cloud system of each cloud system service provider and process the collected data; each cloud system service provider obtains data of all flying UAVs through the UAV real-time data collection and sharing unit; the UAV fence management unit is used to import UAV fence data, query, update, download UAV fence data, and log in users; the UAV real-time data collection and sharing unit and the UAV fence management unit share the database. However, the above technology has the following problems: 1. UAV data collection problem: Although the system provides a solution based on remote data collection and local data analysis and processing, it does not perform remote control management based on data processing results, and does not provide technical solutions for high-concurrency control, cross-manufacturer control, and control in out-of-control scenarios of UAVs. 2. Data compatibility and standardization issues: UAV data from different cloud system service providers may have different formats and standards, and data compatibility and consistency need to be ensured. 3. Performance issues of real-time data collection: The drone real-time data collection and sharing unit needs to have the ability to efficiently process large amounts of real-time data to ensure the timeliness of the data. 4. Data processing and analysis issues: The collected data needs to be effectively processed and analyzed to extract useful information and support decision-making. 5. Security and privacy protection issues: The data transmitted and stored in the system needs to have strict security measures to prevent data leakage and unauthorized access. 6. User authentication and permission management issues: User login and query, update, download and other operations of drone fence data require strict authentication and permission management. 7. Management issues of drone fence data: The import, query, update and download of fence data need to be accurate to ensure flight safety. 8. Database performance and reliability issues: The database needs to be able to support high concurrent access and storage of large amounts of data while ensuring the accuracy and integrity of the data. 9. Network dependency and stability: The system relies on network connection, and the stability of the network and the reliability of data transmission need to be ensured.
[0005] The existing technology of sewage treatment evaluation system and method based on big data (application publication number CN117591890A) discloses a sewage treatment system, a big data evaluation system, a patrol drone, a 5G base station and an evaluation web display device. The big data evaluation system is used to obtain the historical terminal record data of the ceramic membrane pool in the sewage treatment system; the characteristic factor set analysis module in the big data evaluation system is used to analyze the characteristic factor set of the sewage treatment system, and the safety evaluation module is used to construct the operation safety evaluation module corresponding to the target characteristic factor and calculate the safety evaluation index; the patrol drone is used to collect the status data of the sewage treatment area and is also matched based on the 5G base station and the safety evaluation module in the big data evaluation system; the evaluation response module locates the position of the ceramic membrane and the acquisition sensor, and stores the water quality and other data of the sewage treatment area; the Web display device displays the evaluation data, which can quickly find abnormal problems and deal with them; and the above technology has the following problems: 1. UAV data collection problem: Although the system provides a solution based on remote data collection and local data analysis and processing, it does not perform remote control management based on the verification of data processing results, and does not provide technical response solutions for the high concurrency control, cross-manufacturer control and control of drones in out-of-control scenarios. 2. Data integration and compatibility issues: The big data evaluation system needs to obtain historical terminal record data from the sewage treatment system, which may involve data integration and format compatibility issues of different devices and sensors. 3. Accuracy issues in characteristic factor set analysis: The analysis module needs to accurately identify and analyze the characteristic factor set that affects the operation of the sewage treatment system, which requires the algorithm to be able to process large amounts of data and accurately identify key factors. 4. Issues in building a safety assessment model: To build an operational safety assessment model and calculate the safety assessment index, it is necessary to ensure the scientificity and applicability of the model, and that the index can truly reflect the safety status of the system. 5. Performance and stability issues of inspection drones: Inspection drones need to be able to work stably under various weather and environmental conditions, and be able to accurately collect status data of the sewage treatment area.
[0006] In the data collection based on ground control stations of current UAV systems, the deployment location of ground control stations is limited by the communication distance of UAVs. For UAV flight missions in long distances or special environments such as the sea, ground control stations are difficult to play a role. In addition, the construction and maintenance costs are high, which is not conducive to large-scale deployment. In data collection based on satellite communication, satellite communication is susceptible to weather, such as cloud cover, which may affect the stability of data transmission. In addition, the latency of satellite communication is relatively high, which may not be the best choice for application scenarios that require extremely low latency (such as real-time video monitoring). In data collection based on 4G / 5G networks, the coverage and signal quality of 4G / 5G networks directly affect the effect of data collection, especially in remote areas or urban environments with dense buildings, where there may be problems with unstable signals. In addition, large amounts of data transmission may be limited by network bandwidth. In data collection based on sensor networks, sensor networks need to be deployed in advance, and data collection cannot be performed in areas without sensor coverage. In addition, the maintenance and management of sensor networks also require additional costs and efforts.
[0007] Therefore, in order to realize the control and management of data collection using drones and ensure that drones can collect data in real time, effectively, safely and reliably, it is urgent to provide a new drone-based data collection method. Summary of the invention
[0008] The purpose of this application is to provide a drone-based data collection method, equipment, medium and product to achieve control and management of data collection using drones, and ensure that drones can collect data in real time, effectively, safely and reliably.
[0009] To achieve the above objectives, this application provides the following solutions:
[0010] In a first aspect, the present application provides a method for collecting data based on a drone, wherein the method for collecting data based on a drone is implemented based on an instruction-level data service bus, wherein the instruction-level data service bus includes: a multi-source heterogeneous system access control module, an instruction / data transmission logic channel, a data processing and analysis module, and a data application service gateway; the method for collecting data based on a drone includes:
[0011] Based on the multi-source heterogeneous system access control module, the lightweight communication protocol based on TCP / IP or TCP / UDP is automatically adapted to perform real-time adaptive access to the UAV system; and full-duplex communication monitoring of the UAV system is performed; and management and control are performed according to the monitoring results;
[0012] Based on the type of communication information received from the drone system, the command / data transmission logical channel is used to automatically allocate different logical channels; the communication information type includes: real-time transmitted data, real-time executed commands, offline transmitted data, and high-concurrency commands;
[0013] According to the communication information of the received UAV system, a data processing and analysis module is used to process the data to obtain a data packet set; the data packet set includes: the flight status of the current UAV, the execution result of the task instruction and the abnormal information;
[0014] According to the data application service gateway, the data packet set is packaged and published as an application service for drone data collection.
[0015] Optionally, the multi-source heterogeneous system access control module specifically includes: system protocol automatic configuration service, system automatic access scheduling service, system communication monitoring service and system communication response control service;
[0016] Use the system protocol automatic configuration service and system automatic access scheduling service to automatically adapt to lightweight communication protocols based on TCP / IP or TCP / UDP to perform real-time adaptive access to the UAV system;
[0017] Use the system communication monitoring service to conduct full-duplex communication monitoring of the UAV system;
[0018] Utilize the system communication response control service to conduct real-time control over the communication of UAV system commands / data based on the monitoring results.
[0019] Optionally, the method of automatically allocating different logical channels based on the type of communication information of the received UAV system by using a command / data transmission logical channel may also include:
[0020] An instruction-level data service bus is used to determine multiple bus data service channels; and priorities are assigned according to the traffic of each bus data service channel.
[0021] Optionally, the method of automatically allocating different logical channels based on the type of communication information received from the drone system and using a command / data transmission logical channel specifically includes:
[0022] When the communication information type is real-time transmission data, a real-time data transmission channel is allocated for real-time transmission;
[0023] When the communication information type is a real-time executed instruction, a real-time instruction communication channel is allocated for real-time communication;
[0024] When the communication information type is offline transmission data, multi-channel parallel transmission is performed;
[0025] When the communication information type is a high-concurrency instruction, real-time parallel transmission is performed under the action of the load balancing mechanism.
[0026] Optionally, the step of performing data processing using a data processing and analysis module according to the received communication information of the drone system to obtain a data packet set specifically includes:
[0027] Adapt the UAV system interface protocol according to the docking requirements of the UAV system interface;
[0028] Communication information collection through UAV system interface;
[0029] Classify communication information according to address, protocol, port and binary format; the classification results include static storage information and dynamic transmission instructions;
[0030] Data processing is performed based on the classification results.
[0031] Optionally, the data processing includes: message queue processing, data storage, data collection, data cleaning, data conversion, data aggregation and data calculation and analysis.
[0032] In a second aspect, the present application provides a data collection device based on a drone, which is implemented based on an instruction-level data service bus, wherein the instruction-level data service bus includes: a multi-source heterogeneous system access control module, an instruction / data transmission logic channel, a data processing and analysis module, and a data application service gateway; the data collection device based on a drone includes:
[0033] The access unit is used to automatically adapt the lightweight communication protocol based on TCP / IP or TCP / UDP based on the multi-source heterogeneous system access control module to perform real-time adaptive access to the UAV system; and perform full-duplex communication monitoring of the UAV system; and perform management and control based on the monitoring results;
[0034] An allocation unit, configured to automatically allocate different logical channels based on the type of communication information received from the unmanned aerial vehicle system, using a command / data transmission logical channel; the communication information type includes: real-time transmitted data, real-time executed commands, offline transmitted data, and high-concurrency commands;
[0035] A data processing unit, configured to process data using a data processing and analysis module according to the received communication information of the UAV system to obtain a data packet set; the data packet set includes: the current flight status of the UAV, the execution result of the mission instruction and abnormal information;
[0036] The publishing unit is used to package and publish a set of data packets as an application service for collecting data from drones according to the data application service gateway.
[0037] In a third aspect, the present application provides a computer device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the drone-based data collection method.
[0038] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the drone-based data collection method.
[0039] In a fifth aspect, the present application provides a computer program product, including a computer program, which implements the drone-based data collection method when executed by a processor.
[0040] According to the specific embodiments provided in this application, this application discloses the following technical effects:
[0041] The present application provides a method, device, medium and product for data collection based on drones, which is based on the instruction-level data service bus to control drone system access, drone communication message collection task release communication, real-time data collection control management, data processing and data application service full-cycle control management, and now drones perform full-process control management of real-time data collection; based on the instruction-level data service bus, the scope of data collection is expanded, the safety of operators is guaranteed, the cost of real-time data collection is reduced, and the application of drones in the field of data collection and application services is deepened. This application realizes the control and management of data collection using drones, ensuring that drones can collect data in real time, effectively, safely and reliably, effectively improving the efficiency and quality of data collection, and laying a solid foundation for the application of drones in more fields. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0043] Figure 1 A flowchart of a data collection method based on a drone provided in one embodiment of the present application;
[0044] Figure 2 A schematic diagram of the principle of a drone-based data collection method provided in one embodiment of the present application. DETAILED DESCRIPTION
[0045] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0046] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below with reference to the accompanying drawings and specific implementation methods.
[0047] In an exemplary embodiment, Figure 1 and Figure 2 As shown, a data collection method based on drones is provided. The method is implemented based on an instruction-level data service bus. The instruction-level data service bus includes: a multi-source heterogeneous system access control module, an instruction / data transmission logic channel, a data processing and analysis module, and a data application service gateway.
[0048] The instruction-level data service bus is based on the microservice technology architecture, which supports the decoupling of components within the system:
[0049] (1) Decoupling through system service splitting: split complex monolithic applications into multiple independent, deployable small services, each responsible for a specific business function. Each service can be independently developed, tested, and deployed, reducing mutual dependencies;
[0050] (2) Decoupling through inter-service communication: Microservices communicate with each other through APIs (application programming interfaces) such as RESTful APIs or message queues, making the interaction between services more flexible and reducing the coupling between components;
[0051] (3) Decoupling through data isolation: Each microservice has its own database to avoid data coupling between different services;
[0052] (4) Decoupling through system fault tolerance and elasticity: The microservice architecture supports independent horizontal expansion of each service, improving the system's fault tolerance and elasticity. Problems in one service do not affect the operation of other services, and fault isolation is performed;
[0053] (5) Decoupling through technological diversity: The microservice architecture supports the development of different services using different technologies and programming languages, allowing each service to select the appropriate technology stack based on its own business needs, thereby improving the degree of decoupling of various functional components within the system.
[0054] In the embodiment of the present application, the method includes the following S101 to S104. Wherein:
[0055] S101, based on the multi-source heterogeneous system access control module, automatically adapts to the lightweight communication protocol based on TCP / IP or TCP / UDP to perform real-time adaptive access to the UAV system; and performs full-duplex communication monitoring of the UAV system; and performs management and control based on the monitoring results; S101 can improve the system's access flexibility and communication efficiency, ensuring stable access to the UAV system and real-time and accurate transmission of data.
[0056] S102, based on the communication information type received from the drone system, adopts the command / data transmission logical channel and automatically allocates different logical channels; the communication information type includes: real-time transmitted data, real-time executed commands, offline transmitted data and high-concurrency commands; S102 can ensure high efficiency and low latency of data transmission, meet the needs of real-time monitoring and data analysis, and improve the reliability of data processing.
[0057] S103, based on the communication information received from the UAV system, a data processing and analysis module is used to process the data to obtain a data packet set; the data packet set includes: the current flight status of the UAV, the execution results of the mission instructions and abnormal information; S103 can achieve efficient data processing and resource coordination, ensure data accuracy and timeliness, and provide data support for decision-making.
[0058] S104, according to the data application service gateway, packages and publishes the data packet set as an application service for the drone to collect data. S104 can enhance the practicality and accessibility of data, support fast query and real-time analysis, and improve operational efficiency and service quality.
[0059] The entire process of implementing S101-S104 demonstrates a highly automated, scalable, robust and effective drone control management system mechanism. Through adaptive system connection and communication, efficient data processing and analysis, timely and accurate provision of necessary data support greatly improves the operational performance and service quality of drone data collection. Ensure the high efficiency and high precision operation of the entire system, while having good risk control capabilities, becoming a key technical infrastructure in modern drone system management.
[0060] The multi-source heterogeneous system access control module specifically includes: system protocol automatic configuration service, system automatic access scheduling service, system communication monitoring service and system communication response control service;
[0061] Use the system protocol automatic configuration service and system automatic access scheduling service to automatically adapt to lightweight communication protocols based on TCP / IP or TCP / UDP to perform real-time adaptive access to the UAV system;
[0062] Use the system communication monitoring service to conduct full-duplex communication monitoring of the UAV system;
[0063] Using the system communication response control service, the communication of UAV system commands / data is controlled in real time based on the monitoring results. For example, if the communication efficiency is found to be reduced, communication control is carried out according to the communication guarantee strategy.
[0064] The adaptive docking UAV system in S101 automatically adapts to the system communication interface protocol requirements of mainstream UAV manufacturers, connects to the UAV system, and connects the UAV collected data to the command bus command / data service channel real-time processing mechanism in real time. The implementation is based on: 1. System protocol automatic configuration service (this service is required for new system access) and system automatic access scheduling service, real-time adaptive docking with the UAV system, automatic adaptation of the two lightweight communication protocols based on TCP / IP or TCP / UDP of the UAV system, and real-time adaptive docking (after opening access rights and providing interface examples, the system supports adaptive docking); 2. Full-duplex communication monitoring of the sending and transmission of UAV system communications (system communication monitoring service); 3. System communication response control service based on the monitoring results, real-time rapid response control of the UAV system command / data communication (for example, if the communication efficiency is found to be reduced, communication management and control are carried out according to the communication guarantee strategy, first transmitting real-time command information, and then transmitting offline data information).
[0065] Implement the multi-source heterogeneous system access control module in S101, adapt to the interface requirements of the UAV system in real time, automatically adapt and access the UAV system based on two lightweight communication protocols such as TCP / IP or TCP / UDP, and monitor the sending and transmission of UAV data in real time; track the transmission flow of UAV system data, the connection status of the UAV system and other parameters in real time; connect to the command bus command / data service channel related communication control management functions, build full-duplex communication monitoring and real-time rapid response control between the UAV system and the command-level data service bus, and realize effective control of the access of the UAV system.
[0066] Before S102, it also included:
[0067] An instruction-level data service bus is used to determine multiple bus data service channels; and priorities are assigned according to the traffic of each bus data service channel.
[0068] S102 specifically includes:
[0069] When the communication information type is real-time transmission data, a real-time data transmission channel is allocated for real-time transmission;
[0070] When the communication information type is a real-time executed instruction, a real-time instruction communication channel is allocated for real-time communication;
[0071] When the communication information type is offline transmission data, multi-channel parallel transmission is performed;
[0072] When the communication information type is a high-concurrency instruction, real-time parallel transmission is performed under the action of the load balancing mechanism.
[0073] In the process of automatically allocating different logical channels, load balancing and dynamic adjustment methods are implemented to avoid overloading of a single channel and improve overall transmission efficiency. At the same time, the dynamic adjustment method optimizes the system for immediate new problems that arise in real-time transmission communications through flow monitoring and control, error detection and retransmission, buffer setting and optimization.
[0074] Implement the instruction / data transmission logic channel in S102, allocate various instruction / data transmission logic channels (bus data service channel, determine the communication information type by agreeing on the file structure, program entry point and communication information position of the docking drone system); after distinguishing the communication information to be transmitted, realize channel allocation and efficient transmission; through flow monitoring control, error detection retransmission, buffer setting and optimization, perform system optimization for new problems arising in real-time transmission communication, provide real-time streaming transmission channels for drone collected data (such as transmitting high-definition video images, remote sensing data and other data information requiring low latency and high bandwidth collected by drone mission payloads) to support data transmission and guarantee, and provide offline batch transmission channels for drone collected data (such as drones collect certain types of sensor data, drone system logs and other non-real-time data) to support data transmission and guarantee; instruction-level data service bus instruction / data service channel, manage data transmission through two data transmission methods, ensure the transmission efficiency of various types of data collected by drones in real time, and ensure low latency and high reliability of communication; provide a dedicated data transmission service channel for drone collected data, and perform data security service monitoring.
[0075] Among them, file structure: the organizational form of various files in the UAV system, including flight control programs, map data, sensor data, etc.; program entry: the access interface of various programs in the UAV system, including flight control program interface, UAV data transmission program interface, etc.; communication information location: information of the UAV communication information source system, such as the UAV ground station control system, UAV data transmission communication system, UAV mission management system and UAV flight real-time guidance and monitoring system (remote command personnel can remotely command the UAV flight mission in real time by viewing the monitoring screen, and the on-site management personnel can make immediate adjustments to the current flight mission of the UAV), etc.
[0076] S103 specifically includes:
[0077] Adapt the UAV system interface protocol according to the docking requirements of the UAV system interface;
[0078] Communication information collection through UAV system interface;
[0079] Classify communication information according to address, protocol, port and binary format; the classification results include static storage information and dynamic transmission instructions;
[0080] Data processing is performed based on the classification results, including message queue processing, data storage, data collection, data cleaning, data conversion, data aggregation, and data calculation and analysis.
[0081] The instruction-level data service bus provides data processing for the data information collected by the drone. Based on the communication messages collected and transmitted by the instruction-level data service bus instruction / data service channel, the data processing and analysis module in the instruction-level data service bus performs data processing on the data information collected by the drone through resource coordination and data processing mechanisms such as message queue processing, data storage, data collection, data cleaning / conversion / aggregation, and data calculation and analysis;
[0082] 1. Data collection: automatic collection - through automation tools and scripts, drones can trigger data collection at a fixed time or according to specific events, reducing human intervention and improving the efficiency and accuracy of data collection; conditional trigger collection - set specific conditions, such as weather changes, specific time points, or when sensor readings exceed a threshold, to automatically start data collection to meet specific analysis needs.
[0083] 2. Message queue processing: decoupling system components - message queues allow different components in the data processing process (such as data collection, storage and analysis) to run independently, reducing direct dependencies between components through asynchronous communication, and improving the scalability and fault tolerance of the system; buffering and sorting - the queue acts as a buffer, temporarily storing large amounts of data to prevent the backend processing service from being overloaded due to instantaneous data peaks; at the same time, the message queue ensures that data is processed in a predetermined order, which is especially important for data that requires strict sequential processing. For example, protocols such as data collection open platform transmission control, MQTT message queue telemetry transmission or RESTfulAP are used to detect and ensure the effective data collection process. Once a problem occurs in any processing process, a system alarm will be triggered immediately, and the system administrator will intervene and deal with it, without locking the entire process.
[0084] 3. Data cleaning / conversion / aggregation: Perform data quality management - improve data accuracy and availability by filling missing values, smoothing noisy data, correcting erroneous data, etc. Perform format unification and standardization - convert data from different data sources into a unified format and metric to facilitate subsequent data analysis and comparison.
[0085] 4. Data storage: Implement a tiered storage strategy - store data on storage media with different performance and costs according to the access frequency and importance of the data, such as storing hot data on high-speed SSDs and migrating cold data to lower-cost HDDs or cloud storage; perform backup and recovery - regularly back up data to prevent data loss or damage. The backup can be local or remote to ensure that data can be quickly restored in the event of a disaster.
[0086] 5. Data computing and analysis: Real-time data processing - For applications that require immediate response, such as real-time monitoring and early warning systems, use stream data processing technology to quickly analyze and output results.
[0087] The data processing and analysis module in the instruction-level data service bus is based on the data collected and transmitted by the instruction / data service channel of the instruction-level data service bus, and processes the data through message queue processing, data storage, data collection, data cleaning / conversion / aggregation, etc.; and provides data resource coordination mechanisms such as internal computing, real-time computing, offline computing and data warehouse services to jointly ensure efficient data processing of drone collected data information; the data processing and analysis module packages the processed drone collected data and transmits it to the instruction-level data service bus data application service gateway according to the various uses of drone collected data and various system data requirements of drone mobile phone data, and publishes it to the outside as various data applications.
[0088] The data application service gateway in the instruction-level data service bus publishes data packets required by various purposes and types of systems as application services for drone data collection through a unified access interface for drone data collection.
[0089] The data application service gateway extracts the drone data collection information service package provided by the instruction-level data service bus data processing and analysis module, and publishes the data packages required by various purposes and types of systems as application services for drone data collection through the drone data collection unified access interface;
[0090] Identification mechanism for external data service release: UAV data provides external data application service interface and outputs data service. When connecting to external systems, the purpose of the external system for the drone data service should be confirmed, and its data requirements (usually obtained from the connection agreement, such as: data or information format, communication transmission method, transmission frequency and data visualization display, etc.) should be used for service design, process design, service interface development, and the requirements should be integrated into the system data service list to provide corresponding data services.
[0091] Among them, "service design and process design" is to instruct the bus to design data service requirements and data service processes for external systems that have determined data service requirements; "service interface development" is to transform data service requirement development into system program code based on the above "service design and process design", encapsulate it into a data service system interface, connect to the external system through the interface, publish the data service to the external system, and realize data service.
[0092] Application service support includes: UAV flight monitoring and visualization services, UAV flight status real-time query and analysis services, UAV asset search index, UAV flight mission search index and other types of UAV data application services; according to the demand for UAV data collection application services, guide the data processing and analysis module of the instruction-level data service bus for the data storage, backup and recovery management requirements of UAV collected data information (such as determining the management requirements of data storage and backup resources based on the current data volume and fast query and retrieval requirements; and guiding the data recovery requirements based on the re-query and retrieval requirements after the data backup resources are released).
[0093] The command-level data service bus is used to control drones for real-time data collection. It can adapt to the communication protocols of various drone manufacturers' systems, centrally access drone systems, publish communications for drone data collection tasks, conduct real-time data collection and efficient processing of data information collected by humans and machines, and publish data application services for drone data information collected, thereby realizing the use of drones for real-time data collection and data application services and centralized management and control guarantees.
[0094] Based on the same inventive concept, the embodiment of the present application also provides a drone-based data collection device for implementing the drone-based data collection method involved above. The implementation solution provided by the device to solve the problem is similar to the implementation solution recorded in the above method, so the specific limitations in one or more drone-based data collection device embodiments provided below can refer to the above limitations on the drone-based data collection method, and will not be repeated here.
[0095] In an exemplary embodiment, a drone-based data collection device is provided, which is implemented based on an instruction-level data service bus, wherein the instruction-level data service bus includes: a multi-source heterogeneous system access control module, an instruction / data transmission logic channel, a data processing and analysis module, and a data application service gateway; the drone-based data collection device includes:
[0096] The access unit is used to automatically adapt the lightweight communication protocol based on TCP / IP or TCP / UDP based on the multi-source heterogeneous system access control module to perform real-time adaptive access to the UAV system; and perform full-duplex communication monitoring of the UAV system; and perform management and control based on the monitoring results;
[0097] An allocation unit, configured to automatically allocate different logical channels based on the type of communication information received from the unmanned aerial vehicle system, using a command / data transmission logical channel; the communication information type includes: real-time transmitted data, real-time executed commands, offline transmitted data, and high-concurrency commands;
[0098] A data processing unit, configured to process data using a data processing and analysis module according to the received communication information of the UAV system to obtain a data packet set; the data packet set includes: the current flight status of the UAV, the execution result of the mission instruction and abnormal information;
[0099] The publishing unit is used to package and publish a set of data packets as an application service for collecting data from drones according to the data application service gateway.
[0100] In an exemplary embodiment, a computer device is provided, which may be a server or a terminal. The computer device includes a processor, a memory, an input / output interface (I / O for short) and a communication interface. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface is connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, a data collection method based on a drone is implemented.
[0101] In an exemplary embodiment, a computer-readable storage medium is provided, storing a computer program, and when the computer program is executed by a processor, the steps in the above method embodiments are implemented.
[0102] In an exemplary embodiment, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the steps in the above method embodiments are implemented.
[0103] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.
[0104] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM may be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).
[0105] The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. The non-relational database may include a distributed database based on blockchain, etc., but is not limited thereto. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but is not limited thereto.
[0106] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0107] This article uses specific examples to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand the method and core ideas of this application. At the same time, for those skilled in the art, according to the ideas of this application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting this application.
Claims
1. A data collection method based on drone, characterized in that: The data collection method based on drones is implemented based on an instruction-level data service bus, which includes: a multi-source heterogeneous system access control module, an instruction / data transmission logic channel, a data processing and analysis module, and a data application service gateway; The data collection method based on drones includes: Based on the multi-source heterogeneous system access control module, the lightweight communication protocol based on TCP / IP or TCP / UDP is automatically adapted to perform real-time adaptive access to the UAV system; and full-duplex communication monitoring of the UAV system is performed; and management and control are performed according to the monitoring results; Based on the type of communication information received from the drone system, the command / data transmission logical channel is used to automatically allocate different logical channels; the communication information type includes: real-time transmitted data, real-time executed commands, offline transmitted data, and high-concurrency commands; According to the communication information of the received UAV system, a data processing and analysis module is used to process the data to obtain a data packet set; the data packet set includes: the flight status of the current UAV, the execution result of the task instruction and the abnormal information; According to the data application service gateway, the data packet set is packaged and published as an application service for drone data collection.
2. The drone-based data collection method according to claim 1, characterized in that: The multi-source heterogeneous system access control module specifically includes: system protocol automatic configuration service, system automatic access scheduling service, system communication monitoring service and system communication response control service; Use the system protocol automatic configuration service and system automatic access scheduling service to automatically adapt to lightweight communication protocols based on TCP / IP or TCP / UDP to perform real-time adaptive access to the UAV system; Use the system communication monitoring service to conduct full-duplex communication monitoring of the UAV system; Utilize the system communication response control service to conduct real-time control over the communication of UAV system commands / data based on the monitoring results.
3. The method for collecting data based on a drone according to claim 1, characterized in that: The method of automatically allocating different logical channels based on the type of communication information received from the drone system, using a command / data transmission logical channel, and previously also includes: An instruction-level data service bus is used to determine multiple bus data service channels; and priorities are assigned according to the traffic of each bus data service channel.
4. The method for collecting data based on a drone according to claim 1, characterized in that: The communication information type of the received UAV system is based on the command / data transmission logical channel, and different logical channels are automatically allocated, specifically including: When the communication information type is real-time transmission data, a real-time data transmission channel is allocated for real-time transmission; When the communication information type is a real-time executed instruction, a real-time instruction communication channel is allocated for real-time communication; When the communication information type is offline transmission data, multi-channel parallel transmission is performed; When the communication information type is a high-concurrency instruction, real-time parallel transmission is performed under the action of the load balancing mechanism.
5. The method for collecting data based on a drone according to claim 1, characterized in that: The method of processing the data according to the received communication information of the UAV system using the data processing and analysis module to obtain a data packet set specifically includes: Adapt the UAV system interface protocol according to the docking requirements of the UAV system interface; Communication information collection through UAV system interface; Classify communication information according to address, protocol, port and binary format; the classification results include static storage information and dynamic transmission instructions; Data processing is performed based on the classification results.
6. The drone-based data collection method according to claim 1 or 5, characterized in that: The data processing includes: message queue processing, data storage, data collection, data cleaning, data conversion, data aggregation and data calculation and analysis.
7. A data collection device based on a drone, characterized in that: Based on the instruction-level data service bus, the instruction-level data service bus includes: a multi-source heterogeneous system access control module, an instruction / data transmission logic channel, a data processing and analysis module, and a data application service gateway; the drone-based data collection device includes: The access unit is used to automatically adapt the lightweight communication protocol based on TCP / IP or TCP / UDP based on the multi-source heterogeneous system access control module to perform real-time adaptive access to the UAV system; and perform full-duplex communication monitoring of the UAV system; and perform management and control based on the monitoring results; An allocation unit, configured to automatically allocate different logical channels based on the type of communication information received from the unmanned aerial vehicle system, using a command / data transmission logical channel; the communication information type includes: real-time transmitted data, real-time executed commands, offline transmitted data, and high-concurrency commands; A data processing unit, configured to process data using a data processing and analysis module according to the received communication information of the UAV system to obtain a data packet set; the data packet set includes: the current flight status of the UAV, the execution result of the mission instruction and abnormal information; The publishing unit is used to package and publish a set of data packets as an application service for collecting data from drones according to the data application service gateway.
8. A computer device comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the drone-based data collection method according to any one of claims 1 to 6.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the drone-based data collection method described in any one of claims 1 to 6 is implemented.
10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the drone-based data collection method described in any one of claims 1 to 6 is implemented.
Citation Information
Patent Citations
Drone cloud data exchange system and method
CN108536847A
Real-time data acquisition system
CN113859559A
Sewage treatment evaluation system and method based on big data
CN117591890A
Cited By
Scheduling method and device of controller, equipment and storage medium
CN119356265A
Smart medical information pushing method and system applied to Internet hospital
CN120780893A
Intelligent medical information pushing method and system applied to internet hospital
CN120780893B
