Service system and method based on unmanned aerial vehicle

Abstract

The invention discloses a service system and method based on an unmanned aerial vehicle, the service system comprises a support platform, a unified management and control and service platform and a business platform, the support platform is used for providing basic data and a data processing module; the unified management and control and service platform is used for providing functional modules and open capability services of the unmanned aerial vehicle, the open capability services are determined according to the functional modules, and the business platform is used for providing business application scenes of the unmanned aerial vehicle. According to the embodiment of the invention, unified management and control, resource sharing and deep integration with services of the unmanned aerial vehicles can be realized; and meanwhile, data security and operation security are effectively guaranteed, and cost reduction and benefit increase are realized.

Description

Technical Field

[0001] The present invention relates to the field of unmanned aerial vehicle (UAV) application technology, and in particular to a service system and method based on UAV. Background Art

[0002] As a new type of equipment that integrates 5G, IoT, and AI technologies, drones have played a role in many different industry application scenarios and have gradually entered the transportation industry, where they have been used and studied in some practical applications. As drone technology continues to mature and its application deepens, the role of drones in the transportation industry will become more diversified. They can not only improve the operating efficiency of existing transportation systems, but are also expected to play a key role in the construction of intelligent transportation systems, providing continuous technical support and innovative impetus for the intelligent, efficient, and safe development of highways. Through the deep integration and innovative application of these technologies, drones will help the transportation industry move towards a more intelligent, efficient, and safe future.

[0003] With the dual challenges of limited management personnel and increasing management requirements, there is an urgent need for automated, digital, and intelligent technical means to improve the construction, management, and maintenance of highways. In this context, drone technology has gradually been integrated into various highway tasks with its unique advantages. The all-round perspective and maneuverability of drones make them an important tool for the intelligent upgrade of highways, and this view has become a consensus in the transportation industry.

[0004] There is no systematic management and control of drones and low-altitude flight activities, the security of drone data is not effectively guaranteed, and drone data is stored on different Internet platforms, each forming a data island. There are also security risks such as data leakage. Drones are not deeply integrated with businesses, and drone data cannot be shared, resulting in insufficient business collaboration and affecting business processing efficiency. Summary of the invention

[0005] In view of this, in order to solve one of the above problems, the purpose of an embodiment of the present invention is to provide a drone-based service system and method, which can realize drone data sharing, facilitate overall planning and supervision, and reduce costs and increase efficiency for business.

[0006] On the one hand, an embodiment of the present invention provides a service system based on drones, including a support platform, a unified management and service platform and a business platform, wherein;

[0007] The support platform is used to provide basic data and data processing modules;

[0008] The unified control and service middle platform is used to provide the functional modules and open capability services of the drone; the open capability services are determined according to the functional modules;

[0009] The business platform is used to provide business scenario application services for drones.

[0010] Optionally, the basic data includes a digital map, and the data processing module includes a streaming center and / or an AI middle station.

[0011] Optionally, the functional modules of the UAV include any one or more of equipment management, route management, route management, airspace management, plan management, flight scheduling, flight monitoring, flight intelligence, data management, statistical analysis, and system management.

[0012] Optionally, the open capability service includes any one or more of drone access service, drone route service, drone management and control service, drone dispatch service, drone monitoring service, drone intelligence service or drone data service.

[0013] Optionally, the business platform includes a road transport integration platform and / or a road network operation and emergency command and dispatch one-picture platform.

[0014] Optionally, the road transport integration platform can implement any one or more of holiday inspection applications, road network automated inspection applications or slope inspection applications.

[0015] Optionally, the one-picture platform for road network operation and emergency command and dispatch can realize any one or more of applications including emergency monitoring, emergency search and rescue or emergency warning.

[0016] On the other hand, an embodiment of the present invention provides a drone-based service method, which is applied to the above-mentioned service system, including:

[0017] Controlling the support platform to obtain basic data;

[0018] Control the unified control and service middle platform to determine service tasks according to the basic data and the open capability services, and send the service tasks to the drones;

[0019] Obtain the return data sent by the drone, control the unified control and service center and / or the data processing module to process the return data, obtain the processing result, and feed back the processing result to the business platform.

[0020] Optionally, controlling the unified control and service middle platform and / or the control data processing module to process the returned data to obtain a processing result, and feeding the processing result back to the business platform includes:

[0021] The streaming media center of the control data processing module processes the returned data to obtain streaming media data;

[0022] Sending the streaming media data to the unified management and service platform and / or business platform;

[0023] and / or,

[0024] Control the unified management and service center to process the returned data to obtain historical video and / or image data;

[0025] The historical video and / or image data are stored in a unified management and service platform and / or sent to a business platform.

[0026] Optionally, the service method further includes:

[0027] Feeding the streaming media data, historical video and / or picture data back to the AI ​​middle station of the data processing module for processing to obtain an execution result;

[0028] The execution result is sent to the service platform.

[0029] The implementation of the embodiment of the present invention includes the following beneficial effects: The service system based on the drone of this embodiment includes a support platform, a unified management and service middle platform and a business platform. The support platform is used to provide basic data and data processing modules to provide a basis for data sharing and intercommunication. The unified management and service middle platform is used to provide functional modules and open capability services for the drone. The open capability services are determined according to the functional modules to provide diversified open capability services, so that the application of drones can be systematized, which is convenient for overall planning and supervision and reduces safety hazards. The business platform is used to provide business application scenarios for drones to cover a variety of application scenarios, simplify the application of drones, facilitate promotion and data sharing, and reduce costs and increase efficiency for the business. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 is a structural block diagram of a drone-based service system provided by an embodiment of the present invention;

[0031] Figure 2 is a structural block diagram of another drone-based service system provided by an embodiment of the present invention;

[0032] Figure 3 is a structural block diagram of another drone-based service system provided by an embodiment of the present invention;

[0033] Figure 4 is a schematic diagram of a process flow of a drone-based service method provided by an embodiment of the present invention;

[0034] Figure 5 It is a schematic diagram of data flow of a drone-based service system provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0035] The present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. The step numbers in the following embodiments are only provided for the convenience of explanation and description, and the order between the steps is not limited in any way. The execution order of each step in the embodiment can be adaptively adjusted according to the understanding of those skilled in the art.

[0036] Drones: Remotely controlled aircraft and autonomous aircraft are collectively referred to as drones. Autonomous aircraft are unmanned aircraft that do not require the pilot to intervene in the entire or stage of flight. Remotely controlled aircraft are unmanned aircraft that are controlled by a remote control station (station).

[0037] Mission payload: The equipment or devices carried by the UAV aircraft to complete the specified mission. These equipment or devices can be high-definition cameras, thermal imaging sensors, loudspeakers and other professional measurement tools.

[0038] UAV nest: a device that provides storage, landing platform, communication, power supply, load loading and unloading, environmental monitoring, video monitoring and other functions for drones. It is generally composed of a main control system, electromechanical module, communication module, monitoring module and landing platform. Car nest: a car with a UAV nest installed.

[0039] Drone ground station: A device that controls a drone or receives data from a drone, such as a remote controller.

[0040] The drone unified control and service platform is a software platform deployed in a private cloud, which is used to access drones, machine nests, mission payloads and other equipment, and supports equipment management, route management, plan management, data management and drone video live broadcast functions. The platform opens data interfaces for different business systems to connect, so that business systems can obtain drone control capabilities and related data.

[0041] High-precision digital base map: Apply GIS, digital twins, traffic simulation and other technical means to monitor and manage highways in all directions, build a one-picture refined application of business such as road network operation and emergency command and dispatch, road network electromechanical equipment management and maintenance, road facility maintenance and emergency response, and dynamic integration and presentation of road facilities and equipment, explore an open technology cooperation ecosystem and new highway management models, and create a new smart travel experience.

[0042] The AI ​​capability center has built a computing power cluster, and the computing power scale basically meets the needs of AI application research and development; it has a million-level labeled training data set, including sample data such as drone road inspections and under-bridge space inspections, which can provide training data for highway drone AI application scenarios; through the construction of an algorithm market, it carries out AI algorithm ecosystem construction work for drone business and empowers business development.

[0043] Streaming service: A service provided by high-precision digital basemaps, which is an important service to support live streaming. It provides comprehensive drone video processing capabilities, can identify and decode drone encoding formats, and convert them into a unified format for use by other business systems.

[0044] Map-industry integration middle platform: The design of this project is based on the concept of service sharing. On the basis of high-precision digital base map, it integrates highway business system data, base map data, government website data, two passenger and one dangerous goods data and other information to form an industry-specific map-industry integration middle platform, forming a business ecosystem enabled by the middle platform and the front desk, to help digital transformation: integrate maps and data to form a map-industry integration layer, and provide data services, SaaS page services, and component services through business decomposition; provide public services for upper-level applications: data verification, data chain, video streaming, AI algorithm capabilities, etc.

[0045] Vehicle and drone inspection layer: One of the layers of the map industry fusion platform. You can view the inspection status of vehicles and drones.

[0046] Control zone: Bridge control zone or highway control zone refers to a certain range on both sides of the bridge or highway. Except for protection and maintenance needs, the construction of buildings and ground structures within the control zone is prohibited.

[0047] like Figure 1 As shown, an embodiment of the present invention provides a service system based on drones, including a support platform, a unified management and service middle platform and a business platform, wherein;

[0048] Support platform, used to provide basic data and data processing modules;

[0049] Unified control and service platform, used to provide drone functional modules and open capability services; open capability services are determined according to functional modules;

[0050] Business platform, used to provide business application scenarios for drones.

[0051] It should be noted that the types and quantities of basic data and data processing modules in the support platform are determined according to actual applications, and this embodiment does not impose specific restrictions. The types and quantities of functional modules and open capability services of the unified management and service platform are determined according to actual applications, and this embodiment does not impose specific restrictions. The business application scenarios of the business platform are determined according to actual applications, and this embodiment does not impose specific restrictions.

[0052] The support platform provides basic data support and data processing capability support. The unified management and service center builds a basic platform for drone business applications based on the support platform, providing drone access, management, scheduling, data services, etc. The business platform builds drone-based road network inspection and emergency services and other applications based on the above capabilities.

[0053] Optionally, see Figure 2 , the basic data includes digital maps, and the data processing module includes a streaming center and / or an AI middle station.

[0054] Digital maps provide drones with 2D and 3D digital base maps of highways. Based on high-precision digital maps, drone panoramic route planning, high-precision location distribution, playback of drone flight trajectories, and superposition of drone image models can be realized.

[0055] The streaming center provides comprehensive drone video processing capabilities. It can identify and decode the encoding format from the drone and convert it into a unified format for use by other business systems. The streaming center supports the secure transmission of video content, including encapsulation encryption and anti-hotlink processing. At the same time, it also supports transcoding and compression of videos, generating video streams with different bit rates and resolutions to adapt to a variety of client devices such as mobile terminals, PC terminals, and large monitoring screens. In addition, the streaming center can also provide dynamic or static live streaming and on-demand streaming services, and support the distribution of video content to other system platforms or smart devices. To ensure smooth playback in high-concurrency scenarios, the streaming center also has the ability to retrieve multi-source buffers and deploy multi-node clusters, achieving high availability of streaming services.

[0056] The AI ​​middle platform provides a unified data, algorithm and model warehouse. Based on the powerful cloud computing resources and training platform and the open shared architecture of the AI ​​middle platform, drone applications can quickly realize AI recognition functions such as congestion recognition.

[0057] Optionally, see Figure 2 ,The functional modules of UAV include any one or more of equipment management, route management, ,route management, airspace management, plan management, flight scheduling, flight monitoring, ,aviation intelligence, data management, statistical analysis, and system management.

[0058] The drone unified control and service platform (referred to as "drone platform") is a basic capability platform that supports the scenario-based application of drones in highways. The drone platform provides functions such as drone equipment management, operation management, route management, data management, airspace management, flight control, and system management, realizing unified access, unified control, unified scheduling, and unified data management of drones. Based on the above functions, the drone platform opens a series of drone capability services, including drone access services, drone control services, drone scheduling services, and drone data services. Based on the drone capabilities opened by the drone platform, the business system realizes highway applications based on drones.

[0059] Equipment management (drones, nests, loads, models): supports access to drones, nests, loads, weather stations, navigation facilities, communication facilities, airport monitoring and other equipment. It can view the equipment operation status in real time, manage the equipment, and have a global grasp of asset information.

[0060] Route management (waypoint collection, waypoint management): realize three-dimensional waypoint collection and management of highways, including waypoint viewing, route map viewing, and risk assessment (conflict monitoring, obstacle, intersection and other risk detection).

[0061] Route management (route planning, intelligent route planning): Based on a high-precision digital base map, the three-dimensional visualization setting of the drone's flight route and movements is realized. What you see is what you get, and a fast route planning function is provided. Users only need to enter the destination to quickly generate a safe and efficient drone route.

[0062] Airspace management (restricted flight zone setting): realize the management function of airspace resources, including airspace query, flight restriction type setting (restricted flight, no-fly zone), and airspace change warning, to ensure that flight missions are carried out safely in compliant airspace.

[0063] Planning management: Tasks can be quickly planned in the cloud, covering three types of operations: automated operations by the drone nest, flight operations by pilots, and manual operations by pilots.

[0064] Flight scheduling (one-key takeoff, task scheduling): realizes the scheduling and management functions of drone flight missions, supports one-key takeoff, task scheduling and flight conflict detection, and ensures efficient execution and flexible adjustment of flight missions.

[0065] Flight monitoring (live flight, flight control, load control): real-time monitoring of the flight status of drones on highways, real-time conflict prediction and conflict monitoring, and instant warning of risk situations such as abnormal weather, intrusion into restricted flying areas, flight conflicts, etc. During the flight of the drone, by building a drone streaming media service, you can watch the drone live broadcast in real time (supports multiple channels), and also support remote control of loads such as gimbals and loudspeakers, as well as flight pause, continued flight, one-key return, flight direction adjustment, etc.

[0066] Flight information: Provide management and release of internal and external intelligence information such as airspace intelligence, air traffic situation information, meteorological intelligence, and electromagnetic interference intelligence, so that the recipient can respond in a timely manner.

[0067] Data management (media management, data playback, data annotation, standard report): Map the drone-collected data to the geographic space based on the map, playback the flight trajectory and collected data, and integrate and display multi-dimensional data to manage the data.

[0068] Statistical analysis (resource statistics, flight statistics, data statistics): provides statistical analysis functions for platform operation, including resource statistics, flight statistics and data statistics, supports multi-dimensional data analysis and report generation, and helps optimize platform management and flight efficiency.

[0069] System management (organization management, user management, role management, operation log): provides platform user role management, pilot management, integrated system application management, permission management and other functions.

[0070] Optionally, see Figure 2 ,Open capability services include any one or more of drone access ,service, drone route service, drone control service, drone dispatch ,service, drone monitoring service, drone intelligence service or drone data service.

[0071] The drone middle platform opens a series of capability services to the business system to support the business system to realize drone-related functions. The capability services are provided in the form of SaaS pages and API interfaces. The specific open services are: drone access service. Based on the drone equipment access technical standards formulated by the drone middle platform, the drone middle platform provides drone equipment access services of different brands and models to meet different business needs. Drone management and control service. Business systems can use this service to manage drone equipment. Drone dispatching service. Business systems can use this service to dispatch drones for operations. Drone data service. Business systems can use this service to obtain relevant data to support business needs. Drone route service. Business systems can use this service to formulate routes to support drone flight routes. Drone monitoring service. Business systems can use this service to perceive risks such as flight weather anomalies, intrusion into restricted flight zones, and flight conflicts. Drone intelligence service. Business systems can use this service to perceive internal and external intelligence information such as airspace intelligence, air traffic situation information, meteorological intelligence, and electromagnetic interference intelligence.

[0072] Optionally, see Figure 2 The business platform includes a road transport integration platform and / or a road network operation and emergency command and dispatch one-map platform.

[0073] The road transport integration platform is a comprehensive monitoring platform for the group and the road section monitoring center. Based on the drone capabilities opened by the drone platform, the road transport integration platform can realize applications such as holiday inspections based on drones, automated road network inspections, and slope monitoring.

[0074] The one-picture platform for road network operation and emergency command and dispatch realizes the full process management and auxiliary management of emergency events, and realizes the full business process management of emergency command and dispatch from monitoring and alarm, emergency response, emergency disposal, emergency recovery, and emergency assessment. Based on the open drone capabilities of the drone platform, the platform can realize emergency monitoring, emergency search and rescue, and emergency warning applications, and enhance the high-altitude situation awareness and emergency disposal capabilities in emergency command and dispatch.

[0075] Optionally, the integrated road transport platform can implement any one or more of the applications including holiday inspections, automated road network inspections, or slope inspections.

[0076] The specific contents of the road transport integration platform include the following aspects. UAV distribution view: Based on the road network map, you can view the distribution location, idle status, and health status of the machine nests deployed on this road section. You can initiate a UAV inspection task according to the section of the road that needs to be inspected. Inspection task: By creating a one-time inspection task or a scheduled inspection task for a UAV, you can set the inspection nest, inspection time, route, and other information to allow the UAV to automatically inspect. Emergency flight: Through the fast route planning function built by the UAV middle platform, when an abnormal situation occurs in the road network, the monitoring personnel can quickly take off the UAV to the target point with one click. Live video: View the live video of the UAV in flight, and project it to the large screen for monitoring to monitor the on-site situation of the road section in real time. Flight control: By controlling the gimbal and other loads, you can flexibly view the on-site situation. If an abnormal situation occurs, you can use the loudspeaker and other sound and light loads to guide and deal with the on-site situation. Data management: After the UAV inspection, you can replay the UAV flight trajectory and view the collected video and pictures and other data; at the same time, you can annotate the pictures and videos, the trend evolution of the road surface, bridges, and slopes, and generate an inspection report.

[0077] Holiday patrol: Automatically patrol traffic conditions, timely find traffic jams and assist in finding the causes. The drone arrives at the traffic jam site, uses a high-definition camera to remotely transmit the scene, and uses a loudspeaker to guide and publicize traffic safety to ground vehicles, greatly improving the efficiency of traffic police operations. At the same time, it can capture illegal occupation of emergency lanes, etc.

[0078] Automated road network inspection: Automatically inspect and identify road spills, potholes, cracks, breaks, water accumulation, damaged or missing traffic safety facilities, and other issues.

[0079] Slope inspection: Automatically inspect and identify problems such as congestion or rupture of slope drainage systems, slope scour, damaged slope protection, and isolated rocks on the slope.

[0080] Control area inspection: Automatically inspect and identify problems in the control area such as illegal construction and planting, illegal digging and burial, illegal parking and dumping, vagrants, and ignition.

[0081] Tunnel entrance inspection: Automatically inspect and identify whether there are any defects in the tunnel entrance drainage system, high-level water pool, and side slope.

[0082] Optionally, the one-picture platform for road network operation and emergency command and dispatch can realize any one or more of applications including emergency monitoring, emergency search and rescue or emergency warning.

[0083] The one-picture platform for road network operation and emergency command and dispatch specifically includes the following contents:

[0084] Drone distribution view: Based on the road network map, you can view the distribution location of airports deployed on this road section, the idle status of the aircraft nests, the health status of the equipment, and other information. You can also view the drone equipment around the emergency accident point.

[0085] One-click flight: Through the fast route planning function built in the drone platform, the drone can be quickly launched to the emergency target point with one click.

[0086] Live video: You can view live video of the drone in flight and project it onto a large screen for monitoring, so as to monitor the emergency scene in real time and assist in decision-making.

[0087] Drone emergency response: By controlling the drone to drop emergency supplies, controlling infrared and other gimbal loads to search and rescue personnel, and controlling loudspeakers and other sound and light loads to issue early warnings, emergency response can be carried out on site.

[0088] Emergency rescue: As the "third eye flying in the sky", drones can meet the needs of many application scenarios in the transportation industry. They can effectively improve the "visual" range of business personnel, provide high-definition aerial images with a wide coverage, and make up for the lack of fixed video surveillance capabilities. In the event of a traffic accident that requires on-site processing, if the responding personnel are blocked from going to the scene, or the on-site conditions are dangerous and not suitable for immediate entry and exit, drones can arrive at the first time and conduct aerial photography, audio recording, evidence collection, and traffic diversion. In addition, drones can conduct low-altitude monitoring of road accessibility to ensure the rescue route of the rescue team.

[0089] See also Figure 3 The high-precision digital base map includes a map engine, a digital twin engine, and a traffic simulation engine. The high-precision digital base map provides basic support for the unified control and service platform of drones; the data processing module includes an AI capability platform and streaming media services. The AI ​​capability platform includes AI detection services and AI development platforms. The data processing module processes data according to the data provided by the unified control and service platform of drones to provide basic support for data processing; after systematic integration, drones provide route planning, flight management, data collection, data transmission, data storage, data analysis and data distribution and other functions, providing services for specific business application scenarios, such as automated operations, one-click execution by pilots, bridge inspections, slope inspections, holiday inspections, road reform inspections, traffic diversion and emergency rescue.

[0090] See also Figure 4 The embodiment of the present invention provides a drone-based service method, which is applied to the above-mentioned service system, including:

[0091] S100, control support platform to obtain basic data;

[0092] S200, control unified management and service center determines service tasks based on basic data and open capability services, and sends service tasks to drones;

[0093] S300, obtain the return data sent by the drone, control the unified control and service center and / or data processing module to process the return data, obtain the processing results, and feed back the processing results to the business platform.

[0094] Specifically, first, basic data, such as map data, is obtained through the support platform; then, the service tasks are determined according to the basic data and open capability services through the unified control and service middle platform, and the service tasks are issued to the drone. For example, the unified control and service middle platform determines the drone route according to the map data and route management, and sends the drone route to the drone; finally, the drone sends the video data taken according to the route to the unified control and service middle platform and / or the business platform.

[0095] Optionally, controlling the data processing module to process the returned data, obtaining a processing result, and feeding the processing result back to the business platform includes:

[0096] S310, the streaming media center of the control data processing module processes the returned data to obtain streaming media data;

[0097] S320, sending the streaming media data to the unified management and service center and / or business platform.

[0098] Specifically, the streaming media center of the data processing module is responsible for the unified collection and distribution of live video streams, format conversion or encoding of the returned live video data, obtaining live stream data, and distributing the live stream data to the drone unified management and control center and other business applications to realize the viewing and application of live video data; and distributing the live stream data to the AI ​​capability center to realize online real-time AI recognition.

[0099] Control the unified management and service center to process the returned data, obtain the processing results, and feed the processing results back to the business platform, including:

[0100] S330, controlling the unified control and service center to process the returned data to obtain historical video and / or image data;

[0101] S340. Store the historical video and / or image data in a unified management and service platform and / or send it to the business platform.

[0102] Specifically, the unified control and service center receives the return data sent by the drone, controls the unified control and service center to extract or filter the return data, obtains historical video and / or image data, stores the historical video and / or image data in the unified control and service center, and sends the historical video and / or image data to the business platform.

[0103] Optionally, the service method also includes:

[0104] S330, feeding back the streaming media data to the AI ​​middle station of the data processing module for processing to obtain an execution result;

[0105] S340: Send the execution result to the business platform.

[0106] Specifically, the streaming media data is fed back to the AI ​​middle station of the data processing module for processing to obtain the execution result, such as feeding the streaming media data back to the AI ​​middle station of the data processing module for processing target detection to obtain the target detection result, and then sending the execution result to the business platform for data display or data application.

[0107] In a specific embodiment, see Figure 5 ,The data flow in the drone-based service process is as follows.

[0108] High-precision maps provide map data for the unified drone control and service center (drone center) and business system. The drone center sends flight missions to the machine nest, which controls the flight of the drone. The drone center supports remote operation of drone flights and payloads. The drone center can create flight missions for pilots. Pilots receive flight missions in the flight control app to control drones and payloads. The drone center does not support remote operation from the cloud center for remote-controlled drones.

[0109] The status data of the drone during flight is transmitted back to the drone platform through the flight control APP or the airport. The drone platform development interface can transmit the status data to the business system.

[0110] After the drone flight is completed, the pictures and historical video data are transmitted back to the drone platform through the flight control APP or the airport. The drone platform development interface can transmit the status data to the business system or AI algorithm service.

[0111] The live broadcast data of the drone during flight is pushed to the streaming service through the flight control APP or the airport, and distributed by the streaming service to the drone middle platform, business system, AI algorithm service and other application terminals.

[0112] AI algorithm services can connect to business systems, obtain images and historical videos after flight missions set by the business system, perform offline reasoning, or obtain drone live streams for real-time reasoning based on the flight plan being executed by the business system, and synchronize monitoring events to the business system.

[0113] The following uses bridge inspection and tunnel emergency rescue as examples to illustrate the drone-based service process.

[0114] S1. Construction of base map data: First, use drones to collect data on the entire bridge, the landforms under the bridge, and the landforms within 50 meters on both sides of the bridge, and use professional modeling software to process the data and generate two-dimensional orthophotos and three-dimensional models with a resolution of no more than 5cm. After data processing, the two-dimensional and three-dimensional data results are loaded into the high-precision digital base map. On the one hand, the high-precision base map can be continuously updated and enriched, and reused for other functional requirements of the original high-precision base map. On the other hand, it can support the visual high-precision route setting of bridge inspections, providing a good foundation for the automated inspection of bridge inspections. It can also associate, display and manage the attribute information of bridge components and inspection information with the three-dimensional model, so that operation and maintenance managers can more intuitively judge the real situation of the bridge.

[0115] S2. Route planning: Visual route planning for bridge inspections is carried out through the drone platform, and on-site verification is carried out, and adjustments are made according to the on-site terrain to ensure flight safety. Route planning must ensure legality and compliance, and airspace applications and flight reports must be made in accordance with relevant requirements. The planned routes are as follows:

[0116] S21, under-bridge inspection route: The drone flies outside the bridge, 10 meters horizontally away from the bridge's outer guardrail, parallel to the bridge's outer guardrail edge, -1 meter high relative to the bottom of the beam, with the gimbal perpendicular to the bridge's centerline and the gimbal pitch angle -60°. One route is planned for each side of the bridge, for a total of two routes.

[0117] S22, bridge control area inspection route: The drone flies along the middle of each side of the control area and parallel to the bridge guardrail, with a relative height of 30 meters relative to the bridge deck, the gimbal is parallel to the center line of the bridge, and the gimbal pitch angle is -60°. One route is planned for each side of the bridge, for a total of two routes.

[0118] S23, bridge inspection route: The drone flies on the outside of the bridge, 5 meters horizontally away from the bridge's outer guardrail, parallel to the bridge's outer guardrail edge, 15 meters above the bridge deck, with the gimbal perpendicular to the bridge's centerline and the gimbal pitch angle -45°. One route is planned for each side of the bridge, for a total of two routes.

[0119] S24, beam inspection route: The drone is equipped with a gimbal and a camera. It flies in a U-shaped pattern along the longitudinal direction of the beam at the bottom of the bridge, between each bridge collapse (there is a drone navigation signal at the bottom of the bridge). The aircraft is -1.5 meters high relative to the bottom of the beam, and the camera is facing the bottom of the beam. A route is planned for each bridge collapse.

[0120] S25, support inspection route: The drone is equipped with a gimbal and a camera, and flies parallel to the cap beam at the bottom of the bridge (there is a drone navigation signal at the bottom of the bridge). The aircraft is -0.6 meters higher than the bottom of the beam, and the lens is facing the support. The supports on the cap beams at both ends of each collapsed bridge are combined to plan a route, that is, one route for each collapsed bridge.

[0121] S26, Ground inspection route: Reuse the inspection data of the space under the bridge and no longer set a separate route.

[0122] S3. Automatic inspection: Automatic inspection is achieved through the middle platform. The middle platform supports the establishment of scheduled tasks or temporary special inspection tasks for drones according to the required frequency, and sends routes to drones through the machine nest or flight control APP to achieve fully automated operation of drones, visual monitoring of the entire operation, and automatic data transmission in real time, which is flexible and efficient. Automatic inspection is carried out according to the actual required frequency. The tentative inspection frequency is as follows: (1) once a day for the space under the bridge; (2) once a day for the bridge control area; (3) once a day for the bridge deck; (4) once a half-monthly for the beam inspection; (5) once a half-monthly for the bearing inspection.

[0123] S4. Data analysis: There are two main ways to analyze data. One is to manually identify and report in the business-side application management system, and the other is to use AI capabilities to automatically identify problems and automatically generate reports. Using AI capabilities for data analysis can reduce the difficulty and workload of manual identification and improve the accuracy and efficiency of bridge inspections.

[0124] The following takes tunnel entrance emergency rescue as an example to illustrate the drone-based service process.

[0125] S01. Equipment preparation: Select UAVs and their payloads for emergency rescue scenarios. The UAVs are equipped with sound and light warning devices, loudspeakers and high-resolution cameras. They can play historical recordings in rotation and can make real-time remote calls through a remote control to achieve a warning effect.

[0126] S02, equipment and software access: The drone nest, drone, and drone mount are connected to the drone unified control and service center. The drone center is connected to the road network operation and emergency command and dispatch in one map, enabling live broadcast and historical data viewing.

[0127] S03. Route planning: When road maintenance personnel receive accident alarms from the monitoring center, they conduct visual route planning through the drone platform and call the drone to the tunnel entrance for early warning.

[0128] S04. Execute warning tasks: After the drone arrives at the scene, road maintenance personnel or business personnel such as the monitoring center can remotely view the drone live broadcast through the cloud platform (a business system that has been connected to the drone unified control and service center). Road maintenance personnel operate the drone to fly at a low altitude at the tunnel entrance to shout warnings. The drone carries an LED warning screen and provides sound and light warnings at the same time.

[0129] S05, automatic return to the nest: After completing the warning mission, the drone automatically flies back to the nest.

[0130] The embodiments of the present invention have the following beneficial effects:

[0131] (1) Systematic use of resources: This solution integrates technical resources such as drone platform, high-precision digital base map, streaming media, AI capability platform, and road transport integration, making the application of drone technology simpler, safer, and more systematic, and fully empowering the highway industry.

[0132] (2) Build a drone middle platform that integrates management, control and services, and establish a unified equipment access standard: unified access standards, support access to drones of various brands and models, and realize remote control; realize data sharing and interoperability.

[0133] (3) Rapid planning of drone routes on highways can be achieved based on maps, which can simplify the planning process and difficulty of drone routes and improve the professionalism and safety of drone flights.

[0134] (4) Flexible scheduling, command and automated operation support.

[0135] (5) Unify data standards and conduct data collection in a unified manner to facilitate data governance and ensure data security.

[0136] The above is a specific description of the preferred implementation of the present invention, but the invention is not limited to the embodiments. Those skilled in the art may make various equivalent modifications or substitutions without violating the spirit of the present invention. These equivalent modifications or substitutions are all included in the scope defined by the claims of this application.

Claims

1. A service system based on drones, characterized in that: It includes support platform, unified management and control, service platform and business platform, among which; The support platform is used to provide basic data and data processing modules; The unified control and service middle platform is used to provide the functional modules and open capability services of the drone; the open capability services are determined according to the functional modules; The business platform is used to provide business scenario application services for drones.

2. The service system according to claim 1, characterized in that: The basic data includes a digital map, and the data processing module includes a streaming media center and / or an AI middle station.

3. The service system according to claim 1, characterized in that: The functional modules of the UAV include any one or more of equipment management, route management, route management, airspace management, plan management, flight scheduling, flight monitoring, flight intelligence, data management, statistical analysis, and system management.

4. The service system according to claim 1, characterized in that: The open capability service includes any one or more of drone access service, drone route service, drone management and control service, drone dispatch service, drone monitoring service, drone intelligence service or drone data service.

5. The service system according to claim 1, characterized in that: The business platform includes a road transport integration platform and / or a road network operation and emergency command and dispatch one-picture platform.

6. The service system according to claim 5, characterized in that: The road transport integration platform can realize any one or more of the applications including drone-based holiday inspections, automated road network inspections, slope monitoring, etc.

7. The service system according to claim 5, characterized in that: The one-picture platform for road network operation and emergency command and dispatch can realize any one or more of emergency monitoring applications, emergency search and rescue applications, or emergency warning applications.

8. A service method based on drone, characterized in that: The service system according to any one of claims 1 to 5, include: Controlling the support platform to obtain basic data; Control the unified control and service middle platform to determine service tasks according to the basic data and the open capability services, and send the service tasks to the drones; Obtain the return data sent by the drone, control the unified control and service center and / or the data processing module to process the return data, obtain the processing result, and feed back the processing result to the business platform.

9. The service method according to claim 8, characterized in that: The unified control and service platform and / or the control data processing module processes the returned data to obtain a processing result, and feeds the processing result back to the business platform, including: The streaming media center of the control data processing module processes the returned data to obtain streaming media data; Sending the streaming media data to the unified management and service platform and / or business platform; and / or, Control the unified management and service center to process the returned data to obtain historical video and / or image data; The historical video and / or image data are stored in a unified management and service platform and / or sent to a business platform.

10. The service method according to claim 9, characterized in that: The service method also includes: Feeding the streaming media data, the historical video and / or the image data back to the AI ​​middle station of the data processing module for processing to obtain an execution result; The execution result is sent to the service platform.

Images