Flight management server and flight management system for unmanned aerial vehicle

Abstract

To automatically set an optimum flight route only by selecting various work objects.SOLUTION: A flight management server according to the present invention is connected to a user terminal and an unmanned aerial vehicle via a network. The flight management server includes a storage unit configured to store flight route information including flight parameters and a plurality of destination Bettobu applications, a reception unit configured to receive a flight request including at least a flight location and a flight purpose, a generation unit configured to generate, based on the flight request, a flight mission including a flight route generated with reference to the flight route information and a flight application selected from the destination Bettobu applications, and a communication unit configured to transmit the generated flight mission to the unmanned aerial vehicle.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a flight management server and a flight management system for an unmanned aerial vehicle. [Background technology]

[0002] In recent years, drones and unmanned aerial vehicles (UAVs) have become increasingly popular. Air vehicles such as the ISS (Aircraft Lift Vehicle) (hereinafter collectively referred to as "Air Vehicles") have begun to be used in industry. In this context, Patent Document 1 describes a drone that collects inspection data from wind turbines. A system is disclosed that creates a flight route that reflects the control status of the wind turbine. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-21491 Summary of the Invention [Problem to be solved by the invention]

[0004] On the other hand, drones are not only used for the inspections mentioned above, but also for security, disaster information gathering, surveying, etc. Various needs have arisen, and the targets are diverse, including solar power generation facilities, bridges, roads, etc. .

[0005] The present invention allows the optimum flight route to be automatically set simply by selecting various work targets. One of our goals is to provide technology that can achieve this. [Means for solving the problem]

[0006] According to the present invention, A flight control system for an unmanned aerial vehicle connected to a user terminal and the unmanned aerial vehicle via a network. a management server, It stores flight route information including flight parameters and multiple flight applications for different purposes. a memory unit for storing the a reception unit that receives a flight request including at least a flight location and a flight purpose; a flight route generated based on the flight request and with reference to the flight route information; and a flight application selected from the purpose-specific flight applications. a generator for generating a transmission; a communication unit that transmits the generated flight mission to the unmanned aerial vehicle; Equipped with Flight management server for unmanned aerial vehicles. [Effects of the Invention]

[0007] According to the present invention, the optimum flight route can be automatically set by simply selecting various work targets. It is possible. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram showing the configuration of a flight management system according to an embodiment of the present invention; [Figure 2] FIG. 2 is a block diagram showing the hardware configuration of the management server of FIG. 1. [Figure 3] FIG. 2 is a block diagram showing the hardware configuration of the user terminal of FIG. 1. [Figure 4] FIG. 2 is a block diagram showing the hardware configuration of the aircraft of FIG. 1. [Figure 5] FIG. 2 is a block diagram showing the functions of the management server of FIG. 1. [Figure 6] FIG. 2 is a block diagram showing the functions of the user terminal of FIG. 1. [Figure 7] 1 is a configuration example of a purpose-specific flight application. [Figure 8] FIG. 1 is a flow diagram of a flight management system according to one embodiment of the present invention. [Figure 9]FIG. 1 is a diagram illustrating an image of use of a flight management system according to an embodiment of the present invention. [Figure 10] FIG. 1 is a diagram illustrating an image of use of a flight management system according to an embodiment of the present invention. [Figure 11] FIG. 1 is a diagram illustrating an image of use of a flight management system according to an embodiment of the present invention. [Figure 12] FIG. 1 is a diagram illustrating an image of use of a flight management system according to an embodiment of the present invention. [Figure 13] 10 is an example of a screen displayed on a user terminal side of a flight management system according to an embodiment of the present invention. [Figure 14] 10 is an example of a screen displayed on a user terminal side of a flight management system according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0009] The contents of the embodiments of the present invention will be listed and explained below. Flight management according to the embodiments of the present invention The server and the flight management system have the following configuration. [Item 1] A flight control system for an unmanned aerial vehicle connected to a user terminal and the unmanned aerial vehicle via a network. a management server, It stores flight route information including flight parameters and multiple flight applications for different purposes. a memory unit for storing the a reception unit that receives a flight request including at least a flight location and a flight purpose; a flight route generated based on the flight request and with reference to the flight route information; and a flight application selected from the purpose-specific flight applications. a generator for generating a transmission; a communication unit that transmits the generated flight mission to the unmanned aerial vehicle; Equipped with Flight management server for unmanned aerial vehicles. [Item 2] The system includes a user terminal, an unmanned aerial vehicle, and a flight management server connected via a network. A flight management system for an unmanned aerial vehicle, The flight management server: It stores flight route information including flight parameters and multiple flight applications for different purposes. a memory unit for storing the A flight request including at least a flight location and a flight purpose is received from the user terminal. ; a flight route generated based on the flight request and with reference to the flight route information; and a flight application selected from the purpose-specific flight applications. Generates a transmission; transmitting the generated flight mission to the unmanned air vehicle; The unmanned aerial vehicle executes the flight mission and writes a flight log to the send it to the flight management server, Flight management system for unmanned aerial vehicles.

[0010] <Details of implementation form> Hereinafter, a flight management device and a flight management system for an unmanned aerial vehicle according to an embodiment of the present invention will be described. Regarding the system, particularly, an embodiment of the flight management system (hereinafter referred to as "the system") In the accompanying drawings, the same or similar elements are designated by the same or similar reference numerals and symbols. and names are given, and overlapping descriptions of the same or similar elements are avoided in the description of each embodiment. In addition, the features shown in each embodiment may be used in conjunction with other embodiments unless they are mutually inconsistent. This is also applicable to the embodiment.

[0011] <Configuration> As shown in FIG. 1, the system includes a management server 1, a plurality of user terminals 2 and 3, The management server 1, the user terminals 2 and 3, and the aircraft 4 are are communicatively connected to each other via a network.

[0012] <Management Server 1> FIG. 2 is a diagram showing the hardware configuration of the management server 1. Note that the configuration shown in the figure is This is an example, and other configurations may be used.

[0013] As shown in the figure, a management server 1 is connected to a plurality of user terminals 2 and 3 and an aircraft 4. The management server 1 is a part of the system. It can be a general-purpose computer such as a personal computer, or it can be a cloud computing system. It may be logically realized by the programming.

[0014] The management server 1 includes at least a processor 10, a memory 11, a storage 12, a transmission / reception device, and a These are electrically connected to each other via a bus 15.

[0015] The processor 10 controls the overall operation of the management server 1 and transmits and receives data between the various elements. A computing device that controls communication, executes applications, and processes information necessary for authentication processing. For example, the processor 10 is a CPU (Central Processing Unit). It is a program for this system stored in the storage 12 and deployed in the memory 11. It executes various programs to process information.

[0016] Memory 11 is DRAM (Dynamic Random Access Memory) The main memory is made up of volatile storage devices such as flash memory and HDD (Hard Disk Drive). and auxiliary storage consisting of non-volatile storage devices such as a disk drive. 11 is used as a work area for the processor 10 and is also used when the management server 1 is started. BIOS (Basic Input / Output System) that runs on It also stores various setting information, etc.

[0017] The storage 12 stores various programs such as application programs. A database storing data used for processing may be constructed in storage 12. stomach.

[0018] The transmitting and receiving unit 13 connects the management server 1 to the network and the blockchain network. The transmitter / receiver 13 is compatible with Bluetooth (registered trademark) and BLE (Blu-ray Disc). It may also have a short-range communication interface (e.g., Bluetooth Low Energy). stomach.

[0019] The input / output unit 14 is a device for inputting information such as a keyboard and a mouse, and a display and other output devices. It is equipment.

[0020] A bus 15 is commonly connected to the above elements, and transmits, for example, address signals, data signals, and Transmits a seed control signal.

[0021] <User terminals 2 and 3> The user terminals 2 and 3 shown in FIG. 3 also include a processor 20, a memory 21, a storage 2 2, a transmitting / receiving unit 23, an input / output unit 24, etc., which are electrically connected to each other through a bus 25. The functions of each element can be configured in the same way as the management server 1 described above. Therefore, detailed description of each element will be omitted.

[0022] <Flying Vehicle 4> 4 is a block diagram showing the hardware configuration of the flying vehicle 4. Flight Controller 41 is a programmable processor (e.g., a central processing unit (CPU)) The system may have more than one processor.

[0023] The flight controller 41 also has a memory 411, and the memory is accessible. The memory 411 can be used to store the flight controller's It stores logic, code, and / or program instructions that are executable by the The flight controller 41 also includes an inertial sensor (acceleration sensor, gyro sensor), a GPS sensor, It may include sensors 412 such as S sensors, proximity sensors (e.g., lidar), etc.

[0024] The memory 411 may be a separate memory such as an SD card or random access memory (RAM). This may include a portable medium or external storage device. The data may be directly transmitted to and stored in a memory. For example, the data may be captured by a camera or the like. The captured still and video data is recorded in the built-in memory or external memory. It is installed via a gimbal 43.

[0025] The flight controller 41 is a control device (not shown) configured to control the state of the aircraft. For example, the control module has six degrees of freedom (translational x, y and z, and rotational motion θ x , θ y and θ z ) the spatial arrangement, speed, and / or Or to adjust the acceleration, use ESC44 (Electric Speed ​​Control The propulsion mechanism (motor 45, etc.) of the aircraft is controlled via the battery 4 The propeller 46 is rotated by the motor 45 supplied with power from the The control module can control one or more of the following: the status of the mounted parts and sensors. Cut.

[0026] The flight controller 41 may be connected to one or more external devices (e.g., a transmitter / receiver (a radio transmitter)). ) 49, terminal, display, or other remote control) and / or The transceiver 49 can communicate with the transceiver 47 configured to receive the signal. Any suitable means of communication may be used, such as wireless communication.

[0027] For example, the transceiver 47 may be connected to a local area network (LAN), a wide area network (WLAN), or Network (WAN), infrared, wireless, WiFi, point-to-point (P2P) network It is possible to use one or more of the following: Cut.

[0028] The transmitter / receiver 47 receives data acquired by the sensors 42 and data generated by the flight controller 41. processing results, predetermined control data, user commands from a terminal or a remote controller, etc. One or more of these can be sent and / or received.

[0029] The sensors 42 according to this embodiment include inertial sensors (acceleration sensors, gyro sensors), GPS sensors, proximity sensors (e.g., lidar), or vision / imaging sensors (e.g., For example, a camera).

[0030] <Management server functions> FIG. 5 is a block diagram illustrating the functions implemented in the management server 1. , a communication unit 110, a flight mission generation unit 130, a report generation unit 150, an application The flight mission generation unit 130 is provided with a routing unit 170 and a storage unit 190. The system includes an application generating unit 132, an application selecting unit 134, an evaluating unit 136, and a correcting unit 138. The storage unit 190 also stores flight route information 192, a flight application for each purpose 194, It includes various databases such as a light log 196 and interface information 198.

[0031] The communication unit 110 communicates with the user terminal 2 and the flying object 4. From the end of the month, the reception department will accept flight requests including at least the flight location and purpose. The flight mission generation unit 130 generates a flight mission. Light missions were selected from 194 flight route and purpose-specific flight applications. The flight route is generated by the route generation unit 192 by referring to the flight route information 192. 132. The flight application is generated by the purpose-specific flight application 194. is selected by the application selection unit 134 with reference to the above.

[0032] In this embodiment, the generated flight mission is evaluated to see if it is appropriate. The evaluation unit 136 may be, for example, User interaction with the app and machine learning based on past flight missions The appropriateness may be evaluated by a score or the like. If not, the flight mission is corrected by the correction unit 138.

[0033] In this embodiment, information acquired by the flying object 4 (still images, videos, audio, etc.) The information is stored in a flight log 196. The report generator 150 generates a report based on the flight log. Based on the above, report information to be transmitted to the user terminal 2 is generated. Examples of reports include the inspection results of facilities subject to inspection and the security results of facilities subject to security. , and can be used as various reports according to needs.

[0034] The interface information 198 is used in conjunction with the application section 170 to display the user terminal 2. It stores various control information for displaying on the device (display, etc.) (see the example screen for , see Figure 10).

[0035] 6 is a functional block diagram implemented in the user terminal 2. The user terminal 2 includes a communication unit 2 10, a storage unit 220, an input unit 240, an output unit 250, and an application unit 270 They contain and interact with each other.

[0036] <Flight applications for specific purposes> As shown in FIG. 7, the purpose-specific flight application 194 is created by the present system. For example, a security and surveillance application is prepared for each purpose (use) of the aircraft 4 that performs the work. Application 1941, Equipment Inspection Application 1942, Surveying Application Applications 1943 and disaster response applications 1944 are examples of, but not limited to, Each application has its own flight control system (altitude, speed, range, etc.) that is suited to the purpose. The information to be acquired and the acquisition conditions (camera resolution, shooting angle, overlap rate, whether or not a filter is used) , planned flight time, required battery capacity, etc.), and other aircraft necessary to accomplish the purpose4 It contains control information.

[0037] The flow of processing in this system will be described with reference to Fig. 8. The user inputs the form from the user terminal 2. Send a light request (SQ101). A flight request must include at least the flight location and flight objectives. The management server 1 refers to the storage unit 190 (see FIG. 5) SQ102), and generate a flight mission (SQ104). The information is transmitted directly (or indirectly via a terminal or a transmitter) to the aircraft 4. (SQ106). Aircraft 4 will transmit the information acquired during the flight mission in real time ( The management server 1 then sends (reports) the information to the management server 1 (SQ108). Generate a report based on the information (flight log) obtained from (SQ110).

[0038] FIG. 9 shows an example of flight mission (flight route) generation for a solar power generation facility. If the inspection area is large, the power supply (battery) of the aircraft and the inspection time should be taken into consideration. In consideration of this, a route may be generated that assumes inspections by multiple aircraft. For flight areas A1 and A2, flight routes R1 and R2 by aircraft 4a and 4b are The information acquired by the aircraft 4a and 4b is generated on the management server 1 side. The information acquired is merged based on the location and time information associated with each piece of information, and a report is generated. The flight routes of multiple aircraft are generated by, for example, sending flight requests to each aircraft. may be transmitted to generate a flight route, or a single flying object as shown in FIG. Based on the flight route R3 generated for the flight request in 4a, as shown in Figure 10(b), Flight routes R4 and R5 are assigned to each aircraft (for example, two aircraft 4a and 4b). Furthermore, as shown in Figure 11, in the flight area A1, which is originally operated by two (multiple) vehicles, , A2, a series of flight routes R6 by one aircraft 4 As shown in FIG. 12, a series of flight routes of one flying object 4 may be generated. Route R6 is a long distance and there is a high possibility of battery exhaustion, so Then, a flight route R7 for replacing the replacement battery 5 may be set.

[0039] <Usage example> FIG. 13 shows the state of the user terminal 2 when accepting input (operation) of a flight request from the user. 10 is a display example displayed on the display DP. As shown in the figure, the user can By selecting the purpose of inspection (not shown) and specifying a specific range S on the map, Flight route R8 is automatically generated. Note that the flight route R8 includes The session can also be customized with additional detailed adjustments from the user. .

[0040] Figure 14 shows a report generated based on still image information acquired by an aircraft. This is an example of a display on the display DP of the terminal 2. As shown in the figure, Map image M (for example, orthoimage based on separately acquired information, or via the Internet, etc.) The still image information P1 acquired by the aircraft is plotted (overlapped) on the map image acquired by the aircraft. By using the "fold" function, the latest information is superimposed on the report so that it is easy to check. The information displayed on the display DP of the user terminal 2 is the plotted still image information. It also displays information useful for inspection (e.g., date and time, information about the aircraft, number of abnormalities, etc.) It may be shown.

[0041] The flying object of the present invention can be used in the aircraft-related industry, such as multicopters and drones. Furthermore, the present invention can be suitably used as an aircraft for aerial photography equipped with a camera or the like. It can also be used in various industries such as security, agriculture, and infrastructure monitoring. It is possible.

[0042] The above-described embodiment is merely an example for facilitating understanding of the present invention, and is not intended to limit the present invention. The present invention is not intended to be construed as a modification or improvement without departing from the spirit of the invention. It goes without saying that the present invention includes equivalents thereof. [Explanation of symbols]

[0043] 1 Management Server 2. User terminal 4 Flying Objects

Claims

1. A flight control system for an unmanned aerial vehicle connected to a user terminal and the unmanned aerial vehicle via a network. a management server, It stores flight route information including flight parameters and multiple flight applications for different purposes. a memory unit for storing the a reception unit that receives a flight request including at least a flight location and a flight purpose; a flight route generated based on the flight request and with reference to the flight route information; and a flight application selected from the purpose-specific flight applications. a generator for generating a transmission; a communication unit that transmits the generated flight mission to the unmanned aerial vehicle; Equipped with Flight management server for unmanned aerial vehicles.

2. The system includes a user terminal, an unmanned aerial vehicle, and a flight management server connected via a network. A flight management system for an unmanned aerial vehicle, The flight management server: It stores flight route information including flight parameters and multiple flight applications for different purposes. a memory unit for storing the A flight request including at least a flight location and a flight purpose is received from the user terminal. ； a flight route generated based on the flight request and with reference to the flight route information; and a flight application selected from the purpose-specific flight applications. Generate a transmission; transmitting the generated flight mission to the unmanned air vehicle; The unmanned aerial vehicle executes the flight mission and writes a flight log to the send it to the flight management server, Flight management system for unmanned aerial vehicles.

Images