Flight control system
The flight control system allows for safe and easy manual control of unmanned aerial vehicles by using a control device with estimation units to guide the aircraft along a virtual flight line, addressing the need for advanced piloting skills and path flexibility.
Patent Information
- Application Number
- JP2024137504
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-19
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2041-03-17
AI Technical Summary
Existing flight control systems for unmanned aerial vehicles require advanced piloting skills for manual control, and autonomous flight lacks flexibility in dynamically changing flight paths.
A flight control system with a control device that includes an operation input section, position estimation, posture estimation, speed estimation, and a flight control unit, allowing manual control of unmanned aircraft along a virtual flight line without requiring advanced skills, using a propulsion mechanism controlled by these estimations.
Enables safe and easy manual control of unmanned aerial vehicles without the need for advanced piloting skills, ensuring the aircraft follows a predetermined flight path and maintains stability.
Smart Images

Figure 2024164099000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a flight control system for an air vehicle. [Background technology]
[0002] In recent years, unmanned aerial vehicles (UA), such as drones, have been used for a variety of purposes. Using aircraft including unmanned aerial vehicles (UAVs) and rotorcraft Various services are provided, including aerial photography.
[0003] The flight control method for the aircraft may be, for example, manually using a control device such as a so-called "radio transmitter." There are two methods known: one for controlling the drone by hand and one for flying autonomously according to a pre-set flight plan. (See Patent Document 1). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2015-37937 A Summary of the Invention [Problem to be solved by the invention]
[0005] By the way, when manually operating a drone using a control device, the pilot must have high skills. However, there is a problem that people with little piloting experience cannot operate it easily. When flying, you only need to follow the flight plan and adjust it according to various in-flight situations. However, it is difficult to dynamically change the flight speed and direction.
[0006] The present invention is a flight control system that enables safe manual control of an aircraft without requiring advanced piloting skills. The present invention aims to provide a stem. [Means for solving the problem]
[0007] According to the present invention, a control device having an operation input unit and a control operation based on a control signal from the control device are provided. and an unmanned aerial vehicle capable of being flight-controlled by the The unmanned aerial vehicle includes: A propulsion mechanism including a plurality of rotors; A position estimation unit that estimates a position of the unmanned aerial vehicle; An attitude estimation unit that estimates the attitude of the unmanned aerial vehicle; A speed estimation unit that estimates a moving speed of the unmanned aerial vehicle; The propulsion mechanism is controlled based on information including the current position, attitude, and velocity of the unmanned aerial vehicle. A flight control unit for controlling the The flight control unit controls the flight control device in response to an operation of the operation input unit in one axial direction by a pilot. Based on the control signals sent from the aircraft, the aircraft follows a virtual flight line that is set up in advance on a map. A flight control system for controlling the propulsion mechanism to fly along a can be done. Effect of the Invention
[0008] According to the present invention, a flight that does not require advanced piloting skills and allows safe manual piloting of an aircraft is possible. A control system may be provided. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a diagram showing the configuration of a flight control system according to the present invention. [Diagram 2] FIG. 2 is a functional block diagram showing the configuration of the aircraft of FIG. 1. [Diagram 3] FIG. 2 is a functional block diagram showing the configuration of the control device of FIG. 1. [Figure 4] FIG. 2 is a plan view showing an example of a flight line. [Diagram 5]FIG. 11 is a plan view showing another example of a flight line. [Figure 6] FIG. 11 is a plan view showing yet another example of a flight line. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] The contents of the embodiments of the present invention will be listed and described below. The system has the following configuration. [Item 1] A control device having an operation input unit and capable of flight control based on control signals from the control device and an unmanned aerial vehicle, The unmanned aerial vehicle includes: A propulsion mechanism including a plurality of rotors; A position estimation unit that estimates a position of the unmanned aerial vehicle; An attitude estimation unit that estimates the attitude of the unmanned aerial vehicle; A speed estimation unit that estimates a moving speed of the unmanned aerial vehicle; A flight controller that controls the propulsion mechanism based on the current position, attitude, and speed of the unmanned aerial vehicle. A row control unit; The flight control unit controls the flight control device in response to an operation of the operation input unit in one axial direction by a pilot. Based on the control signals sent from the aircraft, the aircraft follows a virtual flight line that is set up in advance on a map. A flight control system comprising: a flight control mechanism that controls the propulsion mechanism to fly along a path. [Item 2] The flight control device or the unmanned aerial vehicle may then be configured to detect the location of the map data corresponding to each end of the flight line. a flight line setting unit that sets the flight line based on position information of two points on the data; 2. The flight control system of claim 1, [Item 3] The unmanned aerial vehicle includes: A direction estimation unit that estimates a heading direction of the unmanned aerial vehicle, The flight control unit controls the propulsion mechanism based on the current heading direction. A flight control system according to item 1 or 2. [Item 4] The unmanned aerial vehicle includes: An imaging unit capable of capturing an image; an imaging direction estimation unit that estimates an imaging direction of the imaging unit; Controlling the heading direction of the unmanned aerial vehicle or the direction of the gimbal supporting the imaging unit Item 3. The imaging direction control unit controls the imaging direction to change the imaging direction. Flight control system. [Item 5] The flight line is a straight line as a whole. Tem. [Item 6] The flight control method according to any one of claims 1 to 4, wherein the flight line has a bend or curve. system.
[0011] <Details of the embodiment of the present invention> Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The embodiment is merely an example, and other known elements may be used depending on the application, purpose, scale, etc. or alternative measures can be adopted.
[0012] As shown in FIG. 1, the system 1 according to the present invention includes a control device 10 operated by a pilot. and an unmanned aerial vehicle (20) capable of flying based on a control signal transmitted from a control device (10). In the present system 1, the pilot can manually fly the unmanned aerial vehicle 20. By operating the operation input unit 13 of the device 10 in one axial direction, a preset virtual space is created. The unmanned aerial vehicle 20 can fly along the flight line FL in the embodiment. In addition to the above configuration, the pilot device 10 and the unmanned aerial vehicle 20 are connected to a network. The network may also include a management terminal, a repeater, and the like that are connected via the network.
[0013] <Control device configuration> The control device 10 has the functional blocks shown in FIG. 11, memory unit 12, operation input unit 13, transmission / reception unit 14, display unit 15, flight line setting unit 16 The functional blocks in FIG. 2 are for reference only, and the control device 10 may include other functions in addition to those described above. The device may also include other components (for example, an operation unit such as a button).
[0014] The control unit 11 includes, for example, a processor. The control unit 11 controls the operation of each part of the control device 10. Signal processing (generation, output, transmission / reception) for the overall control of the The control unit 11 performs input / output processing, data calculation processing, and data storage processing. Based on the operation of the operation input unit 13, the unmanned aerial vehicle is operated while appropriately referring to the information stored in the memory unit 12. The control unit 11 can generate control signals for controlling the flight of the aircraft 20. A control signal is transmitted to the unmanned aerial vehicle 20 (via the transceiver unit 14) to remotely control the unmanned aerial vehicle 20. This allows the pilot device 10 to remotely control the movement of the unmanned aerial vehicle 20. The control device 10 controls the unmanned aircraft by sending signals to change the flight direction, flight speed, flight acceleration, etc. The signal can be transmitted to the aircraft 20.
[0015] The memory unit 12 stores, for example, programs that define the operation of the control device 10 and data of setting values. The ROM in which the memory is stored temporarily stores various information and data used during processing by the control unit 11. The storage unit 12 may include a memory other than the ROM and the RAM. The memory unit 12 may be provided inside the control device 10 or may be removable from the control device 10. The memory unit 12 can store information about the flight line FL. do.
[0016] The transceiver unit 14 includes a transmitter that transmits control signals and the like based on operational input to the unmanned aerial vehicle 20; The receiver that receives signals from unmanned aerial vehicles is integrated into the transmitter. The transceiver unit 14 may be provided for any suitable communication such as wired communication or wireless communication. For example, the transceiver unit 25 can be a local area network (LAN). LAN, wide area network (WAN), infrared, wireless, WiFi, point P2P networks, telecommunications networks, cloud communications, etc. The transmitter / receiver 25 can use one or more of the following: Bluetooth (registered trademark) ) and short-range communication interfaces such as BLE (Bluetooth Low Energy) The device may also include a base.
[0017] The display unit 15 displays various information acquired by the control device 10 (for example, information received from the unmanned aerial vehicle 20). The display unit 15 displays the flight data (e.g., flight images, flight data, etc.) on the screen. The display unit 15 may be attached to the control device 10 or may be detachably provided from the control device 10. The input device may be configured with a touch panel capable of accepting the above input.
[0018] The operation input unit 13 receives operation input by the operator. The operation input unit 13 includes at least The input device is configured to allow input of operation in one axis direction even when the input device is in the middle. The input includes an operation input to one side from a standing state and an operation input to the other side. One side and the other side of the input unit 13 in the axial direction are the flight line of the unmanned aerial vehicle 20. It corresponds to the flight direction on one side and the other side along the FL.
[0019] The operation input unit 13 includes a control stick that can be tilted left and right, a pair of push buttons (left and right) (including the left and right buttons of the keyboard) or a rotary dial, but not limited to For example, when the operation input unit 13 is a control stick, By tilting the device to one side in the left-right direction from the original state, This allows the control device 10 to input an operation to the other side. Based on the operation input from the signal unit 14) to one side and the other side in a single axis direction toward the unmanned aerial vehicle 20, The operation input unit 13 transmits an operation signal based on the received signal. The direction can be a vertical direction (pushing and pulling direction), but is not limited thereto. do not have.
[0020] It is preferable that the operable direction of the operation input unit 13 is limited to only the above-mentioned one axial direction. However, the present invention is not limited to this. The operation input unit 13 of this embodiment is operated only in the left and right directions. Since the input is limited, the operation is not complicated and the unmanned aerial vehicle 20 can be easily manually operated. It is possible.
[0021] The control device 10 also includes a flight start button for issuing a request to start flight. When the flight start button is pressed, for example, the control unit 11 of the control device 10 The control signal is output to instruct the aircraft to fly to a specified position by referring to the memory unit 12, and the control signal is ignored. The unmanned aerial vehicle 20, which is stationary on the ground, receives the control signal. When it receives the signal, it autonomously flies to a specified aerial position (specified latitude, longitude, and altitude) and The drone then hovers at that position.
[0022] The entire or part of the control device 10 may be, for example, a smartphone having a touch panel screen. The information processing device may be a touch panel, a tablet terminal, or the like. The image icons of the control stick, etc. displayed on the screen constitute the operation input unit. You can tap (touch the screen with your finger) or slide (click the screen to move the (To move a finger by sliding it in any direction while keeping the finger in contact with the surface) Various operation inputs can be performed.
[0023] The operator performs a control operation such as tilting the operation input unit 13 to one side or the other in an axial direction. Then, the control unit 11 of the control device 10 outputs a control signal corresponding to the operation input, and the unmanned aerial vehicle The control signal includes information about the direction (one side or the other side), the degree of control, and the Information about the angle at which the control stick is tilted, the distance the control icon on the touch panel is moved Based on the directional information in the control signal, the flight direction of the unmanned aerial vehicle 20 is The flight of the unmanned aerial vehicle 20 is controlled based on information regarding the degree of operation in the control signal. That is, the flight control system 10 controls the flight of the unmanned aerial vehicle 20 along the flight line FL. A signal indicating the row direction (horizontal movement direction) can be output and transmitted to the unmanned aerial vehicle 20. In addition, the control device 10 of this embodiment transmits a signal instructing the flight speed of the unmanned aerial vehicle 20. The control device 10 can provide instructions regarding the flight altitude of the unmanned aerial vehicle 20, takeoff instructions, and other instructions. Indications, landing instructions, hovering (stopping in the air) instructions, changing the direction (shooting direction) of the camera 26 The drone outputs control signals indicating the direction of the drone, such as the direction of the aircraft (heading direction), etc. The image capturing direction may be controlled by controlling the gimbal 27 of the camera 26. You can change the direction of the camera, or change the direction of the camera to change the shooting direction. It may also be.
[0024] The transceiver 14 can receive signals from the unmanned aerial vehicle 20. For example, images captured by the camera 26 of the unmanned aerial vehicle 20 and voices captured by the microphone may be transmitted to the pilot. The display unit 15 (monitor, etc.) of the device 10 may display the information or output the information from a speaker. can.
[0025] The flight control device 10 is equipped with a flight line setting unit 16 for setting a flight line FL. The flight line setting unit 16 may, for example, determine the positions of two points corresponding to both ends of the flight line FL. Based on the position information and the shape information of the line connecting two points, a flight line FL of any shape is stored. The flight line setting unit 16 can set the flight line on the map data stored in the unit. Based only on the position information, the straight line (segment) connecting these two points is set as the flight line FL. Also, information on the shape of a line other than a straight line can be input by a user using a touch panel or the like. The flight line can be input by drawing through the flight line setting unit 1. 6 is a two-dimensional map displayed on a touch panel or other device, on which the pilot inputs (draws, selects) A flight line FL can be set based on information on the shape and position of the single line.
[0026] The flight line setting unit 16 may be provided in the unmanned aerial vehicle 20 or may be connected to the unmanned aerial vehicle 20 via a network. Alternatively, the control terminal may be provided in a control terminal connected to the control device 10 or the unmanned aerial vehicle. For example, one or more unmanned aerial vehicles can simultaneously transmit and receive information, and one or more unmanned aerial vehicles can simultaneously transmit and receive information. The flight of the aircraft can be managed. The management terminal is connected to a database, for example. The management terminal is a general-purpose computer such as a workstation or a personal computer. It may be a computer or it may be logically realized by cloud computing. The management terminal may include, for example, a processor, a memory, a storage, a transmission / reception unit, an input / output unit, These are electrically connected to each other via a bus.
[0027] <Unmanned Aerial Vehicle Configuration> In this embodiment, the unmanned aerial vehicle 20 UAV (UAV) is an aircraft, drone, or multicopter. opter), RPAS (remote piloted aircraft syst) EMS), or UAS (Unmanned Aircraft Systems), etc. You may be called.
[0028] The unmanned aerial vehicle 20 has the functional blocks shown in FIG. The above configuration is for reference only and can be modified as appropriate. Ra 21 (flight control unit), memory 22 (storage unit), sensors 23, battery 24, transmission and reception unit 25, camera 26 (imaging unit), gimbal 27, ESC 29, motor 30, and propeller The unmanned aerial vehicle 20 is equipped with a rotor 31 (rotor). The camera 26 may be fixed. By providing a gimbal 27, the unmanned aerial vehicle 20 The orientation of the camera 26 relative to the main body can be changed.
[0029] The flight controller 21 is a so-called processing unit. A single processor (e.g., a central processing unit (CPU), MPU, or DSP) The processing unit can have access to the memory 22. The memory 22 may include a processor that is executable by the processing unit to perform one or more steps. The memory 22 may store logic, code, and / or program instructions. , SD card, random access memory (RAM), or other separable media or external storage The data acquired from the camera and sensors 23 is stored in the memory 22. For example, still and video data captured by a camera 26 may be directly transmitted and stored. The data is recorded in the built-in memory or external memory.
[0030] The processing unit may include a control module configured to control the state of the unmanned aerial vehicle 20. For example, the control module may have six degrees of freedom (translational x, y, and z, as well as rotational motion θ x , θ y and θ z ) the spatial arrangement, speed, and / or In order to adjust the acceleration, the propulsion mechanism (ESC 29, motor 30, and propeller) of the unmanned aerial vehicle 20 The control module controls the status of the onboard unit and the sensors 23. The flight controller 21 controls the flight control signal from the control device 10. Based on the signal, the flight of the unmanned aerial vehicle 20 can be controlled. The map information including two-dimensional or three-dimensional map data stored in the storage unit, the unmanned aerial vehicle Based on the current position information, attitude information, speed information, acceleration information, etc. of the aircraft 20, The flight controller 21 can control the flight of the aircraft 20. Based on the received control signal, the unmanned aerial vehicle 20 moves to one side or the other along the flight line FL. The propulsion mechanism can be controlled so that the drone flies in one direction. 1 indicates that the unmanned aerial vehicle 20 is on the flight line FL regardless of the heading direction of the unmanned aerial vehicle 20. (so that the unmanned aerial vehicle 20 does not deviate from the flight line FL) In this case, the flight controller 21 can control the structure of the unmanned aerial vehicle 20. Get the current heading direction information and, based on that heading direction information, The flight controller 21 controls the rotation speed of the propeller 31. When the aircraft 20 moves along the flight line FL, the heading direction is always constant and does not change. Flight control is also possible.
[0031] The processing unit may interface with one or more external devices (e.g., a terminal, a display device, or other remote A transceiver unit 25 configured to transmit and / or receive data from a remote controller The transceiver unit 25 may communicate with any suitable communication means, such as wired or wireless communication. For example, the transceiver unit 25 may be a local area network (LAN). AN), Wide Area Network (WAN), Infrared, Wireless, WiFi, Point-to-Point One of the following: point-to-point (P2P) networks, telecommunications networks, cloud communications, etc. The transmitter / receiver 25 can use one or more of the following: Bluetooth (registered trademark) and Short-range communication interfaces such as BLE (Bluetooth Low Energy) The transmitter / receiver 25 transmits and receives data acquired by the camera 26 and the sensors 23, Processing results generated by the unit, predetermined control data, and data from the control device 10 or management terminal, etc. It can transmit and / or receive one or more of the following: user commands (control signals), can.
[0032] The sensors 23 according to this embodiment include an inertial sensor (acceleration sensor, gyro sensor), GPS sensors, proximity sensors (e.g., LiDAR), or vision / imaging sensors (e.g., For example, a camera.
[0033] The unmanned aerial vehicle 20 has a position estimation unit for estimating the current position of the unmanned aerial vehicle 20. The position estimation part uses GPS and other GNSS (global navigation satellite systems) to obtain Based on the coordinate information of latitude and longitude, altitude information obtained from a pressure sensor, etc., On map data such as a two-dimensional planar map or a three-dimensional spatial map stored in a memory unit of the The current position of the unmanned aerial vehicle 20 is estimated. Based on the current position, the propulsion mechanism is controlled so that the unmanned aerial vehicle 20 stays on the flight line. It is possible.
[0034] The unmanned aerial vehicle 20 has an attitude estimation unit that estimates the current attitude of the unmanned aerial vehicle 20. The estimation unit estimates the current attitude (tilt) of the unmanned aerial vehicle 20 based on information obtained from the inertial sensor, etc. (k) is estimated.
[0035] In addition, the unmanned aerial vehicle 20 has a speed estimation unit that estimates the current moving speed of the unmanned aerial vehicle 20. The speed estimation unit estimates the speed based on data obtained from, for example, an inertial sensor. .
[0036] In addition, the unmanned aerial vehicle 20 estimates the current orientation (heading direction) of the unmanned aerial vehicle 20. The direction estimation unit is provided, for example, in the body (main body) of the unmanned aerial vehicle 20. The heading direction is estimated based on the direction data obtained from sensors such as a compass. do.
[0037] The unmanned aerial vehicle 20 also has an imaging direction estimation unit that estimates the imaging direction of the imaging unit. The direction estimation unit may be implemented using, for example, a camera 26, a gimbal 27, or a compass provided on the aircraft. The shooting direction is estimated based on directional data obtained from the sensor.
[0038] In this embodiment, the data obtained from the unmanned aerial vehicle 20 includes location information (altitude information), attitude information, speed information, battery level, signal strength, camera image information, camera The camera direction (shooting direction), zoom in / out, etc. Any data that can be obtained from the sensor can be used. The data may be transmitted to the control device 10, or may be transmitted to the management terminal via a repeater or the like as necessary. The control device 10 may also transmit the captured image by the camera based on the operation input of the operator. Start / stop shadows, change camera direction (shooting direction), zoom in / out, etc. A signal may be generated and transmitted to unmanned aerial vehicle 20.
[0039] <Flight line setting> An example of a method for setting the flight line FL will be described below. The setting method is not limited to this example, and may be performed via the control device 10, the unmanned aerial vehicle 20, or a network. The settings can be made in any way using a management terminal or the like connected to the network. The flight line FL is connected via a pilot 10, an unmanned aerial vehicle 20, or a network. The flight line FL is a point in the air. It means a linear flight range that is virtually set at a fixed altitude and is a continuous whole. The flight line FL is set before the unmanned aerial vehicle 20 starts flying. Is the flight line FL a continuous linear structure from one end to the other (see Figure 1, Figure 2)? 4, see Fig. 5), or it can be a ring-shaped configuration consisting of a single line (see Fig. 6).
[0040] Figure 1 shows the sky above one sideline SL on a court in a sporting event such as soccer. The flight line FL is shown. The soccer field shown in Figure 1 is long It is a square with a pair of sidelines SL (touch lines) that make up the long sides and The court has a pair of goal lines GL.
[0041] The flight line setting unit 16 may set, for example, two points P1 and P2 located at both ends of the sideline SL. The flight line FL is set based on the position information of these two points P1 and P2. For example, one end of the sideline SL (at the intersection with the goal line GL) The unmanned aerial vehicle 20 is placed at a point P1 of the GPS. By transmitting the information to the flight control device 10, the flight line setting unit 16 determines the latitude and longitude of the point P1. Similarly, the latitude and longitude of the point P2 at the other end of the sideline SL are obtained. The flight line setting unit 16 obtains information on the flight angle. It can be set as a flight line FL on the original flat map. Also, the height of the flight line FL can be set as The altitude (ground altitude or sea level altitude) is a predetermined altitude that is set in advance and stored in the memory unit 12 or the like. (For example, 10m, etc.) Alternatively, the pilot or other personnel may set the flight line FL. The altitude of the flight line FL may be set to any height when the flight is started. The height of the plate may be set to a constant value, or the height of the plate may be set to a different value in some areas.
[0042] When the pilot or the like sets the height of the flight line FL, for example, the pilot or the like uses a touch panel provided on the control device 10. The altitude value (m) may be input from an input unit such as a touch panel, or may be preset. Select and input from the preset altitude options (e.g. 5m, 10m, 20m, etc.) This is also fine.
[0043] The flight line FL is not limited to a straight line as in this example, but may be curved, such as an arc. The conductor may have a bent portion that is bent at a predetermined angle (acute angle, right angle, or obtuse angle), or may be entirely The body or part may be any curved shape. The start point (one end), end point (other end), center of curvature, radius of curvature, bending angle, and corner (bending point) positions of the part The flight line FL can be set based on input information such as position information.
[0044] The flight line setting unit 16 also sets information on one point (latitude , longitude coordinate information) and the distance from that point to the point corresponding to the other end of the flight line FL It is also possible to set the flight line FL based on the information of (m) and direction (bearing). do.
[0045] Here, FIG. 4, FIG. 5, and FIG. 6 are plan views illustrating the flight line FL. The row line FL is a wavy line consisting of alternating arc-shaped curves from one end to the other. In the case of FIG. 4, when the operator operates the operation input unit 13 to one side or the other in the axial direction, , the unmanned aerial vehicle 20 flies along a wavy flight line FL to one side (toward one end) or The drone flies to the other side (toward the other end). When not in flight, unmanned aerial vehicle 20 hovers on flight line FL.
[0046] The flight line FL shown in FIG. 5 has four bends between one end and the other end. The line setting unit 16 may store, for example, position information of six points corresponding to one end, the other end, and four bends. Based on the information on the shape of the lines (five straight lines in this example) connecting them, the flight lane is calculated. In the case of Figure 5, as in the case of Figure 4, the inFL can be set. The aircraft 20 moves to one side or the other along a curved flight line FL.
[0047] The flight line FL shown in FIG. 6 is a square with four bends. Flight Line Setting The unit 16 may, for example, generate position information of four points corresponding to four bends and lines connecting the four points ( Based on the shape information of the flight line (four straight lines in this example), the flight line FL can be set. In the case of FIG. 6, the unmanned aerial vehicle 20 also flies to one side or The circular flight line FL is a rectangular line in plan view. The shape is not limited to this configuration, and may be a square or other polygonal shape, or may be a circle, an ellipse, or the like. If the flight line FL is a circle, for example, the position information of the center of the circle and the information of the radius (diameter) are In the case of an ellipse, the flight line FL can be set based on the information. The flight line FL can be set based on the position information of the heart and the information of the major and minor axes. do.
[0048] The flight line FL is transmitted to the storage unit 12 of the flight control device 10 and / or the unmanned aerial vehicle 20. The flight controller of the unmanned aerial vehicle 20 stores the flight information in the memory 22 of the unmanned aerial vehicle 20. 21 is information on the flight line FL on map data such as a 2D map or a 3D map, and Based on the information of the aircraft's current position, attitude, speed, etc., unmanned aircraft 2 is placed on the flight line FL. The propulsion mechanisms such as the propellers 31 can be controlled so that the flight controller 30 stays at the same speed. The troller 21 further determines, based on the information on the heading direction and acceleration of the unmanned aerial vehicle 20, The propulsion mechanism may be controlled.
[0049] <Control example 1> An example of flight control according to this embodiment will be described below with reference to FIG. This section describes a case where a game such as soccer is photographed using the camera 26 of the unmanned aerial vehicle 20. The flight line FL is set in advance before the start of the flight using the above method or the like.
[0050] For example, the pilot presses the automatic lift button of the control device 10 while the unmanned aerial vehicle 20 is placed on the ground. This allows the control device 10 to control the unmanned aerial vehicle 20 to fly along the flight line FL. The unmanned aerial vehicle 20 that receives the signal automatically ascends to the ground. The light controller 21 controls the propulsion mechanism to automatically rise to a preset altitude. The drone 20 hovers on the flight line FL. It is preferable to place the ball on a line on the ground (in this example, the side line SL) corresponding to the side line FL. In this way, the unmanned aerial vehicle 20 can be easily launched by simply lifting it straight up. 0 can be moved onto the flight line FL. For example, the unmanned aerial vehicle 20 can be moved from point 1 in FIG. If you select and input the automatic ascent button while positioned at point P3, which is the midpoint between points P1 and P2, Hover in the center of the flight line FL directly above.
[0051] The pilot inputs an operation in one axial direction (left and right direction, etc.) of the operation input unit 13, and the flight line F The pilot can control the direction and speed of the unmanned aerial vehicle 20 along the line L. The unmanned aerial vehicle 20 may be piloted while being visually observed, or may be piloted while being displayed on a monitor screen or the like of the control device 10. While looking at the displayed image (a real-time image captured by the camera 26 of the unmanned aerial vehicle 20), Steering operations may also be performed.
[0052] When the operator operates the operation input unit 13 of the control device 10, the operation input on one side of one axial direction is not performed. Then, the unmanned aerial vehicle 20 moves to one side along the flight line FL (e.g., flies horizontally). When an operation input is made to the other side of the one axial direction, the unmanned aerial vehicle 20 flies along the flight line FL. The one side and the other side of the operation input unit 13 in the one axial direction are respectively the flight line For example, one axis of the operation input unit 13 corresponds to the left and right sides along the axis FL. In the case where the direction is to the right, when the operation input unit 13 is tilted to the left, the unmanned aerial vehicle 20 moves in the flight lane. When the unmanned aerial vehicle moves to one side along the in-flight flight and tilts the operation input unit 13 to the right, 20 moves to the other side along the flight line FL.
[0053] While the pilot is inputting the operation input unit 13 of the control device 10 to one side, the unmanned aerial vehicle 2 0 moves toward one end along the flight line FL based on a control signal from the flight control device 10. However, when the unmanned aerial vehicle 20 reaches one end of the flight line FL, the pilot takes control. Even if the operation input unit 13 of the vertical device 10 is operated to one side, the unmanned aerial vehicle 20 will not move any further. Instead of continuing to move, the unmanned aerial vehicle 20 hovers at one end of the flight line. The flight is controlled so as to stay on the FL. The same applies when inputting an operation to the flight line F until the flight line FL reaches the other end. It moves along L toward the other end, and when it reaches the other end, it stops moving and hovers. In this way, while realizing simple manual control using the control device 10, the preset flight The flight of the unmanned aerial vehicle 20 can be controlled so as to automatically stay on the line FL.
[0054] In this way, the pilot can control the flight line FL by only operating the operation input unit 13 in one axial direction. The position of the unmanned aerial vehicle 20 can be easily adjusted. As a result, the control of the unmanned aerial vehicle 20 Even an inexperienced pilot can easily use the camera 26 of the unmanned aerial vehicle 20 to capture a soccer game. For example, when taking pictures using the unmanned aerial vehicle 20, the person to be photographed can be By adjusting the position of the unmanned aerial vehicle 20 on the flight line FL according to the position of the object or body. In addition, the flight control of the unmanned aerial vehicle 20 is The rollers 21 automatically control the flight of the unmanned aerial vehicle 20 so that it stays on the flight line FL. Therefore, the unmanned aerial vehicle 20 may fly in an unintended direction due to an operational error by the pilot. Therefore, the present system 1 can provide a high level of safety. This enables safe manual control of an aircraft without the need for advanced piloting skills.
[0055] The unmanned aerial vehicle 20 includes an imaging direction estimation unit that estimates the imaging direction of the imaging unit and a The imaging direction estimation unit may include, for example, an imaging direction control unit for controlling the imaging direction of the unmanned aerial vehicle. The heading direction of the aircraft 20, information on the orientation of the gimbal 27, and the image captured by the camera 26 The imaging direction control unit estimates the imaging direction based on at least any information of the captured image. , control of the gimbal 27 supporting the camera 26 and / or the heading of the unmanned aerial vehicle 20. By controlling the direction of the image pickup, the image pickup direction can be controlled. This improves the accuracy of photographing the subject.
[0056] In the flight control method for the unmanned aerial vehicle 20 according to the present invention, the flight line setting unit 16 sets a map A flight line setting step in which a virtual flight line is set on the data, and a flight line setting step in which the pilot operates the aircraft Based on the operation signal transmitted from the control device 13 in response to the operation of the input unit 13 in one axial direction, The flight control unit 21 controls the unmanned aerial vehicle to fly along the flight line. The method includes the steps of:
[0057] The above-described embodiment is merely an example for facilitating understanding of the present invention, and does not limit the present invention. The present invention is not intended to be interpreted as being based on the principles of the present invention. It goes without saying that the present invention includes equivalents thereof.
[0058] For example, some of the functions of the control device 10 may be performed by the unmanned aerial vehicle 20. Some of the functions of the aircraft 20 may be performed by the flight control device 10.
[0059] The control device 10 also controls the unmanned aerial vehicle 20 to move only along the flight line FL. A specific control mode for flight control and a normal mode that is not limited to movement along the flight line FL. In that case, the control of the control device 10 may be changed over by a changeover switch. The control unit 11 and / or the flight controller 21 of the unmanned aerial vehicle 20 may include a specific control mode. A mode switching unit is provided for switching between the normal mode and the normal mode. When the specific control mode is switched to, the range of movement of the unmanned aerial vehicle 20 is increased by 100% as described above. For example, during a particular control mode, the operation of the flight control device 10 is restricted to only the row line FL. The input is limited to only one axis, and the control input sent from the control device 10 to the unmanned aerial vehicle 20 is The signals may be limited to only one-axis steering signals. Also, during normal mode, The above restrictions are lifted, and operation input in multiple axial directions is possible using the operation input unit 13 of the control device 10. This makes it possible to transmit control signals in multiple axial directions from the control device 10 to the unmanned aerial vehicle 20. With this configuration, for example, when a pilot with a lot of piloting experience uses the aircraft, the normal mode can be switched to the Therefore, the unmanned aerial vehicle 20 can be freely manually controlled regardless of the flight line FL. In addition, when pilots with little piloting experience use it, it is easy to switch to a specific control mode. This allows manual control of movement only along the flight line FL quickly and safely. [Explanation of symbols]
[0060] 10. Controls 20 Unmanned aerial vehicle 21 Flight Control Unit
Claims
1. A control device having an operation input unit and capable of flight control based on control signals from the control device and an unmanned aerial vehicle, The unmanned aerial vehicle includes: A propulsion mechanism including a plurality of rotors; A position estimation unit that estimates a position of the unmanned aerial vehicle; An attitude estimation unit that estimates the attitude of the unmanned aerial vehicle; A speed estimation unit that estimates a moving speed of the unmanned aerial vehicle; The propulsion mechanism is controlled based on information including the current position, attitude, and velocity of the unmanned aerial vehicle. A flight control unit for controlling the The flight control unit controls the flight control device in response to an operation of the operation input unit in one axial direction by a pilot. Based on the control signals sent from the aircraft, the aircraft follows a virtual flight line that is set up in advance on a map. A flight control system comprising: a flight control mechanism that controls the propulsion mechanism to fly along a path.
2. The flight control device or the unmanned aerial vehicle may then be configured to detect the location of the map data corresponding to each end of the flight line. a flight line setting unit for setting the flight line based on position information of two points on the data; 10. The flight control system of claim 1 , comprising:
3. The unmanned aerial vehicle includes: A direction estimation unit that estimates a heading direction of the unmanned aerial vehicle, The flight control unit controls the propulsion mechanism based on the current heading direction.
3. A flight control system according to claim 1 or 2.
4. The unmanned aerial vehicle includes: An imaging unit capable of capturing an image; an imaging direction estimation unit that estimates an imaging direction of the imaging unit; Controlling the heading direction of the unmanned aerial vehicle or the direction of the gimbal supporting the imaging unit and a photographing direction control unit for controlling the photographing direction to change the photographing direction. On-board flight control system.
5. 5. The flight control system according to claim 1, wherein the flight line is entirely straight. Stem.
6. The flight control system according to any one of claims 1 to 4, wherein the flight line has a bend or curve. Your system.
Citation Information
Patent Citations
System and method for controlling movement of moving body
JP2019020962A
Flight body system, flight body, position measuring method and program
JP2020135327A
Information processing device, method, and recording media
JP2020150417A
Flight vehicle flight control system
JP2015037937A
Cited By
Power cutoff device
EP4714753A1
