Control device for performing flight control of aircraft, and control method

By combining optical sensors and 3-axis sensors, using position information to adjust the attitude inference results, the problem of geomagnetic sensors and inertial sensors being unreliable in strong magnetic or electric field environments is solved, and the stable flight control of the aircraft is achieved.

CN113079698BActive Publication Date: 2024-11-08RAKUTEN GROUP INC
View PDF 21 Cites 0 Cited by

Patent Information

Application Number
CN201980034178.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2019-11-05
Publication Date
2024-11-08
Estimated Expiration
2039-11-05

AI Technical Summary

Technical Problem

The values ​​detected by geomagnetic sensors and inertial sensors in strong magnetic or electric field environments are unreliable, resulting in inaccurate attitude speculation of aircraft and unstable flight.

Method used

Optical sensors are combined with 3-axis sensors to adjust the attitude estimation results through position information proportional adjustment to ensure that the aircraft can still fly stably under unreliable detection values.

Benefits of technology

Even when the detection values ​​of geomagnetic sensors or inertial sensors are unreliable, stable flight of the aircraft can be achieved. Through the combination of optical sensors and 3-axis sensors, position information is used to adjust the attitude inference results to ensure the reliability of flight control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113079698B_ABST
    Figure CN113079698B_ABST
Patent Text Reader

Abstract

The present invention relates to a control device and a control method for performing flight control of an aircraft. A first attitude estimation unit (16) estimates the attitude of a UAV (1) by performing Visual-SLAM based on a detection value detected by a camera unit (14), and a second attitude estimation unit (17) estimates the attitude of the UAV (1) based on a detection value detected by a rotation angle detection unit (15). Furthermore, a control unit (18) performs attitude control of the UAV (1) by using a first attitude estimation result of the first attitude estimation unit (16) and a second attitude estimation result of the second attitude estimation unit (17) in a ratio based on position information of the UAV (1).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of a control method executed by a system for performing flight control of an aircraft. Background Art

[0002] In the past, geomagnetic sensors and inertial sensors (e.g., acceleration sensors, angular velocity sensors) were used in many devices such as mobile phones, car navigation systems, and aircrafts to estimate the attitude. For example, Patent Document 1 discloses a technology that uses the orientation information measured by the geomagnetic sensor to correct the orientation information measured by a three-axis gyro device (angular velocity sensor) to measure the attitude of a flying object with high accuracy.

[0003] Background Art Literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2004-345435 Summary of the invention

[0006] [Problems to be solved by the invention]

[0007] However, the detection values ​​(measured values) detected by the geomagnetic sensor and the inertial sensor may be unreliable. For example, if there is an object generating a strong magnetic field or electric field nearby, the geomagnetic sensor or the inertial sensor may output an abnormal value and the aircraft's attitude may not be accurately estimated. As a result, there is a concern that the aircraft's flight may become unstable.

[0008] Therefore, the present invention provides a control device and a control method that can enable an aircraft to fly stably even when the detection value detected by a geomagnetic sensor or an inertial sensor is unreliable.

[0009] [Technical means to solve the problem]

[0010] In order to solve the above-mentioned problem, the invention described in claim 1 is characterized in that it is a control device for performing flight control of an aircraft having an optical sensor and at least one three-axis sensor, and comprises: a first acquisition unit for acquiring a first detection value detected by the optical sensor; a second acquisition unit for acquiring a second detection value detected by the three-axis sensor; a third acquisition unit for acquiring position information indicating the flight position of the aircraft; a first attitude estimation unit for performing attitude estimation of the aircraft based on the first detection value; a second attitude estimation unit for performing attitude estimation of the aircraft based on the second detection value; and a flight control unit for performing flight control of the aircraft by using the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit in a ratio based on the position information. Thus, even when the detection value detected by the geomagnetic sensor or the inertial sensor is unreliable, the aircraft can be made to fly stably.

[0011] The invention described in claim 2 is the control device according to claim 1, characterized in that: the position information includes altitude information indicating the altitude of the aircraft, and the flight control unit uses the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit at a ratio based on the altitude. Thus, the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit can be used at a ratio that changes according to the flight altitude of the aircraft.

[0012] The invention described in claim 3 is the control device described in claim 2, characterized in that the flight control unit uses at least the attitude estimation result of the first attitude estimation unit from the time the aircraft takes off until it reaches a specific altitude, and uses the attitude estimation result of the second attitude estimation unit after reaching the specific altitude. Thus, it is possible to switch to a flight control with a smaller load at an early stage when it is predicted that the attitude estimation result of the second attitude estimation unit has reached a certain degree of reliability.

[0013] The invention described in claim 4 is the control device according to claim 1, characterized in that it further comprises a distance calculation unit, which calculates the distance between the aircraft and the take-off point based on the position information, and the flight control unit uses the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit at a ratio based on the distance. Thus, the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit can be used at a ratio that changes according to the distance between the aircraft and the take-off point.

[0014] The invention described in claim 5 is a control device according to claim 4, characterized in that the flight control unit uses at least the attitude estimation result of the first attitude estimation unit from the time the aircraft takes off until the aircraft reaches a specific distance, and uses the attitude estimation result of the second attitude estimation unit after the aircraft reaches the specific distance. Thus, it is possible to switch to a flight control with a smaller load at an early stage when the attitude estimation result of the second attitude estimation unit is predicted to reach a reliable level.

[0015] The invention described in claim 6 is a control device according to any one of claims 1, 2 and 4, characterized in that: the flight control unit at least uses the attitude estimation result of the first attitude estimation unit when the deviation amount between the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit is greater than a threshold value, and uses the attitude estimation result of the second attitude estimation unit when the deviation amount is less than the threshold value. Thus, it is possible to switch to a flight control with a smaller load at an early stage when the deviation amount between the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit is small to a certain extent.

[0016] The invention described in claim 7 is a control device according to any one of claims 1, 2 and 4, characterized in that: the three-axis sensor includes a geomagnetic sensor, and the control device further includes a correction unit, which corrects the reference orientation to a true value before the aircraft takes off, and the flight control unit at least uses the attitude estimation result of the first attitude estimation unit when the deviation between the value representing the reference orientation detected by the geomagnetic sensor and the true value is greater than a threshold value, and uses the attitude estimation result of the second attitude estimation unit when the deviation is less than the threshold value. As a result, it is possible to switch to a flight control with a smaller load at an early stage when the deviation between the value representing the reference orientation and the true value is small to a certain extent.

[0017] The invention described in claim 8 is a control device according to any one of claims 1 to 7, characterized in that: when the aircraft is in a specific area, the flight control unit uses the attitude estimation result of the first attitude estimation unit, and when the aircraft is outside the specific area, the attitude estimation result of the second attitude estimation unit is used. Thus, during the flight of the aircraft, the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit can be switched according to whether the aircraft enters the specific area.

[0018] The invention described in claim 9 is a control device according to any one of claims 1 to 8, characterized in that it further comprises a power supply control unit that controls the power supply to the optical sensor based on the position information. This can suppress the power consumption of the aircraft.

[0019] The invention described in claim 10 is characterized in that it is a control method executed by a system for performing flight control of an aircraft, the aircraft having an optical sensor and at least one three-axis sensor, the control method comprising: a step of acquiring a first detection value detected by the optical sensor; a step of acquiring a second detection value detected by the three-axis sensor; a step of acquiring position information representing a flight position of the aircraft; a step of performing an attitude estimation of the aircraft based on the first detection value; a step of performing an attitude estimation of the aircraft based on the second detection value; and a step of performing flight control of the aircraft by utilizing the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit in a ratio based on the position information.

[0020] [Effects of the Invention]

[0021] According to the present invention, even when the detection value detected by the geomagnetic sensor or the inertial sensor is unreliable, the aircraft can be made to fly stably. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 This is a diagram showing a schematic configuration example of a flight system S.

[0023] Figure 2 This is a diagram showing an example of a schematic configuration of UAV1.

[0024] Figure 3 This is a flowchart showing an example of processing executed by the control unit 18 of UAV1.

[0025] Figure 4 It is a diagram showing the reference orientation of the UAV 1 set before takeoff.

[0026] Figure 5 This is a conceptual diagram showing a situation in which UAV 1 takes off from an airport near which a specific object exists and flies to a destination point. DETAILED DESCRIPTION

[0027] Hereinafter, one embodiment of the present invention will be described with reference to the drawings. In addition, the following embodiment is an embodiment of the case where the present invention is applied to a flight system.

[0028] [ 1. Configuration and operation overview of flight system S ]

[0029] First, refer to Figure 1 The configuration and operation outline of the flight system S that enables an unmanned aircraft to fly for a specific purpose will be described. Examples of the specific purpose include transportation, measurement, photography, inspection, and monitoring. Figure 1 : is a diagram showing an example of the schematic configuration of the flight system S. Figure 1 As shown, the flight system S includes an unmanned aerial vehicle (hereinafter referred to as "UAV (Unmanned Aerial Vehicle)") 1 flying in the atmosphere (in the air), a traffic management system (hereinafter referred to as "UTMS (UAV Traffic Management System)") 2, and an airport management system (hereinafter referred to as "PMS (Port Management System)") 3. UAV1, UTMS2, and PMS3 can communicate with each other via a communication network NW. The communication network NW includes, for example, the Internet, a mobile communication network and its wireless base stations. In addition, Figure 1 In the example shown, one UAV 1 is shown, but there may actually be a plurality of UAVs 1. The UTMS 2 and the PMS 3 may also constitute one management system.

[0030] UAV1 can fly from the ground or fly autonomously according to the remote control of the operator. UAV1 is also called a drone or a multi-axis aircraft. UAV1 is managed by a GCS (Ground Control Station). GCS is, for example, installed as an application in a control terminal that can be connected to a communication network NW. In this case, the operator is, for example, a person who operates the control terminal to remotely control UAV1. Alternatively, GCS can also be composed of a server, etc. In this case, the operator is, for example, an administrator of the GCS, or a controller possessed by the server. In addition, the autonomous flight of UAV1 is not limited to autonomous flight based on flight control of the UAV1, and the autonomous flight of the UAV1 also includes, for example, autonomous flight achieved based on flight control of the entire flight system S.

[0031] UTMS2 is composed of one or more servers including a control server CS. The control server CS is an example of a control device. UTMS2 manages the navigation of UAV1. The navigation management of UAV1 includes the navigation plan management of UAV1, the flight status management of UAV1, and the control of UAV1. The navigation plan of UAV1 refers to a flight plan including a flight path (planned path) from the departure point (take-off point) of UAV1 to the destination point. The flight path is represented by the latitude and longitude on the path, for example, and may also include the flight altitude. The flight status management of UAV1 is performed based on the aircraft information of UAV1. The aircraft information of UAV1 includes at least the position information of UAV1. The position information of UAV1 indicates the current position of UAV1. The current position of UAV1 refers to the flight position of UAV1 in flight. The aircraft information of UAV1 may also include the speed information of UAV1. The speed information indicates the flight speed of UAV1.

[0032] PMS3 is composed of one or more servers, etc. PMS3 manages, for example, take-off and landing facilities (hereinafter referred to as "airports") set at the departure point (take-off point) and destination point (or via point) of UAV1. In addition, the airport is set on the ground surface (ground) or the roof of a building, etc. Sometimes there are specific objects (hereinafter referred to as "specific objects") that generate strong magnetic fields, electric fields or electromagnetic fields (hereinafter referred to as "magnetic fields, etc.") near the airport. As examples of specific objects, permanent magnets, transformers, generators, etc. can be listed, and their positions are pre-specified. In addition, even outside the surface of the ground where the airport is set, there may be specific objects (for example, buildings such as power lines, radio towers, base stations, etc.) that generate strong magnetic fields. The airport is managed based on the location information of the airport and the reservation information of the airport. Here, the location information of the airport indicates the location of the airport. The reservation information of the airport includes the body ID of the UAV1 that has reserved the airport, and information on the scheduled arrival time, etc. The body ID of UAV1 is identification information for identifying UAV1. In addition, when there is a specific object near an airport, the PMS 3 may manage the location information of the specific object and the location information of the airport.

[0033] [ 2. UAV1 Configuration and Function Overview ]

[0034] Next, refer to Figure 2 The structure and functions of UAV1 are briefly described. Figure 2 1 is a diagram showing an example of the general configuration of UAV1. Figure 2As shown, UAV1 includes a driving unit 11, a positioning unit 12, a wireless communication unit 13, a camera unit 14, a rotation angle detection unit 15, a first attitude estimation unit 16, a second attitude estimation unit 17, and a control unit 18. Here, the first attitude estimation unit 16 also functions as a first acquisition unit, and the second attitude estimation unit 17 also functions as a second acquisition unit. One attitude estimation unit (for example, composed of one processor, etc.) can also function as both the first attitude estimation unit and the second attitude estimation unit. The control unit 18 is an example of a control device, a third acquisition unit, a flight control unit, a power supply control unit, a correction unit, and a distance calculation unit. In addition, although not shown in the figure, UAV1 includes a rotor (propeller) as a horizontal rotary wing, and a battery that supplies power to various parts of UAV1.

[0035] The driving unit 11 includes a motor and a rotating shaft. The driving unit 11 rotates a plurality of rotors by driving the motor and the rotating shaft according to a control signal output from the control unit 18. The positioning unit 12 includes a radio wave receiver and an altitude sensor. The positioning unit 12 receives radio waves sent from a satellite of a GNSS (Global Navigation Satellite System) through a radio wave receiver, for example, and detects the current position (latitude and longitude) of the UAV1 in the horizontal direction based on the radio waves. The current position of the UAV1 is the flight position of the UAV1 in flight. In addition, the current position of the UAV1 in the horizontal direction can also be corrected based on the image taken by the camera unit 14 or the radio waves sent from the above-mentioned wireless base station. The position information indicating the current position detected by the positioning unit 12 is output to the control unit 18. Furthermore, the positioning unit 12 can also detect the current position (altitude) of the UAV1 in the vertical direction through an altitude sensor such as an air pressure sensor. In this case, the position information includes altitude information indicating the altitude of the UAV1. The position information including the altitude information is expressed as three-dimensional position coordinates (X, Y, Z) in the world coordinate system. In addition, the altitude of UAV1 can also be detected based on the radio waves received from the satellites of GNSS. In this case, the altitude detected based on the radio waves received from the satellites of GNSS can also be used to correct the altitude detected by the altitude sensor.

[0036] The wireless communication unit 13 is responsible for controlling the communication via the communication network NW. The imaging unit 14 includes a camera, etc. A camera is an example of an optical sensor. The camera continuously captures an object in the real space within its field of view (i.e., detects light reflected or radiated from the object), and outputs a detection value (an example of a first detection value) representing an image (pixel group) to the first attitude estimation unit 16. The detection value output to the first attitude estimation unit 16 is used for attitude estimation of UAV1. Here, the attitude of UAV1 indicates, for example, how much UAV1 has rotated from a state where it is horizontal to the ground and the reference orientation of UAV1 is set to north, for example (in other words, how it has rotated to become the orientation). The rotation is represented, for example, by a rotation angle (roll angle) around the X-axis, a rotation angle (pitch angle) around the Y-axis, and a rotation angle (yaw angle) around the Z-axis (vertical direction) (i.e., represented by Euler angles). Alternatively, the rotation may also be represented by a rotation matrix around the X-axis, a rotation matrix around the Y-axis, and a rotation matrix around the Z-axis. Ideally, the rotation can be represented by a quaternion (three rotation axes (vectors) and one rotation angle (scalar)) that does not produce the so-called ring frame lock and is easy to interpolate. Specifically, the quaternion can be represented by the formula "ix+jy+kz+w". Here, i, j, and k are imaginary units, respectively. Here, x, y, and z are imaginary parts, and w is the real part. In addition, x is the value of the X-axis, y is the value of the Y-axis, and z is the value of the Z-axis. Euler angles, rotation matrices, and quaternions can be converted into each other as is well known. The camera is mounted on UAV1 in such a way that its field of view covers at least the horizontal direction. Ideally, the camera can be a camera with a wide-angle lens (for example, a panoramic camera). In addition, the camera is ideally an RGB (red-green-blue) camera, but it can also be an infrared camera. In addition, in order to estimate the posture of UAV1, UAV1 may also have optical sensors other than these cameras (for example, a distance sensor, a laser sensor, or LiDAR (Light Detection and Ranging, or Laser Imaging Detection and Ranging)).

[0037] The rotation angle detection unit 15 includes at least one 3-axis sensor. Examples of the 3-axis sensor include a 3-axis angular velocity sensor (also called a gyro sensor), a 3-axis acceleration sensor, and a 3-axis geomagnetic sensor (also called a magnetic sensor or an orientation sensor). The 3-axis angular velocity sensor and the 3-axis acceleration sensor are also referred to as inertial sensors, respectively. The 3-axis angular velocity sensor includes, for example, a piezoelectric element, etc., and continuously detects the angular velocity around the X-axis (the angle rotated per unit time), the angular velocity around the Y-axis, and the angular velocity around the Z-axis, and outputs the detection value representing each angular velocity (an example of the second detection value) to the second attitude estimation unit 17. The 3-axis acceleration sensor includes, for example, a piezoelectric element, etc., and continuously detects the gravitational acceleration, and outputs the detection value representing the gravitational acceleration as a three-dimensional vector (an example of the second detection value) to the second attitude estimation unit 17. The 3-axis geomagnetic sensor includes, for example, an electronic compass, etc., and continuously detects the geomagnetism, and outputs the detection value representing the north (magnetic north) as a three-dimensional vector (an example of the second detection value) to the second attitude estimation unit 17. In addition, two types of 3-axis sensors (for example, a 3-axis angular velocity sensor and a 3-axis acceleration sensor) are collectively referred to as a 6-axis sensor. In addition, three types of 3-axis sensors (i.e., a 3-axis angular velocity sensor, a 3-axis acceleration sensor, and a 3-axis geomagnetic sensor) are collectively referred to as a 9-axis sensor.

[0038] The first attitude estimation unit 16 includes a processor CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), and non-volatile memory. The first attitude estimation unit 16 continuously obtains detection values ​​from the camera unit 14 and performs Visual (visual)-SLAM (Simultaneous Localization and Mapping) based on the detection values ​​(images) to estimate the attitude (attitude in the world coordinate system) of UAV1. For example, the first attitude estimation unit 16 estimates the attitude of UAV1 by tracking each of a plurality of feature points in a plurality of images (frames) including images captured when UAV1 is in a landing state (for example, placed on the ground, and the reference orientation is set to, for example, north) and images captured continuously after UAV1 starts flying, and calculating a three-dimensional direction vector from the relative position of UAV1 (camera) to the feature point to map (for example, generate a depth map), thereby estimating the attitude of UAV1. The posture estimation result of the first posture estimation unit 16 (hereinafter referred to as "the first posture estimation result") is expressed as Euler angles (including three parameters of roll angle, pitch angle, and yaw angle), rotation matrix (rotation matrix around X-axis, rotation matrix around Y-axis, and rotation matrix around Z-axis), or quaternion (including four parameters (x, y, z, w) of three rotation axes and one rotation angle) (ideally expressed as quaternion), and is output to the control unit 18. In addition, in order to obtain feature points, RGB values ​​obtained from the image can be used. In addition, in order to reduce the error accumulation that occurs in the process of tracking feature points, so-called bundling adjustment can be performed. In addition, the first posture estimation unit 16 can also perform posture estimation of UAV1 by performing SLAM based on detection values ​​detected by optical sensors other than cameras.

[0039] The second attitude estimation unit 17 includes a CPU, a ROM, a RAM, and a non-volatile memory as a processor. The second attitude estimation unit 17 continuously obtains the detection value from the rotation angle detection unit 15, and estimates the attitude (attitude in the world coordinate system) of the UAV1 based on the detection value. The attitude estimation result of the second attitude estimation unit 17 (hereinafter referred to as "the second attitude estimation result") is expressed by Euler angles, a rotation matrix, or a quaternion (ideally expressed by a quaternion), and is output to the control unit 18. For example, when the rotation angle detection unit 15 includes a three-axis angular velocity sensor, the second attitude estimation unit 17 obtains the detection values ​​(angular velocity around the X axis, angular velocity around the Y axis, and angular velocity around the Z axis) continuously detected by the three-axis angular velocity sensor after the UAV1 starts flying, calculates three Euler angles (roll angle, pitch angle, and yaw angle) based on the acquired detection values, and estimates the calculated Euler angles (roll angle, pitch angle, and yaw angle) as the attitude of the UAV1. Here, the roll angle is calculated based on the angular velocity around the X-axis, the pitch angle is calculated based on the angular velocity around the Y-axis, and the yaw angle is calculated based on the angular velocity around the Z-axis. Alternatively, the second attitude estimation unit 17 may also estimate the rotation matrix obtained by converting the calculated Euler angles through a specific conversion formula as the attitude of UAV1. Ideally, the second attitude estimation unit 17 may estimate the quaternion obtained by converting the calculated Euler angles through a specific conversion formula as the attitude of UAV1. In addition, ideally, the dimension (i.e., the number of parameters) of the first attitude estimation result is consistent with the dimension of the second attitude estimation result. For example, when the first attitude estimation result is expressed as a quaternion, the second attitude estimation result is also expressed as a quaternion.

[0040] In addition, when the rotation angle detection unit 15 is equipped with a 3-axis angular velocity sensor and a 3-axis acceleration sensor, the second attitude estimation unit 17 obtains the detection value (each angular velocity around each axis) continuously detected by the 3-axis angular velocity sensor after the UAV1 starts flying, and the detection value (three-dimensional vector representing gravity acceleration) continuously detected by the 3-axis acceleration sensor. Moreover, the second attitude estimation unit 17 calculates the roll angle and the pitch angle by a specific calculation formula based on the three-dimensional vector representing gravity acceleration detected by the 3-axis acceleration sensor. In addition, the second attitude estimation unit 17 calculates three Euler angles (roll angle, pitch angle, and yaw angle) based on the angular velocity around the X-axis, the angular velocity around the Y-axis, and the angular velocity around the Z-axis detected by the 3-axis angular velocity sensor. Moreover, the second attitude estimation unit 17 uses the roll angle and pitch angle calculated based on the three-dimensional vector representing the gravitational acceleration, and the complementary filter (or Kalman filter) to correct the roll angle and pitch angle calculated based on the angular velocity around the X-axis and the angular velocity around the Y-axis. Thereby, the drift error in the roll direction and the pitch direction is eliminated. Moreover, the second attitude estimation unit 17 estimates the corrected roll angle, the corrected pitch angle, and the calculated yaw angle as the attitude of UAV1. Alternatively, the second attitude estimation unit 17 can also estimate the rotation matrix obtained by converting the calculated or corrected Euler angle through a specific conversion formula as the attitude of UAV1. Ideally, the second attitude estimation unit 17 can estimate the quaternion obtained by converting the calculated or corrected Euler angle through a specific conversion formula as the attitude of UAV1.

[0041] In addition, when the rotation angle detection unit 15 is equipped with a 3-axis angular velocity sensor, a 3-axis acceleration sensor, and a 3-axis geomagnetic sensor, the second attitude estimation unit 17 obtains the detection value (each angular velocity around each axis) continuously detected by the 3-axis angular velocity sensor after the UAV1 starts flying, the detection value (three-dimensional vector of gravity acceleration) continuously detected by the 3-axis acceleration sensor, and the detection value (three-dimensional vector indicating north) detected by the 3-axis geomagnetic sensor. Moreover, the second attitude estimation unit 17 calculates the roll angle and the pitch angle by a specific calculation formula based on the three-dimensional vector indicating the gravity acceleration detected by the 3-axis acceleration sensor. In addition, the second attitude estimation unit 17 calculates three Euler angles (roll angle, pitch angle, and yaw angle) based on the angular velocity around the X-axis, the angular velocity around the Y-axis, and the angular velocity around the Z-axis detected by the 3-axis angular velocity sensor. Moreover, the second attitude estimation unit 17 uses the roll angle and pitch angle calculated based on the three-dimensional vector representing the gravitational acceleration, and the complementary filter (or Kalman filter) to correct the roll angle and pitch angle calculated based on the angular velocity around the X-axis and the angular velocity around the Y-axis. Furthermore, the second attitude estimation unit 17 calculates the yaw angle based on the three-dimensional vector representing the north detected by the three-axis geomagnetic sensor through a specific calculation formula, and uses the calculated yaw angle and the complementary filter (or Kalman filter) to correct the yaw angle calculated based on the angular velocity around the Z-axis. Thus, the error in the yaw direction is eliminated. Moreover, the second attitude estimation unit 17 estimates the corrected roll angle, the corrected pitch angle, and the corrected yaw angle as the attitude of UAV1. Alternatively, the second attitude estimation unit 17 can also estimate the rotation matrix obtained by converting the corrected Euler angle through a specific conversion formula as the attitude of UAV1. Ideally, the second attitude estimation unit 17 can estimate the attitude of the UAV 1 using a quaternion obtained by converting the corrected Euler angles using a specific conversion formula.

[0042] In addition, the rotation angle detection unit 15 is more susceptible to the influence of magnetic fields and the like than the camera unit 14 and the like, and its detection value is sometimes unreliable when the above-mentioned specific object exists near UAV1. Therefore, in this situation, the attitude estimation accuracy of the second attitude estimation unit 17 (i.e., the accuracy of the second attitude estimation result) is lower than the attitude estimation accuracy of the first attitude estimation unit 16 (i.e., the accuracy of the first attitude estimation result), and therefore, it is ideal to use the first attitude estimation result for the attitude estimation of UAV1. On the other hand, in the situation where there is no specific object near UAV1, the attitude estimation accuracy of the second attitude estimation unit 17 is higher than the attitude estimation accuracy of the first attitude estimation unit 16, and therefore, it is ideal to use the second attitude estimation result for the attitude estimation of UAV1.

[0043] The control unit 18 includes a CPU, a ROM, a RAM, and a non-volatile memory as a processor. The control unit 18 performs flight control of the UAV 1 (i.e., control from takeoff to landing of the UAV 1) according to a control program stored in the ROM or the non-volatile memory, for example. In flight control, the position information obtained from the positioning unit 12, the first attitude estimation result obtained from the first attitude estimation unit 16, the second attitude estimation result obtained from the second attitude estimation unit 17, and the flight plan information indicating the flight plan are used to control the rotation speed of the rotor, the position, attitude, and travel direction of the UAV 1.

[0044] In particular, the control unit 18 performs attitude control of the UAV 1 by using the first attitude estimation result obtained from the first attitude estimation unit 16 and the second attitude estimation result obtained from the second attitude estimation unit 17 at a ratio based on the position information (i.e., position information indicating the current position) obtained from the positioning unit 12. Here, the ratio based on the position information is, in other words, a ratio that can be changed based on the current position of the UAV 1 in flight. The ratio can be expressed by a ratio "A:B (A to B)" (A and B are values ​​greater than 0) of the weight "A" of using the first attitude estimation result and the weight "B" of using the second attitude estimation result (in this example, the ratio using the first attitude estimation result is "A / (A+B)", and the ratio using the second attitude estimation result is "B / (A+B)"). For example, in the case of "A:B=1:0", the control unit 18 performs attitude control of the UAV 1 (i.e., flight control based on the first attitude estimation result) only using the first attitude estimation result without using the second attitude estimation result. On the other hand, in the case of "A:B=0:1", the control unit 18 does not use the first attitude estimation result, but only uses the second attitude estimation result to perform attitude control of the UAV 1 (that is, flight control based on the second attitude estimation result). In addition, in the case of using a single attitude estimation result such as "A:B=1:0" or "A:B=0:1", the attitude estimation results of both the first attitude estimation result and the second attitude estimation result may not be obtained. That is, in this case, only the attitude estimation result of the used side is obtained, and the calculation of the unused side is not performed.

[0045] On the other hand, in the case of "A:B=1:1", the control unit 18 uses the first attitude estimation result and the second attitude estimation result equally to control the attitude of UAV1. In addition, the cases of "A:B=1:2" or "A:B=3:1" are also considered. When both A and B are not 0, the control unit 18 can combine the first attitude estimation result and the second attitude estimation result for use. As an example of a method of combining the first attitude estimation result and the second attitude estimation result, as shown in the following equations (1) to (4), a method of synthesizing (α blending) the first attitude estimation result and the second attitude estimation result by the α value is listed. The following equations (1) to (4) are examples of synthetic calculation equations for the parameters (x, y, z, w) when the attitude of UAV1 is represented by a quaternion, which are equivalent to linear interpolation equations.

[0046] x=α×x1+(α-1)×x2 (1)

[0047] y=α×y1+(α-1)×y2 (2)

[0048] z=α×z1+(α-1)×z2 (3)

[0049] w=α×w1+(α-1)×w2 (4)

[0050] Here, α is a value greater than or equal to 0 and less than or equal to 1, and is A / (A+B). x1, y1, z1, and w1 represent four parameters of the quaternion in the first attitude estimation result. x2, y2, z2, and w2 represent four parameters of the quaternion in the second attitude estimation result. x, y, z, and w represent four parameters of the quaternion synthesized by the α value, and these are used for attitude control of UAV1. Here, a spherical linear interpolation formula may be used instead of a linear interpolation formula (i.e., "sinαθ / sinθ" may be used instead of α shown in (1) to (4), and "sin(1-α)θ / sinθ" may be used instead of (α-1)), and the four parameters of the quaternion may be synthesized by the α value. Thus, even when the deviation between the first attitude estimation result and the second attitude estimation result is large, a highly accurate synthesis result can be obtained. Alternatively, the first and second posture estimation results expressed as Euler angles or rotation matrices may be synthesized using the α value using the linear interpolation equations shown in equations (1) to (4) above.

[0051] In addition, the proportion of the position information based on UAV1 is determined by the positional relationship between UAV1 and the specific object. For example, the shorter the distance between UAV1 and the specific object, the smaller B is relative to A. As a result, the proportion of the result estimated using the first posture becomes larger. On the other hand, the longer the distance between UAV1 and the specific object, the larger B is relative to A. As a result, the proportion of the result estimated using the second posture becomes larger. In addition, it can be determined in a manner that the proportion of the result estimated using the first posture is inversely proportional to the square of the distance between UAV1 and the specific object. In this way, when using the distance between UAV1 and the specific object, the proportion based on the position information of UAV1 can be called the proportion based on the distance between UAV1 and the specific object.

[0052] For example, in the case where a specific object exists near a take-off point (e.g., an airport), the ratio based on the position information of UAV1 can be referred to as a ratio based on the distance from the take-off point of UAV1. Thus, the first attitude estimation result and the second attitude estimation result can be used at a ratio that changes based on the distance from the take-off point of UAV1. In this case, the control unit 18 calculates the distance from the take-off point of UAV1 based on the position information of UAV1. For example, the distance is calculated based on the three-dimensional position coordinates of the take-off point of UAV1 and the three-dimensional position coordinates of the current position of UAV1. In addition, the control unit 18 can also perform attitude control of UAV1 by using at least the first attitude estimation result (i.e., the first attitude estimation result, or the attitude estimation result obtained by combining the first attitude estimation result and the second attitude estimation result) from the time when UAV1 takes off until reaching a specific distance (e.g., 30m), and using the second attitude estimation result (i.e., "A:B=0:1") after reaching the specific distance. That is, when the UAV 1 leaves the specific object and reaches a specific distance at which the second attitude estimation result is predicted to be reliable (in other words, it will not hinder the attitude control of the UAV 1), the flight control based on the second attitude estimation result is switched. In this way, it is possible to switch to the attitude control with a smaller load at an earlier stage at which the second attitude estimation result is predicted to be reliable.

[0053] In addition, when a specific object exists near the take-off point, the more UAV1 rises, the less the influence of the magnetic field, etc., and thus the lower the altitude of UAV1, the smaller B is relative to A, and on the other hand, the higher the altitude of UAV1, the larger B is relative to A. In the case of using the altitude of UAV1 in this way, the ratio based on the position information of UAV1 can be called the ratio based on the altitude of UAV1. Thus, the first attitude estimation result and the second attitude estimation result can be used in a ratio that changes based on the flight altitude of UAV1. In this case, the control unit 18 can also perform attitude control of UAV1 by at least using the first attitude estimation result from the time when UAV1 takes off until it reaches a specific altitude, and using the second attitude estimation result after reaching the specific altitude. That is, when UAV1 rises to a specific altitude where the second attitude estimation result is predicted to be reliable (in other words, it will not hinder the attitude control of UAV1), it switches to flight control based on the second attitude estimation result. Thus, it is possible to switch to attitude control with a smaller load from an early stage where the second attitude estimation result is predicted to be reliable.

[0054] In addition, the control unit 18 can also perform attitude control of UAV1 by at least using the first attitude estimation result when the deviation between the first attitude estimation result and the second attitude estimation result is greater than a threshold value, and using the second attitude estimation result when the deviation is less than the threshold value. Thus, it is possible to switch to attitude control with a smaller load from an early stage when the deviation between the first attitude estimation result and the second attitude estimation result is small to a certain extent (that is, the second attitude estimation result becomes reliable). In addition, the control unit 18 can also calculate the integral value of the deviation in a specific time from when the deviation between the first attitude estimation result and the second attitude estimation result is less than the threshold value, and use the second attitude estimation result when the integral value of the deviation is less than the threshold value. In addition, even if the first attitude estimation result and the second attitude estimation result are represented by any one of Euler angles, rotation matrices, and quaternions, the deviation can be calculated. If the deviation is calculated using the first attitude estimation result and the second attitude estimation result represented by quaternions, the calculation process can be suppressed from becoming complicated.

[0055] In addition, the control unit 18 corrects (sets) the reference orientation of UAV1 to a true value (e.g., north) before UAV1 takes off, for example, based on the instruction of the operator at the take-off point. When the deviation between the value representing the reference orientation (north) detected by the three-axis geomagnetic sensor and the true value is greater than a threshold, at least the first attitude estimation result is used, and when the deviation is less than the threshold, the second attitude estimation result is used, thereby performing attitude control of UAV1. As a result, it is possible to switch from an early stage when the deviation between the value representing the reference orientation and the true value is small to a certain extent to an attitude control with a smaller load. In addition, the control unit 18 can also calculate the integral value of the deviation in a specific time from when the deviation between the value representing the reference orientation and the true value is less than the threshold, and use the second attitude estimation result when the integral value of the deviation is less than the threshold.

[0056] In addition, there is a case where a specific area with a strong magnetic field, etc. (for example, an area along a power line) can be identified in a wide range. In this case, the control unit 18 can also perform attitude control of the UAV1 by using the first attitude estimation result when the UAV1 is in the specific area and using the second attitude estimation result when the UAV1 is outside the specific area. In this way, the first attitude estimation result and the second attitude estimation result can be switched during the flight of the UAV1 according to whether the UAV1 enters a specific area with a strong magnetic field, etc.

[0057] Moreover, in the posture control of UAV1, feedback control is performed in the following manner, that is, UAV1 is maintained in a normal posture according to the posture estimation result obtained based on the ratio of the position information of UAV1 as described above (that is, the first posture estimation result, the second posture estimation result, or the posture estimation result formed by combining the first posture estimation result and the second posture estimation result).

[0058] [ 3. UAV1’s actions ]

[0059] Next, refer to Figure 3 The operation of UAV1 will be described. Figure 3 is a flowchart showing an example of processing performed by the control unit 18 of UAV1. Figure 3 All or part of the processing shown. Figure 4 It is a diagram showing the reference orientation of the UAV 1 set before takeoff. Figure 5 1 is a conceptual diagram of a case where UAV1 takes off from an airport with a specific object nearby and flies to a destination point. In the following description of the operation, for example, the following case is taken as an example, that is, UAV1 obtains flight plan information from UTMS2. Figure 5As shown, the case where the UAV 1 takes off from the airport P (take-off point) which is located on the roof of the building B and near the specific object O and flies to the destination point. As a premise of the above operation, the operator of the UAV 1 places the UAV 1 with its reference point (e.g., Figure 4 After the reference point R shown in FIG. 1 is horizontally placed on the airport P in a manner of pointing north (N) with respect to the reference point R shown in FIG. 2 , when a flight start instruction is given from the control terminal, the flight start instruction is sent from the control terminal to the UAV 1. In addition, when the power of the UAV 1 is turned on by the operator, power is supplied to each part from the battery of the UAV 1. The control unit 18 can also control the power supply (on / off control) to the camera unit 14 and the first attitude estimation unit 16 based on the position information of the UAV 1 during the flight of the UAV 1.

[0060] Starts when receiving the above flight start command Figure 3 When starting Figure 3 In the process shown, the control unit 18 performs calibration (step S1) to correct the reference orientation of the UAV 1 to a true value (the orientation to which the reference point of the UAV 1 currently faces, for example, north). Thus, the control unit 18 recognizes the accurate north.

[0061] Next, the control unit 18 starts each part of UAV1 and starts the flight control of UAV1 (step S2). As a result, the positioning unit 12 outputs the position information indicating the current position of UAV1 to the control unit 18 at a specific period. The camera unit 14 outputs the detected detection value to the first attitude estimation unit 16 (or, the first attitude estimation unit 16 and the control unit 18) at a specific period. The first attitude estimation unit 16 performs the attitude estimation of UAV1 by performing Visual-SLAM based on the detection value from the camera unit 14, and outputs the first attitude estimation result to the control unit 18 at a specific period. The rotation angle detection unit 15 outputs the detected detection value to the second attitude estimation unit 17 (or, the second attitude estimation unit 17 and the control unit 18) at a specific period. The second attitude estimation unit 17 estimates the attitude of UAV1 based on the detection value from the rotation angle detection unit 15, and outputs the second attitude estimation result to the control unit 18 at a specific period.

[0062] Next, the control unit 18 obtains the position information from the camera unit 14 (step S3). Next, the control unit 18 obtains the first attitude estimation result from the first attitude estimation unit 16 (step S4). Next, the control unit 18 obtains the second attitude estimation result from the second attitude estimation unit 17 (step S5). Next, the control unit 18 determines the ratio as described above based on the position information obtained in step S3 (step S6). Next, the control unit 18 performs flight control including control of the position, attitude, and direction of travel of UAV1 (step S7). In the flight control, the control unit 18 performs attitude control of UAV1 (flight control based on the ratio of attitude estimation results) by using the first attitude estimation result obtained in step S4 and the second attitude estimation result obtained in step S5 at the ratio determined in step S6.

[0063] Next, the control unit 18 determines whether the UAV1 has arrived at the destination point based on the flight plan information and position information of the UAV1 (step S8). If the control unit 18 determines that the UAV1 has not arrived at the destination point (step S8: NO), the control unit 18 proceeds to step S9. On the other hand, if the control unit 18 determines that the UAV1 has arrived at the destination point (step S8: YES), the control unit 18 ends the operation. Figure 3 Processing shown.

[0064] In step S9, the control unit 18 determines whether to switch from the flight control based on the ratio of the attitude estimation result to the flight control based on the second attitude estimation result. Figure 5 As shown, after the control unit 18 determines that the UAV1 has taken off from the airport P based on the altitude information of the UAV1, it specifies the altitude (flight altitude) of the UAV1, and when the specified altitude reaches a specific altitude, it determines to switch from the flight control based on the ratio of the attitude estimation result to the flight control based on the second attitude estimation result. Alternatively, the control unit 18 can also calculate the distance of the UAV1 from the airport P based on the position information of the UAV1, and when the calculated distance reaches a specific distance, it determines to switch to the flight control based on the second attitude estimation result. Alternatively, the control unit 18 can also calculate the deviation between the most recently acquired first attitude estimation result and the most recently acquired second attitude estimation result, and when the calculated deviation is less than a threshold value, it determines to switch to the flight control based on the second attitude estimation result. Alternatively, the control unit 18 can also calculate the deviation between the value indicating the reference orientation (north) detected by the three-axis geomagnetic sensor of the rotation angle detection unit 15 and the true value, and when the calculated deviation is less than a threshold value, it determines to switch to the flight control based on the second attitude estimation result.

[0065] Moreover, when the control unit 18 determines that the flight control based on the second attitude estimation result has not been switched (step S9: NO), it returns to step S3 and repeats the same processing as above. On the other hand, when the control unit 18 determines that the flight control based on the second attitude estimation result has been switched (step S9: YES), it stops acquiring the first attitude estimation result and proceeds to step S10. Here, the control unit 18 may also disconnect the power supply to the camera unit 14 and the first attitude estimation unit 16. That is, the power supply to the camera unit 14 and the first attitude estimation unit 16 is controlled according to the position information of the UAV1. In this way, the power consumption of the UAV1 can be suppressed.

[0066] In step S10, the control unit 18 obtains the position information from the camera unit 14. Next, the control unit 18 obtains the second attitude estimation result from the second attitude estimation unit 17 (step S11). Next, the control unit 18 performs flight control including control of the position, attitude, and travel direction of the UAV 1 (step S12). In the flight control, the control unit 18 performs attitude control of the UAV 1 by using the second attitude estimation result obtained in step S11.

[0067] Next, the control unit 18 determines whether the UAV1 has arrived at the destination point based on the flight plan information and position information of the UAV1 (step S13). If the control unit 18 determines that the UAV1 has not arrived at the destination point (step S13: NO), the control unit 18 proceeds to step S14. On the other hand, if the control unit 18 determines that the UAV1 has arrived at the destination point (step S13: YES), the control unit 18 ends the operation. Figure 3 Processing shown.

[0068] In step S14, the control unit 18 determines whether UAV1 has entered a specific area Ar (e.g., a pre-registered area) with a strong magnetic field, etc., based on the position information of UAV1. If the control unit 18 determines that UAV1 has not entered area Ar (step S14: NO), the control unit 18 returns to step S10 and repeats the same processing as above. On the other hand, if the control unit 18 determines that UAV1 has entered area Ar (step S14: YES), it stops acquiring the second posture estimation result and proceeds to step S15. Figure 5 As shown, the flight control based on the second posture estimation result is switched to the flight control based on the first posture estimation result.

[0069] In addition, in step S9, when the power supply to the camera unit 14 and the first attitude estimation unit 16 is disconnected, the control unit 18 turns on the power supply to the camera unit 14 and the first attitude estimation unit 16 at least before the UAV1 enters the area Ar (for example, several seconds before), and starts the camera unit 14 and the first attitude estimation unit 16. As a result, it is possible to smoothly switch from the flight control based on the second attitude estimation result to the flight control based on the first attitude estimation result. For example, by obtaining the relative relationship between the second attitude estimation result and the first attitude estimation result in advance before the UAV1 enters the area Ar, even if the UAV1 enters the area Ar and switches to the flight control based on the first attitude estimation result, the UAV1 can continue to fly stably. In addition, in the case of multiple flights in the area Ar, or multiple UAV1 flying in the area Ar, the attitude estimation accuracy of the first attitude estimation unit 16 can be expected to be improved by pre-storing the feature point map information of the area Ar.

[0070] In step S15, the control unit 18 obtains the position information from the camera unit 14. Next, the control unit 18 obtains the first attitude estimation result from the first attitude estimation unit 16 (step S16). Next, the control unit 18 performs flight control including control of the position, attitude, and travel direction of the UAV 1 (step S17). In the flight control, the control unit 18 performs attitude control of the UAV 1 by using the first attitude estimation result obtained in step S16.

[0071] Next, the control unit 18 determines whether the UAV1 has arrived at the destination point based on the flight plan information and position information of the UAV1 (step S18). If the control unit 18 determines that the UAV1 has not arrived at the destination point (step S18: NO), the control unit 18 proceeds to step S19. On the other hand, if the control unit 18 determines that the UAV1 has arrived at the destination point (step S18: YES), the control unit 18 ends the operation. Figure 3 Processing shown.

[0072] In step S19, the control unit 18 determines whether UAV1 has left the above-mentioned area Ar based on the position information of UAV1. When the control unit 18 determines that UAV1 has not left the area Ar (step S19: NO), it returns to step S15 and repeats the same processing as above. On the other hand, when the control unit 18 determines that UAV1 has left the area Ar (step S19: YES), it stops obtaining the first posture estimation result and returns to step S10. Figure 5 As shown, the flight control based on the first posture estimation result is switched to the flight control based on the second posture estimation result.

[0073] As described above, according to the above embodiment, the first attitude estimation unit 16 estimates the attitude of the UAV1 by performing Visual-SLAM based on the detection value detected by the camera unit 14, and the second attitude estimation unit 17 estimates the attitude of the UAV1 based on the detection value detected by the rotation angle detection unit 15. In addition, the control unit 18 is configured to perform attitude control of the UAV1 by using the first attitude estimation result of the first attitude estimation unit 16 and the second attitude estimation result of the second attitude estimation unit 17 in a ratio based on the position information of the UAV1, thereby achieving a stable takeoff of the UAV1 and making the UAV1 fly stably even if the detection value detected by the geomagnetic sensor or the inertial sensor is unreliable due to the presence of a specific object near the takeoff point of the UAV1.

[0074] In addition, the above embodiment is one embodiment of the present invention, and the present invention is not limited to the above embodiment. The various configurations of the above embodiment can be changed within the scope of the present invention, and such a situation is also included in the technical scope of the present invention. In the above embodiment, the control unit 18 of UAV1 performs attitude control of UAV1 by using the first attitude estimation result and the second attitude estimation result in a ratio based on the position information of UAV1, but the control server CS can also be configured to perform attitude control of UAV1 as the control device of the present invention. In this case, the control server CS functions as the first acquisition unit, the second acquisition unit, the third acquisition unit, the first attitude estimation unit, the second attitude estimation unit, and the flight control unit. In addition, the control server CS acquires the first detection value detected by the camera unit 14 from UAV1, acquires the second detection value detected by the rotation angle detection unit 15 from UAV1, and acquires the position information indicating the current position of UAV1 detected by the positioning unit 12. Moreover, the control server CS performs attitude estimation of UAV1 through the first attitude estimation unit based on the acquired first detection value, and performs attitude estimation through the second attitude estimation unit UAV1 based on the acquired second detection value, and uses the first attitude estimation result of the first attitude estimation unit and the second attitude estimation result of the second attitude estimation unit in a ratio based on the acquired position information to perform attitude control of UAV1. The control is performed by sending a control command from the control server CS to UAV1. In the above embodiment, the case where the present invention is applied to UAV1 is taken as an example for explanation, but the present invention can also be applied to a manned aircraft that can fly even if there is no operator (pilot) in the aircraft.

[0075] [Explanation of Symbols]

[0076] 1 UAV

[0077] 2 UTMS

[0078] 3 PMS

[0079] 11. Drive unit

[0080] 12 Positioning unit

[0081] 13 Wireless Communications Department

[0082] 14 Camera Department

[0083] 15 Rotation angle detection unit

[0084] 16 First posture estimation unit

[0085] 17 Second posture estimation unit

[0086] 18 Control Department

[0087] CS Control Server

[0088] S flight system.

Claims

1. A control device, characterized in that: Perform flight control of an aircraft equipped with optical sensors and at least one type of three-axis sensor, having: a first acquisition unit that acquires a first detection value detected by the optical sensor; a second acquisition unit that acquires a second detection value detected by the three-axis sensor; a third acquisition unit, which acquires position information indicating a flight position of the aircraft; a first attitude estimation unit for estimating the attitude of the aircraft based on the first detection value; a second attitude estimation unit for estimating the attitude of the aircraft based on the second detection value; and a flight control unit that performs flight control of the aircraft by utilizing the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit in a ratio based on the position information; and The position information includes altitude information indicating the altitude of the aircraft, The flight control unit uses the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit at a ratio based on the altitude information.

2. The control device according to claim 1, characterized in that: The flight control unit uses at least the attitude estimation result of the first attitude estimation unit from the time the aircraft takes off until it reaches a specific altitude, and uses the attitude estimation result of the second attitude estimation unit after the aircraft reaches the specific altitude.

3. A control device, characterized in that: Perform flight control of an aircraft equipped with optical sensors and at least one type of three-axis sensor, having: a first acquisition unit that acquires a first detection value detected by the optical sensor; a second acquisition unit that acquires a second detection value detected by the three-axis sensor; a third acquisition unit, which acquires position information indicating a flight position of the aircraft; a first attitude estimation unit for estimating the attitude of the aircraft based on the first detection value; a second attitude estimation unit for estimating the attitude of the aircraft based on the second detection value; a flight control unit that performs flight control of the aircraft by using the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit in a ratio based on the position information; and a distance calculating unit, the distance calculating unit calculating the distance between the aircraft and the take-off point based on the position information; and The flight control unit uses the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit at a ratio based on the distance.

4. The control device according to claim 3, characterized in that: The flight control unit uses at least the attitude estimation result of the first attitude estimation unit from the time the aircraft takes off until it reaches a specific distance, and uses the attitude estimation result of the second attitude estimation unit after the aircraft reaches the specific distance.

5. The control device according to claim 1 or 3, characterized in that: The flight control unit at least utilizes the attitude prediction result of the first attitude prediction unit when the deviation between the attitude prediction result of the first attitude prediction unit and the attitude prediction result of the second attitude prediction unit is greater than a threshold value, and utilizes the attitude prediction result of the second attitude prediction unit when the deviation is less than the threshold value.

6. A control device, characterized in that: Perform flight control of an aircraft equipped with optical sensors and at least one type of three-axis sensor, having: a first acquisition unit that acquires a first detection value detected by the optical sensor; a second acquisition unit that acquires a second detection value detected by the three-axis sensor; a third acquisition unit, which acquires position information indicating a flight position of the aircraft; a first attitude estimation unit for estimating the attitude of the aircraft based on the first detection value; a second attitude estimation unit that estimates the attitude of the aircraft based on the second detection value; and a flight control unit that performs flight control of the aircraft based on the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit; and The 3-axis sensor includes a geomagnetic sensor, and The control device further includes a correction unit, which corrects the reference orientation to a true value before the aircraft takes off. The flight control unit uses at least the attitude estimation result of the first attitude estimation unit when the deviation between the value representing the reference orientation detected by the geomagnetic sensor and the true value is greater than a threshold value, and uses the attitude estimation result of the second attitude estimation unit when the deviation is less than the threshold value.

7. A control device, characterized in that: Perform flight control of an aircraft equipped with optical sensors and at least one type of three-axis sensor, having: a first acquisition unit that acquires a first detection value detected by the optical sensor; a second acquisition unit that acquires a second detection value detected by the three-axis sensor; a third acquisition unit, which acquires position information indicating a flight position of the aircraft; a first attitude estimation unit for estimating the attitude of the aircraft based on the first detection value; a second attitude estimation unit that estimates the attitude of the aircraft based on the second detection value; and a flight control unit that performs flight control of the aircraft based on the attitude estimation result of the first attitude estimation unit and the attitude estimation result of the second attitude estimation unit; and The flight control unit uses the attitude estimation result of the first attitude estimation unit when the aircraft is within a specific area, and uses the attitude estimation result of the second attitude estimation unit when the aircraft is outside the specific area.

8. A control device according to any one of claims 1, 3, 6 or 7, characterized in that A power supply control unit is further provided, the power supply control unit controlling the power supply to the optical sensor based on the position information.

9. A control method, characterized in that: The control method is performed by a system for performing flight control of an aircraft, the aircraft having an optical sensor and at least one three-axis sensor, the control method comprising: A step of acquiring a first detection value detected by the optical sensor; A step of acquiring a second detection value detected by the three-axis sensor; The step of acquiring position information representing the flight position of the aircraft; A first attitude estimation step of estimating the attitude of the aircraft based on the first detection value; A second attitude estimation step of estimating the attitude of the aircraft based on the second detection value; and A step of performing flight control of the aircraft by utilizing the attitude estimation result of the first attitude estimation step and the attitude estimation result of the second attitude estimation step in a ratio based on the position information; and The position information includes altitude information indicating the altitude of the aircraft, In the step of performing flight control of the aircraft, the attitude estimation result of the first attitude estimation step and the attitude estimation result of the second attitude estimation step are used in a ratio based on the altitude information.

Citation Information

Patent Citations

  • Position and attitude measuring device of flying body

    JP2004345435A

  • Wind estimation system, wind estimation method, and program

    CN108369243A

  • Equipment for controlling flight and operation method thereof

    CN109947122A

  • Aircraft control method and aircraft

    CN110347171A

  • Method and apparatus for correcting aircraft state in real time

    EP3081902A1