Aircraft control system and marker for controlling aircraft
The aircraft control system dynamically adjusts flight paths using marker identification information and server-stored data, addressing the inefficiency of traditional marker-based systems by enabling flexible path changes and enhancing safety and efficiency.
Patent Information
- Application Number
- JP2020162993
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-09-29
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2040-09-29
AI Technical Summary
Existing aircraft control systems require time and effort to change markers and guide lines whenever the flight path is altered, limiting flexibility and efficiency in path adjustments.
Aircraft control systems and markers that utilize identification information displayed on markers to dynamically change flight paths without altering physical markers, incorporating a control device that reads and combines identification information with flight route data stored on a server, allowing for flexible path changes and reduced marker complexity.
Enables aircraft to change flight paths efficiently without modifying physical markers, reduces marker complexity, enhances flight safety, and optimizes marker information display to prevent recognition errors, ensuring safe and adaptable flight operations.
Smart Images

Figure 0007584122000001 
Figure 0007584122000002 
Figure 0007584122000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a control system for an air vehicle and a marker for controlling an air vehicle. [Background technology]
[0002] Conventionally, there is known an aircraft control system that uses markers to control the aircraft (see, for example, Patent Document 1). The aircraft control system of Patent Document 1 controls the aircraft using signs and guiding lines affixed to the floor and walls along the flight path of the aircraft. The aircraft moves by identifying the flight path using the signs and guiding lines. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2014-031118 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, the aircraft control system of Patent Document 1 requires changing markers and guiding lines when changing the flight path of the aircraft, which means that a user of the aircraft control system must take the trouble of changing these markers every time they change the flight path.
[0005] An object of the present disclosure is to provide an aircraft control system and an aircraft control marker that can change a flight path without changing a marker on the flight path. [Means for solving the problem]
[0006] The control system for an aircraft according to the present disclosure includes a control device for the aircraft, a plurality of first markers, and a second marker. The plurality of first markers display identification information. The second marker displays information for causing the control device to acquire flight path information including the identification information. The control device executes a process of reading the information displayed on the second marker and acquiring the flight path information, a process of reading the identification information displayed on the first marker, comparing the read identification information with identification information included in the flight path information, and identifying the flight path of the aircraft, and a process of moving the aircraft based on the identified flight path.
[0007] According to this flying object control system, the flight path can be identified by the identification information displayed on the first marker. This makes it possible to provide a flying object control system and a flying object control marker that can change the flight path without changing the markers on the flight path. As a result, the user is saved from the trouble of changing the marker. Furthermore, the flight path information can be obtained by the control device reading the second marker. This allows the user to have the control device obtain the flight path information even if there are multiple flight paths by simply changing the second marker.
[0008] Furthermore, when flight route information is displayed on a marker, there is a limit to the amount of information that an aircraft can read in one go. This makes it impossible to set complex flight routes. However, with this configuration, the flight route is specified by flight route information that includes identification information. This makes it possible to set any flight route simply by displaying identification information on the marker.
[0009] The control device may execute a process of moving the aircraft toward the next first marker when the read identification information matches the identification information included in the flight path information.
[0010] According to this configuration, if the identification information displayed on the marker does not match the identification information included in the flight path information, the flying object will not move, thereby ensuring flight safety.
[0011] The control system of the aircraft may further include a server that stores the flight path information. The second marker may indicate a storage location of the flight path information. The control device may execute a process of reading the second marker and a process of accessing the storage location indicated by the second marker to obtain the flight path information.
[0012] According to this configuration, since the flight path information is stored in the server, the user can change the flight path information without operating the control device. Furthermore, even if the same flight path information is used for multiple flying objects, for example, the user only needs to change the flight path information in the server. Therefore, the user does not need to change the flight path information for each flying object. As a result, the user can save time and effort. Furthermore, since the server stores the flight path information, the control device does not need to store the flight path information in advance. As a result, the storage capacity of the control device is reduced, and the control device can be made smaller.
[0013] The flight path information may include flight distance information that is a flight distance of the entire flight path. The control device may execute a process of acquiring a remaining battery charge of the aircraft, and a process of not allowing the aircraft to take off when the remaining battery charge is insufficient for the flight distance.
[0014] This configuration makes it possible to prevent the aircraft from landing in a location unexpected by the user.
[0015] The flight path information may include marker distance information that is a distance between a plurality of first markers. The control device may execute a process of acquiring a remaining battery level, and a process of landing the aircraft when the remaining battery level is insufficient for the marker distance.
[0016] According to this configuration, the control device can calculate the flight distance based on the remaining battery power using the marker distance information and the remaining battery power, thereby preventing the aircraft from landing in a location unexpected by the user.
[0017] The flight path information may include movement information related to the movement of the aircraft and operation information related to operations other than the movement of the aircraft.
[0018] According to this configuration, for example, there is no need to display operations other than the movement of the flying object, such as photographing, measuring, and exposing, on the marker. This allows the control system of the flying object to perform operations other than movement without changing the marker. This makes it possible to reduce the number of markers. Also, since there is no need to display operations other than movement on the marker, the amount of information displayed on the marker is reduced. As a result, for example, it is possible to reduce recognition errors that occur when the control device reads the marker.
[0019] The control system of the aircraft may further include a third marker that indicates a position where the aircraft can land if an abnormality occurs in the aircraft.
[0020] This configuration makes it possible to prevent the aircraft from landing in a location unexpected by the user.
[0021] The control system for the aircraft may further include a first port from which the aircraft takes off, at least one second port on which the aircraft can land at any time, and a third port corresponding to the third marker. When an abnormality occurs in the aircraft, the control device may execute a process of selecting a port closest to the aircraft from among the first port, the second port, and the third port, and a process of landing the aircraft on the selected port.
[0022] With this configuration, if an abnormality occurs in the aircraft, it is possible to prevent the aircraft from landing in a location unexpected by the user.
[0023] The control system of the air vehicle may further include a fourth marker that displays information for returning to the flight path flown by the air vehicle.
[0024] This configuration allows the aircraft to return to its take-off position.
[0025] The aircraft control marker is placed at the starting point of the aircraft's flight path, and displays information for allowing the aircraft's control device to acquire the aircraft's flight path information, and at least one of text information and images related to the flight path information.
[0026] This marker for controlling an aircraft can acquire flight path information and change the flight path without changing the marker on the flight path. In addition, the character information or image related to the flight path information makes it easy for the user to recognize the purpose of this marker for controlling an aircraft.
[0027] The aircraft control marker is placed on the flight path of the aircraft, and displays identification information included in the flight path information of the aircraft, and at least one of text information and an image related to the identification information.
[0028] According to this marker for controlling an aircraft, the identification information can be read by the aircraft and the aircraft can be moved without changing the marker on the flight path. In addition, the character information or image related to the identification information makes it easy for the user to recognize the purpose of the marker for controlling an aircraft.
[0029] The aircraft control marker is placed on the flight path of the aircraft and displays at least one of a position where the aircraft can land if an abnormality occurs in the aircraft, and text information and an image related to the abnormality in the aircraft.
[0030] According to this marker for controlling an aircraft, if an abnormality occurs in the aircraft, the aircraft can be landed in a safe place without changing the marker on the flight path. In addition, the character information or image regarding the abnormality of the aircraft makes it easy for the user to recognize the place where the aircraft will land in the event of an abnormality.
[0031] The aircraft control marker is placed on the flight path of the aircraft and displays information for returning the aircraft to the flight path it has flown, and at least one of text information and images related to the information.
[0032] This marker for controlling an aircraft allows the aircraft to return to the takeoff location without changing the marker on the flight path or the flight path information that the control device obtained from the server at the time of takeoff. In addition, the character information or image regarding the aircraft returning to the flight path that it flew makes it easy for the user to recognize the course of the aircraft. Effect of the Invention
[0033] According to the flying object control system and flying object control marker of the present disclosure, it is possible to provide an flying object control system and flying object control marker that can change the flight path without changing the markers on the flight path. [Brief description of the drawings]
[0034] [Figure 1] FIG. 1 is a system diagram of an air vehicle control system according to one embodiment of the present disclosure. [Diagram 2] FIG. 2 is a system diagram of a control device for an air vehicle according to one embodiment of the present disclosure. [Diagram 3] FIG. 2 illustrates common data for a flight plan according to one embodiment of the present disclosure. [Figure 4] FIG. 13 is a diagram illustrating data corresponding to flight plan identification information according to one embodiment of the present disclosure. [Diagram 5] FIG. 1 illustrates an ID marker according to one embodiment of the present disclosure. [Figure 6] FIG. 1 illustrates an initial marker according to one embodiment of the present disclosure. [Figure 7] FIG. 1 illustrates a temporary landing marker according to one embodiment of the present disclosure. [Figure 8] FIG. 1 illustrates a return marker according to one embodiment of the present disclosure. [Figure 9] 4 is a flowchart of a main routine illustrating processing executed by a control device according to an embodiment of the present disclosure. [Figure 10] 5 is a flowchart of a subroutine illustrating processing executed by a control device according to an embodiment of the present disclosure. [Figure 11] FIG. 13 is a diagram showing flight plan data that is checked when a temporary landing marker is read according to one embodiment of the present disclosure. [Figure 12] FIG. 13 is a diagram showing flight plan data that is checked when reading a return marker according to one embodiment of the present disclosure. [Figure 13] FIG. 13 is a diagram showing the behavior of an aircraft when an abnormality occurs in the aircraft according to an embodiment of the present disclosure. [Figure 14] FIG. 13 is a diagram showing the behavior of an aircraft when a return marker according to an embodiment of the present disclosure is used. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0035] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings.
[0036] <Overall composition> As shown in FIG. 1, the control system 1 of the aircraft 2 includes a control device 3 of the aircraft 2, a user terminal 4, a server 6, a relay device 8, a plurality of ID markers (an example of a first marker) 10, an initial marker (an example of a second marker) 12, a temporary landing marker (an example of a third marker) 14, a return marker (an example of a fourth marker) 16, a takeoff port (an example of a first port) 18, a normal landing port (an example of a second port) 20, and a temporary landing port (an example of a third port) 22.
[0037] The control system 1 for the aircraft 2 of this embodiment is a system that inspects a structure X at a construction site or the like using the aircraft 2. The structure X is, for example, the wall surface of a tunnel or a wall surface of a building or other structure.
[0038] 2, the aircraft 2 has at least a camera 24, an exposure device 26, a laser device 28, a battery 30, a plurality of motors 32, and a flight control unit 34. The aircraft 2 may also have a plurality of sensors, such as a gyro and an acceleration sensor, for detecting the attitude and speed of the aircraft. In this embodiment, the aircraft 2 is an unmanned multicopter equipped with four motors 32. However, the aircraft 2 may be any known multicopter.
[0039] The flight control unit 34 is a device for receiving instructions from the control device 3 and controlling the flying object 2. The flight control unit 34 is actually composed of a microcomputer including a CPU, a memory, an I / O interface, and a motor driver, and wireless communication devices such as Wi-Fi (registered trademark) and Bluetooth (registered trademark). The flight control unit 34 executes control of each part of the flying object 2 using a program stored in the memory. The program included in the flight control unit 34 includes at least a process of receiving instructions from the control device 3, a process of controlling the flying object 2 to have a desired attitude and speed by controlling the multiple motors 32 according to the received instructions, a process of capturing images using the camera 24, a process of measuring the distance using the laser device 28, a process of operating the exposure device 26, and a process of acquiring the remaining battery charge of the battery 30.
[0040] The control device 3 is a device for reading the initial marker 12, the ID marker 10, the temporary landing marker 14, and the return marker 16 (hereinafter referred to as each marker in the specification), transmitting desired instructions to the flight control unit 34, and controlling the flying object 2. The control device 3 also records flight history such as the direction, altitude, and distance traveled by the flying object 2 from the takeoff port 18. The control device 3 is actually composed of a microcomputer including a calculation unit 36, a storage unit 38, and an I / O interface, and a wireless communication device (communication unit 40 in FIG. 2) such as Wi-Fi (registered trademark) and Bluetooth (registered trademark). The control device 3 uses a program stored in the storage unit 38 to generate an instruction signal to be transmitted to the flight control unit 34, and transmits it to the flight control unit 34. In this embodiment, the control device 3 is provided separately from the flight control unit 34, fixed to a desired location of the flying object 2, and electrically connected to the flight control unit 34 wirelessly or by wire. This allows the flying object 2 to be controlled using a program included in an existing multicopter. However, the control device 3 may be provided integrally with the flight control unit 34.
[0041] The user terminal 4 is a personal computer for a user to create and record a flight plan (an example of flight route information). However, the user terminal 4 may be a device such as a smartphone or a tablet terminal.
[0042] As shown in Fig. 3 and Fig. 4, the flight plan records the arrangement information of each marker as data. In other words, the flight plan is information for the control device 3 to control the flying object 2 while reading some or all of the markers arranged on the flight path. As shown in Fig. 3, the flight plan records, as an example of common information, the flight plan number, information on the initial marker 12, the speed of the flying object 2, the marker recognition time, information on the temporary landing marker 14, flight distance information of the entire flight path, information on the landing instruction voltage, and information on the takeoff denial voltage. Here, the marker recognition time is the upper limit time required for the control device 3 to process reading the information displayed on each marker. In addition, the common information may include the name of a user who uses the flight plan.
[0043] As shown in FIG. 4, the flight plan includes information on the movement of the aircraft 2 corresponding to the identification information and information on the operation of the aircraft 2 corresponding to the identification information. In the flight plan, as an example of information on the movement of the aircraft 2 corresponding to the identification information, the identification information (id), hovering time, presence or absence of a permanent landing port 20, the direction to the next ID marker 10, the distance to the next ID marker 10, the distance to the structure X, and the altitude of the aircraft 2 are recorded for each identification information. In the flight plan, as an example of information on the operation of the aircraft 2 corresponding to the identification information, the presence or absence of operation of the exposure device 26, the aircraft rotation angle of the aircraft 2, the need for distance measurement by the laser device 28, and the like are recorded. However, if at least the identification information and the direction to the next ID marker 10 are recorded in the flight plan, the control device 3 can move the aircraft 2.
[0044] In this embodiment, the identification information is a number from 1 to 999. Therefore, information related to the movement and operation of the aircraft 2 corresponding to the numbers from 1 to 999 is recorded in the flight plan. In this embodiment, 101 is assigned as the identification information of the initial marker 12. Furthermore, 999 is assigned as the identification information of the temporary landing marker 14. Similarly, 998 is assigned as the identification information of the return marker 16. However, the identification information displayed on these markers may use symbols other than numbers.
[0045] The server 6 is connected to the user terminal 4 via the Internet, and stores flight plans created and recorded by the user terminal 4. The server 6 is, for example, a cloud storage, which is a storage device located on the Internet. However, the server 6 may be any known storage device connected to the Internet as long as it is capable of storing flight plans.
[0046] The relay device 8 is connected to the control device 3 via wireless communication and is also connected to the server 6 via the Internet, and serves as a relay between the control device 3 and the server 6. In this embodiment, the relay device 8 is placed at a construction site where the aircraft 2 is used. However, the relay device 8 is not necessarily required, and for example, the control device 3 and the server 6 may be directly connected by wireless communication.
[0047] As shown in FIG. 1, a plurality of ID markers 10 are placed on a structure X. Permanent landing ports 20 are placed below some of the ID markers 10. The ID markers 10 display identification information as shown in FIG. 5. In this embodiment, the identification information is numbers, so the ID markers 10 display an image in which the numbers, which are the identification information, are converted into an AR marker. The ID markers 10 also display text or image information related to the identification information.
[0048] In this embodiment, for example, when the identification information is 1, the ID marker 10 displays ID1. This makes it easy for the user to recognize which identification information the ID marker 10 indicates. The ID marker 10 may also display an image related to the movement or operation of the aircraft 2. In this embodiment, when the control device 3 reads the ID marker 10, it hovers. In this case, the ID marker 10 may display an image indicating that the aircraft 2 is hovering.
[0049] The initial marker 12 is placed at the start point of the flight path. The initial marker 12 is provided so that the control device 3 can obtain a flight plan. In this embodiment, the initial marker 12 is placed near the takeoff port 18. This allows the control device 3 to read the initial marker 12 before takeoff. However, the initial marker 12 only needs to be placed at the start point of the flight path, in other words, before the ID marker 10 is read, and may be placed, for example, at a position where the aircraft has risen a certain distance from the takeoff port 18.
[0050] The initial marker 12 displays information about the flight plan acquired by the control device 3. In this embodiment, the number 101 is converted into an AR marker and displayed. The number 101 is identification information for PLAN4 of the flight plan (see FIG. 3). However, the initial marker 12 may also be the URL of the server 6 in which the desired flight plan is stored, converted into an AR marker and displayed.
[0051] The initial marker 12 also displays text or image information related to the flight plan. In this embodiment, for example, when the control device 3 is to acquire a flight plan with a flight plan number of 4, the initial marker 12 displays PLAN4. This makes it easy for the user to recognize which flight plan the control device 3 is acquiring. The initial marker 12 may also display an image related to the movement or operation of the aircraft 2. In this embodiment, when the control device 3 reads the initial marker 12, it rises. In this case, the initial marker 12 may display an image indicating that the aircraft 2 is rising.
[0052] The temporary landing marker 14 is placed on the flight path of the aircraft 2. A temporary landing port 22 is placed below the temporary landing marker 14. The temporary landing marker 14 is attached by the user at any position on the flight path so that the aircraft 2 can land only if an abnormality occurs in the aircraft 2. At a construction site, there are some locations where the aircraft 2 cannot land. In this way, by placing the temporary landing marker 14, the aircraft 2 can easily land safely if an abnormality occurs in the aircraft 2. This makes it possible to prevent damage to the construction site by the aircraft 2.
[0053] The temporary landing marker 14 indicates that this is a possible location for landing if an abnormality occurs in the aircraft 2. In this embodiment, the temporary landing marker 14 displays the number 999 by converting it into an AR marker. As will be described later, the portion of the flight plan corresponding to the number 999 is recorded as having a landing port. As a result, the control device 3 stores that landing is possible below the temporary landing marker 14.
[0054] The temporary landing marker 14 also displays text or image information related to an abnormality in the aircraft 2. In this embodiment, for example, the temporary landing marker 14 displays EMERGENCY, which means an abnormality. This makes it easy for the user to recognize that there is a possibility that the aircraft 2 will land under the temporary landing marker 14. The temporary landing marker 14 may also display an image indicating an abnormality in the aircraft 2.
[0055] The return marker 16 is placed on the flight path of the aircraft 2. When returning the aircraft 2 to the take-off position, the user attaches the return marker 16 to any position on the flight path. At a construction site, materials and the like may be hastily placed on the flight path. In such a case, placing the return marker 16 makes it easier for the aircraft 2 to return safely to the take-off position. This prevents the construction site from being damaged by the aircraft 2.
[0056] The return marker 16 displays information for the aircraft 2 to return to its flight path. In this embodiment, the return marker 16 converts the number 998 into an AR marker and displays it. As will be described later, the portion of the flight plan corresponding to the number 998 records information indicating that the aircraft 2 will return to the order of the identification information read by the control device 3. This enables the control device 3 to safely return the aircraft 2 to the takeoff port 18.
[0057] The return marker 16 also displays text or image information indicating that the aircraft 2 will return. In this embodiment, for example, the return marker 16 displays "RETURN." This makes it easy for the user to recognize that the aircraft 2 will return. The return marker 16 may also display an image indicating that the aircraft 2 will return.
[0058] The takeoff port 18 is arranged at the takeoff position as described above. The permanent landing port 20 is arranged below some of the multiple ID markers 10. The temporary landing port 22 is arranged below the temporary landing marker 14. Note that the temporary landing marker 14 is not necessarily required, and the aircraft 2 may land on the ground at a construction site. The takeoff port 18 and the permanent landing port 20 may also be provided with facilities for charging the battery 30 of the aircraft 2.
[0059] <Control configuration> Next, the process executed by the control device 3 will be described with reference to Fig. 1 and Fig. 9 to Fig. 14. When the control device 3 acquires a start instruction, the control device 3 starts the camera 24 and executes a process to start capturing images, and then starts the following process.
[0060] As shown in FIG. 9, the control device 3 reads the initial marker 12 (step S1). After reading the initial marker 12, the control device 3 accesses the storage location of the flight plan in the server 6 via the relay device 8. After accessing the storage location, the control device 3 selects a flight plan that matches the read identification information. In this embodiment, the control device 3 selects a flight plan in which the number 101 is recorded in the initial marker ID field of the flight plan (see FIG. 3). After accessing the flight plan stored in the server 6, the control device 3 downloads and acquires the flight plan (step S2). Note that a plurality of flight plans may be stored in the control device 3 in advance, and the control device 3 may select one flight plan from among the plurality of flight plans by reading the initial marker 12.
[0061] When a URL is displayed in the initial marker 12, the control device 3 may use the URL to access the flight plan stored in the server 6. In addition, the control device 3 may execute a process to determine whether or not the user name recorded in the flight plan matches.
[0062] When the control device 3 acquires the flight plan, it acquires the entire flight distance of the flight path from the common information of the flight plan (step S3). The control device 3 acquires the voltage V of the battery 30 and judges whether the voltage V is equal to or less than a first predetermined voltage V1 (step S4). Here, the voltage V is a value indicating the remaining battery level of the battery 30. The first predetermined voltage V1 is determined based on the remaining battery level required for the entire flight distance of the flight path. In this embodiment, a takeoff permission voltage Vt indicating the remaining battery level of the battery 30 required in consideration of the entire flight distance is recorded in the flight plan. For this reason, the control device 3 acquires the takeoff permission voltage Vt from the flight plan and judges the takeoff permission voltage Vt to be the first predetermined voltage V1. If the voltage V is equal to or more than the first predetermined voltage V1 (step S4 YES), the control device 3 permits takeoff and allows the flying object 2 to take off (step S5). In this way, by allowing the flying object 2 to take off only when the remaining battery level is sufficient for the entire flight distance, it is possible to prevent the flying object 2 from landing at a position unexpected by the user.
[0063] Upon takeoff, the control device 3 reads the identification information of the ID marker 10 (step S6). After reading the identification information, the control device 3 compares it with the identification information of the acquired flight plan and determines whether it matches the identification information of the flight plan (step S7). For example, assume that the control device 3 reads the number 1 as the identification information. In this case, the control device 3 compares the read number 1 with the identification information recorded in the flight plan and determines whether the number 1 (id=1 in FIG. 4) is recorded as the identification information.
[0064] If the read identification information matches the identification information in the flight plan (step S7: YES), the control device 3 reads the movement information of the aircraft 2 corresponding to the identification information in the flight plan and identifies the flight path. The control device 3 moves the aircraft 2 toward the next ID marker 10 based on the identified flight path (step S8).
[0065] In this embodiment, the control device 3 reads a number from the AR marker displayed on the ID marker 10, and refers to the movement information that matches the read number from the number recorded as the identification information of the flight plan. For example, as shown in FIG. 1, when the control device 3 reads the ID marker 10 of ID1, it checks it against the acquired flight plan and determines whether there is a column in which 1 is recorded as the identification information. If the acquired flight plan has 1 as the identification information, the control device 3 acquires the movement direction and movement distance (marker distance information) for moving to the next ID marker 10, ID2, and specifies the flight path. The control device 3 moves the aircraft 2 based on the specified flight path. Similarly, the control device 3 moves the aircraft while reading the identification information from ID2, ID3, ID4, to IDn. Note that, for example, if the information of the aircraft 2 moving to ID3 is not recorded in the acquired flight plan, the control device 3 moves the aircraft 2 from ID2 to ID4 without moving to ID3.
[0066] Steps S9 and S10 are processes executed by the control device 3 when the temporary landing marker 14 is placed on the flight path. The control device 3 judges whether the temporary landing marker 14 has been read (step S9). When the temporary landing marker 14 has been read (step S9 YES), the control device 3 stores the position of the temporary landing port 22 (step S10). In this embodiment, the control device 3 reads the number 999 from the AR marker displayed on the temporary landing marker 14. The control device 3 records the position where the temporary landing marker 14 was read. More specifically, as shown in FIG. 11, the control device 3 records the fact that the landing port is included in the recorded information of 999 as identification information in the acquired flight plan, at the position where the temporary landing marker 14 is placed.
[0067] For example, as shown in Fig. 1, when the temporary landing marker 14 is placed between ID5 and ID7, the control device 3 stores the recorded information of 999 between the information of ID5 and ID7 of the acquired flight plan. In addition, the control device 3 may calculate the position of the temporary landing marker 14 based on the flight history from the takeoff port 18 or the ID marker 10 of ID5, and store the calculated position.
[0068] The control device 3 determines whether or not an abnormality has occurred in the flying object 2 (step S11). Here, an abnormality refers to, for example, a case where the voltage V of the battery 30 is abnormally low, or a case where the attitude of the flying object 2 is unstable due to an abnormality in the motor 32 or the like. The control device 3 also determines that an abnormality has occurred in the flying object 2 if the remaining battery power is insufficient for the inter-marker distance. The control device 3 may determine whether or not the remaining battery power is insufficient for the inter-marker distance by acquiring the voltage V (remaining battery power) and comparing the amount of power consumed to move the inter-marker distance with the remaining battery power. If no abnormality has occurred in the flying object (NO in step S11), the control device 3 proceeds to step S12.
[0069] Steps S12 and S13 are processes executed by the control device 3 when a return marker 16 is placed on the flight path. The control device 3 judges whether or not the return marker 16 has been read (step S12). When the control device 3 has read the return marker 16 (step S12: YES), the control device 3 returns along the flight path that was passed (step S13).
[0070] In this embodiment, the control device 3 reads the number 998 from the AR marker displayed on the return marker 16. As shown in Fig. 12, the acquired flight plan records information indicating that the flight will return in the order of the read ID marker 10 in the movement information field where 998 is recorded as identification information. When the control device 3 reads the return marker 16, it acquires the movement information in the field where 998 is recorded as the identification information of the flight plan, calculates backward from the information of the read ID marker 10, and returns the aircraft 2 to the takeoff port 18.
[0071] For example, as shown in FIG. 14, when the return marker 16 is placed next to IDn, the control device 3 calculates backwards the movement information of the ID markers 10 read from IDn to ID1, and calculates the movement direction, movement distance, distance to the structure X, altitude, etc., for returning the aircraft 2. For example, when the aircraft 2 has traced ID5, ID7, and IDn, the control device 3 calculates movement information such as the movement distance, movement direction, distance to the structure X, altitude, etc. from the return marker 16 to the ID marker 10 of IDn, and moves the aircraft 2. Similarly, when moving from ID7 to the ID marker 10 of ID5, the control device 3 calculates the movement information and moves the aircraft 2. In addition, the control device 3 may calculate movement information for returning to the takeoff port 18 based on the flight history from the takeoff port 18 or each ID marker 10, and move the aircraft 2.
[0072] When the control device 3 reads the last ID marker 10, it returns the aircraft 2 to the takeoff port 18. More specifically, the identification information in the flight plan corresponding to the identification information displayed on the last ID marker 10 of the flight path records movement information for the aircraft 2 to return to the takeoff port 18. For example, if ID7 is the last ID marker 10, the movement information of 7 recorded as the identification information of the flight plan records movement information for the aircraft 2 to return to the takeoff port 18. The movement information is, for example, a movement direction, a movement distance, a distance from the structure X, an altitude, etc., for returning the aircraft 2 along the ID marker 10 that it has followed. In addition, similar to the return marker 16, the control device 3 may calculate movement information for returning to the takeoff port 18 based on the flight history from the takeoff port 18 or each ID marker 10, and move the aircraft 2.
[0073] Next, the control device 3 determines whether the aircraft 2 has landed at the takeoff port 18 (step S14). If the aircraft 2 has landed at the takeoff port 18 (step S14 YES), the control device 3 determines that the aircraft 2 has flown normally along its flight path, and transmits the captured images or videos to the server 6 or the user terminal 4 via the relay device 8. After transmitting the images or videos, the control device 3 ends the processing. Once the images or videos are acquired by the server 6 or the user terminal 4, the user can view the images or videos.
[0074] The control device 3 may determine whether the aircraft has landed at the takeoff port 18 on the condition that the altitude becomes zero after reading the ID marker 10 of ID1. Also, the control device 3 may determine that the aircraft has landed at the takeoff port 18 on the condition that the initial marker 12 is read again.
[0075] If the voltage V is equal to or lower than the first predetermined voltage V1 (step S4: YES), the control device 3 does not permit the aircraft 2 to take off (S16). If the control device 3 determines that an abnormality has occurred in the aircraft 2 (step S11: YES), the control device 3 proceeds to processing subroutine A. Similarly, if the read identification information does not match the identification information in the flight plan (step S7: NO), the control device 3 proceeds to processing subroutine A.
[0076] If the control device 3 determines that the temporary landing marker 14 has not been read (step S9 NO), the process proceeds to before step S11. If the control device 3 determines that the return marker 16 has not been read (step S12 NO), the process proceeds to before step S14. If the control device 3 determines that the aircraft has not landed (step S14 NO), the process proceeds to before step S6, and the control device 3 continues to read the identification information of each marker while continuing to move.
[0077] Next, the subroutine A will be described with reference to FIG.
[0078] When the control device 3 determines that an abnormality has occurred in the flying object 2 (step S7: YES, step S11: YES), it acquires the voltage V and determines whether the voltage V is equal to or lower than the second predetermined voltage V2 (step S21). In this embodiment, the landing command voltage Vr is recorded in the flight plan. Therefore, the control device 3 acquires the landing command voltage Vr from the flight plan and determines the landing command voltage Vr as the second predetermined voltage V2. When the voltage V is greater than the second predetermined voltage V2 (step S21: NO), the control device 3 determines whether an emergency landing is required (step S22). Here, the determination of whether an emergency landing is required may be made based on whether a situation such as damage to the airframe of the flying object 2 or a malfunction of the motor 32 has occurred in the flying object 2. When the control device 3 determines that an emergency landing is not required (step S22: NO), it moves the flying object 2 to the takeoff port 18. At this time, the control device 3 may move the flying object 2 by the shortest distance to the takeoff port 18 based on the flight history. After moving the aircraft 2 toward the takeoff port 18, the control device 3 proceeds to step S24.
[0079] The control device 3 determines whether the aircraft 2 has landed at the takeoff port 18, the normal landing port 20, or the temporary landing port 22 (step S24). Landing may be determined by whether the altitude has reached zero. If the aircraft 2 has landed (step S24: YES), the control device 3 transmits the details of the abnormality to the server 6 or the user terminal 4 via the relay device 8, and ends the process.
[0080] If the voltage V is equal to or lower than the second predetermined voltage V2 (YES in step S21), the control device 3 advances the process to step S26. Similarly, if the control device 3 determines that an emergency landing is required (YES in step S22), the control device 3 advances the process to step S26. If the control device 3 determines that the aircraft has not landed (NO in step S24), the control device 3 returns the process to the beginning of subroutine A (before step S21) and repeats the process of subroutine A.
[0081] In step S26, the control device 3 determines whether or not the position of the temporary landing port 22 has been stored. If the position of the temporary landing port 22 has been stored (step S26: YES), the control device 3 selects the closest landing port from among the takeoff port 18, the normal landing port 20, and the temporary landing port 22 (step S27). After selecting the landing port, the control device 3 moves the aircraft 2 to the selected landing port (step S28). After moving the aircraft 2, the control device 3 advances the process to before step S24.
[0082] If the control device 3 does not store the position of the temporary landing port 22 (NO in step S26), it selects the closest landing port from among the takeoff port 18 and the permanent landing port 20 (step S29). After selecting a landing port, the control device 3 advances the process to step S28. Note that the flight plan records the presence or absence of a permanent landing port 20 in association with the identification information. Therefore, the control device 3 can record the position of the permanent landing port by reading each ID marker 10 and comparing it with the flight plan.
[0083] In such a control system 1 for an aircraft 2, as shown in Fig. 1, the control device 3 of the aircraft 2 reads the information displayed on the initial marker 12 via the camera 24 and obtains a flight plan. If the remaining battery power of the aircraft 2 is sufficient, the aircraft 2 takes off toward ID1. If the flight plan is recorded with a flight route in the order of ID1, ID2, ID4, ID5, and ID7, the control device 3 identifies the flight route while reading the ID markers 10 in the order of ID1, ID2, ID4, ID5, and ID7 according to the flight plan, and the aircraft 2 moves based on the identified flight route.
[0084] On the other hand, if the user wishes to change the flight path of the aircraft 2, the user operates the user terminal 4 to change the flight plan, for example, in the order of ID1, ID3, ID4, ID6, and ID8, and stores it in the server 6. The user changes the initial marker 12 so that the flight plan created by the control device 3 can be acquired. In this way, if multiple ID markers 10, for example, ID1 to ID8, are attached to the structure X, the user can change the flight path of the aircraft 2 simply by creating a flight plan using the user terminal 4 and changing the initial marker 12. In other words, the user does not need to change the ID markers 10 on the flight path.
[0085] Furthermore, the flight plan records operation information other than the movement of the aircraft 2, such as the operation of the exposure device 26, distance measurement, and rotation of the aircraft 2, in association with the identification information. This allows the aircraft 2 to perform various operations by displaying only the identification information on the ID marker 10. As a result, it is not necessary to display a lot of information on the ID marker 10. When there is a lot of information to be displayed on the marker, the camera 24 (actually, the imaging element included in the camera 24) of the aircraft 2 may not be able to recognize the information displayed on the marker (hereinafter, referred to as "unrecognizable" in the specification). When there is a lot of information to be displayed on the marker, the camera 24 may erroneously determine the information displayed on the marker (hereinafter, referred to as "erroneous determination" in the specification). However, when the ID marker 10 displays less information, it is possible to prevent such recognition errors as the inability to recognize or erroneous determination by the camera 24. As a result, the ID marker 10 that displays less information in this way can prevent a malfunction in which the control device 3 cannot read the information displayed on the marker due to the inability of the camera 24 to recognize, and a malfunction in which the control device 3 erroneously reads the information displayed on the marker due to an erroneous determination.
[0086] Furthermore, at construction sites and the like, there are grounds on which the aircraft 2 cannot land. Even in such cases, as shown in Fig. 13, by attaching a temporary landing marker 14 to a location where the aircraft 2 can land, the aircraft 2 can be prevented from landing in a location unexpected by the user even if an abnormality occurs in the aircraft 2, and the aircraft 2 can be landed in a safe location.
[0087] Furthermore, for example, at a construction site, a user may place materials on the flight path planned by the flight plan. Even in such a case, the user can safely return the aircraft 2 to the takeoff port 18 by attaching a return marker 16 as shown in Fig. 14. This can prevent the aircraft 2 from colliding with materials on the flight path.
[0088] As described above, the present disclosure provides an aircraft control system 1 that can change the flight path without changing the ID marker 10 on the flight path, and an ID marker 10, an initial marker 12, a temporary landing marker 14, and a return marker 16 as markers for controlling the aircraft.
[0089] Although the embodiment of the present disclosure has been described above, the present disclosure is not limited to the above embodiment, and various modifications are possible without departing from the gist of the invention. In particular, the multiple modifications described in this specification can be arbitrarily combined as necessary. [Explanation of symbols]
[0090] 1: Control system 2: Flying object 3: Control device 4: User terminal 6: Server 8: Relay device 10: ID marker (example of the first marker) 12: Initial marker (an example of a second marker) 14: Temporary landing marker (an example of a third marker) 16: Return marker (an example of a fourth marker) 18: Takeoff port (an example of the first port) 20: Permanent landing port (an example of a second port) 22: Temporary landing port (an example of a third port) 24: Camera 26: Exposure equipment 28: Laser device 30:Battery 32: Motor 34: Flight control unit 36: Arithmetic section 38: Storage section 40: Communications Department
Claims
1. A control device for the aircraft; A plurality of first markers each displaying identification information; A second marker that displays information for causing the control device to acquire flight path information including the identification information; Equipped with The control device includes: A process of reading information displayed on the second marker and acquiring the flight path information; A process of reading the identification information displayed on the first marker, comparing the read identification information with the identification information included in the flight path information, and identifying the flight path of the aircraft; A process of moving the aircraft based on the identified flight path; Execute Aircraft control system.
2. The control device includes: If the read identification information matches the identification information included in the flight path information, a process is executed to move the aircraft toward the next first marker. The control system for an air vehicle according to claim 1 .
3. A server for storing the flight path information, The second marker indicates a storage location of the flight path information, The control device executes a process of reading the second marker and a process of accessing a storage location displayed on the second marker to obtain the flight path information.
3. The control system for an aircraft according to claim 1 or 2.
4. The flight route information includes flight distance information which is a flight distance of the entire flight route, The control device executes a process of acquiring a remaining battery charge of the aircraft, and a process of not permitting takeoff of the aircraft when the remaining battery charge is insufficient for the flight distance. The control system for an aircraft according to any one of claims 1 to 3.
5. the flight path information includes marker distance information that is a distance between a plurality of the first markers, The control device executes a process of acquiring a remaining battery level, and a process of landing the aircraft when the remaining battery level is insufficient for the marker distance. The control system for an aircraft according to any one of claims 1 to 4.
6. The flight route information includes: Movement information regarding the movement of the aircraft; Operation information regarding operations other than the movement of the flying object; Including, 6. A control system for an aircraft according to claim 1.
7. Further, a third marker is provided to indicate a position where the aircraft can land if an abnormality occurs in the aircraft. The control system for an aircraft according to any one of claims 1 to 6.
8. a first port from which the aircraft takes off; At least one second port on which the air vehicle can land at any time; a third port corresponding to the third marker; Further equipped with When an abnormality occurs in the aircraft, the control device executes a process of selecting a port that is closest to the aircraft from among the first port, the second port, and the third port, and a process of landing the aircraft on the selected port. The control system for an aircraft according to claim 7.
9. Further comprising a fourth marker that displays information for returning to the flight path flown by the flying object; The control system for an aircraft according to any one of claims 1 to 8.
10. It is placed at the start of the flight path of the aircraft, Information for causing a control device of the aircraft to acquire flight path information of the aircraft; and At least one of text information and an image related to the flight route information is displayed. Marker for controlling aircraft.
11. An aircraft control marker that is arranged downstream on the flight path of the aircraft from the aircraft control marker described in claim 10, Identification information included in the flight path information of the aircraft; At least one of text information and an image related to the identification information is displayed. Marker for controlling aircraft.
12. An aircraft control marker that is arranged downstream on the flight path of the aircraft from the aircraft control marker described in claim 10, A position where the aircraft can land when an abnormality occurs in the aircraft; and At least one of text information and an image regarding the abnormality of the flying object is displayed. Marker for controlling aircraft.
13. An aircraft control marker that is arranged downstream on the flight path of the aircraft from the aircraft control marker described in claim 10, Information for returning the flight path flown by the aircraft; and At least one of text information and an image related to the information is displayed. Marker for controlling aircraft.
Citation Information
Patent Citations
Flying body and flying body system
JP2014031118A
RFID reading device
JP2020102163A
Flight management system
WO2018155700A1
Control system for flight vehicle, and control device and marking for same
WO2018163699A1
