Aircraft
The aircraft and monitoring device employ multiple communication units with a control unit to manage data transmission and display, addressing communication redundancy issues, ensuring continuous data transmission and monitoring.
Patent Information
- Application Number
- JP2024512783
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-03-31
- Filing Date
- 2023-03-30
- Publication Date
- 2024-11-06
- Estimated Expiration
- 2043-03-30
AI Technical Summary
Existing technologies do not adequately address communication redundancy between a multicopter and a monitoring device installed on the ground, particularly when using satellite communication lines.
The aircraft and monitoring device utilize multiple communication units, including a first and second wireless communication unit, with a control unit to manage data transmission and a display unit to display received data, ensuring communication redundancy through different wireless methods.
This setup enables reliable communication between the aircraft and monitoring device using at least two communication methods, ensuring continuous data transmission and monitoring even in case of failures in one communication channel.
Smart Images

Figure 0007578350000001 
Figure 0007578350000002 
Figure 0007578350000003
Abstract
Description
[Technical field]
[0001] The technology of this disclosure relates to aircraft. [Background technology]
[0002] Japanese Patent No. 6785019 discloses that at least a part of the communication path between the moving body and the control device is made redundant by using a satellite communication line and other communication lines. Specifically, the communication path between the multicopter and the control device is made redundant by using multiple communication methods in combination. In addition, the means for connecting to the multicopter is made switchable between the satellite communication line and other communication lines, thereby making the communication path with the multicopter redundant. Summary of the Invention [Problem to be solved by the invention]
[0003] However, the above technology does not take into consideration the case where a multicopter is monitored by a monitoring device installed on the ground.
[0004] The technique disclosed herein aims to provide an aircraft and a monitoring device that are capable of communicating between the aircraft and the monitoring device using at least two communication methods. [Means for solving the problem]
[0005] In order to achieve the above-mentioned object, an aircraft of a first aspect of the technology disclosed herein comprises a first communication unit that performs a first wireless communication, a second communication unit that performs a second wireless communication different from the first wireless communication, and a control unit that controls the first communication unit and the second communication unit so that data is transmitted to a monitoring device.
[0006] The monitoring device of the second embodiment comprises a display unit, a first wireless communication unit and a second wireless communication unit which respectively communicate with the first communication unit and the second communication unit of the aircraft of the first embodiment and the first wireless communication unit and the second wireless communication unit, and a control unit which controls the display unit so that data received by the first wireless communication unit and the wireless communication unit is displayed.
[0007] The aircraft of the third aspect includes a plurality of communication units each performing different wireless communication, and a control unit that controls the plurality of communication units so that data is transmitted to a monitoring device.
[0008] The monitoring device of the fourth aspect comprises a display unit, a plurality of wireless communication units each of which performs different wireless communication with the aircraft of the third aspect, and a control unit which controls the display unit so that data received by the wireless communication units is displayed. Effect of the Invention
[0009] The first and second aspects of the technology disclosed herein are capable of communicating between an aircraft and a monitoring device using at least two communication methods. The third and fourth aspects of the technology disclosed herein enable communication between the aircraft and the monitoring device using a plurality of communication methods. [Brief description of the drawings]
[0010] [Figure 1] A block diagram of a system including a drone 10A, monitoring devices 50S, 50G, a cloud server 200, and a live streaming server of the first embodiment. [Diagram 2] A functional block diagram of CPU14 of FC12 of drone 10A. [Diagram 3] 13 is a flowchart of a communication program 40P executed by the CPU 14 of the FC 12. [Figure 4] This is a timing chart of data transmission between the first modem 35A of the first communication control device 36 of the drone 10A and the second modem 35B of the second communication control device 38 of the drone 10A. [Diagram 5] This figure shows how data from a first modem 35A is stored in a first data memory area 68M1 provided in a memory area 68M of a memory device 68S of a monitoring device 50S, and shows how data from a second modem 35B is stored in a second data memory area 68M2. [Figure 6] FIG. 13 is a functional block diagram of a CPU 52S of a monitoring device 50S according to a first modified example of the first embodiment. [Figure 7] 13 is a flowchart of a data storage program of a monitoring device 50S in a first modified example of the first embodiment. [Figure 8] This figure shows how data from the first modem 35A is stored in the first data memory area 68M1 of the memory device 68S of the monitoring device 50S in the first modified example of the first embodiment, and shows how data from the second modem 35B is stored in the second data memory area 68M2. [Figure 9] 13 is a flowchart of a communication program executed by the CPU 14 of the FC 12 of the drone 10A of the second modified example of the first embodiment. [Figure 10] 13 is a timing chart of data transmission from a first modem 35A and a second modem 35B in the second modified example of the first embodiment. [Figure 11] 13 is a flowchart of a communication program executed by the CPU 14 of the FC 12 of the drone 10A in the third modified example of the first embodiment. [Figure 12] 13 is a flowchart of a data storage program of a monitoring device 50S in a third modified example of the first embodiment. [Figure 13A] 13 is a timing chart of data transmission between the first modem 35A and the second modem 35B in the third modified example of the first embodiment. [Figure 13B] 13 is a flowchart of a control data transmission program executed by a CPU 52S of a monitoring device 50S in a fourth modified example of the first embodiment. [Figure 13C]13 is a flowchart of a communication program executed by the CPU 14 of the FC 12 of the drone 10A in the fifth modified example of the first embodiment. [Figure 13D] 13 is a flowchart of a communication program executed by the CPU 14 of the FC 12 of the drone 10A in the sixth modified example of the first embodiment. [Figure 14] FIG. 13 is a functional block diagram of a CPU 14B of a second communication control unit 38 of a seventh modified example of the first embodiment. [Figure 15] 13 is a flowchart of a failure occurrence determination program executed by the second communication control device 38 in the seventh modified example of the first embodiment to determine whether a failure has occurred in communication by the first modem 35A of the first communication control device 36. [Figure 16] This is a flowchart of a program executed by the CPU 14 of the FC 12 when it is notified by the second communication control device 38 of the seventh modified example of the first embodiment that a failure has occurred in communication via the first modem 35A of the first communication control device 36. [Figure 17] 13 is a timing chart of data transmission from the first modem 35A and the second modem 35B in the eighth modified example of the first embodiment. [Figure 18] 13 is a timing chart of data transmission from the first modem 35A and the second modem 35B in the ninth modified example of the first embodiment. [Figure 19] A block diagram of a system including a drone 10B, monitoring devices 50S, 50G, a cloud server 200, and a live streaming server of the second embodiment. [Figure 20] A block diagram of a system including a drone 10C, monitoring devices 50S, 50G, a cloud server 200, and a live streaming server of the third embodiment. [Figure 21] A block diagram of a system including a drone 10D, monitoring devices 50S, 50G, a cloud server 200, and a live streaming server of the fourth embodiment. [Figure 22]A block diagram of a system including a drone 10E, monitoring devices 50S, 50G, a cloud server 200, and a live streaming server of the fifth embodiment. [Figure 23] A block diagram of a system including a drone 10F, monitoring devices 50S, 50G, a cloud server 200, and a live streaming server of the sixth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, embodiments of the technology of the present disclosure will be described with reference to the drawings. [First embodiment] 1 shows a block diagram of a system including a drone 10A according to a first embodiment, monitoring devices 50S and 50G, a cloud server device (hereinafter referred to as a "cloud server") 200, and a live distribution server device (hereinafter referred to as a "live distribution server") 300. As shown in FIG. 1, in the system according to this embodiment, the drone 10A, the monitoring devices 50S and 50G, the cloud server 200, and the live distribution server 300 are mutually connected via the Internet 100.
[0012] The drone 10A includes a flight controller (FC) 12, a first communication control device 36, and a second communication control device 38. The drone 10A includes a sensor 42, a first camera 32, and a second camera 34. The drone 10A includes a battery 25, and four power supply modules (denoted as "power supplies M" in FIG. 1) 12M1, 12M2, 36M, and 38M.
[0013] The FC 12 includes a computer and a secondary storage device 40 connected to the computer. The computer includes a central processing unit (CPU) 14, a read only memory (ROM) 16, a random access memory (RAM) 18, and an input / output (I / O) port 218. The CPU 14, the ROM 16, the RAM 18, and the I / O port 20 are connected to each other via a bus 22.
[0014] The I / O port 20 is connected to a sensor 42, a secondary storage device 40, a first communication control device 36, and a second communication control device 38.
[0015] The secondary storage device 40 stores a communication program 40P (see FIG. 3), which will be described later. The communication program 40P is read from the secondary storage device 40 to the RAM 18 and executed by the CPU 14, thereby executing a communication process, which will be described later. The communication program 40P may be stored in the ROM 16. The secondary storage device 40 is a non-transitory tangible computer readable medium, such as a non-volatile storage device, such as a hard disk drive (HDD) or a solid state drive (SSD).
[0016] The secondary storage device 40 is an example of the "storage unit" and the "recording medium" of the technology of the present disclosure.
[0017] The first communication control device 36 includes a computer and a first modem 35A connected to the computer. The computer of the first communication control device 36 includes a CPU 14A, a ROM 16A, a RAM 18A, and an I / O port 20A, which are connected to each other via a bus 22A. The I / O port 20 of the FC 12, the first camera 32, and the second camera 34 are connected to the I / O port 20A of the first communication control device 36.
[0018] The second communication control device 38 includes a computer and a second modem 35B connected to the computer. The computer of the second communication control device 38 includes a CPU 14B, a ROM 16B, a RAM 18B, and an I / O port 20B, which are connected to each other via a bus 22B. The I / O port 20 of the FC 12, the first camera 32, and the second camera 34 are connected to the I / O port 20B of the second communication control device 38.
[0019] The sensor 42 is a GPS (Global Positioning System) sensor, a gyro sensor, an altitude sensor, an acceleration sensor, an air pressure sensor, etc. In addition, these are shown as the sensor 42 in FIG.
[0020] The first camera 32 is installed at the tip and captures the area in the direction in which the drone is traveling. The second camera 34 is mounted on the top of the rear end of the drone and captures the entire drone. The power supply modules 12M1, 12M2, 36M, and 38M are transformers. The power supply modules 12M1 and 12M2 convert the voltage from the battery 25 into a voltage required by the FC 12. The power supply module 36M converts the voltage from the battery 25 into a voltage required by the first communication control device 36. The power supply module 38M converts the voltage from the battery 25 into a voltage required by the second communication control device 38. Although not shown, the voltage from the battery is also supplied to the first camera 32 and the second camera 34 via the power supply modules.
[0021] The first monitoring device 50S is located in a first area including a first location where the drone 10A is scheduled to take off, and the second monitoring device 50G is located in a second area including a second location where the drone 10A is scheduled to land.
[0022] The first monitoring device 50S includes a computer 50CS, an input device 62S, a first communication device 64S1, a second communication device 64S2, a display 66S, and a storage device 68S. The computer 50CS includes a CPU 52S, a ROM 54S, a RAM 56S, and an I / O port 58S, which are connected to each other via a bus 60S. The input device 62S, the first communication device 64S1, the second communication device 64S2, the display 66S, and the storage device 68S are connected to the I / O port 58S.
[0023] The second monitoring device 50G includes a computer 50CG, an input device 62G, a first communication device 64G1, a second communication device 64G2, a display 66G, and a storage device 68G. The computer 50CG includes a CPU 52G, a ROM 54G, a RAM 56G, and an I / O port 58G, which are connected to each other via a bus 60G. The input device 62G, the first communication device 64G1, the second communication device 64G2, the display 66G, and the storage device 68G are connected to the I / O port 58G.
[0024] The first modem 35A of the first communication control device 36 communicates with each of the first communication device 64S1 of the first monitoring device 50S and the first communication device 64G1 of the second monitoring device 50G via the Internet 100. The first modem 35A performs first wireless communication with each of the first communication device 64S1 of the first monitoring device 50S and the first communication device 64G1 of the second monitoring device 50G by a first indirect wireless communication method.
[0025] The second modem 35B of the second communication control device 38 communicates with each of the second communication device 64S2 of the first monitoring device 50S and the second communication device 64G2 of the second monitoring device 50G via the Internet 100. The second modem 35B performs second wireless communication with each of the second communication device 64S2 of the first monitoring device 50S and the second communication device 64G2 of the second monitoring device 50G by a second wireless communication different from the first wireless communication, i.e., a second indirect wireless communication method different from the first indirect wireless communication method.
[0026] The first indirect wireless communication system between the first modem 35A and each of the first communication device 64S1 and the first communication device 64G1 and the second indirect wireless communication system between the second modem 35B and each of the second communication device 64S2 and the second communication device 64G2 have different communication protocols. Specifically, one of the first indirect wireless communication system and the second indirect wireless communication system is CDMA (Code Division Multiple Access), and the other is W-CDMA (Wideband Code Division Multiple Access). The first indirect wireless communication method and the second indirect wireless communication method may be communication methods such as 4G (4th Generation), 5G (5th Generation), or LTE (Long Term Evolution), and since one method is different from the other method, for example, one method may be a 4G communication method and the other method may be an LET communication method. Also, one method may be a 5G communication method and the other method may be an LET communication method.
[0027] The drone 10A is an example of an "aircraft" of the technology disclosed herein. The first modem 35A and the second modem 35B are an example of a "first communication unit" and a "second communication unit" of the technology disclosed herein. The first communication device 64S1 and the first communication device 64G1 are an example of a "first wireless communication unit" of the technology disclosed herein. The second communication device 64S2 and the second communication device 64G2 are an example of a "second wireless communication unit" of the technology disclosed herein. The CPU 14 is an example of a "control unit" of the technology disclosed herein. The CPUs 52S and 52G are an example of a "display control unit" of the technology disclosed herein.
[0028] Fig. 2 shows a functional block diagram of the CPU 14 of the FC 12 of the drone 10A. The functions of the CPU 14 include an import function, a creation function, a transmission processing function, a judgment function, and a processing function. As shown in Fig. 2, when the CPU 14 executes the communication program 40P, it functions as the import unit 11, the creation unit 13, the transmission processing unit 15, the judgment unit 17, and the processing unit 19.
[0029] Next, the operation of this embodiment will be described.
[0030] 3 shows a flowchart of the communication program 40P executed by the CPU 14 of the FC 12. The communication process and the communication method are performed by the CPU 14 executing the communication program 40P. The communication program 40P starts when a start button (not shown) is turned on.
[0031] In step 102, the capture unit 11 controls the first communication control device 36 and the second communication control device 38 to capture an image from the first camera 32. In step 104, the capture unit 11 controls the first communication control device 36 and the second communication control device 38 to capture an image from the second camera 34.
[0032] In step 106, the acquisition unit 11 acquires data from the sensor.
[0033] In step 108, the creation unit 13 controls the first communication control device 36 and the second communication control device 38 to create transmission data. The transmission data includes image data of an image of the area in the direction of travel of the drone captured by the first camera 32 and an image of the overall appearance of the drone captured by the second camera 34, and sensor data of the state of the drone detected by the sensor.
[0034] In step 110, the transmission processing unit 15 controls the first communication control unit 36 and the second communication control unit 38 so that the first modem 35A and the second modem 35B transmit transmission data to each of the monitoring devices 50S, 50G.
[0035] In step 112, the determination unit 17 determines whether the flight has ended by determining whether a flight end instruction button (not shown) has been turned on. The determination unit 17 may also determine whether the flight has ended by determining whether a flight stop instruction signal has been received from the first communication device 64G1 or the second communication device 64G2 of the monitoring device 50G. If the flight has not been determined to have ended, in step 114, the determination unit 17 determines whether a predetermined time has elapsed since the transmission data was transmitted in step 110. If it has not been determined that the predetermined time has elapsed since the transmission data was transmitted, the communication process returns to step 112. If it has been determined that the predetermined time has elapsed since the transmission data was transmitted, the communication process returns to step 102.
[0036] If it is determined in step 112 that the flight has ended, the processing unit 19 executes flight end processing in step 116, and the communication processing ends. The flight end processing includes, for example, stopping the power supply to the motors for rotating the propellers.
[0037] 4 shows a timing chart (upper side) of the transmission of the first modem 35A of the first communication control device 36 of the drone 10A and a timing chart (lower side) of the transmission of the transmission data of the second modem 35B of the second communication control device 38 of the drone 10A. As shown in FIG. 4, the timing of the transmission of the first modem 35A of the first communication control device 36 and the timing of the transmission of the transmission data of the second modem 35B of the second communication control device 38 of the drone 10A are the same, and the contents of the transmission data D1 and D2 transmitted by each are also the same.
[0038] The transmission data D1 is the data transmitted first from the first modem 35A and the second modem 35B, and the transmission data D2 is the data transmitted second from the first modem 35A and the second modem 35B.
[0039] 5 shows a diagram illustrating a state where data from the first modem 35A is stored in the first data storage area 68M1 provided in the storage area 68M of the storage device 68S of the monitoring device 50S, and a state where data from the second modem 35B is stored in the second data storage area 68M2. As shown in FIG. 5, the transmission data D1 transmitted first from the first modem 35A is stored in the first storage section 68M11 of the first data storage area 68M1, and the transmission data D1 transmitted first from the second modem 35B is stored in the first storage section 68M21 of the second data storage area 68M2. The transmission data D2 transmitted second from the first modem 35A is stored in the second storage section 68M12 of the first data storage area 68M1, and the transmission data D2 transmitted second from the second modem 35B is stored in the second storage section 68M22 of the second data storage area 68M2.
[0040] Incidentally, for example, as shown in Fig. 4, if a failure occurs in data transmission in the first modem 35A at the timing when the third transmission data D3 is transmitted, the third transmission data D3 is transmitted from the second modem 35B, but the third transmission data D3 is not transmitted from the first modem 35A. Furthermore, if a failure continues to occur in data transmission in the first modem 35A, the transmission data D4, ... is transmitted only from the second modem 35B, but the transmission data D4, ... is not transmitted from the first modem 35A. In this case, as shown in Fig. 5, the transmission data D3, D4, ... is not stored in the first data storage area 68M1, but the transmission data D3 is stored in the third storage section 68M23 of the second data storage area 68M2, and the transmission data D4 is stored in the fourth storage section 68M24 of the second data storage area 68M2, and thereafter, data is similarly stored in each storage section of the second data storage area 68M2.
[0041] Meanwhile, when the monitoring devices 50S, 50G receive transmission data from the first modem 35A and the second modem 35B, they immediately display each data in real time in the display areas of the displays 66S, 66G corresponding to each of the first modem 35A and the second modem 35B.
[0042] Therefore, the transmission data D1 and the transmission data D2 are displayed in real time in the display areas of the displays 66S, 66G corresponding to the first modem 35A and the second modem 35B, respectively. However, since the transmission data D3, D4, ... are not received from the first modem 35A, the data is no longer displayed in the display area corresponding to the first modem 35A. However, since the transmission data D3, D4, ... continue to be received from the second modem 35B, the data continues to be displayed in the display area corresponding to the second modem 35B.
[0043] Therefore, the person monitoring the monitoring devices 50S and 50G can recognize in real time that a failure has occurred in data transmission in the first modem 35A.
[0044] Furthermore, since the data transmitted from the second modem 35B continues to be displayed, the monitor at the monitoring device 50S, 50G can continue monitoring the drone 10A.
[0045] As described above, in the first embodiment, the communication paths between the drone 10A and each of the monitoring devices 50S, 50G can be made redundant.
[0046] In step 110 of FIG. 3, the transmission processing unit 15, together with each monitoring device 50S, 50G, may control the first communication control device 36 and the second communication control device 38 so that the first modem 35A and the second modem 35B transmit transmission data to the cloud server 200 and the live streaming server 300.
[0047] As a result, the transmission data is stored in the cloud server 200. In addition, the live distribution server 300 live distributes the transmission data. Therefore, even if a monitor is not near the installation location of the monitoring devices 50S, 50G and cannot directly check the displays 66S, 66G, he or she can monitor the drone 10A in real time on his or her own terminal by accessing the live distribution server 300 from his or her own terminal. [Variations] Next, a modified example of the first embodiment will be described. The configuration of the modified example of the first embodiment described below is the same as that of the first embodiment, so the description will be omitted. The action of the modified example of the first embodiment is also the same as that of the first embodiment, so the different parts will be described. (First Modification of the First Embodiment) The first modification of the first embodiment is applied to monitoring device 50S and monitoring device 50G, but since the operation of both is the same, the following description will be given taking monitoring device 50S as an example.
[0048] Fig. 6 shows a functional block diagram of a CPU 52S of a monitoring device 50S according to a first modified example of the first embodiment. The functions of the CPU 52S of the monitoring device 50S include a set function, a judgment function, a storage processing function, and a processing function. As shown in Fig. 6, when the CPU 52S executes a data storage program (see Fig. 7), it functions as a set unit 121, a judgment unit 123, a storage processing unit 125, and a processing unit 127.
[0049] 7 shows a flowchart of a data storage program of a monitoring device 50S according to a first modified example of the first embodiment. The data storage program starts when a start button (not shown) is turned on. When the data storage program is executed, a data storage process and a data storage method are executed.
[0050] In step 101, the setting unit 121 sets the variable M to 1. The variable M is a variable that distinguishes between the first modem 35A and the second modem 35B, and thus distinguishes between the first data storage area 68M1 and the second data storage area 68M2 shown in Fig. 5. For example, M = 1 identifies the first modem 35A, and thus the first data storage area 68M1, and M = 2 identifies the second modem 35B, and thus the second data storage area 68M2.
[0051] In step 103, the determination unit 123 determines whether or not a predetermined time has passed since the previous data reception from the first modem 35A. If it is determined that the predetermined time has not passed since the previous data reception from the first modem 35A, the data storage process proceeds to step 105, and if it is determined that the predetermined time has passed since the previous data reception, the data storage process proceeds to step 107.
[0052] As shown in Figures 3 and 4, the drone 10A transmits the above transmission data from each of the first modem 35A and the second modem 35B.
[0053] In step 105, if the transmission data has been transmitted from each of the first modem 35A and the second modem 35B before the determination in step 103 becomes positive, the storage processing unit 125 stores the transmission data in the storage device 68S, in which case the data is stored in the storage device 68S. The data storage process returns to step 103.
[0054] In step 107, the determination unit 123 determines whether or not data has been received. If it is determined that data has not been received, the data storage process proceeds to step 111, and if it is determined that data has been received, the data storage process proceeds to step 109.
[0055] If it is not determined in step 107 that data has been received, this is the case when no data has been received within a predetermined time period since the previous data was received from first modem 35A. If it is determined in step 107 that data has been received, this is the case when data has been received within a predetermined time period since the previous data was received from first modem 35A.
[0056] Incidentally, since data is transmitted from the first modem 35A at predetermined time intervals, if there is no problem in data transmission in the first modem 35A, transmission data will be received within the predetermined time since the last time transmission data was received from the first modem 35A. However, if there is a problem in data transmission in the first modem 35A, data will not be received within the predetermined time since the last time transmission data was received from the first modem 35A.
[0057] Therefore, if it is determined that transmission data has been received within the predetermined time since the previous reception of transmission data from the first modem 35A (i.e., if step 107 is judged to be positive), it can be determined that no problem has occurred in data transmission in the first modem 35A. On the other hand, if it is not determined that data has been received within the predetermined time since the previous reception of data from the first modem 35A (i.e., if step 107 is judged to be negative), it can be determined that a problem has occurred in data transmission in the first modem 35A.
[0058] If step 107 is judged to be positive, it can be determined that no problem occurs in data transmission in the first modem 35A, and therefore in step 109, the storage processing unit 125 stores the data in a storage area determined by M. Specifically, when the variable M=1, the first modem 35A is identified by M, the first data storage area 68M1 (see also FIG. 5) is identified, and the data held in step 105 is stored in the first data storage area 68M1.
[0059] In step 117, the determination unit 123 determines whether the data storage process is completed by determining whether an end button (not shown) is turned on. If the data storage process is not completed, the data storage process returns to step 103. If the data storage process is completed, the data storage process is completed.
[0060] If the determination in step 107 is negative, it can be determined that a problem has occurred in data transmission in the first modem 35A, and so in step 111 the determination unit 123 determines whether or not the variable M is 1. If the variable M=1, then in step 113 the set unit 121 sets the variable M to 2. If M=2, the second modem 35B, and therefore the second data storage area 68M2, is identified. After the processing in step 113, the data storage processing proceeds to step 109.
[0061] If the determination in step 111 is negative, a problem is occurring in data transmission not only in the first modem 35A but also in the second modem 35B, so in step 115 the processing unit 127 executes error processing and the data storage processing ends. The error processing is to display a warning on the display 66S that a problem is occurring in data transmission in the first modem 35A and the second modem 35B.
[0062] If the determination in step 111 is positive, then between the time when the determination in step 111 is positive and before step 109, for example, before step 113, the processing unit 127 may display a warning on the display 66S to the effect that a problem is occurring with data transmission in the first modem 35A.
[0063] As mentioned above, the timing of transmission of the transmission data from the first modem 35A of the first communication control device 36 and the timing of transmission of the transmission data from the second modem 35B of the second communication control device 38 of the drone 10A are the same, and the content of the transmission data transmitted by each is also the same.
[0064] Through the above data storage process, initially, the transmission data is stored in the data storage area 68M1 for the first modem 35A, and when the first modem 35A determines that a failure has occurred in data transmission (step 107:N in FIG. 6), the transmission data is stored in the data storage area 68M2 for the second modem 35B.
[0065] FIG. 8 shows how transmission data from the first modem 35A is stored in the first data memory area 68M1 of the memory device 68S of the monitoring device 50S in the first modified example of the first embodiment, and shows how transmission data from the second modem 35B is stored in the second data memory area 68M2.
[0066] As shown in FIG. 4, transmission data D1 and D2 are transmitted from the first modem 35A and the second modem 35B, respectively. However, if a failure occurs in data transmission in the first modem 35A at the timing of transmitting transmission data D3, as shown in FIG. 8, the transmission data D1 and D2 transmitted from the first modem 35A are stored in the first memory unit 68M11 and the second memory unit 68M12 of the first data memory area 68M1, and the transmission data D3 and onwards are stored in the third memory unit 68M23 and onwards of the second data memory area 68M2.
[0067] In this way, since no transmission data is stored in the data memory area 68M2 for the second modem 35B until it is determined that a failure has occurred in data transmission in the first modem 35A, the remaining storage capacity of the storage device 68S can be reduced more slowly than if transmission data were also stored in the data memory area 68M2 for the second modem 35B. (Second Modification of the First Embodiment) FIG. 9 shows a flowchart of a communication program executed by the CPU 14 of the FC 12 of a drone 10A according to a second modified example of the first embodiment.
[0068] In step 122, the processing unit 19 resets and restarts the software timer. In step 124, the judgment unit 17 judges whether or not the first period T1 (see FIG. 10) has elapsed based on the value of the software timer. If it is not judged that the first period T1 has elapsed, the judgment is repeated until it is judged that the first period T1 has elapsed.
[0069] If it is determined that the first period T1 has elapsed, then in step 126, the capture unit 11 captures sensor data from the sensor 42. In step 128, the creation unit 13 creates first transmission data Sd (see FIG. 10) including the sensor data. In step 130, the transmission processing unit 15 controls the first communication control device 36 and the second communication control device 38 so that the first modem 35A and the second modem 35B transmit the first transmission data Sd to each of the monitoring devices 50S, 50G.
[0070] In step 132, the determination unit 17 determines whether or not the second period T2 (see FIG. 10) has elapsed based on the value of the software timer. If it is determined that the second period T2 has not elapsed, the communication process returns to step 124.
[0071] If it is determined that the second period T2 has elapsed, in step 134, the capture unit 11 controls the first communication control device 36 and the second communication control device 38 to capture an image from the first camera 32. In step 136, the capture unit 11 controls the first communication control device 36 and the second communication control device 38 to capture an image from the second camera 34. In step 138, the creation unit 13 creates second transmission data Sg (see FIG. 10) including image data of the image captured from the first camera 32 and the image captured from the second camera 34. In step 140, the transmission processing unit 15 controls the first communication control device 36 and the second communication control device 38 to transmit the second transmission data Sg to each of the monitoring devices 50S, 50G via the first modem 35A and the second modem 35B.
[0072] In step 112, the judgment unit 17 judges whether or not the flight has ended. If it is not judged that the flight has ended, the communication process returns to step 122. If it is judged that the flight has ended, the flight end process of step 116 is executed, and the communication process ends.
[0073] Fig. 10 shows a timing chart of data transmission from the first modem 35A and the second modem 35B in the second modified example of the first embodiment. When the CPU 14 of the FC 12 executes the communication program shown in Fig. 9, the first transmission data Sd including the sensor data and the second transmission data Sg including the image data of each image captured by the first camera 32 and the second camera 34 are separately transmitted to each of the monitoring devices 50S and 50G. Each of the first modem 35A and the second modem 35B transmits the first transmission data Sd at a first time T1 interval and the second transmission data Sg at a second time T2 (>T1) interval.
[0074] 5, the first transmission data Sd and the second transmission data Sg from the first modem 35A and the second modem 35B are stored in the first data storage area 68M1 and the second data storage area 68M2. For example, even if a problem occurs in the transmission in the first modem 35A, the first transmission data Sd and the second transmission data Sg are transmitted from the second modem 35B, so that these data can be stored and displayed on the displays 66S and 66G, and the monitoring of the drone 10A can be continued.
[0075] As shown in FIG. 8, for example, the first transmission data Sd and the second transmission data Sg may be stored only in the first data memory area 68M1 until a transmission interruption occurs in the first modem 35A, and when a transmission interruption occurs in the first modem 35A, the first transmission data Sd and the second transmission data Sg may be stored only in the second data memory area 68M2. (Third Modification of the First Embodiment) Fig. 11 shows a flowchart of a communication program executed by the CPU 14 of the FC 12 of the drone 10A of the third modified example of the first embodiment. Fig. 13A shows a timing chart of data transmission between the first modem 35A and the second modem 35B of the third modified example of the first embodiment.
[0076] In step 150, the processing unit 19 sets a variable F used in this communication program to 0.
[0077] Although the details will be described later, the monitoring devices 50S, 50G judge whether or not a failure has occurred in transmission in the first modem 35A. If the monitoring devices 50S, 50G judge that a failure has occurred in transmission in the first modem 35A, they notify that a failure has occurred in transmission in the first modem 35A.
[0078] When notified by at least one of the monitoring devices 50S, 50G that no failure has occurred in transmission from the first modem 35A, the processing unit 19 of the CPU 14 of the FC 12 sets the variable F to 1. Thus, the variable F=0 indicates that no failure has occurred in transmission from the first modem 35A, and the variable F=1 indicates that a failure has occurred in transmission from the first modem 35A.
[0079] In step 102, the capture unit 11 controls the first communication control device 36 and the second communication control device 38 to capture images from the first camera 32. In step 104, the capture unit 11 controls the first communication control device 36 and the second communication control device 38 to capture images from the second camera 34. In step 106, the capture unit 11 captures sensor data from the sensor 42. In step 108, the creation unit 13 controls the first communication control device 36 and the second communication control device 38 to create transmission data including image data of each image from the first camera 32 and the second camera 34 and the sensor data from the sensor 42.
[0080] In step 152, the judgment unit 17 judges whether F=0, that is, whether a failure has occurred in transmission in the first modem 35A. If it is judged that F=0, in step 154, the transmission processing unit 15 controls the first communication control device 36 so that the first modem 35A transmits transmission data to each of the monitoring devices 50S, 50G.
[0081] In step 112, the determination unit 17 determines whether or not the flight has ended. If it has not been determined that the flight has ended, in step 114, the determination unit 17 determines whether or not a predetermined time has elapsed since it was not determined that the flight had ended. If it has not been determined that the predetermined time has elapsed since it was not determined that the flight had ended, the determination is repeated until it is determined that the predetermined time has elapsed since it was not determined that the flight had ended.
[0082] If it is determined that the predetermined time has elapsed since it was not determined that the flight had ended, the communication process returns to step 102.
[0083] Therefore, when no failure occurs in transmission in the first modem 35A, as shown in FIG. 13A, the first modem 35A transmits transmission data to each of the monitoring devices 50S, 50G at predetermined time intervals.
[0084] If it is not determined in step 152 that F=0, in step 156, the transmission processing unit 15 controls the second communication control device 38 so that the second modem 35B transmits the transmission data to each of the monitoring devices 50S, 50G. After the process of step 158, the present communication process proceeds to step 112.
[0085] Therefore, if a failure occurs in transmission in the first modem 35A but no failure occurs in transmission in the second modem 35B, the second modem 35B transmits transmission data to each monitoring device 50S, 50G at predetermined time intervals, as shown in FIG. 13A.
[0086] If it is determined in step 112 that the flight has ended, then in step 116 the processing unit 19 executes flight end processing.
[0087] 12 shows a flowchart of the data storage program of the monitoring device 50S of the third modified example of the first embodiment. The monitoring device 50G also executes this data storage program, but since the processes are the same, only the data storage program of the monitoring device 50S will be described below. The data storage program starts when a start button (not shown) is turned on.
[0088] In step 170, the setting unit 121 sets the variable F used in this data storage program to 0. Note that the variable F=0 indicates that no failure has occurred in the transmission of the first modem 35A, and the variable F=1 indicates that a failure has occurred in the transmission of the first modem 35A.
[0089] In step 172, the judgment unit 123 judges whether or not a predetermined time has elapsed. If it is not judged that the predetermined time has elapsed, the judgment is repeated until it is judged that the predetermined time has elapsed. If it is judged that the predetermined time has elapsed, in step 174, the judgment unit 123 judges whether or not F=0. If it is judged that F=0, the data storage process proceeds to step 176. If it is not judged that F=0, the data storage process proceeds to step 184.
[0090] In step 176, the determination unit 123 determines whether or not transmission data has been sent from the first modem 35A.
[0091] As described above, since the transmission data is transmitted from the first modem 35A at predetermined time intervals, if no failure occurs in the communication with the first modem 35A, the transmission data is transmitted from the first modem 35A and the judgment in step 176 is affirmative. If it is judged that the transmission data has been transmitted from the first modem 35A, in step 178 the storage processing unit 125 stores the transmission data.
[0092] In step 190, the determination unit 123 determines whether the data storage process is completed by determining whether an end button (not shown) is turned on. If it is determined that the data storage process is completed, the data storage process ends. If it is not determined that the data storage process is completed, the data storage process returns to step 172.
[0093] However, if a failure occurs in the communication with the first modem 35A, the transmission data is not sent from the first modem, and the judgment in step 176 is negative. Therefore, if the judgment in step 176 is negative, it can be determined that a failure occurs in the communication with the first modem 35A. Therefore, in step 180, the processing unit 127 notifies the second modem 35B that a failure has occurred in the communication with the first modem 35A. When the second communication control device 38 is notified via the second modem 35B that a failure has occurred in the communication with the first modem 35A, it notifies the FC12 that a failure has occurred in the communication with the first modem 35A. As a result, as described above, FC12 sets the variable F to 1.
[0094] In step 182, the setting unit 121 sets the variable F to 1.
[0095] If it is not determined in step 174 that F=0, the transmission data will be transmitted from the second modem 35B (see step 156 in FIG. 11). Then, in step 184, the determination unit 123 determines whether or not the transmission data has been transmitted from the second modem. If it is determined that the transmission data has been transmitted from the second modem 35B, in step 186, the storage processing unit 125 stores the transmission data.
[0096] However, if it is not determined in step 184 that the transmission data has been transmitted from the second modem, then no transmission data has been transmitted from the second modem 35B either, and therefore in step 188 the processing unit 127 executes the above-mentioned error processing, and this data communication processing ends. If the determination in step 176 is negative, a warning may be displayed before step 180, after step 180 and before step 182, or after step 182 and before step 190, to inform the user that a problem has occurred in data transmission in the first modem 35A.
[0097] In this manner (see also FIG. 13A), if no failure occurs in communication with the first modem 35A, the transmission data is sent from the first modem 35A and the transmission data is stored in the storage devices 68S, 68G, and if a failure occurs in communication with the first modem 35A, the transmission data is sent from the second modem 35B and the transmission data is stored in the storage devices 68S, 68G. (Fourth Modification of the First Embodiment) As described above, in the third modified example of the first embodiment (see FIG. 13A), if no failure occurs in communication with the first modem 35A, transmission data is sent only from the first modem 35A, i.e., there is no communication between the second modem 35B and the monitoring devices 50S, 50G. In this fourth modified example, for example, if transmission data is sent from the first modem 35A and there is no communication between the second modem 35B and the monitoring devices 50S, 50G, communication is performed between the second modem 35B and the monitoring devices 50S, 50G.
[0098] 13B shows a flowchart of a control data transmission program executed by CPU 52S of monitoring device 50S in the fourth modified example of the first embodiment. The control data transmission program goes into a state when control data is input by input device 62S.
[0099] When an operator of the monitoring device 50S monitors the flight of the drone 10A on the display 66S, he or she may want to change the current operating state of the drone 10A. Therefore, in the fourth modified example, the operator transmits control data from the monitoring device 50S to the drone 10, so that the operator can change the current operating state of the drone 10A.
[0100] Here, the control data is, for example, the following data:
[0101] First, there is control data that instructs the first camera 32 or the second camera 34 to at least one of turn on or off, change the shooting direction, and change the resolution.
[0102] Second, there is control data that directs at least one sensor to be on or off.
[0103] Third, there is control data instructing the drone 10A to land (because an abnormality (emergency) has occurred in the drone 10A). Specifically, if the drone is equipped with a parachute, the parachute is opened or the drone is allowed to hover and gradually lowered.
[0104] 13B, the processing unit 127 detects a communication device that is not currently being used. Specifically, the processing unit 127 detects the second communication device 64S2 that communicates with the second modem 35B.
[0105] In step 159, the processing unit 127 transmits the control data via the detected communication device. The control data is received by the second modem 35B and transmitted to the FC 12 by the communication control device 38. The CPU 14 of the FC 12 changes the current operating state of the drone 10A according to the control data.
[0106] In the fourth variant, control data is sent using an unused modem to change the current operating state of the drone 10A, thereby making effective use of the modem. (Fifth Modification of the First Embodiment) FIG. 13C shows a flowchart of a communication program executed by the CPU 14 of the FC 12 of the drone 10A in the fifth modified example of the first embodiment.
[0107] The communication program of the fifth modified example of the first embodiment is substantially similar to the communication program of the third modified example of the first embodiment shown in FIG. 11, so only the differences will be described.
[0108] In the communication program shown in FIG. 11, transmission data is transmitted by a predetermined first modem 35A, and if a failure occurs in transmission in the first modem 35A, the transmission data is transmitted by a second modem 35B.
[0109] In contrast to this, in the fifth modified example, the transmission data is transmitted by a modem selected based on the selection conditions.
[0110] If the determination in step 152 is positive, in step 154A, the processing unit 19 selects a modem that transmits the transmission data based on the following selection conditions.
[0111] The selection conditions are a modem with a high communication speed, a modem with low communication charges, a modem whose communication charges do not vary according to the amount of data, a modem with good communication conditions (specifically, a modem with strong radio waves from the first communication devices 64S1, 64G1 and the second communication devices 64S2, 64G2 of the monitoring devices 50S, 50G), and a modem with a low frequency of communication failures.
[0112] In step 154B, the transmission processing unit 15 controls the communication control device 36 or the communication control device 38 corresponding to the selected modem so that the selected modem transmits the transmission data to each of the monitoring devices 50S, 50G.
[0113] After processing of step 154B, communication processing proceeds to step 112.
[0114] In the fifth modified example, a modem that satisfies the selection conditions can be selected to transmit the transmission data. (Sixth Modification of the First Embodiment) FIG. 13D shows a flowchart of a communication program executed by the CPU 14 of the FC 12 of the drone 10A in the sixth modified example of the first embodiment.
[0115] In the communication program of the sixth modified example of the first embodiment, the processes of steps 102, 104, and 106 of the communication program of the third modified example of the first embodiment shown in FIG. 11 are executed.
[0116] In step 171, the processing unit 19 estimates the amount of data of each piece of data from the shooting direction and resolution of the first camera 32 and the second camera, and the content of each piece of sensor data.
[0117] In step 173, the creation unit 13 creates the first transmission data to be transmitted by the first modem 35A and the second transmission data to be transmitted by the second modem 35B based on the data amount of each data and the above selection conditions.
[0118] The creation method in step 173 will now be described in detail.
[0119] First, the first creation mode will be described.
[0120] For example, the order of data volume may be first, image data of the entire drone 10 taken by the second camera 34, second, sensor data, and third, image data of the forward direction of the drone 10 taken by the first camera 32.
[0121] It is assumed that the selection condition is to shorten the total transmission time for one transmission, and that the communication speed of the first modem 35A is faster than the communication speed of the second modem 35B.
[0122] In this case, if the second modem 35B, which has a slow communication speed, transmits a large amount of data and the first modem 35A, which has a fast communication speed, transmits a small amount of data, the data transmission by the second modem 35B will not finish even when the transmission by the first modem 35A has finished, and the overall transmission time will be longer.
[0123] Therefore, the processing unit 19 creates the first transmission data to be transmitted by the first modem 35A so as to include image data of the entire drone 10 captured by the second camera 34, and creates the second transmission data to be transmitted by the second modem 35B so as to include the sensor data and image data of the area ahead in the direction of travel of the drone 10 captured by the first camera 32.
[0124] Next, the second creation mode will be described.
[0125] The data volume is ranked in the above order, but the selection condition is to reduce the overall communication fee. In this modification, the communication fee of the second modem 35B varies according to the data volume, but in the transmission by the first modem 35A, the fee is fixed up to a predetermined data volume of the transmission data, but when the data volume of the transmission data exceeds the predetermined value, the communication fee becomes higher than that of the second modem 35B.
[0126] Then, the image data of the entire drone 10 from the second camera 34 exceeds the above-mentioned predetermined value, It is assumed that the total amount of data of the sensor data and the image data of the forward direction of the drone 10 captured by the first camera 32 does not exceed a predetermined value.
[0127] The processing unit 19 creates first transmission data to be transmitted by the first modem 35A so as to include sensor data and image data of the front of the drone 10 in the direction of travel captured by the first camera 32, and creates second transmission data to be transmitted by the second modem 35B so as to include image data of the entire drone 10 captured by the second camera 34.
[0128] In step 154A, the transmission processor 15 controls the communication control device 36 so that the first modem 35A transmits the first transmission data to each of the monitoring devices 50S and 50G.
[0129] In step 154B, the transmission processing unit 15 controls the communication control device 38 so that the second modem 35B transmits the second transmission data to each of the monitoring devices 50S and 50G.
[0130] In the sixth modified example, a modem that satisfies the amount of transmission data and the selection conditions can be selected to transmit the transmission data. (Seventh Modification of the First Embodiment) In the seventh modification of the first embodiment, the FC 12 of the drone 10A executes the communication program shown in Fig. 11. The monitoring devices 50S, 50G do not execute the data storage program of Fig. 12. The monitoring devices 50S, 50G store the transmission data transmitted in step 154 or step 156 of Fig. 11 in the storage devices 68S, 68G.
[0131] Fig. 14 shows a functional block diagram of the CPU 14B of the second communication control device 38 of the seventh modified example of the first embodiment. Fig. 15 shows a flowchart of a failure occurrence determination program executed by the second communication control device 38 of the seventh modified example of the first embodiment for determining whether or not a failure has occurred in communication by the first modem 35A of the first communication control device 36.
[0132] 14, the CPU 14B functions as a command section 201, a judgment section 203, and an output processing section 205 when executing a failure occurrence judgment program.
[0133] In step 212, the instruction unit 201 instructs the CPU 14A of the first communication control unit 36 to execute a predetermined calculation and transmit the result of the calculation to the second communication control unit 38. The predetermined calculation is for determining whether or not the first communication control unit 36 has failed, and may be a calculation that can be completed and returned within a predetermined period of time (described later in step 216), such as addition or subtraction.
[0134] In step 214, the judgment unit 203 judges whether or not the calculation result (specifically, the correct answer) has been received. If it is not judged that the calculation result (specifically, the correct answer) has been received, in step 216, the judgment unit 203 judges whether or not a predetermined time has elapsed since the processing of step 212 was executed. If it is not judged that the predetermined time has elapsed since the processing of step 212 was executed, the fault occurrence judgment processing returns to step 214.
[0135] If the first communication control device 36 is not at fault, the calculation result (specifically, the correct answer) is transmitted from the first communication control device 36 before a predetermined time has elapsed since the execution of the process in step 212. Therefore, if the calculation result (specifically, the correct answer) is transmitted from the first communication control device 36 before a predetermined time has elapsed since the execution of the process in step 212, it can be determined that the first communication control device 36 is not at fault, the determination in step 214 is positive, and the fault occurrence determination process ends.
[0136] However, if the calculation result (specifically, the correct answer) is not transmitted from the first communication control device 36 within a predetermined time from the time the processing of step 212 is executed, it can be determined that the first communication control device 36 has failed, the judgment of step 216 is a positive judgment, and in step 218, the output processing unit 205 notifies FC12 that the first communication control device 36 has failed.
[0137] 16 shows a flowchart of a program executed by the CPU 14 of the FC 12 that is notified by the second communication control device 38 of the seventh modified example of the first embodiment that a failure has occurred in communication by the first modem 35A of the first communication control device 36. As shown in FIG. 16, the CPU 14 sets 1 to a variable F in step 220.
[0138] The seventh modified example is also applied to the first communication control unit 36. Therefore, the first communication control unit 36 and the second communication control unit 38 can check whether the other has a failure.
[0139] The FC 12 may execute a failure occurrence determination program shown in FIG. (Eighth Modification of the First Embodiment) FIG. 17 shows a timing chart of data transmission from the first modem 35A and the second modem 35B in the eighth modified example of the first embodiment.
[0140] As shown in FIG. 17, a first modem 35A of a first communication control unit 36 and a second modem 35B of a second communication control unit 38 transmit transmission data to monitoring devices 50S, 50G alternately at predetermined time intervals.
[0141] For example, if a failure occurs in transmission in the first modem 35A, the second modem 35B transmits the transmission data to the storage devices 68S, 68G at predetermined time intervals.
[0142] The transmitted data includes image data of an image of the area in the direction of the drone's travel taken by the first camera 32 and an image of the overall appearance of the drone taken by the second camera 34, as well as sensor data of the state of the drone detected by the sensor. (Ninth Modification of the First Embodiment) FIG. 18 shows a timing chart of data transmission from the first modem 35A and the second modem 35B in the ninth modification of the first embodiment.
[0143] 18, the first modem 35A of the first communication control device 36 transmits to the monitoring devices 50S, 50G at a predetermined time interval a message informing them that the first transmission data including the sensor data of the drone status will be transmitted multiple times (e.g., three pieces) at a certain time interval. More specifically, after transmitting the multiple pieces of the first transmission data, the first modem 35A waits for a certain time and then transmits the multiple pieces of transmission data.
[0144] The second modem 35B of the second communication control device 38 transmits second transmission data including image data of an image of the area in the direction of travel of the drone captured by the first camera 32 and an image of the overall appearance of the drone captured by the second camera 34 to the monitoring devices 50S, 50G at predetermined time intervals. The second modem 35B transmits the second transmission data while the first modem 35A is on standby.
[0145] For example, when a failure occurs in transmission in the first modem 35A, the second modem 35B transmits the first transmission data and the second transmission data to the monitoring devices 50S, 50G. The transmission timing of the first transmission data is the same as the timing at which the first modem 35A transmits the first transmission data. [Other embodiments] Other embodiments will be described below. Since the configurations of the other embodiments described below are similar to that of the first embodiment, the same parts are given the same reference numerals, and the description of the same parts will be omitted, and the differences will be mainly described.
[0146] In addition, in the other embodiments described below, the content of the transmission data from the drone, the timing of transmission of the transmission data, and the method of storing the transmission data of the first monitoring device 50S and the second monitoring device 50G are similar to those of the first embodiment and each of the modified examples of the first embodiment, and therefore will not be described. [Second embodiment] Next, a second embodiment will be described. Fig. 19 shows a block diagram of a system including a drone 10B, monitoring devices 50S and 50G, a cloud server 200, and a live distribution server according to the second embodiment.
[0147] The drone 10B of the second embodiment is equipped with the following communication devices instead of the first modem 35A of the first communication control device 36, the second modem 35B of the second communication control device 38, the first communication device 64S1 and the second communication device 64S2 of the first monitoring device 50S, and the first communication device 64G1 and the second communication device 64G2 of the second monitoring device 50G in the drone 10A of the first embodiment.
[0148] That is, in the drone 10B, the first communication control device 36 includes a first communicator 37A1 and a second communicator 37A2, and the second communication control device 38 includes a first communicator 37B1 and a second communicator 37B2. The first monitoring device 50S includes a first communicator 64ST1 and a second communicator 64ST2, and the second monitoring device 50G includes a first communicator 64GT1 and a second communicator 64GT2.
[0149] The first communication device 37A1 of the first communication control device 36, the first communication device 64ST1 of the first monitoring device 50S, and the first communication device 64GT1 of the second monitoring device 50G perform first wireless communication using a first direct wireless communication method.
[0150] The first communication device 37B1 of the second communication control device 38, the first communication device 64ST1 of the first monitoring device 50S, and the first communication device 64GT1 of the second monitoring device 50G perform first wireless communication using a first direct wireless communication method.
[0151] The second communication device 37A2 of the first communication control device 36, the second communication device 64ST2 of the first monitoring device 50S, and the second communication device 64GT2 of the second monitoring device 50G perform a second wireless communication using a second direct wireless communication method different from the first direct wireless communication method.
[0152] The second communication device 37B2 of the second communication control device 38, the second communication device 64ST2 of the first monitoring device 50S, and the second communication device 64GT2 of the second monitoring device 50G perform second wireless communication using a second direct wireless communication method.
[0153] The first direct wireless communication scheme and the second direct wireless communication scheme have different communication frequencies.
[0154] The following devices may be omitted. That is, the second communicator 37A2 of the first communication control device 36 and the first communicator 37B1 of the second communication control device 38. Or, the first communicator 37A1 of the first communication control device 36 and the second communicator 37B2 of the second communication control device 38. [Third embodiment] Next, a third embodiment will be described. Fig. 20 shows a block diagram of a system including a drone 10C, monitoring devices 50S and 50G, a cloud server 200, and a live distribution server according to the third embodiment.
[0155] The drone 10C of the third embodiment is equipped with the following communication devices instead of the second modem 35B of the second communication control device 38 of the drone 10A of the first embodiment, the second communication device 64S2 of the first monitoring device 50S, and the second communication device 64G2 of the second monitoring device 50G.
[0156] That is, in the drone 10C, the second communication control device 38 includes the second communicator 37B1 of the second embodiment. Also, the first monitoring device 50S includes the first communicator 64ST1 of the second embodiment, and the second monitoring device 50G includes the first communicator 64GT1 of the second embodiment.
[0157] The communication method between the modem 35A and the first communication devices 64S1 and 64G1 is the same as that in the first embodiment. The communication method between the communication device 37B1 and the first communication devices 64ST1 and 64GT1 is the same as that in the second embodiment. [Fourth embodiment] Next, a fourth embodiment will be described. Fig. 21 shows a block diagram of a system including a drone 10D, monitoring devices 50S and 50G, a cloud server 200, and a live distribution server according to the fourth embodiment.
[0158] In the drone 10D of the fourth embodiment, the second communication control device 38 of the first embodiment is omitted. The first communication control device 36 of the drone 10D is equipped with a modem 35B.
[0159] The communication method between the modem 35A and the first communication device 64S1 of the first monitoring device 50S and the first communication device 64G1 of the second monitoring device 50G is the same as the communication method of the first embodiment. The communication method between the modem 35B and the second communication device 64S2 of the first monitoring device 50S and the second communication device 64G2 of the second monitoring device 50G is the same as the communication method of the first embodiment. (First modified example of the fourth embodiment) The first communication control device 36 of the drone 10D may be equipped with the first communicator 35A1 and the second communicator 37B1 (see FIG. 19) of the second embodiment instead of the modem 35A and the modem 35B. In this case, the monitoring devices 50S and 50G are similar to the monitoring devices 50S and 50 of the second embodiment. (Second modified example of the fourth embodiment) The first communication control device 36 of the drone 10D may be equipped with the second communicator 37B1 (see FIG. 20) of the second embodiment instead of the modem 35B. In this case, the monitoring devices 50S and 50G are similar to the monitoring devices 50S and 50G of the third embodiment. [Fifth embodiment] Next, a fifth embodiment will be described. Fig. 22 shows a block diagram of a system including a drone 10E, monitoring devices 50S and 50G, a cloud server 200, and a live distribution server according to the fifth embodiment.
[0160] In the drone 10E of the fifth embodiment, the first communication control device 36 and the second communication control device 38 of the first embodiment are omitted. The modem 35A and the modem 35B are connected to the FC12. (First modified example of the fifth embodiment) The drone 10E may be provided with the first communicator 35A and the second communicator 37B of the second embodiment instead of the modem 35A and the modem 35B. In this case, the monitoring devices 50S and 50G are similar to the monitoring devices 50S and 50G of the second embodiment. (Second modified example of the fifth embodiment) The drone 10E may be provided with the second communicator 37B of the second embodiment instead of the modem 35B. In this case, the monitoring devices 50S and 50G are similar to the monitoring devices 50S and 50 of the third embodiment. [Sixth embodiment] Next, a sixth embodiment will be described. Fig. 23 shows a block diagram of a system including a drone 10F, monitoring devices 50S and 50G, a cloud server 200, and a live distribution server according to the sixth embodiment.
[0161] In the first embodiment (see FIG. 1), a first communication control unit 36 and a second communication control unit 38 are connected to the FC 12.
[0162] In contrast, the sixth embodiment (see FIG. 23) includes a first FC 12A and a second FC 12B having the same configuration as the FC 12 in the first embodiment. A first communication control device 36 is connected to the first FC 12A. A second communication control device 38 is connected to the second FC 12B. (First modified example of the sixth embodiment) The drone 10F may be provided with the first communicator 35A and the second communicator 37B of the second embodiment instead of the modem 35A and the modem 35B. In this case, the monitoring devices 50S and 50G are similar to the monitoring devices 50S and 50 of the second embodiment. (Second modified example of the sixth embodiment) The drone 10F may be provided with the second communicator 37B of the second embodiment instead of the modem 35B. In this case, the monitoring devices 50S and 50G are similar to the monitoring devices 50S and 50 of the third embodiment. [Seventh embodiment] Next, a seventh embodiment will be described. The seventh embodiment includes the first FC 12A and second FC 12B of the sixth embodiment, and the first communication control device 36 of the fourth embodiment. (First modified example of the seventh embodiment) In this case, the first communication device 35A and the second communication device 37B of the second embodiment may be provided instead of the modem 35A and the modem 35B. In this case, the monitoring devices 50S and 50G are similar to the monitoring devices 50S and 50G of the second embodiment. (First modified example of the seventh embodiment) Moreover, the second communication device 37B of the second embodiment may be provided instead of the modem 35B. In this case, the monitoring devices 50S and 50G are similar to the monitoring devices 50S and 50 of the third embodiment. [Further other embodiments] The first wireless communication between the drone 10A and the first monitoring device 50S may be a first satellite communication via an artificial satellite, and the second wireless communication between the drone 10A and the first monitoring device 50S may be a second satellite communication via an artificial satellite different from the first satellite communication. The first satellite communication and the second satellite communication have different radio wave frequencies. The first satellite communication is an example of a "first indirect wireless communication" of the technology of the present disclosure. The second satellite communication is an example of a "second indirect wireless communication" of the technology of the present disclosure. Also, the first wireless communication between the drone 10A and the first monitoring device 50S is satellite communication via an artificial satellite, and the second wireless communication between the drone 10A and the first monitoring device 50S may be communication via the Internet in the CDMA or W-CDMA format (see FIG. 1) or direct wireless communication (see FIG. 19) instead of satellite communication. Conversely, the first wireless communication between the drone 10A and the first monitoring device 50S is communication via the Internet in the CDMA or W-CDMA format (see FIG. 1) or direct wireless communication (see FIG. 19) instead of satellite communication, and the second wireless communication between the drone 10A and the first monitoring device 50S may be satellite communication via an artificial satellite. In addition, the first wireless communication between the drone 10A and the second monitoring device 50G is equivalent to the above-mentioned first wireless communication between the drone 10A and the first monitoring device 50S, and the second wireless communication between the drone 10A and the second monitoring device 50G is equivalent to the above-mentioned second wireless communication between the drone 10A and the first monitoring device 50S. The drone 10A, the first monitoring device 50S, and the second monitoring device 50G that communicate via satellite are equipped with satellite communication modules such as Iridium (registered trademark) and Inmarsat (registered trademark). When the drone 10A communicates via satellite with the first monitoring device 50S and the second monitoring device 50G, communication is possible between the drone 10A and the first monitoring device 50S and the second monitoring device 50G even if the drone 10A is offshore or in a mountainous area. In the second modified examples of the first to seventh embodiments, the sensor 42 is connected to the FC 12, but the technology of the present disclosure is not limited to this. The sensor 42 may be connected to a communication control device.
[0163] The first camera 32 and the second camera 34 are connected to the communication control device, but may be connected to the FC 12 .
[0164] In the above-described example, the drone is equipped with two modems and each of the monitoring devices 50S, 50G is equipped with two communication devices (FIGS. 1, 21 to 23, etc.), but the technology of the present disclosure is not limited to this. The drone may be equipped with three or more modems and each of the monitoring devices 50S, 50G may be equipped with three or more communication devices. In this case, each of the three or more combinations of modems and communication devices communicates using a different communication method.
[0165] In the above example, the drone is equipped with two communicators and each of the monitoring devices 50S, 50G is equipped with two communicators (FIG. 19, etc.), but the technology of the present disclosure is not limited to this. The drone may be equipped with three or more communicators, and each of the monitoring devices 50S, 50G may be equipped with three or more communicators. In this case, each of the three or more combinations of communicators and communicators communicates using a different communication method.
[0166] Furthermore, in the above example, the combination of modem to communicator in the drone is one to one (Figure 20, etc.), but it may be two or more to one, one to two or more, or multiple to multiple.
[0167] In the above-described embodiment and each modified example, a drone is used for the description, but the technology of the present disclosure is not limited thereto. For example, instead of a drone, other unmanned aircraft, such as a radio-controlled airplane and a radio-controlled unmanned helicopter, or even a manned aircraft, such as a radio-controlled helicopter that a person can ride on, may be used. Aircraft that are not radio-controlled in general may also be used. Specifically, airplanes, rotorcraft, gliders, and airships that can be used for aviation with a person on board, and other equipment that can be used for aviation may also be used.
[0168] In the present disclosure, each component (device, etc.) may be present in only one or in two or more instances, unless a contradiction arises.
[0169] In the above-described examples, the above processes are realized by a software configuration using a computer, but the technology of the present disclosure is not limited to this. For example, instead of a software configuration using a computer, the above processes may be executed only by a hardware configuration such as a field-programmable gate array (FPGA) or an application specific integrated circuit (ASIC). Some of the above processes may be executed by a software configuration, and the remaining processes may be executed by a hardware configuration.
[0170] The above-mentioned program can be stored and supplied to a computer using various types of non-transitory computer-readable media. The non-transitory computer-readable media includes various types of tangible recording media. Examples of the non-transitory computer-readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, and semiconductor memory (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may also be supplied to a computer by various types of temporary computer-readable media. Examples of the temporary computer-readable media include electric signals, optical signals, and electromagnetic waves. The temporary computer-readable media can supply the program to a computer via a wired communication path such as an electric wire and an optical fiber, or via a wireless communication path.
[0171] The above-described processes are merely examples. It goes without saying that unnecessary steps may be deleted, new steps may be added, or the order of processes may be changed without departing from the spirit of the invention.
[0172] All publications, patent applications, and standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or standard was specifically and individually indicated to be incorporated by reference.
Claims
1. a first communication unit that performs a first wireless communication; a second communication unit that performs a second wireless communication different from the first wireless communication; a control unit that controls the first communication unit and the second communication unit so that the same data is transmitted to a monitoring device by each of the first communication unit and the second communication unit; An aircraft comprising: the monitoring device includes a storage device that stores the data transmitted by the first communication unit and the data transmitted by the second communication unit in correspondence with each other; aircraft.
2. The first communication unit performs the first wireless communication in a first indirect wireless communication method; the second communication unit performs the second wireless communication by a second indirect wireless communication method different from the first indirect wireless communication method; 2. The aircraft of claim 1.
3. The aircraft of claim 2 , wherein the first communication unit and the second communication unit indirectly communicate wirelessly via an internet to which the monitoring device is connected.
4. The aircraft according to claim 2 or 3, wherein the first indirect wireless communication system and the second indirect wireless communication system have different communication protocols.
5. the first communication unit performs the first wireless communication in a first direct wireless communication method; the second communication unit performs the second wireless communication in a second direct wireless communication scheme different from the first direct wireless communication scheme; 2. The aircraft of claim 1.
6. The aircraft according to claim 5 , wherein the first direct wireless communication system and the second direct wireless communication system use different communication frequencies.
7. the first communication unit performs the first wireless communication by an indirect wireless communication system or a direct wireless communication system; The second communication unit performs the second wireless communication by a direct wireless communication method or an indirect wireless communication method.
2. The aircraft of claim 1.
8. a first communication unit that performs a first wireless communication; a second communication unit that performs a second wireless communication different from the first wireless communication; a control unit that controls the first communication unit and the second communication unit so that data is transmitted to a monitoring device; An aircraft comprising: the monitoring device is a first monitoring device arranged in a first area including a first point from which the aircraft is scheduled to take off, and a second monitoring device arranged in a second area including a second point from which the aircraft is scheduled to land, the control unit controls the first communication unit and the second communication unit so that the same data is transmitted to the first monitoring device and the second monitoring device by each of the first communication unit and the second communication unit; the first monitoring device includes a first display that displays data transmitted by the first communication unit and the second communication unit, the second monitoring device includes a second display that displays data transmitted by the first communication unit and the second communication unit, aircraft.
9. The aircraft according to any one of claims 1 to 8, wherein the control unit controls the first communication unit and the second communication unit so that the data is further transmitted to a server device other than the monitoring device.
10. The aircraft according to claim 9 , wherein the server device is at least one of a cloud server device and a live streaming server device.
11. Further comprising a first photographing unit that photographs an area in the direction of travel of the aircraft and a second photographing unit that photographs the aircraft, The data includes image data of at least one of an image of the area in the direction of flight of the aircraft captured by the first photographing unit and an image of the aircraft captured by the second photographing unit. An aircraft as described in any one of claims 1 to 10.
12. a sensor for detecting a state of the aircraft; The aircraft according to any one of claims 1 to 11, wherein the data includes sensor data indicative of a state of the aircraft detected by the sensor.
13. The aircraft according to any one of claims 1 to 12, wherein the control unit controls the first communication unit and the second communication unit so that the data is transmitted to the monitoring device from each of the first communication unit and the second communication unit simultaneously or alternately.
14. The aircraft described in any one of claims 1 to 13, wherein, when there is a problem in communication of one of the first communication unit and the second communication unit, the control unit controls the first communication unit and the second communication unit so that the data is transmitted to the monitoring device from the other of the first communication unit and the second communication unit.
15. The main body, A plurality of arms connected to the body; a motor provided at the tip of each of the plurality of arms and a propeller rotated by the motor; The control unit further controls the motor. An aircraft according to any one of claims 1 to 14.
16. The control unit is provided in one flight controller. An aircraft according to any one of claims 1 to 15.
17. The control unit is A first control unit provided in the first flight controller; A second control unit provided in a second flight controller different from the first flight controller; The aircraft according to any one of claims 1 to 15,
18. the first communication unit is provided in a first communication control device, The second communication unit is provided in a second communication control device. An aircraft according to any one of claims 1 to 15.
19. The first communication unit and the second communication unit are provided in one communication control device. An aircraft according to any one of claims 1 to 15.
Citation Information
Patent Citations
Unmanned aerial vehicle
JP2020196440A
Remote operation system and operation device thereof
JP2021179976A
Adaptive communication mode switching
US20150230150A1
Systems and Methods for Restricting Drone Airspace Access
US20160253907A1
Flying device, control device, communication control method, and control method
WO2018105576A1
