Information processing device, program, system, and information processing method

Abstract

Provided is an information processing device comprising: a first pairing unit that transmits an Internet Protocol (IP) address of a drone to a first control device, and transmits an IP address of the first control device to the drone, thereby establishing a first pairing between the first control device and the drone; an instruction acquisition unit that acquires a control authority switching instruction for instructing switching of a control device that has the control authority for the drone from the first control device to a second control device; a second pairing unit that, in response to the instruction acquisition unit acquiring the control authority switching instruction, transmits the IP address of the drone to the second control device while the drone is flying, and transmits the IP address of the second control device to the drone, thereby establishing a second pairing between the second control device and the drone; and a switching unit that, in response to the second pairing unit establishing the second pairing, switches the control device that has the control authority for the drone from the first control device to the second control device.

Description

Information processing device, program, system, and information processing method

[0001] The present invention relates to an information processing device, a program, a system, and an information processing method.

[0002] Patent Document 1 describes a controller terminal that, when photographing a wide area, determines the flight route and altitude at which a wireless aircraft should photograph by specifying a photographing range on a map. [Prior art documents] [Patent documents] [Patent document 1] JP 2017-046328 A General disclosure

[0003] According to one embodiment of the present invention, there is provided an information processing device. The information processing device may include a first pairing unit that establishes a first pairing between a first controller and a drone by transmitting an Internet Protocol (IP) address of the drone to a first controller and transmitting the IP address of the first controller to the drone. The information processing device may include an instruction acquisition unit that acquires a control authority switching instruction instructing a control device having control authority for the drone to switch from the first controller to a second controller. The information processing device may include a second pairing unit that, in response to the instruction acquisition unit acquiring the control authority switching instruction, establishes a second pairing between the second controller and the drone by transmitting the IP address of the drone to the second controller and transmitting the IP address of the second controller to the drone while the drone is flying. The information processing device may include a switching unit that switches the control device having the control authority of the drone from the first control device to the second control device by transmitting a control authority switching signal to the drone indicating that flight will be switched from flight based on control signals transmitted by the first control device to flight based on control signals transmitted by the second control device when the second pairing unit establishes the second pairing. The information processing device may further include a response receiving unit that receives an IP address response from the first control device indicating that the IP address of the drone has been received and receives an IP address response from the drone indicating that the IP address of the first control device has been received. The first pairing unit may determine that the first pairing between the first control device and the drone has been established when the response receiving unit receives the IP address responses from both the first control device and the drone. In any of the information processing devices, the first pairing unit may determine that the first pairing between the first control device and the drone has been established when a predetermined period has elapsed since transmitting the IP addresses to the first control device and the drone, respectively.Any of the information processing devices may further include a response receiving unit that receives an IP address response from the second controller indicating that the IP address of the drone has been received, and receives an IP address response from the drone indicating that the IP address of the second controller has been received, and the second pairing unit may determine that the second pairing between the second controller and the drone has been established when the response receiving unit receives the IP address response from both the second controller and the drone. In any of the information processing devices, the second pairing unit may determine that the second pairing between the second controller and the drone has been established when a predetermined period has elapsed since transmitting IP addresses to the second controller and the drone, respectively. Any of the information processing devices further includes a notification unit that notifies a control authority switching notification indicating that the control device having the control authority of the drone will be switched from the first control device to the second control device, and a response receiving unit that receives a notification confirmation response indicating that the control authority switching notification has been confirmed.The switching unit may switch the control device having the control authority of the drone from the first control device to the second control device when the response receiving unit receives the notification confirmation response.

[0004] According to one embodiment of the present invention, there is provided an information processing device. The information processing device may include a pairing unit that transmits an IP address of a first drone and an IP address of a second drone to a control device and establishes a first pairing between the control device and the first drone and a second pairing between the control device and the second drone by transmitting the IP address of the control device to the first drone and the second drone, respectively. The information processing device may include an instruction acquisition unit that acquires a control object switching instruction instructing the control device to switch the control object from the first drone to the second drone. The information processing device may include a switching unit that, in response to the instruction acquisition unit acquiring the control object switching instruction, switches the control object of the control device from the first drone to the second drone by transmitting an end signal to the first drone indicating an end of flight based on a control signal transmitted by the control device and transmitting a start signal to the second drone indicating a start of flight based on a control signal transmitted by the control device while the second drone is flying. The information processing device may further include a response receiving unit that receives an IP address response from the control device indicating that the IP address of the first drone has been received, and receives an IP address response from the first drone indicating that the IP address of the control device has been received, and the pairing unit may determine that the first pairing between the control device and the first drone has been established when the response receiving unit receives the IP address responses from both the control device and the first drone. In any of the information processing devices, the pairing unit may determine that the first pairing between the control device and the first drone has been established when a predetermined period has elapsed since transmitting IP addresses to the control device and the first drone, respectively.Any of the information processing devices may further include a response receiving unit that receives an IP address response from the control device indicating that the IP address of the second drone has been received, and receives an IP address response from the second drone indicating that the IP address of the control device has been received, and the pairing unit may determine that the second pairing between the control device and the second drone has been established when the response receiving unit receives the IP address response from both the control device and the second drone. In any of the information processing devices, the pairing unit may determine that the second pairing between the control device and the second drone has been established when a predetermined period has elapsed since transmitting IP addresses to the control device and the second drone, respectively. Any of the information processing devices may further include a notification unit that notifies the control device of a control object switching notification indicating that the control object will be switched from the first drone to the second drone, and a response receiving unit that receives a notification confirmation response indicating that the control object switching notification has been confirmed, and the switching unit may switch the control object of the control device from the first drone to the second drone when the response receiving unit receives the notification confirmation response.

[0005] According to one embodiment of the present invention, there is provided an information processing device. The information processing device may include an information storage unit that stores pairing group information indicating a pairing group consisting of a plurality of drones and a plurality of control devices. The information processing device may include a pairing unit that establishes a plurality of pairings between each of the plurality of control devices and each of the plurality of drones by transmitting an IP address of each of the plurality of drones to each of the plurality of control devices based on the pairing group information and transmitting the IP address of each of the plurality of control devices to each of the plurality of drones. The information processing device may include an instruction acquisition unit that acquires a control authority switching instruction to switch a control device having control authority for a drone belonging to the pairing group from a first control device belonging to the pairing group to a second control device belonging to the pairing group. The information processing device may include a switching unit that switches the control device having the control authority of the drone from the first control device to the second control device in response to the instruction acquisition unit acquiring the control authority switching instruction, by transmitting a control authority switching signal to the drone while the drone is flying, indicating a switch from flight based on control signals transmitted from the first control device to flight based on control signals transmitted from the second control device. The information processing device may further include a response receiving unit that receives an IP address response from the first control device indicating that the IP address of the drone has been received, and receives an IP address response from the drone indicating that the IP address of the first control device has been received. The first pairing unit may determine that the first pairing between the first control device and the drone has been established when the response receiving unit receives the IP address responses from both the first control device and the drone. In any of the information processing devices, the first pairing unit may determine that the first pairing between the first control device and the drone has been established when a predetermined period has elapsed since transmitting the IP addresses to the first control device and the drone, respectively.Any of the information processing devices may further include a response receiving unit that receives an IP address response from the second controller indicating that the IP address of the drone has been received, and receives an IP address response from the drone indicating that the IP address of the second controller has been received, and the second pairing unit may determine that the second pairing between the second controller and the drone has been established when the response receiving unit receives the IP address response from both the second controller and the drone. In any of the information processing devices, the second pairing unit may determine that the second pairing between the second controller and the drone has been established when a predetermined period has elapsed since transmitting IP addresses to the second controller and the drone, respectively. Any of the information processing devices further includes a notification unit that notifies a control authority switching notification indicating that the control device having the control authority of the drone will be switched from the first control device to the second control device, and a response receiving unit that receives a notification confirmation response indicating that the control authority switching notification has been confirmed.The switching unit may switch the control device having the control authority of the drone from the first control device to the second control device when the response receiving unit receives the notification confirmation response.

[0006] According to one embodiment of the present invention, an information processing device is provided. The information processing device may include an information storage unit that stores pairing group information indicating a pairing group consisting of a plurality of drones and a plurality of control devices. The information processing device may include a pairing unit that establishes a plurality of pairings between each of the plurality of control devices and each of the plurality of drones by transmitting an IP address of each of the plurality of drones to each of the plurality of control devices and transmitting the IP address of each of the plurality of control devices to each of the plurality of drones based on the pairing group information. The information processing device may include a first instruction unit that instructs the control device to start transmitting a control signal to a first drone belonging to the pairing group that is a control target of the control device belonging to the pairing group. The information processing device may include an instruction acquisition unit that acquires a control target switching instruction that instructs the control device to switch the control target from the first drone to a second drone belonging to the pairing group. The information processing device may include a second instruction unit that instructs the control device to start transmitting a control signal to the second drone in response to the instruction acquisition unit acquiring the control target switching instruction. The information processing device may include a switching unit that, in response to the second instruction unit instructing the control device to start transmitting control signals to the second drone, switches the control target of the control device from the first drone to the second drone by transmitting an end signal to the first drone indicating an end of flight based on the control signals transmitted by the control device and transmitting a start signal to the second drone indicating a start of flight based on the control signals transmitted by the control device while the second drone is flying. The first instruction unit may instruct the control device to end transmission of the control signals to the first drone in response to completion of switching of the control target of the control device by the switching unit.The information processing device may further include a response receiving unit that receives an IP address response from the control device indicating that the IP address of the first drone has been received, and receives an IP address response from the first drone indicating that the IP address of the control device has been received, and the pairing unit may determine that the first pairing between the control device and the first drone has been established when the response receiving unit receives the IP address responses from both the control device and the first drone. In any of the information processing devices, the pairing unit may determine that the first pairing between the control device and the first drone has been established when a predetermined period has elapsed since transmitting IP addresses to the control device and the first drone, respectively. Any of the information processing devices may further include a response receiving unit that receives an IP address response from the control device indicating that the IP address of the second drone has been received, and receives an IP address response from the second drone indicating that the IP address of the control device has been received, and the pairing unit may determine that the second pairing between the control device and the second drone has been established when the response receiving unit receives the IP address response from both the control device and the second drone. In any of the information processing devices, the pairing unit may determine that the second pairing between the control device and the second drone has been established when a predetermined period has elapsed since transmitting IP addresses to the control device and the second drone, respectively. Any of the information processing devices may further include a notification unit that notifies the control device of a control object switching notification indicating that the control object will be switched from the first drone to the second drone, and a response receiving unit that receives a notification confirmation response indicating that the control object switching notification has been confirmed, and the switching unit may switch the control object of the control device from the first drone to the second drone when the response receiving unit receives the notification confirmation response.

[0007] According to one embodiment of the present invention, there is provided a program for causing a computer to function as any one of the information processing devices described above.

[0008] According to one embodiment of the present invention, there is provided a system. The system may include any of the information processing devices. The system may include the drone. The system may include the first control device. The system may include the second control device.

[0009] According to one embodiment of the present invention, there is provided a system. The system may include any of the information processing devices. The system may include the first drone. The system may include the second drone. The system may include the control device.

[0010] According to one embodiment of the present invention, there is provided a system. The system may include any of the information processing devices. The system may include the plurality of drones. The system may include the plurality of control devices.

[0011] According to one embodiment of the present invention, there is provided an information processing method executed by a computer. The information processing method may include a first pairing step of establishing a first pairing between a first controller and a drone by transmitting an IP address of the drone to a first controller and transmitting the IP address of the first controller to the drone. The information processing method may include an instruction acquisition step of acquiring a control authority switching instruction instructing a control device having control authority of the drone to switch from the first controller to a second controller. The information processing method may include a second pairing step of establishing a second pairing between the second controller and the drone by transmitting the IP address of the drone to the second controller and transmitting the IP address of the second controller to the drone in response to receiving the control authority switching instruction in the instruction acquisition step. The information processing method may include a switching step of switching the control device having the control authority of the drone from the first control device to the second control device by sending a control authority switching signal to the drone indicating that the flight will be switched from flight based on control signals transmitted by the first control device to flight based on control signals transmitted by the second control device, in response to establishing the second pairing in the second pairing step.

[0012] According to one embodiment of the present invention, there is provided an information processing method executed by a computer. The information processing method may include a pairing step of establishing a first pairing between the controller and the first drone and a second pairing between the controller and the second drone by transmitting an IP address of a first drone and an IP address of a second drone to a controller and transmitting the IP address of the controller to the first drone and the second drone, respectively. The information processing method may include an instruction acquisition step of acquiring a control object switching instruction instructing the controller to switch a control object from the first drone to the second drone. The information processing method may include a switching step of switching the control object of the controller from the first drone to the second drone by, in response to acquiring the control object switching instruction in the instruction acquisition step, transmitting an end signal to the first drone indicating an end of flight based on a control signal transmitted by the controller while the second drone is flying, and transmitting a start signal to the second drone indicating a start of flight based on a control signal transmitted by the controller, while the second drone is flying.

[0013] According to one embodiment of the present invention, there is provided an information processing method executed by a computer. The information processing method may include a pairing step of establishing a plurality of pairings between each of the plurality of drones and each of the plurality of controllers by transmitting an IP address of each of the plurality of drones to each of the plurality of controllers and transmitting the IP address of each of the plurality of controllers to each of the plurality of drones based on pairing group information stored on the computer. The information processing method may include an instruction acquisition step of acquiring a control authority switching instruction instructing a control device having control authority for a drone belonging to the pairing group to switch from a first control device belonging to the pairing group to a second control device belonging to the pairing group. The information processing method may include a switching step of switching the control device having control authority for the drone from the first control device to the second control device in response to acquiring the control authority switching instruction during flight of the drone by transmitting a control authority switching signal to the drone indicating a switch from flight based on control signals transmitted by the first control device to flight based on control signals transmitted by the second control device.

[0014] According to one embodiment of the present invention, there is provided an information processing method executed by a computer. The information processing method may include a pairing step of establishing a plurality of pairings between each of the plurality of drones and each of the plurality of controllers by transmitting an IP address of each of the plurality of drones to each of the plurality of controllers and transmitting the IP address of each of the plurality of controllers to each of the plurality of drones based on pairing group information stored on the computer and indicating a pairing group composed of a plurality of drones and a plurality of controllers. The information processing method may include a first instruction step of instructing the controller to start transmitting a control signal to a first drone belonging to the pairing group that is a control target of the controller belonging to the pairing group. The information processing method may include an instruction acquisition step of acquiring a control target switching instruction instructing the controller to switch the control target from the first drone to a second drone belonging to the pairing group. The information processing method may include a second instruction step of instructing the controller to start transmitting a control signal to the second drone in response to acquiring the control target switching instruction in the instruction acquisition step. The information processing method may include a switching step of switching the controlled object of the controller from the first drone to the second drone by transmitting an end signal to the first drone indicating an end of flight based on the control signals transmitted by the controller and transmitting a start signal to the second drone indicating a start of flight based on the control signals transmitted by the controller, while the second drone is flying, in response to instructing the controller to start transmitting control signals to the second drone in the second instruction step. The first instruction step may include a step of instructing the controller to end transmission of the control signals to the first drone in response to completion of switching of the controlled object of the controller in the switching step.

[0015] The above summary of the invention does not list all of the necessary features of the present invention, and subcombinations of these features may also constitute inventions.

[0016] 1 is a schematic diagram illustrating an example of a system 10. A schematic diagram illustrating an example of pairing. An explanatory diagram illustrating an example of a processing flow of the system 10. An explanatory diagram illustrating an example of a processing flow of the system 10. An explanatory diagram illustrating an example of a processing flow of the system 10. An explanatory diagram illustrating an example of a processing flow of the system 10. An explanatory diagram illustrating an example of a functional configuration of an information processing device 200. An explanatory diagram illustrating another example of a processing flow of the system 10. An explanatory diagram illustrating another example of a processing flow of the system 10. An explanatory diagram illustrating another example of a processing flow of the system 10. An explanatory diagram illustrating another example of a functional configuration of the information processing device 200. An explanatory diagram illustrating an example of a pairing group. An explanatory diagram illustrating another example of a processing flow of the system 10. An explanatory diagram illustrating another example of a processing flow of the system 10. An explanatory diagram illustrating another example of a processing flow of the system 10. An explanatory diagram illustrating another example of a processing flow of the system 10. An explanatory diagram illustrating another example of a processing flow of the system 10. An explanatory diagram illustrating another example of a processing flow of the system 10. 10 schematically illustrates another example of the functional configuration of the information processing device 200. 11 schematically illustrates an example of the hardware configuration of a computer 1200 that functions as the information processing device 200.

[0017] Conventionally, when remotely controlling a drone by transmitting control signals generated based on control operations input to a remote cellular transmitter via a mobile communication network to the drone, a pairing relationship between the cellular transmitter and the drone had to be established in advance. In other words, the pairing relationship between the cellular transmitter and the drone could not be changed while the drone was flying. Therefore, when controlling a single drone by switching between a total of N transmitters, including N-1 remote transmitters with cellular communication capabilities and one local general transmitter with special wireless communication capabilities, such as a Wi-Fi® transmitter, used by the local pilot to control the drone when it is within the local pilot's line of sight, N transmitters must be assigned to the drone while it is flying. To fly M drones simultaneously with a similar configuration, M × N transmitters were required. A system according to one embodiment employs a mechanism that allows a drone management server to control the pairing relationship between a transmitter with cellular communication capabilities and the drone while the drone is flying, for example.

[0018] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention as claimed. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0019] 1 is a schematic diagram of an example of a system 10. The system 10 may include, for example, a drone 100. The system 10 may include a flight control device 50. The system 10 may include a flight control device 60.

[0020] The system 10 provides, for example, a drone wireless relay service for searching for a victim based on images captured by a camera 120 mounted on the drone 100, while the drone 100 wirelessly relays access to the network 20. The system 10 provides, for example, an inspection service for inspecting inspection targets such as power lines, buildings, bridges, and roads based on images captured by the camera 120. The system 10 may also provide any other service.

[0021] The drone 100 may include a control device 150 and a battery (not shown). The drone 100 may fly using power stored in the battery.

[0022] The drone 100 may acquire location information of the drone 100 using, for example, a GPS (Global Positioning System) function. The location information of the drone 100 includes, for example, latitude information indicating the latitude of the drone 100. The location information of the drone 100 includes, for example, longitude information indicating the longitude of the drone 100.

[0023] The position information of the drone 100 may include altitude information indicating the altitude of the drone 100. In this case, the position information of the drone 100 is three-dimensional position information indicating the three-dimensional position of the drone 100.

[0024] The control device 150 controls various operations of the drone 100. The control device 150 is composed of, for example, a flight controller (FC) that executes flight control processing for the drone 100, a microcontroller such as a Raspberry Pi that executes calculation processing and storage processing for the drone 100, and a communication module that executes communication processing for the drone 100.

[0025] The control device 150 controls the flight of the drone 100, for example, so that the drone 100 flies in a remotely controlled flight mode. The remotely controlled flight mode is a flight mode in which the drone 100 flies based on a control signal received from a control device 50 in a remote location (e.g., a remote control center) via the network 20. The remotely controlled flight mode may be an example of a manually controlled flight mode.

[0026] 1 , if the flight mode of drone 100 at location A (e.g., Tokyo) is remotely controlled flight mode, drone 100 may fly based on control signals received from the control device 50 of remote user 55 or the control device 50 of remote user 57 via network 20 and base station 42. Similarly, if the flight mode of drone 100 at location B (e.g., Hokkaido), which is different from location A, is remotely controlled flight mode, drone 100 may fly based on control signals received from the control device 50 of remote user 55 or the control device 50 of remote user 57 via network 20 and base station 44.

[0027] The network 20 includes, for example, a core network provided by a telecommunications carrier. The core network may conform to, for example, a 5th Generation (5G) communication system. The core network may conform to a 6th Generation (6G) communication system or a later mobile communication system. The core network may conform to a 3rd Generation (3G) communication system. The core network may conform to a Long Term Evolution (LTE) communication system. The network 20 may include the Internet.

[0028] The control device 50 may be any device that can transmit control signals generated based on control operations input by the user to the drone 100 via the network 20. The control device 50 is composed of, for example, a microcontroller such as a Raspberry Pi that executes the calculation and storage processes of the control device 50, and a communication module that executes the wireless communication processes of the control device 50. The control device 50 is, for example, a so-called digital proportional radio control set (the radio control set may be abbreviated to radio control).

[0029] The control device 150 controls the flight of the drone 100, for example, so that the drone 100 flies in a local control flight mode. The local control flight mode is a flight mode in which the drone 100 flies based on control signals received from a local control device 60 via a direct wireless communication connection between the drone 100 and the control device 60. The direct wireless communication between the drone 100 and the local control device 60 may be based on a short-range wireless communication method such as Wi-Fi, Bluetooth (registered trademark), or ZigBee (registered trademark). The local control flight mode may be an example of a manually controlled flight mode.

[0030] 1 , when the flight mode of drone 100 at location A is the locally controlled flight mode, drone 100 may fly based on control signals received from the control device 60 of user 65 at location A via a direct wireless communication connection between drone 100 and the control device 60. Similarly, when the flight mode of drone 100 at location B is the locally controlled flight mode, drone 100 may fly based on control signals received from the control device 60 of user 67 at location B via a direct wireless communication connection between drone 100 and the control device 60.

[0031] The control device 60 may be any device that can transmit control signals generated based on control operations input by a user to the drone 100 via a direct wireless communication connection with the drone 100. The control device 60 is composed of, for example, a microcontroller such as a Raspberry Pi that executes the calculation processing and storage processing of the control device 60, and a communication module that executes the direct wireless communication processing of the control device 60. The control device 60 is, for example, a radio control unit.

[0032] The control device 150 may control the flight of the drone 100 so that the drone 100 flies in an autonomous flight mode. The autonomous flight mode is a flight mode in which the drone 100 flies autonomously. When the flight mode of the drone 100 is the autonomous flight mode, the control device 150 may control the autonomous flight of the drone 100 based on, for example, at least one of an image captured by the camera 120 mounted on the drone 100, position information of the drone 100, and detection information detected by various sensors mounted on the drone 100, such as a speed sensor, an acceleration sensor, and an angle sensor.

[0033] The control device 150 may control the communication of the drone 100 so as to transmit telemetry information of the drone 100 to the information processing device 200 via the network 20. The telemetry information includes, for example, position information of the drone 100. The telemetry information includes, for example, detection information detected by various sensors mounted on the drone 100. The detection information includes, for example, flight speed information indicating the flight speed of the drone 100. The detection information includes, for example, acceleration information indicating the acceleration of the drone 100. The detection information includes, for example, flight direction information indicating the flight direction of the drone 100. The detection information may include malfunction information indicating that the drone 100 is malfunctioning. The telemetry information may include remaining battery capacity information indicating the remaining battery capacity of the battery mounted on the drone 100. The control device 150 may control the communication of the drone 100 so as to transmit, via the network 20, images captured by the camera 120 mounted on the drone 100 to the information processing device 200.

[0034] The information processing device 200 executes various processes. For example, the information processing device 200 executes a pairing establishment process to establish pairing between the control device 50 and the drone 100. For example, the information processing device 200 executes the pairing establishment process before the drone 100 starts flying. For example, the information processing device 200 executes the pairing establishment process while the drone 100 is flying. For example, the information processing device 200 executes the pairing establishment process by writing the IP address of the drone 100 to the control device 50 and writing the IP address of the control device 50 to the drone 100. The pairing establishment process by the information processing device 200 enables the control device 50 to transmit a control signal to the drone 100.

[0035] The information processing device 200 executes, for example, a flight mode setting process that sets the flight mode of the drone 100. The information processing device 200 executes, for example, a flight mode switching process that switches the flight mode of the drone 100.

[0036] The information processing device 200 executes, for example, a control authority setting process for setting a control device 50 that has control authority for the drone 100 flying in the remotely controlled flight mode. The information processing device 200 executes, for example, a control authority switching process for switching between control devices 50 that have control authority for the drone 100 flying in the remotely controlled flight mode. In the example shown in FIG. 1 , for example, while the drone 100 at local site A is flying in the remotely controlled flight mode at local site A, the information processing device 200 switches the control device 50 that has control authority for the drone 100 at local site A from the control device 50 of user 55 to the control device 50 of user 57 by transmitting to the drone 100 a control authority switching signal indicating a switch from flight based on a control signal transmitted by the control device 50 of user 55 to flight based on a control signal transmitted by the control device 50 of user 57.

[0037] 1 , for example, while the control device 50 of the user 55 is remotely controlling the drone 100 at local A, the information processing device 200 transmits to the drone 100 at local A an end signal indicating an end of flight based on the control signal transmitted by the control device 50 of the user 55, and transmits to the drone 100 at local B a start signal indicating a start of flight based on the control signal transmitted by the control device 50 of the user 55, thereby switching the control target of the control device 50 of the user 55 from the drone 100 at local A to the drone 100 at local B. In one example shown in Figure 1, the information processing device 200 may switch the control target of the user 55's control device 50 from the drone 100 at local A to the drone 100 at local B by sending a control target switching instruction to the control device 50 of the user 55, instructing the control device 50 of the user 55 to switch the control target from the drone 100 at local A to the drone 100 at local B, while the control device 50 of the user 55 is remotely controlling the drone 100 at local A.

[0038] The information processing device 200, for example, executes a display control process for displaying on a display various information related to the drone 100. The information processing device 200 executes the display control process by, for example, displaying various information related to the drone 100 on a display corresponding to the control device 50 that has established pairing with the drone 100. The information processing device 200 transmits various information to the display of the drone 100 via the network 20, for example.

[0039] The information processing device 200 displays, for example, telemetry information of the drone 100 on a display. The information processing device 200 may also display, on a display, an image captured by the camera 120 mounted on the drone 100.

[0040] In the example shown in Figure 1, for example, when pairing is established between the control device 50 of user 55 and the drone 100 at location A and between the control device 50 of user 57 and the drone 100 at location B, the information processing device 200 displays various information about the drone 100 at location A on the display 85 corresponding to the control device 50 of user 55, and displays various information about the drone 100 at location B on the display 87 corresponding to the control device 50 of user 57.

[0041] 1 , for example, when pairing is established between the piloting device 50 of the user 55 and the drone 100 at local A and pairing is established between the piloting device 50 of the user 55 and the drone 100 at local B, the information processing device 200 displays various information related to the drone 100 at local A and various information related to the drone 100 at local B on the display 85 corresponding to the piloting device 50 of the user 55. In this case, the information processing device 200 displays, for example, various information related to the drone 100 at local A and various information related to the drone 100 at local B on multiple displays 85 corresponding to the piloting device 50 of the user 55. The information processing device 200 may display the various information related to the drone 100 at local A and various information related to the drone 100 at local B on one display 85 corresponding to the piloting device 50 of the user 55. When the drone 100 being controlled by the control device 50 of the user 55 is a drone 100 at location A, the information processing device 200 may display various information about the drone 100 at location A on the display 85 in a more prominent manner.

[0042] The information processing device 200, for example, displays information indicating that the drone 100 is the drone 100 being controlled by the control device 50 of the user 55 around the periphery of the area in which the various information about the drone 100 at local location A is displayed, thereby causing the various information about the drone 100 at local location A to be displayed more prominently on the display 85. The information processing device 200, for example, displays the various information about the drone 100 at local location A in a different color from the various information about the drone 100 at local location B, thereby causing the various information about the drone 100 at local location A to be displayed more prominently on the display 85. The information processing device 200 may also display the various information about the drone 100 at local location A larger than the various information about the drone 100 at local location B, thereby causing the various information about the drone 100 at local location A to be displayed more prominently on the display 85.

[0043] In the example shown in FIG. 1 , the drone 100 flying in the manually piloted flight mode may be more flexibly controlled than the drone 100 flying in the autonomous flight mode. Furthermore, the remote user's drone 100 piloting skill may be higher than the local user's drone 100 piloting skill. The remote user may be, for example, a professional drone pilot. The local user may be, for example, a worker. Furthermore, the remote user 57's drone 100 piloting skill may be higher than the remote user 55's drone 100 piloting skill.

[0044] 2 is a schematic diagram for explaining an example of pairing. Here, an example in which the information processing device 200 establishes pairing between a transmitter and a drone will be mainly explained.

[0045] For example, the information processing device 200 writes the IP address (Y.Y.Y.Y) of the drone's communication module 154 to the transmitter using the wireless communication module 250, by transmitting the IP address (Y.Y.Y.Y) of the communication module 154 to the transmitter. The information processing device 200 also writes the transmitter's IP address (X.X.X.X) to the Raspberry Pi 152 using the wireless communication module 250, by transmitting the IP address (X.X.X.X) of the communication module 54 to the drone using the wireless communication module 250. In this way, the information processing device 200 establishes pairing between the transmitter and the drone.

[0046] Once pairing between the transmitter and the drone has been established, the transmitter may begin transmitting control signals to the drone's Raspberry Pi 152 using the communication module 54. The drone may use the communication module 154 to receive the transmitter's control signals via a cellular communication network, which is an example of network 20, and transfer the received transmitter's control signals to the Raspberry Pi 152. The Raspberry Pi 152 may transfer the transmitter's control signals to the FC mounted on the drone. The FC may control the flight of the drone 100 based on the control signals transferred by the Raspberry Pi 152.

[0047] 3 to 5 are explanatory diagrams illustrating an example of the processing flow of system 10. Here, the description will be given assuming a starting state in which pairing between the transmitter and the drone has not been established and drones D1 and D2 are waiting on the ground in remotely controlled flight mode. Note that in FIGS. 3 to 5, 7 to 9, 11 to 12, and 15 to 19, the dotted lines connecting the transmitter and drone in the information processing device 200 represent a state in which pairing between the transmitter and drone has been established, and the solid lines connecting the transmitter and drone in the information processing device 200 represent a state in which the transmitter is transmitting a control signal to the drone.

[0048] In step (sometimes abbreviated as S) 102 of FIG. 3, the information processing device 200 receives the IP address (Y １ .Y １ .Y１ .Y １ ) to the Raspberry Pi 52 mounted on the transmitter P1, and the IP address (X １ .X １ .X １ .X １ ) to the Raspberry Pi 152 mounted on the drone D1, thereby establishing pairing between the transmitter P1 and the drone D1. The transmitter P1 then writes the IP address (Y １ .Y １ .Y １ .Y １ In response to the IP address (X １ .X １ .X １ .X １ In response to the information processing device 200 writing the IP address, the communication module 154 may be used to transmit an IP address reception response to the information processing device 200 indicating that the IP address of the transmitter P1 has been received.

[0049] In addition, in S102, the information processing device 200 receives the IP address (Y ２ .Y ２ .Y ２ .Y ２ ) to the Raspberry Pi 52 mounted on the transmitter P2, and the IP address of the transmitter P2 (X ２ .X ２ .X ２ .X ２ ) to the Raspberry Pi 152 mounted on the drone D2, thereby establishing pairing between the transmitter P2 and the drone D2. The transmitter P2 may transmit an IP address reception response indicating that it has received the IP address of the drone D2 side to the information processing device 200, in the same manner as the transmitter P1. The drone D2 may transmit an IP address reception response indicating that it has received the IP address of the transmitter P2 side to the information processing device 200, in the same manner as the drone D1.

[0050] In S104, the transmitter P1 starts transmitting a control signal to the Raspberry Pi 152 of the drone D1 using the communication module 54. For example, the transmitter P1 may use the IP address (Y １ .Y １ .Y １ .Y １ ) is written by the information processing device 200, the transmitter P1 starts transmitting a control signal to the Raspberry Pi 152 of the drone D1. The transmitter P1 may start transmitting a control signal to the Raspberry Pi 152 of the drone D1 in response to being instructed by the information processing device 200 to start transmitting a control signal to the drone D1. The drone D1 receives the control signal from the transmitter P1 via the cellular communication network using the communication module 154, and transfers the received control signal from the transmitter P1 to the Raspberry Pi 152. Here, the description will continue assuming that the control device 50 having the authority to control the drone D1 in remotely controlled flight mode is set to the transmitter P1.

[0051] Also, in S104, transmitter P2, like transmitter P1, begins sending control signals to the Raspberry Pi 152 of drone D2 using the communication module 54. Drone D2 receives the control signals from transmitter P2 via the cellular communication network using the communication module 154, and transfers the received control signals from transmitter P2 to the Raspberry Pi 152. Here, the explanation will continue assuming that transmitter P2 is set as the control device 50 with control authority for drone D2 in remotely controlled flight mode.

[0052] In S106, the Raspberry Pi 152 of drone D1 transfers the control signal of transmitter P1 to the FC of drone D1 because the flight mode of drone D1 is set to remote control flight mode and the control device 50 with control authority for drone D1 is set to transmitter P1. The FC of drone D1 starts flying drone D1 based on the control signal of transmitter P1 transferred by the Raspberry Pi 152.

[0053] Furthermore, in S106, the Raspberry Pi 152 of drone D2 sets the flight mode of drone D2 to remote control flight mode, and the control device 50 with control authority for drone D2 is set to transmitter P2, so the Raspberry Pi 152 transfers the control signal of transmitter P2 to the FC of drone D2. The FC of drone D2 starts flying drone D2 based on the control signal of transmitter P2 transferred by the Raspberry Pi 152.

[0054] 4, the information processing device 200 acquires a control authority switching instruction that instructs switching the control device 50 having control authority for drone D1 from transmitter P1 to transmitter P2. In S110, in response to acquiring the control authority switching instruction in S108, the information processing device 200 changes the flight mode of drone D2 stored in the Raspberry Pi 152 of drone D2 from remotely controlled flight mode to autonomous flight mode by transmitting a flight mode switching signal to drone D2 indicating that the flight mode of drone D2 should be switched from remotely controlled flight mode to autonomous flight mode.

[0055] In S112, the FC of drone D2 causes drone D2 to begin autonomous flight in response to the flight mode of drone D2 stored in the Raspberry Pi 152 of drone D2 being changed from remotely controlled flight mode to autonomous flight mode by the information processing device 200 in S110. In response to starting autonomous flight, drone D2 may use the communication module 154 to transmit a flight mode switching response to the information processing device 200 indicating that the flight mode of drone D2 has been switched from remotely controlled flight mode to autonomous flight mode. In response to receiving the flight mode switching response from drone D2, the information processing device 200 may instruct transmitter P2 to end transmission of control signals to drone D2. Transmitter P2 may end transmission of control signals to drone D2 in accordance with the instruction from the information processing device 200.

[0056] In S114, the information processing device 200 receives the IP address (Y １ .Y １ .Y １ .Y１ ) to the Raspberry Pi 52 mounted on the transmitter P2, and the IP address of the transmitter P2 (X ２ .X ２ .X ２ .X ２ ) to the Raspberry Pi 152 mounted on the drone D1, thereby establishing pairing between the transmitter P2 and the drone D1. The transmitter P2 then writes the IP address (Y １ .Y １ .Y １ .Y １ In response to the IP address (X ２ .X ２ .X ２ .X ２ ) is written by the information processing device 200, the communication module 154 may be used to transmit an IP address reception response to the information processing device 200 indicating that the IP address of the transmitter P2 side has been received.

[0057] In S116, the transmitter P2 starts transmitting a control signal to the Raspberry Pi 152 of the drone D1 using the communication module 54. For example, the transmitter P2 receives the IP address (Y １ .Y １ .Y １ .Y １ ) is written by the information processing device 200, the transmitter P2 starts transmitting a control signal to the Raspberry Pi 152 of the drone D1. The transmitter P2 may start transmitting a control signal to the Raspberry Pi 152 of the drone D1 in response to being instructed by the information processing device 200 to start transmitting a control signal to the drone D1. The drone D1 receives the control signal from the transmitter P2 via the cellular communication network using the communication module 154, and transfers the received control signal from the transmitter P2 to the Raspberry Pi 152.

[0058] In S118, the flight mode of drone D1 is set to remote control flight mode, and the control device 50 with control authority for drone D1 is set to transmitter P1, so the Raspberry Pi 152 of drone D1 transfers the control signal of transmitter P1 to the FC of drone D1, but does not transfer the control signal of transmitter P2 to the FC of drone D1. The FC of drone D1 controls the flight of drone D1 based on the control signal of transmitter P1 transferred by the Raspberry Pi 152.

[0059] 5 , the information processing device 200 changes the control device 50 with control authority for drone D1 stored in the Raspberry Pi 152 of drone D1 from transmitter P1 to transmitter P2 by transmitting a control authority switching signal to drone D1 indicating a switch from flight based on control signals transmitted by transmitter P1 to flight based on control signals transmitted by transmitter P2. In S122, in response to the change in the control device 50 with control authority for drone D1 from transmitter P1 to transmitter P2 by the information processing device 200 in S120, the Raspberry Pi 152 of drone D1 stops transferring the control signal for transmitter P1 to the FC of drone D1 and starts transferring the control signal for transmitter P2 to the FC of drone D1. The FC of drone D1 controls the flight of drone D1 based on the control signal for transmitter P2 transferred by the Raspberry Pi 152. This completes the control authority switching process by the information processing device 200, which switches the control device 50 with control authority for drone D1 from transmitter P1 to transmitter P2.

[0060] In response to starting flight based on the control signal transmitted by transmitter P2, drone D1 may use communication module 154 to transmit to information processing device 200 a control authority switching response indicating that the control device 50 having control authority for drone D1 has been switched from transmitter P1 to transmitter P2. In response to receiving the control authority switching response from drone D1, information processing device 200 may instruct transmitter P1 to end transmission of control signals to drone D1. Transmitter P1 may end transmission of control signals to drone D1 in accordance with the instruction from information processing device 200.

[0061] 4 may be changed to a process in which transmitter P2, which has the authority to control drone D2 in remotely controlled flight mode, directly transmits a flight mode switching signal to drone D2 indicating that the flight mode of drone D2 should be switched from remotely controlled flight mode to autonomous flight mode. This allows the flight mode of the drone to be switched without going through the information processing device 200. In this case, the information processing device 200 may switch the control device 50, which has the authority to control drone D1, from transmitter P1 to transmitter P2 as necessary.

[0062] Conventional systems that remotely control drones via a mobile communication network using a control device have adopted the configuration of systems that control drones via direct wireless communication between the control device and the drone. Therefore, when remotely controlling a drone using a conventional system, pairing between the control device and the drone must be set up in advance, and it is not possible to switch drone operators while the drone is flying.

[0063] On the other hand, when operating a drone using a control device, advanced piloting skills may be required of the drone pilot. In particular, when a drone is used for drone radio relay services to search for missing persons or for inspection services, the drone is relatively large, so more advanced piloting skills are required of the drone pilot. Furthermore, the difficulty of drone operation varies depending on the flight situation in which the drone is flown. Since drone piloting skills vary depending on the drone pilot, it is desirable to flexibly and efficiently switch drone pilots while the drone is in flight, allowing drone pilots with more advanced piloting skills to take over control of the drone in flight situations that are more difficult to operate.

[0064] According to the system 10 shown in FIGS. 3 to 5 , while the drone 100 is flying in remotely controlled flight mode, the information processing device 200 transmits the IP address of the drone 100 to the target control device 50 and then transmits the IP address of the target control device 50 to the drone 100, thereby establishing pairing between the target control device 50 and the drone 100, thereby switching the control device 50 with control authority for the drone 100. This allows a single drone 100 to be remotely controlled by switching the control device 50 with control authority for the drone 100 among multiple control devices 50, without constantly assigning multiple control devices 50 to the drone 100 while the drone 100 is flying. Therefore, the system 10 shown in FIGS. 3 to 5 allows the information processing device 200 to flexibly and efficiently switch the drone 100's operator while the drone 100 is flying, thereby enabling a drone operator with more advanced piloting skills to be responsible for piloting the drone in flight situations that require more difficult piloting.

[0065] 6 shows an example of the functional configuration of the information processing device 200. The information processing device 200 includes an information storage unit 202, an information receiving unit 204, an instruction acquisition unit 206, a first pairing unit 208, a response receiving unit 210, an instruction unit 212, a second pairing unit 214, a switching unit 216, a notification unit 217, and an information transmitting unit 218. Note that it is not essential that the information processing device 200 includes all of these components.

[0066] The information storage unit 202 stores various types of information. For example, the information storage unit 202 stores the IP address of the drone 100. For example, the information storage unit 202 stores the IP address of the control device 50.

[0067] The information storage unit 202 may store pairing relationship information indicating the pairing relationship between the control device 50 and the drone 100. The pairing relationship between the control device 50 and the drone 100 indicates, for example, that pairing between the control device 50 and the drone 100 has been established. The pairing relationship between the control device 50 and the drone 100 indicates, for example, that pairing between the control device 50 and the drone 100 has not been established.

[0068] The information receiving unit 204 receives various types of information related to the drone 100 from the drone 100. For example, the information receiving unit 204 periodically receives various types of information related to the drone 100. The information receiving unit 204 may store the received various types of information related to the drone 100 in the information storage unit 202.

[0069] The information receiving unit 204 receives, for example, telemetry information of the drone 100. The information receiving unit 204 may also receive captured images captured by the camera 120 mounted on the drone 100.

[0070] The instruction acquisition unit 206 acquires various instructions. The instruction acquisition unit 206 acquires various instructions by, for example, receiving various instructions from a communication terminal. The communication terminal is, for example, a communication terminal of a user who is operating the drone 100 on-site. The communication terminal is, for example, a communication terminal of a user who is remotely operating the drone 100. The communication terminal may be a communication terminal of a user of the information processing device 200. The instruction acquisition unit 206 may acquire various instructions by an input unit included in the information processing device 200 accepting input of various instructions. The instruction acquisition unit 206 may store the acquired various instructions in the information storage unit 202.

[0071] The instruction acquisition unit 206 acquires, for example, a pairing establishment instruction that instructs establishing pairing between the control device 50 and the drone 100. The instruction acquisition unit 206 acquires, for example, a flight mode setting instruction that instructs setting the flight mode of the drone 100. The instruction acquisition unit 206 acquires, for example, a flight mode switching instruction that instructs switching the flight mode of the drone 100. The instruction acquisition unit 206 acquires, for example, a control authority setting instruction that instructs setting the control device 50 that has control authority for the drone 100 to fly in the remotely controlled flight mode. The instruction acquisition unit 206 acquires, for example, a control authority switching instruction that instructs switching the control device 50 that has control authority for the drone 100 to fly in the remotely controlled flight mode.

[0072] The first pairing unit 208 establishes the first pairing between the first control device and the drone 100. The control device 50 may be an example of the first control device.

[0073] For example, in response to the instruction acquisition unit 206 acquiring a pairing establishment instruction, the first pairing unit 208 establishes the first pairing between the first control device and the drone 100. For example, the first pairing unit 208 establishes the first pairing between the first control device and the drone 100 by transmitting the IP address of the drone 100 stored in the information storage unit 202 to the first control device, and transmitting the IP address of the first control device stored in the information storage unit 202 to the drone 100.

[0074] The response receiving unit 210 receives various responses. For example, the response receiving unit 210 receives an IP address reception response indicating that the IP address of the drone 100 has been received from the control device 50. For example, the response receiving unit 210 receives an IP address reception response indicating that the IP address of the control device 50 has been received from the drone 100.

[0075] For example, the first pairing unit 208 determines that the first pairing between the first controller and the drone 100 has been established when the response receiving unit 210 receives IP address reception responses from both the first controller and the drone 100. The first pairing unit 208 may also determine that the first pairing between the first controller and the drone 100 has been established when a predetermined period has elapsed since the first controller and the drone 100 transmitted the IP addresses to each of them.

[0076] The instruction unit 212 instructs various operations. For example, the instruction unit 212 instructs various operations to the control device 50. For example, the instruction unit 212 instructs the first control device to start transmitting a control signal to the drone 100 in response to the first pairing unit 208 establishing the first pairing between the first control device and the drone 100.

[0077] The instruction unit 212, for example, instructs the drone 100 to perform various operations. For example, the instruction unit 212 instructs the drone 100 to set the flight mode of the drone 100 to the flight mode of the drone 100 indicated by the flight mode setting instruction acquired by the instruction acquisition unit 206. For example, the instruction unit 212 instructs the drone 100 to set the control device 50 having control authority for the drone 100 flying in the remotely controlled flight mode to the control device 50 indicated by the control authority setting instruction acquired by the instruction acquisition unit 206.

[0078] The second pairing unit 214 establishes a second pairing between a second control device different from the first control device and the drone 100. The control device 50 may be an example of the second control device.

[0079] For example, in response to the instruction acquisition unit 206 acquiring a control authority switching instruction instructing the control device 50 having control authority of the drone 100 to be switched from the first control device to the second control device, the second pairing unit 214 establishes the second pairing between the second control device and the drone 100. For example, while the drone 100 is flying, the second pairing unit 214 transmits the IP address of the drone 100 stored in the information storage unit 202 to the second control device, and transmits the IP address of the second control device stored in the information storage unit 202 to the drone 100, thereby establishing the second pairing between the second control device and the drone 100.

[0080] For example, the second pairing unit 214 determines that the second pairing between the second controller and the drone 100 has been established when the response receiving unit 210 receives IP address reception responses from both the second controller and the drone 100. The second pairing unit 214 may also determine that the second pairing between the second controller and the drone 100 has been established when a predetermined period of time has elapsed since the second pairing unit 214 transmitted the IP addresses to each of the second controller and the drone 100. The instruction unit 212 instructs the second controller to start transmitting a control signal to the drone 100 in response to the second pairing unit 214 establishing the second pairing between the second controller and the drone 100, for example.

[0081] The switching unit 216 executes various switching processes. For example, the switching unit 216 executes flight mode switching process for the drone 100. For example, the switching unit 216 executes flight mode switching process for the drone 100 by transmitting a flight mode switching signal to the drone 100 in response to the instruction acquisition unit 206 acquiring a flight mode switching command. For example, the switching unit 216 transmits the flight mode switching signal to the drone 100 while the drone 100 is flying.

[0082] The response receiving unit 210 receives, for example, a flight mode switching response from the drone 100. For example, when the instruction unit 212 receives a flight mode switching response indicating that the flight mode has been switched from the remotely controlled flight mode to another flight mode, the instruction unit 212 may instruct the control device 50 to end transmission of the control signal to the drone 100.

[0083] The switching unit 216, for example, executes a control authority switching process for the drone 100. For example, in response to the second pairing unit 214 establishing the second pairing between the second control device and the drone 100, the switching unit 216 switches the control device 50 having the control authority for the drone 100 from the first control device to the second control device by transmitting to the drone 100 a control authority switching signal indicating a switch from flight based on a control signal transmitted by the first control device to flight based on a control signal transmitted by the second control device.

[0084] The response receiving unit 210 may receive a control authority switching response from the drone 100. In response to receiving the control authority switching response from the drone 100, the instruction unit 212 may instruct the drone 100 before switching to end transmission of the control signal to the drone 100.

[0085] The notification unit 217 issues various notifications. For example, the notification unit 217 issues various notifications to the control device. The notification unit 217 may also issue various notifications to the communication terminal of the user of the control device.

[0086] The notification unit 217 issues various notifications using, for example, image data, text data, or audio data.

[0087] The notification unit 217 issues, for example, a control authority switching notification indicating that the control device 50 having the control authority for the drone 100 will be switched from the first control device to the second control device. The notification unit 217 issues, for example, the control authority switching notification before the switching unit 216 switches the control device 50 having the control authority for the drone 100 from the first control device to the second control device.

[0088] The notification unit 217 notifies, for example, the user of the first control device of the control authority switching notification. The notification unit 217 notifies, for example, the user of the second control device of the control authority switching notification.

[0089] The switching unit 216 may switch the control device 50 having the control authority for the drone 100 from the first control device to the second control device when the response receiving unit 210 receives a notification confirmation response indicating that the control authority switching notification has been confirmed from the second control device or the communication terminal of the user of the second control device. The switching unit 216 may switch the control device 50 having the control authority for the drone 100 from the first control device to the second control device when the response receiving unit 210 receives a notification confirmation response from the first control device or the communication terminal of the user of the first control device and the second control device or the communication terminal of the user of the second control device.

[0090] The information transmitting unit 218 transmits various pieces of information stored in the information storage unit 202. The information transmitting unit 218 transmits various pieces of information periodically, for example.

[0091] The information transmitting unit 218 transmits various information to, for example, a display, and may transmit various information to any other peripheral device of the display.

[0092] The information transmission unit 218 transmits the pairing relationship information, for example, to display the pairing relationship information on a display corresponding to the control device 50. The information transmission unit 218 transmits the pairing relationship information, for example, when the pairing relationship between the control device 50 and the drone 100 is updated.

[0093] The information transmission unit 218 transmits telemetry information of the drone 100, for example, to display the telemetry information on a display corresponding to a control device 50 that has established pairing with the drone 100. The information transmission unit 218 transmits telemetry information, for example, to display the telemetry information on a display corresponding to a control device 50 that is transmitting a control signal to the drone 100, among the control devices 50 that have established pairing with the drone 100.

[0094] The information transmission unit 218 may transmit a captured image captured by the camera 120 mounted on the drone 100 to a display corresponding to a control device 50 that has established pairing with the drone 100, so that the captured image is displayed on the display corresponding to the control device 50 that is transmitting a control signal to the drone 100, among the control devices 50 that have established pairing with the drone 100. The information transmission unit 218 may transmit a captured image captured by the camera 120 mounted on the drone 100 to a display corresponding to the control device 50 that is transmitting a control signal to the drone 100, so that the captured image is displayed on the display corresponding to the control device 50.

[0095] 7 to 9 are explanatory diagrams illustrating another example of the processing flow of the system 10. Here, the description will be given assuming that the starting state is one in which pairing between the transmitter and the drone has not been established, drone D1 is waiting on the ground in remotely controlled flight mode, and drone D2 is flying in locally controlled flight mode.

[0096] In S202 of FIG. 7, the information processing device 200 receives the IP address (Y １ .Y １ .Y １ .Y １ ) and the IP address of the drone D2 (Y ２ .Y ２ .Y ２ .Y ２ ) to the Raspberry Pi 52 mounted on the transmitter P1, and the IP address (X １ .X １ .X １ .X １ ) to the Raspberry Pi 152 mounted on the drone D1 and the Raspberry Pi 152 mounted on the drone D2, thereby establishing pairing between the transmitter P1 and the drone D1 and pairing between the transmitter P1 and the drone D2.

[0097] The transmitter P1 uses the IP address (Y １ .Y １ .Y １ .Y １ ) and the IP address of the drone D2 (Y ２ .Y ２ .Y ２ .Y２ ) written by the information processing device 200, the communication module 54 may be used to transmit to the information processing device 200 an IP address reception response indicating that the IP address of the drone D1 side and the IP address of the drone D2 side have been received. １ .X １ .X １ .X １ In response to the information processing device 200 writing the IP address, the communication module 154 may be used to transmit an IP address reception response to the information processing device 200 indicating that the IP address of the transmitter P1 has been received.

[0098] In S204, the transmitter P1 starts transmitting control signals to the Raspberry Pi 152 of the drone D1 and the Raspberry Pi 152 of the drone D2 using the communication module 54. For example, the transmitter P1 may use the IP address (Y １ .Y １ .Y １ .Y １ ) and the IP address of the drone D2 (Y ２ .Y ２ .Y ２ .Y ２ ) is written by the information processing device 200, the transmitter P1 starts transmitting control signals to the Raspberry Pi 152 of the drone D1 and the Raspberry Pi 152 of the drone D2. The transmitter P1 may start transmitting control signals to the Raspberry Pi 152 of the drone D1 and the Raspberry Pi 152 of the drone D2 in response to being instructed by the information processing device 200 to start transmitting control signals to the drones D1 and D2.

[0099] Drone D1 receives control signals from transmitter P1 via the cellular communication network using communication module 154 and transfers the received control signals from transmitter P1 to Raspberry Pi 152. Here, the explanation will continue assuming that transmitter P1 is set as the control device 50 with control authority for drone D1 in remotely controlled flight mode. Drone D2 also receives control signals from transmitter P1 via the cellular communication network using communication module 154 and transfers the received control signals from transmitter P2 to Raspberry Pi 152.

[0100] In S206, the Raspberry Pi 152 of drone D1 transfers the control signal of transmitter P1 to the FC of drone D1 because the flight mode of drone D1 is set to remote control flight mode and the control device 50 with control authority for drone D1 is set to transmitter P1. The FC of drone D1 starts flying drone D1 based on the control signal of transmitter P1 transferred by the Raspberry Pi 152.

[0101] In addition, in S206, the Raspberry Pi 152 of drone D2 does not transfer the control signal of the transmitter P1 to the FC of drone D2 because the flight mode of drone D2 is set to local control flight mode. The FC of drone D2 controls the flight of drone D2 based on the control signal received directly from the local transmitter via wireless communication.

[0102] 8, the information processing device 200 acquires a control object switching instruction that instructs the transmitter P1 to switch the control object from the drone D1 to the drone D2. In S210, in response to acquiring the control object switching instruction in S208, the information processing device 200 acquires the IP address (Y １ .Y １ .Y １ .Y １ ) to the Raspberry Pi 52 mounted on the transmitter P3, and the IP address of the transmitter P3 (X ３ .X ３ .X ３ .X ３ ) to the Raspberry Pi 152 mounted on the drone D1, thereby establishing pairing between the transmitter P3 and the drone D1.

[0103] In S212, transmitter P3 begins transmitting control signals to the Raspberry Pi 152 of drone D1 using the communication module 54. Drone D1 receives the control signals from transmitter P3 via the cellular communication network using the communication module 154, and transfers the received control signals from transmitter P3 to the Raspberry Pi 152.

[0104] In S214, the flight mode of drone D1 is set to remote control flight mode, and the control device 50 with control authority for drone D1 is set to transmitter P1, so the Raspberry Pi 152 of drone D1 transfers the control signal of transmitter P1 to the FC of drone D1, but does not transfer the control signal of transmitter P3 to the FC of drone D1. The FC of drone D1 controls the flight of drone D1 based on the control signal of transmitter P1 transferred by the Raspberry Pi 152.

[0105] 9 , the information processing device 200 changes the control device 50 with control authority for drone D1 stored in the Raspberry Pi 152 of drone D1 from transmitter P1 to transmitter P3 by transmitting a control authority switching signal to drone D1, the control device 50 including transmitter P1 and transmitter P3, to the control device 50. In S218, in response to the change in the control device 50 with control authority for drone D1 from transmitter P1 to transmitter P3 by the information processing device 200 in S216, the Raspberry Pi 152 of drone D1 stops transferring the control signal for transmitter P1 to the FC of drone D1 and starts transferring the control signal for transmitter P3 to the FC of drone D1. The FC of drone D1 controls the flight of drone D1 based on the control signal for transmitter P3 transferred by the Raspberry Pi 152. This completes the control object switching process by the information processing device 200, which switches the control object of the transmitter P1 from drone D1 to drone D2.

[0106] At S220, the information processing device 200 changes the flight mode of drone D2 stored in the Raspberry Pi 152 of drone D2 from the local control flight mode to the remote control flight mode by transmitting a flight mode switching signal to drone D2 indicating that the flight mode of drone D2 should be switched from the local control flight mode to the remote control flight mode. The flight mode switching signal includes, for example, a start signal indicating the start of flight based on the control signal transmitted by transmitter P1. In this case, the information processing device 200 writes to the Raspberry Pi 152 of drone D2 that the control device 50 having the authority to control drone D2 is transmitter P1.

[0107] In S222, the Raspberry Pi 152 of drone D2 transfers the control signal of transmitter P1 to the FC of drone D2 because the flight mode of drone D2 is set to remotely controlled flight mode and the control device 50 with control authority for drone D2 is set to transmitter P1. The FC of drone D2 controls the flight of drone D2 based on the control signal of transmitter P1 transferred by the Raspberry Pi 152. This completes the flight mode switching process by the information processing device 200 to switch the flight mode of drone D2 from locally controlled flight mode to remotely controlled flight mode.

[0108] In response to starting flight based on the control signal transmitted by transmitter P3, drone D1 may use the communication module 154 to transmit to the information processing device 200 a control authority switching response indicating that the control device 50 having control authority for drone D1 has been switched from transmitter P1 to transmitter P3. In response to starting flight based on the control signal transmitted by transmitter P1, drone D2 may use the communication module 154 to transmit to the information processing device 200 a flight mode switching response indicating that the flight mode of drone D2 has been switched from the local control flight mode to the remote control flight mode.

[0109] The information processing device 200 may instruct the transmitter P1 to end transmission of the control signal to the drone D1 in response to receiving the control authority switching response from the drone D1 and receiving the flight mode switching response from the drone D2. The transmitter P1 may end transmission of the control signal to the drone D1 in accordance with the instruction from the information processing device 200.

[0110] 7 to 9 , the information processing device 200, while the target drone 100 is flying, transmits an end signal to the drone 100 currently controlled by the controller 50, indicating that flight based on the control signals transmitted by the controller 50 will end, and transmits a start signal to the target drone 100, indicating that flight based on the control signals transmitted by the controller 50 will begin, thereby switching the target drone 100 controlled by the controller 50 from the drone 100 currently controlled by the controller 50 to the target drone 100. In response to the controller 50 switching the target drone 100 to the target drone 100, the drone 100 that is no longer the target drone 100 controlled by the controller 50 may fly in any one of the following flight modes: autonomous flight mode, local control flight mode, and remote control flight mode. This allows remote control of multiple drones 100 using a single controller 50 by switching the target drone 100 controlled by the single controller 50 among the multiple drones 100, without constantly assigning multiple controllers 50 to the drones 100 while the drones 100 are flying. Therefore, the system 10 shown in Figures 7 to 9 allows the information processing device 200 to flexibly and efficiently switch the operator of the drone 100 while the drone 100 is flying, making it possible to have a drone operator with more advanced piloting skills take over the piloting of the drone in flight situations that are more difficult to pilot.

[0111] 10 schematically illustrates another example of the functional configuration of the information processing device 200. The information processing device 200 includes an information storage unit 202, an information receiving unit 204, an instruction acquisition unit 206, a pairing unit 209, a response receiving unit 210, an instruction unit 212, a switching unit 216, a notification unit 217, and an information transmitting unit 218. Note that it is not essential for the information processing device 200 to include all of these components. Here, differences between the example of the information processing device 200 illustrated in FIG. 10 and the example of the information processing device 200 illustrated in FIG. 6 will be mainly described.

[0112] The pairing unit 209 establishes a first pairing between the control device 50 and the first drone and a second pairing between the control device 50 and the second drone. The drone 100 may be an example of the first drone. The drone 100 may be an example of the second drone.

[0113] The pairing unit 209 establishes a first pairing between the control device 50 and the first drone and a second pairing between the control device 50 and the second drone, for example, by transmitting the IP address of the first drone and the IP address of the second drone stored in the information storage unit 202 to the control device, and by transmitting the IP address of the control device 50 stored in the information storage unit 202 to the first drone and the second drone. The instruction unit 212 instructs the control device 50 to start transmitting control signals to the first drone and the second drone, for example, in response to the pairing unit 209 establishing the first pairing between the control device 50 and the first drone and the second pairing between the control device 50 and the second drone, respectively.

[0114] The instruction acquisition unit 206 acquires, for example, a control object switching instruction instructing the control device 50 to switch the control object from the first drone to the second drone. The switching unit 216 switches the control object of the control device 50 from the first drone to the second drone in response to the instruction acquisition unit 206 acquiring the control object switching instruction. The switching unit 216 switches the control object of the control device 50 from the first drone to the second drone, for example, by transmitting, while the second drone is flying, an end signal indicating an end of flight based on the control signal transmitted by the control device 50 to the first drone, and transmitting a start signal indicating a start of flight based on the control signal transmitted by the control device 50 to the second drone. The switching unit 216 may switch the control object of the control device 50 from the first drone to the second drone by transmitting the control object switching instruction acquired by the instruction acquisition unit 206 to the control device 50.

[0115] For example, the notification unit 217 issues a control object switching notification indicating that the control object of the control device 50 will be switched from the first drone to the second drone. For example, the notification unit 217 issues the control object switching notification before the switching unit 216 switches the control object of the control device 50 from the first drone to the second drone. For example, the notification unit 217 notifies the user of the control device 50 of the control object switching notification. When the response receiving unit 210 receives a notification confirmation response indicating that the control object switching notification has been confirmed from the control device 50 or the communication terminal of the user of the control device 50, the switching unit 216 may switch the control object of the control device 50 from the first drone to the second drone.

[0116] 11 is a schematic diagram illustrating an example of a pairing group. The example pairing group illustrated in FIG. 11 is composed of M drones (M≧2) and N control devices (N≧2). Note that M may be a number greater than N, M may be the same as N, or M may be a number smaller than N.

[0117] 12 and 13 are explanatory diagrams illustrating another example of the processing flow of the system 10. Here, the description will be given assuming that the starting state is a state in which pairing between the transmitter and the drone has not been established and drones D1 and D2 are waiting on the ground in remotely controlled flight mode. Note that the information processing device 200 is assumed to store pairing group information indicating a pairing group consisting of drones D1 and D2, and transmitters P1 and P2.

[0118] In S302 of FIG. 12, the information processing device 200 determines the IP address (Y １ .Y １ .Y １ .Y １ ) and the IP address of the drone D2 (Y ２ .Y ２ .Y ２ .Y ２ ) is written to the Raspberry Pi 52 mounted on the transmitter P1 and the Raspberry Pi 52 mounted on the transmitter P2, and the IP address (X １ .X １ .X １ .X １ ) and the IP address of the transmitter P2 (X ２ .X ２ .X ２ .X ２ ) to the Raspberry Pi 152 mounted on the drone D1 and the Raspberry Pi 152 mounted on the drone D2, thereby establishing pairing between the transmitter P1 and the drone D1, pairing between the transmitter P1 and the drone D2, pairing between the transmitter P2 and the drone D1, and pairing between the transmitter P2 and the drone D2.

[0119] In S304, transmitter P1 begins transmitting control signals to the Raspberry Pi 152 of drone D1 and to the Raspberry Pi 152 of drone D2 using the communication module 54. Also in S304, transmitter P2 begins transmitting control signals to the Raspberry Pi 152 of drone D1 and to the Raspberry Pi 152 of drone D2 using the communication module 54.

[0120] Drone D1 receives control signals from transmitter P1 and transmitter P2 via the cellular communication network using communication module 154, and transfers the received control signals from transmitter P1 and transmitter P2 to Raspberry Pi 152. Here, we will continue the explanation assuming that transmitter P1 is set as the control device 50 with the authority to control drone D1 in remotely controlled flight mode.

[0121] Drone D2 receives control signals from transmitter P1 and transmitter P2 via the cellular communication network using communication module 154, and transfers the received control signals from transmitter P1 and transmitter P2 to Raspberry Pi 152. Here, we will continue the explanation assuming that transmitter P2 is set as the control device 50 with the authority to control drone D2 in remotely controlled flight mode.

[0122] In S306, the Raspberry Pi 152 of drone D1 sets the flight mode of drone D1 to remote control flight mode and the control device 50 with control authority for drone D1 is set to transmitter P1, so it transfers the control signal of transmitter P1 to the FC of drone D1 but does not transfer the control signal of transmitter P2 to the FC of drone D1. The FC of drone D1 starts flying drone D1 based on the control signal of transmitter P1 transferred by the Raspberry Pi 152.

[0123] Furthermore, in S306, the Raspberry Pi 152 of drone D2 sets the flight mode of drone D2 to remote control flight mode and the control device 50 with control authority for drone D2 is set to transmitter P2, so it transfers the control signal of transmitter P2 to the FC of drone D2 but does not transfer the control signal of transmitter P1 to the FC of drone D2. The FC of drone D2 starts flying drone D2 based on the control signal of transmitter P2 transferred by the Raspberry Pi 152.

[0124] 13 , the information processing device 200 acquires a control authority switching instruction to switch the control device 50 with control authority for drone D1 from transmitter P1 to transmitter P2, and to switch the control device 50 with control authority for drone D2 from transmitter P2 to transmitter P1. In S310, the information processing device 200 changes the control device 50 with control authority for drone D1 stored in the Raspberry Pi 152 of drone D1 from transmitter P1 to transmitter P2 by transmitting a control authority switching signal to drone D1 indicating a switch from flight based on control signals transmitted by transmitter P1 to flight based on control signals transmitted by transmitter P2. Also in S310, the information processing device 200 changes the control device 50 with control authority for drone D2 stored in the Raspberry Pi 152 of drone D2 from transmitter P2 to transmitter P1 by transmitting a control authority switching signal to drone D2 indicating a switch from flight based on control signals transmitted by transmitter P2 to flight based on control signals transmitted by transmitter P1.

[0125] In S312, in response to the control device 50 having control authority for drone D1 being changed from transmitter P1 to transmitter P2 by the information processing device 200 in S310, the Raspberry Pi 152 of drone D1 stops transferring the control signal of transmitter P1 to the FC of drone D1 and starts transferring the control signal of transmitter P2 to the FC of drone D1. The FC of drone D1 controls the flight of drone D1 based on the control signal of transmitter P2 transferred by the Raspberry Pi 152. This completes the control authority switching process by the information processing device 200, which switches the control device 50 having control authority for drone D1 from transmitter P1 to transmitter P2.

[0126] Furthermore, in S312, in response to the control device 50 having control authority for drone D2 being changed from transmitter P2 to transmitter P1 by the information processing device 200 in S310, the Raspberry Pi 152 of drone D2 stops transferring the control signal of transmitter P2 to the FC of drone D2 and starts transferring the control signal of transmitter P1 to the FC of drone D2. The FC of drone D2 controls the flight of drone D2 based on the control signal of transmitter P1 transferred by the Raspberry Pi 152. This completes the control authority switching process by the information processing device 200, which switches the control device 50 having control authority for drone D2 from transmitter P2 to transmitter P1.

[0127] 12 and 13 , the information processing device 200 establishes a plurality of pairings between each of a plurality of control devices 50 and each of a plurality of drones 100 based on the pairing group information. The control device 50 transmits a control signal to each of the plurality of drones 100 with which the pairing has been established. After that, in response to receiving a control authority switching instruction instructing the information processing device 200 to switch the control device 50 having control authority for the drones 100 belonging to the pairing group indicated by the pairing group information from a first control device belonging to the pairing group to a second control device belonging to the pairing group, the information processing device 200 switches the control device 50 having control authority for the drone 100 from the first control device to the second control device while the drone 100 is flying. 12 and 13, the information processing device 200 establishes a plurality of pairings between each of the plurality of control devices 50 and each of the plurality of drones 100 based on the pairing group information, and the control device 50 transmits a control signal to each of the plurality of drones 100 with which it has established pairings, thereby enabling the control device 50 having control authority for the drone 100 to be safely switched from the first control device to the second control device. Furthermore, the system 10 shown in FIGS. 12 and 13 can switch the control device 50 having control authority for the drone 100 simply by transmitting a control authority switching signal to the drone 100, thereby enabling the control device 50 having control authority for the drone 100 to be switched with a smaller processing load on the information processing device 200.

[0128] Fig. 14 schematically shows another example of the functional configuration of the information processing device 200. The information processing device 200 includes an information storage unit 202, an information receiving unit 204, an instruction acquisition unit 206, a pairing unit 209, a response receiving unit 210, an instruction unit 212, a switching unit 216, a notification unit 217, and an information transmitting unit 218. Note that it is not essential that the information processing device 200 includes all of these components. Here, differences between the example of the information processing device 200 shown in Fig. 14 and the example of the information processing device 200 shown in Fig. 6 and the example of the information processing device 200 shown in Fig. 10 will be mainly described.

[0129] The information storage unit 202 stores, for example, pairing group information indicating a pairing group configured of a plurality of drones 100 and a plurality of control devices 50. The pairing unit 209, for example, establishes a plurality of pairings between each of the plurality of control devices 50 and each of the plurality of drones 100. The pairing unit 209, for example, transmits the IP addresses of each of the plurality of drones 100 stored in the information storage unit 202 to each of the plurality of control devices 50 based on the pairing group information stored in the information storage unit 202, and transmits the IP addresses of each of the plurality of control devices 50 stored in the information storage unit 202 to each of the plurality of drones 100, thereby establishing a plurality of pairings between each of the plurality of control devices 50 and each of the plurality of drones 100.

[0130] The instruction acquisition unit 206 acquires, for example, a control authority switching instruction instructing the control device 50 having control authority for the drone 100 belonging to the pairing group indicated by the pairing group information stored in the information storage unit 202 to be switched from a first control device belonging to the pairing group to a second control device belonging to the pairing group. In response to the instruction acquisition unit 206 acquiring the control authority switching instruction, the switching unit 216 switches the control device 50 having control authority for the drone 100 from the first control device to the second control device by transmitting a control authority switching signal to the drone 100 while the drone 100 is flying, indicating that the control device 50 will switch from the first control device to the second control device.

[0131] 15 to 19 are explanatory diagrams illustrating another example of the processing flow of the system 10. Here, the description will be given assuming that the starting state is a state in which pairing between the transmitter and the drone has not been established and drones D1 and D2 are waiting on the ground in remotely controlled flight mode. Note that the information processing device 200 is assumed to store pairing group information indicating a pairing group consisting of drones D1 and D2, and transmitters P1 and P2.

[0132] In S402 of FIG. 15, the information processing device 200 determines the IP address (Y １ .Y １ .Y １ .Y １ ) and the IP address of the drone D2 (Y ２ .Y ２ .Y ２ .Y ２ ) is written to the Raspberry Pi 52 mounted on the transmitter P1 and the Raspberry Pi 52 mounted on the transmitter P2, and the IP address (X １ .X １ .X １ .X １ ) and the IP address of the transmitter P2 (X ２ .X ２ .X ２ .X ２ ) to the Raspberry Pi 152 mounted on drone D1 and the Raspberry Pi 152 mounted on drone D2, thereby establishing pairing between transmitter P1 and drone D1, pairing between transmitter P1 and drone D2, pairing between transmitter P2 and drone D1, and pairing between transmitter P2 and drone D2. Here, the explanation will continue assuming that the control target of transmitter P1 is set to drone D1 and the control target of transmitter P2 is set to drone D2.

[0133] 16, the control target of transmitter P1 is set to drone D1, so the information processing device 200 instructs transmitter P1 to start transmitting control signals to drone D1. Also, in S404, the control target of transmitter P2 is set to drone D2, so the information processing device 200 instructs transmitter P2 to start transmitting control signals to drone D2.

[0134] In S406, transmitter P1 begins transmitting control signals to drone D1's Raspberry Pi 152 in accordance with the instructions from information processing device 200 in S404. Drone D1 receives the control signals from transmitter P1 via the cellular communication network using communication module 154, and transfers the received control signals from transmitter P1 to Raspberry Pi 152. Here, the explanation will continue assuming that transmitter P1 is set as the control device 50 that has the authority to control drone D1 in remotely controlled flight mode.

[0135] Also, in S406, transmitter P2 begins transmitting control signals to drone D2's Raspberry Pi 152 in accordance with the instructions from information processing device 200 in S404. Drone D2 receives the control signals from transmitter P2 via the cellular communication network using communication module 154, and transfers the received control signals from transmitter P2 to Raspberry Pi 152. Here, the explanation will continue assuming that transmitter P2 is set as the control device 50 that has the authority to control drone D2 in remotely controlled flight mode.

[0136] In S408, the Raspberry Pi 152 of drone D1 transfers the control signal of transmitter P1 to the FC of drone D1 because the flight mode of drone D1 is set to remote control flight mode and the control device 50 with control authority for drone D1 is set to transmitter P1. The FC of drone D1 starts flying drone D1 based on the control signal of transmitter P1 transferred by the Raspberry Pi 152.

[0137] Also, in S408, the Raspberry Pi 152 of drone D2 sets the flight mode of drone D2 to remote control flight mode and the control device 50 with control authority for drone D2 is set to transmitter P2, so the Raspberry Pi 152 transfers the control signal of transmitter P2 to the FC of drone D2. The FC of drone D2 starts flying drone D2 based on the control signal of transmitter P2 transferred by the Raspberry Pi 152.

[0138] 17 , the information processing device 200 acquires a control object switching instruction that switches the control object of transmitter P1 from drone D1 to drone D2, and switches the control object of transmitter P2 from drone D2 to drone D1. In S412, in response to acquiring the control object switching instruction in S410, the information processing device 200 instructs transmitter P1 to start transmitting a control signal to drone D2. Also, in S412, in response to acquiring the control object switching instruction in S410, the information processing device 200 instructs transmitter P2 to start transmitting a control signal to drone D1.

[0139] In S414, in accordance with the instruction from the information processing device 200 in S412, transmitter P1 begins transmitting control signals to the Raspberry Pi 152 of drone D1, as well as to the Raspberry Pi 152 of drone D2. Drone D2 receives the control signals of transmitter P1 via the cellular communication network using the communication module 154, and transfers the received control signals of transmitter P1 to the Raspberry Pi 152.

[0140] Furthermore, in S414, in accordance with the instruction from the information processing device 200 in S412, transmitter P2 begins transmitting control signals to the Raspberry Pi 152 of drone D2, as well as to the Raspberry Pi 152 of drone D1. Drone D1 receives the control signals from transmitter P2 via the cellular communication network using the communication module 154, and transfers the received control signals from transmitter P2 to the Raspberry Pi 152.

[0141] In S416, the flight mode of drone D1 is set to remote control flight mode and the control device 50 with control authority for drone D1 is set to transmitter P1, so the Raspberry Pi 152 of drone D1 transfers the control signal of transmitter P1 to the FC of drone D1 but does not transfer the control signal of transmitter P2 to the FC of drone D1. Also, in S416, the flight mode of drone D2 is set to remote control flight mode and the control device 50 with control authority for drone D2 is set to transmitter P1, so the Raspberry Pi 152 of drone D2 transfers the control signal of transmitter P2 to the FC of drone D2 but does not transfer the control signal of transmitter P1 to the FC of drone D2.

[0142] 18 , the information processing device 200 changes the control device 50 with control authority for drone D1 stored in the Raspberry Pi 152 of drone D1 from transmitter P1 to transmitter P2 by transmitting to drone D1 a control authority switching signal including an end signal indicating the end of flight based on the control signals transmitted by transmitter P1 and a start signal indicating the start of flight based on the control signals transmitted by transmitter P2. Also, in S418, the information processing device 200 changes the control device 50 with control authority for drone D2 stored in the Raspberry Pi 152 of drone D2 from transmitter P2 to transmitter P1 by transmitting to drone D2 a control authority switching signal including an end signal indicating the end of flight based on the control signals transmitted by transmitter P2 and a start signal indicating the start of flight based on the control signals transmitted by transmitter P1.

[0143] At S420, in response to the control device 50 having the control authority for drone D1 being changed from transmitter P1 to transmitter P2 by the information processing device 200 at S418, the Raspberry Pi 152 of drone D1 stops transferring the control signal of transmitter P1 to the FC of drone D1 and starts transferring the control signal of transmitter P2 to the FC of drone D1. The FC of drone D1 controls the flight of drone D1 based on the control signal of transmitter P2 transferred by the Raspberry Pi 152. This completes the control target switching process by the information processing device 200, which switches the control target of transmitter P1 from drone D1 to drone D2.

[0144] Furthermore, in S420, in response to the control device 50 having the control authority for drone D2 being changed from transmitter P2 to transmitter P1 by the information processing device 200 in S418, the Raspberry Pi 152 of drone D2 stops transferring the control signal of transmitter P2 to the FC of drone D2 and starts transferring the control signal of transmitter P1 to the FC of drone D2. The FC of drone D2 controls the flight of drone D2 based on the control signal of transmitter P1 transferred by the Raspberry Pi 152. This completes the control target switching process by the information processing device 200, which switches the control target of transmitter P2 from drone D2 to drone D1.

[0145] 19, in response to the completion of switching from drone D1 to drone D2 as the control target of transmitter P1 in S420, the information processing device 200 instructs transmitter P1 to end transmission of control signals to drone D1. Also, in S422, in response to the completion of switching from drone D2 to drone D1 as the control target of transmitter P2 in S420, the information processing device 200 instructs transmitter P2 to end transmission of control signals to drone D2.

[0146] In S424, transmitter P1, in accordance with the instruction from the information processing device 200 in S422, ends the transmission of the control signal to drone D1's Raspberry Pi 152. Also in S424, transmitter P2, in accordance with the instruction from the information processing device 200 in S422, ends the transmission of the control signal to drone D2's Raspberry Pi 152.

[0147] According to the system 10 shown in FIGS. 15 to 19 , the information processing device 200 establishes a plurality of pairings between each of a plurality of control devices 50 and each of a plurality of drones 100 based on the pairing group information. Furthermore, the information processing device 200 instructs the control device 50 to start transmitting control signals to a first drone that belongs to the pairing group indicated by the pairing group information and is the control target of the control device 50 that belongs to the pairing group. The control device 50 starts transmitting control signals to the first drone in accordance with the instruction from the information processing device 200. As a result, the control device 50 begins transmitting control signals to the first drone. Next, in response to receiving a control target switching instruction instructing the control device 50 to switch the control target of the control device 50 from the first control device to a second control device that belongs to the pairing group, the information processing device 200 instructs the control device 50 to start transmitting control signals to the second drone. The control device 50 starts transmitting control signals to the second drone in accordance with the instruction from the information processing device 200. As a result, the control device 50 begins transmitting control signals to the first drone and the second drone. Thereafter, while the second drone is flying, the information processing device 200 switches the control target of the control device 50 from the first drone to the second drone. Furthermore, upon completion of the switching of the control target of the control device 50, the information processing device 200 instructs the control device 50 to end transmission of control signals to the first drone. The control device 50 stops transmitting control signals to the first drone in accordance with the instruction from the information processing device 200. As a result, the control device 50 begins transmitting control signals only to the second drone. Therefore, in the system 10 shown in FIGS. 15 to 19, the information processing device 200 causes the control device 50 to transmit control signals to both the drone 100 currently being controlled and the drone 100 to be switched to only when the control target of the control device 50 is switched, thereby suppressing the transmission of unnecessary control signals that are not forwarded to the FC of the drone 100 and enabling the control target of the control device 50 to be switched from the first drone to the second drone using fewer communication resources.

[0148] Fig. 20 schematically illustrates another example of the functional configuration of the information processing device 200. The information processing device 200 includes an information storage unit 202, an information receiving unit 204, an instruction acquisition unit 206, a pairing unit 209, a response receiving unit 210, a first instruction unit 211, a second instruction unit 213, a switching unit 216, a notification unit 217, and an information transmitting unit 218. Note that it is not essential that the information processing device 200 includes all of these components. Here, differences between the example of the information processing device 200 illustrated in Fig. 20 and the example of the information processing device 200 illustrated in Fig. 6, the example of the information processing device 200 illustrated in Fig. 10, and the example of the information processing device 200 illustrated in Fig. 14 will be mainly described.

[0149] The first instruction unit 211 instructs the control device 50 to start transmitting a control signal to a first drone that belongs to a pairing group and is the control target of the control device 50 that belongs to the pairing group indicated by the pairing group information stored in the information storage unit 202. For example, the first instruction unit 211 instructs the control device 50 to start transmitting a control signal to the first drone in response to the pairing unit 209 establishing pairing between the control device 50 and the first drone.

[0150] The instruction acquisition unit 206 acquires, for example, a control object switching instruction to switch the control object of the control device 50 from the first drone to a second drone belonging to the pairing group. In response to the instruction acquisition unit 206 acquiring the control object switching instruction, the second instruction unit 213 instructs the control device 50 to start transmitting a control signal to the second drone.

[0151] For example, in response to the second instruction unit 213 instructing the control device 50 to start transmitting control signals to the second drone, the switching unit 216 switches the control target of the control device 50 from the first drone to the second drone by transmitting, while the second drone is flying, an end signal indicating an end of flight based on the control signals transmitted by the control device 50 to the first drone, and transmitting a start signal indicating a start of flight based on the control signals transmitted by the control device 50 to the second drone. In response to the switching unit 216 completing the switching of the control target of the control device 50, the first instruction unit 211 may instruct the control device 50 to end transmission of control signals to the first drone.

[0152] 21 schematically illustrates an example of the hardware configuration of a computer 1200 functioning as the information processing device 200. A program installed on the computer 1200 can cause the computer 1200 to function as one or more "parts" of the device according to the above embodiment, or can cause the computer 1200 to execute operations associated with the device according to the above embodiment or one or more "parts," and / or can cause the computer 1200 to execute a process or steps of the process according to the above embodiment. Such a program can be executed by the CPU 1212 to cause the computer 1200 to perform specific operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

[0153] The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphics controller 1216, which are interconnected by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224, a DVD drive 1226, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The DVD drive 1226 may be a DVD-ROM drive, a DVD-RAM drive, or the like. The storage device 1224 may be a hard disk drive, a solid-state drive, or the like. The computer 1200 also includes legacy input / output units such as a ROM 1230 and a keyboard 1242, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0154] The CPU 1212 operates according to programs stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphics controller 1216 acquires image data generated by the CPU 1212 into a frame buffer or the like provided in the RAM 1214 or into the graphics controller 1216 itself, and causes the image data to be displayed on the display device 1218.

[0155] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD drive 1226 reads programs or data from a DVD-ROM 1227 or the like and provides them to the storage device 1224. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0156] The ROM 1230 stores therein a boot program or the like that is executed by the computer 1200 upon activation, and / or programs that depend on the hardware of the computer 1200. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a USB port, a parallel port, a serial port, a keyboard port, a mouse port, etc.

[0157] The programs are provided by a computer-readable storage medium such as a DVD-ROM 1227 or an IC card. The programs are read from the computer-readable storage medium, installed in the storage device 1224, RAM 1214, or ROM 1230, which are also examples of computer-readable storage media, and executed by the CPU 1212. Information processing described in these programs is read by the computer 1200, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or a method may be configured by implementing operations or processing of information in accordance with the use of the computer 1200.

[0158] For example, when communication is performed between computer 1200 and an external device, CPU 1212 may execute a communication program loaded into RAM 1214 and instruct communication interface 1222 to perform communication processing based on the processing described in the communication program. Under the control of CPU 1212, communication interface 1222 reads transmission data stored in a transmission buffer area provided in RAM 1214, storage device 1224, DVD-ROM 1227, or a recording medium such as an IC card, and transmits the read transmission data to a network, or writes received data received from the network to a reception buffer area or the like provided on the recording medium.

[0159] Furthermore, the CPU 1212 may cause all or a necessary portion of a file or database stored in an external recording medium such as the storage device 1224, the DVD drive 1226 (DVD-ROM 1227), an IC card, etc. to be read into the RAM 1214, and may perform various types of processing on the data on the RAM 1214. The CPU 1212 may then write back the processed data to the external recording medium.

[0160] Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and may undergo information processing. The CPU 1212 may perform various types of processing on data read from the RAM 1214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequences of the programs, and write the results back to the RAM 1214. The CPU 1212 may also search for information in a file, database, etc. on the recording medium. For example, if multiple entries, each having an attribute value of a first attribute associated with an attribute value of a second attribute, are stored on the recording medium, the CPU 1212 may search for an entry whose attribute value of the first attribute matches a specified condition from among the multiple entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0161] The above-described programs or software modules may be stored in a computer-readable storage medium on or near the computer 1200. A recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can also be used as a computer-readable storage medium, thereby providing the programs to the computer 1200 via the network.

[0162] The blocks in the flowcharts and block diagrams in the present embodiments may represent stages of a process in which an operation is performed or "parts" of a device responsible for performing the operation. Particular stages and "parts" may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable storage medium, and / or a processor provided with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuitry may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. The programmable circuitry may include reconfigurable hardware circuits, such as field programmable gate arrays (FPGAs) and programmable logic arrays (PLAs), including AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, and memory elements.

[0163] A computer-readable storage medium may include any tangible device capable of storing instructions that are executed by an appropriate device, such that a computer-readable storage medium having instructions stored thereon comprises an article of manufacture, including instructions that can be executed to create means for performing the operations specified in the flowcharts or block diagrams. Examples of computer-readable storage media may include electronic, magnetic, optical, electromagnetic, and semiconductor storage media. More specific examples of computer-readable storage media may include floppy disks, diskettes, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), electrically erasable programmable read-only memories (EEPROMs), static random access memories (SRAMs), compact disc read-only memories (CD-ROMs), digital versatile discs (DVDs), Blu-ray discs, memory sticks, integrated circuit cards, and the like.

[0164] The computer readable instructions may include either assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state-setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages ​​such as the “C” programming language or similar programming languages.

[0165] Computer-readable instructions may be provided locally or over a local area network (LAN), a wide area network (WAN) such as the Internet, to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, or programmable circuitry, such that the processor or programmable circuitry executes the computer-readable instructions to generate means for performing the operations specified in the flowcharts or block diagrams. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

[0166] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the claims that such modifications and improvements can also be included within the technical scope of the present invention.

[0167] It should be noted that the execution order of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before," "prior to," etc., and that the processes can be performed in any order unless the output of a previous process is used in a subsequent process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, this does not mean that the processes must be performed in this order.

[0168] 10 System, 20 Network, 42 ​​Base Station, 44 Base Station, 50 Control Device, 52 Raspberry Pi, 54 Communication Module, 55 User, 57 User, 60 Control Device, 65 User, 67 User, 85 Display, 87 Display, 100 Drone, 120 Camera, 150 Control Device, 152 Raspberry Pi, 154 Communication Module, 200 Information Processing Device, 202 Information Storage Unit, 204 Information Receiving Unit, 206 Instruction Acquisition Unit, 208 First Pairing Unit, 209 Pairing Unit, 210 Response Receiving Unit, 211 First Instruction Unit, 212 Instruction Unit, 213 Second Instruction Unit, 214 Second Pairing Unit, 216 Switching Unit, 217 Notification Unit, 218 Information Transmission Unit, 250 Wireless Communication Module, 1200 Computer, 1210 Host Controller, 1212 CPU, 1214 RAM, 1216 graphic controller, 1218 display device, 1220 input / output controller, 1222 communication interface, 1224 storage device, 1226 DVD drive, 1227 DVD-ROM, 1230 ROM, 1240 input / output chip, 1242 keyboard

Claims

1. An information processing device comprising: a first pairing unit that establishes a first pairing between a first controller and the drone by transmitting an IP (Internet Protocol) address of the drone to a first controller and transmitting the IP address of the first controller to the drone; an instruction acquisition unit that acquires a control authority switching instruction that instructs a control device having control authority for the drone to be switched from the first controller to a second controller; a second pairing unit that, in response to the instruction acquisition unit acquiring the control authority switching instruction, establishes a second pairing between the second controller and the drone by transmitting the IP address of the drone to the second controller while the drone is flying and transmitting the IP address of the second controller to the drone; and a switching unit that, in response to the second pairing being established by the second pairing unit, switches the control device having the control authority for the drone from the first controller to the second controller by transmitting to the drone a control authority switching signal indicating a switch from flight based on a control signal transmitted by the first controller to flight based on a control signal transmitted by the second controller.

2. An information processing device comprising: a pairing unit that establishes a first pairing between the control device and the first drone and a second pairing between the control device and the second drone by transmitting an IP address of a first drone and an IP address of a second drone to a control device and transmitting the IP address of the control device to the first drone and the second drone; an instruction acquisition unit that acquires a control target switching instruction that instructs the control device to switch the control target from the first drone to the second drone; and a switching unit that switches the control target of the control device from the first drone to the second drone in response to the instruction acquisition unit acquiring the control target switching instruction, by transmitting an end signal to the first drone indicating that flight based on the control signal transmitted by the control device will be terminated while the second drone is flying, and transmitting a start signal to the second drone indicating that flight based on the control signal transmitted by the control device will be initiated.

3. An information processing device comprising: an information storage unit that stores pairing group information indicating a pairing group consisting of a plurality of drones and a plurality of control devices; a pairing unit that establishes a plurality of pairings between each of the plurality of control devices and each of the plurality of drones by transmitting an IP address of each of the plurality of drones to each of the plurality of control devices and transmitting an IP address of each of the plurality of control devices to each of the plurality of drones based on the pairing group information; an instruction acquisition unit that acquires a control authority switching instruction that instructs a control device having control authority for a drone belonging to the pairing group to be switched from a first control device belonging to the pairing group to a second control device belonging to the pairing group; and a switching unit that switches the control device having the control authority for the drone from the first control device to the second control device in response to the instruction acquisition unit acquiring the control authority switching instruction, by transmitting to the drone a control authority switching signal indicating that the control device will switch from flight based on a control signal transmitted by the first control device to flight based on a control signal transmitted by the second control device while the drone is flying.

4. An information storage unit that stores pairing group information indicating a pairing group consisting of multiple drones and multiple control devices; a pairing unit that establishes multiple pairings between each of the multiple control devices and each of the multiple drones by transmitting an IP address of each of the multiple control devices to each of the multiple drones based on the pairing group information and transmitting an IP address of each of the multiple control devices to each of the multiple drones; a first instruction unit that instructs the control device to start transmitting a control signal to a first drone belonging to the pairing group that is a control target of the control device belonging to the pairing group; an instruction acquisition unit that acquires a control target switching instruction that instructs the control device to switch the control target from the first drone to a second drone belonging to the pairing group; and a second instruction unit that instructs the control device to start transmitting a control signal to the second drone in response to the instruction acquisition unit acquiring the control target switching instruction. an end signal indicating that flight based on the control signal transmitted by the control device will be ended to the first drone while the second drone is flying, and an end signal indicating that flight based on the control signal transmitted by the control device will be started to the second drone, in response to the second instruction unit instructing the control device to start transmitting a control signal to the second drone, by which the control device switches the control target from the first drone to the second drone, in response to the second instruction unit completing the switching of the control target of the control device by the switching unit; 5. A program for causing a computer to function as the information processing device according to any one of claims 1 to 4.

6. A system comprising: the information processing device according to claim 1; the drone; the first control device; and the second control device.

7. A system comprising: the information processing device according to claim 2; the first drone; the second drone; and the control device.

8. A system comprising: the information processing device according to claim 3; the plurality of drones; and the plurality of control devices.

9. A system comprising: the information processing device according to claim 4; the plurality of drones; and the plurality of control devices.

10. An information processing method executed by a computer, comprising: a first pairing step of establishing a first pairing between a first controller and the drone by transmitting an IP address of the drone to a first controller and transmitting the IP address of the first controller to the drone; an instruction acquisition step of acquiring a control authority switching instruction to switch a controller having control authority for the drone from the first controller to a second controller; a second pairing step of establishing a second pairing between the second controller and the drone by transmitting the IP address of the drone to the second controller while the drone is flying in response to acquiring the control authority switching instruction in the instruction acquisition step; and a switching step of switching the controller having the control authority for the drone from the first controller to the second controller in response to establishing the second pairing in the second pairing step by transmitting to the drone a control authority switching signal indicating a switch from flight based on a control signal transmitted by the first controller to flight based on a control signal transmitted by the second controller.

11. An information processing method executed by a computer, comprising: a pairing step of establishing a first pairing between the controller and the first drone and a second pairing between the controller and the second drone by transmitting an IP address of a first drone and an IP address of a second drone to a controller and transmitting the IP address of the controller to the first drone and the second drone; an instruction acquisition step of acquiring a control target switching instruction that instructs the controller to switch the control target from the first drone to the second drone; and a switching step of switching the control target of the controller from the first drone to the second drone in response to acquiring the control target switching instruction in the instruction acquisition step, by transmitting an end signal to the first drone, indicating an end of flight based on the control signal transmitted by the controller, while the second drone is flying, and transmitting a start signal to the second drone, indicating a start of flight based on the control signal transmitted by the controller.

12. An information processing method executed by a computer, comprising: a pairing step of establishing a plurality of pairings between each of the plurality of controllers and each of the plurality of drones by transmitting an IP address of each of the plurality of drones to each of the plurality of controllers and transmitting an IP address of each of the plurality of controllers to each of the plurality of drones based on pairing group information stored on the computer and indicating a pairing group composed of a plurality of drones and a plurality of controllers; an instruction acquisition step of acquiring a control authority switching instruction to switch a control device having control authority for a drone belonging to the pairing group from a first control device belonging to the pairing group to a second control device belonging to the pairing group; and a switching step of switching the control device having the control authority for the drone from the first control device to the second control device in response to acquiring the control authority switching instruction in the instruction acquisition step, by transmitting to the drone a control authority switching signal indicating that the drone will be switched from flight based on a control signal transmitted by the first control device to flight based on a control signal transmitted by the second control device while the drone is flying.

13. An information processing method executed by a computer, comprising: a pairing step of establishing a plurality of pairings between each of the plurality of controllers and each of the plurality of drones by transmitting an IP address of each of the plurality of drones to each of the plurality of controllers and transmitting an IP address of each of the plurality of controllers to each of the plurality of drones based on pairing group information stored in the computer and indicating a pairing group composed of a plurality of drones and a plurality of controllers; a first instruction step of instructing the controller to start transmitting a control signal to a first drone belonging to the pairing group that is a control target of the controller belonging to the pairing group; an instruction acquisition step of acquiring a control target switching instruction instructing the controller to switch the control target from the first drone to a second drone belonging to the pairing group; and a second instruction step of instructing the controller to start transmitting a control signal to the second drone in response to acquiring the control target switching instruction in the instruction acquisition step. a switching step of switching the controlled object of the controller from the first drone to the second drone by transmitting an end signal to the first drone, indicating that flight based on the control signal transmitted by the controller will be ended, and transmitting a start signal to the second drone, indicating that flight based on the control signal transmitted by the controller will be started, while the second drone is flying, in response to instructing the controller to start transmitting control signals to the second drone in the second instruction step, wherein the first instruction step has a step of instructing the controller to end transmission of the control signal to the first drone in response to completion of switching of the controlled object of the controller in the switching step.

Images