Information processing device, method, computer program, and communication system

Abstract

[Problem] To avoid a collision with another moving object. [Solution] An information processing device of the present disclosure comprises an image capturing unit that acquires image data by capturing an environment including a travel direction of a moving object, and a control unit that detects another moving object present in the travel direction of the moving object on the basis of the image data and takes an action to avoid a collision with the other moving object on the basis of information pertaining to the other moving object.

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, a method, a computer program, and a communication system. [Background technology]

[0002] Several methods have been proposed for drone obstacle avoidance. However, these methods are mainly for collision avoidance with stationary objects, and few methods have been proposed for drones avoiding collisions with other drones moving through space.

[0003] Patent Document 1 discloses a method for determining the priority of drones based on flight speed or weight, etc., and for each drone to take action to avoid collisions in accordance with the determined priority. In this method, when the distance between drones falls below a certain value, the priorities of the drones are compared to determine the priority of the drones.

[0004] However, in order to determine the priority, the drone and the other drone must be able to recognize and communicate with each other. In addition, both the drone and the other drone must have functions corresponding to the technology of Patent Document 1. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2018-77754 A Summary of the Invention [Problem to be solved by the invention]

[0006] The present disclosure provides an information processing device, a method, a computer program, and a communication system that prevent a collision with another moving object. [Means for solving the problem]

[0007] The information processing device according to the present disclosure includes: an imaging unit that captures an image of an environment including a moving direction of the moving object to obtain image data; and detecting other moving objects that are present in the moving direction of the moving object based on the image data. a control unit that performs an action to prevent a collision with the other moving object based on information about the other moving object; Equipped with.

[0008] The control unit determines the action to prevent a collision with the other moving body, and performs the action.

[0009] The control unit, as the action, proceeding while taking evasive action against the other moving object, Whether to perform standby operation Proceed without taking any avoidance action against the other moving object, or Change the route? Do one of the following:

[0010] The control unit is determining whether the moving body or the other moving body has priority; When the other moving object has priority, the vehicle advances while taking an avoidance action against the other moving object, or takes the waiting action, or changes the route; If the moving object has priority, it proceeds without taking any avoidance action against the other moving object.

[0011] The control unit is determining a priority of the moving body and a priority of the other moving body; Based on the priority of the moving body and the priority of the other moving bodies, it is determined whether the moving body or the other moving bodies should be given priority.

[0012] The information about the other moving object includes a recognition performance of an imaging unit of the other moving object, The control unit determines whether the moving body or the other moving body is to be given priority based on the recognition performance of the imaging unit and the recognition performance of the imaging unit of the other moving body.

[0013] The imaging unit and the imaging unit of the other moving object each include at least one camera, The recognition performance of the imaging unit and the recognition performance of the imaging unit of the other moving object are The number of cameras, The angle of view of the camera, The installation position of the camera; the resolution of said camera; The determination is based on at least one of the following:

[0014] The recognition performance of the imaging unit is determined based on the number of the other moving objects detected by the control unit, The recognition performance of the imaging unit of the other moving body is determined based on the number of moving bodies that the other moving body recognizes in the traveling direction of the other moving body.

[0015] The control unit is determining whether the other moving body recognizes the moving body; When it is determined that the other moving bodies do not recognize the moving body, the other moving bodies are given priority.

[0016] The information about the other moving body includes a purpose of movement of the other moving body, The control unit determines whether the moving body or the other moving body is to have priority, based on a movement purpose of the moving body and a movement purpose of the other moving body.

[0017] The information about the other moving object includes a mobility performance of the other moving object, The control unit determines whether the moving body or the other moving body is to be given priority based on the mobility performance of the moving body and the mobility performance of the other moving body.

[0018] The information about the other moving object includes a speed of the other moving object, The control unit determines whether the moving body or the other moving body is to have priority, based on a speed of the moving body and a speed of the other moving body.

[0019] The control unit calculates a time until the moving object collides with the other moving object, determining whether the control unit or the base station should determine which of the moving object and the other moving object should have priority, depending on the time; If the base station decides to do so, it sends a request to the base station to make the decision.

[0020] The control unit is Calculate the time until the moving object collides with the other moving object; determining the type of information to obtain based on the time; The information acquisition unit acquires the information of the determined type.

[0021] The information regarding the other moving body includes at least one of a position of the other moving body and a distance to the other moving body.

[0022] The moving body is an air vehicle.

[0023] A computer program according to the present disclosure comprises: A computer program for causing a computer mounted on a moving object to execute the program, An imaging step of acquiring image data by imaging an environment including a traveling direction of the moving object; a detection step of detecting another moving object present in the traveling direction of the moving object based on the image data; A control step of taking action to prevent a collision with the other moving body based on information about the other moving body. Equipped with.

[0024] A method according to the present disclosure is a method performed by a mobile entity, comprising: A method performed by a mobile entity, comprising: Acquiring image data by capturing an image of an environment including a traveling direction of the moving object; Detecting another moving object present in the traveling direction of the moving object based on the image data; Based on the information about the other moving object, an action is taken to prevent a collision with the other moving object.

[0025] A communication system according to the present disclosure is a communication system including a plurality of mobile objects and a base station, The plurality of moving bodies An imaging unit that captures an image of an environment including a traveling direction of the moving object to obtain image data; A control unit that detects another moving object present in the traveling direction of the moving object based on the image data; A communication unit that communicates with the base station, The base station, A communication unit that communicates with the mobile object; an information acquisition unit that acquires information about the moving object and the image data from the moving object; The system further includes a control unit that generates information for determining an action to be taken by the moving body to prevent a collision with the other moving body based on information about the moving body and the image data, and transmits the generated information to the moving body. [Brief description of the drawings]

[0026] [Figure 1] 1 is a block diagram of a communication system including an information processing device according to a first embodiment. [Diagram 2] Block diagram of a drone. [Diagram 3] FIG. 2 is a block diagram of a base station. [Figure 4] A schematic diagram showing the two-dimensional flight of drones A and B. [Diagram 5] A diagram showing an example of image data captured by a camera installed in front of drone A. [Figure 6] FIG. 13 is a side view showing an example of an avoidance operation. [Figure 7] FIG. 13 is a side view showing an example of the shunting operation. [Figure 8] FIG. 13 is a plan view showing an example of a pause. [Figure 9] FIG. 11 is a diagram for specifically explaining a third example of priority determination. [Figure 10]11 is a flowchart of an example of collision avoidance control performed by a control unit of a drone. [Figure 11] 13 is a flowchart of an example of a priority determination process performed in a control unit of a drone. [Figure 12] 4 is a flowchart of a first example of collision avoidance control. [Figure 13] FIG. 11 is a diagram for explaining a second example of collision avoidance control. [Figure 14] 11 is a flowchart of a second example of collision avoidance control. [Figure 15] FIG. 11 is a diagram for explaining a specific example of the third example of collision avoidance control. [Figure 16] FIG. 11 is a diagram for explaining a specific example of the third example of collision avoidance control. [Figure 17] FIG. 11 is a diagram for explaining a specific example of the third example of collision avoidance control. [Figure 18] A diagram showing an example of how each drone acts based on the adjusted priority. [Figure 19] 13 is a flowchart of a third example of collision avoidance control. [Figure 20] A diagram showing an example of the hardware configuration of an information processing device or base station of a drone. [Figure 21] 13 is a flowchart of an example of collision avoidance control in the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] Hereinafter, the embodiments of the present disclosure will be described with reference to the drawings. In one or more embodiments shown in the present disclosure, the elements included in each embodiment can be combined with each other, and the combined result also forms part of the embodiment shown in the present disclosure.

[0028] FIG. 1 is a block diagram of a communication system according to a first embodiment. The communication system in FIG. 1 includes a plurality of moving bodies 101A, 101B, and 101C, and a base station 201. The moving bodies in this embodiment are drones (unmanned aerial vehicles), and the moving bodies 101A to 101C are referred to as drones 101A to 101C. A drone is an example of a moving body, and the moving body may be a robot or an unmanned guided vehicle. Although three drones are shown in the figure, the number of drones may be two, four or more. Hereinafter, any one drone will be referred to as a drone 101. The arrows in the figure indicate the direction of communication. The drones 101A and 101B can communicate bidirectionally, the drones 101A and 101C can communicate bidirectionally, and the drones 101B and 101C can communicate bidirectionally. The base station 201 can also communicate bidirectionally with the drones 101A, 101B, and 101C.

[0029] The drone 101 is a mobile object capable of flying by driving multiple rotors. The drone 101 is capable of wireless communication with the base station 201. The drone 101 flies along a route under the control of the base station 201. The drone 101 may generate a route by itself from a departure point and a destination and fly (autonomous flight), or may receive a route specified by the base station 201 and fly the specified route.

[0030] 2 is a block diagram of the drone 101. The drone 101 includes an information processing device 1, rotors 14A to 14D, and motors 15A to 15D. The information processing device 1 includes an antenna 10, an imaging unit 11, a control unit 13, a communication unit 12, a sensor unit 16, a position detection unit 17, a battery 18, a storage unit 19, and an information acquisition unit 20.

[0031] The imaging unit 11 captures an image of the environment including the direction of travel of the drone 101, and acquires image data. The imaging unit 11 stores the captured image data in the storage unit 19 in association with a time. Alternatively, the imaging unit 11 may provide the captured image data to the control unit 13. The captured image is a still image or a moving image. The imaging device 101 includes one or more cameras including a lens and an imaging element. The camera may be a stereo camera. The imaging element is, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

[0032] The rotors 14A to 14D generate lift through rotation, thereby flying the drone 101. The rotors 14A to 14D are rotated by the motors 15A to 15D. The motors 15A to 15D rotate the rotors 14A to 14D. The rotation of the motors 15A to 15D is controlled by the control unit 13.

[0033] The control unit 13 controls the operation of the drone 101. The control unit 13 controls the imaging unit 11, the communication unit 12, the motors 15A to 15D, the sensor unit 16, the position detection unit 17, the battery 18, the information acquisition unit 20, and the storage unit 19.

[0034] The control unit 13 adjusts the rotation speed of the rotors 14A to 14D by adjusting the rotation speed of the motors 15A to 15D. By adjusting the rotation speed of the rotors 14A to 14D, the drone 101 can be moved in any direction at any speed.

[0035] The control unit 13 controls the imaging by the imaging unit 11 during flight. For example, it controls so that imaging is performed at regular sampling intervals. The control unit 13 also controls the transmission and reception processing of information or data between the imaging unit 11 and other devices (for example, the base station 101 and other mobile bodies) via the communication unit 12.

[0036] The control unit 13 generates a flight route based on the flight departure point and destination given as instruction data from the base station 201, and flies along the generated route. That is, the control unit 13 performs autonomous flight. The control unit 13 has a function of avoiding other drones (hereinafter, other drones) and other obstacles. The control unit 13 may regenerate the route when it is desired to change the route to prevent collision with an obstacle. In addition to generating the route itself, the control unit 13 may receive data on the flight route from the base station 201 and fly along the route of the received data. When it is desired to change the route, the control unit 13 may, for example, transmit information on the position of the drone 101 to the base station 201 and transmit a request to regenerate the route.

[0037] The control unit 13 performs a process of detecting other drones present in the traveling direction of the drone 101 based on image data captured by the imaging unit 11. Other drones present in the traveling direction are called interfering drones as they may interfere with the drone itself. The process of detecting interfering drones is called interfering drone detection processing. As an example, the control unit 13 performs the interfering drone detection processing each time image data is acquired by the imaging unit 11. By detecting an interfering drone, the control unit 13 can recognize other drones present in the traveling direction.

[0038] The traveling direction of the drone is, for example, the forward direction of the drone, but is not necessarily limited to the forward direction. For example, when the drone ascends or descends, the traveling direction may be the upward or downward direction.

[0039] An example of the interfering drone detection process is to detect a drone object from image data using a segmentation technique. For example, semantic segmentation, which performs object detection at the pixel level, can be used. The drone indicated by the detected object is determined to be an interfering drone. The method of detecting an interfering drone from image data is not limited to a method using a segmentation technique, and any method may be used.

[0040] A medium (e.g., a sticker) with the drone 101's aircraft ID attached thereto may be attached to the drone 101. The aircraft ID is an ID that uniquely identifies the drone. If the aircraft ID can be read from the image data, the aircraft ID of the interfering drone may be identified from the read information.

[0041] As one example, a drone present in the traveling direction of the drone 101 is a drone that appears in an image captured by a camera installed at a location (e.g., in front of the aircraft) corresponding to the traveling direction of the drone 101. As one example, the entire image captured by the camera is subject to object detection, and a detected object is determined to be an interfering drone.

[0042] Alternatively, a part of the captured image, rather than the entire captured image, may be subject to object detection. For example, a specific portion (partial image) of the captured image may be subject to object detection. The specific portion may be a certain range from the center of the captured image. The specific portion may also be a portion through which the drone passes (a portion of the space occupied by the drone), or a portion in which a margin area is added to the portion of the space occupied by the drone. Other drones present in the direction of travel may also be detected using other methods.

[0043] The control unit 13 may perform processing to detect drones in surrounding directions other than the traveling direction (for example, backward, left, right, downward, upward, etc.). In this case, image data captured by a camera installed at a location other than the traveling direction may be used. By detecting drones in directions other than the traveling direction, it is possible to prevent collisions with other drones, for example, when avoiding an interfering drone in the traveling direction.

[0044] When the control unit 13 detects an interfering drone from the image data, it generates interference detection information including the position and time of the interfering drone. The control unit 13 stores the interference detection information in the storage unit 19. A collection of interference detection information corresponds to a detection history of the interfering drone. In addition to or instead of the position of the interfering drone, the distance to the interfering drone may be calculated. The position or distance of the interfering drone can be calculated using image data captured by a stereo camera, for example.

[0045] The communication unit 12 performs transmission and reception processing of information or data by performing wireless communication with the base station 101 and other drones (including cases of interfering drones). Any wireless communication method may be used. For example, the method may be based on the IEEE802.11 standard, the IEEE802.15.1 standard, or other standards. For example, the frequency band used for wireless communication is the 2.4 GHz band, the 5 GHz band, or other frequency bands.

[0046] As an example, the communication unit 12 receives instruction data related to flight from the base station 201. The communication unit 12 provides the instruction data to the control unit 13. The control unit 13 controls the flight to be performed according to the instruction data. As an example, the instruction data includes a departure point and a destination. The control unit 13 generates a route to the destination and controls the flight to be performed according to the generated route.

[0047] The communication unit 12 also receives information (described in detail below) about the other drones from the other drones. The communication unit 12 provides the acquired information about the other drones to the information acquisition unit 20. The communication unit 12 may acquire information about the other drones via the base station 101. The communication unit 12 may also transmit information about the drone 101 (the drone itself) to the interfering drone or the base station 101.

[0048] The position detection unit 17 detects the position of the drone 101. The position of the drone 101 is, for example, the current position (real-time position) of the drone 101. The position detection unit 17 detects the position using, for example, a Global Positioning System (GPS) or the like. The position detection unit 17 stores information on the detected position in the memory unit 19 in association with time. The position detection unit 17 may provide the position information to the control unit 13.

[0049] The position of the drone is, for example, a position in a predetermined coordinate system. The predetermined coordinate system may be a three-axis coordinate system (XYZ coordinate system) with the position of the base station 101 as the origin or a predetermined position. For example, (X, Y, Z) = (7.3 m, 4.1 m, 15.8 m). The coordinate system may have a point other than the position of the base station 101 as the origin. Alternatively, the position of the drone may be a position based on latitude and longitude acquired by GPS. The position based on latitude and longitude may be converted into a position in the predetermined coordinate system.

[0050] The sensor unit 16 includes one or more sensors that acquire the state of the drone 101. Examples of the sensors include an acceleration sensor, a direction sensor (such as a gyro sensor, a GPS compass, or an electronic compass), an ultrasonic sensor, and an air pressure sensor. The sensor unit 16 associates the acquired information representing the state of the drone 101 with time and stores the information in the storage unit 19. The sensor unit 16 may provide the acquired information representing the state of the drone 101 to the control unit 13.

[0051] Examples of information acquired by the sensor unit 16 include the speed and traveling direction of the drone. The traveling direction is expressed, for example, in a predetermined coordinate system. Alternatively, the traveling direction may be expressed, for example, as an absolute direction expressed in a range from true north at 0 degrees to 359.99 degrees eastward. The absolute direction may be converted into a direction in a predetermined coordinate system.

[0052] As an example, the imaging unit 11, the sensor unit 16, and the position detection unit 17 operate (imaging, sensing, and position detection) at fixed sampling intervals and at the same time under the control of the control unit 13. However, the sampling intervals and operation times of the imaging unit 11, the sensor unit 16, and the position detection unit 17 may be different.

[0053] The battery 18 stores electric power energy for operating each element in the drone 101. The battery 18 may be a primary battery that can only discharge, or a secondary battery that can be charged and discharged.

[0054] The memory unit 19 stores information (speed, direction of travel, etc.) acquired by the sensor unit 16, position information acquired by the position detection unit 17, image data acquired by the imaging unit 11, and interference detection information (position and time of the interfering drone, etc.) acquired by the control unit 13. The control unit 13 may acquire information on the remaining energy amount of the battery 18 and store the acquired information in the memory unit 19.

[0055] The storage unit 19 also stores information about the attributes and performance of the drone 101. Examples of the information about the attributes and performance of the drone 101 include the following. Aircraft ID ·Flight purpose (movement purpose) ·Flight performance (movement performance) · Places of departure and destination ·Recognition performance

[0056] The aircraft ID is an ID that uniquely identifies the drone. For example, it may be “ABC123”. The aircraft ID may include a communication address according to the protocol used.

[0057] Examples of flight purposes include photography, life-saving (including rescue), logistics, firefighting, and surveillance. Examples of photography include photographing vehicles traveling on roads on the ground, photographing transport vehicles autonomously traveling within a facility, or photographing ships. An example of life-saving is the transport of medical supplies or daily necessities to disaster areas or accident sites. An example of firefighting is the dropping of extinguishing agents at the scene of a fire. An example of logistics is the transport of luggage, etc. Examples of surveillance include the detection of suspicious individuals, detection of abnormalities in facilities, etc.

[0058] Examples of flight performance include braking performance and maneuverability. An index of braking performance is, for example, the distance (braking distance) from when the control unit issues a stop command (a command to stop in the air) until the drone actually stops. The braking distance depends on the speed of the drone or the strength of the brakes (braking force). An index of maneuverability is, for example, the minimum turning radius.

[0059] The destination or starting point is determined in a predetermined coordinate system, for example. For example, the destination is (X, Y, Z) = (180 m, 210 m, 1.0 m). The destination or starting point may be a position based on latitude and longitude obtained by GPS. When flying the same route repeatedly for surveillance purposes, etc., the destination may not exist.

[0060] The recognition performance is the performance of the ability to detect a drone from image data. Examples of the recognition performance include at least one of the position, number, angle of view, and resolution of the camera installed on the drone. The recognition performance may include the number of other drones recognized by the drone in the direction of travel.

[0061] As examples of camera positions and numbers, a single camera may be installed in front of the drone, or multiple cameras (e.g., eight) may be installed around the drone. If only one camera is installed in front of the drone, it can only capture images in front of the drone, so it can only detect drones in front. In other words, it can only recognize drones in front. If multiple cameras are installed around the drone, it can capture images of the entire surroundings, including not only the front, but also the rear, left and right, so drones can be detected over a wide range. In other words, it becomes possible to recognize drones over a wide range.

[0062] In addition, the narrower the angle of view, the farther the drone can be captured. In other words, the farther away the drone can be recognized. However, since the capture range is narrower, it is necessary to install more cameras to recognize drones over a wider area than when using a camera with a wider angle of view.

[0063] With a higher resolution, drones in captured images can be identified with higher accuracy. For example, even if a drone appears small in the captured image, the drone can be detected and recognized as an interfering drone.

[0064] The information acquisition unit 20 acquires information about the other drones from the other drones via the communication unit 12. The information acquisition unit 20 may also be configured to acquire information about the other drones from the base station 101.

[0065] The information about other drones acquired from the information acquisition unit 20 includes, for example, the same items as the information in the memory unit 19 of the drone 101. For example, the information includes the following items. Aircraft ID ·Flight purpose (movement purpose) ·Flight performance (movement performance) · Places of departure and destination ·Recognition performance ·position ·speed ·Direction of travel -Remaining energy in the battery -Interference detection information (position of interfering drone and time of detection, etc.)

[0066] [Collision avoidance control] The collision avoidance control according to this embodiment will be described below. When the control unit 13 detects one or more interfering drones in the direction of travel of the drone itself from the image data, it communicates with the interfering drone to acquire information about the interfering drone. The acquired information about the interfering drone is all or part of the items described above. There may also be a configuration in which some or all of the information about the interfering drone is acquired from the base station 201. The control unit 13 may also transmit information about the drone 101 to the interfering drone or the base station 201 via the communication unit 12.

[0067] If the aircraft ID of the interfering drone can be identified from the image data, communication with the interfering drone is performed based on the aircraft ID. For example, communication is performed using a packet including the aircraft ID. If the aircraft ID cannot be identified, communication may be performed by forming a directional beam toward the position of the interfering drone. Alternatively, a packet may be transmitted by broadcast, and the interfering drone may be identified based on a response packet transmitted from the direction or position of the interfering drone.

[0068] The control unit 13 determines an action required to prevent a collision with the interfering drone based on the acquired information about the interfering drone. The control unit 13 controls the flight of the drone 101 based on the determined action.

[0069] Examples of actions required to prevent a collision include proceeding while avoiding a collision with the interfering drone (i.e., performing evasive maneuvers), proceeding without performing evasive maneuvers, performing a waiting maneuver, or changing route (either by temporarily stopping on the route or by taking refuge off the route).

[0070] The action of determining the action to prevent collision and executing the determined action is called collision avoidance control. When a standby action is performed, flight is resumed after the interference is resolved, that is, after the interfering drone is no longer in the flight direction. When a temporary stop is performed as a standby action, flight is resumed from the point where it was temporarily stopped. When a waiting action is performed as a withdrawal action, flight is continued by returning to the original route, or a new route is regenerated from the withdrawal position and flight is continued along the regenerated route. Details of collision avoidance control will be described later.

[0071] 3 is a block diagram of the base station 201. The base station 201 includes an antenna 50, a communication unit 51, a control unit 52, and a storage unit 53.

[0072] The communication unit 51 performs transmission and reception processing of information or data by performing wireless communication with the drones 101 (101A to 101C). Any wireless communication method may be used. For example, the IEEE802.11 standard, the IEEE802.15.1 standard, or other standards may be used. For example, the frequency band used for wireless communication is the 2.4 GHz band, the 5 GHz band, or other frequency bands.

[0073] The communication unit 51 obtains flight instruction data for the drone 101 from the control unit 52 and transmits the instruction data to the drone 101.

[0074] The storage unit 53 stores information related to the attributes and performance of the drone 101. For example, information related to the drone 101's aircraft ID, specification information (model, weight, size, etc.), flight purpose (travel purpose), flight performance (travel performance), departure point and destination, and recognition performance is stored.

[0075] The control unit 52 controls the operation of the base station 201. It also issues instructions to the drone 101 regarding flight.

[0076] The control unit 52 generates instruction data for the flight of the drone 101 based on the information related to the drone 101 in the storage unit 53. The instruction data includes, as an example, a departure point and a destination. As another example, the instruction data may include a flight route. The control unit 52 transmits the generated instruction data to the drone 101 via the communication unit 51.

[0077] The control unit 52 regenerates the route when receiving a request to regenerate the route from the drone 101. The control unit 52 transmits instruction data including the regenerated route to the drone 101.

[0078] The control unit 52 controls transmission and reception of information or data to and from the drone 101. As an example, the control unit 52 acquires information or data acquired by the sensor unit 16, the control unit 13, and the position detection unit 17 of the drone 101 from the drone 101, and stores the acquired information or data in the storage unit 53.

[0079] When the control unit 52 receives a request from the drone 101 to send information about other drones, it reads the requested information about the drone from the memory unit 53 and sends it to the drone 101.

[0080] The collision avoidance control performed by the control unit 13 of the drone 101 will be specifically described below.

[0081] Figure 4 is a schematic diagram showing in plan the flight of drones A and B. Drone A flies in the direction indicated by the arrow, and drone B flies in the direction indicated by the arrow.

[0082] FIG. 5 shows an example of image data 31 captured by a camera installed in front of drone A. This camera captures image data in the direction of travel. Drone A detects object B on the left side of the center of image data 31. From the shape of object B, it is determined that object B is a drone. In other words, drone A determines that object B is an interfering drone.

[0083] Drone B may also detect drone A as an interfering drone by analyzing image data in the same manner as drone A.

[0084] The control unit 13 of the drone 101 determines whether the drone 101 or the interfering drone will advance with priority. For the sake of explanation, the drone 101 is assumed to be drone A and the drone B is assumed to be an interfering drone.

[0085] When the interfering drone has priority, the drone 101 performs, for example, a waiting operation (temporarily stopping or taking refuge at a position off the route) to prevent a collision with the interfering drone. Alternatively, the route is changed. The drone 101 performs an avoidance operation (flying while avoiding the interfering drone). As an example, which of the drone 101 or the interfering drone has priority is determined by negotiation between the drone 101 and the interfering drone. Alternatively, one of the drones acts as a master and determines which of the drone 101 or the interfering drone has priority. Alternatively, there is also a configuration in which the base station 201 determines which of the drone 101 or the interfering drone has priority, as described below.

[0086] On the other hand, if the drone 101 has priority, the drone 101 proceeds without taking evasive action. In other words, it continues to fly along the current route. On the other hand, the interfering drone takes a waiting action or an evasive action.

[0087] FIG. 6 is a diagram showing an example of an avoidance operation from the side. In this example, drone A and drone B fly in opposite directions (FIG. 6(A)). Assume that drone B has priority over drone A. Drone B moves straight along the route. Drone A rises while moving forward to avoid drone B (FIG. 6(B)). After avoiding drone B, drone A returns to the original route (FIG. 6(C)). Here, drone A rises to avoid drone B, but it may also descend or move left or right to avoid drone B. After avoiding interference, drone A may regenerate the route without returning to the original route. It may also avoid interfering drone B in other ways.

[0088] FIG. 7 is a side view showing an example of an avoidance operation. As in FIG. 6, drone A and drone B fly in opposite directions. Drone B has priority over drone A. Drone B moves straight along the route. Drone A pauses and then rises, for example, 10 m (FIG. 7(A)). Drone A waits until interference with drone B is avoided. For example, it waits at a position 10 m above. After interference with interfering drone B is avoided (after there is no interfering drone in the direction of drone A's travel), drone A descends and returns to the original route (FIG. 7(B)). Drone A resumes flight (FIG. 7(C)). Drone A may regenerate a new route at the ascending position and switch the route to the regenerated route. Here, drone A ascends to avoid drone B, but it may descend or move left or right.

[0089] Figure 8 is a plan view of an example of temporary suspension. Drone A and drone B are each flying straight along their routes (Figure 8(A)). Assume that drone B has priority over drone A. Drone A temporarily suspends its flight, while drone B continues flying straight ahead (Figure 8(B)). After drone A has avoided interference with interfering drone B (after there is no longer an interfering drone in drone A's direction of travel), it resumes flying from the position where it was temporarily suspended (Figure 8(C)).

[0090] There is a method of using priorities to determine which of the drone 101 and the interfering drone has priority. The control unit 13 of the drone 101 determines the priority of the drone 101 and the priority of the interfering drone based on information on the drone 101 and the interfering drone. The control unit 13 determines that the drone 101 and the interfering drone have priority in the order of the highest priority. For example, if the drone 101 has priority 2 and two interfering drones (interfering drones X and Y) have priority 1 and priority 3, respectively, the order of priority is the interfering drone X, the drone 101, and the interfering drone Y. In this case, as an example, the interfering drone X, which has the highest priority, continues along the route. The drone 101 and the drone Y perform standby operations. When interference with the interfering drone X is avoided, the drone 101 with the next highest priority resumes flying. When interference with the interfering drone X is avoided, the drone Y with the lowest priority resumes flying. Here, the drone 101 and the drone Y perform standby operations as an action to prevent a collision, but at least one of the drone 101 and the drone Y may perform an avoidance operation. Alternatively, at least one of the drone 101 and the drone Y may change the route. In this description, the smaller the value, the higher the priority. However, the larger the value, the higher the priority. Hereinafter, examples of determining the priority will be described as the first to fifth examples.

[0091] [First example of priority determination] The priority is determined based on the recognition performance of the drone 101 and the recognition performance of the interfering drone. For example, if the recognition performance of the interfering drone is lower than that of the drone 101, the priority of the interfering drone is set higher than that of the drone 101. An example of low recognition performance of the interfering drone is that the number of cameras installed is less than that of the drone 101. The drone 101 has cameras installed in other places in addition to the front, but if the interfering drone has cameras installed in other places in addition to the front of the drone, it can be said that the recognition performance of the interfering drone is lower than that of the drone 101. In addition, the recognition performance of the drone 101 and the interfering drone may be compared according to the number of drones recognized in the direction of travel. The recognition performance is higher when the number of recognized drones is greater. The recognition performance may be compared between the drone 101 and the interfering drone by other methods. If an avoidance operation or a waiting operation is performed when the recognition performance is low, there is a possibility of collision with a drone that has not been recognized (an undetected drone), so the priority of the drone with low recognition performance can be increased so that it can be advanced preferentially. The recognition performance may be classified into two classes, high and low, or three classes, high, medium, and low. For example, if the number of cameras installed is less than a threshold, it is classified as a low class, and if it is equal to or more than the threshold, it is classified as a high class. Classification may also be performed according to the number of drones recognized in the direction of travel. If the recognition performance is the same or the drones are in the same class, the drone 101 and the interfering drone may negotiate to determine the priority. In this case, the priority may be determined randomly.

[0092] [Second example of priority determination] The priority is determined based on the flight purpose of the drone 101 and the flight purpose of the interfering drone. For example, if the flight purposes of three drones are rescue, photography, and logistics, respectively, the priority may be increased in this order. As another example, the priority of the drone with an emergency purpose may be the highest. Examples of emergency purposes include rescue or firefighting. If the flight purposes are the same or in the same category, the priority may be determined by negotiation between the drone 101 and the interfering drone.

[0093] [Third example of priority determination] The priority is determined based on whether the drone 101 is recognized by the interfering drone (whether it is detected by analysis of image data). Whether the drone 101 is recognized by the interfering drone can be determined, for example, based on interference detection information of the interfering drone. For example, if the position of another drone included in the interference detection information of the interfering drone matches the position of the drone 101 or falls within a certain margin, the drone 101 can determine that the interfering drone recognizes the drone 101. As another method, if the aircraft ID of the drone 101 is included in the interference detection information as the aircraft ID of the drone detected by the interfering drone, the drone 101 can determine that the interfering drone recognizes the drone 101.

[0094] Fig. 9 is a diagram for specifically explaining a third example of priority determination. Assume that three drones A, B, and C are flying. The diagram shows the positions of drones A to C (own drones) and the positions of other drones (interfering drones) that drones A to C have found in their respective directions of travel. The information in Fig. 9 is based on the positions and interference detection information of drones A to C at the same time (for example, the latest time), as an example.

[0095] Drone A detects its own drone's position as (x, y, z) = (1m, 2m, 3m), and detects the relative positions of the two other drones from its own drone as (x, y, z) = (2m, 5m, -2m) and (5m, -1m, 4m). In other words, drone A recognizes the two other drones. Note that at this point, the aircraft IDs of the two drones do not need to be known.

[0096] Drone B also detects its own drone's position and the relative positions of the two other drones from its own drone. Drone C also detects its own drone's position and the relative position of one other drone from its own drone. Drone C only recognizes one of drones A and B, and does not recognize (overlooks) the other one.

[0097] The relative position (2m, 5m, -2m) of another drone detected by drone A corresponds to the relative position (-2m, -5m, 2m) of another drone detected by drone B. Therefore, the drone detected by drone A at the relative position (2m, 5m, -2m) can be determined to be drone B. The aircraft ID of drone B may be identified by communicating with drone B, or may be identified by inquiring of the base station 201 about the aircraft ID of the drone present at the position of drone B. In the same manner, the drone detected by drone A at the relative position (5m, -1m, 4m) can be determined to be drone C.

[0098] Similarly, in the case of drone B, the drone at the relative position (-2m, -5m, 2m) detected by drone B can be determined to be drone A. On the other hand, the drone (drone C) at the relative position (3m, -6m, 6m) detected by drone B has not detected another drone at the position of drone B. Therefore, it can be determined that drone B is not recognized by the drone (drone C) at the relative position (3m, -6m, 6m).

[0099] Similarly, the drone detected by drone C at the relative position (-5m, 1m, -4m) can be determined to be drone A. However, drone C does not recognize any drone in the position of drone B.

[0100] Drones A to C communicate with each other and determine the priority. Even if drone C cannot recognize drone B (even if drone B is not captured on drone C's camera), it may be possible for drone C to communicate with drone B due to communication triggered by drone B. However, even if drone C can communicate with drone B, drone C cannot recognize drone B with its camera, so drone C is treated as not recognizing drone B. Drone C does not recognize drone B and is determined to have the lowest recognition performance, with the highest priority 1. In other words, if drone C is made to perform a retreat or avoidance operation, drone C may not recognize drone B (e.g., the angle of view is narrow and it is not captured on the camera), and there is a possibility that it may collide with drone B. Since drone A and drone B can recognize each other, the priority may be determined using the first or second example of priority determination described above, or the fourth or fifth example described below. Alternatively, the priority may be determined randomly.

[0101] [Fourth example of priority determination] The priority is determined based on the flight performance of the drone 101 and the flight performance of the interfering drone.

[0102] For example, the priority is determined based on the maximum altitude at which the drone 101 can fly and the maximum altitude at which the interfering drone can fly. As an example, the priority is set higher for the drone with the lower maximum altitude. This is because the drone with the higher maximum altitude can avoid other drones by rising to a higher position, and has more options for avoidance actions. If the flight performance is the same or comparable, the priority may be determined by negotiation between the drone 101 and the interfering drone. Alternatively, the priority may be determined randomly.

[0103] In this case, the priority may be determined based on whether there is a space in the sky above the drone 101 and the interfering drone where they can take refuge. As a premise, it is assumed that both the drone 101 and the interfering drone have the ability to rise further from their current positions. If there is another drone or other obstacle in the sky above the drone 101 and the interfering drone, it is determined that there is no space in the sky above the drone 101 and the interfering drone where they can take refuge. The priority of a drone with a space where it can take refuge is set lower than the priority of a drone without a space.

[0104] As another example, the priority is determined based on the braking performance of the drone 101 and the braking performance of the interfering drone. This is because a drone with poor braking performance takes a long time to stop after a stop command is issued. In this case, a high priority is determined for the drone with poor braking performance, and a low priority is determined for the drone with high braking ability. The high priority drone proceeds without changing its speed, and the low priority drone waits temporarily to wait for the drone ahead to pass, thereby preventing a collision.

[0105] As another example, the priority is determined based on the maneuverability of the drone 101 and the maneuverability of the drone with respect to an interfering drone. The higher the maneuverability, the smaller the minimum turning radius is, so that when performing a retreat or avoidance operation by changing direction, there is less wasted movement when changing direction, and the possibility of collision with another drone can be reduced.

[0106] The flight performance used to determine the priority is not limited to the above example, and other performance may be used.

[0107] [Fifth example of priority determination] The priority is determined based on the speed of the drone 101 and the speed of the interfering drone. For example, if the speed of the drone 101 is faster than that of the interfering drone, the priority of the drone 101 is set higher than that of the interfering drone. This is because a faster drone usually takes longer to stop. However, based on the braking performance of both drones, the time required from the issuance of a stop command to stopping can be calculated, and the priority of the drone that takes longer can be set higher than that of the drone that takes shorter time.

[0108] The first to fifth examples of the priority determination are merely examples, and two or more of the first to fifth examples may be combined. Furthermore, as long as information on the drone 101 and the interfering drone is used, the priority may be determined by other methods.

[0109] FIG. 10 is a flowchart of an example of collision avoidance control performed by the control unit 13 of the drone 101.

[0110] Based on the image data acquired by the imaging unit 11, it is determined whether or not another drone (interfering drone) has been found in the traveling direction of the drone 101 (S101). If no other drone has been found (NO), the process proceeds to step S105.

[0111] When one or more other drones are found, the control unit 13 communicates with the other drones via the communication unit 12 and transmits information about the drone 101 (the drone itself) to the other drones (S102). The method of communicating with the other drones is as described above. The control unit 13 also receives information about the other drones from the other drones via the communication unit 12 (same S102).

[0112] Priority is determined between the drone and the other drones (S103). As an example, the priority of all drones (the drone and the other drones) is determined through negotiation between the drone and the other drones. As another method, each drone may determine the priority of all drones (the drone and the other drones). If the drone and the other drones have the same information and determine the priority using the same algorithm, the priority of all drones determined by each drone will be the same.

[0113] Furthermore, as another method, one of the drone itself and the other drones may act as a master and determine the priority of all drones. The master transmits information on the determined priority to the other drones. The drone that becomes the master is, for example, a drone that recognizes the most other drones, or a drone equipped with a computing device with the highest computing performance. When the drone 101 (the drone itself) becomes the master, the drone itself determines the priority of all drones. In this case, when there are other drones with which the drone 101 cannot communicate, the drone 101 may transmit information on the priority to the other drones via the base station 201 or another drone.

[0114] In addition, suppose that one of the other drones is recognized by the user's drone and the other drones, but the other drone does not recognize the user's drone or the other drones and cannot communicate with them. In this case, the user's drone and the other drones determine the highest priority for the other drone. No priority information is transmitted to the other drone. The other drone continues to move forward in the same direction as the drone with the highest priority.

[0115] The drone 101 flies according to the priority determined in step S103 (S104). More specifically, the drone 101 determines the action to prevent a collision (for example, continue straight, perform an avoidance action, or perform a standby action) based on the priority of each drone, and executes the determined action. Details of this step S104 will be described later.

[0116] In the next step S105, it is determined whether to end this operation. For example, if the drone 101 has landed, it is determined to end this operation. If it is determined to end this operation (YES), the operation is ended. In other cases, the process returns to step S101. If the drone starts flying again after ending the operation, the process of the flowchart in FIG. 10 is resumed.

[0117] FIG. 11 is a flowchart of an example of a priority determination process performed in step S103 of FIG. 10 by the control unit 13 of the drone 101.

[0118] If there is a drone (assumed to be drone X) that cannot recognize other drones among one or more drones discovered by drone 101, drone X is set to the highest priority (S201). For example, the priority is set to 1. If drone X cannot recognize other drones but can communicate with them, drone X may be set to the highest priority in negotiations between drones including drone X. If drone X cannot communicate with other drones, drone X's priority is determined to be the highest priority in negotiations between drones other than drone X. If drone 101 is the only drone other than drone X, drone 101 may determine drone X's priority to be the highest priority. If drone X cannot communicate with other drones, no information is transmitted to drone X. Drone X continues to move forward along the direction of travel.

[0119] Next, the flight purpose of the drone 101 is compared with the flight purpose of other drones to determine whether there is a drone with an emergency purpose (S202). Emergency purposes include, for example, rescue purposes or firefighting purposes. If there is a drone with an emergency purpose, the priority of that drone is set to the second highest after the drone identified in step S201 (same S202). If no drone is identified in step S201, the priority of the drone identified in step 202 is set to the highest. If there are multiple drones with an emergency purpose, the priority is determined by negotiation between the drones. Alternatively, the priority may be determined by more detailed classification, such as rescue purposes or firefighting purposes. In this embodiment, different priorities are set for each drone, but the same priority may also be set for multiple drones.

[0120] Next, based on the flight performance of the drone 101 and the flight performance of the other drones, it is determined whether there is an airspace where each drone can take refuge (for example, an airspace with no obstacles 3 m above the position of the drone) and whether there is a drone that can move to that airspace (S203). If such a drone is present, the drone is assigned the second highest priority after the drones identified in steps S201 and S202 (same S203).

[0121] The flowchart in Fig. 11 shows an example of determining priority based on the presence or absence of recognition of other drones, the flight purpose, and flight performance. This example is merely one example, and as shown in the first to fifth examples of priority determination described above, it is also possible to determine priority by using other information in addition to or instead of it.

[0122] The following describes the details of step S104 in Fig. 10. In step S104, the action of each drone is determined according to the priority determined in step S103, and the determined action is executed (collision avoidance control).

[0123] (First example of collision avoidance control) Assume that there is no space in the direction of each drone's flight that allows two or more drones to pass each other. In this case, the drones are flown one at a time. First, the drone with the highest priority flies in the same direction. Drones with the second or higher priority continue to wait until there is no drone with a higher priority in their direction of flight. The waiting action to be taken, either temporary waiting (see Figure 8) or evacuation (see Figure 7), may be determined based on the direction of flight of the drone with the higher priority, and whether it will collide with the drone's own drone. For example, if there is no collision, the drone will wait temporarily, and if there is a possibility of collision, the drone will evacuate to an airspace above, etc.

[0124] A drone with a second or higher priority will resume flying in the direction of travel when a drone with a higher priority is no longer present in the direction of travel. Specifically, if the drone was temporarily waiting, it will resume flying in the direction of travel from that position (see Figure 8). If it was performing an evasive maneuver, it will return to its original route and resume flying (see Figure 7). Alternatively, it may generate a new route and resume flying.

[0125] The determination as to whether or not the drone with the next higher priority is no longer present in the direction of travel is, for example, based on image data acquired by the imaging unit 11. Alternatively, the determination may be made by receiving information notifying that interference has been avoided from the drone with the next higher priority (i.e., that the other drone is no longer present in the direction of travel). The notification may be received from the base station 201.

[0126] This allows each drone to fly without colliding with another.

[0127] 12 is a flowchart of a first example of collision avoidance control performed by the control unit 13 of the drone 101. It is determined whether there is a drone with a higher priority than the priority of the drone 101 (S301). If there is not (NO), the drone 101 proceeds along the traveling direction (S302).

[0128] If it exists (YES), the drone 101 performs a standby operation (S303). For example, if a drone with a higher priority than the drone 101 is likely to collide with the drone 101 while the drone 101 is on the route, the drone 101 evacuates to an airspace above, etc. If there is no such possibility, the drone 101 temporarily stops on the current route. If the drone 101 cannot evacuate to an airspace above, etc. due to its flight performance, the drone 101 temporarily stops on the current route. In this case, if there is a possibility that a drone with a higher priority will collide with the drone 101, the drone 101 is expected to avoid the drone (see FIG. 6).

[0129] The drone 101 waits until there are no drones with a higher priority in its flight direction (S303). If the drone is no longer present (NO in S301), the drone 101 resumes flight along its flight direction (S302). After resuming flight, the drone 101 may transmit information to the drone with the next lower priority to notify it of the fact that interference has been avoided, etc.

[0130] (Second example of collision avoidance control) Assume that there is a space in which multiple drones can pass each other in the direction of each drone's flight. Here, it is assumed that there is a space in which three drones can pass each other. In this case, up to three drones can fly in the same direction at the same time while autonomously avoiding collisions. The number of drones that can pass each other may be set in advance in association with map data, or the base station 201 may transmit information on the number of drones that can pass each other to each drone.

[0131] 13 is a diagram for explaining a second example of collision avoidance control. There are seven drones A to G. In the traveling direction of the drones A to G, there is a space 41 in which three drones can intersect.

[0132] First, the top three drones (e.g. drones A to C) are grouped in descending order of priority. The three drones A to C in the group move in parallel along the direction of travel. At this time, the drone with the highest priority among drones A to C (e.g. drone A) moves forward without taking any evasive action against the other drones (drones B and C), while drones B and C fly while taking evasive action against the drone A with the highest priority and each other drone (C or B).

[0133] Next, the top three drones (e.g. drones D to F) in order of priority from the fourth onwards are grouped into one group. The drones D to F in the second group continue to wait (temporarily wait or evacuate) until the drones A to C belonging to the first group are no longer in their direction of travel. When the drones A to C of the first group are no longer in their direction of travel, the drones D to F in the second group resume (proceed) flying along their respective directions of travel. At this time, the drone with the highest priority among the three (e.g. drone D) proceeds without performing evasive action against the other drones (drones E and F), while drones E and F fly while performing evasive action against the drone D with the highest priority and against either of the other drones (F or E).

[0134] Similarly, drones are flown simultaneously in groups of three. In the example of Fig. 13, the last drone is one (drone G), so drone G continues to move forward in the direction of travel. In this example, drones are grouped into groups of three, but the number of drones in a group may be less than three depending on the flight performance and interference recognition performance of the drones.

[0135] In the example of Fig. 13, multiple drones in a group are flown simultaneously. If a drone with poor maneuverability or poor recognition performance is the second or subsequent drone in the group, the drone may be made to wait until the other drones avoid interference.

[0136] This allows each drone to fly without colliding with another.

[0137] Fig. 14 is a flowchart of a second example of collision avoidance control performed by the control unit 13 of the drone 101. Descriptions that are the same as those in Fig. 12 will be omitted as appropriate.

[0138] It is determined whether a drone in a group higher than the group to which the drone 101 belongs is present in the direction of travel (S401). If it is present (YES), the drone 101 performs standby operation (S402). If it is not present (NO), the priority ranking of the drone 101 within the group is determined (S403). If the drone itself has the highest priority (YES), it proceeds along the direction of travel without performing evasive operation (S404). In all other cases, it proceeds along the direction of travel while performing evasive operation (S405). The targets of the evasive operation are other drones in the same group, and drones in other groups that are waiting.

[0139] (Third example of collision avoidance control) Based on the recognition performance of each drone, the priority of each drone is adjusted. Based on the adjusted priority, the behavior of each drone is determined. The adjustment of the priority and the behavior of each drone may be determined by negotiation between the drones, or one drone may be determined as the master.

[0140] As in the second example described above, assume that drones A to G exist and that there is space in the direction of the drones' movements that allows the three drones to pass each other (see Figure 13).

[0141] More specifically, based on the recognition performance of each drone, each drone is classified into a drone with high recognition performance (high recognition performance drone) and a drone with low recognition performance (low recognition performance drone). A high recognition performance drone is a drone that has the ability to recognize other drones while avoiding them. A low recognition performance drone is a drone that has no or low ability to recognize other drones while avoiding them (i.e., a drone that may lose sight of the other drone during the operation to avoid the other drone).

[0142] For example, drones may be classified as high or low recognition performance depending on the number and locations of cameras installed. For example, a drone with only one camera on the front may lose sight of the target drone during evasive maneuvers. Such a drone falls under the category of low recognition performance. On the other hand, a drone with cameras installed around, above, below, etc., can recognize the target drone even during evasive maneuvers. Such a drone falls under the category of high recognition performance.

[0143] In addition to the number and locations of cameras installed, whether a drone has high recognition performance or low recognition performance may be determined based on the angle of view or resolution. In addition to recognition performance, interference detection information or flight performance may be used to determine whether a drone has high recognition performance or low recognition performance. For example, a drone with poor maneuverability may be classified as a low recognition performance drone because it is more likely to collide with another drone without being able to avoid collisions in time. In addition, when there are seven drones including a certain drone, if a certain drone recognizes fewer than six interfering drones, the certain drone may be classified as a low recognition performance drone.

[0144] Here, drones are classified into two classes, high recognition performance and low recognition performance, but they may be classified into three classes, high recognition performance, low recognition performance, and medium recognition performance, or may be classified into four or more classes.

[0145] As an option for a low-recognition performance drone, there are options to fly it in the same direction as the drone, without making any evasive maneuvers for other drones, or to make it wait. As an option for a high-recognition performance drone, there are options to fly it while making any evasive maneuvers for other drones, to make it continue in the same direction as the drone, without making any evasive maneuvers for other drones, or to make it wait. Based on these assumptions, the priority is adjusted by negotiation between each drone.

[0146] 15, 16, and 17 are diagrams for explaining a specific example of the third example of collision avoidance control. In this example, there are seven drones (A, B, C, D, E, F, and G). In the traveling direction of the seven drones, there is a space where three drones can pass each other.

[0147] Figure 15 shows the pre-adjustment priorities and recognition performance (high or low) of seven drones.

[0148] As a premise, drones are grouped into groups of three, in descending order of priority. Groups are selected in descending order of priority, and the drone with the highest priority among the three in the group is allowed to continue in the direction of travel without taking evasive action, while the remaining two drones are allowed to take evasive action. Drones not belonging to the selected group are allowed to wait.

[0149] Under this premise, and under the current priorities (priorities before adjustment), the first group is drones A, B, and C. This first group is called group 1. Drone A has the highest priority within group 1, so it is necessary to have drone A continue on in the direction of travel without taking evasive action. Drones B and C, which have the second and third priorities, need to take evasive action, but drone C cannot be made to take evasive action because it has low recognition performance. For this reason, it is necessary to adjust the priority of drone C so that it becomes the highest priority within any of the groups, in other words, so that it can continue on in the direction of travel without taking evasive action.

[0150] Similarly, the second group (called group 2) consists of drones D, E, and F. Drone D has the highest priority within group 2, so it is necessary to allow drone D to continue in the direction of travel without taking evasive action. Drones E and F, which have the second and third priorities, need to take evasive action, but drone E cannot take evasive action because it has low recognition performance. For this reason, it is necessary to adjust the priority of drone E so that it has the highest priority within any of the groups, in other words, so that it can continue in the direction of travel without taking evasive action.

[0151] Finally, drone G remains as the third group (group 3). Since drone G has the highest priority, it can continue moving forward in the direction it is moving without taking evasive action.

[0152] Figure 16 shows an example of the procedure for adjusting the priorities of drones C and E, which require priority adjustment, so that their priorities become the highest within each of their groups. Operation O1 swaps drone C's priority 3 with drone D's priority 4. Operation O2 sets drone E's priority to 7, the highest priority within group 3. Operation O3 raises drone F's priority from 6 to 5. Operation O4 raises drone G's priority from 7 to 6.

[0153] Figure 17 shows the results of adjusting the priority. Drone C, which has low recognition performance, has the highest priority in Group 2. Drone E, which has low recognition performance, has the highest priority in Group 3.

[0154] FIG. 18 shows an example of making each drone act according to the adjusted priority shown in FIG. 17. First, group 1 including drones A, B, and D is targeted in order of priority. Drone A, which has the highest priority in group 1, proceeds without taking evasive action, while drones B and D proceed while taking evasive action. Drones C, F, G, and E wait while drones A, B, and D proceed. After drones A, B, and D have completed their progress, group 2 including drones C, F, and G is targeted in order of priority. Drone C, which has the highest priority in group 2, proceeds without taking evasive action, while drones F and G proceed while taking evasive action. Drone E waits while groups C, F, and G proceed. After groups C, F, and G have completed their progress, group 3 including drone E is targeted in order of priority. Drone E, which has the highest priority in group 3, proceeds without taking evasive action.

[0155] Fig. 19 is a flowchart of a third example of collision avoidance control performed by the control unit 13 of the drone 101. Descriptions that are the same as those in Figs. 12 and 14 will be omitted as appropriate.

[0156] The difference from Fig. 14 is that step S501 for adjusting the priority is added at the beginning. The other steps are the same as in Fig. 14.

[0157] In step S501, the priority of each drone is adjusted so that the drone with low recognition performance has the highest priority in the group. The priority adjustment is performed by negotiation between the drones. Alternatively, one drone may become the master and adjust the priority of each drone.

[0158] As described above, according to this embodiment, another drone that has entered the path of the drone is detected based on image data captured by the drone. The priority of the drone and the detected drone is determined according to at least one of the recognition performance, flight performance, and flight purpose, and an action to prevent a collision is determined according to the priority, and the determined action is executed. Examples of the action include multiple types such as proceeding along the route without performing an avoidance action, proceeding along the route while performing an avoidance action, and waiting action (temporarily stopping or taking refuge in the sky, etc.). Therefore, appropriate action to prevent a collision can be determined in consideration of the recognition performance, flight performance, and flight purpose of the drone and the other drone. In addition, even if the other drone does not recognize the drone and cannot communicate with the drone, the priority of the other drone can be determined to be high and the other drone can be flown preferentially to prevent a collision.

[0159] (Hardware configuration) Fig. 20 shows an example of the hardware configuration of the drone 101 in Fig. 2 or the base station 201 in Fig. 3. The information processing device 1 of the drone 101 in Fig. 2 or the base station 201 in Fig. 3 is configured with a computer device 200. The computer device 200 includes a CPU 201, an input interface 202, a display device 203, a communication device 204, a main memory device 205, and an external memory device 206, which are connected to each other by a bus 207. At least one of these elements may not be included in the information processing device 1 or the base station 201.

[0160] The CPU (Central Processing Unit) 201 executes a computer program on the main memory device 205. The computer program is a program that realizes each of the above-mentioned functional configurations of the information processing device 1 or the base station 201. The computer program may be realized by a combination of multiple programs or scripts, rather than a single program. Each functional configuration is realized by the CPU 201 executing the computer program.

[0161] The input interface 202 is a circuit for inputting operation signals from input devices such as a keyboard, a mouse, and a touch panel to the information processing device 1 or the base station 201.

[0162] The display device 203 displays data stored in the information processing device 1 or the base station 201 or data calculated by the information processing device 1 or the base station 201. The display device 203 is, for example, an LCD (liquid crystal display), an organic electroluminescence display, a CRT (cathode ray tube), or a PDP (plasma display), but is not limited to these.

[0163] The communication device 204 is a circuit for the information processing device 1 or the base station 201 to communicate with an external device wirelessly or via a wire. Data used in the information processing device 1 or the base station 201 can be input from an external device via the communication device 204. The communication device 204 includes an antenna. The data input from the external device can be stored in the main memory device 205 or the external memory device 206.

[0164] The primary storage device 205 stores computer programs, data necessary for executing the computer programs, data generated by executing the computer programs, and the like. The computer programs are deployed and executed on the primary storage device 205. The primary storage device 205 is, for example, a RAM, a DRAM, or an SRAM, but is not limited to these. The storage unit in FIG. 2 or FIG. 3 may be constructed on the primary storage device 205.

[0165] The external storage device 206 stores computer programs, data necessary for executing the computer programs, data generated by executing the computer programs, etc. These computer programs and data are read into the main storage device 205 when the computer programs are executed. The external storage device 206 is, for example, a hard disk, an optical disk, a flash memory, and a magnetic tape, but is not limited to these. The storage unit in FIG. 2 or FIG. 3 may be constructed on the external storage device 206.

[0166] The computer program may be pre-installed in the computer device 200, or may be stored in a storage medium such as a CD-ROM. The computer program may also be uploaded onto the Internet.

[0167] Furthermore, computer device 200 may be configured as a single device, or may be configured as a system made up of multiple computer devices connected to each other.

[0168] Second embodiment In the third example of the collision avoidance control in the first embodiment, the priority adjustment (step S501 in FIG. 19) is performed using the recognition performance, but the priority adjustment may be performed using other information in addition to or instead of the recognition performance. For example, the priority adjustment may be performed using the flight purpose.

[0169] For example, when drones interfere with each other's flight objectives, the priorities may be adjusted. As a specific example, assume that drone A's flight objective is to photograph the ground surface, and drone B's flight objective is to photograph vehicles traveling on a road. In this case, if drone A flies while avoiding drone B, and as a result drone B comes below drone A or drone A's body tilts, this will hinder drone A's photography. A similar problem occurs when drone B avoids drone A. In such a case, the priorities are adjusted so that drone A and drone B can proceed without performing evasive actions. For example, drone A and drone B are each placed in a separate group, and are given the highest priority within the group.

[0170] As another specific example, suppose that drone A's flight purpose is to photograph the ground surface, and drone B's flight purpose is to transport luggage. In this case, drone A is set to the highest priority within the group, and drone B, if it is in the same group as drone A, is set to a lower priority than drone A. This allows drone A to proceed without taking evasive action, so there is no disruption to photography. Drone B's purpose is to transport luggage, so there is no disruption even if it takes evasive action.

[0171] According to the second embodiment, it is possible to adjust the priority by using information other than the recognition performance.

[0172] (Third embodiment) When a drone communicates with another drone (interfering drone) detected based on image data to obtain information about the other drone, if it takes time to obtain the information, it may not be able to take action to prevent the collision in time and may collide with the other drone. Therefore, the time until the collision with the detected other drone may be calculated, and the type of information obtained from the other drone may be limited depending on the calculated time.

[0173] For example, the control unit 13 of the drone 101 calculates the time until collision with the interfering drone based on the speed of the drone itself, the speed of the interfering drone, the distance from the drone itself to the interfering drone, and the braking performance of the drone itself.

[0174] As a concrete example, the speed of your drone is 20 m / s, and the position of the interfering drone is 20 m ahead in the direction of your drone's travel. Your drone has the braking capability to stop at 20 m / s in 1 second. The interfering drone is temporarily stopped to take pictures. In this case, the time until collision is 1 second. If the interfering drone is flying in the direction of your drone, this time will be even shorter.

[0175] Priority is set in advance for the types of information to be acquired from interfering drones. For example, the priority order may be [1] position, speed, recognition performance, [2] flight purpose, [3] flight performance, and [4] others. The types of information to be acquired are limited according to time.

[0176] As an example, when the time is equal to or less than α, information [1] is acquired; when the time is equal to or more than α and less than β, information [1] to [2] is acquired; when the time is equal to or more than β and less than γ, information [1] to [3] is acquired; and when the time is equal to or more than γ, information [1] to [4] is acquired. The above-described example is merely illustrative, and other examples may be used. The more types of information are acquired, the more appropriate the priority determination becomes possible. Note that the above-described priority order is merely an example, and other examples may be used.

[0177] If there are two or more interfering drones, the system calculates the time until collision with each of the interfering drones, and calculates the allowable time for communication with each interfering drone based on the shortest time. Only the type of information corresponding to the calculated time is obtained from each interfering drone.

[0178] According to the third embodiment, by limiting the information to be acquired depending on the time until a collision with an interfering drone occurs, it is possible to determine actions to prevent a collision before a collision with an interfering drone occurs.

[0179] (Fourth embodiment) In the first to third embodiments described above, the priority is determined mainly by negotiation between the drones, but in the fourth embodiment, the base station 201 determines the priority.

[0180] The control unit 52 (see FIG. 3) of the base station 201 receives a notification of detection of an interfering drone from the drone (assumed to be drone A) that detected the interfering drone via the communication unit 51. The control unit 52 communicates with drone A to obtain information about drone A (position, speed, direction of travel, recognition performance, flight purpose, flight performance, interference detection information, etc.). The control unit 52 communicates with an interfering drone (assumed to be drone B) that is present at the position indicated in the interference detection information to obtain information about drone B (position, speed, direction of travel, recognition performance, flight purpose, flight performance, interference detection information, etc.).

[0181] The control unit 52 determines the priority of the drones A and B in the same manner as in the first to third embodiments, and transmits information on the determined priority to the drones A and B. The priority information is information for the drones A and B to determine actions to prevent collisions with each other.

[0182] Each of drone A and drone B decides an action based on the received priority and executes the decided action. For example, in the case of following the first example of the collision avoidance control of the first embodiment, the drone with the higher priority advances in the direction of travel first. The other drone waits until the one drone completes its travel (until the one drone is no longer in the other drone's direction of travel). When the one drone completes its travel, the other drone starts traveling.

[0183] Here, an example of two drones is shown, but the same applies to the case of three or more drones. When receiving notification of detection of an interfering drone from two or more drones, the base station 201 similarly acquires information about each drone and determines the priority. Then, it transmits the determined priority information to each drone. In addition, the example of collision avoidance control is not limited to the first example, but may be the second or third example.

[0184] According to the fourth embodiment, the base station 201 determines the priority, thereby reducing the computational load of the drone. In addition, since the base station 201 usually has higher computational performance than the drone, it can determine the priority at high speed even when many types of information are used. In addition, when the priority is determined by negotiation between the drones, the amount of communication between the drones increases and the control becomes complicated. However, by performing the process of determining the priority collectively at the base station 201, the amount of communication between the drones is reduced and complicated control is not required.

[0185] (Modification 1 of the fourth embodiment) After the control unit 52 of the base station 201 determines the priority of each drone, it further determines the behavior of each drone based on the determined priority. The base station 201 transmits data including information on the determined behavior to each drone. The information on the behavior is information for drones A and B to determine the behavior to prevent collision with each other.

[0186] The behavior of each drone may be determined in the same manner as in the first to third examples of the collision avoidance control in the first embodiment. Alternatively, as another example, the control unit 52 of the base station 201 may regenerate a route that allows each drone to avoid collision with another. At this time, the drone with the highest priority in the group may not regenerate the route, but may use the original route as it is. The base station 201 transmits information on the route generated for each drone to each drone. Each drone flies along the route specified by the base station 201. This method is effective not only when each drone is not capable of autonomous flight, but also when each drone is capable of autonomous flight.

[0187] According to the first variant, the base station 201 determines the behavior of each drone, thereby reducing the computational load on each drone.

[0188] Fifth embodiment In the above-mentioned fourth embodiment, the base station 201 determined the priority, but in the fifth embodiment, depending on the situation of each drone, it is possible to switch between whether the base station 201 determines the priority or the drone determines the priority.

[0189] As described in the description of the third embodiment above, when a drone acquires information about another drone (interfering drone) detected based on image data, if the acquisition takes time, there is a possibility that the drone may collide with the other drone. Therefore, the time until the collision with the detected other drone is calculated, and depending on the calculated time, it is determined whether the drone itself or the base station 201 will determine the priority. If there is time to spare, the base station 201 will determine the priority. In this case, more appropriate priority determination is possible using a lot of information (for example, all of the above-mentioned [1] to [4]). If there is not enough time, the drone itself will determine the priority. In this case, the priority is determined simply using limited information (for example, only certain information among the above-mentioned [1] to [4]).

[0190] For example, as described in the explanation of the third embodiment, the control unit 13 of the drone 101 calculates the time until collision with the interfering drone based on the speed of the drone itself, the speed of the interfering drone, the distance from the drone itself to the interfering drone, and the braking performance of the drone itself. If the time is less than a predetermined value, information about the drone 101 is transmitted to the base station 201, and the base station 201 is made to determine the priority. If the time is equal to or greater than the predetermined value, the drone 101 determines the priority.

[0191] The operation when the base station 201 determines the priority is the same as that of the fourth embodiment, and therefore the description thereof will be omitted. The operation when the drone determines the priority is the same as that of the first to third embodiments, and therefore the description thereof will be omitted.

[0192] Fig. 21 is a flowchart of an example of collision avoidance control performed by the control unit 13 of the drone in the fifth embodiment. Steps S701 to S703 are added to Fig. 10 used in the first embodiment.

[0193] When another drone is found in the traveling direction, the control unit 13 calculates the time until the collision with the other drone. If the calculated time is equal to or greater than a predetermined value, it is determined that there is sufficient time until the collision (YES in S701), and the process proceeds to step S102. Step S102 and subsequent steps are the same as those in the first embodiment.

[0194] If the calculated time is less than a predetermined value, it is determined that there is not enough time until collision (NO in S701). The control unit 13 transmits information about the drone itself to the base station 201 via the communication unit 12 (S702). The control unit 13 receives information about the priority of the drone itself and other drones determined by the base station 201 via the communication unit 12 (S703). After this, the process proceeds to step S104. Step S104 and subsequent steps are the same as in the first embodiment.

[0195] According to the fifth embodiment, when there is sufficient time before a collision with an interfering drone occurs, the base station 201 can appropriately determine the priority using a large amount of information. When there is not sufficient time, the priority can be simply determined between the drones based on limited information.

[0196] The above-described embodiment shows an example for realizing the present disclosure, and the present disclosure can be implemented in various other forms. For example, various modifications, substitutions, omissions, or combinations thereof are possible without departing from the gist of the present disclosure. Such modifications, substitutions, omissions, etc. are also included in the scope of the present disclosure, as well as in the scope of the invention and its equivalents described in the claims.

[0197] Furthermore, the effects of the present disclosure described in this specification are merely examples, and other effects may be available.

[0198] The present disclosure may also be configured as follows. [Item 1] An imaging unit that captures an image of an environment of the moving body to obtain image data; a control unit that detects another moving object present in a traveling direction of the moving object based on the image data, and performs an action to prevent a collision with the other moving object based on information about the other moving object; An information processing device comprising: [Item 2] 2. The information processing device according to item 1, wherein the control unit determines the action to prevent the collision with the other moving object and performs the action. [Item 3] The control unit, as the action, proceeding while taking evasive action against the other moving object, Whether to perform standby operation Proceed without taking any avoidance action against the other moving object, or Change the route? Do one of the following: Item 1. An information processing device according to item 1. [Item 4] The control unit is determining whether the moving body or the other moving body has priority; When the other moving object has priority, the vehicle advances while taking an avoidance action against the other moving object, or takes the waiting action, or changes the route; If the moving object has priority, the moving object proceeds without taking any avoidance action against the other moving object. Item 3. An information processing device according to item 3. [Item 5] The control unit is determining a priority of the moving body and a priority of the other moving body; Based on the priority of the moving body and the priority of the other moving body, it is determined whether the moving body or the other moving body is to be given priority. Item 5. An information processing device according to item 4. [Item 6] The information about the other moving object includes a recognition performance of an imaging unit of the other moving object, The control unit determines whether the moving object or the other moving object is to be prioritized based on the recognition performance of the imaging unit and the recognition performance of the imaging unit of the other moving object. Item 5. An information processing device according to item 5. [Item 7] The imaging unit and the imaging unit of the other moving object each include at least one camera, The recognition performance of the imaging unit and the recognition performance of the imaging unit of the other moving object are The number of cameras, The angle of view of the camera, The installation position of the camera; the resolution of said camera; is determined based on at least one of Item 7. An information processing device according to item 6. [Item 8] The recognition performance of the imaging unit is determined based on the number of the other moving objects detected by the control unit, The recognition performance of the imaging unit of the other moving body is determined based on the number of moving bodies that the other moving body recognizes in the traveling direction of the other moving body. Item 7. An information processing device according to item 6. [Item 9] The control unit is determining whether the other moving body recognizes the moving body; If it is determined that the other moving body does not recognize the moving body, the other moving body is given priority. Item 5. An information processing device according to item 4. [Item 10] The information about the other moving body includes a purpose of movement of the other moving body, The control unit determines whether the moving body or the other moving body has priority based on a movement purpose of the moving body and a movement purpose of the other moving body. Item 5. An information processing device according to item 4. [Item 11] The information about the other moving object includes a mobility performance of the other moving object, The control unit determines whether the moving body or the other moving body is to have priority based on the mobility performance of the moving body and the mobility performance of the other moving body. Item 5. An information processing device according to item 4. [Item 12] The information about the other moving object includes a speed of the other moving object, The control unit determines whether the moving body or the other moving body has priority based on a speed of the moving body and a speed of the other moving body. Item 5. An information processing device according to item 4. [Item 13] The control unit calculates a time until the moving object collides with the other moving object, determining whether the control unit or the base station should determine which of the moving object and the other moving object should have priority, depending on the time; If the base station decides to do so, sending a request to the base station to make the decision. Item 5. An information processing device according to item 4. [Item 14] The control unit is Calculate the time until the moving object collides with the other moving object; determining the type of information to obtain based on the time; The information acquisition unit acquires the information of the determined type. Item 1. An information processing device according to item 1. [Item 15] The information about the other moving body includes at least one of a position of the other moving body and a distance to the other moving body. Item 14. An information processing device according to item 13. [Item 16] The moving object is an air vehicle. Item 1. An information processing device according to item 1. [Item 17] A computer program for causing a computer mounted on a moving object to execute the program, An imaging step of acquiring image data by imaging an environment including a traveling direction of the moving object; a detection step of detecting another moving object present in the traveling direction of the moving object based on the image data; a control step of taking an action to prevent a collision with the other moving object based on information about the other moving object; A computer program comprising: [Item 18] A method performed by a mobile entity, comprising: Acquiring image data by capturing an image of an environment including a traveling direction of the moving object; Detecting another moving object present in the traveling direction of the moving object based on the image data; Taking action to prevent a collision with the other moving object based on information about the other moving object. [Item 19] A communication system including a plurality of mobile objects and a base station, The plurality of moving bodies An imaging unit that captures an image of an environment including a traveling direction of the moving object to obtain image data; A control unit that detects another moving object present in the traveling direction of the moving object based on the image data; A communication unit that communicates with the base station, The base station, A communication unit that communicates with the mobile object; an information acquisition unit that acquires information about the moving object and the image data from the moving object; a control unit that generates information for determining an action for preventing a collision between the moving body and the other moving body based on information about the moving body and the image data, and transmits the generated information to the moving body. Communication systems. [Explanation of symbols]

[0199] 1: Information processing device 101, 101A-101C, A-G: drones, 201: base station, 10: antenna, 11: imaging unit, 14A to 14D: rotors, 15A to 15D: motors, 13: control unit, 12: communication unit, 16: sensor unit, 17: position detection unit, 18: battery, 19: storage unit, 20: information acquisition unit, 31: Image data, 41: Space, 50: antenna, 51: communication unit, 52: control unit, 53: storage unit O1~O4: Operation 200: computer device, 201: CPU, 202: input interface, 203: display device, 204: communication device, 205: main memory device, 206: external memory device, 207: bus,

Claims

1. An imaging unit that captures an image of an environment including a moving direction of the moving object to obtain image data; a control unit that detects another moving object present in the traveling direction of the moving object based on the image data, determines which of the moving object and the other moving object has priority based on the recognition performance of the imaging unit and information about the other moving object including the recognition performance of the imaging unit of the other moving object, and takes action to prevent a collision with the other moving object; An information processing device comprising:

2. The imaging unit and the imaging unit of the other moving object each include at least one camera, The recognition performance of the imaging unit and the recognition performance of the imaging unit of the other moving object are The number of cameras, The angle of view of the camera, The installation position of the camera; the resolution of said camera; is determined based on at least one of The information processing device according to claim 1 .

3. The recognition performance of the imaging unit is determined based on the number of the other moving objects detected by the control unit, The recognition performance of the imaging unit of the other moving body is determined based on the number of moving bodies that the other moving body recognizes in the traveling direction of the other moving body. The information processing device according to claim 1 .

4. The control unit determines the action to prevent a collision with the other moving object and performs the action. The information processing device according to claim 1 .

5. The control unit, as the action, proceeding while taking evasive action against the other moving object, Whether to perform standby operation Proceed without taking any avoidance action against the other moving object, or Change the route? Do one of the following: The information processing device according to claim 1 .

6. The control unit is determining whether the moving body or the other moving body has priority; When the other moving object has priority, the vehicle advances while performing an avoidance operation for the other moving object, performs the waiting operation, or changes the route; If the moving object has priority, the moving object proceeds without taking any avoidance action against the other moving object. The information processing device according to claim 5 .

7. The control unit is determining a priority of the moving body and a priority of the other moving body; Based on the priority of the moving body and the priority of the other moving body, it is determined whether the moving body or the other moving body has priority. The information processing device according to claim 6.

8. The information on the other moving body includes a travel purpose of the other moving body, and the control unit determines whether the other moving body or the other moving body is to have priority based on the travel purpose of the other moving body and the travel purpose of the other moving body. The information processing device according to claim 6.

9. The information about the other moving object includes a mobility performance of the other moving object, The control unit determines whether the moving body or the other moving body is to have priority based on the mobility performance of the moving body and the mobility performance of the other moving body. The information processing device according to claim 6.

10. The information about the other moving object includes a speed of the other moving object, The control unit determines whether the moving body or the other moving body has priority based on a speed of the moving body and a speed of the other moving body. The information processing device according to claim 6.

11. The control unit calculates a time until the moving object collides with the other moving object, determining whether the control unit or the base station should determine which of the moving object and the other moving object should have priority, depending on the time; If the base station decides to do so, sending a request to the base station to make the decision. The information processing device according to claim 6.

12. An information acquisition unit that acquires information about the other moving object, The control unit is Calculate the time until the moving object collides with the other moving object; determining the type of information to obtain based on the time; The information acquisition unit acquires the information of the determined type. The information processing device according to claim 1 .

13. The information about the other moving body includes at least one of a position of the other moving body and a distance to the other moving body. The information processing device according to claim 11.

14. The moving object is an air vehicle. The information processing device according to claim 1 .

15. An imaging unit that captures an image of an environment including a moving direction of the moving object to obtain image data; a control unit that detects another moving object present in the traveling direction of the moving object based on the image data, and performs an action to prevent a collision with the other moving object based on information about the other moving object; Equipped with The control unit, as the action, proceeding while taking evasive action against the other moving object, Whether to perform standby operation Proceed without taking any avoidance action against the other moving object, or Change the route? Do one of the following: the control unit determines whether the moving object or the other moving object has priority; When the other moving object has priority, the vehicle advances while performing an avoidance operation for the other moving object, performs the waiting operation, or changes the route; If the moving object has priority, it proceeds without taking any avoidance action against the other moving object; In addition, the control unit determining whether the other moving body recognizes the moving body; When it is determined that the other moving bodies do not recognize the moving body, the information processing device gives priority to the other moving bodies.

16. A computer program for causing a computer mounted on a moving object to execute the program, An imaging step of acquiring image data by imaging an environment including a traveling direction of the moving object using an imaging unit; a detection step of detecting another moving object present in the traveling direction of the moving object based on the image data; a control step of determining which of the moving body and the other moving body has priority based on the recognition performance of the imaging unit and information about the other moving body including the recognition performance of the imaging unit of the other moving body, and taking an action to prevent a collision with the other moving body; A computer program comprising:

17. A method performed by a mobile entity, comprising: An image capturing unit captures an image of an environment including a traveling direction of the moving object to obtain image data; Detecting another moving object present in the traveling direction of the moving object based on the image data; A method for determining whether the moving body or the other moving body has priority based on the recognition performance of the imaging unit and information about the other moving body including the recognition performance of the imaging unit of the other moving body, and taking action to prevent a collision with the other moving body.

18. A communication system including a plurality of mobile objects and a base station, The plurality of moving bodies an imaging unit that captures an image of an environment including a traveling direction of the moving object to obtain image data; A control unit that detects another moving object present in the traveling direction of the moving object based on the image data; A communication unit that communicates with the base station, The base station, A communication unit that communicates with the mobile object; an information acquisition unit that acquires information about the moving object, including the recognition performance of the imaging unit, and the image data from the moving object; a control unit that determines which of the plurality of moving bodies has priority based on information about the moving body and the image data, generates information for determining an action to be taken by the moving body to prevent collision with the other moving body, and transmits the generated information to the moving body. Communication systems.

Images