Information processing device, information processing method, and program

The information processing device for drones addresses the risk of theft by using detection and determination units to verify authorized access and generating an emergency flight control signal to secure the drone's departure from the port, thereby reducing theft risks even in areas with inadequate monitoring.

JP7675957B1Active Publication Date: 2025-05-13KDDI CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2025002058
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2025-01-07
Publication Date
2025-05-13
Estimated Expiration
2045-01-07

AI Technical Summary

Technical Problem

Conventional surveillance technologies using drones face risks of theft, especially in areas with inadequate human monitoring, due to the presence of expensive components and sensitive information.

Method used

An information processing device equipped with a detection unit to identify individuals around the drone's port, a determination unit to verify permission, and a generation unit to create an emergency flight control signal, causing the drone to leave the port if unauthorized access is detected.

Benefits of technology

This solution effectively reduces the risk of drone theft by enabling autonomous detection and response to unauthorized access, even in areas with limited human monitoring.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007675957000001_ABST
    Figure 0007675957000001_ABST
Patent Text Reader

Abstract

Reduce the risk of drone theft. [Solution] The information processing device comprises a detection unit that detects whether a person is present in the vicinity of a port where the aircraft is waiting, a judgment unit that determines whether the detected person is a person who has been authorized by the administrator of the aircraft based on the detection result by the detection unit, and a generation unit that generates an emergency flight control signal to control the flight of the aircraft to leave the port, assuming that an abnormality has occurred if the detected person is determined to be an unauthorized person based on the judgment result by the judgment unit.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] Conventionally, a surveillance technology that flies an unmanned aerial vehicle such as a drone is known. The subject of surveillance may be a predetermined range or a specific object to be monitored (such as a vehicle or a plant). For example, Patent Document 1 discloses a surveillance system that can perform tracking flight by an aerial vehicle for a long period of time. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2024-040769 A Summary of the Invention [Problem to be solved by the invention]

[0004] Using such conventional technology, it is conceivable to deploy drones in mountainous regions and other areas where human surveillance is inadequate, and have them autonomously monitor a specified area. When autonomous surveillance is performed using a drone, the drone is deployed in a location where no one is present (i.e., a location where human surveillance is inadequate) due to takeoff and landing for charging, etc. Here, various expensive parts are usually used in the drone's body, and the drone itself is highly valuable, so there is a possibility that the drone itself or the parts used in the drone will be stolen for the purpose of selling it. In addition, there are cases where highly confidential information remains in the drone's internal memory, and there is a possibility that the drone will be stolen in order to obtain the information.

[0005] In order to deal with such risks, it is conceivable to install an alarm device on the drone itself or on the drone's takeoff and landing port, etc. Such an alarm device is intended to activate the alarm when a theft is suspected, in the hope that the thief will escape. However, in areas where surveillance by humans is poor, such as mountainous regions, it may take a long time for an administrator or security service provider to arrive, so there may be enough time for the theft to occur and the alarm may not be effective. In other words, since there is a risk of drone theft in the conventional technology, it can be said that there has been a demand for creating an environment where drones are less likely to be stolen.

[0006] The present invention has been made in consideration of the above circumstances, and its purpose is to provide an information processing device, an information processing method, and a program that can reduce the risk of drone theft. [Means for solving the problem]

[0007] (1) One aspect of the present invention is an information processing device that includes a detection unit that detects whether a person is present in the vicinity of a port where an aircraft is waiting; a determination unit that determines whether the detected person is a person who has been authorized by an administrator of the aircraft based on the detection result by the detection unit; and a generation unit that, if it is determined that the detected person is an unauthorized person based on the determination result by the determination unit, generates an emergency flight control signal that controls the flight of the aircraft to leave the port, as an abnormality has occurred. (2) Also, one aspect of the present invention is that in the information processing device described above in (1), the generation unit generates the emergency flight control signal in an abnormality as a control different from a flight control signal in a normal situation. (3) Also, one aspect of the present invention is that in the information processing device described above in (2), the generation unit generates the emergency flight control signal in the event of an abnormality so as to control flight to fly above an altitude for departure under normal circumstances. (4) Furthermore, one aspect of the present invention is an information processing device in any of (1) to (3) described above, further comprising a reporting unit that reports to a location designated by an administrator when a person is determined to be an unauthorized person based on the judgment result by the judgment unit. (5) Furthermore, one aspect of the present invention is an information processing device according to any of (1) to (4) described above, further comprising a detection unit that detects vibrations of the flying object or the port, and when vibrations are detected by the detection unit, the detection unit is enabled to detect whether a person is present in the vicinity of the port. (6) Furthermore, in one aspect of the present invention, in any of the information processing devices described above in (1) to (5), the detection unit includes an imaging unit that images the area around the port, and detects whether or not a person is present in the captured image by performing image analysis on the image information captured by the imaging unit. (7) Furthermore, one aspect of the present invention is that in any of the information processing devices described above in (1) to (6), the generation unit generates, in the event of an abnormality, an emergency flight control signal to activate an imaging function of the aircraft, cause the aircraft to detach from the port, and capture an image of the area surrounding the port. (8) Furthermore, in one aspect of the present invention, in the information processing device described above in (7), the generation unit does not activate the imaging function when the remaining battery charge of the aircraft is below a predetermined value even when an abnormality occurs. (9) Also, one aspect of the present invention is that in any of the information processing devices described above in (1) to (8), the generation unit enables a self-location information acquisition function that acquires and outputs location information of the aircraft if the aircraft fails to leave the port. (10) Furthermore, one aspect of the present invention is that in any of the information processing devices described above in (1) to (9), the generation unit erases or renders a pre-designated memory unreadable if the aircraft fails to leave the port. (11) Another aspect of the present invention is an information processing device that includes a detection unit that detects whether a person is present in the vicinity of a port where an aircraft is waiting, a determination unit that determines whether the detected person is a person who has been authorized by an administrator of the aircraft based on the detection result by the detection unit, and a generation unit that generates an emergency flight control signal that controls the flight of the aircraft to prevent it from landing at the port, when the determination unit determines that the detected person is an unauthorized person based on the determination result by the determination unit. (12) Another aspect of the present invention is an information processing method executed by a computer, comprising: a detection step of detecting whether or not a person is present in the vicinity of a port where the aircraft is waiting; a determination step of determining whether or not the detected person is a person who has been authorized by an administrator of the aircraft based on the detection result by the detection step; a generating step of generating an emergency flight control signal for controlling the flight of the aircraft to leave the port when it is determined that the person is an unauthorized person based on the determination result by the determining step, as an abnormality; An information processing method comprising the steps of: (13) Another aspect of the present invention is a program that causes a computer to execute a detection step of detecting whether or not a person is present in the vicinity of a port where an aircraft is waiting; a determination step of determining, based on a detection result from the detection step, whether or not the detected person is a person who has been authorized by an administrator of the aircraft; and a generation step of generating an emergency flight control signal that controls the flight of the aircraft to leave the port, assuming that an abnormality has occurred if it is determined that the detected person is an unauthorized person based on the determination result from the determination step. Effect of the Invention

[0008] According to the present invention, it is possible to provide an information processing device, an information processing method, and a program that can reduce the risk of drone theft. [Brief description of the drawings]

[0009] [Figure 1]FIG. 1 is a diagram illustrating an overview of a system according to an embodiment. [Diagram 2] FIG. 1 is a diagram showing an image of a port where drones in this embodiment take off and land. [Diagram 3] FIG. 13 is a diagram showing an image of a modified example of a port where drones in this embodiment take off and land. [Figure 4] FIG. 2 is a functional configuration diagram showing the functional configuration of the information processing device according to the present embodiment. [Diagram 5] 1 is a functional configuration diagram showing an example in which an information processing device according to the present embodiment is provided in a port. [Figure 6] FIG. 2 is a functional configuration diagram showing an example in which the information processing device according to the present embodiment is provided in a server. [Figure 7] A functional configuration diagram showing an example of a case where an information processing device according to this embodiment is provided in a drone. [Figure 8] 4 is a flowchart showing a series of steps of an information processing method according to the present embodiment. [Figure 9] FIG. 2 is a functional configuration diagram showing a first modified example of the functional configuration of the information processing device according to the present embodiment. [Figure 10] FIG. 11 is a functional configuration diagram showing a second modified example of the functional configuration of the information processing device according to the present embodiment. [Figure 11] FIG. 11 is a functional configuration diagram showing a third modified example of the functional configuration of the information processing device according to the present embodiment. [Figure 12] 2 is a block diagram showing an example of an internal configuration of an information processing device according to the present embodiment. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] [Embodiment] The information processing device, information processing method, and program according to the aspects of the present invention will be described in detail below with reference to the accompanying drawings, showing preferred embodiments. Note that the aspects of the present invention are not limited to these embodiments, and include various modifications or improvements. In other words, the components described below include those that a person skilled in the art can easily imagine, and those that are substantially the same, and the components described below can be appropriately combined. In addition, various omissions, substitutions, or modifications of the components can be made without departing from the gist of the present invention. In addition, in the following drawings, the scale and number of each structure may be different from the scale and number of the actual structure in order to make each structure easier to understand.

[0011] [System Configuration] FIG. 1 is a diagram showing an outline of a system according to an embodiment. The system 1 includes a drone 10 and a flight management device 30, and monitors or inspects a facility 50. Although the figure shows one facility 50 for the sake of simplicity, the system 1 may monitor multiple facilities 50. Although the figure shows one drone 10 for the sake of simplicity, multiple drones 10 may be provided. In this case, the multiple drones 10 may each perform wireless communication with a common flight management device 30, or each may perform wireless communication with an independent flight management device 30. In other words, the relationship between the flight management device 30 and the drones 10 may be 1:N (N is a natural number equal to or greater than 1) or N:N.

[0012] The facility 50 is a facility that is the subject of monitoring or inspection by the system 1. The facility 50 may be a communication tower (which may also be called a base station) used for wireless communication. The facility 50 may also be a solar power generation facility or other facility that is fixed to land outdoors. Other examples of facilities that are the subject of monitoring by the system 1 include power transmission lines and towers, as well as bridges, tunnels, industrial facilities, and the like. The system 1 may also be used in areas where some facilities exist, such as farmland, forests, rivers, coastlines, and the like.

[0013] The flight management device 30 manages the flight of the drone 10. Specifically, the flight management device 30 issues flight instructions to the drone 10 and monitors the facility 50. Monitoring the facility 50 may, for example, be monitoring that objects provided in the facility 50 are not stolen. Specifically, when the facility 50 is a solar power generation facility, the objects provided in the facility 50 may be electric wires, solar panels, and the like. In addition to flying around the facility 50, monitoring the facility 50 may also include, for example, capturing images around the facility 50 and detecting intruders around the facility 50.

[0014] The drone 10 flies around the facility 50 and performs monitoring based on instructions from the flight management device 30. The drone 10 may take images of the area around the facility 50 and detect intruders around the facility 50 based on instructions from the flight management device 30. Note that in this embodiment, it is assumed that the drone 10 is capable of flying. In the following description, the drone 10 may also be referred to as an air vehicle.

[0015] The information processing device, information processing method, and program according to the present embodiment are preferably applied to the flight of the drone 10 using the above-described system 1. However, the present embodiment is not limited to this example, and may be used to determine candidates for takeoff and landing points of various aircraft.

[0016] In the following embodiments, when "takeoff or landing" is described, it means at least one of takeoff or landing, and does not necessarily mean both takeoff and landing.

[0017] In addition, in the system 1, the facility 50 is described as an object to be monitored or inspected by the drone 10, but the present embodiment does not necessarily require the facility 50. In other words, the present embodiment can be widely applied to any system in which the drone 10 takes off and lands, and the purpose of the drone 10's takeoff and landing is not limited to monitoring, inspection, or the like.

[0018] [port] FIG. 2 is a diagram showing an image of a port where a drone according to this embodiment takes off and lands. An example of the port 40 will be described with reference to the figure. The drone 10 takes off from the port 40 shown in the figure, for example, and lands on the port 40 after completing tasks such as monitoring and inspection. The port 40 can also be said to be a place where the drone 10 is kept waiting. The port 40 has the minimum function of having a place where the drone 10 is kept waiting. In this embodiment, the various functions of the port 40 are not limited, and this embodiment is applicable to various types of ports 40.

[0019] In the example shown in FIG. 2, the port 40 has an openable / closable lid 42. Specifically, the port 40 has a lid 42-1 and a lid 42-2 that can be opened and closed in the left-right direction. When the lid 42 is in an open state, the takeoff and landing section 43 is exposed to the outside, and when the lid 42 is in a closed state, the takeoff and landing section 43 is blocked from the outside. When the lid 42 is in a closed state while the drone 10 is landing on the takeoff and landing section 43, the drone 10 is stored inside the port 40 and cannot be touched by outsiders, thereby reducing the risk of theft. Note that FIG. 2(A) shows an image of the lid 42 in an open state, and FIG. 2(B) shows an image of the lid 42 in a closed state.

[0020] Here, a predetermined range AR is set in the vicinity of the port 40. The predetermined range AR is a range having a predetermined area, and its shape is not particularly limited. For example, the predetermined range AR may be a circle with a radius R centered on the port 40. Alternatively, the predetermined range AR may have a shape that takes into consideration structures (e.g., buildings) around the port 40.

[0021] The port 40 detects whether a person is present within a predetermined range AR. Specifically, the port 40 may detect whether a person is present within the predetermined range AR using a camera, an infrared sensor, or the like. When a person is present within the predetermined range AR and the person is a suspicious person, the port 40 performs a process to reduce the risk of theft. The process to reduce the risk of theft may be, for example, a process to control the cover part 42 from an open state to a closed state while the drone 10 is landing on the takeoff and landing part 43, or may be a process to take off the drone 10 to prevent theft by a suspicious person.

[0022] It should be noted that the object that is detected as to whether the port 40 is within the predetermined range AR is not limited to the example of a person, and may be an object that may steal or damage the drone 10. The object that may steal or damage the drone 10 may be, for example, a moving object such as a robot or an animal, or an object such as a bug net or a bullet.

[0023] In addition, the predetermined range AR is depicted two-dimensionally in the figure. However, the present embodiment is not limited to this example, and the predetermined range AR may be set as a three-dimensional range. In other words, by setting a three-dimensional range, the port 40 can detect intrusion from the sky and reduce the risk of theft from the sky.

[0024] FIG. 3 is a diagram showing an image of a modified port from which a drone according to this embodiment takes off and lands. An example of a port 40A will be described with reference to the same figure. The port 40A is a modified version of the port 40 described above. The port 40A differs from the port 40 in that the port 40A is provided with a shutter section 44 instead of the lid section 42. In the following description, when the port 40 and the port 40A are not distinguished from each other and both are referred to inclusively, they may be simply referred to as the port 40. Note that the predetermined range AR is common to the port 40 and the port 40A, and therefore description thereof will be omitted.

[0025] The drone 10 enters the port 40A from the side and lands on the takeoff and landing section 43. The shutter section 44 simply opens and closes in the vertical direction to block the drone 10 from the outside or expose the drone 10 to the outside. Specifically, when the shutter section 44 is in the open state, the takeoff and landing section 43 is exposed to the outside, and when the shutter section 44 is in the closed state, the takeoff and landing section 43 is blocked from the outside. When the shutter section 44 is in the closed state while the drone 10 is landing on the takeoff and landing section 43, the drone 10 is stored inside the port 40 and cannot be touched by outsiders, thereby reducing the risk of theft. Note that FIG. 3(A) shows an image of the shutter section 44 in the open state, and FIG. 3(B) shows an image of the shutter section 44 in the closed state.

[0026] [Information processing device] FIG. 4 is a functional configuration diagram showing the functional configuration of the information processing device according to this embodiment. With reference to the same figure, an example of the functional configuration of the information processing device 80 will be described. The information processing device 80 is configured to control the port 40 as described above. The information processing device 80 may be provided in the port 40, may be provided in the drone 10, or may be provided in a server device (not shown). An example of the case where the information processing device 80 is provided in each configuration will be described later with reference to FIGS. 5 to 7.

[0027] The information processing device 80 may perform its functions by executing an application installed in, for example, a general computer. A specific example of such an application is an application provided as a dedicated application. Another specific example of such an application is a WEB browser application. Such an application may be installed in a specific computer in advance, or may be downloaded each time information processing is performed. For example, when implemented as a WEB browser application, the computer may download and execute the application from a device (which may be the WEB server itself or another server, for example) designated by the WEB server in response to the computer connecting to the specific WEB server, under the control of the WEB server. In this case, the information processing device 60 operates according to the program of the application being executed.

[0028] The information processing device 80 includes a detection unit 81, a determination unit 82, a generation unit 83, and a storage unit 89 as functional components.

[0029] The detection unit 81 detects whether or not a person is present around the port 40 where the drone 10 is waiting. Specifically, the periphery of the port 40 may be the range AR shown in Fig. 2 and Fig. 3. More specifically, the detection unit 81 may perform detection using an imaging device that captures images and moving images, an infrared sensor, or the like.

[0030] The determination unit 82 determines whether or not the detected person is a person who has obtained permission from the administrator of the drone 10, based on the detection result by the detection unit 81. Here, a list of people who have obtained permission from the administrator of the drone 10 may be stored in the storage unit 89. For example, the storage unit 89 may store identification information such as features acquired from an image of a person who has obtained permission from the administrator of the drone 10, or an identification number of the person. The determination unit 82 may perform the determination by processing an image obtained by the detection unit 81, for example. In addition, the determination unit 82 may determine whether or not the person is authorized, based on information acquired by an identification information acquisition unit (not shown) in a non-contact manner from a device held by the person.

[0031] 4, for ease of explanation, the information processing device 80 is configured to include a storage unit 89. However, the storage unit 89 does not necessarily have to exist inside the information processing device 80. For example, the storage unit 89 may exist on a configuration different from the information processing device 80, such as a cloud.

[0032] If it is determined based on the determination result by the determination unit 82 that the person is an unauthorized person, the generation unit 83 generates an emergency flight control signal, assuming that an abnormality has occurred. The emergency flight control signal is a signal for flight control to cause the drone 10 to leave the port 40. Based on the emergency flight control signal, the drone 10 quickly leaves the port 40 and avoids the risk of theft. This is because if the drone 10 leaves the port 40, the risk of theft can be reduced (unless the thief pursues it into the air).

[0033] It can be said that the emergency flight control signal and the flight control signal in normal times are different control signals. In normal times, it is required to take off the drone 10 with consideration for safety. For example, in normal times, various measures may be taken, such as checking the surroundings or using a driving method that does not put a large load on the motor. However, in takeoff based on the emergency flight control signal, it is required to leave the thief as soon as possible. In other words, the emergency flight control signal is a signal for controlling takeoff with the top priority being to take off quickly. In other words, the generation unit 83 can be said to generate the emergency flight control signal in abnormal times as a control different from the flight control signal in normal times.

[0034] In addition, in the flight based on the emergency flight control signal, control may be performed so that the drone 10 rapidly ascends to a higher altitude than the normal flight altitude. This is because it is believed that by retreating the drone 10 to a higher altitude than the normal flight altitude, the drone 10 can be retreated farther from the thief. In other words, the generation unit 83 can generate an emergency flight control signal in an abnormal situation so as to fly above the altitude for retreating in normal circumstances.

[0035] As described above, the information processing device 80 according to the present embodiment may be provided in any of the port 40 where the drone 10 takes off and lands, a server (not shown), or the drone 10. The information processing device 80 may also be provided in other locations. Hereinafter, with reference to Figs. 5 to 7, an example of a functional configuration in which the information processing device 80 is provided in each of the port 40, the server, or the drone 10 will be described.

[0036] [When information processing equipment is provided at the port] 5 is a functional configuration diagram showing an example of a case where the information processing device according to the present embodiment is provided in a port. In the figure, an image diagram of a drone 10 taking off and landing from a port 40 is shown as an example.

[0037] The port 40 includes a port control device 41 and an information processing device 80. In the example shown in the figure, the port control device 41 and the information processing device 80 are described as being separate and independent from each other, but the port control device 41 and the information processing device 80 may exist as being substantially the same configuration and inseparably connected. The information processing device 80 may be included in the port control device 41, or the port control device 41 may be included in the information processing device 80.

[0038] The port control device 41 controls the port. Specifically, when the drone 10 takes off, the port control device 41 opens the lid portion, making the drone 10 capable of flying. In addition, the port control device 41 closes the lid portion after the drone 10 takes off. Furthermore, when the drone 10 lands, the port control device 41 opens the lid portion again, making the drone 10 capable of landing. Note that the opening and closing control of the lid portion may be performed based on an instruction from the information processing device 80 or an instruction from the drone 10, or may be performed based on detection of a sign of the drone 10 taking off or landing by a sensor (not shown).

[0039] In addition, the port control device 41 may perform wireless communication and wired communication with the drone 10. The port control device 41 may also supply power to the drone 10 (charge the battery), etc.

[0040] The information processing device 80 has the functional configuration described with reference to Fig. 4. The information processing device 80 may indirectly manage the flight of the drone 10 via the port control device 41, or may directly manage the flight of the drone 10.

[0041] [When the information processing device is provided in the server] FIG. 6 is a functional configuration diagram showing an example of a case where an information processing device according to this embodiment is provided in a server. With reference to the same figure, an example of a case where an information processing device 80 is provided in a server 70 will be described. When the information processing device 80 is provided in the server 70, it is preferable that the system 1 includes multiple drones 10. In the same figure, drones 10-1 and 10-2 are shown as an example of the multiple drones 10. However, this embodiment is not limited to this example, and the system 1 may include multiple (a large number of) drones 10.

[0042] As shown in the figure, the information processing device 80 is provided in a server 70. The server 70 communicates information with a plurality of drones 10 via a predetermined communication network NW. The information processing device 80 provided in the server 70 transmits flight control information to each of the plurality of drones 10 via the communication network NW. The flight control information includes at least an emergency flight control signal, and may also include other flight-related control information.

[0043] The flight control information transmitted to each of the multiple drones 10 may be the same or different. When the flight control information is the same, it may be the case that the flight control information includes emergency flight control signals for the multiple drones 10. When the flight control information includes emergency flight control signals for the multiple drones 10, it is the case that the multiple drones 10 are to be evacuated all at once. When the flight control information is different, it may be the case that the flight control information includes only an emergency flight control signal for the target drone 10. When the flight control information includes only an emergency flight control signal for the target drone 10, it is the case that the specific drone 10 among the multiple drones 10 is to be evacuated.

[0044] When the information processing device 80 is provided in the server 70, it is assumed that the information processing device 80 is located away from the port 40. In this case, the detection unit 81 may be configured as an acquisition unit that acquires information via a camera, an infrared sensor, or the like provided near the port 40.

[0045] [When information processing equipment is installed on a drone] 7 is a functional configuration diagram showing an example of a case where the information processing device according to the present embodiment is provided in a drone. With reference to the same figure, an example of a case where the information processing device 80 is provided in a drone 10 will be described. As shown in the figure, the information processing device 80 may be provided inside the drone 10. The drone 10 includes a drone control device 11 and an information processing device 80.

[0046] The drone control device 11 controls the drone 10. Specifically, the drone control device 11 controls the flight of the drone 10 by driving motors, sensors, and the like (not shown) that the drone 10 is equipped with. Note that the flight path (for example, the altitude to which the drone rises with takeoff), the timing of the flight, whether the takeoff and landing are normal or emergency, and the like are determined based on flight management information acquired from the information processing device 80.

[0047] The information processing device 80 has the functional configuration described with reference to Fig. 4. The information processing device 80 may indirectly control the flight of the drone 10 via the drone control device 11, or may directly control the flight of the drone 10.

[0048] [Information processing method] 8 is a flow chart showing a series of steps in the information processing device method according to this embodiment. With reference to this figure, a series of steps in the process performed using the information processing device 80 described above will be described.

[0049] (Step S11) First, the information processing device 80 detects whether or not a person is present around the port 40 where the drone 10 is waiting. For example, the information processing device 80 may detect that a person is present around the port 40 when a change occurs in the image by performing image processing on the surrounding image of the port 40 acquired over time. The information processing device 80 may also perform a similar detection process using an infrared sensor or the like. This process may also be referred to as a detection process or a detection step.

[0050] (Step S12) Next, the information processing device 80 determines whether or not the detected person is a person who has obtained permission from the administrator of the drone 10, based on the detection result from the detection process. For example, when there is a change in the image, the information processing device 80 may determine whether or not the person is a person who has obtained permission from the administrator of the drone 10 by comparing the features obtained by image processing of the image information with the features of the authorized person. When an infrared sensor or the like is used, it may be possible to determine whether or not the person is a person who has obtained permission from the administrator of the drone 10 by using a known short-range communication technology or the like. This process may also be referred to as a determination process or a determination step.

[0051] (Step S13) When the information processing device 80 determines in the determination process that the person is an authorized person, the information processing device 80 returns the process to step S11. Also, when the information processing device 80 determines in the determination process that the person is not an authorized person (i.e., a person who may steal the drone 10), the information processing device 80 advances the process to step S14.

[0052] (Step S14) Finally, based on the determination result from the determination process, if the information processing device 80 determines that the person is an unauthorized person, it determines that an abnormality has occurred and generates an emergency flight control signal that controls the flight of the drone 10 to leave the port 40. Based on the generated emergency flight control signal, the drone 10 escapes from the risk of theft. This process may also be referred to as a generation process or generation step.

[0053] [Variations] Next, a modification of the above-described information processing device 80 will be described with reference to FIGS.

[0054] 9 is a functional configuration diagram showing a first modified example of the functional configuration of an information processing device according to this embodiment. First, the functional configuration of an information processing device 80A will be described with reference to the same figure. The information processing device 80A is a modified example of the information processing device 80. In the description of the information processing device 80A, matters similar to the configuration of the information processing device 80 have already been described, and therefore may not be described again. The information processing device 80A differs from the information processing device 80 in that it further includes a reporting unit 84.

[0055] When it is determined that the person is an unauthorized person based on the determination result by the determination unit 82, the notification unit 84 reports to a location designated by an administrator. The report may be, for example, a notification that an emergency flight will be performed by wireless information communication. The report may also be a notification that a loud alarm will be sounded, a predetermined sensor will be turned on, or the action of the unauthorized person will be restricted.

[0056] The notification unit 84 may issue a notification based on the emergency flight control signal generated by the generation unit 83. In this case, the configuration of the notification unit 84 is added to the rear stage of the generation unit 83.

[0057] 10 is a functional configuration diagram showing a second modified example of the functional configuration of the information processing device according to this embodiment. Next, the functional configuration of the information processing device 80B will be described with reference to the same figure. The information processing device 80B is a modified example of the information processing device 80. In the description of the information processing device 80B, matters similar to those in the configuration of the information processing device 80 have already been described, and therefore may not be described again. The information processing device 80B differs from the information processing device 80 in that it further includes a detection unit 85.

[0058] The detection unit 85 detects vibration of the drone 10 or the port 40. Specific examples of the detection unit 85 that can be used include an acceleration sensor, a speed sensor, a displacement sensor, and a piezoelectric sensor.

[0059] The detection unit 85 is preferably attached to the drone 10 or the port 40 itself in order to detect physical vibrations. Therefore, it is preferable that the information processing device 80B has the configuration shown in Fig. 5 or the configuration shown in Fig. 7. However, it is also possible to adopt the configuration shown in Fig. 6 by attaching the detection unit 85 to the drone 10 or the port 40 and configuring the information processing device 80B to acquire the results detected by the detection unit.

[0060] When vibrations are detected by the detection unit 85, it can be said that this suggests the possibility that the drone 10 or the port 40 may be the victim of theft. Therefore, when vibrations are detected by the detection unit 85, detection by the detection unit 81 (i.e., detection of whether or not a person is present in the vicinity of the information processing device 80B) becomes effective. In other words, the information processing device 80B disables detection by the detection unit 81 until vibrations are detected. With this configuration, it is possible to prevent the detection operation of suspicious people from being frequently performed, which may result in erroneous operation (e.g. emergency takeoff).

[0061] In order to eliminate malfunctions caused by vibrations associated with normal takeoff and landing, the timing of detection by the detection unit 85 may be limited. For example, the information processing device 80B may disable detection by the detection unit 85 while performing control involving vibration, and enable detection by the detection unit 85 when control involving vibration is not being performed, for example, during standby. With such a configuration, it is possible to prevent malfunctions (e.g. emergency takeoff) caused by frequent detection operations for suspicious persons.

[0062] FIG. 11 is a functional configuration diagram showing a third modified example of the functional configuration of the information processing device according to this embodiment. Next, the functional configuration of the information processing device 80C will be described with reference to the same figure. The information processing device 80C is a modified example of the information processing device 80. In the description of the information processing device 80C, matters similar to the configuration of the information processing device 80 have already been described, and therefore may be omitted. The information processing device 80C differs from the information processing device 80 in that the detection unit 81 further includes an imaging unit 86.

[0063] The imaging unit 86 captures an image of the periphery of the port 40. The imaging unit 86 may capture a moving image by successively capturing successive frame images over time. The image captured by the imaging unit 86 is preferably a typical color image, but may also be a monochrome image. Furthermore, the image captured by the imaging unit 86 is not limited to a pictorial image, and may be an image showing the distribution of some physical value other than color information, such as a thermal image.

[0064] In the information processing device 80C, the detection unit 81 detects whether or not a person is present in the captured image by performing image analysis on the image information captured by the imaging unit 86. That is, it can be said that the information processing device 80C detects the presence or absence of a suspicious person based on an image.

[0065] Here, when the information processing device 80C is provided in the drone 10, that is, when the configuration shown in FIG. 7 is adopted, or when the information processing device 80C is provided in the port 40, that is, when the configuration shown in FIG. 5 is adopted, the information processing device 80C may image the periphery of the port 40 after emergency takeoff based on the emergency flight control signal. That is, the generation unit 83 can generate an emergency flight control signal in an emergency flight control signal in an abnormality so as to activate the imaging function of the drone 10, to separate the drone 10 from the port 40, and to image the periphery of the port 40. With such a configuration, it is possible to image a suspicious person, reconfirm whether or not it is a false detection, and if it is a real suspicious person, to track the person thereafter.

[0066] It goes without saying that the imaging function is optional, and the top priority is to take off in an emergency and escape from the hands of a thief. For example, a situation in which the battery is consumed by imaging and evacuation itself becomes difficult must be avoided. Therefore, the information processing device 80C may take an image only when the battery is sufficiently left, taking into consideration the remaining battery power of the drone 10. In other words, the generating unit 83 may generate an emergency flight control signal without activating the imaging function when the remaining battery power of the drone 10 is equal to or less than a predetermined value, even in the event of an abnormality.

[0067] [Other variations] In addition, various modified examples are assumed for the evacuation of the drone 10. Although not illustrated, other modified examples for the evacuation of the drone 10 will be described below.

[0068] First, it is considered that the drone 10 fails to leave the port 40. For example, when the drone 10 fails to leave, the drone 10 may be caught by a thief. For example, when the sky above the drone 10 is covered with a net or the like before the drone 10 leaves, the drone 10 may fail to leave the port 40. For example, examples of when the drone 10 fails to leave include when an abnormality occurs in the drone 10's body and the drone 10 is unable to take off, or when an emergency flight control signal is sent to the drone 10 but there is no reception response. In such a case, the drone 10 transmits (or continues to transmit) its own location information, so that the administrator can monitor where the drone 10 is being taken away. In this case, the generating unit 83 may enable a self-location information acquisition function that acquires and outputs the location information of the drone 10 when the drone 10 fails to leave the port 40.

[0069] Furthermore, when the drone 10 fails to leave the port 40, there is a high risk that the drone 10 has already been stolen. Therefore, in such a case, it is possible to erase the memory held by the drone 10 to prevent confidential information held by the drone 10 from falling into the hands of a thief. In this case, the generation unit 83 can erase a pre-designated memory or make it unreadable when the drone 10 fails to leave the port 40.

[0070] [Modifications to deal with theft during landing] Up to this point, the explanation has been given on the premise that theft is dealt with when the drone 10 is stored in the port 40. Therefore, it has been assumed that the theft is prevented by emergency release of the drone 10. However, the timing of the theft is not limited to this one example, and it is also assumed that the theft is planned to coincide with the timing when the drone 10 lands on the port 40. The configuration for such a case will be explained.

[0071] As a configuration for dealing with theft targeting landing, the configurations of the detection unit 81 and the determination unit 82 can be those already described. The generation unit 83 can be configured to generate an emergency flight control signal that controls the flight of the drone 10 so as not to land on the port 40 when it is determined that the person is an unauthorized person based on the determination result by the determination unit 82, assuming that an abnormality has occurred. That is, when the drone 10 lands, if there is a suspicious person in the vicinity of the port 40, the drone 10 may be led to another port nearby without landing on the port 40, for example, or may be controlled to continue flying in the sky.

[0072] [Internal configuration] FIG. 12 is a block diagram showing an example of the internal configuration of an information processing device according to this embodiment. The computer shown in FIG. 12 shows an example of a specific hardware configuration for realizing an information processing device 80. The computer includes a central processing unit (processor) 901, a RAM 902, an input / output port 903, input / output devices 904 and 905, and a bus 906. The computer itself can be realized using existing technology. The central processing unit 901 executes instructions included in a program read from the RAM 902 or the like. The central processing unit 901 writes data to the RAM 902, reads data from the RAM 902, and performs arithmetic and logical operations according to each instruction. The RAM 902 stores data and programs. Each element included in the RAM 902 has an address and can be accessed using the address. Note that RAM is an abbreviation for "random access memory." The input / output port 903 is a port through which the central processing unit 901 exchanges data with an external input / output device or the like. The input / output devices 904 and 905 are input / output devices. The input / output devices 904 and 905 exchange data with the central processing unit 901 via the input / output port 903. The bus 906 is a common communication path used inside the computer. For example, the central processing unit 901 reads and writes data from the RAM 902 via the bus 906. Also, for example, the central processing unit 901 accesses the input / output port via the bus 906. Also, all or a part of the information processing device 80 may be realized using hardware such as an ASIC, a PLD, or an FPGA. Also, all or a part of each functional unit may be realized by a combination of software and hardware.

[0073] [Summary of the embodiment] According to the embodiment described above, the information processing device 80 includes a detection unit 81, a determination unit 82, and a generation unit 83. The detection unit 81 detects whether or not a person is present in the vicinity of the port 40 where the drone 10 is waiting. The determination unit 82 determines whether or not the detected person is a person who has obtained permission from the administrator of the drone 10, based on the detection result by the detection unit 81. If the generation unit 83 determines that the detected person is an unauthorized person based on the determination result by the determination unit 82, it is an abnormality, and generates an emergency flight control signal that controls the flight of the drone 10 to leave the port 40.

[0074] By adopting such a configuration, it is possible to reduce the risk of drone theft. Furthermore, according to this embodiment, the drone 10 is autonomously released from the port 40 without relying on an alarm or the like, so even in areas where human surveillance is poor, such as mountainous regions, it is possible to autonomously reduce the risk of theft without requiring an administrator, security service provider, or the like to visit the area.

[0075] Moreover, according to this embodiment, the generating unit 83 generates an emergency flight control signal in an abnormal state as a control different from the flight control signal in a normal state. Here, if a suspicious person is present around the port 40 and the risk of theft is high, the normal takeoff control may result in theft, and it is preferable to perform control that prioritizes matters for avoiding theft (for example, the speed until takeoff). According to this embodiment, by generating an emergency flight control signal in an abnormal state as a control different from the flight control signal in a normal state, the risk of theft can be significantly reduced.

[0076] According to this embodiment, the generation unit 83 generates an emergency flight control signal in an abnormal situation to control the flight so as to fly higher than the altitude for normal departure. According to this embodiment, when a suspicious person is present around the port 40 and the risk of theft is increased, the risk of theft can be significantly reduced by controlling the flight so as to fly higher than the altitude for normal departure.

[0077] Moreover, according to this embodiment, the information processing device 80 further includes a reporting unit 84. When it is determined that the person is an unauthorized person based on the determination result by the determining unit 82, the reporting unit 84 reports to a location designated by the administrator. Therefore, according to this embodiment, in addition to autonomously reducing the risk of theft, the administrator, security service provider, etc. can recognize that a suspicious person is present in the vicinity of the port 40 and that the risk of theft is increasing. Therefore, according to this embodiment, the risk of theft can be reduced in a double manner.

[0078] Moreover, according to the present embodiment, the information processing device 80 further includes a detection unit 85. The detection unit 85 detects that the drone 10 or the port 40 has vibrated. When the detection unit 85 detects vibration, the information processing device 80 further includes the detection unit 85 and validates the detection by the detection unit 81. By employing such a configuration, the risk of erroneous detection can be reduced.

[0079] Moreover, according to the present embodiment, the detection unit 81 includes an imaging unit 86 that captures an image of the periphery of the port 40. The detection unit 81 detects whether or not a person is present in the captured image by performing image analysis on the image information captured by the imaging unit 86. By employing a configuration for detecting a person by image analysis, the detection unit 81 can easily and accurately detect whether or not a person is present in the vicinity of the port 40 where the drone 10 is waiting.

[0080] Furthermore, according to this embodiment, in generating an emergency flight control signal in the event of an abnormality, the generating unit 83 activates the imaging function of the drone 10, causes the drone 10 to leave the port 40, and generates an emergency flight control signal to capture an image of the periphery of the port 40. With this configuration, it is possible to obtain information on suspicious persons (particularly image information on the appearance of suspicious persons), which can contribute to identifying the person who planned the theft.

[0081] Furthermore, according to this embodiment, the generation unit 83 does not activate the above-mentioned imaging function when the remaining battery charge of the drone 10 is equal to or less than a predetermined value even in the event of an abnormality. Therefore, according to this embodiment, it is possible to prioritize departure to reduce the risk of theft over obtaining information that contributes to identifying the person who planned the theft.

[0082] Furthermore, according to this embodiment, the generation unit 83 enables a self-location information acquisition function that acquires and outputs location information of the drone 10 when the drone 10 fails to leave the port 40. According to this embodiment, by enabling the self-location information acquisition function, it is possible to identify where the drone 10 is being taken away, which can contribute to the recovery of the drone after it has been stolen and the identification of the person who planned the theft.

[0083] Furthermore, according to this embodiment, the generation unit 83 erases or renders the pre-designated memory unreadable when the drone 10 fails to leave the port 40. With this configuration, according to this embodiment, it is possible to prevent leakage of confidential information even in the event of theft.

[0084] According to the present embodiment, the information processing device 80 includes a detection unit 81, a determination unit 82, and a generation unit 83. The detection unit 81 detects whether or not a person is present in the vicinity of the port 40 where the drone 10 is waiting. The determination unit 82 determines whether or not the detected person is a person who has been authorized by the administrator of the drone 10 based on the detection result by the detection unit 81. Based on the determination result by the determination unit 82, the generation unit 83 generates an emergency flight control signal that controls the flight of the drone 10 so as not to land on the port 40, assuming that an abnormality has occurred when the person is determined to be an unauthorized person. According to the present embodiment, by adopting such a configuration, it is possible to reduce the risk of theft of the drone even against thefts that target the time of landing. According to the present embodiment, the risk of theft is reduced by autonomously not returning the drone 10 to the port 40 without relying on an alarm or the like, so that even in areas where people are not closely monitored, such as mountainous areas, the risk of theft can be reduced autonomously without the need for an administrator, security service provider, or the like to go to the site.

[0085] The above-described embodiment can "reduce the risk of drone theft." The drones covered by this embodiment are used to monitor or inspect infrastructure such as equipment used in wireless communication networks. Therefore, this embodiment can contribute to Goal 9 of the United Nations-led Sustainable Development Goals (SDGs), which is to "build resilient infrastructure, promote sustainable industrialization, and foster innovation."

[0086] Although an embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to this embodiment, and design changes and the like that do not deviate from the gist of the present invention are also included.

[0087] In addition, a computer program for implementing the functions of each of the above-mentioned devices may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed. Note that the "computer system" referred to here may include hardware such as an OS and peripheral devices. In addition, the term "computer-readable recording medium" refers to writable non-volatile memory such as a flexible disk, an optical magnetic disk, a ROM, or a flash memory, a portable medium such as a DVD (Digital Versatile Disc), or a storage device such as a hard disk built into a computer system.

[0088] Furthermore, the term "computer-readable recording medium" includes a memory that holds a program for a certain period of time, such as a volatile memory (e.g., DRAM (Dynamic Random Access Memory)) inside a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. The above-mentioned program may be transmitted from a computer system that stores the program in a storage device or the like to another computer system via a transmission medium, or by a transmission wave in the transmission medium. Here, the "transmission medium" that transmits the program refers to a medium that has a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The above-mentioned program may be a program for realizing part of the above-mentioned functions. Furthermore, the above-mentioned function may be realized in combination with a program already recorded in the computer system, that is, a so-called difference file (difference program). [Explanation of symbols]

[0089] 1...system, 10...drone, 30...flight management device, 50...equipment, 80...information processing device, 81...detection unit, 82...determination unit, 83...generation unit, 84...reporting unit, 85...detection unit, 86...imaging unit, 89...memory unit, 42...lid unit, 43...takeoff and landing unit, 44...shutter unit

Claims

1. a detection unit that detects whether or not a person is present around a port where the aircraft is waiting; a determination unit that determines whether the detected person is a person who has been authorized by an administrator of the flying object based on a detection result by the detection unit; a generation unit that generates an emergency flight control signal for controlling the flight of the aircraft to leave the port when it is determined that the person is an unauthorized person based on the determination result by the determination unit, as an abnormality; and An information processing device comprising:

2. The generation unit generates the emergency flight control signal in an abnormal state as a control different from a flight control signal in a normal state. The information processing device according to claim 1 .

3. The generation unit generates the emergency flight control signal in the event of an abnormality so as to control flight to fly above an altitude for departure in normal times. The information processing device according to claim 2 .

4. a reporting unit that reports to a location designated by an administrator when the person is determined to be an unauthorized person based on the determination result by the determining unit; The information processing device according to claim 1 .

5. The device further includes a detection unit that detects that the flying object or the port has vibrated, When the detection unit detects vibration, the detection unit is enabled to detect whether or not a person is present around the port. The information processing device according to claim 1 .

6. the detection unit includes an imaging unit that images the periphery of the port, By performing image analysis on the image information captured by the imaging unit, it is detected whether or not a person is present in the captured image. The information processing device according to claim 1 .

7. The generation unit generates the emergency flight control signal in the event of an abnormality to activate an imaging function of the aircraft, to separate the aircraft from the port, and to capture an image of the periphery of the port. The information processing device according to claim 1 .

8. The generation unit does not start the imaging function when the remaining battery charge of the aircraft is equal to or less than a predetermined value even when an abnormality occurs. The information processing device according to claim 7.

9. The generation unit enables a self-location information acquisition function that acquires and outputs location information of the aircraft when the aircraft fails to leave the port. The information processing device according to claim 1 .

10. The generation unit erases or renders a pre-designated memory unreadable if the aircraft fails to leave the port. The information processing device according to claim 1 .

11. a detection unit that detects whether or not a person is present around a port where the aircraft is waiting; a determination unit that determines whether the detected person is a person who has been authorized by an administrator of the flying object based on a detection result by the detection unit; a generation unit that generates an emergency flight control signal for controlling the flight of the aircraft so as not to land on the port when it is determined that the person is an unauthorized person based on the determination result by the determination unit, as an abnormality; and An information processing device comprising:

12. An information processing method executed by a computer, comprising: a detection step of detecting whether or not a person is present in the vicinity of a port where the aircraft is waiting; a determination step of determining whether or not the detected person is a person who has been authorized by an administrator of the aircraft based on the detection result by the detection step; a generating step of generating an emergency flight control signal for controlling the flight of the aircraft to leave the port when it is determined that the person is an unauthorized person based on the determination result by the determining step, as an abnormality; An information processing method comprising the steps of:

13. On the computer, A detection step of detecting whether or not a person is present in the vicinity of a port where the aircraft is waiting; a determination step of determining whether or not the detected person is a person who has been authorized by an administrator of the flying object based on a detection result by the detection step; a generating step of generating an emergency flight control signal for controlling the flight of the aircraft to leave the port when it is determined that the person is an unauthorized person based on the determination result by the determining step, as an abnormality; A program that executes the following.

Citation Information

Patent Citations

  • Disaster monitoring apparatus and evacuation guidance apparatus using drone

    JP2018181285A

  • Drone Box

    JP2018528123A

  • Monitoring system using flight vehicle

    JP2024040769A

  • Flying robot control system and flying robot control method

    JP2024095415A

  • Unmanned aircraft parking system

    JP2025014246A