Information processing device
The information processing device addresses the challenge of evaluating landing sites for unmanned aerial vehicles by using detection and risk assessment units to determine optimal landing points, enhancing safety and efficiency in delivery operations.
Patent Information
- Application Number
- JP2024551241
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-10-17
- Filing Date
- 2023-08-07
- Publication Date
- 2026-01-13
- Estimated Expiration
- 2043-08-07
AI Technical Summary
Existing systems struggle to appropriately evaluate landing sites for unmanned aerial vehicles due to unpredictable environments at destinations, which may include uneven ground, puddles, animals, or other obstacles.
An information processing device that includes a detection unit to identify landing and non-landing areas, a safety level identification unit to assess the safety of landing areas, and a risk level identification unit to evaluate adjacent risks, ultimately determining the optimal landing point based on safety and risk levels.
Enables accurate evaluation of landing points for unmanned aerial vehicles, ensuring safe and efficient delivery operations by identifying suitable landing sites and minimizing potential hazards.
Smart Images

Figure 0007797680000001 
Figure 0007797680000002 
Figure 0007797680000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a technique for assessing the landing site of an air vehicle. [Background technology]
[0002] With the spread of unmanned aerial vehicles known as drones, various proposals have been made for mechanisms for using drones for various purposes such as package delivery, etc. For example, Patent Document 1 discloses a system for safely landing a drone at its destination. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-196150 Summary of the Invention [Problem to be solved by the invention]
[0004] At the destination of the aircraft, there may be an environment suitable for landing the aircraft, for example, the ground surface is covered with a moderately soft material such as grass, and there are no objects that could be considered obstacles, but there may also be an environment that is not suitable for landing the aircraft, for example, the ground is uneven, there are puddles, there are animals, etc. In other words, there may be various situations at the destination of the aircraft that cannot be predicted in advance.
[0005] Therefore, an object of the present invention is to appropriately evaluate the landing point of an aircraft. [Means for solving the problem]
[0006] The present invention provides an information processing device comprising: a detection unit that detects landing areas and non-landing areas for an aircraft; a safety level identification unit that identifies one of multiple safety levels at the time of landing for the detected landing area; a risk level identification unit that identifies one of multiple risk levels at the time of landing for the landing area adjacent to the detected non-landing area in accordance with the detected non-landing area; and an evaluation unit that evaluates the landing point of the aircraft within the detected landing area based on the identified safety level and risk level. [Effects of the Invention]
[0007] According to the present invention, it is possible to appropriately evaluate the landing point of an aircraft. [Brief explanation of the drawings]
[0008] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a drone management system 1 according to one embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing an example of the hardware configuration of the drone 10 according to the embodiment. [Figure 3] FIG. 2 is a block diagram showing an example of a hardware configuration of a server device 50 according to the embodiment. [Figure 4] FIG. 2 is a block diagram showing an example of the functional configuration of the drone 10. [Figure 5] A plan view illustrating possible landing areas and non-landing areas at the destination of the drone 10. [Figure 6] FIG. 10 is a diagram illustrating a safety coefficient table according to the embodiment. [Figure 7] FIG. 10 is a diagram illustrating a safety coefficient table according to the embodiment. [Figure 8] FIG. 10 is a diagram illustrating a risk coefficient table according to the embodiment. [Figure 9] FIG. 10 is a diagram illustrating a risk coefficient table according to the embodiment. [Figure 10] 10 is a flowchart illustrating a processing procedure performed by the drone 10. DETAILED DESCRIPTION OF THE INVENTION
[0009] [composition] FIG. 1 is a block diagram showing an example of the configuration of a drone management system 1 according to an embodiment of the present invention. The drone management system 1 includes a drone 10 that flies through the air to deliver packages to a destination, a user terminal 30 used by a user who lives or works in the destination building, a wireless communication network 40, and a server device 50 connected to the wireless communication network 40. The wireless communication network 40 is a system that enables wireless communication and may be, for example, equipment that complies with a fourth-generation mobile communication system or a fifth-generation mobile communication system. Note that while FIG. 1 illustrates one each of the drone 10, user terminal 30, wireless communication network 40, and server device 50, there may be multiple of each of these.
[0010] The drone 10 is an unmanned aerial vehicle that flies through the air. The drone 10 flies from a takeoff point, such as a base or a base, to a destination carrying a load, and lands at the destination to deliver the load. The destination of the drone 10 is an area with a certain extent, specified by, for example, an address or latitude and longitude. The drone 10 lands at a point within the destination, which is its landing point.
[0011] The user terminal 30 is a communication-enabled computer such as a smartphone, a tablet, or a personal computer. In this embodiment, the user terminal 30 is a smartphone, and functions as a communication terminal that enables a user receiving a package to access the server device 50 via the wireless communication network 40.
[0012] The server device 50 stores flight plan information related to the flight date and time, flight path, and flight altitude of the drone 10, as well as cargo-related information (including cargo attribute data, described below) related to cargo delivered by the drone 10, and remotely controls the drone 10 in accordance with the flight plan information. Remote control by the server device 50 is mainly performed between the aforementioned takeoff and landing point and the airspace above the destination of the drone 10, or between multiple destinations of the drone 10. In the section between the airspace above the destination and the landing point of the drone 10, flight is performed under autonomous control by the drone itself. Specifically, the drone 10 evaluates each possible landing point within the destination, lands at the landing point corresponding to the highest evaluation result, performs an operation to detach the cargo, and then ascends again to the airspace above the destination.
[0013] In this embodiment, as described above, the section above the takeoff and landing point and the destination point of the drone 10 is controlled by remote control by the server device 50, and the section between the destination point and the landing point of the drone 10 is controlled by autonomous flight by the drone itself, but this is not limited to this example. For example, the drone 10 may fly autonomously over the entire section between the takeoff and landing point and the landing point of the destination without relying on remote control by the server device 50, or may fly under remote control by the server device 50 over the entire section between the takeoff and landing point and the landing point of the destination.
[0014] FIG. 2 is a diagram illustrating an example of the hardware configuration of the drone 10. The drone 10 is physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a positioning device 1007, a sensor 1008, a flight drive mechanism 1009, a cargo loading mechanism 1010, and a bus connecting these. In the following description, the term "device" can be interpreted as a circuit, a device, a unit, or the like. The hardware configuration of the drone 10 may be configured to include one or more of the devices illustrated in the figure, or may be configured without including some of the devices.
[0015] Each function of the drone 10 is realized by loading specified software (programs) onto hardware such as the processor 1001 and memory 1002, causing the processor 1001 to perform calculations, control communication via the communication device 1004, control at least one of reading and writing data in the memory 1002 and storage 1003, and control the positioning device 1007, sensor 1008, flight drive mechanism 1009, and cargo loading mechanism 1010.
[0016] The processor 1001, for example, runs an operating system to control the entire computer. The processor 1001 may be configured as a central processing unit (CPU) including an interface with peripheral devices, a control unit, an arithmetic unit, a register, etc. Furthermore, for example, a baseband signal processing unit, a call processing unit, etc. may be realized by the processor 1001.
[0017] The processor 1001 reads programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 into the memory 1002 and executes various processes in accordance with these. The programs used are those that cause a computer to execute at least some of the operations described below. The functional blocks of the drone 10 may be implemented by a control program stored in the memory 1002 and running on the processor 1001. Various processes may be executed by one processor 1001, or may be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. The programs may be transmitted to the drone 10 via the wireless communication network 40.
[0018] The memory 1002 is a computer-readable recording medium and may be configured by, for example, at least one of a ROM, an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), a RAM, etc. The memory 1002 may also be called a register, a cache, a main memory (primary storage device), etc. The memory 1002 can store an executable program (program code), a software module, etc. for implementing the method according to this embodiment.
[0019] Storage 1003 is a computer-readable recording medium, and may be composed of at least one of an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, etc. Storage 1003 may also be called an auxiliary storage device. Storage 1003 stores various programs and data groups.
[0020] The above-described processor 1001, memory 1002, and storage 1003 function as an example of an information processing device according to the present invention.
[0021] The communication device 1004 is hardware (transmission / reception device) for communicating between computers via the wireless communication network 40, and is also referred to as, for example, a network device, a network controller, a network card, or a communication module. The communication device 1004 includes a high-frequency switch, a duplexer, a filter, a frequency synthesizer, etc. to realize frequency division duplexing and time division duplexing. The transmission / reception antenna, an amplifier unit, a transmission / reception unit, a transmission path interface, etc. may be realized by the communication device 1004. The transmission / reception unit may be implemented as a transmission unit and a reception unit that are physically or logically separated.
[0022] The input device 1005 is an input device that receives input from the outside, and includes, for example, keys, switches, a microphone, etc. The output device 1006 is an output device that outputs to the outside, and includes, for example, a display device such as a liquid crystal display, a speaker, etc. Note that the input device 1005 and the output device 1006 may be integrated into one device.
[0023] The positioning device 1007 is hardware, such as a GPS (Global Positioning System) device, that measures the position of the drone 10. The drone 10 flies from the departure and arrival point to the sky above the destination based on the positioning measured by the positioning device 1007.
[0024] The sensor 1008 includes a ranging sensor, a Lidar (Light Detection And Ranging) sensor, an infrared sensor, and an image sensor that function as an altitude measurement means for the drone 10 and a means for checking the status of the destination, as well as a gyro sensor and a direction sensor that function as an attitude measurement means for the drone 10.
[0025] The flight drive mechanism 1009 is a mechanism that enables the drone 10 to fly, and includes hardware such as motors, shafts, gears, and propellers.
[0026] The cargo mounting mechanism 1010 is a mechanism for the drone 10 to mount and detach cargo, and includes hardware such as a motor, winch, wire, gear, locking mechanism, or hanging mechanism.
[0027] Each device, such as the processor 1001 and the memory 1002, is connected by a bus for communicating information. The bus may be configured using a single bus, or different buses may be used between each device. The drone 10 may also be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA), and some or all of the functional blocks may be realized by the hardware. For example, the processor 1001 may be implemented using at least one of these pieces of hardware.
[0028] Fig. 3 is a diagram showing the hardware configuration of server device 50. The hardware configuration of server device 50 may be configured to include one or more of the devices shown in Fig. 3, or may be configured to exclude some of the devices. Furthermore, server device 50 may be configured by communicating with multiple devices each having a different housing.
[0029] The server device 50 is physically configured as a computer device including a processor 5001, a memory 5002, a storage 5003, a communication device 5004, and a bus connecting these devices. Each function of the server device 50 is realized by loading predetermined software (programs) onto hardware such as the processor 5001 and the memory 5002, causing the processor 5001 to perform calculations, control communication by the communication device 5004, and control at least one of reading and writing of data from and to the memory 5002 and the storage 5003. Each of these devices operates using power supplied from a power source (not shown).
[0030] The processor 5001 controls the entire computer by running, for example, an operating system. The processor 5001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control unit, an arithmetic unit, a register, etc. Furthermore, for example, a baseband signal processing unit, a call processing unit, etc. may be realized by the processor 5001.
[0031] The processor 5001 reads programs (program codes), software modules, data, etc. from at least one of the storage 5003 and the communication device 5004 into the memory 5002, and executes various processes in accordance with these. The programs used are those that cause a computer to execute at least some of the operations described below. The functional blocks of the server device 50 may be realized by a control program stored in the memory 5002 and running on the processor 5001. The various processes may be executed by one processor 5001, or may be executed simultaneously or sequentially by two or more processors 5001. The processor 5001 may be implemented by one or more chips.
[0032] The memory 5002 is a computer-readable recording medium and may be configured by, for example, at least one of a ROM, an EPROM, an EEPROM, a RAM, etc. The memory 5002 may also be called a register, a cache, a main memory (primary storage device), etc. The memory 5002 can store an executable program (program code), a software module, etc. for implementing the method according to this embodiment.
[0033] Storage 5003 is a computer-readable recording medium, and may be composed of at least one of, for example, an optical disk such as a CD-ROM, a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, etc. Storage 5003 may also be called an auxiliary storage device. Storage 5003 stores at least programs and data groups for executing various processes as described below.
[0034] The communication device 5004 is hardware (transmission / reception device) for performing communication between computers via the wireless communication network 40, and is also called, for example, a network device, a network controller, a network card, or a communication module.
[0035] Each device, such as the processor 5001 and the memory 5002, is connected by a bus for communicating information. The bus may be configured using a single bus, or may be configured using different buses between each device.
[0036] The server device 50 may be configured to include hardware such as a microprocessor, a digital signal processor, an ASIC, a PLD, an FPGA, etc., and some or all of the functional blocks may be realized by the hardware. For example, the processor 5001 may be implemented using at least one of these pieces of hardware.
[0037] The hardware configuration of the user terminal 30 is almost the same as that of the server device 50, and therefore a description thereof will be omitted.
[0038] 4 is a diagram showing an example of the functional configuration of the drone 10. In the drone 10, the following functions are realized: an acquisition unit 11, a detection unit 12, a safety level identification unit 13, a risk level identification unit 14, an evaluation unit 15, and a control unit 16.
[0039] The acquisition unit 11 acquires various data from the positioning device 1007, the sensor 1008, the server device 50, or the like. For example, the acquisition unit 11 acquires sensing data obtained by sensing a destination using the sensor 1008. This sensing data is data indicating the size, material, shape, attributes, or state of the destination. The acquisition unit 11 also acquires baggage attribute data relating to the attributes of the baggage delivered by the drone 10 from the server device 50 via the wireless communication network 40. The baggage attribute data includes data relating to at least one of the size, weight, type, contents, material, or structure of the baggage.
[0040] The detection unit 12 detects possible landing areas and impermissible landing areas for the drone 10 at the destination by applying image recognition processing such as pattern matching to the sensing data acquired by the acquisition unit 11. A possible landing area is an area corresponding to, for example, a garden, a balcony, a parking lot, or a space in front of a front door. An impermissible landing area is an area corresponding to, for example, a roof, a pond, or vegetation or rocks above a certain height. As a result, for example, possible landing areas Ap and impermissible landing areas Ai1, Ai2, and Ai3 are detected within the entire area A of one destination, as illustrated in FIG. 5.
[0041] The safety level identification unit 13 uses image recognition processing such as pattern matching on the sensing data acquired by the acquisition unit 11 for the possible landing area detected by the detection unit 12 to identify one of multiple safety levels at the time of landing of the drone 10. At this time, the safety level identification unit 13 identifies the safety level based on at least one of the size, material, shape, attribute or state of the possible landing surface in the possible landing area, or the attribute, state or movement of an object present in the possible landing area.
[0042] More specifically, the safety level identification unit 13 first determines the shortest distance rp from each point p included in the possible landing area to the non-landing area. This rp corresponds to the radius of an inscribed circle centered at each point p and inscribed on the boundary of the possible landing area. The safety level identification unit 13 then calculates the landing evaluation area ap for each point p using the formula ap = πrp2. The larger this landing evaluation area ap is, the larger the area of the possible landing surface on which the drone 10 can land, and therefore the higher the safety level of the drone 10 when landing.
[0043] Furthermore, the safety identification unit 13 calculates the safety level s by multiplying the landing evaluation area ap by a safety level coefficient x according to the material, shape, attribute, or state of each point p that can be analyzed from the sensing data. In other words, safety level s = landing evaluation area ap × safety level coefficient x. This safety level coefficient x is determined in advance according to the material, shape, attribute, or state of each point p.
[0044] 6 is a diagram illustrating a safety coefficient table that describes the correspondence between the material of each point p and the safety coefficient. Furthermore, in FIG. 6, the safety coefficient differs depending on the importance level of the package delivered by the drone 10. The importance level of the package is determined in advance based on the package attribute data described above, such as the size, weight, type, contents, material, or structure of the package, e.g., if the package is a precision machine, the importance level is high, or if the package is expensive, the importance level is high.
[0045] In the example of Figure 6, if the material of point p is "material α", if the importance level of the luggage is "high", the safety coefficient is "x11", and if the importance level of the luggage is "low", the safety coefficient is "x21". If the material of point p is "material β", if the importance level of the luggage is "high", the safety coefficient is "x12", and if the importance level of the luggage is "low", the safety coefficient is "x22". If the material of point p is "material γ", if the importance level of the luggage is "high", the safety coefficient is "x13", and if the importance level of the luggage is "low", the safety coefficient is "x23". As a specific example, when the material of point p is "grass," if the importance level of the cargo is "high," the safety coefficient is "0.9," and if the importance level of the cargo is "low," the safety coefficient is "1." When the material of point p is "soil," if the importance level of the cargo is "high," the safety coefficient is "0.5," and if the importance level of the cargo is "low," the safety coefficient is "0.7." When the material of point p is "gravel," if the importance level of the cargo is "high," the safety coefficient is "0.3," and if the importance level of the cargo is "low," the safety coefficient is "0.6." In this way, the safety level identification unit 13 identifies the safety level using dynamically changing variable conditions (here, conditions that change according to the attributes of the cargo that the drone 10 transports to the landing point).
[0046] Note that Figure 6 shows an example in which the safety factor is determined according to the material of the landing surface, but similarly, the safety factor is determined according to the shape (flat or uneven, etc.), properties (hard or soft, etc.) or condition (dry or wet, etc.) of the landing surface.
[0047] Furthermore, the safety level determination unit 13 calculates the safety level s by multiplying the landing evaluation area ap of point p by a safety level coefficient corresponding to the attributes, state, or movement of an object present in the possible landing area including point p. This safety level coefficient is determined in advance according to the attributes, state, or movement of an object present in the possible landing area including each point p. FIG. 7 is a diagram illustrating an example of a safety level coefficient table that describes the correspondence between the attributes of objects present in the possible landing area including each point p and the safety level coefficient. In FIG. 7, as in FIG. 6, the safety level coefficient differs depending on the importance level of the package delivered by the drone 10.
[0048] In the example of Figure 7, if the attribute of an object present in the possible landing area including point p is "attribute p," the safety coefficient is "X11" if the importance level of the luggage is "high," and the safety coefficient is "X21" if the importance level of the luggage is "low." If the attribute of an object present in the possible landing area including point p is "attribute q," the safety coefficient is "X12" if the importance level of the luggage is "high," and the safety coefficient is "X22" if the importance level of the luggage is "low." If the attribute of an object present in the possible landing area including point p is "attribute r," the safety coefficient is "X13" if the importance level of the luggage is "high," and the safety coefficient is "X23" if the importance level of the luggage is "low." To give a specific example, if the attribute of the object present in the possible landing area including point p is "dog," then if the importance level of the luggage is "high," the safety coefficient is "0.4," and if the importance level of the luggage is "low," the safety coefficient is "0.6." If the attribute of the object present in the possible landing area including point p is "child," then if the importance level of the luggage is "high," the safety coefficient is "0.5," and if the importance level of the luggage is "low," the safety coefficient is "0.6." If the attribute of the object present in the possible landing area including point p is "adult," then if the importance level of the luggage is "high," the safety coefficient is "0.9," and if the importance level of the luggage is "low," the safety coefficient is "1."
[0049] Note that Figure 7 is an example in which the safety coefficient is determined according to the attributes of the object present in the possible landing area including point p. Similarly, the safety coefficient is determined according to the state (whether it is large, etc.) or movement (whether it is moving, etc.) of the object present in the possible landing area including each point p.
[0050] Returning to the explanation of Fig. 4, the risk identification unit 14 performs image recognition processing such as pattern matching on the sensing data acquired by the acquisition unit 11 for the no-landing zone detected by the detection unit 12, and identifies one of multiple levels of risk at the time of landing for a possible landing zone adjacent to the no-landing zone. At this time, the risk identification unit 14 identifies the level of risk based on at least one of the material, shape, attribute, or state of the no-landing surface of the no-landing zone adjacent to the possible landing zone (for example, the no-landing zone closest to point p), or the attribute, state, or movement of an object present in the no-landing zone.
[0051] More specifically, the risk identification unit 14 calculates the risk t by dividing the landing evaluation area ap calculated for each point p described above by a risk coefficient y according to the material, shape, attribute, or condition of the no-landing area adjacent to the possible landing area including that point p. In other words, risk t = risk coefficient y / landing evaluation area ap. This risk coefficient y is determined in advance according to the material, shape, attribute, or condition of the no-landing surface of the no-landing area.
[0052] 8 is a diagram illustrating an example of a risk coefficient table that describes the correspondence between the state of an impassable landing surface and a risk coefficient. In FIG. 8, the risk coefficient also differs depending on the importance level of the package delivered by the drone 10.
[0053] In the example of Figure 8, when the condition of the impassable landing surface is "condition a," if the importance level of the luggage is "high," the risk coefficient is "y11," and if the importance level of the luggage is "low," the risk coefficient is "y21." When the condition of the impassable landing surface is "condition b," if the importance level of the luggage is "high," the risk coefficient is "y12," and if the importance level of the luggage is "low," the risk coefficient is "y22." When the condition of the impassable landing surface is "condition c," if the importance level of the luggage is "high," the risk coefficient is "y13," and if the importance level of the luggage is "low," the risk coefficient is "y23." To cite a specific example, when the condition of the impermissible landing surface is "rock," if the importance level of the cargo is "high," the risk coefficient is "1," and if the importance level of the cargo is "low," the risk coefficient is "0.8." When the condition of the impermissible landing surface is "tree," if the importance level of the cargo is "high," the risk coefficient is "1," and if the importance level of the cargo is "low," the risk coefficient is "0.7." When the condition of the impermissible landing surface is "pond," if the importance level of the cargo is "high," the risk coefficient is "1," and if the importance level of the cargo is "low," the risk coefficient is "0.8." In this way, the risk level identification unit 14 identifies the risk level using dynamically changing variable conditions (here, conditions that change according to the attributes of the cargo transported by the drone 10).
[0054] Note that Figure 8 shows an example in which the risk coefficient is determined according to the condition of the impassable surface, but similarly, the risk coefficient is determined according to the material, shape, and attributes of the impassable surface.
[0055] Furthermore, the risk identification unit 14 calculates the risk t by dividing the landing evaluation area ap calculated for each point p by a risk coefficient corresponding to the attribute, state, or movement of an object present in an improper landing area adjacent to the possible landing area including point p (for example, the improper landing area closest to point p). Figure 9 is a diagram illustrating an example of a risk coefficient table that describes the correspondence between the attribute of an object present in an improper landing area adjacent to the possible landing area including point p and the risk coefficient. In Figure 9, as in Figure 8, the risk coefficient differs depending on the importance level of the package delivered by the drone 10.
[0056] In the example of Figure 9, if the attribute of an object present in a possible landing area that includes an impractical surface is "attribute p," the risk coefficient is "Y11" if the importance level of the luggage is "high," and the risk coefficient is "Y21" if the importance level of the luggage is "low." If the attribute of an object present in a possible landing area that includes an impractical surface is "attribute q," the risk coefficient is "Y12" if the importance level of the luggage is "high," and the risk coefficient is "Y22" if the importance level of the luggage is "low." If the attribute of an object present in a possible landing area that includes an impractical surface is "attribute r," the risk coefficient is "Y13" if the importance level of the luggage is "high," and the risk coefficient is "Y23" if the importance level of the luggage is "low." To give a specific example, if the attribute of the object is "dog," the risk coefficient is "0.8" if the importance level of the luggage is "high," and the risk coefficient is "0.6" if the importance level of the luggage is "low." If the attribute of the object is "child," the risk coefficient is "0.5" if the importance level of the luggage is "high," and the risk coefficient is "0.4" if the importance level of the luggage is "low." If the attribute of the object is "adult," the risk coefficient is "0.2" if the importance level of the luggage is "high," and the risk coefficient is "0.1" if the importance level of the luggage is "low."
[0057] Note that Figure 9 shows an example in which the risk coefficient is determined according to the attributes of an object present in the no-landing area adjacent to the possible landing area including point p. Similarly, the risk coefficient is determined according to the state or movement of the object.
[0058] Returning to the explanation of FIG. 4, the evaluation unit 15 evaluates the landing point of the drone 10 based on the safety level and risk level identified for each point p within the possible landing area detected by the detection unit 12. Specifically, the evaluation unit 15 calculates an evaluation score for each point p by, for example, dividing the safety level s calculated as described above by the risk level t. The higher the safety level s, the higher the evaluation score, and the lower the risk level t, the higher the evaluation score. Therefore, the evaluation unit 15 determines the point p with the highest evaluation score as the actual landing point. Note that the evaluation method using the safety level and risk level is not limited to this example. In short, any evaluation method may be used as long as the higher the safety level s, the higher the evaluation, or the lower the risk level t, the higher the evaluation.
[0059] The control unit 16 determines the point p that is most highly evaluated by the evaluation unit 15 as the landing point, controls the flight drive mechanism 1009 to land the drone 10 at that landing point, and after the landing, controls the cargo loading mechanism 1010 to detach the cargo from the drone 10.
[0060] [Operation] Next, the processing performed when the drone 10 is flying will be described with reference to the flowchart shown in Fig. 10. In Fig. 10, the drone 10 starts flying from the takeoff and landing point toward the destination (step S01).
[0061] Before the drone 10 starts flying, the acquisition unit 11 of the drone 10 acquires package attribute data relating to the attributes of the package to be delivered by the drone 10 from the server device 50 via the wireless communication network 40. Thereafter, the drone 10, under the control of the server device 50, flies to the sky above the destination address specified when the package delivery request was made.
[0062] When the drone 10 reaches the sky above the destination (step S02; YES), the acquisition unit 11 acquires sensing data from the sensor 1008 (step S03).
[0063] Next, the detection unit 12 detects the landing possible area and the landing impossible area of the drone 10 (step S04).
[0064] Next, the safety level identifying unit 13 identifies the safety level of the detected possible landing area, and the risk level identifying unit 14 identifies the risk level of the detected possible landing area (step S05).
[0065] The evaluation unit 15 evaluates the landing point of the drone 10 within the detected possible landing area based on the identified safety and risk levels (step S06).
[0066] The control unit 16 controls the flight drive mechanism 1009 to land the drone 10 at the landing site that has been given the highest evaluation by the evaluation unit 15, and after the landing, controls the cargo loading mechanism 1010 to detach the cargo from the drone 10 (step S07). When the delivery of the cargo is completed, the drone 10 moves on to the next process, such as returning to the departure or arrival point or moving to the next delivery destination. Note that if there is no possible landing area within the destination, the drone 10 performs an operation such as returning without landing.
[0067] According to the embodiment described above, it is possible to appropriately evaluate the landing point of the drone 10.
[0068] [Variations] The present invention is not limited to the above-described embodiment. The above-described embodiment may be modified as follows. Furthermore, two or more of the following modifications may be combined and implemented. [Variation 1] In the above embodiment, the safety coefficient or risk coefficient dynamically varies, for example, depending on the attributes of the cargo transported by the drone 10. This example is not limiting, and the safety coefficient or risk coefficient may vary depending on the weather or temperature at the destination. To cite a specific example, when the weather at the destination is "clear" and the temperature is "moderate" or "low," the safety coefficient will be higher and the risk coefficient will be lower. When the weather at the destination is "rainy" and the temperature is "high," the safety coefficient will be lower and the risk coefficient will be higher. In this way, the variable condition may be a condition that varies depending on the weather or temperature. This allows evaluation to be performed depending on the weather or temperature at the destination.
[0069] [Variation 2] Furthermore, the safety coefficient or risk coefficient may be varied depending on the number or density of objects present at the destination (landing zone or no-landing zone). As a specific example, when there are many objects (e.g., people, animals, cars, etc.) at the destination, the safety coefficient may be lower and the risk coefficient may be higher. This allows evaluation to be performed depending on the number or density of objects at the destination.
[0070] [Variation 3] If a moving object is present at the destination, the safety level or risk level may be determined multiple times during the period from when the drone 10 leaves the destination to when it lands. For example, if a potentially moving object such as a human, animal, car, or motorcycle is detected, the safety level or risk level may be determined and evaluated multiple times before landing, thereby reducing the possibility that the object will interfere with the landing. Specifically, the safety level or risk level may be determined and evaluated once at an altitude of 20 meters above ground, then once at an altitude of 10 meters above ground, then once at an altitude of 5 meters above ground, and then once at an altitude of 3 meters above ground. In this way, if an object present in the landing permitted area or landing prohibited area is a moving object, the safety level determination unit 13 or the risk level determination unit 14 may determine the safety level or risk level multiple times as the altitude decreases before the drone 10 lands, and the evaluation unit 15 may perform an evaluation each time the safety level or risk level is determined.
[0071] [Variation 4] For example, if a potentially moving object such as a human, animal, car, or motorcycle is detected at the destination, the direction of movement of the object may be calculated, and the evaluation of point p corresponding to that direction of movement may be lowered. In this way, if an object present in the possible landing area or the impossible landing area is a moving object, the safety level identification unit 13 or the risk level identification unit 14 may also identify the direction of movement of the object, and the evaluation unit 15 may evaluate the landing point of the drone 10 based on the identified direction of movement of the object within the detected possible landing area. This allows evaluation to be made according to the direction of movement of the object at the destination.
[0072] [Variation 5] There are cases where it is not desirable to waste time before the drone 10 lands. This occurs, for example, when the drone 10 has little remaining power and it is desirable to shorten the hovering time, or when the designated delivery time for the package is approaching. In such cases, the value of the safety level s may be used as is for a point p directly below the current position of the drone 10, while the value of the safety level s may be multiplied by a coefficient less than 1 for a point p where the drone 10 must move horizontally 5 m from its current position before descending. In this way, the evaluation unit 15 may evaluate the landing point of the drone 10 based on the time required for the drone 10 to land within the detected possible landing area. This makes it possible to shorten the time required for the drone 10 to land.
[0073] [Variation 6] Control of the drone 10 may be realized by so-called edge computing (control by the drone), cloud computing (control by a server device), or a combination of both (control by the drone and the server device) as described in the embodiment. Therefore, the information processing device according to the present invention may be provided in the server device 50 disclosed in the embodiment.
[0074] [Variation 7] The unmanned aerial vehicle is not limited to those called drones, and may be of any structure or shape as long as it is an unmanned aerial vehicle capable of delivering packages.
[0075] [Other variations] The block diagrams used to explain the above embodiments show functional blocks. These functional blocks (components) are realized by any combination of hardware and / or software. Furthermore, the means for realizing each functional block is not particularly limited. That is, each functional block may be realized by a single device that is physically and / or logically coupled, or by two or more physically and / or logically separated devices that are directly and / or indirectly (e.g., wired and / or wirelessly) connected to each other and realized by these multiple devices. For example, the functions of the user terminal 30 exemplified in the embodiments may be provided by a single computer. In other words, each function illustrated in FIG. 4 may be provided by any of the devices that constitute the drone management system 1 as an information processing system. For example, the information processing device according to the present invention may be implemented in a server device 50.
[0076] Each aspect / embodiment described herein may be applied to systems utilizing LTE (Long Term Evolution), LTE-Advanced (LTE-A), SUPER 3G, IMT-Advanced, 4G, 5G, FRA (Future Radio Access), W-CDMA (registered trademark), GSM (registered trademark), CDMA2000, UMB (Ultra Mobile Broadband), IEEE 802.11 (Wi-Fi), IEEE 802.16 (WiMAX), IEEE 802.20, UWB (Ultra-WideBand), Bluetooth (registered trademark), or other suitable systems and / or next generation systems enhanced thereon.
[0077] The order of the processing procedures, sequences, flowcharts, etc. of each aspect / embodiment described herein may be rearranged unless inconsistent. For example, the methods described herein present various step elements in an exemplary order and are not limited to the specific order presented. Each aspect / embodiment described herein may be used alone, in combination, or switched depending on the implementation. Furthermore, notification of predetermined information (e.g., notification that "X is true") is not limited to being explicit, but may be implicit (e.g., not notifying the predetermined information).
[0078] The information or parameters described in this specification may be expressed as absolute values, relative values from a predetermined value, or other corresponding information.
[0079] As used herein, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up (e.g., looking up in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and the like. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judged" or "decided." In other words, "judgment" and "decision" can include regarding some action as having been "judged" or "decided."
[0080] The present invention may be provided as an information processing method or as a program. Such a program may be provided in a form recorded on a recording medium such as an optical disk, or may be provided in a form that can be downloaded to a computer via a network such as the Internet and installed for use.
[0081] Software, instructions, etc. may be transmitted or received over a transmission medium. For example, if the software is transmitted from a website, server, or other remote source using wired technologies such as coaxial cable, fiber optic cable, twisted pair, and Digital Subscriber Line (DSL), and / or wireless technologies such as infrared, radio, and microwave, these wired and / or wireless technologies are included within the definition of transmission media.
[0082] The information, signals, etc. described herein may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.
[0083] As used herein, any reference to an element using a designation such as "first," "second," etc. does not generally limit the quantity or order of those elements. These designations may be used herein as a convenient method of distinguishing between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed therein or that the first element must precede the second element in some way.
[0084] The "means" in the configuration of each of the above devices may be replaced with "part," "circuit," "device," etc.
[0085] To the extent that the terms "including," "comprising," and variations thereof are used herein in the specification or claims, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, the term "or," as used herein in the claims, is not intended to be an exclusive or.
[0086] Throughout this disclosure, where articles are added by translation, such as a, an, and the in English, these articles are intended to include the plural unless the context clearly indicates otherwise.
[0087] Although the present invention has been described in detail above, it is clear to those skilled in the art that the present invention is not limited to the embodiments described herein. The present invention can be implemented in modified and altered forms without departing from the spirit and scope of the present invention as defined by the claims. Therefore, the description in this specification is intended to be illustrative and does not have any limiting meaning on the present invention. [Explanation of symbols]
[0088] 1: Drone management system, 10: Drone, 11: Acquisition unit, 12: Detection unit, 13: Safety level identification unit, 14: Risk level identification unit, 15: Evaluation unit, 16: Control unit, 30: User terminal, 40: Wireless communication network, 50: Server device, 1001: Processor, 1002: Memory, 1003: Storage, 1004: Communication device, 1005: Input device, 1006: Output device, 1007: Positioning device, 1008: Sensor, 1009: Flight drive mechanism, 1010: Cargo loading mechanism, 50: Server device, 5001: Processor, 5002: Memory, 5003: Storage, 5004: Communication device, A: Destination, Ap: Allowable landing area, Ai1, Ai2, Ai3: Prohibited landing area.
Claims
1. a detection unit that detects a possible landing area and a non-landing area of the aircraft; a safety level determination unit that determines one of a plurality of safety levels at the time of landing for the detected possible landing area; a risk identification unit that identifies one of a plurality of risk levels as the degree of risk that a risk element included in the non-landing area adjacent to the detected possible landing area poses to the aircraft during landing in the possible landing area; an evaluation unit that evaluates a landing point of the aircraft based on the identified safety level and risk level within the detected possible landing area; An information processing device comprising:
2. The safety level identification unit identifies the safety level based on at least one of the size, material, shape, attribute, or state of a landing surface in the possible landing area, or the attribute, state, or movement of an object present in the possible landing area.
2. The information processing apparatus according to claim 1, wherein:
3. The risk identification unit identifies the risk based on at least one of the shape, attribute, or state of the no-landing surface in the no-landing area, or the attribute, state, or movement of an object present in the no-landing area.
2. The information processing apparatus according to claim 1, wherein:
4. The security level determination unit determines the security level using a dynamically changing variable condition. Or, The risk identification unit identifies the risk using a dynamically changing variable condition.
2. The information processing apparatus according to claim 1, wherein:
5. The variable condition varies depending on the attributes of the cargo that the aircraft will transport to the landing point.
5. The information processing apparatus according to claim 4.
6. The variable conditions vary depending on the weather or temperature.
5. The information processing apparatus according to claim 4.
7. The variable condition varies depending on the number or density of objects present in the possible landing area or the impossible landing area.
5. The information processing apparatus according to claim 4.
8. When an object present in the possible landing area or the impossible landing area is a moving object, the safety level identification unit or the risk level identification unit identifies the safety level or the risk level multiple times before the flying object lands, The evaluation unit performs the evaluation each time the safety level or the risk level is identified.
2. The information processing apparatus according to claim 1, wherein:
9. When an object present in the possible landing area or the impossible landing area is a moving object, the safety level identification unit or the risk level identification unit also identifies the moving direction of the object, The evaluation unit evaluates the landing point of the aircraft based on the identified movement direction of the object within the detected possible landing area.
2. The information processing apparatus according to claim 1, wherein:
10. The evaluation unit evaluates the landing point of the aircraft based on the time required for the aircraft to land within the detected possible landing area.
2. The information processing apparatus according to claim 1, wherein:
11. The risk identification unit identifies the risk by dividing a risk coefficient according to the material, shape, attribute or state of the non-landing area adjacent to the possible landing area by the landing evaluation area calculated for each point within the possible landing area.
2. The information processing apparatus according to claim 1, wherein:
12. The evaluation unit calculates an evaluation score that is higher the higher the safety level identified for the possible landing area and higher the lower the risk level identified for the possible landing area, and determines the point with the highest evaluation score as the landing point.
2. The information processing apparatus according to claim 1, wherein:
Citation Information
Patent Citations
Taking-off / landing device, control method of taking-off / landing device, and program
JP2019031164A
System, method, and program for identifying safe landing area, and storage medium for storing the program
JP2019196150A
Control device, system and method
JP2021039726A
Landing control device of flying object
JP2022067672A
Mobile body, control method, and program
WO2020262060A1