Device, computer program and method for monitoring a UAV

A surveillance drone system addresses UAV interference by identifying and notifying violations, monitoring movements, and collecting evidence to enforce compliance, enhancing airspace safety and regulation adherence.

JP7584520B2Active Publication Date: 2024-11-15SONY GROUP CORP +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2022542913
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-03-31
Filing Date
2021-01-29
Publication Date
2024-11-15
Estimated Expiration
2041-01-29

AI Technical Summary

Technical Problem

Unmanned aerial vehicles (UAVs) often interfere with or violate predetermined flight paths and enter prohibited airspace, posing risks and requiring effective monitoring and intervention.

Method used

A surveillance drone system that identifies UAVs violating regulations, notifies them of violations, monitors their movements, and collects secondary evidence using multiple drones to ensure compliance, with actions including fines, signal interference, or remote control.

Benefits of technology

Effectively manages UAVs in prohibited airspace by ensuring compliance and preventing interference through precise monitoring and evidence collection, reducing the risk of collisions and unauthorized operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007584520000001
    Figure 0007584520000001
  • Figure 0007584520000002
    Figure 0007584520000002
  • Figure 0007584520000003
    Figure 0007584520000003
Patent Text Reader

Abstract

A method including locating an unmanned aerial vehicle (UAV) violating a predetermined rule, notifying the UAV of an indication of the violation, monitoring movement of the UAV after notification of the violation, and if the movement falls below a threshold amount after a predetermined time, notifying another device that the movement is below the threshold amount.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present technology relates to devices, computer programs and methods for monitoring UAVs. [Background technology]

[0002] The description of the "Background Art" in this specification is intended to provide an overview of the contents of the present disclosure. The achievements of the inventors within the scope of the Background Art and aspects of the description that are not considered prior art at the time of filing are not expressly or implicitly acknowledged as prior art to the present technology.

[0003] The number of Unmanned Aerial Vehicles (UAVs) used in modern life is increasing. They are used to deliver goods to customers' homes, capture aerial photographs and videos, etc. In fact, the use of satellites continues to increase, even at high altitudes (such as orbiting the Earth). For example, Low Earth Orbit (LEO) satellites provide Internet connectivity to remote locations.

[0004] These UAVs typically follow a predetermined flight path to complete their tasks, however, in some cases the use of other UAVs can block the flight path or interfere with or damage UAVs in that path.

[0005] Additionally, in some cases, using a UAV may result in entering prohibited airspace, including flying over airports or private property. Sometimes no-fly zones are established around film sets to prevent UAVs from taking aerial photographs of the set. Summary of the Invention [Problem to be solved by the invention]

[0006] It is an object of the present disclosure to address at least one of these problems. [Means for solving the problem]

[0007] A method is provided that includes locating an unmanned aerial vehicle (UAV) that is violating a predetermined rule, notifying the UAV of an indication of the violation, monitoring movement of the UAV after notification of the violation, and if the movement falls below a threshold amount after a predetermined time, notifying another device that the movement is below the threshold amount.

[0008] According to one embodiment, a method is provided that includes locating an unmanned aerial vehicle (UAV) that is violating a predetermined rule, notifying the UAV of an indication of the violation, and notifying another device of the location of the UAV if a response identifying the UAV is not received from the UAV.

[0009] According to one embodiment, a method is provided that includes determining a geographic location of an unmanned aerial vehicle (UAV) at a first time and a second different time, capturing information identifying the UAV, and communicating the location of the UAV to another device at a second time, where the other device is selected from a plurality of other devices, and where the other device is selected based on a flight plan of the other device.

[0010] The preceding paragraphs are a summary and are not intended to limit the scope of the claims. The described embodiments, together with further advantages, will be best understood by reference to the following detailed description taken in conjunction with the accompanying drawings, in which:

[0011] A more complete understanding of the present disclosure and many of the attendant advantages thereof will become better understood by reference to the following detailed description when considered in conjunction with the accompanying drawings. [Brief description of the drawings]

[0012] [Figure 1] 1A and 1B show an example of a UAV. [Figure 2A] 2A-2D show a deployment 200 having a surveillance drone 100B1 monitoring an airspace 205. [Figure 2B]2A-2D show a deployment 200 having a surveillance drone 100B1 monitoring an airspace 205. [Figure 2C] 2A-2D show a deployment 200 having a surveillance drone 100B1 monitoring an airspace 205. [Figure 2D] 2A-2D show a deployment 200 having a surveillance drone 100B1 monitoring an airspace 205. [Figure 3A] FIG. 3A shows an embodiment 300 similar to that shown in FIG. 2C. [Figure 3B] FIG. 3B illustrates a situation in which a third drone 100B4 is selected as the drone to collect secondary evidence of the unauthorized drone 100B2. [Figure 4] FIG. 4 illustrates a process 400 according to an embodiment of the present disclosure. [Diagram 5] FIG. 5 illustrates the process of step 432 in more detail according to an embodiment. [Figure 6] FIG. 6 illustrates the process of step 510 in more detail. [Figure 7] FIG. 7 illustrates the process of step 620 in more detail. [Figure 8] FIG. 8 illustrates one embodiment of the present disclosure. [Figure 9] FIG. 9 illustrates one embodiment according to the present disclosure. [Figure 10] FIG. 10 illustrates components of the surveillance drone 100B1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Referring now to the drawings, like reference numbers indicate identical or corresponding parts in the several views.

[0014] 1A and 1B show exemplary types of UAVs. FIG. 1A shows a fixed-wing UAV 100A, and FIG. 1B shows a rotary UAV 100B. Although embodiments of the present disclosure are described with reference to these types of UAVs, the disclosure is not limited thereto, and other types of flying objects are contemplated, such as satellites orbiting the Earth. Although the present disclosure is described with reference to a rotary UAV 100B, the disclosure is not limited thereto.

[0015] Here, an overview of the embodiments of the present disclosure will be briefly described.

[0016] 2A, 2B, 2C, and 2D show a deployment 200 having a surveillance drone 100B1 monitoring an airspace 205. Although the following is described with reference to one or more drones, the disclosure is not so limited. Indeed, any unmanned aerial vehicle (UAV) is contemplated, including drones, satellites, and the like. The surveillance drone 100B1 may scout the airspace using one or a combination of technologies. For example, the surveillance drone 100B1 may be equipped with one or more image sensors and associated optics for capturing images of a scene that are analyzed to identify other flying objects, a time-of-flight (ToF) sensor, a LIDAR sensor, a radar instrument used to identify other objects, an infrared sensor, an RF sensor for detecting radio frequency signals indicative of control signals transmitted and emitted by flying objects, and the like. In some embodiments, the surveillance drone 100B1 may have a specific role of policing the airspace or may have a specific flight plan for police airspace. In some embodiments, a surveillance drone may be any drone capable of reconnaissance and may have the resources to perform reconnaissance of the airspace while performing some other task, such as delivering goods or conducting ground reconnaissance.

[0017] Airspace 205 includes no-fly zones 215. In some embodiments, 205 represents a 3D volume of space. In some embodiments, no-fly zones 215 may be placed over movie sets, airports, or private residences. In some examples, no-fly zones 215 may be permanent (such as over airports) or temporary (such as over movie sets or locations where events such as concerts take place). No-fly zones 215 are shown with hatching. No-fly zones are defined by coordinates in 3D space. In some embodiments, airspace is provided to a centralized system such as the Global UTM (Unmanned Vehicle Traffic Management) Consortium that provides rules to drone operators to ensure proper use of the airspace.

[0018] A second drone 100B3 is located within the airspace 205. The second drone 100B3 may be a drone traveling along a flight path or may be a drone completing a task, such as scouting an area. The second drone 100B3 may be owned by the same person (legal or natural person) as the surveillance drone 100B1, or may be independent of the surveillance drone 100B1. For example, the second drone 100B3 may be owned or operated by an independent third party, such as a delivery company. The field of view of the second drone 100B3 is shown by area 210.

[0019] An unauthorized drone 100B2 is also shown. The unauthorized drone 100B2 may be a drone operated in an unregulated manner, or may be a drone regulated by an organization such as the Global UTM Society, but that has moved from an approved flight path. In FIG. 2A, the unauthorized drone 100B2 has just entered a no-fly zone 215 under the surveillance of the surveillance drone 100B1. As will be described below, the unauthorized drone 100B2 is notified of a violation of certain regulations by entering the no-fly zone 215. This notification is made by the surveillance drone 100B1 or by the Global UTM Society. In some embodiments, the unregulated manner may be for the drone to announce its identity by radio signals. There is a requirement to announce its identity. The requirement is to announce its identity periodically and / or to incorporate its identity into other communication signals. The announcement of the identity can be by broadcast, point-to-point communication, or point-to-multipoint communication. The announcement of the identity is made to the UTM and / or to other drones or infrastructure.

[0020] The Global UTM Consortium is an organization that defines protocols for operating UAVs. It sets guiding principles for implementing UAV traffic management, which ensures that as more UAVs are used (i.e., their density in airspace increases), UAVs are operated safely and airspace is shared appropriately with other UAVs and general aviation.

[0021] As is clear from FIG. 2B, the unauthorized drone 100B2 further moves into the no-fly zone 215 of the airspace 205 under the supervision of the surveillance drone 100B1. This means that the unauthorized drone 100B2 violates a certain rule by flying into the no-fly zone. Of course, the unauthorized drone may also violate other certain rules. For example, the unauthorized drone 100B2 may enter the airspace at the wrong time, follow an unapproved flight path, or follow a flight path at the wrong time.

[0022] From FIG. 2B, it can be seen that the position of the unauthorized drone 100B2 is outside the field of view 210 of the second drone 100B3.

[0023] The location of the unauthorized drone 100B2 is still within the airspace 205 monitored by the surveillance drone 100B1. However, the location of the unauthorized drone 100B2 is very close to the edge of the airspace monitored by the surveillance drone 100B1 and to the edge of the no-fly zone 215. Thus, to confirm a violation of a given rule, evidence of the violation needs to be provided by a second UAV (e.g., a second drone).

[0024] Additionally, actions can be taken against the unauthorized drone 100B2 or its operator for violation of certain rules, in this case entering a no-fly zone 215. These actions can include sanctions against the operator or drone, such as fines or avoidance of the drone, such as firing a projectile at the unauthorized drone 215, safely capturing the drone, jamming the signal, or remotely taking control of the drone by intercepting and modifying the control signal.

[0025] Before this action is taken, evidence from a second UAV is captured to ensure that action is not taken erroneously. This evidence reduces the likelihood that erroneous action will be taken against the UAV.

[0026] 2C, the unauthorized drone 100B2 has moved a distance D1 from the original location (shown in FIG. 2A) where the violation first occurred. This movement occurs over a period of time. As will be described later, this distance is used in embodiments to determine whether a second drone is needed for secondary evidence collection.

[0027] 2D, the position of the second drone 100B3 is moved so that the field of view of the second drone 100B3 captures the unauthorized drone 100B2. This movement may be at the request of the surveillance drone 100B3 or at the request of the Global UTM Consortium. The second drone 100B3 then captures secondary evidence of the unauthorized drone 100B2 being located in a no-fly zone and violating certain regulations.

[0028] Once secondary evidence is captured, further action may be taken against the unauthorized drone 100B2 or the operator of the unauthorized drone 100B2. Although the second drone 100B3 is described above as being closer to the unauthorized drone 100B2 than the surveillance drone 100B1, the disclosure is not so limited. In some examples, the surveillance drone 100B1 moves closer to the unauthorized drone 100B2 than the second drone 100B3. In addition, the positions of the surveillance drone 100B1 and the second drone 100B3 are selected such that different views of the unauthorized drone 100B2 are captured. This allows sufficient evidence to be captured.

[0029] Additionally, the secondary evidence captured by the second drone 100B3 and the evidence captured by the surveillance drone 100B1 may include a timestamp, indicating the time the evidence was captured, indicating that the evidence was contemporaneous. Such evidence may be stored in an immutable form or placed on a blockchain to prevent tampering. In this regard, before the secondary evidence is captured, a synchronization signal may be exchanged between the surveillance drone 100B1 and the second drone 100B3 to ensure that their respective times are synchronized.

[0030] Additionally, the types of evidence captured by the surveillance drone 100B1 and the second drone 100B3 may be the same, although the disclosure is not so limited. For example, the surveillance drone 100B1 captures one or more types of evidence, such as a radio frequency signature of the unauthorized drone 100B2, and the second drone 100B3 captures a second, different type of evidence, such as still or video images of the unauthorized drone 100B2. Other types of evidence may be captured. These may or may not be unique identifiers of the unique drone. They may be considered fingerprints that represent variations in the operation of the unauthorized drone, such as noise patterns or an indication of the degree to which the rotors are synchronized or aligned. In other embodiments, the same types of evidence are captured by the surveillance drone 100B1 and the second drone 100B3.

[0031] An embodiment of the present disclosure is shown in Figures 3A and 3B, in which like reference numbers refer to like features and therefore descriptions of these features are omitted for the sake of brevity.

[0032] FIG. 3A shows an embodiment 300 similar to that shown in FIG. 2C. In FIG. 2C, it can be seen that one additional drone (the second drone 100B3) was included in the airspace under surveillance by the surveillance drone 100B1. However, in the embodiment of FIG. 3A, a third drone 100B4 and a fourth drone 100B5 are also shown in the airspace under surveillance 205. The third drone 100B4 and the fourth drone 100B5 follow their respective flight paths shown by black lines in FIG. 3A. That is, when the third drone 100B4 and the fourth drone 100B5 pass through the airspace 205, secondary evidence of the unauthorized drone 100B2 violating the predetermined driving rules in the no-fly area is required. Thus, as described below, a drone is selected from the plurality of other drones (the second drone 100B3, the third drone 100B4, or the fourth drone 100B5) that is best suited to capture secondary evidence of the unauthorized drone 100B2. This selection can be made using any one or more criteria, such as the best suited evidence capture device, the drone with the least deviation from the flight path, etc. Of course, other criteria are contemplated, such as the location of the other drones relative to the unauthorized drone 100B2. The selection of the other drone from the plurality of other drones is described below.

[0033] 3B illustrates a situation in which the third drone 100B4 is selected as a drone to collect secondary evidence of the unauthorized drone 100B2. In this case, the position of the third drone 100B4 is adjusted so that the field of view 305 of the third drone 100B4 captures the secondary evidence of the unauthorized drone 100B2. As described with respect to FIG. 2D with reference to the second drone 100B3, the secondary evidence of the unauthorized drone 100B2 is captured from a different angle than that captured by the surveillance drone 100B1.

[0034] Of course, while only the third drone 100B4 is shown capturing secondary evidence of the unauthorized drone 100B2, the disclosure is not so limited and two or more other drones are used to capture secondary evidence. In another example, a second other drone is used to capture tertiary evidence of the unauthorized drone 100B2 if the unauthorized drone 100B2 does not move out of the no-fly zone.

[0035] The evidence after capture can be provided to law enforcement agencies who can fine or prosecute the operator of the unauthorized drone 100B2, or take action against the unauthorized drone by firing bullets at the unauthorized drone 100B2, or capture the unauthorized drone safely in some manner. Of course, the evidence is provided to the operator of the unauthorized drone 100B2 along with a fine for operating the unauthorized drone 100B2 in the no-fly zone 215.

[0036] Operation process The process of operation of the embodiment of the present disclosure will now be described with reference to FIGS.

[0037] 4 illustrates a process 400 according to an embodiment of the present disclosure. The process 400 begins at step 405. The process then proceeds to step 410, where the surveillance drone 100B1 scans and monitors the airspace 205. By scanning the airspace 205, the surveillance drone 100B1 monitors the airspace 205. This is ongoing.

[0038] Surveillance drone 100B1 monitors airspace 205 for other UAVs violating one or more predetermined rules, a check performed in step 415.

[0039] The predetermined rules are stored in a storage device within the surveillance drone 100B1, although the disclosure is not so limited. In some embodiments, the surveillance drone 100B1 is updated with new rules via a communication interface (described below) located within the surveillance drone 100B1. The communication interface may communicate with a control center (not shown) to provide updates. The control center may be operated by the owner of the surveillance drone 100B1, or by a global UTM consortium or the like. This communication interface may update the surveillance drone 100B1 with flight paths for other UAVs, changes in no-fly zones, or other updates to the predetermined rules stored within the surveillance drone 100B1.

[0040] If no violation is found, return to step 410 with “No” (N) and surveillance drone 100B1 continues to monitor airspace 205.

[0041] However, if the surveillance drone 100B1 identifies one or more UAVs as violating a predetermined rule, then proceed to step 420 with a "yes" (Y). In the above exemplary embodiment, the predetermined rule that was violated was the unauthorized drone 100B2 entering the no-fly zone 215.

[0042] In step 420, the surveillance drone 100B1 communicates with the unauthorized drone 100B2 notifying the unauthorized drone 100B2 of the violation. This communication is performed by communications circuitry located within the surveillance drone 100B1. This communication is accomplished using a telecommunications standard, such as 5G (machine-to-machine) communications, although the disclosure is not limited thereto.

[0043] The surveillance drone 100B1 may include information regarding the violation. For example, the surveillance drone 100B1 may identify the specific rule being violated and how the unauthorized drone 100B2 is violating the rule. For example, in the above example, the surveillance drone 100B1 indicates that the unauthorized drone 100B2 has entered a no-fly zone and also provides the coordinates of the no-fly zone. This means that the surveillance drone 100B1 determines the geographic location of the unauthorized drone 100B2. This allows the unauthorized drone 100B2 to take corrective action to rectify the violation. At this time, the surveillance drone 100B1 stores information regarding the violation. For example, the surveillance drone 100B1 stores the geographic location of the unauthorized drone 100B2, the identity of the unauthorized drone 100B2, and the corresponding details of the violation of the given rule. For example, the time of the violation and a copy of the communication are sent to the unauthorized drone 100B2 in the storage device. Further, the surveillance drone 100B1 starts capturing and storing evidence of the violation. For example, the location of the unauthorized drone and information identifying the unauthorized drone or its operator are stored. For example, images or videos of the unauthorized drone 100B2, radio signatures, and radar signatures of the drone are captured and stored. Additionally or alternatively, the evidence captured by the surveillance drone 100B1 is communicated to a control center. The unauthorized drone 100B2 is notified by the surveillance drone 100B1 that evidence matching is being performed.

[0044] Furthermore, the surveillance drone 100B1 communicates the violation to a control center. As mentioned above, the control center may be the operator of the surveillance drone 100B1 or the Global UTM Consortium (hereinafter, "UTM"). One or more drone traffic management (UTM) servers are located within the control center. Thus, the surveillance drone 100B1 reports the violation to the drone traffic management server.

[0045] In response to the communication from the surveillance drone 100B1, the unauthorized drone 11B2 communicates with the surveillance drone 100B1. The unauthorized drone 100B2 identifies itself to the surveillance drone 100B1 using the provided identifier. Alternatively or in addition, the unauthorized drone 100B2 provides information related to the authorization provided to allow the violation. For example, the unauthorized drone 100B2 grants temporary permission to fly within the no-fly zone 215. In this case, the information on the authorization is provided by the unauthorized drone 100B2. The information collected by the surveillance drone 100B1 regarding the unauthorized drone 100B2 is provided to the control center for checking. The identification and / or related authorization of the unauthorized drone 100B2 indicates the status of the unauthorized drone 100B2, which is used to determine whether secondary evidence is required in step 425.

[0046] Of course, the unauthorized drone 100B2 may not respond to communications from the surveillance drone 100B1, or may refuse to provide information identifying itself or its operator, or to provide reasons for violating a given rule. In other examples, the unauthorized drone 100B2 may not respond to communications from the surveillance drone 100B1. Instead, the unauthorized drone 100B2 may take corrective action to remedy the violation. For example, the unauthorized drone 100B2 may leave the no-fly zone 215.

[0047] After the surveillance drone 100B1 notifies the unauthorized drone 100B2 of the violation, the process proceeds to step 425, where a decision is made as to whether secondary evidence is required. The operation of the decision process will be described later, but if no further evidence is required, the process proceeds to "No" (N) and ends at step 435. An example of a situation in which no further evidence is required is when the unauthorized drone 100B2 leaves the no-fly zone 215 within a predetermined time, or when the unauthorized drone 100B2 has a status that allows the violation, for example, when the unauthorized drone 100B2 is an emergency vehicle that passes through the no-fly zone and quickly arrives at the location. The status of the unauthorized drone 100B2 is notified to the surveillance drone 100B1 after receiving the notice of the violation. This status is communicated by the unauthorized drone 100B2 or by a control center with which the surveillance drone 100B1 has communicated.

[0048] If secondary evidence is required, answer "yes" (Y) and proceed to step 430. In step 430, the secondary evidence is collected by a second UAV. In the above example, the secondary evidence is captured by the second drone 100B3 or the third drone 100B3. Selection of an appropriate drone for collecting secondary evidence is described below.

[0049] After the secondary evidence is collected, the process proceeds to step 437, where a decision is made as to whether further action should be taken against the unauthorized drone 100B2 or its operator. As discussed above, this further action may include firing a bullet at the unauthorized drone 100B2 to stop it from flying, contacting law enforcement, etc.

[0050] If no further action is required, then the process exits "No" (N) at step 435. Alternatively, if further action is required, the process proceeds to step 432 and the appropriate further action is taken. The process then exits at step 435.

[0051] Figure 5 illustrates the process of step 432 in more detail according to an embodiment, i.e., Figure 5 illustrates the process of collecting secondary evidence.

[0052] The process begins at step 500. The process proceeds to step 505 where evidence collected by the surveillance drone 100B1 is reviewed, including images captured of the unauthorized drone 100B2, coordinates of the location of the unauthorized drone 100B2, the direction and speed of the unauthorized drone 100B2, etc. This review may be performed by the surveillance drone 100B1 itself, a control center with which the surveillance drone 100B1 communicates, or a UTM.

[0053] The process then proceeds to step 510, where the most suitable other device is determined. The process in step 510 is performed by the UTM, the surveillance drone 100B1, or a control center with which the surveillance drone 100B1 communicates. In the above example, the most suitable device was the second drone 100B3 in FIG. 2D and the third drone 100B4 in FIG. 3B. The process for selecting the most suitable other device for capturing secondary evidence is described with reference to FIG. 6.

[0054] The process then proceeds to step 515, where the selected other device moves to an appropriate evidence collection location to capture secondary evidence. The appropriate evidence collection location is determined based on evidence already collected by the surveillance drone 100B1. For example, the evidence already collected by the surveillance drone 100B1 includes images captured using an image sensor. However, more detailed images may be required to identify the unauthorized drone 100B2 or the operator of the unauthorized drone 100B2. In this case, the location of the other device is selected accordingly. This location information is provided to the other device by either the UTM or the surveillance drone 100B1.

[0055] The process continues at step 520 where secondary evidence is collected by other devices. The secondary evidence is then provided to one or more of the surveillance drone 100B1, the UTM, or a control center associated with the surveillance drone 100B1.

[0056] The process then proceeds to step 525, where the secondary evidence is compared to the evidence provided by the surveillance drone 100B1. During this comparison, it is determined whether the evidence captured by the surveillance drone 100B1 matches the secondary evidence captured by the other device. That is, a check is made to determine whether the unauthorized drone 100B2 has been captured in both sets of evidence. In some embodiments, the check is made using an image comparison to see if the level of similarity between the captured images of the drone exceeds a threshold level. Of course, other checks are envisioned, such as identifying the make and / or model of the unauthorized drone 100B2. If the make or model of the drone is identified, this can be compared to other reference information, such as a reference image or a known owner, and a check can be made to ensure that the identity of the unauthorized drone 100B2 is the same in both images. This check may also be made so that information from other devices complements the captured information. For example, information from the other device may be photographic evidence of the unauthorized drone 100B2 captured from a different angle or with a different focal length or zoom applied, which is compared to evidence captured by the surveillance drone 100B1.

[0057] Additionally, the location of the unauthorized drone 100B2 is compared in both sets of evidence. Because the secondary evidence was captured at a period of time after the evidence was captured by the surveillance drone 100B1, the location of the unauthorized drone 100B2 may have changed. This means that the unauthorized drone 100B2 may have corrected the violation by leaving the no-fly zone 215. Also, because the time difference between the capture of the evidence by the surveillance drone 100B1 and the other device is known, the direction and speed of the unauthorized drone 100B2 are known. This indicates that the unauthorized drone 100B2 has moved out of the no-fly zone 215.

[0058] The process then proceeds to step 530. In step 530, a determination is made whether the evidence captured by the surveillance drone 100B1 and the evidence captured by other devices is sufficient to take action. In particular, the evidence indicates that the unauthorized drone 100B2 has not traveled a sufficient distance since the unauthorized drone 100B2 was identified and the initial communication of the violation was made by the surveillance drone 100B1, or that the unauthorized drone 100B2 has traveled further into the no-fly zone 215. In this case, a "yes" (Y) proceeds to step 437 where action is taken.

[0059] If the evidence does not meet the threshold, the process proceeds to step 535 with a "no" (N). In this case, more evidence is required to be captured. For example, evidence from additional devices is needed to more clearly identify the unauthorized drone 100B2. Alternatively, the unauthorized drone 100B2 may be moving in a direction that indicates that the unauthorized drone 100B2 is leaving the no-fly zone. This means that more time is needed to see if the unauthorized drone 100B2 leaves the no-fly zone.

[0060] The other device may capture more evidence, or may select to collect a third set of evidence, in step 535. The process then proceeds to step 505.

[0061] FIG. 6 illustrates the process of step 510 in more detail.

[0062] The process 510 begins at step 600. The process then proceeds to step 605 where each device (such as a UAV or other drone) in a local area is called. This call is made by the UTM or surveillance drone 100B1. The local area is defined as a predefined distance from a geographic location, or a distance within the airspace. The geographic location is the current location of the unauthorized drone 100B2, or a predicted location of the unauthorized drone 100B2.

[0063] The process then proceeds to step 610 where the evidence collection capabilities of each candidate other device in the local area are determined. This may be the result of a response sent by the candidate device to the call of step 605, or may already be known by the UTM. Examples of evidence collection capabilities include image sensors, radar, RF scanning capabilities, etc.

[0064] The process then proceeds to step 615, where the most suitable location of the other device candidate with suitable evidence collection capabilities is determined. For example, a drone with radar evidence collection capabilities is more suitable for a situation where the unauthorized drone 100B2 is in clouds compared to a drone with only image sensor capabilities. Furthermore, the location of the drone with radar equipment is more suitable to be placed farther away from the unauthorized drone than a drone with image sensor capabilities to avoid backscattered light. Furthermore, the preferred location of the other drone will vary depending on the evidence captured by the surveillance drone 100B1. For example, if the surveillance drone 100B1 only has an image sensor that captures one image of the unauthorized drone from the side, the location of the other drone can be such that the other drone captures a planar image of the unauthorized drone 100B2.

[0065] That is, in step 615, the most appropriate locations for secondary evidence collection for at least a subset of each of the other devices are determined.

[0066] The process then proceeds to step 620, where it is determined which of the subset of other devices can be moved to the desired location while deviating from the current flight plan by an acceptable amount. That is, the deviation of each of the subset of other devices from the original flight plan is quantified. This deviation may be a distance deviation or a time deviation. If the deviation is below a threshold amount, the other device is asked to deviate to the location identified in step 615.

[0067] The process then proceeds to step 625 where other devices having deviations below the threshold are selected.

[0068] FIG. 7 shows the process of step 620 in more detail. The process starts at step 700. Then the process proceeds to step 705, where the current geographic location of the other device candidate is determined. This is done by the other device candidate providing Global Positioning System (GPS) coordinates to the surveillance drone 100B1 or the UTM system. Then the process proceeds to step 710, where the terminal location of the other device candidate is determined. That is, the final destination of the other device candidate is determined. This may be obtained directly from the other device candidate or from its operator. Furthermore, the route (i.e., flight path) of the other device candidate is determined. As will become clear, by knowing the flight path, it is possible to determine the amount of deviation in terms of distance and / or time from the scheduled path for the other device candidate to capture secondary evidence.

[0069] The process then proceeds to step 715, where the locations of the other potential devices and current weather conditions along their flight path are determined. This is useful because if inclement weather occurs later on in the flight path, it may not be appropriate to divert the other potential devices, as this would increase the likelihood of delays along that path. Additionally, the current speed and direction, and operational evidence capture capabilities are determined. Additionally, previous delays along the flight path are determined at this point. This is because if the other potential devices are already delayed, it may not be appropriate to further increase their delays.

[0070] The process continues at step 720 where the evidence collection location for the motion evidence capture capability is determined. This is determined in the same manner, and with the same considerations, as described with respect to step 615.

[0071] The process continues at step 725 where the arrival times of the other potential diverted devices at their final destinations are calculated to capture secondary evidence, which in some embodiments may include additional delays due to adverse weather or other flight conditions.

[0072] The process then proceeds to step 730 where it is determined whether the delay caused by the diversion to capture secondary evidence is less than a threshold. This is done by comparing the expected arrival time of the other device candidate to the expected arrival time of the other device candidate without the diversion. If the delay is less than or equal to the threshold delay, then "yes" (Y) at step 740 and the other device candidate is part of the subset of devices. Alternatively, if the delay is greater than the threshold, then "no" (N) is discarded at step 735. The process then proceeds to the next candidate at step 745. The process of FIG. 7 is performed for the other device candidate.

[0073] Note that the threshold delay noted in step 730 may be modified based on a number of factors. For example, if the other candidate device is carrying time-critical cargo such as human organs for transplant, the amount of delay introduced into the flight path may be very small. In another example, if the operator of the other candidate device wishes to operate the drone on a very tight schedule, the operator may pay an additional fee to the Global UTM Consortium for a very low threshold delay. Additionally, the operator of the other candidate device may be reimbursed by the Global UTM Consortium for a large threshold if the operator is able to accept a large threshold time.

[0074] 8 illustrates one embodiment of the present disclosure. In some examples, an unauthorized drone 100B2 provides its ID to the surveillance drone 100B1, but remains in the no-fly zone 215. This embodiment addresses this situation.

[0075] The process 800 begins at step 805. The process proceeds to step 810 where the surveillance drone 100B1 scans the airspace 205. The process proceeds to step 815 where the unauthorized drone 100B2 is located within the airspace 205. The surveillance drone 100B1 determines the geographic location of the unauthorized drone 100B2. Specifically, the surveillance drone 100B1 determines whether the unauthorized drone 100B2 is within the prohibited fly zone 215. If the unauthorized drone 100B2 is not within the prohibited fly zone 215, the process returns to step 810 with a "no" (N). However, if the unauthorized drone 100B2 is within the prohibited fly zone 215, the process proceeds to step 820 with a "yes" (Y) where the unauthorized drone 100B2 is contacted and notified of a violation of a predetermined rule (entering the prohibited fly zone 215). This contact is made by either one of the surveillance drone 100B1, a control center operating the surveillance drone 100B1, or the UTM system. The process proceeds to step 825, where the unauthorized drone 100B2 provides an acknowledgement to the surveillance drone 100B1. In some embodiments, the acknowledgement includes information identifying the unauthorized drone 100B2. This information can uniquely identify the unauthorized drone 100B2 locally or globally.

[0076] Although not specifically shown in FIG. 8, if no identification is provided by the unauthorized drone 100B1, the surveillance drone 100B1 may move to step 840 and notify other devices of the location of the unauthorized drone 100B2.

[0077] The process then proceeds to step 830, where the coordinates of the unauthorized drone 100B2 are used by the surveillance drone 100B1 or the UTM to check whether the unauthorized drone 100B2 has left the no-fly zone 215. This check is performed by checking whether the unauthorized drone 100B2 has moved a predetermined distance or more within a predetermined time. That is, the movement of the unauthorized drone 100B2 that is below the threshold distance after a predetermined time is checked.

[0078] If the unauthorized drone 100B2 leaves the no-fly zone 215 within a predetermined time after notification of the violation, then "yes" (Y) proceeds to step 835, where an indication of the violation and the identity of the unauthorized drone 100B2 and its operator are stored.

[0079] However, if the movement is below the threshold amount (distance) after the predetermined time, proceed "No" (N) to step 840, i.e., the geographic location of the unauthorized drone 100B2 is located at a second time that is different from the time of step 815.

[0080] In step 840, one or more other devices are notified. The movement is below a threshold amount or no ID is provided by the unauthorized drone 100B2. That is, one or more other devices are notified of the violation. The other devices include the second drone 100B3, a control center that controls the surveillance drone 100B1, or other drones such as the Global UTM Consortium. The notification to the one or more other devices may be instructions to capture evidence. The location of the unauthorized drone 100B2 may be provided in the instructions. The instructions are derived from the calculation that the movement is below a threshold amount.

[0081] The process continues at step 845, where one or more drones (including one or more notified other devices) are commanded to move to an evidence collection location. Selection of an appropriate device and selection of an appropriate evidence collection location are described above. Exemplary mechanisms for selecting the other device include, as described above, based on at least one of the location of the other device relative to the UAV, the flight path of the other device, and the flight path of the UAV. In some embodiments, selection based on flight path is advantageous to reduce downstream problems for the other device and other devices interacting with the device.

[0082] The process continues at step 850, where one of the other devices estimates the location of the unauthorized drone 100B2 from the captured secondary evidence. This is transmitted at step 855 to the UTM Society, the surveillance drone 100B1, or its own control center. That is, the surveillance drone 100B1 or the UTM Society receives information from the other device. This information is related to the location of the unauthorized drone 100B2.

[0083] The process then proceeds to step 860, where a position difference is calculated between the reported position of the unauthorized drone 100B2 as defined by another device (such as the second device 100B3) and the position of the unauthorized drone 100B2 as defined by the surveillance drone 100B1, i.e., a comparison is made between the received information and the monitored movement of the UAV following notification of the violation.

[0084] The process then proceeds to step 865 where a check is made to determine whether the unauthorized drone 100B2 has moved sufficiently within a predetermined time. That is, a check is performed to see if the unauthorized drone 100B2 has moved or is moving in a direction to leave the prohibited fly zone 215. If the unauthorized drone 100B2 has made sufficient progress, a "yes" (Y) is returned to step 820 to again contact the unauthorized drone 100B2 to inform it of its progress and its leaving the prohibited fly zone 215. At this stage, a period is provided giving the unauthorized drone 100B2 a time limit to leave the prohibited fly zone 215.

[0085] If the comparison in step 865 is negative, proceed "no" (N) to step 870. In step 870, a further check is made to see if the captured evidence is sufficient, for example evidence from two sources, to identify unauthorized drones and their operators, as described above.

[0086] If the evidence is sufficient, proceed to step 875 with "yes" (Y). In this case, steps are taken to disable the unauthorized drone 100B2. In some embodiments, disabling the unauthorized drone 100B2 includes at least one of jamming a signal controlling the operation of the unauthorized drone 100B2, firing a bullet at the unauthorized drone 100B2, or colliding with the unauthorized drone 100B2. In some embodiments, the disablement involves disrupting the photographic or image sensing capabilities of the unauthorized drone 100B2, for example, by generating interference or jamming signals at potential targets of the unauthorized drone 100B2, such as a concert venue or a movie set. In some embodiments, the disablement is delayed until the unauthorized drone 100B2 moves into an airspace where it is safe to perform the disablement. Also, the surveillance drone 100B1 itself may perform the disablement, but the invention is not limited thereto. In some embodiments, the disablement is performed by a different device. For example, another drone may be commanded to perform the disablement, or a control center may perform the disablement. However, the disablement is requested by the surveillance drone 100B1.

[0087] However, if there is not enough evidence, then "No" (N) continues to step 880 where additional devices are asked to capture additional evidence. The process then returns to step 840.

[0088] FIG. 9 illustrates one embodiment according to the present disclosure. In this embodiment, flight paths passing through the same volume of airspace need to be carefully planned in time to avoid collisions. In some instances, the flight plan of one UAV (such as a drone or satellite) is slightly delayed. This means that the scheduled times of other UAVs passing through the airspace need to be changed to avoid collisions with the delayed UAV.

[0089] The embodiment shown in FIG. 9 aims to address this problem. In this case, there are five UAVs (UAV1-UAV5) passing through the airspace. Each of the UAVs is 30 seconds apart, except for the time gap between UAV4 and UAV5, which is 1 minute. If UAV1 is delayed by 20 seconds, the interval between UAV1 and UAV2 will be reduced to 10 seconds. This is very short and may lead to a collision. In the embodiment of the present disclosure, a 20 second delay is applied to the flight plan of UAV4, a 20 second delay is applied to the flight plan of UAV3, and a 20 second delay is applied to the flight plan of UAV2. This means that the time gap between UAV4 and UAV5 is reduced by 20 seconds to 40 seconds, while the time gap between the remaining UAVs is maintained at 30 seconds. This reduces the chance of a collision. The computer uses the operating instructions to search for a relatively large time gap between the flight plans of each UAV in the airspace and generates a revised flight plan for some or all of the flight plans that occur before the relatively large time gap. In some embodiments, this is more efficient, timely and safer than modifying a first flight plan, calculating its impact on a second flight plan, modifying the second flight plan, calculating its impact on a third flight plan, etc. The computer can simultaneously modify at least some of the flight plans of each of UAV1-UAV5 in real time.

[0090] That is, a time gap along the flight path that exceeds the delay by a comfortable margin is found. Any UAV passing through the space between the delayed UAV and the large time gap is delayed an amount of time equal to the delay. This allows delays to be well managed along the flight path and allows many UAVs to pass through the airspace in a given unit of time.

[0091] FIG. 10 illustrates components of the surveillance drone 100B1. The surveillance drone 100B1 includes a communication interface 901 for performing wireless communication with other devices, including its control center, the unauthorized drone 100B2, and the second (and other) drones, and a storage medium 902 for storing digital data (e.g., hard disk drive, solid state drive, tape drive, etc.). Each of these components is controlled by a controller 900. The controller 900 includes circuitry for performing other operations of the surveillance drone 100B1 described above. In addition, a sensor 903 is provided that enables the surveillance drone 100B1 to detect other devices (UAVs, etc.), such as an image sensor, an RF sensor, etc.

[0092] Numerous modifications and variations of the present disclosure are possible in light of the above teachings. It is therefore contemplated that, within the scope of the appended claims, the present disclosure may be practiced other than as specifically described herein.

[0093] To the extent that embodiments of the present disclosure are described as being implemented, at least in part, by a software-controlled data processing apparatus, non-transitory machine-readable media carrying software, such as optical disks, magnetic disks, semiconductor memories, and the like, are also considered to represent an embodiment of the present disclosure.

[0094] For clarity, the above description has described embodiments with reference to different functional units, circuits and / or processors. However, it will be apparent that functionality may be distributed as desired between different functional units, circuits and / or processors without deviating from the embodiments.

[0095] The embodiments may be implemented in any suitable form including hardware, software, firmware, or any combination thereof. The described embodiments are optionally implemented at least in part as computer software running on one or more data processors and / or digital signal processors. The elements and components of the embodiments may be physically, functionally, and logically implemented in any suitable way. Indeed, functionality may be implemented in a single unit, in multiple units, or as part of other functional units. Thus, embodiments of the present disclosure may be implemented in a single unit, or may be physically and functionally distributed between different units, circuits, and / or processors.

[0096] Although the present disclosure has been described in terms of several embodiments, it is not intended to be limited to the specific form set forth herein. Moreover, while features have been described in connection with particular embodiments, those skilled in the art will recognize that various features of the described embodiments may be combined in any manner suitable for practicing the present technology.

[0097] Embodiments of the present technology are described by the following sections. 1. Identify the location of unmanned aerial vehicles (UAVs) that are violating prescribed regulations; Notify the UAV of the violation instructions, Following notification of a violation, monitor the movements of the UAV; If the movement is below the threshold amount after a predetermined time, notifying other devices that the movement is below the threshold amount. 2. Identify the location of unmanned aerial vehicles (UAVs) that are violating prescribed regulations; Notify the UAV of the violation instructions, The method includes notifying other devices of the location of the UAV if a response identifying the UAV is not received from the UAV. 3. The method according to paragraph 1 or 2, wherein the prescribed rule is not to enter a no-fly zone. 4. The method of any preceding claim, wherein the other device is a UTM society, and the method further includes instructing the UAV to move to a position to capture evidence of the UAV violating a predetermined rule. 5. The method according to any one of clauses 1 to 3, wherein the other device is selected from a plurality of other devices, and the other device is selected based on at least one of the position of the other device relative to the UAV, the flight path of the other device, the flight path of the UAV, and the type of sensing equipment located on the other device. 6. Determining a geographic location of the unmanned aerial vehicle (UAV) at a first time and at a second different time; Capture information to identify the UAV, The method includes communicating the location of the UAV to the other device at a second time, the other device being selected from a plurality of other devices, the other device being selected based on a flight plan of the other device. 7. Receive information from other devices; The method of any of the preceding clauses, including, following notification of the violation, comparing the received information with monitored movements of the UAV, and, in the event of a positive comparison, further including issuing a request to disable the UAV. 8. Prior to the step of issuing a request to disable the UAV, Receive information identifying the UAV from the other device; Identifying the UAV from other devices and comparing the received information with the captured information; 8. The method of claim 7, further comprising issuing a request to disable the UAV in case of a positive comparison. 9. The method of claim 8, wherein information received from other devices supplements the captured information. 10. The method of any one of clauses 7, 8, or 9, wherein the disabling includes at least one of jamming a signal controlling the operation of the UAV, firing a projectile at or colliding with the UAV, capturing the drone, and remotely controlling the drone by intercepting and modifying the control signal. 11. A computer program product comprising computer readable instructions which, when loaded into a computer, configures the computer to carry out the method according to any one of clauses 1 to 10. 12. A device including a sensor, a communication interface, and a processor, the sensors and communication interface are operated under control of a processor; The sensor is configured to identify a location of an unmanned aerial vehicle (UAV) violating a predetermined rule, and the communication interface is configured to communicate an indication of the violation to the UAV; The processor, following notification of the breach, monitors the movement of the UAV; The device is configured to, if the movement falls below the threshold amount after a predetermined time, notify other devices using the communications interface that the movement falls below the threshold amount. 13. A device including a sensor, a communication interface, and a processor, the sensors and communication interface are operated under control of a processor; The sensor is configured to identify a location of an unmanned aerial vehicle (UAV) that is violating a predetermined regulation; The communication interface is configured to communicate an indication of the breach to the UAV; The processor is configured to notify other devices of the location of the UAV using the communications interface if a response identifying the UAV is not received from the UAV, the device. 14. The device according to paragraph 12 or 13, wherein the predetermined rule is not to fly into a no-fly zone. 15. The device of any one of clauses 12 to 14, wherein the other device is a UTM Society, and the UTM Society is further configured to instruct the UAV to move to a position to capture evidence of the UAV violating a specified rule. 16. A device described in any one of clauses 12 to 14, wherein the other device is selected from a plurality of other devices, and the other device is selected based on at least one of the position of the other device relative to the UAV, the flight path of the other device, the flight path of the UAV, and the type of sensing equipment located on the other device. 17. A device including a sensor, a communication interface, and a processor, the sensors and communication interface are operated under control of a processor; The sensor is configured to geographically locate an unmanned aerial vehicle (UAV) at a first time and at a second different time to capture information identifying the UAV; The communications interface, under control of the processor, is operable to notify the other device of the location of the UAV at a second time, the other device being selected from a plurality of other devices and selected based on a flight plan of the other device, the device. 18. The processor: Receive information from other devices via the communication interface; Following notification of a violation, comparing the received information with the monitored movements of the UAV; 18. A device as described in any one of clauses 12 to 17, wherein in the case of a positive comparison, the processing circuitry is configured to issue, via the communication interface, a request to disable the UAV. 19. Prior to the step of issuing a request to disable the UAV, the processor: receiving information identifying the UAV from another device via the communication interface; Identifying the UAV from other devices and comparing the received information with the captured information; The device of clause 18, configured to issue, in case of a positive comparison, a request to disable the UAV via the communication interface. 20. The method of claim 19, wherein information received from other devices supplements the captured information. 21. The device of any one of clauses 18, 19, or 20, wherein the disabling includes at least one of jamming a signal controlling the operation of the UAV, firing a projectile at or colliding with the UAV, capturing the drone, and remotely controlling the drone by intercepting and modifying the control signal.

Claims

1. 1. A method performed by a surveillance drone, comprising: Identifying the location of unmanned aerial vehicles (UAVs) that are violating prescribed regulations; providing a notice of violation to the UAV, the notice being a notice indicating a violation of the predetermined rule; Following notification of the violation, monitoring the movement of the UAV; determining whether a distance of the movement of the surveillance drone in a direction outside a monitored airspace falls below a threshold amount after a predetermined time; notifying other devices that capture of secondary evidence of the violation is necessary if a distance of the movement of the surveillance drone in a direction outside of a monitored airspace falls below a threshold amount after a predetermined time.

2. 1. A method performed by a surveillance drone, comprising: Identifying the location of unmanned aerial vehicles (UAVs) that are violating prescribed regulations; providing a notice of violation to the UAV, the notice being a notice indicating a violation of the predetermined rule; If a response identifying the UAV is not received from the UAV, notifying other devices that capture of secondary evidence of the violation is required.

3. The method of claim 1 , wherein the predetermined rule is not to enter a no-fly zone.

4. 2. The method of claim 1, wherein the other device is a drone traffic control server, the method further comprising the drone traffic control server instructing the UAV to move to a location to capture evidence of the UAV violating the predetermined rule.

5. 2. The method of claim 1 , wherein the other device is selected from a plurality of other devices, and the other device is selected based on at least one of a position of the other device relative to the UAV, a flight path of the other device, a flight path of the UAV, and a type of sensing equipment located on the other device.

6. receiving information from the other device; 2. The method of claim 1, further comprising: following notification of the violation, comparing the received information with the monitored movements of the UAV, and if the results of the comparison affirmatively indicate sufficient action to be taken, issuing a request to disable the UAV.

7. Prior to the step of issuing a request to disable the UAV, receiving information identifying the UAV from the other device; comparing the received information that identifies the UAV from the other devices with the captured information, and if the comparison is sufficient to take action; The method of claim 6 , further comprising issuing the request to disable the UAV.

8. The method of claim 7 , wherein the information received from the other devices supplements the captured information.

9. 7. The method of claim 6, wherein disabling the UAV includes at least one of jamming a signal controlling operation of the UAV, firing a projectile at or colliding with the UAV, capturing the drone, and remotely taking control of the drone by intercepting and modifying control signals.

10. A computer program product comprising computer readable instructions which, when loaded into a computer, configures the computer to carry out the method of claim 1.

11. A device including a sensor, a communication interface, and a processor, the sensor and the communication interface are operated under control of the processor; The sensor is configured to identify a location of an unmanned aerial vehicle (UAV) violating a predetermined rule, and the communication interface is configured to communicate a violation notification to the UAV, the violation notification being a notification indicating that the predetermined rule is being violated; The processor monitors movement of the UAV following notification of the violation; determining whether the distance of the movement of the device in a direction outside the monitored airspace falls below a threshold amount after a predetermined time; a device configured to notify other devices using the communications interface that capture of secondary evidence of the violation is required if a distance of the movement of the device in a direction outside of a monitored airspace falls below a threshold amount after a predetermined time.

12. A device including a sensor, a communication interface, and a processor, the sensor and the communication interface are operated under control of the processor; The sensor is configured to identify a location of an unmanned aerial vehicle (UAV) that is violating a predetermined regulation; The communication interface is configured to communicate a notification of a violation to the UAV indicating that the predetermined rule has been violated; The device, wherein the processor is configured to, if a response identifying the UAV is not received from the UAV, notify other devices using the communications interface that capture of secondary evidence of the violation is required.

13. The device of claim 11 , wherein the predetermined rule is not to enter a no-fly zone.

14. The device of claim 12, wherein the other device is a drone traffic control server, the drone traffic control server further configured to instruct the UAV to move to a location to capture evidence of the UAV violating the predetermined rule.

15. The device of claim 11 , wherein the other device is selected from a plurality of other devices, and the other device is selected based on at least one of a position of the other device relative to the UAV, a flight path of the other device, a flight path of the UAV, and a type of sensing equipment located on the other device.

16. The processor, receiving information from the other device via the communication interface; Following notification of the violation, comparing the received information with the monitored movement of the UAV; 12. The device of claim 11, wherein if the comparison result is sufficient to take action, the processing circuitry is configured to issue a request via the communications interface to disable the UAV.

17. Prior to the step of issuing a request to disable the UAV, the processor: receiving information identifying the UAV from the other device via the communication interface; comparing the received information with the captured information that identifies the UAV from the other devices; The device of claim 16, further configured to issue a request via the communications interface to disable the UAV if the comparison result is sufficient to take action.

18. The device of claim 17 , wherein the received information from the other devices supplements the captured information.

19. 17. The device of claim 16, wherein disabling the UAV includes at least one of jamming a signal controlling operation of the UAV, firing a projectile at or colliding with the UAV, capturing the drone, and remotely taking control of the drone by intercepting and modifying control signals.

Citation Information

Patent Citations

  • Modular approach for smart and customizable security solutions and other applications for a smart city

    US20170301220A1

  • Airspace activity tracking using unmanned aerial vehicles

    US9858822B1