Unmanned aerial vehicle for route marking

Abstract

The invention provides a drone for route marking. An unmanned aerial vehicle (UAV) is disclosed. The UAV may include a UAV transceiver configured to receive route information associated with a route. The UAV may also include a UAV processor, which may be configured to obtain the route information from the UAV transceiver. In response to obtaining the route information, the UAV processor may determine a UAV location in the route and identify a route marker near the UAV location from a plurality of route markers based on the route information. The UAV processor may then determine navigation instructions associated with the route markings for a vehicle to navigate the route based on the route information. The UAV may be configured to move near a front of the vehicle and display the navigation instructions.

Description

Technical Field

[0001] The present disclosure relates to an unmanned aerial vehicle (UAV), and more particularly, to a UAV for route marking. Background Art

[0002] Route markers are often needed to mark waypoints in a route or path to assist in vehicle navigation. For example, route markers are needed to indicate junctions / intersections or turning points on a route. Route organizers or operators often use different types of route markers to mark waypoints, such as ribbons, pushpin markers, turn markers, reflective strips, etc.

[0003] On some routes, physical route markers may not be allowed due to environmental considerations. Users often face inconveniences when navigating their vehicles on such routes. Therefore, there is a need for a system that can facilitate user navigation on routes where physical route markers may not exist. Summary of the invention

[0004] The present disclosure describes an unmanned aerial vehicle (UAV) (e.g., a drone) that can act as a route marker and can provide an indication of a waypoint to assist a vehicle driver in navigating a route. The UAV can be communicatively coupled to a vehicle and guide the vehicle (e.g., moving in front of the vehicle) to provide navigation instructions to the vehicle driver. To determine the navigation instructions to be provided to the vehicle driver, the UAV can obtain route information, which can include a route map, a route path, route markers on the route path, and the location and type of each route marker. In response to obtaining the route information, the UAV can identify the real-time UAV position in the route map, and identify the route marker (e.g., an upcoming route marker) that may be closest to the vehicle in the route path based on the real-time UAV position and the route information. The UAV can determine the navigation instructions to be provided to the vehicle driver based on the identified route markers. In response to determining the navigation instructions, the UAV can display the navigation instructions on the UAV display screen. Because the UAV moves in front of the vehicle, the vehicle driver can view the navigation instructions on the UAV display screen and can manipulate the vehicle movement accordingly.

[0005] In some aspects, the navigation instructions displayed on the UAV display screen can be in the form of text messages and / or signs or symbols. In other aspects, the UAV can store multiple ribbons / slogans in the UAV cabin, and one or more of the ribbons / slogans can be used to display navigation instructions to the vehicle driver. Each ribbon / slogan can be associated with a type of route marker. In response to identifying an upcoming route marker, the UAV can identify the route marker type associated with the upcoming route marker from the route information, and can select the ribbon / slogan to be displayed to the vehicle driver based on the identified route marker type accordingly. The UAV can be configured to display the ribbon / slogan to the vehicle driver by physically moving the selected ribbon / slogan out of the UAV cabin.

[0006] In some aspects, the UAV may be configured to provide navigation instructions to the vehicle driver for turning points, bridge points, deceleration points, etc. on the route path. In additional aspects, the UAV may be configured to obtain input from a built-in camera of the UAV, and may determine adverse situations or obstacles on the route path based on the obtained input. The UAV may also be configured to provide instructions and / or navigation instructions to the vehicle driver based on the determined adverse situations or obstacles so that the vehicle driver can avoid the adverse situations or obstacles.

[0007] The present disclosure discloses a UAV that displays navigation instructions to a vehicle driver while the vehicle is traveling on a route. Because the UAV determines the navigation instructions based on route information, there is no need to place physical route markers on the route, which helps save resources and protect the environment. In addition, because the navigation instructions are displayed on the UAV display and the UAV moves in front of the vehicle, the vehicle driver can view the navigation instructions very conveniently and the probability of missing the route markers is greatly reduced.

[0008] These and other advantages of the present disclosure are provided in detail herein. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Detailed description is set forth with reference to the accompanying drawings. The use of the same reference numerals may indicate similar or identical items. Various embodiments may utilize elements and / or components other than those shown in the accompanying drawings, and some elements and / or components may not be present in various embodiments. The elements and / or components in the accompanying drawings are not necessarily drawn to scale. Throughout this disclosure, singular and plural terms may be used interchangeably, depending on the context.

[0010] Figure 1 An example environment is depicted in which techniques and structures for providing the systems and methods disclosed herein may be implemented.

[0011] Figure 2An example system for route marking and navigating a vehicle according to the present disclosure is depicted.

[0012] FIG. 3A to FIG. 3C Depicted are example snapshots of an unmanned aerial vehicle (UAV) providing navigation instructions to a vehicle in accordance with the present disclosure.

[0013] Figure 4 Depicted is another example snapshot of a UAV providing navigation instructions to a vehicle in accordance with the present disclosure.

[0014] Figure 5 Depicted is an example route map of a geographic area showing prohibited areas within the route in accordance with the present disclosure.

[0015] Figure 6 A flow chart of an example method for route marking and navigating a vehicle according to the present disclosure is depicted. DETAILED DESCRIPTION

[0016] The present disclosure will be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the disclosure are shown and which are not intended to be limiting.

[0017] Figure 1 An example environment 100 is depicted in which techniques and structures for providing the systems and methods disclosed herein may be implemented. Environment 100 may include a vehicle 102 and an unmanned aerial vehicle (UAV) 104 (e.g., a drone). Vehicle 102 may take the form of any passenger vehicle or commercial vehicle. In an exemplary aspect, vehicle 102 may be an off-road vehicle that may travel on a route 106 (e.g., an off-road route or path), such as a Figure 1 In other aspects, the vehicle 102 can be a sedan, a crossover vehicle, a van, a minivan, a bus, a truck, etc. In addition, the vehicle 102 can be a manually driven vehicle and / or can be configured to operate in a partially autonomous mode. In addition, the vehicle 102 can include any powertrain, such as, for example, a gasoline engine, one or more electric actuation motors, a hybrid powertrain, etc.

[0018] The UAV 104 may be communicatively coupled to the vehicle 102 and may be configured to guide the vehicle 102 and provide navigation instructions to the vehicle 102 as the vehicle 102 travels on the route 106 (e.g., during drone operations). In other words, the UAV 104 may be configured to move near the front of the vehicle and may be configured to provide navigation instructions to the vehicle 102 to complete the route 106. In some aspects, the UAV 104 may be configured to obtain a GPS position of the vehicle and may be configured to guide the vehicle 102 based on the GPS position of the vehicle. In other aspects, the UAV 104 may include a built-in UAV camera and may be configured to guide the vehicle 102 based on images of the vehicle captured by the built-in UAV camera.

[0019] In some aspects, the UAV 104 may be housed in the vehicle 102 when the UAV 104 may not be in operation and / or when the vehicle 102 may not be traveling. Specifically, the vehicle 102 may include a housing (not shown) for the UAV 104, in which the UAV 104 may rest when the UAV 104 may not be in operation. In some aspects, the housing may be present near the top or roof area of ​​the vehicle and may include a landing pad. When the UAV 104 may not be in use, the UAV 104 may rest in the housing to save power. The UAV 104 may be configured to move out of the housing and move (or "fly") near the front of the vehicle when the UAV 104 may be in operation.

[0020] When the UAV 104 may be in operation (i.e., moving near the front of the vehicle), the UAV 104 may act as a route marker and may provide indications of waypoints to assist in vehicle navigation. For example, when the UAV 104 may be moving near the front of the vehicle, the UAV 104 may provide the vehicle 102 with indications of waypoints (e.g., route markers), such as turning points, speed reduction points, bridge points, pothole points, etc. The vehicle driver / operator may view the indications provided by the UAV 104 and may manipulate the vehicle movement accordingly. The UAV 104 may provide different indications for route marker types. For example, the UAV 104 may provide different indications for turning points compared to indications for bridge points. In FIG. 3A to FIG. 3C and Figure 4 Examples of different types of indications are depicted in and described later in the description below. In additional aspects, the UAV 104 can be configured to provide an indication of an adverse condition or situation when the UAV 104 identifies an adverse condition / situation on the route, for example, based on input / images received from a built-in UAV camera.

[0021] To provide the vehicle 102 with instructions associated with the waypoints, the UAV 104 may first obtain route information associated with the route. In some aspects, the UAV 104 may obtain the route information from the vehicle 102 or an external server that may be associated with a route organizer / operator. The route information may include, for example, a route path, a route map, a route starting point, a route exit point, a list of multiple route markers on the route path, a route marker location associated with each route marker, and a route marker type associated with each route marker.

[0022] In response to obtaining the route information, the UAV 104 may determine a real-time UAV position within the route 106. In some aspects, the UAV 104 may determine the real-time UAV position within the route based on a global positioning system (GPS) signal obtained from a UAV GPS receiver and a route map included in the route information. In other aspects, the UAV 104 may determine the real-time UAV position within the route based on a real-time vehicle geographic location that the UAV 104 may receive from the vehicle 102 and a route map included in the route information.

[0023] In response to determining the real-time UAV position (or UAV position) in the route, the UAV 104 can determine or identify a route marker (from a plurality of route markers) or waypoints near the UAV position. For example, the UAV 104 can identify a route marker that is closest to the UAV 104 in the direction of vehicle movement / heading. In some aspects, the UAV 104 can identify a route marker from a plurality of route markers based on the route information. As an example, by using the route path, the route map, the route marker locations, and the UAV position, the UAV 104 can identify an upcoming or nearest route marker that the vehicle 102 may encounter in the route path.

[0024] In response to route marker identification, the UAV 104 may determine navigation instructions for the vehicle 102 to navigate the route based on the route marker location associated with the identified route marker. For example, when the UAV 104 determines that an upcoming route marker is a junction that may require the vehicle 102 to turn left, the UAV 104 may provide a "turn left" instruction or indication to the vehicle 102. In some aspects, the UAV 104 may provide the instructions / instructions to the vehicle 102 by displaying the instructions on the UAV display. Because the UAV 104 moves in front of the vehicle 102 (as described above), the vehicle driver can view the instructions on the UAV display and can manipulate the vehicle movement accordingly. FIG. 3A to FIG. 3C and Figure 4 An example snapshot of displaying instructions on a UAV display is depicted in FIG. 1 and described later in the description below.

[0025] The vehicle 102 and UAV 104 implement and / or perform operations as described herein in the present disclosure in accordance with the vehicle owner's manual and safety guidelines. In addition, any actions taken by the vehicle driver based on recommendations or notifications provided by the vehicle 102 and / or UAV 104 should comply with all rules specific to the location (e.g., federal, state, country, city, etc.) and operation of the vehicle 102 and UAV 104. Recommendations or notifications as provided by the vehicle 102 and UAV 104 should be considered suggestions and followed only in accordance with any rules specific to the location and operation of the vehicle 102 and UAV 104.

[0026] Figure 2 An example system 200 for route marking and navigating a vehicle 202 according to the present disclosure is depicted. Figure 2 When FIG. 3A to FIG. 3C and Figure 4 . FIG. 3A to FIG. 3C An example snapshot of unmanned aerial vehicle 204 (UAV 204) providing navigation instructions to vehicle 202 is depicted. Figure 4 Another example snapshot of UAV 204 providing navigation instructions to vehicle 202 is depicted.

[0027] System 200 may include a vehicle 202 and a UAV 204, which may be communicatively coupled to each other (e.g., via one or more networks 216 described below). Vehicle 202 may be the same as vehicle 102, and UAV 204 may be the same as UAV 104. Vehicle 202 may include a vehicle computer 206, a vehicle control unit (VCU) 208, and a UAV unit 210. VCU 208 may include a plurality of electronic control units (ECUs) 212 configured to communicate with vehicle computer 206.

[0028] The system 200 may also include a mobile device 214 that may be connected to the vehicle computer 206 and / or the UAV unit 210 using wired and / or wireless communication protocols and transceivers. In some aspects, the mobile device 214 may communicate with the vehicle driver / operator ( Figure 2 The mobile device 214 may be communicatively coupled to the vehicle 202 via one or more networks 216, which may communicate via one or more wireless connections, and / or the mobile device may communicate via a near field communication (NFC) protocol, Protocol, Wi-Fi, ultra-wideband (UWB), and other possible data connection and sharing technologies to connect directly with the vehicle 202. In another aspect, the mobile device 214 can be communicatively coupled with the UAV 204 via one or more networks 216.

[0029] The network 216 illustrates an example communication infrastructure in which the connected devices discussed in the various embodiments of the present disclosure may communicate. The network 216 may be and / or may include the Internet, a private network, a public network, or other configurations operating using any one or more known communication protocols, such as Transmission Control Protocol / Internet Protocol (TCP / IP), Wi-Fi, UWB based on the Institute of Electrical and Electronics Engineers (IEEE) standard 802.11, and cellular technologies such as Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), High Speed ​​Packet Access (HSPDA), Long Term Evolution (LTE), Global System for Mobile Communications (GSM), and Fifth Generation (5G), to name a few examples.

[0030] In some aspects, the vehicle computer 206 and / or the UAV 210 can be installed anywhere in the vehicle 202. The vehicle computer 206 can be or include an electronic vehicle controller having one or more processors 218 and a memory 220. In addition, the UAV unit 210 can be separate from the vehicle computer 206 (e.g., Figure 2 ), or can be integrated as part of the car's computer.

[0031] The processor 218 may be configured to communicate with one or more memory devices (eg, memory 220 and / or memory 220) configured to communicate with a corresponding computing system. Figure 2 The processor 218 may utilize the memory 220 to store programs in code and / or store data for performing aspects according to the present disclosure. The memory 220 may be a non-transitory computer-readable medium or memory that stores UAV operation program code. The memory 220 may include any one or combination of volatile memory elements (e.g., dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), etc.), and may include any one or more non-volatile memory elements (e.g., erasable programmable read-only memory (EPROM), flash memory, electronically erasable programmable read-only memory, (EEPROM), programmable read-only memory (PROM), etc.).

[0032] In some aspects, the vehicle computer 206 can be configured to communicate with one or more servers 222 and the mobile device 214. The server 222 can be part of a cloud-based computing infrastructure and can be associated with and / or include a telematics service delivery network (SDN) that provides services to the vehicle 202 and other vehicles that may be part of a vehicle fleet ( Figure 2In some aspects, the server 222 may be configured to store the above Figure 1 The server 222 may also be communicatively coupled to the UAV 104 via the network 216. The server 222 may transmit route information to the vehicle 202 and / or the UAV 104 via the network 216 at a predefined frequency or when the vehicle 202 / UAV 204 transmits a request to the server 222 to obtain route information.

[0033] According to some aspects, the VCU 208 can share a power bus with the vehicle computer 206 and can be configured and / or programmed to coordinate systems of the vehicle 202, a connected server (e.g., server 222), and other vehicles operating as part of a vehicle platoon (e.g., Figure 2 214). The VCU 208 may include or communicate with any combination of ECUs 212, such as a body control module (BCM) 224, an engine control module (ECM) 226, a transmission control module (TCM) 228, a telematics control unit (TCU) 230, a driver assistance technology (DAT) controller 232, etc. The VCU 208 may also include and / or communicate with a vehicle perception system (VPS) 234, which connects and / or controls one or more vehicle sensing systems 236. The vehicle sensing system 236 may include a vehicle camera, a seating area sensor, an ambient temperature sensor, etc. In some aspects, the VCU 208 may control aspects of the operation of the vehicle and implement one or more instruction sets received from an application (e.g., a drone control application) operating on the mobile device 214, the UAV 204, implement one or more instruction sets stored in the memory 220, and / or implement an instruction set stored in the UAV unit 210.

[0034] The TCU 230 may be configured and / or programmed to provide vehicle connectivity to wireless computing systems on and off the vehicle 202 and may include a navigation (NAV) receiver 238 for receiving and processing GPS signals, module (BLEM) 240 or BUN (BLE, UWB, NFC module), Wi-Fi transceiver, ultra-wideband (UWB) transceiver and / or other wireless transceivers (such as BLEM) 240 that may be configured for wireless communication between the vehicle 202 and other systems, computers and modules Figure 2 20). The TCU 230 may be configured to communicate with the ECU 212 via a bus. The vehicle 202 may be configured to transmit real-time vehicle positioning to the UAV 204 based on GPS signals received by the NAV receiver 238.

[0035] The ECU 212 may control various aspects of vehicle operation and communications using input from a human driver, input from an autonomous vehicle controller, the UAV unit 210, and / or via wireless signal input received over a wireless connection from other connected devices (such as a mobile device 214, a server 222, etc.).

[0036] BCM 224 generally includes an integration of sensors, vehicle performance indicators, and varactors associated with vehicle systems, and may include processor-based power distribution circuits that can control functions associated with the vehicle body (such as lights, windows, security devices, cameras, audio systems, speakers, display systems, door locks and access control, vehicle energy management, and various comfort controls). BCM 224 may also operate as a gateway for bus and network interfaces to communicate with remote ECUs ( Figure 2 (not shown) to interact.

[0037] The DAT controller 232 can provide Level 1 to Level 3 autonomous driving and driver assistance functionality, which can include features such as active parking assistance, trailer back-up assistance, adaptive cruise control, and / or driver state monitoring. In some aspects, the DAT controller 232 can assist the vehicle driver based on navigation instructions / instructions that the UAV 204 can provide to the vehicle 202 (in conjunction with the above). Figure 1 Description) to control vehicle movement (e.g., autonomously manipulate vehicle movement).

[0038] In some aspects, the vehicle computer 206 may be connected to an infotainment system 242, which may include a touch screen interface portion and may include voice recognition features, biometric capabilities that may identify a user based on facial recognition, voice recognition, fingerprint recognition, or other biometric means. The infotainment system 242 may also be configured to audibly and / or visually output notifications / information received from external systems (e.g., the server 222, the mobile device 214, and the UAV 204). For example, the infotainment system 242 may output navigation instructions / directions that the UAV 204 may provide to the vehicle 202 (described above in conjunction with Figure 1 describe).

[0039] The computing system architecture of the vehicle computer 206, VCU 208 and / or UAV unit 210 may omit certain computing modules. Figure 2 The computing environment depicted in FIG. 1 is an example of possible implementations according to the present disclosure and, therefore, should not be considered limiting or exclusive.

[0040] According to some aspects, the UAV unit 210 can be implemented as part of and / or integrated with the ECU 212. The UAV unit 210 can enable efficient UAV movement around the vehicle 202. The UAV unit 210, whether it is integrated with the vehicle computer 206 or the ECU 212, or whether it operates as a standalone computing system in the vehicle 202, can include a vehicle transceiver 244, a vehicle processor 246, and a vehicle memory 248 that can be communicatively coupled to each other. The vehicle processor 246 and the vehicle memory 248 can be similar to the processor 218 and the memory 220, respectively.

[0041] In some aspects, to enable UAV movement near the vehicle 202, the vehicle processor 246 may obtain user input (such as a user preference for UAV flight near the vehicle 202) from the infotainment system 242 and / or the mobile device 214 (e.g., via a UAV control application installed in the mobile device 214). As an example, the user input may include a user preference that the UAV 204 should move between 5 feet and 8 feet in front of the vehicle 202 when the vehicle 202 is traveling on the route 106. In response to obtaining the user input, the vehicle processor 246 may store the obtained user input in the vehicle memory 248, and may additionally transmit the user input to the UAV 204 via the vehicle transceiver 244 and the network 216. The vehicle processor 246 may also obtain vehicle data (such as vehicle speed, vehicle direction / heading, real-time vehicle location, etc.) from the VCU 208, and may transmit the vehicle data to the UAV 204 via the vehicle transceiver 244 and the network 216. The UAV 204 may obtain user input and vehicle data from the vehicle transceiver 244 and may control movement of the UAV near the front of the vehicle based on the user input and vehicle data.

[0042] The UAV 204 may include multiple components, including but not limited to a UAV transceiver 250, a UAV processor 252, a UAV memory 254, and a UAV display module 256, which may be communicatively coupled to each other.

[0043] The UAV display module 256 may be configured to display the above combined Figure 1 In some aspects, the UAV display module 256 may include an electronic ink display that can effectively transmit visual instructions to the vehicle driver. As an example, the UAV display module 256 can use a single color (such as red, yellow, or green) to display navigation instructions, and / or activate different colors when additional instructions or an "all clear" indication may need to be displayed to the vehicle driver.

[0044] The UAV memory 254 may store programs and / or store data in code form for performing various UAV operations according to the present disclosure. Specifically, the UAV processor 252 may be configured and / or programmed to execute computer executable instructions stored in the UAV memory 254 for performing various UAV functions according to the present disclosure. Therefore, the UAV memory 254 may be used to store code and / or data code and / or data for performing operations according to the present disclosure.

[0045] In some aspects, the UAV processor 252 may be configured to communicate with one or more memory devices (e.g., the UAV memory 254 and / or one or more external databases ( Figure 2 The UAV memory 254 may be similar to the memory 220 or the vehicle memory 248 described above.

[0046] According to some aspects, the UAV memory 254 may include a plurality of databases configured to store a plurality of information / data sets. Examples of such databases include, but are not limited to, a route information database 258, a vehicle database 260, and a UAV database 262.

[0047] The UAV transceiver 250 may be configured to receive route information associated with a route (e.g., route 106). In some aspects, the UAV transceiver 250 may receive route information from the vehicle transceiver 244 or the server 222 via the network 216. In addition, the UAV transceiver 250 may be configured to receive vehicle data and user input from the vehicle 202 (e.g., from the vehicle processor 246 via the vehicle transceiver 244). The UAV transceiver 250 may be configured to store the received data in the UAV memory 254. For example, the UAV transceiver 250 may store the route information in the route information database 258 and store the vehicle data and user input in the vehicle database 260.

[0048] In further aspects, the UAV 204 may include a UAV detection unit 264, which may be configured to capture information associated with a geographic area near the UAV 204. In an exemplary aspect, the UAV detection unit 264 may be a built-in UAV camera, and the information captured by the UAV detection unit 264 may include an image / video of a geographic area near the UAV 204. The UAV database 262 may be configured to store images / videos of geographic areas captured by the built-in UAV camera. In some aspects, the UAV processor 252 may be configured to acquire images / videos stored in the UAV database 262, and transmit the images / videos to the vehicle transceiver 244 via the UAV transceiver 250 for display at the infotainment system 242, and for storage in the vehicle memory 248. The UAV processor 252 may additionally transmit the images / videos to the mobile device 214 via the UAV transceiver 250 and / or to the server 222 via the network 216.

[0049] During operation, the user / vehicle driver can initiate vehicle movement on a route. Prior to initiating vehicle movement or during vehicle movement, the user can provide a request to the infotainment system 242 and / or the mobile device 214 to request that the UAV 204 be launched from the housing of the vehicle 202 (described above in conjunction with Figure 1 In response to obtaining a request from the user, the infotainment system 242 and / or the mobile device 214 may transmit a command signal to the UAV 204 (e.g., via the vehicle transceiver 244 when the user provides input to the infotainment system 242) to be transmitted from the housing. The vehicle transceiver 244 may additionally transmit the user input (or the user preferences described above) and vehicle data to the UAV 204.

[0050] The UAV transceiver 250 may receive command signals, user inputs, and vehicle data from the vehicle transceiver 244, and may transmit the received information to the UAV processor 252. In response to receiving the above information, the UAV processor 252 may cause the UAV 204 to launch from the housing and "direct" the vehicle to move (or move near the front of the vehicle) based on the user inputs and vehicle data.

[0051] In addition, in response to or before the UAV 204 is launched from the shell, the UAV processor 252 can obtain route information from the UAV memory 254 or directly from the vehicle 202 or the server 222 via the UAV transceiver 250. In response to obtaining the route information, the UAV processor 252 can determine the position / location of the UAV in the route map (which can be part of the route information). In an exemplary aspect, the UAV processor 252 can determine the UAV position by using a GPS signal associated with the UAV 204 received by a UAV GPS receiver (not shown), and the UAV position can be correlated with the route map to determine the position / location of the UAV in the route map. In other aspects, the UAV processor 252 can determine the UAV position / location by using real-time vehicle positioning (which can be part of the vehicle data obtained from the vehicle 202), and the real-time vehicle positioning can be correlated with the route map to determine the position / location of the UAV in the route map.

[0052] In response to determining the position / location of the UAV in the route map, the UAV processor 252 may identify a route marker or waypoint from a plurality of route markers near the determined UAV position (e.g., an upcoming route marker or a nearest route marker in the route path). In some aspects, the UAV processor 252 may identify the route marker based on route information and information associated with the vehicle heading that may be part of the vehicle data. In response to identifying the route marker, the UAV processor 252 may determine the location of the route marker in the route map (i.e., a "route marker location") and the type of the route marker based on the route information. For example, the UAV processor 252 may determine whether the identified route marker is a junction point or a bridge point as the route marker type.

[0053] In response to determining the route marker location and the route marker type, the UAV processor 252 may determine or generate navigation instructions for the vehicle 202 to navigate the route based on the route information (e.g., the route marker location and the route marker type). As an example, when the UAV processor 252 determines that the identified route marker may be a junction that requires the vehicle 202 to turn right and the identified route marker may be within a predefined distance range in front of the vehicle 202 (e.g., 100 feet to 150 feet in front), the UAV processor 252 may determine or generate navigation instructions for the vehicle 202 to "turn right."

[0054] In response to determining the navigation instruction, the UAV processor 252 can cause the UAV display module 256 to display / provide (as a written message or visual signal) the navigation instruction "turn right" to the vehicle driver, such as Figure 3A The vehicle driver can view the visual messages / instructions and can take appropriate actions based on the displayed navigation instructions.

[0055] In some aspects, the UAV processor 252 may determine navigation instructions based on a mapping of a plurality of route markers and a plurality of navigation instructions that may be pre-stored in the UAV memory 254. In this case, the UAV processor 252 may retrieve the mapping from the UAV memory 254 and determine the appropriate navigation instructions to display / provide to the vehicle 202 based on the determined route marker type and the mapping.

[0056] As described above, the UAV processor 252 can display navigation instructions on the UAV display module 256. For example, the UAV processor 252 can transmit instructions to the UAV display module 256 to display a written message "turn right" or display any symbol to provide the vehicle 202 / vehicle driver with an indication of "turn right". In some aspects, the UAV processor 252 can additionally transmit the navigation instructions to the vehicle transceiver 244 via the UAV transceiver 250 to display / audibly output the navigation instructions on the infotainment system 242. In other aspects, the UAV processor 252 can transmit the navigation instructions to the DAT controller 232 via the UAV transceiver 250, and the DAT controller can assist the vehicle driver in navigating the route based on the received navigation instructions.

[0057] In other aspects, UAV 204 may include or store multiple ribbons or slogans, and UAV processor 252 may use the multiple ribbons or slogans to provide information (e.g., route marking type) and / or navigation instructions associated with the identified route marking to vehicle 202 / vehicle driver. UAV processor 252 may cause UAV 204 to select a ribbon / slogan from multiple ribbons / slogans stored in a cabin (which may be located at the bottom of the UAV) associated with UAV 204 based on the identified route marking (e.g., route marking type), and display the selected ribbon / slogan to vehicle 202 / vehicle driver to provide / display navigation instructions and / or route marking type. For example, UAV processor 252 may cause UAV 204 to lower the selected ribbon / slogan from the bottom of the UAV so that vehicle 202 / vehicle driver can conveniently view navigation instructions. In some aspects, ribbons / slogans may include specific printed messages, such as "turn right". In other aspects, ribbons / slogans may include specific colors indicating navigation instructions. In some aspects, the UAV database 262 may include a mapping of navigation instructions and slogan colors, and the UAV processor 252 may select a slogan color or slogan to display based on the determined navigation instructions.

[0058] In further aspects, the UAV 204 may include lighting elements that may be configured to provide visual indications to the vehicle driver based on the determined navigation instructions.

[0059] Although the above description describes an aspect in which the UAV display module 256 displays the navigation message "turn right", the present disclosure is not limited to such messages. In a similar manner as described above, the UAV processor 252 may display other navigation instructions based on the route marker location and the route marker type associated with the identified route marker, including but not limited to "slowly descend" (e.g., Figure 3B ), "Follow Me" (as Figure 3C As another example, when the UAV processor 252 determines that the route marker type may be a bridge point (or a bump point), the UAV processor 252 may cause the UAV display module 256 to display a message “Jump”, such as Figure 4 Described in.

[0060] In other aspects, the UAV processor 252 may be configured to determine one or more adverse situations in the route path, and indicate information associated with the adverse situation to the vehicle 202 / vehicle driver via the UAV display module 256 (or ribbon / slogan). In this case, the UAV processor 252 may obtain input (i.e., image / video) captured by the UAV built-in camera, and determine the adverse situation based on the input obtained. In some aspects, in response to obtaining input from the UAV built-in camera, the UAV processor 252 may be configured to determine whether there is an adverse situation (e.g., the vehicle is stuck in a pothole) on the route path where the vehicle 202 may be traveling. When the UAV processor 252 determines that there is an adverse situation, the UAV processor 252 may cause the UAV 204 to hover near the adverse situation (e.g., on a vehicle that may be trapped in a pothole), and / or display an image of the adverse situation on the UAV display module 256 to indicate the adverse situation to the vehicle 202 / vehicle driver. Similarly, the UAV processor 252 can determine blind spots on the route path based on input obtained from the UAV's built-in camera, and can determine navigation instructions / notifications based on the determination of the blind spots and output the navigation instructions / notifications on the UAV display module 256.

[0061] In another aspect, the UAV processor 252 can be configured to determine the presence of an obstacle (such as another vehicle, a person, an object, or a wild animal) near the vehicle 202, and output information associated with the presence of the obstacle to the vehicle 202 / vehicle driver. In this case, the UAV processor 252 can detect the presence of an obstacle based on an image / video obtained from a built-in camera of the UAV, and can transmit information associated with the presence of the obstacle to the vehicle 202 / vehicle driver to indicate the presence of such an obstacle near the vehicle 202. The UAV processor 252 can also output information associated with the presence of the obstacle on the UAV display module 256. In addition, in this case, the UAV processor 252 can determine and output navigation instructions for the vehicle 202 / vehicle driver to navigate the route based on the obstacle presence detection.

[0062] In addition to detecting obstacles (e.g., another vehicle) near the vehicle 202, the UAV processor 252 can also cause the UAV 204 to identify and follow unauthorized vehicles in the route 106. The UAV processor 252 and / or the UAV 204 can also notify a third-party entity (such as a route organizer / operator) of the presence of an unauthorized vehicle in the route 106. In addition, the UAV processor 252 can provide instructions to the unauthorized vehicle to leave the route / venue by displaying such instructions on the UAV display module 256.

[0063] In additional aspects, the UAV processor 252 can cause the UAV 204 to land on the vehicle 202 (e.g., to save energy) when there may not be other vehicles near the vehicle 202. The UAV processor 252 can cause the UAV 204 to take off again when a vehicle can be detected near the vehicle 202. In further aspects, the UAV processor 252 can be configured to display navigation instructions to other vehicles near the vehicle 202 and also mark the routes of other vehicles.

[0064] In other aspects, the UAV processor 252 can be configured to predict vehicle movement based on vehicle data. In response to predicting vehicle movement, the UAV processor 252 can be configured to control UAV movement so that the UAV 204 always leads the vehicle 202 (i.e., remains near the front of the vehicle). In additional aspects, the UAV processor 252 can control UAV movement based on user input (e.g., user preferences).

[0065] In some aspects, the UAV 204 may include a UAV battery for performing the above operations. In some aspects, the route 106 may include a charging pad (not shown) that can be used by the UAV 204 to charge its battery so that the UAV 204 can have enough power to operate in the route 106. In other aspects, the UAV 204 can charge the UAV battery by drawing power from the vehicle 202 (e.g., the UAV 204 can land on the vehicle 202, such as landing in the UAV shell, and can charge itself by using the vehicle power supply). In additional aspects, the route 106 may include a specific location where the UAV 204 can land and exchange / replace the UAV battery. In addition, the UAV 204 can replace the UAV battery with a spare battery provided in the vehicle 202. In other aspects, the UAV 204 can also receive power from the vehicle 202 by using a tether connection unit (not shown).

[0066] Figure 5 An example route map 500 of a geographic area is depicted that illustrates prohibited areas / regions within a route in accordance with the present disclosure. In some aspects, the UAV processor 252 can be configured to obtain route information, which can include the route map 500. The route map 500 can include information about prohibited areas (e.g., private areas or areas where vehicles or UAVs may not be allowed to enter, such as in the example of FIG. 5 ). Figure 5 Information of the forbidden area 502 is shown in FIG.

[0067] In response to obtaining the route information, the UAV processor 252 may identify the forbidden area 502 based on the route information. In other words, the UAV processor 252 may extract information associated with the forbidden area 502 from the route information. The UAV processor 252 may be configured to determine and output navigation instructions for the vehicle 202 / vehicle driver to navigate the route 106 based on the identification of the forbidden area 502, so that the vehicle 202 cannot enter such an area / region. For example, the UAV 204 may display "Forbidden area ahead, turn left".

[0068] In other aspects, the UAV 204 can be used in military applications to provide navigation instructions to personnel (such as soldiers). In such cases, the UAV 204 can guide the soldier and display the navigation instructions. In some aspects, the UAV processor 252 can be configured to obtain route information associated with the route that the soldier can take and determine the UAV position in the route. The UAV processor 252 can also be configured to identify waypoints.

[0069] In an additional aspect, UAV 204 may be used as a cellular or WiFi or Bluetooth repeater to help enhance RF communications between off-road participants or broadcast teams.

[0070] Figure 6 A flow chart of an example method 600 for route marking and navigating a vehicle according to the present disclosure is depicted. Figures 1 to 5 ) to describe Figure 6 The following process is exemplary and is not limited to the steps described below. Furthermore, alternative embodiments may include more or fewer steps than shown or described herein, and may include the steps in an order different from the order described in the example embodiments below.

[0071] At step 602, the method 600 may begin. At step 604, the method 600 may include obtaining, by the UAV processor 252, route information associated with the route 106. The UAV processor 252 may obtain the route information from the vehicle 202 or the server 222. As described above, the route information may include a route path, a route map, a route starting point, a route exit point, a list of a plurality of route markers on the route path, a route marker location associated with each route marker, and a route marker type associated with each route marker.

[0072] At step 606, the method 600 may include determining, by the UAV processor 252, the UAV position in response to obtaining the route information. Specifically, the UAV processor 252 may determine the position of the UAV in the route map. At step 608, the method 600 may include identifying, by the UAV processor 252, a route marker from a plurality of route markers near the UAV position. In some aspects, the UAV processor 252 may identify the route marker based on the route information.

[0073] At step 610, the method 600 may include determining, by the UAV processor 252, navigation instructions associated with the identified route markers for the vehicle 202 to navigate the route 106. In some aspects, the UAV processor 252 may determine the navigation instructions based on the route information. At step 612, the method 600 may include displaying, by the UAV processor 252, the navigation instructions.

[0074] Method 600 may end at step 614 .

[0075] In the above disclosure, reference has been made to the accompanying drawings that form a part of the above disclosure, which illustrate specific implementations in which the present disclosure may be practiced. It should be understood that other implementations may be utilized and structural changes may be made without departing from the scope of the present disclosure. References to "one embodiment," "embodiment," "exemplary embodiment," etc. in this specification indicate that the described embodiment may include specific features, structures, or characteristics, but each embodiment may not necessarily include the specific features, structures, or characteristics. In addition, such phrases do not necessarily refer to the same embodiment. In addition, when features, structures, or characteristics are described in conjunction with an embodiment, whether or not explicitly described, those skilled in the art will recognize such features, structures, or characteristics in conjunction with other embodiments.

[0076] In addition, where appropriate, the functions described herein may be performed in one or more of the following: hardware, software, firmware, digital components, or analog components. For example, one or more application specific integrated circuits (ASICs) may be programmed to perform one or more of the systems and programs described herein. Certain terms are used throughout the specification and claims to refer to specific system components. As will be appreciated by those skilled in the art, components may be referred to by different names. This document is not intended to distinguish between components that have different names but the same function.

[0077] It should also be understood that the word "example" as used herein is intended to be non-exclusive and non-limiting in nature. More specifically, the word "example" as used herein indicates one of several examples, and it should be understood that no undue emphasis or preference is placed on the specific example described.

[0078] Computer-readable media (also referred to as processor-readable media) include any non-transitory (e.g., tangible) media that participate in providing data (e.g., instructions) that can be read by a computer (e.g., by a processor of a computer). Such media may take many forms, including, but not limited to, non-volatile media and volatile media. A computing device may include computer-executable instructions, where the instructions may be executable by one or more computing devices (such as those listed above) and stored on a computer-readable medium.

[0079] With respect to the processes, systems, methods, heuristics, etc. described herein, it should be understood that although the steps of such processes, etc. have been described as occurring according to a certain ordered sequence, such processes may be practiced by performing the described steps in an order different from that described herein. It should also be understood that certain steps may be performed simultaneously, other steps may be added, or certain steps described herein may be omitted. In other words, the descriptions of the processes herein are provided for the purpose of illustrating various embodiments and should in no way be construed as limiting the claims.

[0080] Therefore, it should be understood that the above description is intended to be illustrative rather than restrictive. Upon reading the above description, many embodiments and applications other than the examples provided will be apparent. The scope should not be determined with reference to the above description, but should be determined with reference to the entire scope of the appended claims and equivalents to which such claims are entitled. It is anticipated and expected that the technology discussed herein will develop in the future, and the disclosed systems and methods will be incorporated into such future embodiments. In short, it should be understood that the present application is capable of modification and change.

[0081] Unless explicitly indicated to the contrary in this article, all terms used in the claims are intended to be given their ordinary meanings as understood by the skilled person described herein. Specifically, unless the claim states an explicit limitation to the contrary, the use of singular articles such as "one", "the", "said" and the like should be interpreted as describing one or more of the indicated elements. Unless otherwise specifically stated or understood in other ways within the context when used, conditional language such as, in particular, "can", "may", "can" or "may" is generally intended to express that certain embodiments may include certain features, elements and / or steps, while other embodiments may not include certain features, elements and / or steps. Therefore, such conditional language is generally not intended to imply that one or more embodiments require each feature, element and / or step in any way.

[0082] In one aspect of the present invention, the method includes: selecting a ribbon associated with the route marker from a plurality of ribbons, wherein the plurality of ribbons indicate information associated with the corresponding route marker; and displaying the navigation instructions based on the selection, wherein displaying the navigation instructions includes displaying the selected ribbon from the bottom of the UAV.

[0083] In one aspect of the invention, the method includes: identifying a restricted area based on the route information; determining the navigation instructions for the vehicle to navigate the route based on the identification of the restricted area; and displaying the navigation instructions.

[0084] In one aspect of the invention, the method comprises: obtaining input from a detection unit; detecting obstacles near the vehicle based on the input; and determining the navigation instructions for the vehicle to navigate the route based on the determination of the obstacles.

[0085] According to the present invention, a non-transitory computer-readable medium storing computer-executable instructions is provided, which, when executed by one or more processors, results in the following operations, the operations comprising: obtaining route information associated with a route; determining an unmanned aerial vehicle (UAV) position of the UAV in the route based on the route information; identifying a route marker near the UAV position from a plurality of route markers based on the route information; determining navigation instructions associated with the route marker for a vehicle to navigate the route based on the route information, wherein the UAV is communicatively coupled to the vehicle and wherein the UAV is configured to move near the front of the vehicle; and displaying the navigation instructions.

[0086] According to an embodiment, the route information includes one or more of the following: a route path, a route map, a route starting point, a route exit point, a list of multiple route markers on the route path, a route marker location associated with each of the multiple route markers, or a route marker type associated with each of the multiple route markers.

Claims

1. An unmanned aerial vehicle (UAV), comprising: a UAV transceiver configured to receive route information associated with the route; a UAV processor communicatively coupled to the UAV transceiver, wherein the UAV processor is configured to: obtaining the route information from the UAV transceiver; determining a position of the UAV within the route based on the route information; identifying a route marker near the UAV location from a plurality of route markers based on the route information; determining navigation instructions associated with the route markings for a vehicle to navigate the route based on the route information, wherein the UAV is communicatively coupled to the vehicle, and wherein the UAV is configured to move proximate a front portion of the vehicle; as well as The navigation instructions are displayed.

2. A UAV as described in claim 1, wherein the route information includes one or more of the following: a route path, a route map, a route starting point, a route exit point, a list of the multiple route markers on the route path, a route marker location associated with each of the multiple route markers, or a route marker type associated with each of the multiple route markers.

3. A UAV as described in claim 1, wherein the plurality of route markers include waypoints associated with the route, and wherein the waypoints include at least one of a turning point, a deceleration point, a bridge point, or a pothole point.

4. The UAV of claim 1, further comprising a UAV display module configured to display the navigation instructions.

5. A UAV as described in claim 4, wherein the UAV display module includes an electronic ink display.

6. The UAV of claim 1, further comprising a plurality of colored ribbons, wherein the plurality of colored ribbons indicate the navigation instructions.

7. The UAV of claim 6, wherein the UAV processor is further configured to: selecting a colored ribbon from the plurality of colored ribbons to be associated with the route marker; and The navigation instructions are displayed based on the selection, wherein the UAV processor displays the navigation instructions by displaying the selected ribbon from a bottom of the UAV.

8. The UAV of claim 1, wherein the UAV processor is further configured to: identifying a prohibited area in the route based on the route information; determining the navigation instructions for the vehicle to navigate the route based on the identification of the restricted area; and The navigation instructions are displayed.

9. The UAV of claim 1, further comprising a detection unit configured to capture information associated with a geographic area near the UAV.

10. The UAV of claim 9, wherein the detection unit comprises a camera, and wherein the information associated with the geographic area comprises an image of the geographic area.

11. The UAV of claim 9, wherein the UAV processor is further configured to: obtaining input from the detection unit; detecting obstacles in the vicinity of the vehicle based on the input; and The navigation instructions for the vehicle to navigate the route are determined based on the determination of the obstacle.

12. A UAV as described in claim 1, wherein the route information includes a mapping of the plurality of route markers to a plurality of navigation instructions, and wherein the UAV processor is configured to determine the navigation instructions for the vehicle to navigate the route based on the mapping.

13. A method for route marking by an unmanned aerial vehicle (UAV), comprising: obtaining, by the processor, route information associated with the route; determining, by the processor, a position of the UAV within the route based on the route information; identifying, by the processor, a route marker near the UAV location from a plurality of route markers based on the route information; determining, by the processor, navigation instructions associated with the route markings for a vehicle to navigate the route based on the route information, wherein the UAV is communicatively coupled to the vehicle, and wherein the UAV is configured to move near a front portion of the vehicle; as well as The navigation instructions are displayed by the processor.

14. The method of claim 13, wherein the route information comprises one or more of: a route path, a route map, a route starting point, a route exit point, a list of the plurality of route markers on the route path, a route marker location associated with each of the plurality of route markers, or a route marker type associated with each of the plurality of route markers.

15. The method of claim 13, wherein the plurality of route markers include waypoints associated with the route, and wherein the waypoints include at least one of a turning point, a deceleration point, a bridge point, or a pothole point.

Images