Enhanced navigation prompt system and method

Abstract

The invention provides an enhanced navigation cue system and method. A navigation system is disclosed. The system may include a transceiver and a processor. The transceiver may be configured to receive navigation information from a navigation server and sensor input from a sensor of the vehicle. The processor may be configured to obtain the navigation information and the sensor input from the transceiver and determine a predetermined condition of a plurality of predetermined conditions that may be satisfied based on the sensor input. The processor may also be configured to determine a navigation notification based on the predetermined condition and the navigation information. Further, the processor may be configured to output the determined navigation notification.

Description

Technical Field

[0001] The present disclosure relates to navigation systems and methods, and more particularly to navigation systems and methods for providing enhanced navigation prompts based on situational awareness. Background Art

[0002] Most modern vehicles are equipped with navigation systems that assist users when driving their vehicles. For example, a navigation system may guide a user to drive on the best possible route to minimize travel time when the user is driving from a source location to a destination location. In addition, a navigation system may output turn-by-turn navigation instructions or prompts regarding a route, which may assist the user when driving to a destination location.

[0003] Although turn-by-turn navigation instructions enhance the user's driving experience, in many instances, the navigation instructions may not take into account the current vehicle conditions or the conditions of the road the vehicle may be on. Such navigation instructions may cause inconvenience to the user. Summary of the invention

[0004] The present disclosure describes a navigation system and method for providing enhanced navigation instructions or prompts to a vehicle user based on situational awareness of the vehicle's surroundings. The system can be configured to obtain input from vehicle sensors and other vehicles (via vehicle-to-vehicle (V2V) communications) and determine optimal navigation prompts based on the obtained input. In some aspects, the vehicle sensors can include external vehicle cameras, and the input obtained from the vehicle sensors can include images captured by the external vehicle cameras. In response to obtaining the image, the system can determine whether one or more predefined conditions are likely to be met based on the obtained image, and can determine customized navigation prompts based on the type of predefined conditions that are likely to be met.

[0005] For example, when the system determines (based on acquired images or via V2V communications) that a traffic light at a road intersection from which the vehicle may need to turn right may be red, the system may determine a customized or "enhanced" navigation prompt description, such as "turn right when the light turns green." In response to determining such an enhanced navigation prompt, the system may cause the vehicle infotainment system or user device to audibly and / or visually output the navigation prompt.

[0006] As another example, when the system determines that there may be an obstacle (e.g., a construction zone) near an intersection where the vehicle may need to turn, the system can determine a customized navigation prompt description, such as "turn right after avoiding the construction zone." In this case as well, the system can cause the vehicle infotainment system or user device to output the navigation prompt audibly and / or visually. In other aspects, the system can delay outputting the navigation prompt until the vehicle avoids or passes through the construction zone.

[0007] In additional aspects, the system may be configured to obtain information associated with a geographic area in which the vehicle may be traveling, and may determine enhanced navigation prompts based on the obtained information. In an exemplary aspect, the information may include the names of one or more points of interest in the geographic area in which the vehicle may be traveling. The system may use the names of the points of interest to provide enhanced navigation prompts. For example, the system may cause the vehicle infotainment system or user device to output a navigation prompt such as, "Turn right after the museum" (rather than simply outputting "Turn right" as provided by conventional navigation systems).

[0008] In another aspect, the system may be configured to obtain real-time vehicle information from the vehicle, and may determine enhanced navigation prompts based on the obtained vehicle information. In an exemplary aspect, the real-time vehicle information may include vehicle speed, rate of change of vehicle speed, etc. The system may use vehicle information to provide enhanced navigation prompts. For example, when the system determines that the vehicle may slow down near a wrong intersection (based on vehicle information), the system may output a navigation prompt description, such as, "Not this intersection, turn right at the next intersection." Similarly, when the system determines that the vehicle may not slow down or increase speed near an intersection where the vehicle may be expected to turn, the system may output a navigation prompt description, such as, "Slow down, about to turn right."

[0009] The system may also be configured to determine a troublesome roadside condition based on images obtained from a camera external to the vehicle and transmit a maintenance notification to an agency for repair. Examples of troublesome roadside conditions include, but are not limited to, non-functioning traffic lights, graffiti that may obscure traffic signs, signs that are distorted / run over / broken, signs that are obscured by foliage growth, etc.

[0010] The present disclosure discloses a navigation system and method for providing enhanced navigation prompts based on situational awareness of the surrounding environment of a vehicle. Because the navigation prompts take into account the real-time situation or context near the vehicle when the vehicle may be traveling, the navigation prompts are more relevant and useful to the user. In addition, the navigation prompts provided by the system prevent the user from taking wrong turns during the trip and / or missing the intersection where the user should turn in order to conveniently reach the destination location. The system further assists the agency in repairing faulty roadside conditions by timely transmitting maintenance notifications based on images obtained from the vehicle camera.

[0011] These and other advantages of the present disclosure are provided in detail herein. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Detailed description is set forth with reference to the accompanying drawings. The use of the same reference numerals may indicate similar or identical items. Various embodiments may utilize elements and / or components other than those shown in the accompanying drawings, and some elements and / or components may not be present in various embodiments. The elements and / or components in the accompanying drawings are not necessarily drawn to scale. Throughout this disclosure, singular and plural terms may be used interchangeably, depending on the context.

[0013] Figure 1 An environment is depicted in which techniques and structures for providing the systems and methods disclosed herein may be implemented.

[0014] Figure 2 A navigation system according to the present disclosure is depicted.

[0015] Figure 3 A first scenario is depicted in which a vehicle according to the present disclosure is traveling on a road.

[0016] Figure 4 A second scenario is depicted where a vehicle according to the present disclosure is traveling on a road.

[0017] Figure 5 A flow chart of a navigation method according to the present disclosure is depicted. DETAILED DESCRIPTION

[0018] The present disclosure will be described more fully hereinafter with reference to the accompanying drawings, in which example embodiments of the disclosure are shown and which are not intended to be limiting.

[0019] Figure 1 An environment 100 is depicted in which techniques and structures for providing the systems and methods disclosed herein may be implemented. The environment 100 may include a vehicle 102 that may travel on a road 104.

[0020] The vehicle 102 may take the form of any vehicle, such as, for example, an off-road vehicle, a car, a crossover vehicle, a van, a minivan, a bus, a truck, etc. Furthermore, the vehicle 102 may include any powertrain, such as, for example, a gasoline engine, one or more electrically actuated motors, a hybrid powertrain, etc. Furthermore, the vehicle 102 may be a manually driven vehicle, and / or may be configured to operate in a partially autonomous mode.

[0021] The vehicle 102 may include a navigation system (in Figure 2 102) or may be communicatively coupled with a navigation system that may provide navigation assistance to a vehicle user (e.g., a driver) while the user is driving the vehicle 102. For example, the navigation system may provide turn-by-turn navigation instructions or “prompts” to the user via the vehicle infotainment system or a user device as the user drives the vehicle 102 from a source location to a destination location.

[0022] In an exemplary aspect, when a user begins driving from a source location (e.g., home) to a destination location, the user may enter a destination location (e.g., an office address) on a vehicle infotainment system or a user device. The navigation system may obtain the destination location from the vehicle infotainment system or the user device, and may determine the source location from a vehicle geolocation or a global positioning system (GPS) receiver. In response to obtaining / determining the source location and the destination location, the navigation system may determine the best possible route for the user to drive the vehicle 102 from the source location to the destination location. In some aspects, the best possible route may be a route with the shortest travel time or a route with the least traffic. The navigation system may utilize one or more known or conventional methods for determining the best possible route. For the sake of simplicity and conciseness, such known / conventional methods are not described in the present disclosure.

[0023] In response to determining the best possible route, the navigation system may provide turn-by-turn navigation prompts to the user (via the vehicle infotainment system or the user device) as the user drives the vehicle 102 from the source location to the destination location. In some aspects, the navigation system may communicate with one or more vehicle sensors (in the example of FIG. 1 ) via vehicle-to-vehicle (V2V) communications that may provide input to the navigation system at a predefined frequency. Figure 2 The sensor 210 is shown in FIG. 1 ), the vehicle control unit (in Figure 2 , shown as a vehicle control unit 208), one or more servers (in Figure 2 The navigation system may be configured to provide "enhanced" navigation prompts to the user based on input received from the above units.

[0024] For example, when the vehicle 102 may be approaching an intersection where the vehicle 102 may have to turn right (or left) and the navigation system detects that the traffic light / signal 106 at the intersection is red based on input provided by a vehicle sensor (e.g., an external vehicle camera), the navigation system may provide a navigation prompt stating, “Turn right when the light turns green,” such as Figure 1 108. In a conventional navigation system, a navigation prompt in a similar vehicle situation (i.e., when the traffic signal 106 may be red) may be "turn right". However, it will be appreciated by those of ordinary skill in the art that such a navigation prompt may not be accurate because the user may not turn right until the traffic light 106 changes from red to green. Therefore, conventional navigation systems do not consider the current vehicle situation when providing navigation prompts. As disclosed in the present disclosure, the navigation system utilizes input from the above-mentioned units to provide enhanced navigation prompts based on situational awareness of the vehicle's surroundings, thereby enhancing user convenience.

[0025] As another example, when the navigation system detects that the vehicle 102 may be slowing down (based on input obtained from the vehicle control unit) and is about to make a wrong turn on the route to the destination location, the navigation system may provide a prompt stating, "Not this intersection, turn right at the next intersection." In this way, the navigation system can prevent the user from straying from the route by tracking the vehicle's speed or rate of change of speed to predict whether the user / vehicle 102 may be about to make a wrong turn.

[0026] Combined with the following Figure 2 Describe the details of the navigation system.

[0027] The vehicle 102, the user, and the navigation system implement and / or perform operations as described herein in the present disclosure in accordance with the owner's manual and safety guide. In addition, any action taken by the user of the vehicle in response to one or more navigation prompts disclosed herein should comply with all rules and regulations specific to the location (e.g., federal, state, country, city, etc.) and operation of the vehicle. More importantly, any navigation prompt disclosed herein is for illustrative purposes only. Depending on the context, situation, and applicable rules and regulations, certain navigation prompts may be modified and / or omitted. In addition, regardless of the navigation prompts, the user should use good judgment and common sense when operating the vehicle. That is, all navigation prompts (whether standard or "enhanced") should be considered suggestions and only followed when it is safe to do so and in compliance with any rules and regulations specific to the location and operation of the vehicle.

[0028] Figure 2 An example navigation system 200 is depicted in accordance with the present disclosure. As described herein, the navigation system 200 can be implemented in hardware, software (eg, firmware), or a combination thereof. Figure 2 When you can refer to Figure 3 and Figure 4 .

[0029] The navigation system 200 (or system 200) can be communicatively coupled to the vehicle 202 and one or more servers 204 via the network 206. The vehicle 202 can be combined with the above Figure 1 The vehicle 102 described is the same. Figure 2 The system 200 is depicted as being separate from the vehicle 202 , but in some aspects the system 200 may be part of the vehicle 202 .

[0030] The server 204 may be one or more navigation or commercial servers associated with a map provider that provides navigation information or map information to the system 200 associated with a geographic area where the vehicle 202 may be located. In some aspects, the map information may include a digital map of the geographic area where the vehicle 202 may be located, the names of a plurality of points of interest (e.g., restaurants, office buildings, parks, etc.) in the geographic area, and the like.

[0031] The network 206 illustrates an exemplary communication infrastructure in which the connected devices discussed in various embodiments of the present disclosure may communicate. The network 206 may be and / or include the Internet, a private network, a public network, or other configurations operating using any one or more known communication protocols, such as, for example, Transmission Control Protocol / Internet Protocol (TCP / IP), Wi-Fi, UWB based on the Institute of Electrical and Electronics Engineers (IEEE) standard 802.11, and cellular technologies such as Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), High Speed ​​Packet Access (HSPDA), Long Term Evolution (LTE), Global System for Mobile Communications (GSM), and Fifth Generation (5G), to name a few examples.

[0032] The vehicle 202 may include a plurality of units that may be communicatively coupled to one another. The plurality of units included in the vehicle 202 include, but are not limited to, a vehicle control unit 208 (or VCU 208), one or more sensors 210, an infotainment system 212, a vehicle transceiver 214, and a telematics control unit 216 (or TCU 216). The VCU 208 may be configured to determine vehicle information, including but not limited to vehicle speed, rate of change of vehicle speed, vehicle heading, etc. The VCU 208 may transmit the vehicle information to the vehicle transceiver 214 and / or to a vehicle memory (not shown) for storage purposes.

[0033] Sensors 210 may include, but are not limited to, interior and exterior vehicle cameras, radio detection and ranging (RADAR or “radar”) sensors, light detection and ranging (LiDAR or “laser radar”) sensors, etc. Sensors 210 may be configured to capture images of the vicinity of vehicle 202 and / or detect and locate objects inside and outside vehicle 202, and transmit sensor input to vehicle transceiver 214 and / or to vehicle memory for storage purposes.

[0034] The infotainment system 212 may be configured to receive input from a vehicle user and to output notifications, instructions, etc. For example, a user may enter details (e.g., name, address, etc.) of a destination location that the user may desire to reach on the infotainment system 212. Additionally, the infotainment system 212 may be configured to output audible and / or visual navigation prompts that may assist the user in navigating from a source location to a destination location.

[0035] The TCU 216 may be configured to determine the vehicle geographic location by using a global positioning system (GPS) signal. Specifically, the TCU 216 may include a GPS receiver that may receive GPS signals. The TCU 216 may determine the real-time vehicle geographic location based on the received GPS signal, and may transmit the determined vehicle geographic location to the vehicle transceiver 214 and / or to a vehicle memory for storage purposes.

[0036] The vehicle transceiver 214 may be configured to receive and transmit data, information, instructions, etc. from / to units inside the vehicle 202 and from / to systems or devices outside the vehicle 202 via the network 206. For example, the vehicle transceiver 214 may be configured to transmit sensor input (obtained from the sensor 210), vehicle information (obtained from the VCU 208), vehicle geographic location (obtained from the TCU 216), user input (obtained from the infotainment system 212), etc. to the system 200 and other external devices (e.g., user devices, not shown) via the network 206. Similarly, the vehicle transceiver 214 may be configured to receive data, information, instructions (e.g., turn-by-turn navigation instructions / prompts), etc. from the system 200 and other external devices via the network 206.

[0037] It can be understood by those skilled in the art that Figure 2 The vehicle architecture shown may omit certain vehicle units and / or vehicle computing modules. Figure 2 The vehicle 202 depicted in FIG. 2 is an example of possible implementations according to the present disclosure and, therefore, should not be considered limiting or exclusive.

[0038] The system 200 may include multiple units that may be communicatively coupled to each other. The multiple units included in the system 200 include, but are not limited to, a system transceiver 218, a system processor 220, and a system memory 222. The system transceiver 218 may be configured to receive and transmit data, information, instructions, etc. from / to units within the system 200 and from / to the system (e.g., vehicle 202, server 204) or devices external to the system 200 via the network 206.

[0039] The system processor 220 may be configured to communicate with one or more memory devices (eg, system memory 222 and / or Figure 2The system processor 220 may utilize the system memory 222 to store programs and / or store data in code form to perform various system operations according to the present disclosure. The system memory 222 may be a non-temporary computer-readable storage memory. The system memory 222 may include any one or combination of volatile memory elements (e.g., dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), etc.), and may include any one or more non-volatile memory elements (e.g., erasable programmable read-only memory (EPROM), flash memory, electronically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), etc.).

[0040] In some aspects, the system memory 222 may include a plurality of modules and databases, including but not limited to a vehicle information database 224, a geographic area information database 226, and an image processing module 228. The image processing module 228 as described herein may be stored in the form of computer executable instructions, and the system processor 220 may be configured and / or programmed to execute the stored computer executable instructions for providing navigation instructions / prompts according to the present disclosure. The functions of the databases included in the system memory 222 are described in the following description.

[0041] In operation, a user may enter details of a destination location (e.g., an office address) on the infotainment system 212 or a user device (not shown). The infotainment system 212 or the user device may transmit the destination location details to the vehicle transceiver 214. The vehicle transceiver 214 may also obtain the current real-time vehicle geographic location (e.g., source location). In response to obtaining the source location details and the destination location details, the vehicle transceiver 214 may transmit these location details to the system transceiver 218 via the network 206.

[0042] The system transceiver 218 may receive source location details and destination location details of the vehicle trip from the vehicle transceiver 214, and may send the received details to the system processor 220 and to the vehicle information database 224 for storage purposes. In response to obtaining the source location details and the destination location details, the system processor 220 may obtain navigation information associated with the destination location from the server 204 via the network 206 (or send a request to receive the navigation information). Specifically, the system processor 220 may obtain navigation information associated with a geographic area including the source location and the destination location from the server 204 via the system transceiver 218 and the network 206. In some aspects, the navigation information may include map information associated with a geographic area where the vehicle 202 may be located or a geographic area including the source location and the destination location. In other aspects, the navigation information may include the names of a plurality of points of interest (e.g., restaurants, office buildings, parks, etc.) in the geographic area where the vehicle 202 may be located or a geographic area including the source location and the destination location. In alternative aspects, the names of the plurality of points of interest may be obtained from the server 204 and / or cloud storage as "additional" information rather than as part of the navigation information. In some aspects, the system processor 220 may send the obtained navigation information (and / or additional information) to the geographic region information database 226 for storage purposes.

[0043] In response to obtaining navigation information from server 204 via system transceiver 218, system processor 220 may determine the best possible route that vehicle 102 may traverse from a source location to a destination location, as described above in conjunction with Figure 1 In response to determining the best possible route, the system processor 220 may transmit the details of the best possible route to the vehicle transceiver 214 via the system transceiver 218. The vehicle transceiver 214 may send the received details of the best possible route to the infotainment system 212, and the infotainment system 212 may display the received details on the infotainment system display. The user may then view the details on the display and may start the vehicle journey.

[0044] In some aspects, the system transceiver 218 can receive sensor input from the sensor 210 at a predefined frequency via the vehicle transceiver 214, real-time vehicle geolocation from the TCU 216, vehicle information from the VCU 208, and / or input from other vehicles via V2V communications when the vehicle 202 may be crossing a vehicle path. In response to receiving the above input / information, the system transceiver 218 can send the input / information to the system processor 220.

[0045] The system processor 220 may obtain the above-mentioned input / information from the system transceiver 218, and may determine the turn-by-turn navigation instructions or prompts based on the obtained input / information and the navigation information obtained from the server 204. Specifically, the system processor 220 may be configured to determine "enhanced" turn-by-turn navigation prompts based on the obtained input and the navigation information when a predetermined condition among a plurality of predetermined conditions may be met. In some aspects, the plurality of predetermined conditions may be, for example, the presence of a stop sign on a side of the road 104 on which the vehicle 202 may be traveling, the presence of a traffic signal, the presence of an obstacle on the road 104, the presence of traffic on the road 104, etc. The process of determining the enhanced turn-by-turn navigation prompt when the predetermined conditions are met may be understood in conjunction with the description provided below.

[0046] In some aspects, the system processor 220 can determine an intersection (left or right) at which the vehicle 202 may have to turn on the road 104 while in the vehicle's travel based on navigation information (e.g., map information) and real-time vehicle geographic location obtained from the TCU 216. In response to determining the intersection, the system processor 220 can determine whether a predetermined condition is likely to be satisfied based on sensor input obtained from the sensor 210 and / or vehicle information obtained from the VCU 208. In some aspects, the system processor 220 can determine that the predetermined condition is likely to be satisfied by executing instructions stored in the image processing module 228.

[0047] Specifically, in response to obtaining an image of the vehicle's surroundings captured by a vehicle exterior camera (i.e., sensor 210) (i.e., sensor input), the system processor 220 may execute instructions stored in the image processing module 228 to determine whether a stop sign may be set near an intersection on the road 104 (as a "first predefined condition"), whether the traffic light 106 may be red (as a "second predefined condition"), whether an obstacle (e.g., a construction zone, a vehicle, etc.) may exist near an intersection on the road 104 (as a "third predefined condition"), whether traffic may exist near an intersection on the road 104 (as a "fourth predefined condition"), etc. The examples of predefined conditions described herein are for illustrative purposes and should not be construed as limiting.

[0048] Based on the types of predefined conditions that may be met, the system processor 220 may determine appropriate navigation prompts when the vehicle 202 may need to turn (as determined by using navigation information and real-time vehicle geolocation). In some aspects, the system memory 222 may pre-store a mapping of multiple navigation prompts to multiple predefined conditions, and the system processor 220 may extract the mapping from the system memory 222 to determine the navigation prompts based on the predefined conditions that may be met. In other aspects, the system processor 220 may be an artificial intelligence (AI) / machine learning (ML) based processor that can "learn" from historical navigation prompts, input received from other vehicles or navigation systems installed in other vehicles, feedback received from users, etc. to create navigation prompts based on situational awareness. As the system processor 220 learns from the above information, the system processor 220 can enhance or refine the navigation prompts over time.

[0049] For example, when the system processor 220 determines that the traffic light 106 may be red, the system processor 220 may use the mapping obtained from the system memory 222 to determine a navigation prompt stating, “Turn right when the light turns green.” In response to determining the navigation prompt, the system processor 220 may output or transmit the navigation prompt to the vehicle transceiver 214 (or user device) via the system transceiver 218. In response to obtaining the navigation prompt from the system transceiver 218, the vehicle transceiver 214 may send the navigation prompt to the infotainment system 212, which may output the navigation prompt audibly and / or visually, such as Figure 1 108 of FIG. 108. In this manner, the system processor 220 uses input from the sensors 210 of the vehicle 202 (e.g., a vehicle exterior camera) to provide enhanced navigation prompts that take into account the vehicle's current situation or context. Thus, the navigation prompts provided by the system processor 220 are based on situational awareness of the vehicle's surroundings and are therefore more relevant to the user.

[0050] As another example, when the system processor 220 determines that a red vehicle ahead of the vehicle 202 may be traveling to a similar destination location or may be traversing the same path or turning at the same intersection, the system processor 220 determines the prompt statement, “Follow the vehicle ahead of you.”

[0051] As another example, in some aspects, when the system processor 220 determines that the stop sign 302 (eg, Figure 3When the system processor 220 detects a stop sign 302 near an intersection or on the road 104, the system processor 220 may delay outputting the navigation prompt until the vehicle 202 passes through the stop sign 302.

[0052] As yet another example, in some aspects, when the system processor 220 determines that traffic or a construction zone may exist near an intersection where the vehicle 202 may need to turn during the vehicle's journey, the system processor 220 may use the mapping obtained from the system memory 222 to determine a navigation prompt description, "Turn right after traffic clears" or "Turn right after the construction zone." Also in this case, in alternative aspects, the system processor 220 may delay outputting the navigation prompt until traffic clears or the vehicle 202 passes through the construction zone.

[0053] In another aspect, the system processor 220 may determine enhanced navigation prompts using the names of multiple points of interest (e.g., restaurants, office buildings, parks, etc.) obtained from the server 204 near the intersection on the road 104 as part of the navigation or additional information. For example, the system processor 220 may determine a navigation prompt description, "Turn right after the restaurant," based on the obtained navigation and / or additional information and the real-time vehicle geographic location, instead of outputting the navigation prompt "Turn right." In this way, the system processor 220 determines a navigation prompt that may be more contextually relevant to the situation or location where the vehicle 202 may be located, and thus may assist the user in conveniently using the navigation prompt. Also in this case, the system processor 220 may cause the infotainment system 212 to audibly and / or visually output the determined navigation prompt (i.e., "Turn right after the restaurant"), as described above.

[0054] In additional aspects, the system processor 220 can determine navigation prompts based on the vehicle information obtained from the VCU 208 and the real-time vehicle geographic location. For example, when the system processor 220 determines that the vehicle 202 may be slowing down near a wrong intersection on the road 104 (based on the rate of change of the vehicle speed information obtained from the VCU 208), the system processor 220 can determine that the vehicle 202 may be about to make a wrong turn. In response to such a determination, the system processor 220 can determine and output a navigation prompt "Not this intersection, turn right at the next intersection" or "This is a wrong intersection." The system processor 220 can cause the infotainment system 212 to output such a notification, which can prevent the user from making a wrong turn.

[0055] In a similar manner, when the system processor 220 determines that the vehicle 202 may not slow down or increase the vehicle speed near the intersection where the vehicle 202 should turn during the vehicle's journey, the system processor 220 may determine that the vehicle 202 may be about to miss the intersection. In response to this determination, the system processor 220 may determine and output a navigation prompt "Slow down, you need to turn right at the next intersection." The system processor 220 may cause the infotainment system 212 to output such a navigation prompt, which can prevent the user from missing the intersection.

[0056] Although the above description describes aspects in which the system processor 220 causes the infotainment system 212 to output navigation prompts, in some aspects, the system processor 220 can alternatively or additionally transmit navigation prompts to a user device or other navigation device via the system transceiver 218 and the network 206. In this manner, the user device and / or other navigation device can also use and output enhanced navigation prompts.

[0057] Furthermore, while the above description describes aspects in which the system processor 220 uses sensor input obtained from the sensor 210 and / or vehicle information obtained from the VCU 208 to determine appropriate navigation prompts, in some aspects, the system processor 220 can use the sensor input for performing additional actions. In an exemplary aspect, when the system processor 220 detects the presence of a stop sign, a construction zone, a disabled vehicle, or any other obstacle on the road 104 using images captured by the vehicle camera (i.e., the sensor 210), the system processor 220 can transmit information about such detection to an external server (e.g., a commercial navigation server or company), a cloud storage device, other vehicles, etc. for storage purposes and enhanced navigation purposes. For example, a commercial navigation server receiving such information can update its database to include an indication of a construction zone or stop sign on the road 104 so that the navigation server can provide accurate or "enhanced" navigation services or instructions to its customers.

[0058] In another exemplary aspect, when the system processor 220 detects a troublesome roadside condition based on an image captured by the vehicle camera, the system processor 220 may transmit a maintenance notification to a maintenance server (not shown) via the system transceiver 218. In some aspects, the maintenance server may be associated with an agency (e.g., a municipal agency), and the maintenance notification may include information associated with the troublesome roadside condition (e.g., a geographic location of the troublesome roadside condition, an image captured by the vehicle camera, etc.). Examples of troublesome roadside conditions may include, but are not limited to, a traffic light not functioning, graffiti that may obscure a traffic sign, a sign that is distorted / run over / broken, a sign that is obscured by foliage growth (in Figure 4 402), etc.

[0059] In response to receiving the maintenance notification, the relevant agency can repair the faulty roadside condition. In this way, in addition to providing the enhanced navigation prompts described above, the system processor 220 also assists in enhancing the user's overall driving experience.

[0060] Figure 5 A flowchart of an example navigation method 500 according to the present disclosure is depicted. Figures 1 to 4 To describe Figure 5 The following process is exemplary and is not limited to the steps described below. Furthermore, alternative embodiments may include more or fewer steps than shown or described herein, and may include the steps in an order different from the order described in the following exemplary embodiments.

[0061] refer to Figure 5 , at step 502, the method 500 may begin. At step 504, the method 500 may include obtaining, by the system processor 220, navigation information and sensor input. At step 506, the method 500 may include determining, by the system processor 220, based on the sensor input, that a predefined condition may be satisfied. For example, as described above, the system processor 220 may determine whether a stop sign, traffic light / signal, or obstacle may be present near an intersection where the vehicle 202 may turn on the road 104.

[0062] In response to determining that the predefined condition may be met, at step 508, the system processor 220 may determine the best navigation instructions or prompts based on the type of predefined condition that may be met, the navigation information, and the real-time vehicle geographic location, as described above. At step 510, the method 500 may include outputting or transmitting, by the system processor 220, the determined navigation prompts to the vehicle transceiver 214 via the system transceiver 218 so that the infotainment system 212 can output the navigation prompts audibly and / or visually.

[0063] At step 512 , method 500 ends.

[0064] In the above disclosure, reference has been made to the accompanying drawings that form a part of the above disclosure, which illustrate specific embodiments in which the present disclosure may be practiced. It should be understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present disclosure. References to "one embodiment," "embodiment," "example embodiment," etc. in this specification indicate that the described embodiment may include specific features, structures, or characteristics, but each embodiment may not necessarily include the specific features, structures, or characteristics. In addition, such phrases do not necessarily refer to the same embodiment. In addition, when features, structures, or characteristics are described in conjunction with an embodiment, whether or not explicitly described, those skilled in the art will recognize such features, structures, or characteristics in conjunction with other embodiments.

[0065] In addition, where appropriate, the functions described herein may be performed in one or more of the following: hardware, software, firmware, digital components, or analog components. For example, one or more application specific integrated circuits (ASICs) may be programmed to perform one or more of the systems and programs described herein. Certain terms are used throughout the specification and claims to refer to specific system components. As will be appreciated by those skilled in the art, components may be referred to by different names. This document is not intended to distinguish between components that have different names but the same function.

[0066] It should also be understood that the word "example" as used herein is intended to be non-exclusive and non-limiting in nature. More specifically, the word "example" used herein indicates one of several examples, and it should be understood that no undue emphasis or preference is placed on the specific example described.

[0067] Computer-readable media (also referred to as processor-readable media) include any non-transitory (e.g., tangible) media that participate in providing data (e.g., instructions) that can be read by a computer (e.g., by a processor of a computer). Such media may take many forms, including but not limited to non-volatile media and volatile media. A computing device may include computer-executable instructions, where the instructions may be executable by one or more computing devices (such as those listed above) and stored on a computer-readable medium.

[0068] With respect to the processes, systems, methods, heuristics, etc. described herein, it should be understood that although the steps of such processes, etc. have been described as occurring according to a certain ordered sequence, such processes may be practiced by performing the described steps in an order different from the order described herein. It should also be understood that certain steps may be performed simultaneously, other steps may be added, or certain steps described herein may be omitted. In other words, the descriptions of processes herein are provided for the purpose of illustrating various embodiments and should in no way be construed as limiting the claims.

[0069] Therefore, it should be understood that the above description is intended to be illustrative and not restrictive. Upon reading the above description, many embodiments and applications other than the examples provided will be apparent. The scope should not be determined with reference to the above description, but should be determined with reference to the entire scope of the appended claims and equivalents to which such claims are entitled. It is expected and anticipated that the technology discussed herein will develop in the future, and the disclosed systems and methods will be incorporated into such future embodiments. In short, it should be understood that the present application is capable of modification and change.

[0070] Unless explicitly indicated to the contrary in this article, all terms used in the claims are intended to be given their ordinary meanings as understood by the skilled person described herein. Specifically, unless the claims state an explicit limitation to the contrary, the use of singular articles such as "one", "the", "said" and the like should be interpreted as describing one or more of the indicated elements. Unless otherwise specifically stated or understood in other ways within the context when used, conditional language such as, in particular, "can", "may", "can" or "may" is generally intended to express that certain embodiments may include certain features, elements and / or steps, while other embodiments may not include certain features, elements and / or steps. Therefore, such conditional language is generally not intended to imply that one or more embodiments require each feature, element and / or step in any way.

[0071] In one aspect of the present invention, the vehicle information includes vehicle speed, vehicle heading, and rate of change of vehicle speed.

[0072] In one aspect of the present invention, the method includes: obtaining additional information associated with a geographical area where the vehicle is located from an external server; and determining the navigation notification based on the additional information.

[0073] In one aspect of the invention, the additional information includes the names of one or more points of interest in the geographical area where the vehicle is located.

[0074] In one aspect of the present invention, the method includes: determining a faulty roadside condition based on the sensor input; and transmitting a maintenance notification to a maintenance server in response to determining the faulty roadside condition, wherein the maintenance notification includes information associated with the faulty roadside condition.

[0075] According to the present invention, a non-transitory computer-readable storage medium is provided, on which instructions are stored, and when the instructions are executed by a processor, the processor causes the processor to: obtain navigation information from a navigation server and sensor input from a sensor of a vehicle; determine whether a predetermined condition among multiple predetermined conditions is satisfied based on the sensor input; determine a navigation notification based on the predetermined condition and the navigation information; and output the navigation notification.

Claims

1. A navigation system, comprising: a transceiver configured to receive navigation information from a navigation server and sensor input from sensors of the vehicle; as well as a processor communicatively coupled to the transceiver, wherein the processor is configured to: obtaining the navigation information and the sensor input from the transceiver; determining based on the sensor input that a predetermined condition of a plurality of predetermined conditions is satisfied; determining a navigation notification based on the predetermined condition and the navigation information; and The navigation notification is output.

2. The navigation system according to claim 1, wherein: The transceiver is further configured to receive a destination location of a vehicle trip, and wherein the navigation information is associated with the destination location.

3. The navigation system according to claim 1, wherein: The navigation information includes map information associated with a geographic area in which the vehicle is located.

4. The navigation system according to claim 1, wherein: The sensor is a vehicle camera, and wherein the sensor input comprises an image captured by the vehicle camera.

5. The navigation system according to claim 1, wherein: The plurality of predetermined conditions include presence of a stop sign, presence of a traffic signal, presence of an obstacle, and presence of traffic.

6. The navigation system according to claim 1, wherein: The transceiver is further configured to receive vehicle information from a vehicle control unit, and wherein the processor is further configured to: obtaining the vehicle information from the transceiver; and The navigation notification is determined based on the vehicle information.

7. The navigation system according to claim 6, wherein: The vehicle information includes vehicle speed, vehicle heading, and rate of change of vehicle speed.

8. The navigation system according to claim 1, wherein: The transceiver is further configured to receive additional information associated with a geographical area in which the vehicle is located from an external server, and wherein the processor is further configured to: obtaining the additional information from the transceiver; and The navigation notification is determined based on the additional information.

9. The navigation system according to claim 8, wherein: The additional information includes the names of one or more points of interest in the geographic area where the vehicle is located.

10. The navigation system according to claim 1, wherein: The processor is further configured to: determining a faulty roadside condition based on the sensor input; and A maintenance notification is transmitted to a maintenance server in response to determining the troubled roadside condition, wherein the maintenance notification includes information associated with the troubled roadside condition.

11. A navigation method, comprising: obtaining, by a processor, navigation information from a navigation server and sensor input from a sensor of the vehicle; determining, by the processor, based on the sensor input, that a predetermined condition among a plurality of predetermined conditions is satisfied; determining, by the processor, a navigation notification based on the predetermined condition and the navigation information; as well as The navigation notification is output by the processor.

12. The navigation method according to claim 11, wherein: The navigation information includes map information associated with a geographic area in which the vehicle is located.

13. The navigation method according to claim 11, wherein: The sensor is a vehicle camera, and wherein the sensor input comprises an image captured by the vehicle camera.

14. The navigation method according to claim 11, wherein: The plurality of predetermined conditions include presence of a stop sign, presence of a traffic signal, presence of an obstacle, and presence of traffic.

15. The navigation method according to claim 11, further comprising: Obtain vehicle information from a vehicle control unit; as well as The navigation notification is determined based on the vehicle information.

Images