Mark monitoring system

Abstract

A landmark monitoring system for a vehicle is disclosed. The sign monitoring system includes a vehicle processor that stores data including vehicle location, vehicle event data, and existing outdoor sign information. The landmark monitoring system also includes a server communicatively coupled to the vehicle processor and configured to determine an existing outdoor landmark validity based on related vehicle event data and vehicle location data from the plurality of vehicles.

Description

Technical Field

[0001] The present disclosure relates generally to sign monitoring systems. Background Art

[0002] The information provided in this section is for the purpose of generally presenting the background of the present disclosure. To the extent described in this section, the work of the presently named inventors, as well as aspects of the description that may not qualify as prior art at the time of filing, are neither explicitly nor implicitly admitted to be prior art with respect to the present disclosure.

[0003] Road signs and markings are an important part of the road network and are vital to ensuring road safety. Road signs provide drivers, pedestrians and other road users with valuable information about road conditions ahead, including hazards, speed limits, directions and traffic rules.

[0004] When these signs or markings are missing due to vandalism, accidents, or other reasons, public safety is impacted. For example, if a stop sign is missing, drivers will not know to stop at an intersection, potentially causing an accident. If road markings such as lane dividers, stop lines, or turn lanes are missing, this can create another potential situation. Therefore, there is still a need to detect missing or broken road signs to mitigate the impact on public safety. Summary of the invention

[0005] In some examples, a sign monitoring system for a vehicle includes a vehicle processor storing data, the data including vehicle location, vehicle event data, and existing outdoor sign information. The sign monitoring system also includes a server, which is communicatively coupled to the vehicle processor and configured to determine the validity of existing outdoor signs based on relevant vehicle event data and vehicle location data from multiple vehicles. In some examples, at least one data stored by the vehicle processor is captured by a video captured by a camera disposed on the vehicle. In some examples, the server is configured to determine the validity of existing outdoor signs based on whether the correlation between the vehicle event data and the existing outdoor sign information is higher than a predetermined correlation threshold. In addition, in some examples, if the server determines that the validity of the existing outdoor sign is less than the predetermined correlation threshold, the server is configured to display the sign to the user through augmented reality. In some examples, the server continues to display the sign to the user through augmented reality until the vehicle leaves the vehicle location. In addition, in some examples, the vehicle event data is based on a vehicle event including one or more of a vehicle speed change, a vehicle direction change, or a lane change. In some examples, the data stored by the vehicle processor is stored in the vehicle processor for less than about 15 minutes. In addition, in some examples, a vehicle includes the sign monitoring system.

[0006] In some examples, a sign monitoring system for a vehicle includes a vehicle processor storing data, the data including a vehicle location, vehicle event data, and existing outdoor sign information. The sign monitoring system also includes a server, which is communicatively coupled to the vehicle processor and configured to determine the occurrence of a vehicle event using the vehicle event data, associate the vehicle event data, the vehicle location, and the existing outdoor sign information, determine the validity of the outdoor sign based on the association of the vehicle event data, the vehicle location, and the existing outdoor sign information, and recommend changes to the existing outdoor sign. In some examples, at least one of the data stored by the vehicle processor is captured by a video captured by a camera disposed on the vehicle. In some examples, the server is configured to determine whether the existing outdoor sign is valid based on whether the correlation between the vehicle event data and the existing outdoor sign information is higher than a predetermined correlation threshold. In some examples, if the server determines that the validity of the existing outdoor sign is less than the predetermined correlation threshold, the server is configured to display the sign to the user through augmented reality. In some examples, the server continues to display the sign to the user through augmented reality until the vehicle leaves the vehicle location. In some examples, the vehicle event data is based on a vehicle event including one or more of a vehicle speed change, a vehicle direction change, or a lane change.

[0007] In some examples, a sign monitoring system for a vehicle includes a vehicle processor storing data, the data including a vehicle location, vehicle event data, and existing outdoor sign information. The sign monitoring system also includes a server that is communicatively coupled to the vehicle processor and configured to determine the occurrence of a vehicle event, associate the vehicle event data, the vehicle location, and the existing outdoor sign information, determine whether the existing outdoor sign information is valid based on the association of the vehicle event data, the vehicle location, and the existing outdoor sign information, and if the existing outdoor sign information is determined to be invalid, display the sign via augmented reality. In some examples, at least one of the data stored by the vehicle processor is captured by a video captured by a camera disposed on the vehicle. In some examples, the server is configured to determine whether the existing outdoor sign is valid based on whether the correlation between the vehicle event data and the existing outdoor sign information is higher than a predetermined correlation threshold. In some examples, the server continues to display the sign to the user via augmented reality until the vehicle leaves the vehicle location. In some examples, the vehicle event data is based on a vehicle event including one or more of a vehicle speed change, a vehicle direction change, or a lane change. In addition, in some examples, the sign monitoring system is included in the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The drawings described herein are for illustrative purposes only of selected configurations and are not intended to limit the scope of the present disclosure.

[0009] Figure 1is a perspective view of a vehicle including a vehicle processor in communication with a server according to the present invention;

[0010] Figure 2 is a diagram showing communication with a server and a third-party processor according to the present disclosure Figure 1 Functional block diagram of a vehicle processor;

[0011] Figure 3 is an example flow chart of a sign monitoring system according to the present disclosure; and

[0012] Figure 4 is an example flow chart of a sign monitoring system according to the present disclosure.

[0013] Corresponding reference characters indicate corresponding parts throughout the several views. DETAILED DESCRIPTION

[0014] Example configurations will now be described more fully with reference to the accompanying drawings. Example configurations are provided so that the present disclosure will be thorough and will fully convey the scope of the present disclosure to those of ordinary skill in the art. Specific details, such as examples of specific components, devices, and methods, are set forth to provide a thorough understanding of the configurations of the present disclosure. It will be apparent to those of ordinary skill in the art that specific details need not be employed, that example configurations may be implemented in many different forms, and that the specific details and exemplary configurations should not be construed as limiting the scope of the present disclosure.

[0015] The terms used herein are only for describing specific exemplary configurations, not for limiting. As used herein, the singular articles "a", "an" and "the" may also be intended to include plural forms, unless the context clearly indicates otherwise. The terms "comprise", "include", "contain" and "have" are inclusive, thus specifying the presence of features, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, steps, operations, elements, parts and / or groups thereof. The method steps, processes and operations described herein should not be interpreted as necessarily requiring them to be performed in the specific order discussed or shown, unless specifically identified as an execution order. Additional or alternative steps may be adopted.

[0016] When an element or layer is referred to as being "on another element or layer," "engaged to," "connected to," "attached to," or "coupled to" another element or layer, it may be directly on, engaged, connected, attached to, or coupled to another element or layer, or there may be intermediate elements or layers. Conversely, when an element is referred to as being "directly on another element or layer," "directly engaged to," "directly connected to," "directly attached to," or "directly coupled to" another element or layer, there may be no intermediate elements or layers. Other words used to describe the relationship between elements should be interpreted in a similar manner (e.g., "between" versus "directly between," "adjacent" versus "directly adjacent," etc.). As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0017] The terms first, second, third, etc. can be used here to describe various elements, components, regions, layers and / or parts. These elements, components, regions, layers and / or parts should not be limited by these terms. These terms are only used to distinguish each element, component, region, layer or part. Terms such as "first", "second" and other numerical terms do not imply order or sequence unless the context clearly indicates. Therefore, the first element, component, region, layer or part discussed below can be referred to as the second element, component, region, layer or part, without departing from the teaching of the example configuration.

[0018] In this application, including the definitions below, the term module may be replaced by the term circuit. The term "module" may refer to or be part of an application specific integrated circuit (ASIC), or include an application specific integrated circuit (ASIC); a digital, analog, or mixed analog / digital discrete circuit; a digital, analog, or mixed analog / digital integrated circuit; a combinational logic circuit; a field programmable gate array (FPGA); a processor (shared, dedicated, or group) that executes code; a memory (shared, dedicated, or group) that stores code executed by the processor; other suitable hardware components that provide the functionality; or a combination of some or all of the above, such as in a system on a chip.

[0019] The term code used above may include software, firmware and / or microcode, and may refer to a program, a routine, a function, a class and / or an object. The term shared processor includes a single processor that executes some or all of the code from multiple modules. The term group processor includes a processor that executes some or all of the code from one or more modules in combination with an additional processor. The term shared memory includes a single memory that stores some or all of the code from multiple modules. The term group memory includes a memory that stores some or all of the code from one or more modules in combination with an additional memory. The term memory may be a subset of the term computer-readable medium. The term computer-readable medium does not include transient electrical signals and electromagnetic signals propagated through the medium and can therefore be considered to be tangible non-transitory memory. Non-limiting examples of non-transitory memory include tangible computer-readable media, including non-volatile memory, magnetic memory, and optical memory.

[0020] The apparatus and methods described in this application may be implemented in part or in whole by one or more computer programs executed by one or more processors. The computer program includes processor executable instructions stored on at least one non-transitory tangible computer readable medium. The computer program may also include and / or rely on stored data.

[0021] Software applications (i.e., software resources) may refer to computer software that enables a computing device to perform tasks. In some examples, software applications may be referred to as "applications," "apps," or "programs." Example applications include, but are not limited to, system diagnostic applications, system management applications, system maintenance applications, word processing applications, spreadsheet applications, messaging applications, media streaming applications, social networking applications, and gaming applications.

[0022] Non-transitory memory can be a physical device used to temporarily or permanently store programs (e.g., instruction sequences) or data (e.g., program state information) for use by a computing device. Non-transitory memory can be volatile and / or non-volatile addressable semiconductor memory. Examples of non-volatile memory include, but are not limited to, flash memory and read-only memory (ROM) / programmable read-only memory (PROM) / erasable programmable read-only memory (EPROM) / electrically erasable programmable read-only memory (EEPROM) (e.g., commonly used for firmware, such as bootloaders). Examples of volatile memory include, but are not limited to, random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), phase change memory (PCM), and disk or tape.

[0023] These computer programs (also referred to as programs, software, software applications, or code) include machine instructions for a programmable processor and may be implemented in high-level procedural and / or object-oriented programming languages ​​and / or assembly / machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, non-transitory computer-readable medium, apparatus, and / or device (e.g., disk, optical disk, memory, programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.

[0024] Various implementations of the systems and techniques described herein can be realized in digital electronic and / or optical circuits, integrated circuits, specially designed ASICs (application specific integrated circuits), computer hardware, firmware, software, and / or combinations thereof. These various implementations may include implementations in one or more computer programs executable and / or interpretable on a programmable system comprising at least one programmable processor, which may be special purpose or general purpose, coupled to receive data and instructions from a storage system, and to send data and instructions to the storage system.

[0025] The processes and logic flows described in this specification can be performed by one or more programmable processors, also known as data processing hardware, executing one or more computer programs to perform functions by operating on input data and generating outputs. These processes and logic flows can also be performed by dedicated logic circuits, such as FPGAs (field programmable gate arrays) or ASICs (application-specific integrated circuits). For example, processors suitable for executing computer programs include general-purpose and special-purpose microprocessors, and any one or more processors of any kind of digital computer. Typically, the processor will receive instructions and data from a read-only memory or a random access memory or both. The basic elements of a computer are a processor for executing instructions and one or more storage devices for storing instructions and data. Typically, a computer will also include or be operably connected to one or more large-capacity storage devices for storing data, such as magnetic disks, magneto-optical disks, or optical disks, to receive data from the large-capacity storage device or to transmit data to it, or both. However, a computer does not need to have such a device. Computer-readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media and storage devices, including, for example, semiconductor memory devices, such as EPROM, EEPROM and flash memory devices; magnetic disks, such as internal hard disks or removable disks; magneto-optical disks; and CD ROM and DVD-ROM disks. The processor and memory may be supplemented by or incorporated in special purpose logic circuitry.

[0026] To provide interaction with a user, one or more aspects of the present disclosure may be implemented on a computer having a display device for displaying information to the user, such as a CRT (cathode ray tube), LCD (liquid crystal display) monitor, or touch screen, and an optional keyboard and pointing device, such as a mouse or trackball, through which the user can provide input to the computer. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback, such as visual feedback, auditory feedback, or tactile feedback; and input from the user may be received in any form, including sound, voice, or tactile input. In addition, the computer may interact with the user by sending documents to and receiving documents from a device used by the user; for example, by sending a web page to a web browser on a user's client device in response to a request received from the web browser.

[0027] refer to Figure 1-4, a sign monitoring system 100 for a vehicle 10 includes a vehicle processor 200 storing vehicle data 202 of the vehicle 10. The monitoring system 100 may also include a server 300 communicatively coupled to the vehicle processor 200, as described in more detail below. As described below, the vehicle 10 is contemplated as an electric vehicle (EV), and may include autonomous or semi-autonomous capabilities. Additionally or alternatively, the vehicle 10 may be a hybrid vehicle including EV and internal combustion engine (ICE) components and capabilities. Furthermore, if desired, the vehicle 10 may include only an internal combustion engine or other power source.

[0028] The vehicle data 202 includes vehicle location, vehicle event data 206, and existing outdoor sign information 208. The vehicle location generally relates to the location of the vehicle. The vehicle location may be collected from a global positioning system (GPS) or other navigation system and transmitted to the vehicle processor 200. Alternatively, the vehicle location may be collected from a user device or a third-party application and transmitted to the vehicle processor 200. In addition, the vehicle location data 204 may include route data, so that the route traveled by the vehicle 10 may also be transmitted to the vehicle processor 200.

[0029] The vehicle event data 206 generally relates to actions taken by the vehicle 10 during operation. The vehicle event data 206 may be collected by any vehicle sensor and / or vehicle camera for other applications and transmitted to the vehicle processor 200 for further processing. In some examples, the vehicle event data 206 may include vehicle speed, lane merging, vehicle steering wheel angle, vehicle crosswalk data, or other vehicle operations. In some examples, the vehicle speed may be related to the current speed of the vehicle 10, whether the vehicle 10 has stopped, whether the vehicle 10 has changed speed rapidly, and other events related to vehicle speed. In some examples, based on visual evidence from the vehicle camera, the vehicle lane merging data may relate to whether a lane change of the vehicle 10 has been detected and / or whether the lane has ended. In some examples, the vehicle steering wheel angle may be related to the current angle of the steering wheel and whether the angle of the steering wheel indicating the vehicle turning has changed rapidly. In some examples, the vehicle crosswalk data includes whether the vehicle camera has detected a pedestrian crosswalk. Other examples of vehicle event data 206 are also contemplated.

[0030] Outdoor sign information generally refers to any sign information, including but not limited to roadside signs or road signs. Typically, the outdoor sign information is collected by a vehicle camera and transmitted to the vehicle processor 200. However, it is contemplated that the vehicle sign information may additionally and / or alternatively be collected by crowdsourcing. Specifically, the vehicle sign information may be collected from nearby vehicles traveling near the vehicle 10. The data from the nearby vehicles may be collected by Wi-Fi, third-party apps, or other similar methods.

[0031] Further references Figure 1-4 , the server 300 is configured as a network and / or cloud-based system that communicates with the vehicle processor 200. The server 300 is also configured to communicate with a third-party processor 400 to collect third-party data. For example, the third-party processor 400 may include, but is not limited to, a vehicle processor associated with other vehicles traveling along the route traveled by the vehicle 10. Additionally or alternatively, the third-party processor 400 may include a processor associated with a third-party user device such as a mobile phone and / or a tablet (neither shown) that moves within the vehicle along the same route as the vehicle 10. It is generally contemplated that the third-party data includes vehicle position data 204, vehicle event data 206, and / or outdoor sign information 208 from the third-party processor 400. In some examples, the vehicle position data 204 is transmitted to the server 300 and indicates the vehicle position of each respective vehicle traveling along the route. In some examples, the vehicle event data 206 is transmitted to the server 300 and includes, but is not limited to, vehicle speed, vehicle lane merging, vehicle steering wheel angle, vehicle crosswalk data, or other vehicle operations of each respective vehicle traveling along the route. In some examples, the outdoor sign information is transmitted to the server 300 and includes sign information collected from each respective vehicle traveling along the route.

[0032] In some examples, it is also contemplated that the vehicle processor 200 can transmit any or all of the vehicle data 202 to the server 300 for further processing and / or evaluation. It is also contemplated that the vehicle processor 200 and / or the server 300 can be continuously and / or periodically updated so that the vehicle data 202 is updated in real time.

[0033] Still refer to Figure 1-4 In the example shown, the server 300 is configured to determine the validity of the existing outdoor sign based on the relevant data, including but not limited to one or more of the vehicle event data 206, the vehicle location data 204 from the current vehicle and / or multiple vehicles, and the existing outdoor sign information 208. Specifically, the server 300 is configured to associate the vehicle event data 206 with the vehicle location 204 and the existing outdoor sign information 208 to determine whether the existing outdoor sign is valid. For example, the server 300 is configured to correlate the data about the current vehicle behavior with the historical vehicle data. More specifically, if the vehicle speed remains constant at a location where the historical vehicle data 200 shows that the vehicle speed usually stops, the server 300 can determine that the existing outdoor sign information is currently invalid.

[0034] In addition, in some examples, the server 300 is configured to use the vehicle event data 206, the related vehicle event data, the vehicle location 204, and the existing outdoor sign information 208 to determine the occurrence of a vehicle event. More specifically, the server 300 can determine whether a vehicle event has occurred, such as a quick stop, a sudden turn of the vehicle, an increase in vehicle speed, a lane merge, etc. For example, the server 300 can use the vehicle data to detect that a lane merge has occurred. The vehicle event can then be associated with the vehicle location 204 and the existing outdoor sign 208 information to help determine whether the current outdoor sign is valid.

[0035] Still refer to Figure 1-4 In the example shown, the server 300 is configured to recommend changes to existing outdoor signs. For example, if the server 300 determines that the existing outdoor sign information is invalid, the server 300 can directly contact the transportation department or local road committee. In addition, in some examples, the server 300 can prompt the user to contact the appropriate agency to report the invalid sign.

[0036] Additionally, in some examples, if the existing outdoor sign information is determined to be invalid, the server 300 may also be configured to display the sign via augmented reality. For example, if the existing outdoor sign information is determined to be invalid for a speed limit sign along the vehicle route, the server 300 may display the correct speed limit, or remind the driver of the correct speed limit via audio or other augmented reality technology.

[0037] Reference now Figure 3 and Figure 4 , an example flow chart of the operation of the sign monitoring system 100 is provided. At an initial step of 500, the vehicle is turned off before a user activates the ignition and begins driving at step 502. Once the vehicle 10 begins to move, at step 504, the vehicle processor 200 begins capturing and recording vehicle data 202. In some examples, capturing and recording vehicle data 202 may include recording a forward-facing camera, and capturing vehicle event data 206 and vehicle location data 204 through other internal sensors and systems. In some examples, the video data is continuously stored by the vehicle processor 200. At step 506, the video data is stored for approximately 15 minutes or less. The vehicle data 202 may be stored by the vehicle processor 200 for approximately ten (10) minutes or less, approximately seven (7) minutes or less, or approximately five (5) minutes or less. If vehicle event data 206 is detected, the stored vehicle event data 206 is transmitted to the server 300. Additionally, if a vehicle event is detected, at steps 508, 510, and 512, the stored video data is also transmitted to the server 300. Furthermore, it is contemplated that if a vehicle event is detected, the vehicle's position during the vehicle event is also transmitted to the server 300 .

[0038] Once the vehicle data 202 including the vehicle event data 206 and the video data is transmitted to the server 300, the server 300 is configured to analyze the video data at step 514 to determine whether an outdoor sign is visible near the location of the vehicle event. In some examples, the server 300 uses an algorithm, an example of which is shown at step 516, to determine whether the vehicle event data 206 indicates that an outdoor sign is missing by correlating the vehicle event data 206 with information related to the presence of the outdoor sign. For example, if the vehicle 10 is stopped (true at 516) and no stop sign is detected (false at 516)—e.g., by a vehicle camera, then the stop sign is determined to be missing (true at 516). At 518, the results of the correlation are uploaded to the server 300 along with the driver behavior.

[0039] Still refer to Figure 3 In the example shown, the validity of the existing sign is determined at step 520. In some examples, the validity of the existing sign is determined using the relevant vehicle data 202 from the vehicle 10 in addition to the relevant vehicle data 202 from various other vehicles along the route. In some examples, at step 522, the server 300 can use a correlation threshold to determine whether the correlation of the vehicle event data 206 and the outdoor sign information reaches a predetermined correlation threshold, at which the server 300 determines that the outdoor sign information is invalid. Even if the sign is detected by video data, consistent vehicle event data 206 that is contrary to the existing sign can trigger the server 300 to determine that the current sign is invalid. Determining that the current sign is invalid may mean that the current sign is missing, damaged, and / or needs to be updated to be more effective. For example, if the vehicle data 202 along the route indicates that the vehicle is continuously speeding at a certain location, the sign at that location may be determined to be invalid.

[0040] The server 300 may also store the vehicle data 202 for a period of time so that new vehicle data 202 can be compared to the current vehicle data 202 to help determine the validity of the sign. For example, if the vehicle data 202 indicates that the vehicle has not been parked at a certain location, and the historical data shows that the vehicle has been parked at the location before, the server 300 may determine that the current sign is invalid. The server 300 continues to collect vehicle data 202 until a predetermined validity threshold is reached. In some examples, once the predetermined validity threshold is reached, the server 300 is configured to recommend changes to the sign at step 524. These changes may be recommended to the state department of transportation or other relevant entities so that the sign can be updated. In some examples, the server 300 may also be configured to continue checking whether the sign is invalid at step 526 and upload data about the validity at step 528.

[0041] Reference now Figure 4In the example shown, in the initial step, the user activates the ignition and begins driving at step 602. Once the vehicle 10 begins to move, the vehicle processor 200 begins to capture and record vehicle data 202. In some examples, for example Figure 4 In the example shown, the vehicle data 202 includes the vehicle location 204 and / or the vehicle route information. Then, at step 604, the vehicle location 204 and / or the vehicle route information is transmitted to the server 300, where it is analyzed to determine whether a known invalid sign is ahead of the vehicle route. The known invalid sign information can be used Figure 3 The examples shown may be calculated or collected from other third party processors 400.

[0042] If it is determined that an invalid sign is ahead in step 606, then in step 608, a valid sign may be displayed via augmented reality or otherwise communicated by the vehicle processor 200. For example, if it is determined that there is no speed limit sign ahead, the correct speed limit sign may be displayed on the driver's dashboard via augmented reality. In another example, if it is determined that the stop sign ahead is damaged, the stop sign may be displayed on the dashboard via augmented reality. In addition, due to extreme safety concerns for damaged stop signs, the stop sign may also be announced via the vehicle audio system or other additional vehicle systems. In another example, if it is determined that a lane sign is missing, the missing lane sign may be displayed with additional visual information, such as an arrow and / or a written display. In this way, the level of determination of the augmented reality to be displayed to the driver may be predetermined based on the type of sign determined to be invalid. The augmented reality may also continue to be displayed until it is determined that the vehicle 10 is outside the invalid sign area in step 610. In some examples, the vehicle processor 200 uses the vehicle position to determine whether the vehicle 10 is outside the invalid sign area. However, it is also contemplated that the vehicle processor 200 may transmit the vehicle location to the server 300 or a third party processor 400 to determine whether the vehicle 10 is outside of a valid landmark area.

[0043] Reference again Figure 1-4, the sign monitoring system 100 includes a vehicle processor 200 storing vehicle data 202, the vehicle data 202 including vehicle location 204, vehicle event data 206, and existing outdoor sign information 208. The vehicle processor 200 can communicate with a server 300 to determine the validity of existing outdoor signs based on the relevant vehicle event data 206 and vehicle location data 204 from multiple vehicles. Once the server 300 determines that the existing outdoor signs are invalid, the server 300 can then notify the appropriate authorities so that the existing outdoor signs can be updated or replaced, and / or can communicate with the vehicle processor 200 to display valid signs through augmented reality. Therefore, the sign monitoring system 100 can advantageously help monitor the validity of existing signs and also take necessary steps to mitigate safety issues caused by missing and / or damaged signs.

[0044] Many embodiments have been described. However, it should be understood that various modifications can be made without departing from the spirit and scope of the present disclosure. Therefore, other embodiments are also within the scope of the following claims.

[0045] The foregoing description has been provided for the purpose of illustration and description. It is not intended to be exhaustive or to limit the present disclosure. Individual elements or features of a particular configuration are generally not limited to that particular configuration, but where applicable, they are interchangeable and can be used in a selected configuration even if not specifically shown or described. This can also be varied in a variety of ways. Such variations should not be considered a departure from the present disclosure, and all such modifications are intended to be included within the scope of the present disclosure.

Claims

1. A sign monitoring system for a vehicle, the sign monitoring system comprising: a vehicle processor that stores data including vehicle location, vehicle event data, and existing outdoor sign information; as well as A server is communicatively coupled to the vehicle processor and is configured to determine existing outdoor sign validity based on correlated vehicle event data and vehicle location data from a plurality of vehicles.

2. The sign monitoring system according to claim 1, wherein: At least one data stored by the vehicle processor is acquired through a video captured by a camera disposed on the vehicle.

3. The sign monitoring system according to claim 1, wherein: The server is configured to determine the validity of the existing outdoor sign based on whether the correlation between the vehicle event data and the existing outdoor sign information is higher than a predetermined correlation threshold.

4. The sign monitoring system according to claim 3, wherein: If the server determines that the existing outdoor sign validity is less than the predetermined relevance threshold, the server is configured to display the sign to the user via augmented reality.

5. The sign monitoring system according to claim 4, wherein: The server continues to display the sign to the user via augmented reality until the vehicle leaves the vehicle location.

6. The sign monitoring system according to claim 1, wherein: The vehicle event data is based on vehicle events including one or more of a vehicle speed change, a vehicle direction change, or a lane change.

7. The sign monitoring system according to claim 1, wherein: The server is further configured to recommend changes to existing outdoor signs if the existing outdoor sign information is determined to be invalid.

8. The sign monitoring system according to claim 1, wherein: The server is further configured to display a sign through augmented reality if the existing outdoor sign information is determined to be invalid.

9. The sign monitoring system according to claim 1, wherein: The data stored by the vehicle processor is stored in the vehicle processor for less than about 15 minutes.

10. A vehicle comprising the sign monitoring system according to claim 1.

Images