SIGNAGE MONITORING SYSTEM

The signboard monitoring system addresses the issue of missing or damaged traffic signs by using vehicle processors and servers to correlate data and display alerts through augmented reality, thereby improving road safety and clarity for drivers.

DE102023134870B4Active Publication Date: 2025-06-05GM GLOBAL TECHNOLOGY OPERATIONS LLC
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
DE102023134870
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2023-10-14
Filing Date
2023-12-13
Publication Date
2025-06-05
Estimated Expiration
2043-12-13

AI Technical Summary

Technical Problem

Missing or damaged traffic signs and markings can impair public safety by providing unclear information to drivers and other road users, leading to potential accidents.

Method used

A signboard monitoring system for vehicles that includes a vehicle processor storing data on vehicle location, events, and exterior sign information, and a server that determines the effectiveness of exterior markings by correlating vehicle event data with location data and sign information, and displays missing or damaged signs through augmented reality if they are ineffective.

Benefits of technology

The system effectively identifies and alerts users to missing or damaged traffic signs, enhancing road safety by providing clear information to drivers and enabling timely updates or replacements of ineffective signage.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

A sign monitoring system for a vehicle is disclosed. The sign monitoring system includes a vehicle processor that stores data including vehicle location, vehicle event data, and information about existing exterior signage. The sign monitoring system also includes a server communicatively coupled to the vehicle processor and configured to determine the effectiveness of existing exterior signage based on correlated vehicle event data and vehicle location data from a plurality of vehicles.
Need to check novelty before this filing date? Find Prior Art

Description

INTRODUCTION

[0001] The present disclosure generally relates to a signage monitoring system.

[0002] The document US 2015 / 0 227 965 A1 discloses a signage monitoring system for a vehicle according to the preamble of claim 1. The documents JP 6 813 595 B2, DE 10 2019 209 552 A1, US 2019 / 0 362 165 A1 and DE 10 2015 203 115 A1 disclose related systems.

[0003] Road and traffic signs and markings are an essential component of the road network and contribute significantly to road safety. Traffic signs provide drivers, pedestrians, and other road users with valuable information about the road conditions ahead, including hazards, speed limits, directions, and traffic rules.

[0004] When these signs or markings are lost due to vandalism, accidents, or other reasons, public safety is compromised. For example, if a stop sign is missing, drivers are unaware that they need to stop at an intersection and may cause an accident. Another potential situation can arise when road markings such as lane dividers, stop lines, or turn lanes are missing.

[0005] It is therefore an object of the invention to detect missing or damaged traffic signs in order to mitigate the impact on public safety. SUMMARY

[0006] The above-mentioned object is achieved by the features of claim 1. Advantageous further developments emerge from the subclaims.

[0007] A sign monitoring system for a vehicle includes a vehicle processor that stores data such as vehicle location, vehicle event data, and information about existing exterior signage. The sign monitoring system also includes a server communicatively coupled to the vehicle processor and configured to determine the effectiveness of existing exterior signage based on correlated vehicle event data and vehicle location data from a plurality of vehicles. In some examples, at least one of the data sets stored by the vehicle processor is acquired through video recordings from vehicle-mounted cameras. The server is configured to determine the effectiveness of existing exterior signage based on whether the correlation between vehicle event data and information about existing exterior signage is above a predetermined correlation threshold.If the server determines that the effectiveness of the existing exterior signage is below the predetermined correlation threshold, the server is further configured to display a sign to the user through augmented reality. In some examples, the server displays the sign to the user through augmented reality until the vehicle leaves the vehicle location. Additionally, in some examples, the vehicle event data is based on a vehicle event that includes one or more of the following changes: vehicle speed, vehicle direction, and lane. In some examples, the data stored by the vehicle processor is stored in the vehicle processor for less than about 15 minutes. In some examples, the sign monitoring system is also integrated with a vehicle.

[0008] In some examples, a sign monitoring system for a vehicle includes a vehicle processor that stores data such as vehicle location, vehicle event data, and information about existing exterior signage. The sign monitoring system also includes a server communicatively coupled to the vehicle processor and configured to determine the occurrence of a vehicle event using vehicle event data, correlate vehicle event data, vehicle location, and information about existing exterior signage, determine the effectiveness of the exterior signage based on the correlation of vehicle event data, vehicle location, and information about existing exterior signage, and recommend changes to the existing exterior signage. In some examples, at least one of the sets of data stored by the vehicle processor is acquired through video recordings from cameras mounted on the vehicle.The server is configured to determine whether the existing exterior signage is effective based on whether the correlation between vehicle event data and information about the existing exterior signage is above a predetermined correlation threshold. The server is configured to, if the server determines that the effectiveness of the existing exterior signage is less than the predetermined correlation threshold, display a sign to the user through augmented reality. In some examples, the server displays the sign to the user through augmented reality until the vehicle leaves the vehicle location. In some examples, the vehicle event data is based on a vehicle event that includes one or more of the following changes: vehicle speed, vehicle direction, and vehicle lane change.

[0009] In some examples, a sign monitoring system for a vehicle includes a vehicle processor that stores data such as vehicle location, vehicle event data, and existing exterior signage information. The sign monitoring system also includes a server communicatively coupled to the vehicle processor and configured to detect the occurrence of a vehicle event, correlate vehicle event data, vehicle location, and existing exterior signage information, determine whether existing exterior signage information is effective based on the correlation of vehicle event data, vehicle location, and existing exterior signage information, and display signage via augmented reality if existing exterior signage information is determined to be ineffective.In some examples, at least one of the data groups stored by the vehicle processor is acquired through video recordings from cameras mounted in the vehicle. The server is configured to determine whether the existing exterior signage is effective based on whether the correlation between vehicle event data and information about the existing exterior signage is above a predetermined correlation threshold. In some examples, the server displays the sign to the user through augmented reality until the vehicle leaves the vehicle location. In some examples, the vehicle event data is based on a vehicle event that includes one or more of the following changes: vehicle speed, vehicle direction, and vehicle lane change. In some examples, the sign monitoring system is installed in a vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The drawings described here are for illustrative purposes only and are intended to illustrate selected configurations. Fig. 1 is a perspective view of a vehicle having a vehicle processor communicating with a server according to the present disclosure; Fig. 2 is a functional block diagram illustrating the vehicle processor of Fig. 1 in communication with the server and a third-party processor; Fig. 3 is an exemplary flow diagram of a signage monitoring system according to the present disclosure; and Fig. 4 is an exemplary flow diagram of a signage monitoring system according to the present disclosure.

[0011] Corresponding reference numbers indicate corresponding parts in the drawings. DETAILED DESCRIPTION

[0012] Example configurations will now be described in more detail with reference to the accompanying drawings. Example configurations are provided so that this disclosure will be thorough, and will fully convey the scope of the disclosure to those skilled in the art. Specific details are set forth, such as examples of specific components, devices, and methods, in order to provide a thorough understanding of configurations of the present disclosure. It will be understood by those skilled in the art that specific details need not be used, and that example configurations can be implemented in many different forms.

[0013] The terminology used herein is for the purpose of describing particular example configurations only and is not intended to be limiting. As used herein, the singular articles "a," "an," and "the" can also include the plural forms unless the context clearly indicates otherwise. The terms "comprises," "comprising," "including," and "having" are inclusive and therefore specify the presence of features, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and / or groups thereof. The method steps, processes, and operations described herein should not be construed as necessarily being performed in the order discussed or illustrated unless they are expressly identified as being in order of performance.Additional or alternative steps may be applied.

[0014] When an element or layer is described as being "on," "engaging," "connected," "attached to," or "coupled" with another element or layer, it may be directly on, engaging, connected, attached, or coupled with the other element or layer, or there may be intervening elements or layers. Conversely, when an element is described as being "directly on," "directly engaging," "directly connected to," "directly attached to," or "directly coupled with" another element or layer, there may be no intervening elements or layers. Other words used to describe the relationship between elements should be interpreted similarly (e.g., "between" versus "directly between," "adjacent" versus "directly next to," etc.).As used herein, the term “and / or” includes all combinations of one or more of the related listed items.

[0015] The terms "first," "second," "third," etc., may be used herein to describe various elements, components, regions, layers, and / or sections. These elements, components, regions, layers, and / or sections should not be limited by these terms. These terms may only be used to distinguish one element, component, region, layer, or section from another region, layer, or section, respectively. Terms such as "first," "second," and other numerical terms do not imply a sequence or order unless clearly indicated by the context. Thus, a first element, component, region, layer, or section discussed below could be referred to as a second element, component, region, layer, or section without departing from the teachings of the example configurations.

[0016] In this application, including the definitions below, the term "module" may be replaced by the term "circuit". The term "module" may refer to, be part of, or include: an application-specific integrated circuit (ASIC); a digital, analog, or mixed analog / digital discrete circuit; a digital, analog, or mixed analog / digital integrated circuit; a combinational logic circuit; a field-programmable gate array (FPGA); a processor (shared, dedicated, or group) executing code; memory (shared, dedicated, or group) storing code executed by a processor; other suitable hardware components providing the described functionality; or a combination of some or all of the above, e.g., in a system-on-chip.

[0017] The term “code,” as used above, may include software, firmware, and / or microcode and may refer to programs, routines, functions, classes, and / or objects. The term “shared processor” includes a single processor that executes some or all of the code from multiple modules. The term “group processor” includes a processor that, in combination with other processors, executes some or all of the code from one or more modules. The term “shared memory” includes a single memory that stores some or all of the code from multiple modules. The term “group memory” includes memory that, in combination with other memory, stores some or all of the code from one or more modules. The term “memory” may be a subset of the term “computer-readable medium.”The term "computer-readable medium" does not encompass transitory electrical and electromagnetic signals propagating through a medium and can therefore be considered tangible and non-transitory storage. Non-limiting examples of non-transitory storage include tangible, computer-readable medium, including non-volatile memory, magnetic storage, and optical storage.

[0018] The devices and methods described in this application may be implemented in part or in whole by one or more computer programs executed by one or more processors. The computer programs include processor-executable instructions stored on at least one non-transitory, tangible, computer-readable medium. The computer programs may also include and / or access stored data.

[0019] A software application (i.e., a software resource) may refer to computer software that causes a computing device to perform a task. In some examples, a software application may be referred to as an "application," "app," or "program." Example applications include, but are not limited to, system diagnostic applications, system management applications, system maintenance applications, word processing applications, spreadsheet applications, messaging applications, media streaming applications, social networking applications, and gaming applications.

[0020] Non-transitory memory can be physical devices used to temporarily or permanently store programs (e.g., instruction sequences) or data (e.g., program state information) for use by a computing device. Non-transitory memory can be volatile and / or non-volatile addressable semiconductor memory. Examples of non-volatile memory include flash memory and read-only memory (ROM) / programmable read-only memory (PROM) / erasable programmable read-only memory (EPROM) / electronically erasable programmable read-only memory (EEPROM) (e.g., typically used for firmware such as boot programs). Examples of volatile memory include random-access memory (RAM), dynamic random-access memory (DRAM), static random-access memory (SRAM), phase-change memory (PCM), and floppy disks or tapes.

[0021] These computer programs (also referred to as programs, software, software applications, or code) contain machine instructions for a programmable processor and may be implemented in a procedural and / or object-oriented high-level language and / or in assembly / machine language. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, non-transitory computer-readable medium, apparatus, and / or device (e.g., magnetic disks, optical disks, memories, programmable logic devices (PLDs)) designed to deliver machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal.The term “machine-readable signal” refers to any signal used to convey machine instructions and / or data to a programmable processor.

[0022] Various implementations of the systems and techniques described herein may be realized in digital electronic and / or optical circuits, integrated circuits, purpose-built ASICs (Application Specific Integrated Circuits), computer hardware, firmware, software, and / or combinations thereof. These various implementations may include implementation in one or more computer programs executable and / or interpretable on a programmable system comprising at least one programmable processor, which may be used for special or general purpose purposes and is coupled to receive data and instructions from and to transmit data and instructions to a storage system, and at least one input device and at least one output device.

[0023] The processes and logic flows described in this specification may be performed by one or more programmable processors, also known as data processing hardware, which run one or more computer programs to perform functions by responding to input data and generating output. The processes and logic flows may also be performed by special-purpose logic circuits, such as an FPGA (Field Programmable Gate Array) or an ASIC (application specific integrated circuit). Processors suitable for executing a computer program include, for example, both general-purpose and special-purpose microprocessors, as well as one or more processors of any type of digital computer. Generally, a processor receives instructions and data from read-only memory or random-access memory, or both.The essential elements of a computer are a processor for executing instructions, and one or more storage devices for storing instructions and data. Generally, a computer will also include, or be operatively connected to, one or more mass storage devices for storing data, e.g., magnetic, magneto-optical, or optical disks, or to receive or transfer data to or from them. However, a computer is not required to have such devices. Computer-readable media suitable for storing computer program instructions and data includes all forms of non-volatile memory, media, and storage devices, including, for example, semiconductor memory devices such as EPROM, EEPROM, and flash memory devices; magnetic disks, e.g., internal hard disks or removable media; magneto-optical disks; and CD-ROM and DVD-ROM disks.The processor and memory can be supplemented by or integrated into special logic circuits.

[0024] To enable interaction with a user, one or more aspects of the disclosure may be implemented on a computer having a display device, e.g., a CRT (cathode ray tube), LCD (liquid crystal display) monitor, or a touchscreen for displaying information to the user, and optionally a keyboard and pointing device, e.g., a mouse or trackball, with which the user can provide input to the computer. Other types of devices may also be used to interact with the user; for example, the feedback to the user may be any form of sensory feedback, e.g., visual feedback, auditory feedback, or tactile feedback; and input from the user may be received in any form, including auditory, voice, or tactile input.In addition, a computer can interact with a user by sending and receiving documents to and from a device used by the user; for example, by sending web pages to a web browser on a user's client device in response to requests received from the web browser.

[0025] A signage monitoring system 100 for a vehicle 10 comprises according to Fig. 1-4, a vehicle processor 200 that stores vehicle data 202 of the vehicle 10. The monitoring system 100 may also include a server 300, described in more detail below, that is communicatively coupled to the vehicle processor 200. The vehicle 10 described below is designed as an electric vehicle (EV) and may have autonomous or semi-autonomous capabilities. Additionally or alternatively, the vehicle 10 may be a hybrid vehicle that includes components and capabilities of both an EV and an internal combustion engine (ICE). Furthermore, the vehicle 10 may be equipped with only an internal combustion engine or another power source, if desired.

[0026] The vehicle data 202 includes the vehicle location, vehicle event data 206, and information 208 regarding the presence of exterior signage. The vehicle location generally refers to the location of the vehicle. The vehicle location may be detected by a Global Positioning System (GPS) or other navigation system and transmitted to the vehicle processor 200. Alternatively, the vehicle location may be detected by a user device or a third-party application and transmitted to the vehicle processor 200. In addition, the vehicle location data 204 may also include route data, so that a route on which the vehicle 10 is located may also be transmitted to the vehicle processor 200.

[0027] Vehicle event data 206 generally relates to actions performed by vehicle 10 during operation. Vehicle event data 206 may be collected from any vehicle sensors and / or vehicle cameras used for other applications and communicated to vehicle processor 200 for further processing. In some examples, vehicle event data 206 may include vehicle speed, vehicle lane merging, vehicle steering wheel angle, vehicle crosswalk data, or other vehicle events. In some examples, vehicle speed may refer to the current speed of vehicle 10, whether vehicle 10 has stopped, whether vehicle 10 has changed speed quickly, and other speed-related events.In some examples, the vehicle lane merging data may relate to whether a lane change was detected by the vehicle 10 and / or whether a lane has ended based on visual cues from the vehicle camera. In some examples, the vehicle steering wheel angle may relate to the current angle of the steering wheel and whether the angle of the steering wheel changed rapidly, indicating a vehicle turn. In some examples, the vehicle overpass data includes whether the vehicle camera detected a pedestrian crossing. Other examples of vehicle event data 206 have also been contemplated.

[0028] The exterior signage information generally refers to all signage information, including, but not limited to, roadside or roadside signage. Typically, the exterior signage information is captured via the vehicle camera and transmitted to the vehicle processor 200. However, it is conceivable that the vehicle signage information may additionally and / or alternatively be collected through crowdsourcing. In particular, information about vehicle signage may be collected from vehicles traveling in the immediate vicinity of the vehicle 10. Data from nearby vehicles may be transmitted via Bluetooth. ® , WiFi, third-party applications or other similar methods.

[0029] With further reference to Fig. 1-4, server 300 is configured as a network and / or cloud-based system that communicates with vehicle processor 200. Server 300 is also configured to communicate with third-party processors 400 to collect data from third parties. Third-party processors 400 may include, for example, but are not limited to, vehicle processors associated with other vehicles traveling along the route traveled by vehicle 10. Additionally or alternatively, third-party processors 400 may include processors associated with third-party user devices, such as mobile phones and / or tablets (both not shown), traveling in vehicles along the same route as vehicle 10. Generally, third-party data is expected to include vehicle location data 204, vehicle event data 206, and / or exterior signage information 208 from third-party processors 400.In some examples, vehicle location data 204 is transmitted to server 300 and indicates the vehicle location of each vehicle traveling along the route. In some examples, vehicle event data 206 is transmitted to server 300 and includes, among other things, vehicle speed, lane transitions, vehicle steering angle, vehicle crossing data, or other vehicle operations of each vehicle traveling along the route. In some examples, exterior signage information is transmitted to server 300 and includes signage information collected from each vehicle traveling along the route.

[0030] It is also conceivable that, in some examples, the vehicle processor 200 transmits some or all of the vehicle data 202 to the server 300 for further processing and / or evaluation. It is also conceivable that the vehicle processor 200 and / or the server 300 are continuously and / or regularly updated so that the vehicle data 202 is updated in real time.

[0031] Related to the Fig. 1-4, the server 300 is configured to determine the effectiveness of the existing exterior signage based on correlated data, including, but not limited to, one or more of the following: vehicle event data 206, vehicle location data 204 of the current vehicle and / or a plurality of vehicles, and information 208 about the existing exterior signage. In particular, the server 300 is configured to correlate the vehicle event data 206 with the vehicle location 204 and the information 208 about the existing exterior signage to determine whether the existing exterior signage is effective. For example, the server 300 is configured to correlate data related to current vehicle action with historical vehicle data.More specifically, if the vehicle speed remains constant at a location where the historical vehicle data 200 shows that the vehicle speed typically comes to a standstill, the server 300 may determine that the information about the existing outdoor signage is currently ineffective.

[0032] In some examples, server 300 is also configured to determine the occurrence of a vehicle event using vehicle event data 206, correlated vehicle event data, vehicle location 204, and existing exterior signage information 208. More specifically, server 300 may determine whether a vehicle event, such as a quick stop, evasive maneuver, speed increase, lane merge, or the like, has occurred. For example, server 300 may determine from the vehicle data that a lane merge has occurred. This vehicle event may then be correlated with vehicle location 204 and existing exterior signage information 208 to determine whether the current exterior signage is effective.

[0033] In the Fig. In the example shown in Figures 1-4, the server 300 is configured to recommend changes to the existing outdoor signage. For example, if the server 300 determines that the existing outdoor signage information is ineffective, it may contact a transportation authority or local road authority directly. In some examples, the server 300 may also prompt the user to contact the appropriate authority to report the ineffective signage.

[0034] Additionally, in some examples, server 300 may also be configured to display signage via augmented reality if the existing exterior signage information is determined to be ineffective. For example, if the existing exterior signage information is determined to be ineffective for a speed limit sign along the vehicle's route, server 300 may display the correct speed limit or otherwise alert the driver to the correct speed limit through audio or other augmented reality techniques.

[0035] In the Fig. 3 and Fig. 4 illustrates an exemplary flowchart for the operation of the sign monitoring system 100. In a first step 400, the vehicle is turned off before the user activates the ignition and begins driving in step 502. Once the vehicle 10 starts moving, the vehicle processor 200 begins collecting and recording vehicle data 202 in step 504. In some examples, collecting and recording the vehicle data 202 may include recording from forward-facing cameras and collecting vehicle event data 206 and vehicle location data 204 from other internal sensors and systems. In some examples, the video data is continuously stored by the vehicle processor 200. In step 506, the video data is stored for approximately 15 minutes or less.The vehicle data 202 may be stored by the vehicle processor 200 for approximately ten (10) minutes or less, approximately seven (7) minutes or less, or approximately five (5) minutes or less. When vehicle event data 206 is detected, the stored vehicle event data 206 is transmitted to the server 300. Additionally, when a vehicle event is detected, stored video data is also transmitted to the server 300 in steps 508, 510, and 512. Furthermore, it is contemplated that the vehicle location during the vehicle event may also be transmitted to the server 300 if a vehicle event is detected.

[0036] Once the vehicle data 202, along with the vehicle event data 206 and the video data, are transmitted to the server 300, the server 300 is configured to analyze the video data at step 514 to determine whether any exterior signage is visible near the location of the vehicle event. In some examples, the server 300 uses an algorithm, examples of which are illustrated at step 516, to determine whether the vehicle event data 206 indicates that exterior signage is missing by correlating the vehicle event data 206 with information about the presence of exterior signage. For example, if the vehicle 10 is stopped (true at 516) and no stop sign is detected (false at 516)—for example, by a vehicle camera—a missing stop sign is determined (true at 516). The results of the correlation are then uploaded to the server 300 at 518 along with the driver behavior.

[0037] Related to the Fig. 3, the effectiveness of the existing traffic sign is determined in step 520. In some examples, the effectiveness of the existing sign is determined using the correlated vehicle data 202 of the vehicle 10 in addition to the correlated vehicle data 202 of various other vehicles along the route. In some examples, the server 300 may use a correlation threshold to determine whether the correlation of vehicle event data 206 and exterior sign information reaches a predetermined correlation threshold at which the server 300 determines that the exterior sign information is ineffective in step 522. Even if a sign is detected by the video data, consistent vehicle event data 206 that conflicts with the existing sign may cause the server 300 to determine that the current sign is ineffective.A determination that current signage is ineffective may indicate that the current signage is missing, damaged, and / or needs to be updated to be more effective. For example, if vehicle data 202 along the route shows that vehicles are consistently overspeeding at a particular location, the signage at that location may be determined to be ineffective.

[0038] The server 300 may also store the vehicle data 202 for a specific period of time so that new vehicle data 202 can be compared to the current vehicle data 202 to determine the effectiveness of the signage. For example, if the vehicle data 202 shows that vehicles are not stopping at a location, while historical data shows that vehicles have previously stopped at that location, the server 300 may determine that the current signage is ineffective. The server 300 continues to collect vehicle data 202 until the predetermined effectiveness threshold is reached. In some examples, the server 300 is configured to recommend changes to the signage in step 524 once the predetermined effectiveness threshold is reached. The changes may be recommended to the state department of transportation or other applicable agencies so that the signage can be updated.In some examples, the server 300 may also be configured to further check whether the signage is ineffective in step 526 and upload effectiveness data in step 528.

[0039] In the Fig. 4, the user first activates the ignition and begins driving in step 602. Once the vehicle 10 starts moving, the vehicle processor 200 begins capturing and recording vehicle data 202. In some examples, such as the one shown in Fig. 4, the vehicle data 202 includes the vehicle location 204 and / or the vehicle route information. The information about the vehicle location 204 and / or the vehicle route is then transmitted to the server 300 in step 604, where it is analyzed to determine if there are any known invalid signs ahead on the vehicle route. This known invalid signage information can be determined from the Fig. 3 example or collected by other third-party processors 400.

[0040] If it is determined in step 606 that invalid signage is ahead, in step 608, valid signage may be displayed via augmented reality or otherwise communicated by the vehicle processor 200. For example, if a speed limit sign is determined to be missing, the correct speed limit sign may be displayed on the driver's dashboard via augmented reality. As another example, if it is determined that a stop sign ahead of the vehicle is damaged, the stop sign may be displayed on the dashboard via augmented reality. Since a damaged stop sign is particularly safety-critical, the stop sign may also be announced via the vehicle's audio system or another auxiliary vehicle system.For example, if a lane marking is determined to be missing, the missing lane marking may be displayed along with an additional visual cue such as an arrow and / or written indicators. Thus, the level of augmented reality to be displayed to the driver may be pre-determined based on the signage deemed ineffective. Augmented reality may also be displayed until it is determined, at step 610, that the vehicle 10 is outside the area of ​​the ineffective signage. In some examples, the vehicle processor 200 uses the vehicle position to determine whether the vehicle 10 is outside the area of ​​the ineffective signage.However, it is also conceivable that the vehicle processor 200 transmits the vehicle location to the server 300 or the third-party processor 400 to determine whether the vehicle 10 is outside the area of ​​the effective signage.

[0041] As in Fig.1-4, the sign monitoring system 100 includes the vehicle processor 200, which stores vehicle data 202, including vehicle location 204, vehicle event data 206, and information about existing exterior signs 208. The vehicle processor 200 can communicate with the server 300 to determine the effectiveness of the existing exterior signage based on correlated vehicle event data 206 and vehicle location data 204 from a plurality of vehicles. Once the server 300 determines that an existing exterior signage is ineffective, the server 300 can notify the appropriate authorities to update or replace the existing exterior signage and / or communicate with the vehicle processor 200 to display effective signage through augmented reality.Thus, the sign monitoring system 100 can advantageously help monitor the effectiveness of existing signage and also take the necessary steps to mitigate safety concerns due to missing and / or damaged signage.

Claims

[1] A signage monitoring system (100) for a vehicle (10), the signage monitoring system (100) comprising: a vehicle processor (200) that stores data records (202) including vehicle location, vehicle event data (206), and information about existing exterior signage (208); and a server (300) communicatively coupled to the vehicle processor (200) and configured to determine the effectiveness of the existing exterior signage based on correlated vehicle event data (206) and vehicle location data (204) from a plurality of vehicles, characterized by , that the server (300) is configured to determine the effectiveness of the existing outdoor signage based on whether the correlation between vehicle event data (206) and information about the existing outdoor signage (208) is above a predetermined correlation threshold, wherein the server (300) is configured to, if it determines that the effectiveness of the existing outdoor signage is less than the predetermined correlation threshold, display a sign to the user through augmended reality. [2] The signage monitoring system (100) of claim 1, wherein at least one of the data sets stored by the vehicle processor (200) is captured by video recordings from cameras arranged in the vehicle (10). [3] The signage monitoring system (100) of claim 1, wherein the server (300) displays the sign to the user through augmented reality until the vehicle (10) leaves the vehicle location. [4] The signage monitoring system (100) of claim 1, wherein the vehicle event data (206) is based on a vehicle event comprising one or more of the following changes: vehicle speed, vehicle direction, and vehicle lane. [5] The signage monitoring system (100) of claim 1, wherein the server (300) is also configured to recommend changes to the existing outdoor signage if the information about the existing outdoor signage (208) is determined to be ineffective. [6] The signage monitoring system (100) of claim 1, wherein the server (300) is also configured to display signage through augmented reality when the information about the existing outdoor signage (208) is determined to be ineffective. [7] The signage monitoring system (100) of claim 1, wherein the data stored by the vehicle processor (200) is stored in the vehicle processor (200) for less than about 15 minutes. [8] Vehicle (10) with the signage monitoring system (100) according to claim 1.

Citation Information

Patent Citations

  • Identifying faulty configurations of detectors and signals from light signaling systems

    DE102015203115A1

  • Traffic recording procedures

    DE102019209552A1

  • Methods for verifying the content and location of traffic signs

    JP6813595B2

  • Method and system for evaluting signage

    US20150227965A1

  • Automated crowd sourced tracking of signage conditions by vehicular imaging

    US20190362165A1