Methods for monitoring infrastructure and / or traffic flow-related communication
The method addresses inaccuracies in infrastructure-related traffic data by using RSUs to capture and compare environmental features with actual conditions, ensuring accurate and reliable V2X communication for enhanced traffic safety and efficiency.
Patent Information
- Application Number
- DE102023119460
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-07-24
- Publication Date
- 2024-11-28
- Estimated Expiration
- 2043-07-24
AI Technical Summary
Existing infrastructure-related traffic data, such as lane information and traffic light switching, is often inaccurate, outdated, or unavailable due to systematic errors in roadside units and dynamic changes in traffic conditions, affecting the reliability of V2X communication.
A method for monitoring infrastructure and traffic flow-related communication using roadside units (RSUs) that involves capturing the environment optically or using drones, extracting relevant features, comparing them with actual conditions, and sending deviation messages if discrepancies exceed permissible limits, ensuring accurate data transmission.
Enhances the accuracy and reliability of V2X communication by automatically correcting or deactivating RSUs, improving traffic safety and efficiency through precise lane guidance and traffic light synchronization.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to a method for monitoring infrastructure and / or traffic flow-related communication State of the art
[0002] Document DE 10 2014 016 550 A1 describes a method for recording reference data, in particular of an object and / or the surrounding area. The reference data is recorded from a bird's eye view using an image recording device and compared with a vehicle-mounted assistance system.
[0003] The document DE 10 2019 126 432 A1 relates to a method for operating a motor vehicle assistance system, in which a lane to be traveled is determined. The lane with the lowest resistance value is selected. The resistance value is determined based on the lane surroundings, the lane surface, or the traffic flow in the lane. The traffic flow can be recorded using a drone and transmitted to the assistance system.
[0004] Document US 2019 / 0 322 367 A1 discloses a method for controlling an unmanned drone, in which the drone is used as a mobile roadside unit (RSU) in zones where no stationary RSU is available. The drone then takes over the communication of road- or traffic-related data, for example, using V21 (vehicle-to-infrastructure) communication.
[0005] The use of drones and roadside units for traffic recording and transmitting relevant traffic information is known. However, the current state of the art has fundamental problems. Infrastructure-related traffic data in particular, such as the number and orientation of lanes, especially at intersections, right-of-way rules or traffic light sequences, can be inadequately represented, out of date, missing or incorrect. In practice, the transmission of information generally works quite reliably, but the underlying database (intersection geometries, traffic light sequences) is surprisingly often inaccurate. A further problem is that the recording of traffic flow using roadside units is also subject to systematic or random sources of error. Systematic influences can include inappropriate positioning or orientation of the units orThese could include their detection units (sensors), subsequent structural changes in the detection area, or even unsuitable detection algorithms, i.e., the way in which the desired information is extracted from the detected features. Random influences could include weather or lighting conditions.
[0006] Document EP 3 816 945 A1 relates to an abnormality detection system for vehicles. The system consists of an infrastructural sensor unit installed at a specific location that detects an obstacle, an on-board device connected to an on-board sensor that also detects an obstacle, and a server installed at a different location. The abnormality detection unit compares information about the obstacle detected by the infrastructural sensor and the obstacle detected by the on-board sensor and determines whether one of the sensors is abnormal based on the result of this comparison. If an abnormality is detected, the server displays a predetermined warning that includes at least the location information of the sensor where the abnormality occurred.
[0007] DE 10 2021 209 314 A1 relates to a method for determining the accuracy of at least one infrastructure component of an infrastructure system for driving assistance of at least partially automated motor vehicles. It comprises steps such as acquiring environmental information by the infrastructure component, transmitting this data to vehicles within the detection range, comparing this data with data acquired by the vehicle, determining accuracy information based on the comparison, and transmitting the accuracy information / infrastructure environmental data and the data acquired by the vehicle to a central server unit. The central server unit then aggregates this data and determines the resulting accuracy information, which is then made available.
[0008] The method described in document DE 10 2019 216 732 A1 is used to check the plausibility of map data using at least one sensor in a vehicle. First, map data containing both map guidance information and context information is received by a control unit of the vehicle. At the same time, the control unit receives sensor data from the vehicle sensor(s). Based on this sensor data, at least one piece of sensor guidance information is determined. Subsequently, a discrepancy between the map guidance information and the sensor guidance information is identified. To evaluate the plausibility of this information, a plausibility value is determined based on the sensor data and the context information. This plausibility value indicates how plausible the map guidance information and / or the sensor guidance information is.The aim of the process is to improve the accuracy and timeliness of the map data by continuously comparing it with the vehicle's real sensor data.
[0009] DE 10 2016 219 455 A1 relates to a method and infrastructure for testing or calibrating sensors in vehicles, particularly in the context of automated driving functions. Various test scenarios are generated to test and verify sensor performance. Extraction of sensor data is used for verification, and comparison with stored reference data is performed. The active infrastructure can also include the ability to simulate various environmental conditions as needed.
[0010] Document DE 10 2021 209 315 A1 relates to a method for operating an infrastructure system for driving assistance of at least partially automated motor vehicles. This method involves receiving V2X messages sent by vehicles within the range of the infrastructure system's infrastructure environment sensors. The environmental information from these messages is compared with the data generated by the infrastructure environment sensors. Depending on the comparison result, appropriate measures for the infrastructure environment sensors are determined and initiated.
[0011] A disadvantage of the state of the art is the lack of objectivity and flexibility in monitoring the data emitted by an infrastructure unit and the associated limited scope for improvement. Object of the invention
[0012] The object of the present invention is therefore to improve the transmission of road and traffic-related data. Description and advantages of the invention
[0013] The object is achieved by a method according to the measures of independent claim 1. Advantageous embodiments of the invention are the subject of the dependent claims.
[0014] The invention relates to a method for monitoring infrastructure- and / or traffic-flow-related communication. Infrastructure- and traffic-flow-related communication refers to the context of V2X communication. V2X stands for "Vehicle-to-Everything" and describes wireless communication between vehicles and everything in their surroundings. It is a technology that enables vehicles to communicate with other vehicles, infrastructure components, pedestrians, traffic management systems, and other devices or entities in the surrounding area.
[0015] V2X encompasses various communication domains such as vehicle-to-vehicle (V2V), vehicle-to-infrastructure (V2I), vehicle-to-pedestrian (V2P), vehicle-to-network (V2N), and others. Each of these domains refers to the type of communication and interaction between the vehicle and the corresponding elements or actors.
[0016] In its most basic terms, V2X enables bidirectional communication, exchanging information between vehicles and their surroundings. This allows vehicles to receive relevant data to improve road safety, optimize traffic flows, reduce congestion, increase energy efficiency, and overall enhance the driving experience.
[0017] It is important to note that V2X is a broad and evolving concept that encompasses various technologies and standards. These include wireless communication technologies such as Dedicated Short Range Communication (DSRC, e.g., Wi-Fi according to IEEE 802.11p) and Cellular Vehicle-to-Everything (C-V2X, e.g., via LTE or 5G mobile networks), which can be used in V2X communication. In practice, this usually involves establishing locally limited ad hoc radio networks between the individual communication participants. V2X communication thus differs from traditional radio-based broadcasting of information, e.g., via the Traffic Message Channel (TMC) over VHF.
[0018] Infrastructure-related communication contains information about the infrastructure in a defined environment. Infrastructure in road traffic includes traffic routes, traffic control systems, and physical boundaries. Information about this infrastructure, such as the number of existing lanes, road layouts, lane guidance at intersections, existing traffic lights, their control directions and phase times, the location and direction of pedestrian crossings, and permitted speeds, is transmitted as part of V2X communication, for example.
[0019] Traffic flow-related communication includes information about moving road users, such as vehicles, cyclists, or pedestrians. This information includes the density of road users (number of road users per route section), their average speed, lane occupancy, and much more.
[0020] Infrastructure and traffic flow-related communication also includes information derived from the above-mentioned information, such as recommended speed, recommended lane selection, etc.
[0021] V2X communication takes place using different message types, which are structured according to individual protocols, although these can vary depending on the implemented standard. A central message type is the Cooperative Awareness Message (CAM). This contains information about the road user sending the message. This includes their own identification, their own status (speed, direction of travel, position, size), as well as results from their own environmental perception (obstacles, road conditions, weather conditions). Depending on the application, additional information such as the driver status or current or planned vehicle actions may be included.
[0022] Other V2X messages include, for example, the Basic Safety Message (BSM), Intersection Collision Warning (ICW), the DENM (Decentralized Environmental Notification Message), or the Emergency Vehicle Warning (EVW). In the context of the present invention, the message types SPaT (Signal Phase and Timing), MAP (map), and GID (Geographic Intersection Description) play a particularly important role, as they reflect a large portion of the content to be monitored.
[0023] The SPaT messages transmit information about the current status of traffic light phases and their chronological sequence to surrounding road users. They provide information about when a traffic light will change from red to green or vice versa, and how long a particular phase will last. This allows vehicles to adjust their speed and behavior accordingly to optimize traffic flow and improve safety.
[0024] MAP stands for "map" and refers to a digital map containing information about the roads, lanes, traffic rules, and other relevant features. This map is sent from the infrastructure to vehicles to provide them with a detailed representation of their surroundings. The MAP message can contain information such as road and lane types, speed limits, traffic signs, traffic signal locations and conditions, geocoordinates of intersections, and more. Vehicles can use this information to plan their routes, prepare for lane changes, enhance driver assistance systems, and increase road safety.
[0025] GID messages are used to communicate information about the geographical location of an intersection and its characteristics to other road users. Unlike MAP, GID refers to general information about the infrastructure that is not specifically tied to a map or map update. GID messages can contain information about roadworks, speed limits, parking availability, electric vehicle charging stations, or other points of interest in the area. This information is sent from the infrastructure to vehicles to provide drivers with useful information about the surrounding area. This provides vehicles and other road users in the area with accurate information about the road configuration, helping to improve safety and efficiency.
[0026] As mentioned at the beginning, the content of the communication can deviate from the actual characteristics for a variety of reasons. In the future, the content of V2X communication will increasingly be incorporated into decisions made by automated driving functions and autonomous vehicles. The requirements for the accuracy and reliability of the communicated content will therefore increase, also because its relevance to road safety is increasing. Monitoring, whether immediately after the installation of a unit generating infrastructure- and traffic flow-related communication, during or after roadwork, after changes in traffic control programs, or at regular intervals, is becoming increasingly necessary.
[0027] In a first step of the method according to the invention, the infrastructure and / or traffic flow-related communication transmitted by a mobile or stationary roadside unit is received.
[0028] A roadside unit is typically referred to as a roadside unit (RSU), occasionally also as roadside equipment (RSE) or intelligent roadside station. This is a transceiver (transmitter-receiver) located along a road or sidewalk. Typically, the transceiver units are permanently installed on existing infrastructure elements, such as motorway bridges, traffic lights, or traffic signs. However, there are also dedicated RSUs that are placed, for example, in particularly critical traffic areas. RSUs can also be installed on or in mobile devices, such as portable devices, vehicles, or drones. For the purposes of this description, a mobile RSU preferably refers to a mobile station (e.g., a temporary construction site warning beacon).
[0029] In order to transmit information about the traffic area, the RSU must first acquire this information. Information about immobile environmental elements (infrastructure) can be stored as local data directly in the RSU or retrieved from a remote server via a network. However, much information about the traffic area changes dynamically over time and must therefore be recorded promptly or regularly. This can be done using environmental detection devices (sensors) that are located directly on the RSU, e.g., cameras. The detection devices can also be located remotely or even distributed. For example, counters for determining the number of passing vehicles can be distributed over a longer stretch of road and transmit their current counts to one or more RSUs. These then determine, for example, the current traffic flow and, based on this, a recommended or maximum permitted speed.The acquisition of the content to be transmitted is essential for the function of an RSU, but the manner in which it is obtained is not essential for the present invention.
[0030] In a further step of the method according to the invention, infrastructure and / or traffic flow data are extracted from the received communication. In the V2X concept, infrastructure- and / or traffic flow-related communication takes place via messages sent by the roadside unit. These messages encode the currently recorded or stored infrastructure and / or traffic flow data. Extracting this data means making the information usable for further processing steps, e.g., by storing it or transferring it to a processor for further processing. This step is familiar to those skilled in the art, as it is performed by every assistance system that uses V2X messages.
[0031] In a further step of the method according to the invention, the environment of the roadside unit is detected, preferably optically detected. The environment of the roadside unit to be detected is defined by the fact that the data transmitted by it relate to this environment. If, for example, the lane layout of an intersection is transmitted by the RSU, the environment to be detected contains, at least for the most part, the (relative or absolute) geographical coordinates of the transmitted data. If, for example, the traffic light phases are transmitted, the environment to be detected includes at least the traffic light, possibly with the corresponding viewing angle, so that the optical signals can be detected. The spatial validity of the transmitted communication can thus be directly mapped technically.In other words, the environment of the roadside unit is detected, whereby the environment is determined depending on the local validity of the transmitted communication.
[0032] In some cases, alternatively or in addition to spatial validity, the temporal validity of the transmitted communication can also play a role in the detection of the environment, especially when the transmitted communication changes over time, specifically when the time of transmission of the communication does not coincide with the time of occurrence of the transmitted feature. This is the case, for example, when traffic light phases are transmitted. Accordingly, the detection of the environment of the roadside unit takes place, with the environment being determined depending on the spatial and / or temporal validity of the transmitted communication.
[0033] The environment is preferably image-based and captured using a camera. Other detection methods and means, such as radar, can also be used if this is practical for monitoring the transmitted data.
[0034] In a further step of the method according to the invention, captured infrastructure and / or traffic flow features are extracted from the captured environment. The features to be extracted differ from the data to be extracted in that features are derived from the observation of the environment and data are derived from the received communication. However, both refer to an identical aspect of reality, e.g., lane guidance at an intersection, traffic light control, and the positions of obstacles or special road users, such as emergency vehicles.
[0035] The extraction methods also differ. Depending on the protocol used by the message, the data can be read or derived directly from the communication by a processor. Extracting the captured features may require additional steps depending on the capture method. For example, optical capture of an intersection by a camera requires image processing techniques to determine the road geometry from lane markings or the positions of road users. If other capture tools are used, such as radar, the raw data must be processed accordingly. The extraction results can be returned and saved as object lists, positions, map data, or signal functions.
[0036] In a further step of the method according to the invention, a deviation of the extracted infrastructure and / or traffic flow data from the extracted infrastructure and / or traffic flow characteristics is determined. The data derived from the message is compared with the recorded, i.e., observed, characteristics. This determines if the transmitted data differs from the actually present characteristics. For example, the number, location, and geometry of lanes, their absolute geographical positions, or even the lane-specific traffic light phases can be compared. The determined deviation can be determined as an integer difference (e.g., number of lanes) or as a fraction of a physical quantity (e.g., absolute or relative position deviations; temporal deviation of traffic light phases, deviations in the dimensions of existing areas or objects).
[0037] In a further step of the method according to the invention, a deviation message is sent if the determined deviation is greater than a permissible deviation. The determined deviation from the previous step of the method according to the invention is compared with a preferably feature-specific predetermined permissible deviation. Since the individual features are both known in advance and encoded in the transmitted messages, the permissible deviation can be specified individually for each feature. For the number of lanes, for example, the permissible deviation is zero. Permissible deviations of other features can be specified depending on systematic measurement errors in the detection and extraction of these features. Furthermore, permissible deviations can also depend on the practical relevance of the accuracy of the transmitted data or detected features.For example, permissible deviations from traffic light phases can be specified in tenths of a second, or permissible deviations from positions (traffic lights, lanes) can be specified in the centimeter range. In addition to absolute values, permissible deviations can also include relative deviations, i.e., deviations determined depending on the measured value.
[0038] If the detected deviation exceeds the permissible deviation, a deviation message is sent in response. In the simplest case, a message is sent to a monitoring center (so-called backend), which triggers a review and comparison of the transmitted data with the actual characteristics. Possible configurations of the deviation message can include an automatic correction of the transmitted data, deactivation of the RSU, or the transmission of alternative data.
[0039] According to the invention, the data transmitted by an RSU is thus advantageously checked automatically, which enables the initial or regular comparison of the transmitted data with the actually present features very efficiently and with minimal resource consumption. This improves the road and traffic-related data transmitted by the RSU by increasing its accuracy.
[0040] According to the invention, the surroundings of the roadside unit are recorded from a bird's eye view, preferably by means of a flying unit. A flying unit can be an unmanned aerial vehicle, for example, a drone. Advantageously, this allows the monitoring of communications to be largely automated. If the flying unit is a manned aerial vehicle, for example, a helicopter used to record the traffic situation, the monitoring of communications can also be carried out fully automatically without pilot intervention, for example, through automated use of the existing equipment of the aerial vehicle (communications device, camera). The monitoring takes place almost incidentally. This enables a further increase in monitoring efficiency.In an advantageous development of the method according to the invention, the detection of the environment or the extraction of detected infrastructure and / or traffic flow features from the detected environment takes place depending on the communication transmitted by the roadside unit. The detection of the environment can be carried out depending on the spatial scope or the local validity of the transmitted data. Accordingly, only the environment relevant to the transmitted data is detected. For example, if only the traffic light phase is transmitted by the RSU, the optical detection of the perimeter of the RSU can be omitted.
[0041] The same applies to the extraction of features from the captured environment. If only the traffic light phase is transmitted by the RSU, image processing may not be required to determine the exact lane path. If image processing is necessary, for example, to detect the current traffic light phase, the relevant regions of the captured image can be selected (so-called regions of interest, ROI). This means that only the capture and extraction processes necessary for monitoring the transmitted data are performed. This advantageously further increases the efficiency of monitoring.
[0042] The features can be extracted by selecting an extraction algorithm based on the transmitted communication. For example, if a lane narrowing signal is transmitted by an RSU, an algorithm for optical detection of a lane merging signal (pattern recognition) can be used specifically.
[0043] In a further advantageous embodiment of the invention, when extracting captured infrastructure and / or traffic flow features from the captured environment, the extracted features are georeferenced. This enables not only the localization of environmental features relative to the RSU, but also their absolute localization in a global coordinate system, for example, absolute geographical positions of an underlying global navigation system.
[0044] In a further advantageous embodiment of the invention, the transmission of the deviation message includes a warning about the deviation-related infrastructure- or traffic flow-related communication and / or a corrected infrastructure- or traffic flow-related communication and / or a command to adapt the infrastructure- or traffic flow-related communication to be transmitted.
[0045] As already noted, in the simplest case, the deviation message can consist of a warning. This triggers a manual review of the data transmitted by the RSU if it is determined to be incorrect or inaccurate. It is particularly advantageous to send a corrected communication or a command to adjust the communication to be transmitted. The corrected communication can, for example, override the incorrect or inaccurate communication transmitted by the RSU or correct the data transmitted by the RSU. In each of these cases, the deviation message can also include deactivation of the RSU, at least with regard to the data identified as incorrect.
[0046] In a further advantageous embodiment of the invention, the deviation message is transmitted within the vicinity of the roadside unit and / or to a remote control center. This allows corrected communication to occur in the vicinity of the RSU. The corrected or overlaid communication preferably uses the same communication type as the RSU, for example, using V2X messages. The command to adjust the communication can also be sent directly to the RSU. However, the underlying data can also be corrected in a remote control center if the data transmitted by the RSU is retrieved by the control center (e.g., backend map). The message can also be sent via the RSU to the control center or via alternative channels (e.g., long-range communication via a cellular connection).
[0047] In a further advantageous embodiment of the invention, the traffic flow data is transmitted to the remote control center. Thus, in addition to the deviation message, the traffic flow data transmitted by the RSU is also transmitted to the control center, e.g., a backend. This advantageously enables the collection of time-relevant traffic data that is generated anyway and therefore does not need to be determined using additional means. This traffic data can be used as historical data in the further development or optimization of infrastructure, such as lane guidance or traffic light systems, and of mobile applications, such as navigation systems or driver assistance systems, as well as for the generation of test data.
[0048] In a further advantageous embodiment of the invention, a traffic situation is determined from the transmitted traffic flow data. This allows anomalous patterns to be detected, such as a broken-down vehicle, an accident, or other traffic disruptions. Advantageously, the anomalous traffic situation can be detected early, and if necessary, a warning can be sent via V2X message. Example
[0049] Further features, possible applications and advantages of the invention will become apparent from the following description of embodiments of the invention with reference to the schematically illustrated drawings.
[0050] Here we show: Fig. 1 a stylized intersection with geometric information as encoded in a MAP or MAPEM message; Fig. 2 a stylized intersection with traffic light phase information as encoded in a SPaT message; Fig. 3 a lane change recommendation in the event of a broken-down vehicle and Fig. 4 an abnormal traffic situation due to a broken-down vehicle.
[0051] Fig. Figure 1 shows a concrete use case for MAP messages for precise vehicle localization and the improvement of driver assistance systems. By receiving MAP messages containing detailed information about the road infrastructure, vehicles can determine their precise position on the road. The MAP messages provide information about lanes, speed limits, traffic signal locations, and other road features.
[0052] Using this information, the vehicle can determine its current position more precisely and improve its driver assistance systems, such as lane-keeping assistants, adaptive cruise control, or adaptive cruise control. Precise lane information, for example, enables lane-keeping assistants to keep the vehicle within its lane, even around curves or in complex traffic situations. Knowledge of speed limits helps the vehicle set the optimal speed and avoid speeding. Information about traffic signals can be used for better anticipation and adaptive driving.
[0053] In addition, MAP messages can also be used for route planning and navigation. Vehicles can use information about road types, traffic rules, and traffic signals to optimize their routes and detect potential traffic disruptions or obstacles early on.
[0054] Overall, MAP messages enable more precise vehicle localization, improved driver assistance systems, and optimized route planning. This application can increase safety, boost efficiency, and improve driving comfort.
[0055] The Fig. The structure of intersection 1 shown in Figure 1 is sent to road users in the vicinity of RSU 13 via a MAP message. The coding takes the form of a list of individual segments of intersection 1. In addition to the intersection ID, this includes the intersection layout with clearly identified entry lanes 2 and exit lanes 3, as well as the connections 4 between entry and exit lanes 2 and 3. Furthermore, the message can include restricted zones 5 (intersection area) in which no vehicle is permitted to stop, footpaths, pedestrian crossings 5, cycle paths, permitted driving maneuvers, and much more. Furthermore, the specific intersection geometry includes the width of the lanes and the (vectorized) lane path, which is defined in the center of the lane using intersection points.
[0056] This information is transmitted by one or more RSUs 13, which can be located at existing traffic lights, traffic signs or other suitable locations.
[0057] In the method according to the invention, for example, an unmanned aerial vehicle (drone) is used to capture the communication transmitted by the RSU 13 and to capture the surroundings of the RSU 13. Message-type-specific information is extracted from the captured communication, for example, by storing the list of individual road or intersection segments.
[0058] The environment to be recorded refers to the spatial validity of the data sent by the RSU 13 and includes Fig. 1 the entire intersection shown. The spatial validity is determined by the spatial distribution of the individual segments. The drone optically records the intersection area and uses this to determine infrastructure and / or traffic flow data. The recording can be carried out statically, for example using a single image, or dynamically using a large number of images taken over time. Infrastructure features, such as the number and layout of lanes 2 and 3, can be extracted by determining the lane markings. These can also be derived from the actual movements of road users. Traffic flow features, such as traffic density, average speed, or obstructions to traffic flow, can also be extracted from both the statically and dynamically recorded environment, for example by counting the existing road users or using object tracking.
[0059] The recorded features can be subjected to georeferencing. This can be done in a global coordinate system, for example, using geographical coordinates of the Earth's graticule, or in a local, for example, intersection-specific coordinate system, and serves to assign features to a coordinate or to a region of the coordinate system. Georeferencing can be done using a positioning unit assigned to the drone, for example, a Global Navigation Satellite System (GNSS) such as Galileo, or using landmarks whose position is known absolutely or relative to the RSU 13. Georeferencing can be performed using known geometric methods, for example, relating the geographical position and, if applicable, the altitude of the drone to the recording unit.
[0060] The recorded or extracted features can then be compared with the data transmitted by the RSU. This can include the number of lanes, the geometric layout of the lanes, the position and extent of pedestrian crossings or structural features, traffic density, and many other features. The result of this comparison is a deviation between the transmitted data and the recorded features. Deviations can be an integer number, e.g., the difference between existing and detected lanes or road users. Deviations can also be fractional differences, for example, the difference in the dimensions of lanes, special spatial areas, or objects. The difference can be determined absolutely or in relation to the recorded features.
[0061] For each feature to be monitored, a maximum specified deviation can be stored, for example, zero for the number of lanes or 20 cm or 10% for the lane width. If the determined deviation exceeds the maximum specified deviation, the drone transmits a deviation message. This contains at least the relevant feature (e.g., the lane ID) and, ideally, the received and recorded variables. The deviation message can be sent directly to the RSU 13 or to a monitoring center. In addition to the pure information about the deviation (warning), a correction signal can also be sent to the RSU 13 or the control center so that the transmitted communication can be automatically corrected.
[0062] The SPaT message contains information about the signal status of traffic lights, the traffic light phases (green, yellow, red), and the timing at a traffic light intersection. It is sent by the traffic infrastructure to vehicles to provide them with real-time data on the traffic light status. Vehicles can use this information to adjust their speed and route, thus optimizing traffic flow, improving safety, and reducing fuel consumption.
[0063] A specific use case for an SPaT message in the V2X context is the so-called "Green Light Optimized Speed Advisory" (GLOSA). This allows the vehicle to receive information about the traffic light status and the remaining time until the next signal phase well in advance of reaching a traffic light intersection. Based on this information, the vehicle can adjust its speed to pass the intersection when the light turns green without having to stop. This improves traffic flow, as vehicles move through the intersection more efficiently and spend less time stationary.
[0064] In addition to GLOSA, the SPaT message can also be used for other applications, such as optimizing traffic management, predicting traffic light times, or integrating vehicles into intelligent traffic systems.
[0065] The content of an SPaT message includes the system time, the operating mode (time-controlled or traffic-controlled), the current signal phase and relevant timestamps, such as the scheduled or predicted switching time of the next phase. Fig. 2 shows the same intersection as in Fig. 1 with traffic lights 9, 10, 11 and specific traffic light phases. The solid arrows 7 indicate the status of the movement phase "Permission to enter the intersection" according to the display of traffic lights 10 (green for straight ahead) and 11 (green for straight ahead, red for left turn). In a SPaT, it is not usually the displayed traffic light colors that are transmitted, but rather the permitted maneuvers or application rules for each traffic light phase. The dotted arrows 8 indicate the movement phase "Entry into intersection prohibited" according to the display of traffic light 9 (red for left turn, no green for right turn). Transitional phases (yellow phases) are in Fig. 2 not shown.
[0066] The communication monitoring method according to the invention can also be implemented when monitoring SPaT messages using a drone. Alternatively, a monitoring vehicle that is part of the traffic can be used. Both the drone and the monitoring vehicle receive the signals from the RSU (in Fig. 2 not shown) and preferably simultaneously detect the current traffic light phase. The traffic light phase is preferably detected optically. The traffic light can then be identified in the captured image using image processing methods, and the displayed traffic light phase can be recognized. The traffic light phase extracted in this way can be directly compared with the traffic light phase encoded in the SPaT message.
[0067] More precise monitoring of the communication transmitted by the RSU is possible if not only the currently displayed traffic light phase is monitored, but also the times at which the traffic light phases change. To achieve this, the respective traffic light should ideally be recorded over a complete cycle of switching phases. Deviations can then be determined individually for each switching process. This ensures that the communicated schedules correspond to the traffic light phases actually switched.
[0068] Deviations are preferably determined as temporal deviations in the application case. The switching time of an SPaT message is typically communicated with an accuracy of 1 / 10 of a second. The maximum specified deviation can be selected according to application-specific requirements, e.g., 0.2 seconds for autonomous vehicle applications.
[0069] Fig. Figure 3 shows a construction site 12 on a two-lane, one-way road. The construction site 12 is marked by a construction warning 15. The construction warning 15 is equipped with a transceiver unit, enabling the functionality of an RSU. This unit sends a warning via V2X communication. The transmitted message is of the type RWW (Road Works Warning) or WZW (Work Zone Warning), depending on the standard used.
[0070] The message provides coordinates or a geographic description to identify the exact location of work site 12. The message can indicate the type of work site 12, such as a road closure, lane narrowing, roadway work, or other construction activity. The message can include information about temporary speed limits in the work zone to help drivers adjust their speed. Additional information about potential hazards in work site 12 can be provided, such as the presence of construction vehicles, loose debris, or uneven road conditions. Finally, information about the estimated duration of work site 12 can be sent to give drivers an idea of how long they need to drive with caution.
[0071] In the example shown, a lane narrowing warning 14 is transmitted by the RSU. In the course of the method according to the invention, the RWW transmitted by the construction site warning 14 is received, and from this, for example, the presence, geographical position, and type of disruption are extracted. The lane narrowing 14 can then be detected based on optically detected infrastructure features, e.g., the presence of warning beacons or other objects in the right-hand lane, or based on optically detected traffic flow features, such as the merging of all road users into the left-hand lane. Traffic flow can be determined optically by assigning detected moving objects to a lane. Alternatively or additionally, traffic flow can be determined from the V2X messages transmitted by the road users (CAM, especially their own position, direction of travel, and possibly speed).
[0072] The data extracted from the V2X message is then compared with the detected features. This can relate to both the lane narrowing 14 and the geographical position of the construction site 12. If a deviation is detected, for example, if there is no construction site 12 or lane narrowing 14, or if a different geographical position is detected, a deviation message is transmitted. This can be sent directly to the construction site warning 15 acting as the RSU or to a traffic control center, if necessary using the forwarding (hop) of the deviation message via the construction site warning 15. The message triggers a deactivation or correction of the transmitted message, or a further (manual) check of the transceiver unit.
[0073] Fig.Figure 4 shows a traffic situation in which a vehicle 16 has broken down (breakdown). Broken-down vehicles can be communicated to nearby road users via V2X messages. One option is to send a Traffic Condition Warning (TCW). This message is used to share traffic information, including accidents or traffic jams. If an accident occurs, affected vehicles can receive this warning and choose alternative routes.
[0074] Another option is a Road Hazard Warning (RHW). This message is used to warn other vehicles about obstacles or hazards on the road. If a vehicle breaks down or encounters an obstacle, this warning can alert other drivers.
[0075] In addition, CAMs can be sent by disabled vehicles themselves to share basic information about their status, such as position, speed, and acceleration, with other vehicles in the area. If a vehicle is disabled or involved in an accident, this can be encoded in the CAM message to inform other vehicles of the incident.
[0076] The RSU 13 can receive this information and transmit or forward it as a message. This is done primarily via TCW or RHW messages. The RSU 13 receives this information via the CAM of the disabled vehicle 16, which is received directly from the disabled vehicle 16 or forwarded by other road users. The RSU 13 can also receive this information from messages from other road users who have identified the disabled vehicle 16 as such, or from a traffic control center.
[0077] In the course of the method according to the invention, one of the messages about the broken-down vehicle 16 is received. This is followed by a preferably optical detection of the position encoded in the message. A broken-down vehicle 16 or a lane narrowing is then specifically extracted from the detected surroundings.
[0078] If none of these features are detected, a deviation message is sent, which triggers a correction of the transmitted data in the RSU 13 or the traffic control center. If a deviation in the position of the incident is detected, the deviation message contains the position correction.
[0079] If no deviation is detected, an (additional) warning or a lane change recommendation can be sent based on the received message type. Alternatively or additionally, a breakdown service or emergency services can be notified. List of reference symbols 1 intersection 2 Lane-related direction of travel (entrance lane) 3 Lane-related direction of travel (exit lane) 4 intersection trajectories 5 Intersection area, restricted zone 6 Pedestrian crossing 7 Green phase 8 Red phase 9 red traffic lights (with turning lights) 10 green traffic lights 11 double traffic lights 12 Construction site 13 Roadside Unit (RSU) 14 Lane narrowing 15 Construction site warning 16 broken-down vehicle 17 waiting vehicles 18 moving vehicles
Claims
[1] A method for monitoring infrastructure and / or traffic flow related communication comprising the following steps: - Receiving infrastructure- or traffic flow-related communications transmitted by a mobile or stationary roadside unit, - Extracting transmitted infrastructure and / or traffic flow data from the received communication, - Capturing an environment of the roadside unit, - Extracting recorded infrastructure and / or traffic flow features from the recorded environment, - Determining a deviation of the extracted infrastructure and / or traffic flow data from the extracted infrastructure and / or traffic flow characteristics, - Sending a deviation message if the detected deviation is greater than a permissible deviation, whereby the surroundings of the roadside unit are captured from a bird's eye view by means of a flying unit. [2] A method for monitoring infrastructure and / or traffic flow-related communication according to claim 1, wherein the detection of the environment or the extraction of detected infrastructure and / or traffic flow features from the detected environment is carried out as a function of the communication transmitted by the roadside unit. [3] Method for monitoring infrastructure and / or traffic flow-related communication according to one of the preceding claims, wherein, when extracting detected infrastructure and / or traffic flow features from the detected environment, georeferencing of the extracted features takes place. [4] A method for monitoring infrastructure and / or traffic flow-related communication according to any one of the preceding claims, wherein the transmission of the deviation message includes a warning about the deviation-affected infrastructure or traffic flow-related communication and / or a corrected infrastructure or traffic flow-related communication and / or a command to adapt the infrastructure or traffic flow-related communication to be transmitted and / or the deactivation of the transmission of the infrastructure or traffic flow-related communication by the RSU. [5] A method for monitoring infrastructure and / or traffic flow-related communication according to any one of the preceding claims, wherein the deviation message is sent within the environment of the roadside unit and / or to a remote control center. [6] A method for monitoring infrastructure and / or traffic flow related communication according to any one of the preceding claims, wherein the traffic flow data is transmitted to the remote control center. [7] Method for monitoring infrastructure and / or traffic flow-related communication according to one of the preceding claims, wherein a traffic situation is determined from the transmitted traffic flow data. [8] Method for monitoring infrastructure- and / or traffic flow-related communication according to claim 7, wherein an infrastructure- or traffic flow-related communication to be transmitted is determined from the determined traffic situation.
Citation Information
Patent Citations
Procedure for operating a motor vehicle assistance system
DE102019126432A1
Method of controlling an unmanned aerial road side unit drone
US20190322367A1
Method for acquiring reference data, method for comparing reference data, and device for acquiring reference data
DE102014016550A1
Method and active infrastructure for checking an environment detection of a motor vehicle
DE102016219455A1
Methods and systems for validating map data
DE102019216732A1
Cited By
Method for generating a track occupancy map
DE102025127418B3
