Methods for controlling reliability of a shared object perception data in a connected intelligent transport system
By transmitting extended CPMs with reference landmark data, the method improves the reliability of shared object perception in connected vehicles, addressing the challenge of unreliable data in poor weather, thereby enhancing safety and accuracy in automated driving.
Patent Information
- Application Number
- PCT/FI2026/050232
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-05-07
- Filing Date
- 2026-05-06
- Publication Date
- 2026-11-12
AI Technical Summary
The reliability of shared object perception data in connected vehicles is compromised, especially in poor weather conditions, due to variations in sensor accuracy and the lack of effective methods to validate the credibility of external data.
A method involving vehicles transmitting extended Collective Perception Messages (CPM) that include information about known stationary reference landmarks, allowing an ITS infrastructure to assess the reliability of perceived object information by comparing it to reference data, and sending notifications to vehicles about unreliable data.
Enhances the accuracy of collective perception by identifying and filtering out unreliable sensor information, ensuring safer and more reliable automated driving, particularly in harsh weather conditions.
Smart Images

Figure FI2026050232_12112026_PF_FP_ABST
Abstract
Description
METHODS FOR CONTROLLING RELIABILITY OF A SHARED OBJECT PERCEPTION DATA IN A CONNECTED INTELLIGENT TRANSPORT SYSTEMFIELD
[0001] The invention relates generally to connected or cooperative Intelligent Transport System (C-ITS), and particularly to improving reliability of data shared by connected vehicles.BACKGROUND
[0002] One of the main challenges towards highly automated driving is the comprehensive environmental perception of vehicles. Vehicles with a certain degree of driving automation require sufficient knowledge concerning their surroundings to perform safe and comfortable automated manoeuvres. Onboard sensor systems, being restricted to line-of-sight detections, often fall short when meeting the strict functional requirements imposed by automated driving applications. Vehicle-to-everything (V2X) communication has emerged as a promising technology to mitigate this lack, allowing traffic participants to share all kinds of information to improve their environmental perception and strengthen their decisionmaking basis.
[0003] Examples of V2X applications are cooperative awareness service (CAS) and collective (or cooperative) perception service (CPS), allowing vehicles to share data about their state and detected objects in the surroundings, respectively. Cooperative awareness enables vehicles to transmit data about their state via V2X communication, such as their current position, speed, and heading. Collective perception allows stations (traffic participants and infrastructure) to inform connected stations of objects (such as pedestrians, obstacles, and other vehicles) detected by their object-tracking sensors. This allows the receiving vehicles to “see through the eyes of others” and to extend their environmental model beyond their own sensors’ range. The object data are exchanged through Collective Perception Messages (CPM).
[0004] In the traffic environment, there may be vehicles moving with several different sensor combinations or sensor systems that can collect and send data, such as a LiDAR sensor or a combination of a camera and a LiDAR sensor. New automotive sensors (and methods) for poor weather conditions are evolving gradually all the time (like 4D radars, etc.). High accuracy sensors that can adapt to different weather conditions are able to produce usable and reliable data for asignificantly longer period of time to support autonomous driving, while low accuracy sensor solutions lose their ability to deliver earlier. Therefore, although collective perception messages with confidence value (estimated absolute sensor accuracy) can be used for sharing overall situational information in context of automated and connected vehicles, the problem is how to trust this external data especially in poor weather conditions.
[0005] DE102021209314A and DE102021209315A disclose ITS infrastructures having infrastructure environment sensors that generate environmental information. The infrastructure further receives environment data in V2X messages from one or more vehicles that are currently located or moving within the range of the infrastructure environment sensors. The environment information of the received V2X messages is now compared with data generated by the infrastructure environment sensors. Depending on the result of the comparison, suitable measures for the infrastructure environment sensors are determined and initiated.
[0006] US20220105956A1 discloses a concept that a transportation vehicle can verify the validity / reliability of environment information that has been received from another transportation vehicle and can return the environment information together with information relating to the validity / reliability to the other transportation vehicle and / or can forward it to one or more further transportation vehicles. The vehicle validates the received environment information using its own sensor data and / or user input. This allows transportation vehicles which receive the reliability-related information to assess the credibility of the environment information. An iterative and / or multiple validation of the same environment information by a plurality of transportation vehicles within the fleet of transportation vehicles allows a higher credibility of the reliability information.
[0007] US11292481B2 discloses a method for diagnosing perception sensors in V2V equipped vehicles by exchanging and comparing sensor information between vehicles, The diagnosis may be refined over aggregate measurements between multiple vehicles. The method can use perception data from multiple vehicles to diagnose sensor suite health for each vehicle and aggregate device confidence and historic performance of participating vehicles to improve cross vehicle object detection robustness. More specifically, sensor data (e.g. from Lidar, camera) about the location of target objects is gathered by the sensors on a host vehicle. The host vehicle also receives sensor data about the same target objects from remote vehicles via V2V communication. The host vehicle then processorcompares the host vehicle's sensor data to the remote vehicle's sensor data and generates a sensor confidence score based on this comparison.SUMMARY
[0008] According to an aspect of the invention, a new approach is provided to increase accuracy of a collective perception and facilitate detecting unreliable or faulty sensor information. The scope of protection sought for various example embodiments is set out by the claims. The example embodiments and features, if any, described in this specification that do not fall under the scope of the claims are to be interpreted as examples useful for understanding various embodiments.
[0009] A first aspect of the invention is a method for controlling reliability of a shared object perception data in a connected intelligent transport system (ITS), the connected ITS comprising an ITS infrastructure and vehicle ITS stations mounted on vehicles, wherein the vehicle ITS stations are capable of wirelessly communicating with each other and the ITS infrastructure and sharing information about their perceived environment by exchanging collective perception messages (CPM), each CPM message containing perceived object information about at least one object, if any, perceived by a transmitting vehicle ITS station, the method comprising
[0010] an infrastructure ITS station in the ITS infrastructure receives extended CPM messages from the transmitting vehicle ITS station mounted on a vehicle approaching a known stationary reference landmark, each extended CPM message containing additional perceived object information about the known stationary reference landmark, if such reference landmark is perceived by the transmitting vehicle ITS station,
[0011] the infrastructure ITS station assesses reliability or sufficiency of the perceived object information received from the transmitting vehicle ITS station by comparing the perceived object information about the known stationary reference landmark to reference object information, and
[0012] if the perceived object information received from the transmitting vehicle ITS station is not reliable or sufficient based on the assessment, the ITS infrastructure sends a notification message to the transmitting vehicle ITS station and broadcasts a notification message to other vehicle ITS stations, the notification message indicating that perceived object information from the transmitting vehicle ITS station is not reliable or sufficient.
[0013] In embodiments, the infrastructure ITS station receives extended CPM messages from the vehicle ITS station only when the vehicle ITS station is within a certain measurement distance or measurement area associated with the known stationary reference landmark.
[0014] In embodiments, the infrastructure ITS station receives extended CPM messages from the ITS station at regular intervals, and the perceived object information in an extension portion of the extended CPM message is null if no reference object is detected.
[0015] In embodiments, the reference object information includes a predetermined reference distance of a vehicle from the known stationary reference landmark, and wherein the perceived object information in the extended CPM message includes information for determining a distance from the vehicle to the known stationary reference landmark at a time of perception.
[0016] In embodiments, the reference object information comprises further reference object information detected at the predetermined distance from the known stationary reference landmark.
[0017] In embodiments, the predetermined distance is dependent on a road class, a road speed limit, a road environment and / or a road weather type.
[0018] In embodiments, the infrastructure ITS station concludes that the perceived object information received from the transmitting vehicle ITS station is not reliable or sufficient based on the assessment, if the known stationary reference landmark is detected at a distance less than the predetermined distance.
[0019] In embodiments, the perceived object information in the extended CPM message includes at least one confidence value associated with the perception of the known stationary reference landmark, wherein the reference object information comprises at least one reference confidence value for the perception of the known stationary reference landmark, and wherein the infrastructure ITS station concludes that the perceived object information received from the transmitting vehicle ITS station is not reliable or sufficient based on the assessment, if the at least one confidence value in the extended CPM messages is lower than the at least one reference confidence value and / or the at least one confidence value in successively received extended CPM messages varies in a predetermined manner.
[0020] In embodiments, the perceived object information in the extended CPM message includes a perceived class of the known stationary reference landmark, wherein the reference object information comprises a reference class ofthe known stationary reference landmark, and wherein the infrastructure ITS station concludes that the perceived object information received from the transmitting vehicle ITS station is not reliable or sufficient based on the assessment, if the perceived class in the extended CPM messages does not match with the reference class.
[0021] In embodiments, the perceived object information in the extended CPM message further includes one or more of following: a speed of the vehicle, a time of perception of the known stationary reference landmark, a position of the vehicle at the time of perception, a size of the reference landmark, dimensions of the reference landmark, shape of the reference landmark, class of the reference landmark, and information about a sensor system which originated the perceived object information.
[0022] In embodiments the method further comprises that the infrastructure ITS station creates the reference object information at least partially based on perceived object information of extended CPM messages received from one or multiple vehicle ITS stations mounted on one or multiple vehicles passing by the known stationary reference landmark, preferably from one or more vehicle ITS stations having confidence values associated with the perceptions that meet a preset confidence value limit.
[0023] In embodiments the method further comprises that the infrastructure ITS station creates the reference object information at least partially based on perceived object information of extended CPM messages received from one or more predetermined measurement ITS with high-quality sensor systems mounted on one or more vehicles passing by the known stationary reference landmark.
[0024] In embodiments, reference object information comprises different sets of reference object information for two or more road environment or road weather conditions, and wherein the infrastructure ITS station selects the reference object information set used according to a current road environment or weather condition.
[0025] In embodiments, the known stationary reference landmark, and optionally also the infrastructure ITS station, is associated with a vehicle inspection station or a vehicle service garage or like, and the infrastructure ITS concludes whether an object perception capability of the vehicle will meet inspection requirements, preferably set in the reference object information, or not, and wherein the infrastructure ITS station sends a result of the conclusion to the transmittingvehicle ITS station, a data system of the vehicle inspection station or the vehicle service garage or like, and / or to a measuring device of the vehicle inspection station or the vehicle service garage or like.
[0026] In embodiments, the notification message sent to the transmittingvehicle station indicates that the perceived object information provided by the transmitting vehicle ITS station is not reliable or sufficient for controlling vehicle, or commands a vehicle control system of the vehicle to perform a control action to limit or stop an automated or assisted driving mode or lower a speed of the vehicle and / or to urge a driver through a user interface to limit or stop the automated or assisted driving mode or lower the speed of the vehicle.
[0027] In embodiments, the known stationary reference landmark comprises a distinct road infrastructure landmark or a distinct roadside landmark or a radar reflector, wherein preferably, the radar reflector is configured to provide a reflection of an object in a certain object class.
[0028] A second aspect of the invention is an infrastructure intelligent transport system (ITS ) station for a connected intelligent transport system (ITS), the connected ITS comprising an ITS infrastructure and vehicle ITS stations mounted on vehicles, wherein the vehicle ITS stations are capable of wirelessly communicating with each other and the ITS infrastructure and sharing information about their perceived environment by exchanging collective perception messages (CPM), each CPM message containing perceived object information about at least one object, if any, perceived by a transmitting vehicle ITS station, the infrastructure ITS station comprising
[0029] communication unit receiving messages from and sending messages to and from vehicle ITS station directly or via one or more other infrastructure ITS stations,
[0030] a memory storing data,
[0031] and one or more processors controlling the memory and the communication unit, the one or more processors are configured to cause the infrastructure ITS to perform the method as claimed in any one of claims 1-16.
[0032] In embodiments, the infrastructure ITS station comprises one of an ITS roadside unit or an ITS application server or an ITS application cloud server, an edge server, an edge server co-located with an ITS roadside unit, and an edge server co-located with two or more ITS roadside units in the same geographical area.
[0033] A third aspect of the invention is a method in a vehicleintelligent transport system (ITS) station in a connected intelligent transport system (ITS), the connected ITS comprising an ITS infrastructure and vehicle ITS stations mounted on vehicles, wherein the vehicle ITS stations are capable of wirelessly communicating with each other and the ITS infrastructure, the method comprising
[0034] the vehicle ITS station mounted on a vehicle shares information about its perceived environment by transmitting collective perception messages (CPM), each CPM message containing perceived object information about at least one object, if any, perceived by the vehicle ITS station, and
[0035] the vehicle ITS station mounted on the vehicle approaching a known stationary reference landmark additionally transmits an extended CPM message to the ITS infrastructure, the extended CPM message containing additional perceived object information about the known stationary reference landmark, if such reference landmark is perceived by the vehicle ITS station.
[0036] In embodiments, the vehicle ITS station transmits extended CPM messages only when the vehicle ITS station is within a certain measurement distance or measurement area associated with the known stationary reference landmark.
[0037] In embodiments, the vehicle ITS station transmits extended CPM messages at regular intervals, and the perceived object information in an extension portion of the extended CPM message is null if no reference object is detected.
[0038] In embodiments, the vehicle ITS station obtains information about the vehicle being approaching the stationary reference landmark and / or about a need for transmitting an extended CPM message from a digital map provided in advance to the vehicle and stored on the vehicle.
[0039] In embodiments, the vehicle ITS station receives from the ITS infrastructure, in response to one or more transmitted extended CPM messages, a notification message indicating that the perceived object information from the vehicle ITS station is not reliable or sufficient for controlling the vehicle.
[0040] In embodiments, a vehicle control system of the vehicle performs, in response to the notification message, a control action to stop sharing the perceived object information with to other vehicle ITS stations, to limit or stop an automated or assisted driving mode or lower a speed of the vehicle, and / or to urge a driver of the vehicle through a user interface to limit or stop the automated or assisted driving mode or lower the speed of the vehicle.
[0041] A fourth aspect of the invention is a vehicle intelligent transport system (ITS) station for a connected intelligent transport system (ITS), the connected ITS comprising an ITS infrastructure and vehicle ITS stations mounted on vehicles, wherein the vehicle ITS stations are capable of wirelessly communicating with each other and the ITS infrastructure and sharing information abouttheir perceived environment by exchanging collective perception messages (CPM), each CPM message containing perceived object information about at least one object, if any, perceived by a transmitting vehicle ITS station, the vehicle ITS station comprising
[0042] communication unit receiving messages from and sending messages to the ITS infrastructure,
[0043] a memory storing data,
[0044] and one or more processors controlling the memory and the communication unit, the one or more processors are configured to cause the vehicle ITS station to perform the method according to the third aspect.
[0045] A fifth aspect of the invention is connected intelligent transport system (ITS), comprising
[0046] an ITS infrastructure with the infrastructure ITS station according to the second aspect, and
[0047] vehicle ITS stations according to the fourth aspect.
[0048] A sixth aspect of the invention is a method in a vehicle intelligent transport system (ITS) station in a connected intelligent transport system (ITS), the connected ITS comprising an ITS infrastructure and vehicle ITS stations mounted on vehicles, wherein the vehicle ITS stations are capable of wirelessly communicating with each other and the ITS infrastructure, the method comprising
[0049] the vehicle ITS station mounted on a vehicle receives collective perception messages (CPM) transmitted from at least one other vehicle ITS station, each CPM message containing perceived object information about at least one object, if any, perceived by the transmitting at least one other vehicle ITS station,
[0050] the vehicle ITS station receives from the ITS infrastructure a notification message indicating that the perceived object information received from a certain vehicle ITS station is not reliable or sufficient for use in controlling the vehicle, and
[0051] the vehicle ITS station discards or rejects the perceived object information received from the certain vehicle ITS station.
[0052] A seventh aspect of the invention is a vehicle intelligenttransport system (ITS) station for a connected intelligent transport system (ITS), the connected ITS comprising an ITS infrastructure and vehicle ITS stations mounted on vehicles, wherein the vehicle ITS stations are capable of wirelessly communicating with each other and the ITS infrastructure and sharing information about their perceived environment by exchanging collective perception messages (CPM), each CPM message containing perceived object information about at least one object, if any, perceived by a transmitting vehicle ITS station, the vehicle ITS station comprising
[0053] communication unit receiving messages from and sending messages to the ITS infrastructure,
[0054] a memory storing data,
[0055] and one or more processors controlling the memory and the communication unit, the one or more processors are configured to cause the vehicle ITS station to perform the method according to the sixth aspect.BRIEF DESCRIPTION OF THE DRAWINGS
[0056] In the following, various example embodiments will be described in greater detail with reference to the accompanying drawings, in which
[0057] Figure 1 illustrates an exemplary architecture of a cooperative ITS (C-1TS) system;
[0058] Figure 2 shows a simplified block diagram of an exemplary roadside unit RSU;
[0059] Figure 3 shows a simplified block diagram of an exemplary onboard unit OBU and an object detection system mounted on a vehicle;
[0060] Figure 4 shows an example of a basic structure of a collective perception message CPM;
[0061] Figure 5 shows a flow diagram illustrating an exemplary process of generating a CPM message;
[0062] Figure 6 shows a flow diagram illustrating an exemplary operation of a transmitting vehicle ITS station;
[0063] Figure 7 shows a flow diagram illustrating an exemplary operation of an infrastructure ITS station carrying out a reliability assessment;
[0064] Figure 8 shows a flow diagram illustrating an exemplary operation of a vehicle ITS station receiving a notification from the ITS infrastructure;
[0065] Figure 9 shows a flow diagram illustrating another exemplary operation of a vehicle ITS station receiving a notification from the ITSinfrastructure; and
[0066] Figure 10 shows a flow diagram illustrating another exemplary operation of an infrastructure ITS station carrying out a reliability assessment. DETAILED DESCRIPTION
[0067] The following embodiments are exemplifying. Although the specification may refer to “an”, “one”, or “some” embodiment(s) in several locations of the text, this does not necessarily mean that each reference is made to the same embodiment(s), or that a particular feature only applies to a single embodiment. Single features of different embodiments may also be combined to provide other embodiments within the scope of the claims. Furthermore, the words "comprising" and "including" should be understood as not limiting the described embodiments to consist of only those features that have been mentioned, and such embodiments may also contain features that have not been specifically mentioned. Reference numbers, in the description and / or in the claims, serve to illustrate the embodiments with reference to the drawings, without limiting the embodiments to these examples only.
[0068] Most of the terms used in the present disclosure are selected from the general ones that are widely used in the field, but some terms are arbitrarily selected by the applicant and the meaning thereof will be described in detail in the following description as necessary. Accordingly, embodiments of the invention should be understood based on the intended meaning of the term rather than the mere name or meaning of the term.
[0069] Exemplary embodiments of the invention relate so called Intelligent Transport Systems or Intelligent Transportation Systems (ITSs). There are many definitions of ITSs, but put simply, they are the use of technology to improve transport efficiency. The concept of ITS is the application of sensing, analysis, control and communications technologies in order to improve safety, mobility, efficiency, and traffic flow, to avoid accidents, and / or to increase passengers’ safety and comfort. In other words, ITSs integrate advanced sensing, communication, and control technologies into transportation infrastructure and vehicles. ITS aims to link people, roads and intelligent vehicles thanks to the development of embedded systems and communication technologies by connecting and distributing intelligent processors inside vehicles and also through transportation infrastructure. While basic ITSs focus on digital technologies providing intelligence placed at the roadside or in vehicles, Cooperative Intelligent Transport System (C-1TS) refers totransport systems, where the cooperation between two or more ITS sub-systems (personal, vehicle, roadside and central) enables and provides an ITS service that offers better quality and an enhanced service level, compared to the same ITS service provided by only one of the ITS sub-systems. The system that provides the connectivity enabling (wireless) communication between different actors and ITS communication units - so called ITS stations (ITS-Ss), may be referred to as a connected vehicle system. Embodiments of the invention may be used both in manually driven or human-driven vehicles for driving assistance, and in autonomous or self-driving vehicles for automated driving.
[0070] In embodiments, the connectivity of the cooperative or connected system may be implemented using communication technologies that are often collectively referred to as a cooperative vehicle-to-everything (V2X) communication. Cooperative V2X communication may include, for example, Vehicle-to-Ve-hicle (V2V), Vehicle-to-lnfrastructure (V21), Infrastructure-to-Vehicle (12V), or Ve-hicle-to-Network (V2N), Network- to-Vehicle (N2V) communications, Vehicle to Pedestrian (V2P), and Vehicle to Grid (V2G). Currently, two wireless technologies have risen as possible enablers of direct V2X communications. The first one is the Wi-Fi-based IEEE 802. lip standard, also known as Dedicated Short-Range Communication (DSRC) in the USA and 1TS-G5 in Europe. The second one is the cellularbased technology (such as 4G, 5G, future 6G, LTE), known as C-V2X, proposed by the 3rd Generation Partnership Project (3GPP) as an alternative to enable direct communication among vehicles using the side link or PC5 interface. It shall be appreciated that the specific wireless technology used is not relevant for the present invention.
[0071] An exemplary cooperative ITS (C-1TS) system concept is illustrated in FIG. 1. In embodiments, the communication devices installed in vehicles may be referred to as onboard units (OBU). The OBU may be referred to as onboard Equipment (OBE). Similar communication units used by other types of road users, such as pedestrians, cyclists, and other vulnerable road users (VRU) may be referred to as mobile units (MU). OBU / MU is configured for functioning as part of a data transmission network between vehicles, other road users, road infrastructure and intelligent transport system. In embodiments, the communication units installed in the infrastructure of the cooperative transport system, e.g., in the road infrastructure, to send and receive data to and from the OBUs may be referred to as roadside units (RSU). The RSU may also be referred to as roadside equipment (RSE). Generally, any communication unit (such as any OBU, MU, RSU or anotheractor) with V2X communication and the associated ITS functionality may all be referred to as an ITS station. In the example system shown in Fig. 1 three vehicles with onboard units OBU1, OBU2, and OBU3, as well two roadside units RSU1 and RSU1 are depicted. Further, a cooperative V2V communication between OBUs 1, 2 and 3 is illustrated, as well as a cooperative V2N communication between OBU1 and RSU1, OBU2 and RSU1, and OBU3 and RSU2. Moreover, a pedestrian as example of a vulnerable road user (VRU) and a cooperative V2P communication between mobile unit MU of the VRU and OBU2 are illustrated. The V2X access layer may be WIFI-based or cellular-based technology. The RSU serves as the interface between an OBU and the rest of the transportation infrastructure. Roadside units RSU1 and RSU2 may have suitable wired or wireless backend connections for communicating with each other and ITS units in a backend, e.g. traffic control centre (TCC), traffic management centre, or cloud system from road authorities, ITS application suppliers, etc. In the example of Fig. 1, a traffic control centre (TCC) and an ITS visibility application server 10 are shown. In the example of Fig. 1, the RSU backend connections may be provided by any suitable communication system(s) or data network^) 12. Generally, it may be said that the RSUs are connected to the Internet. It shall be appreciated that embodiments of the invention are not intended to be restricted to the exemplary cooperative ITS (C-ITS) system concept illustrated herein as an example of a connected intelligent transportation system.
[0072] Fig. 2 shows a simplified block diagram of an exemplary roadside unit RSU. The purpose of the RSU is to provide the infrastructure side of the V2I communication link. This includes both a communication function (V2I / V2X communications) and the intelligence / decision-making function to interpret received messages and generate the appropriate messages to be transmitted. The exemplary RSU may include a control unit 20, a V2X communication unit 24, and wireless 26 and / or wired 28 backend communication units. The V2X communication unit 24 may be a V2X modem, such as a modem intended for vehicular use but repurposed for the infrastructure application. The control unit 20, such as a Central Processing Unit CPU, may provide an interface to the V2X communication unit as well as computation power to translate V2X messages to the backend communication interface(s) 26, 26 (e.g., Ethernet, LTE / 5G wireless, or Wi-Fi wireless) as well as to run V2X layer applications needed to interpret and transmit safety-critical messages. Messages and / or data may be communicated between the RSU and remote ITS stations or servers using a suitable protocol, such as MQTT (Message Queuing Telemetry Transport) messaging protocol. The control unit 20 mayinclude a controller or processor, and a memory device 22. The memory 22 may store instructions or program code executable by the processor and may also store operational data. In embodiments, the message processing functions and applications may be, at least partially, distributed to other infrastructure device(s), such as the TCC. It shall be appreciated that a specific implementation and structure of RSU is not essential to the present invention, and embodiments of the invention are not intended to be restricted to the examples illustrated herein.
[0073] Fig. 3 is a simplified block diagram of an exemplary of OBU 30 and an object detection system or safety system 32 mounted on a vehicle for the purpose of driving assistance or automatic driving and arranged to detect objects existing around the vehicle. The object detection system 32 includes at least one sensor system 320 (e.g., a LiDAR sensor, a camera, a gated camera, a radar), and a control system 322. The control system 322 may include a controller or processor 324, and a memory 326. The control system 322 may be a controller, or part of the controller, of a vehicle. The control system 322 may include a controller for sensor systems 320, such as a controller of the LiDAR sensor system and a controller of the gated camera sensor system. The memory 326 may include instructions executable by the processor 324 and may also store operational data. The control system 322 may be configured to receive sensor data from the sensor system or systems 320 and may also control its / their operation. The control system 322 may also receive operational data of the vehicle, such as speed, GNSS location, weather information, etc., from onboard or external systems. The control system 322 may be configured to work in an interconnected fashion with various components of the vehicle, such as a vehicle control system 34, brakes, engine, lighting, steering, etc., to enable driving assistance or automated driving functions. The exemplary onboard unit OBU 30 may include a control unit 302, a V2X communication unit 300, and an interface 328 to the onboard object detection system 32, e.g., through a vehicle control bus. The V2X communication unit 300 may be a V2X modem. The control unit 302, such as a Central Processing Unit CPU, may include a controller or processor, and a memory device 22. The memory 22 may store instructions or program code executable by the processor and may also store operational data. The control unit 20 may provide an interface to the V2X communication unit 300 and the object detection system 32. The control unit 302 may provide a computation power to generate and encode V2X messages based on sensor information about perceived object(s) received from the object detection system 32 and to run V2X layer applications needed to transmit V2X messages via the V2X communicationunit 300, e.g., illustrated in more detail in examples below. Similarly, the control unit 302 may provide a computation power to interpret and decode V2X messages received via the V2X communication unit 300 and to forward the resulting information to the object detection system 32. It shall be appreciated that a specific implementation and structure of BSU and object detection and control system(s) mounted on a vehicle are not essential to the present invention, and embodiments of the invention are not intended to be restricted to the examples illustrated herein.
[0074] The Collective Perception Service (CPS) is a feature within Intelligent Transport Systems (ITS) that enhances situational awareness for vehicles by sharing information about the surrounding environment. Vehicles and infrastructure equipped with sensors (like radars, LIDARs, and cameras) detect objects in their vicinity, such as other vehicles, pedestrians, and obstacles. This information about perceived objects and perceived regions (road regions) is then transmitted to nearby vehicles and infrastructure using V2X communication. This enhances the environmental perception of CPS-enabled ITS-Ss by providing information about relevant objects, unoccupied regions and increases the number of information sources. The availability of multiple sources of information associated with an object or an unoccupied region allows the receiving ITS-Ss to perform data fusion which generally leads to lower uncertainty in both the classification of objects and in their properties such as their sizes and their kinematic and attitude states. Thus, by aggregating data from multiple sources, CPS reduces the uncertainty about the driving environment. Even if data manipulated or corrupted at the source are received, a sufficient number of independent sources that maintain integrity may allow identification of such data.
[0075] CPS service according to ETS1 specifications defines a Collective Perception Message (CPM) that enables the interoperable sharing of basic information about the transmitting 1TS-S (required for the interpretation of the transmitted data), its sensory capabilities, perceived objects and road-related perception regions. Fig. 4 shows an example of a basic structure of a CPM, which consists of an ITS protocol data unit header and the actual CPM. The management container and station data container contain the information related to the 1TS-S generating the CPM. They may include, among others, the position, speed, and heading of the transmitting 1TS-S. The sensor information container (SIC) includes details about the on-board object-detection sensors in the transmitting 1TS-S, sensor types (e.g. radar, lidar, camera or a sensor fusion system), ranges, aperture angles and fields of view, etc. The perceived objects containers (POC) describe the dynamic state andproperties of the objects detected by the transmitting ITS-S. In other words, the POCs contain a list of the relevant objects Each POC includes relevant attributes of one object, e.g., ID of the object, ID of the sensor(s) that detected it, detection time, relative position and speed, dimensions, and other data. Some fields within the POC, such as distances and speeds, include not only the value of the component but also the confidence associated with it, e.g., a confidence value. A single CPM can include up to 255 POCs. Multiple POCs could report information about the same detected object but obtained with different sensors. Alternatively, the sensed information of the object could also be fused and reported in a single POC. The first approach reduces the computational needs and processing delays at the transmittingvehicle but may increase the channel load and processing needs at the receiver. Finally, other containers, such as the free space addendum, may contain free space areas detected by the transmitting ITS-S, i.e., the free area around the vehicle.
[0076] For each CPM, the inclusion or not of optional containers relies on a set of generation rules defined for each type, aiming to reduce the channel load while focusing on reporting relevant changes in the dynamic environment. The CPM generation rules define how often a CPM is generated by the transmitting vehicle and which information (detected objects and sensors information) is included in the CPM. The transmission interval of CPM messages or time between consecutive CPM generations may be limited to a value between 100 ms and 1 s. The lower value is means that a vehicle may transmit CPM messages 10 times a second in maximum, while the upper value means that at least one CPM message is transmitted per second even if no objects are detected. The transmitting ITS-S may check regularly (e.g., every 100ms) if the environment has changed and it is necessary to generate and transmit a new CPM. If it is, the vehicle may decide the objects that should be included in the CPM according to the CPM generation rules. A vehicle may generate a new CPM if it has detected a new object, or any of preset conditions are satisfied for any of the previously detected objects (such as the time elapsed since the last time the object was included in a CPM exceeds 1 s. Sensor information may be sent every 1 s.
[0077] Fig. 5 shows a flow diagram illustrating an exemplary process of generating a CPM message. One or more sensors 51, 52, 53 mounted on ITS station are providing raw sensor data as a result of their measurements. A measurement is performed cyclically, depending on the sensor type. This data is specific to a sensor type (e.g. reflexions, time of flight, point clouds, camera image, etc.). In embodiments, the raw sensor data may include a list of objects as detected by themeasurement of the sensor. The detection mechanisms and data processing capabilities 54, 55, 56 are specific to a sensor. After each measurement, the computed state of each detected object may be provided in an object list that is specific to the timestamp of the measurement. The raw data or sensor object lists may be forwarded to a data (sensor) fusion mechanism 57 or directly to a CPM generation block 58 (as illustrated by dashed arrows in Fig.5). In the latter case, multiple POCs could report information about the same detected object but obtained with different sensors. In the example of Fig. 5, a data fusion mechanism 57 provides a list of objects that are currently perceived by the 1TS-S and forwards it to the CPM generation block. In this case, the sensed information of a specific object from different sensors may be fused and reported in a single POC. In the CPM generation block 58, a CPM message may be generated based on CPM generation rules, e.g. as described above. For example, an object may be included in a CPM message based on its type, position, speed, heading, and time since its last inclusion in a CPM. If a CPM is generated, it is passed to the lower layers of the C-1TS protocol stack and broadcasted over the wireless channel to the other C-ITS-Ss within range, as illustrated by a CPM transmission block 59.
[0078] The confidence values in the CPM represent the reliability or certainty of the information being shared about detected objects. More specifically, the confidence value may represent the absolute accuracy of the measured value, in other words, how close the measured value is to a standardized or known value. The confidence value is provided with a certain confidence level, such as 95 %. For example, when a vehicle detects an object using its sensors and shares this information via a CPM, it includes a confidence value that indicates the accuracy of the detection. Factors influencing this confidence value can include sensor quality, environmental conditions, and the distance to the detected object.
[0079] A receiving ITS station receives CPMs from transmitting ITS stations. These messages contain information about objects detected by the transmitting station’s sensors, along with associated confidence values. The receiving ITS station may integrate the received data with its own sensor data in a data fusion process. Confidence values play a crucial role in this process by indicating the reliability of the transmitted information. Higher confidence values mean the data is more likely to be accurate and reliable and can be given more weight during the fusion process. For example, if multiple CPMs report the same object with high confidence, the receiving 1TS-S may weight this object more prominently. Alternatively, the receiving ITS station can use a confidence value for data filtering bysetting a threshold for the confidence value and rejecting data with a confidence value below the threshold. This can help filtering out unreliable data at the receiving 1TS-S. As a further alternative, confidence values may be used to help in prioritizing which CPMs to process first, especially in scenarios with high communication traffic. Messages with higher confidence values are processed with higher priority to ensure that the most reliable information is used promptly. The receiving ITS station may update its information (e.g., model) about the local environment based on the fused data. The updated information about the local environment can be used in decision-making processes in the receiving 1TS-S, such as path planning, collision avoidance, and adaptive cruise control. Confidence values ensure that decisions are based on the most reliable and accurate information available, enhancing the safety and efficiency of the ITS. Thus, by effectively utilizing confidence values, receiving ITS stations can assess the reliability of the received data and improve their perception of the environment, leading to safer and more efficient transportation systems.
[0080] An aspect of the invention is to further increase accuracy of a collective perception and facilitate detecting unreliable or faulty sensor information, so that external sources can be better trusted, especially in poor or harsh weather conditions.
[0081] According to a first aspect of the invention, vehicle mounted ITS stations, e.g., OBUs, are arranged to transmit extended CPM messages to the ITS infrastructure for enabling the ITS infrastructure to assess the reliability or sufficiency of their environment perception capabilities, particularly the sensor operation. An ITS station mounted on a vehicle is called a vehicle ITS-station herein. The extended CPM message may be a CPM message having an extension providing information about a known stationary landmark. A known stationary landmark is called a reference landmark herein. For example, an extended CPM message may include an extension in form of a perceived object container POC for providing information about a reference landmark, in addition to or instead of POCs providing information about other perceived objects. Extended CPM messages may be broadcast to and received by all V2X stations in a normal manner, but the extension of the extended CPM message may be addressed to and read by an ITS infrastructure station only. Other parts (e.g., POCs) of extended CPM messages may be read by other receiving V2X stations in a normal manner.
[0082] Basically, a reference landmark may be any distinct structure along a road or like travelling route which is known to an ITS infrastructure entityperforming the reliability assessment. Examples of reference landmarks may include traffic signs, lamp posts, camera posts, weather stations, sign portals or larger traffic signs crossing the road, and other kind of road infrastructure landmarks or distinct roadside landmarks. As a further example, a reference landmark may be a radar reflector. Radar reflectors are designed to strongly reflect radar waves back to a receiving antenna. They may be used to mark poorly reflecting objects to produce a strong echo signal. A reference landmark may be specially designed and provided for the purposes of the present invention. For example, a reference landmark may be a radar reflector configured to provide a reflection that imitates an object in a certain object class, such as pedestrian, behind of a car, behind of a motorcycle, behind of a truck, behind of a van, etc.
[0083] In embodiments, information about a nearby reference landmark and / or need for sending an extended CPM message may be provided in advance to vehicles on digital maps which are stored on the vehicles.
[0084] In embodiments, a vehicle may send an extended CPM message preferably only when a vehicle is in an area where there is such a reference landmark or checkpoint. In embodiments, a vehicle may send an extended CPM message preferably only when a vehicle is within a certain measurement distance from a reference landmark or checkpoint. Thereby, unnecessary sending of extended CPM messages and unnecessary load on the data transfer bandwidth can be avoided.
[0085] In embodiments, certain reference measurement areas associated to reference landmarks may be defined in advance and provided to vehicles, e.g., on digital maps. The certain reference area may be defined in various ways, e.g., by coordinates of corner points of such a reference area. A landmark or landmarks perceived within such a reference measurement area may be included in extended messages sent by the vehicles.
[0086] In embodiments, a vehicle approaching a reference measurement area and / or a reference landmark may start sending extended messages to an ITS infrastructure entity at a certain distance before the reference measurement area and / or the reference landmark and stop sending extended messages after the vehicle has passed by the reference measurement area and / or the reference landmark.
[0087] In embodiments, an extended CPM message is sent at regular intervals also in the case that no reference object is detected. In that case the perceived object information in an extension portion of the extended CPM message isnull.
[0088] In embodiments, referring to Fig.6, a vehicle with an ITS station approaching the known stationary reference object may collect information of its environment using the onboard environment sensor or sensors (e.g., sensors 320 in Fig. 3) (step 60) and share it using the collective perception messages (CPM) in a conventional manner (step 61), e.g., by means of OBU 30 as described above.
[0089] The vehicle ITS may further check whether there is need to transmit extended CPM messages in the present location (step 62). For example, the vehicle ITS may determine based on digital map data whether it is located within a predefined reference measurement area or approaching such area or a predefined reference landmark and has not yet passed by the reference measurement area and / or the reference landmark. If there is no need to transmit extended CPM messages, the procedure may return to step 60.
[0090] If extended CPM messages need to be transmitted, the vehicle ITS may check whether the reference landmark is detected (step 63), and if the reference landmark is detected, the vehicle ITS may transmit object information about the reference landmark in extended CPM messages (step 64). In embodiments, the vehicle ITS may transmit extended CPM messages at regular intervals, e.g., at intervals of 1 s. In embodiments, an extended CPM message is sent at regular intervals also in the case that no reference object is detected (steps 65 and 66). In that case the perceived object information in the message is null.
[0091] According to a second aspect of the invention, an ITS station is provided in the ITS infrastructure to carry out the reliability assessment according to the invention. Such ITS station is called an infrastructure ITS station (1TS-S) herein. The infrastructure 1TS-S may be any entity having a reliability assessment capability or unit according to embodiments of the invention in the ITS infrastructure. The infrastructure 1TS-S may be, for example, an ITS roadside unit RSU (e.g., RSU1 and RSU2 in Fig. 1) or an ITS application server or an ITS application cloud server (e.g., server 10 in Fig. 1), an edge server, a server co-located with RSU, etc. In preferred embodiments, the infrastructure 1TS-S may be an edge server co-lo-cated with RSU or multiple RSUs in the same geographical area.
[0092] The infrastructure 1TS-S receives extended CPM messages from vehicle ITS stations of vehicles approaching and / or passing by a known stationary reference landmark (step 70 in Fig. 7). An extended CPM message contains perceived object information about the known stationary reference landmark, if such reference landmark is perceived by the transmitting vehicle ITS station. Inembodiments, an extended CPM message may contain no perceived object information about the known stationary reference landmark, i.e., the perceived object information is null, if no reference landmark is perceived by the transmitting vehicle ITS station. The infrastructure 1TS-S station will assess a reliability or sufficiency of the perceived object information received in the extended CPM messages by comparing the perceived object information about the reference landmark to reference object information of the reference landmark stored in a data storage of the infrastructure 1TS-S (step 71 in Fig. 7). The location of stationary reference landmark is known to the infrastructure 1TS-S. The infrastructure 1TS-S receives the vehicle's speed, location, and direction (e.g., a station data block) in each CPM message even if the CPM message does not contain any POCs. The infrastructure 1TS-S station may conclude from this information that the vehicle ITS should detect the reference landmark from a predetermined distance (e.g., at a specific location and at a specific time). If the extended CPM message does not contain reference object detection information (e.g., the extension is null) for a specific vehicle location area or reference measurement area, the infrastructure 1TS-S may conclude that the reference landmark has not been detected.
[0093] In embodiments, if the perceived object information received from a certain vehicle ITS station is not reliable or sufficient based on the assessment (step 72 in Fig. 7), the infrastructure 1TS-S may send or broadcast a notification message to other vehicle ITS stations that the shared environment data received from the specific vehicle ITS station may not be reliable or sufficient or can-notbe trusted (step 73). Alternatively, or additionally, the infrastructure 1TS-S may send to the specific vehicle ITS station a notification message indicating that the perceived object information provided at the specific vehicle ITS station may not be reliable or sufficient for controlling vehicle (step 74). In embodiments, the infrastructure 1TS-S may send to the specific vehicle ITS station a notification that commands or causes a vehicle control system of the vehicle to perform a control action to limit or stop an automated or assisted driving mode or lower a speed of the vehicle. In embodiments, the infrastructure 1TS-S may send to the specific vehicle ITS station a notification that will urge a driver through a user interface to limit or stop the automated or assisted driving mode or lower the speed of the vehicle.
[0094] Reference object data on the known reference landmarks may be collected in various ways. In embodiments, test vehicle(s) having high-accuracy sensors are driven past the targets from different directions, and the objectdetection data / sensor data sent from the vehicle(s) are collected to form reference object data. In embodiments, the ITS infrastructure may collect object detection messages received from high capability vehicles in the normal traffic and create the reference object data or model based on perceived object data received over time. In the traffic environment, there may be vehicles moving with several different sensor combinations and systems that can collect and send data (e.g. a LiDAR sensor, radar, or a combination of a camera and a LiDAR sensor or a radar). High accuracy high-end sensors that can adaptto different weather conditions are able to produce usable and reliable data for a significantly longer period of time to support autonomous driving, while low accuracy low-cost sensor solutions lose their ability to deliver earlier. Therefore, their object detection data is suitable for creating reference data for reliability assessment of the ITS infrastructure side. The ITS infrastructure may continuously update or fine tune the reference object data or model with new detection data received from the selected vehicles. In embodiments, the reference object data may be in form of reference tables. The collected data may contain, for example, weather information, road state information, position, driving direction, driving speed, position of and distance to detected objects in the vehicle coordination. The reference data / model may include, for example, a reference detection distance of a target, possibly in different weather conditions, another kind of distance-dependent visibility / reflectivity value. The comparison of instantaneous object detections or sensor data is compared with the reference data may indicate that the sensors of the vehicle do or do not detect the target early enough, e.g., at a given distance, or at all.
[0095] After the assessment is made vehicles that have sent their data may be sent an assessment of the sufficiency of the vehicle's sensor data, e.g., to continue autonomous driving. For example, the infrastructure may inform the vehicle that the sensor system is not working adequately and cannot be trusted. For example, the radar sensor or camera may be partly blocked by dirt or snow. In embodiments, a control system of the vehicle may automatically switch off the vehicle automation, which is based on the malfunctioning or low-quality sensors, and optionally inform the changed driving mode and the cause to the driver of the vehicle. The driver of the vehicle may then make further decisions how to proceed with autonomous, automated or manual driving. Alternatively, the driver may manually switch off a vehicle automation after the vehicle has informed the driver about the malfunctioning or low-quality sensors. For example, an autonomous driving mode of a vehicle may be switched to manual driving mode requiring a human driver. Forexample, the relevant functions of a driver assistance system (DAS) of the vehicle that are relying on the malfunctioning or low-quality sensors may be switched off (e.g., an adaptive cruise control). As still further examples, the infrastructure may deny the permission of the automated vehicle to drive in the autonomous driving mode. The vehicle may have to switch to a manual driving mode, to stop, or to exit from the specific road. In embodiments, the infrastructure may send a message to other vehicles in the area to inform about unreliable or faulty data sources. Thereby, receiving vehicle can know which data sources can be trusted and ignore the unreliable and faulty ones. This enables vehicles to operate more effectively in adverse weather compared to relying solely on vehicle’s own sensors.
[0096] In embodiments, the infrastructure may send a message to other vehicles in the area to inform that a certain data source is reliable or trusted again and can be used as normally.
[0097] In embodiments, the infrastructure may store in a database, e.g. in a vehicle registration database of a traffic authority, information that an autonomous or assisted driving mode is not allowed for the specific vehicle.
[0098] In embodiments, the infrastructure may store in an ITS database information that the specific vehicle is not to be trusted.
[0099] In embodiments, the information that the vehicle is not to be trusted may be associated with the information on the current weather or road conditions that may temporarily cause decreased performance of sensor systems of vehicles. For example, in certain weather or road conditions, snow may stick to sensors and temporarily block or disturb their operation. The temporal malfunction of sensors may end when the conditions improve or the sensors are cleaned, without any need for service or new inspection. The information on weather or road conditions may be obtained from roadside weather stations, weather information service providers, and / or vehicle ITS stations, for examples
[0100] In embodiments, the ITS database or the database of a traffic authority may be updated with information that the specific vehicle can be trusted again and / or that an autonomous or assisted driving mode is allowed for the specific vehicle again, when the specific vehicle next time successfully passes the reliability assessment by the infrastructure, and / or a test in a car service and / or a vehicle inspection, and / or the weather or road conditions have improved from the weather or road conditions associated with the information that the specific vehicle is not to be trusted.
[0101] In embodiments, the infrastructure may send the reference datato the vehicles in the area, and the vehicles may carry out the comparison of its own sensor data with the reference data in order to verify that the own sensor data can be trusted.
[0102] In embodiments, the infrastructure 1TS-S (e.g., a Misbehaviour Authority, MA) may define the specific vehicle ITS station as an untrusted or misbehaving station in a database, e.g., add the specific vehicle station on a list of untrusted or misbehaving stations (“a blacklist”). In embodiments, the specific vehicle can be defined trusted again or removed from the “blacklist”, when the specific vehicle next time successfully passes the reliability assessment by the infrastructure, and / or a test in a car service and / or a vehicle inspection.
[0103] In embodiments, the assessment results on unreliable data sources (vehicles) may be sent to a traffic management centre TMC. TMC may take advantage of this information e.g. to see if the weather affects heavily to capabilities of vehicles. Based on the information, TMC may perform a traffic control action to adapt to the situation, e.g., lower the speed limit.
[0104] In embodiments, a vehicle ITS station, upon receiving from the ITS infrastructure a notification message indicating that the perceived object information received from a certain vehicle ITS station is not reliable or sufficient for use in controlling the vehicle (step 80 in Fig. 8), discards or rejects the perceived object information received from the certain vehicle ITS station (step 81).
[0105] In embodiments, a vehicle control system of a vehicle with a vehicle ITS mounted (e.g., the vehicle control system 34 in Fig. 3) performs, in response to receiving the notification message (step 90 in Fig. 9), a control action to stop sharing the perceived object information with to other vehicle ITS stations, to limit or stop an automated or assisted driving mode or lower a speed of the vehicle, and / or to urge a driver of the vehicle through a user interface to limit or stop the automated or assisted driving mode or lower the speed of the vehicle (step 91) .
[0106] In embodiments, the reference object information includes a predetermined reference distance of a vehicle from the reference landmark. The predetermined reference distance may be defined as a minimum distance at which the reference landmark shall be detected. Similarly, the perceived object information received in extended CPM messages may include information that directly or indirectly indicates a distance from a vehicle to the known stationary reference landmark at a time of perception.
[0107] In embodiments, the infrastructure 1TS-S may compare the distance obtained based on the received extended CPM message to the predeterminedreference distance. The infrastructure ITS-S may conclude that the perceived object information received from a specific vehicle ITS station is not reliable or sufficient, if the known stationary reference landmark is detected at a distance less than the predetermined reference distance based on the comparison. In embodiments, the infrastructure ITS may, in response to the conclusion, send or broadcast the notification message to the specific vehicle ITS station and / or to other vehicle ITS stations receiving shared perception data from the specific vehicle ITS station. In embodiments, if the known stationary reference landmark is detected at a distance more than or equal to the predetermined reference distance based on the comparison, the infrastructure ITS-S may conclude that the perceived object information received from a specific vehicle ITS station is reliable or sufficient. In alternative embodiments, even if the known stationary reference landmark is detected at a distance more than or equal to the predetermined reference distance, the infrastructure ITS-S may assess the reliability based on further criterium or criteria, for example based on confidence values, type (class) of the reference landmark, etc., as will be described in exemplary embodiments below. In embodiments, the distance and the one or more further criteria may be applied in different order. In embodiments, the distance and the one or more further criteria may be applied parallel in the reliability assessment, so that the perceived object information received from a specific vehicle ITS station is not considered reliable or sufficient, if any one of the criteria is not met.
[0108] In embodiments, the predetermined distance may vary dependent on a road class, a road speed limit, a road environment, a road weather type and / or other conditions. For example, on a motorway environment and / or at higher speeds (e.g., 100 km / h or 120 km / h speed limit) the predetermined reference distance may be relatively long (e.g., longer or equal to 150 m, 120 m, or 100 m) while in urban areas and / or at lower speeds (e.g., less or equal to 80 km / h, 60 km / h or 50 km / h speed limit) the predetermined reference distance may be shorter (e.g., between 40 m and 80 m, more preferably between 40 m to 60 m). Similarly, the reference landmark may have different predetermined reference distances for different types of road environment or road weather conditions. Examples of different types of road environment or road weather conditions may include generally lighting conditions (e.g., daylight, dark at night), a terrain / road state, and a rain state. The rain state may include different forms of rain, e.g. one or more of following states: no rain, rain, light rain, moderate rain, heavy rain, snowfall, sleet, hail, etc. The terrain / road conditions may include different forms of road states,e.g. one or more of following states: a dry road, a wet road, a snowy road, an icy road, and so on. The infrastructure 1TS-S may then select the reference distance used according to a current type of road environment or road weather. The current type of road environment or road weather may be obtained from one or more sources, e.g., weather service providers, road weather service providers, road weather stations, road environment or road weather reported by vehicle ITS stations or other infrastructure ITS stations.
[0109] In embodiments, reference object information comprises further reference object information detected at the predetermined reference distance from the known stationary reference landmark.
[0110] In embodiments, perceived object information in the extended CPM message includes at least one confidence value associated with the perception of the known stationary reference landmark. As explained above, confidence values may represent the reliability or certainty of the information being shared about detected objects. More specifically, a confidence value may represent the absolute accuracy of the measured value (e.g., a distance), in other words, how close the measured value is to a standardized or known value. Similarly, reference object information at the infrastructure 1TS-S performing the reliability assessment may include at least one reference confidence value for a perception of the known stationary reference landmark. Such reference confidence value(s) may be used to define confidence value limit(s) or confidence value range(s). In embodiments, the infrastructure ITS station may conclude that the perceived object information received from the transmitting vehicle ITS station is not reliable or sufficient based on the assessment, if the at least one confidence value in the extended CPM messages is lower than the at least one reference confidence value. In embodiments, the received information may be concluded to be not reliable or sufficient based on the assessment, if the at least one confidence value in successive extended CPM messages varies in a predetermined manner.
[0111] In embodiments, perceived object information in the extended CPM message includes a perceived type (or class) of the known stationary reference landmark. For example, the perceived type may be one of a truck, a van, a passenger car, a motorcycle, a bicycle, etc. Similarly, reference object information at the infrastructure 1TS-S performing the reliability assessment may include an actual type of the known stationary reference landmark. For example, the reference landmark may be a radar reflector that returns a reflection of a motorcycle, and therefore the reference type would be a motorcycle. In embodiments, theinfrastructure ITS station may conclude that the perceived object information received from the transmitting vehicle ITS station is not reliable or sufficient based on the assessment, if the perceived type in the extended CPM message (e.g., a passenger car) does not match with the reference type (e.g., a motorcycle)
[0112] In embodiments, perceived object information in the extended CPM message may include one or more of a time of perception of the known stationary reference landmark, a position of the vehicle at the time of perception, a size of the reference landmark, dimensions of the reference landmark, shape of the reference landmark, and information about a sensor system which originated the perceived object information. This information may be utilized in addition to or instead of any other information utilized in other embodiments.
[0113] In embodiments, reference object information comprises different sets of reference object information for (two or more) different types of road environment or road weather conditions. The infrastructure ITS-S selects the reference object information set used for the assessment according to a current road environment or road weather condition. Examples of different types of road environment or road weather conditions may include generally lighting conditions (e.g., daylight, dark at night), a terrain / road state, and a rain state. The rain state may include different forms of rain, e.g. one or more of following states: no rain, rain, light rain, moderate rain, heavy rain, snowfall, sleet, hail, etc. The terrain / road conditions may include different forms of road states, e.g. one or more of following states: a dry road, a wet road, a snowy road, an icy road, and so on. The infrastructure ITS-S may then select the reference distance used according to a current type of road environment or road weather. The current type of road environment or road weather may be obtained from one or more sources, e.g., weather service providers, road weather service providers, road weather stations, road environment or road weather reported by vehicle ITS stations or other infrastructure ITS stations.
[0114] In embodiments, different sets of reference object information for different types of road environment or road weather conditions comprise sled references. There may be separate sled reference tables for different types of weather that affect the detection performance of the sensors, e.g. fog, snow / sleet, rain. For each weather type there may be different visibility levels (e.g., nor-mal / weak / poor).
[0115] In embodiments, the infrastructure ITS-S may create the reference object information at least partially based on perceived object information of(extended) CPM messages received from one or multiple vehicle ITS stations mounted on one or multiple vehicles when the vehicle(s) pass by the known stationary reference landmark. In embodiments, the reference object information is preferably created based on information from vehicle ITS stations whose confidence values associated with the perceptions that meet a preset confidence value limit. In other words, environment information from vehicle ITS station(s) having perception sensor systems of high enough accuracy or quality may be selected and used to create the reference object information. The information from vehicle ITS station(s) having perception sensor systems of lower accuracy or quality is discarded from creation of the reference object information. Sufficiency of accuracy or quality of sensor systems may also be determined based on the sensor information received in CPM messages. Vehicles have several different sensor combinations or sensor systems that can collect and send data, e.g., a LiDAR sensor or a combination of a camera and a LiDAR sensor. High accuracy sensors that can adapt to different weather conditions are able to produce usable and reliable data for a significantly longer period of time to support autonomous driving, while low accuracy sensor solutions lose their ability to deliver earlier. Thus, the high accuracy sensors can be used to set reference levels or limits to a larger vehicle population, especially in harsh environments.
[0116] In embodiments, the infrastructure 1TS-S may create the reference object information at least partially based on perceived object information received from one or more predetermined measurement ITS stations with high-quality high-end sensor systems mounted on one or more vehicles. The measurement ITS stations may be specially assigned for this purpose, i.e., for producing high-quality perceived object information while moving on roads and passing by known stationary reference landmarks.
[0117] In embodiments, instead of or in addition to the CPM messages received from one or multiple vehicle ITS stations, the infrastructure 1TS-S may create the reference object information using data from the road infrastructure, such as road infrastructure sensor data, e.g., data from traffic cameras, traffic control centres, road weather stations, speed sensors, etc. Reference data may also be entered by road authorities or like operators, e.g., the predetermined detection distances, the type (class), size, dimensions, position of a reference landmark, speed limits, road class, etc.
[0118] In embodiments, the infrastructure 1TS-S may create different reference distances or different sets of reference object information for (two ormore) different types of road environment or road weather conditions. The different reference distances or different sets of reference object information may be created based on information from the infrastructure or one or more vehicle ITS stations, but now the reference information is assigned to different sets depending on current road environment or road weather conditions in which the information is obtained. The current type of road environment or road weather may be obtained from one or more sources, e.g., weather service providers, road weather service providers, road weather stations, or from road environment or road weather reported by vehicle ITS stations or other infrastructure ITS stations.
[0119] In embodiments, reference object information may dynamically change with time according to perceived object information received from one or more vehicle ITS station with sensor system of high accuracy or quality. As result, the reference object information may closely follow the short-term variations in road environment or road weather conditions. In embodiments, the reference object information may be based on measurements of one or few latest vehicles with high-accuracy sensors system which have passed by the known stationary reference landmark. In a most straightforward implementation, the reference object information is based on measurements of one (e.g., the latest) vehicle with a high-accuracy sensor system.
[0120] Embodiments of the invention can be used for testing and approving the sensor systems of the vehicle, e.g., in a vehicle inspection or in a vehicle repair garage. The test area may be provided with one or more targets, and when a vehicle moves in the area, the vehicle sends detection or sensor data to a test system. If the vehicle does not detect the reference landmark as required, the vehicle fails the inspection. As a result, driving of the vehicle in an autonomous mode may be denied until the defects have been corrected.
[0121] Let us examine a principle and operation by means of exemplary use cases. In the examples, the infrastructure ITS station assessing the reliability or sufficiency of perception capability of vehicles is an ITS application server connected to the Internet, such the ITS visibility application server 10 illustrated in Fig.1.
[0122] In the first example, an exemplary process of the assessing a reliability or sufficiency of perception capability of vehicles without taking the influence of weather into account (e.g., under good weather conditions) will be described referring to a flow chart illustrated in Fig. 10. The roadside unit RSU 1 receives extended CPM messages with V2X communication from vehicles A and Bapproaching a known stationary reference landmark, such as reference landmark REF shown in Fig. 1. In addition to a basic content CPM message content, the extended CPM messages contain additional perceived object information about the reference landmark REF, if the reference landmark REF is perceived by the vehicles A and B. CPM messages or relevant content thereof are routed to and received by the remote ITS visibility application server 10 (step 100 in Fig. 10). The perceived object information includes at least one confidence value associated with the perception of the reference landmark REF as well as information that directly or indirectly indicates a distance from a vehicle to the known stationary reference landmark at a time of perception. In embodiments, the vehicle may send a list of the perceived object(s) with its (their) coordinates. In embodiments, the vehicle may send coordinates of the perceived known stationary reference landmark and coordinates of the vehicle at the time of perception, and the server 10 may derive the distance based on the coordinates. In embodiments, the vehicle may send a relative position of the perceived known stationary reference landmark to the position of the vehicle (e.g., distance, spatial orientation, relative angle(s)) at the time of perception. The server 10 may compare the perceived object information about the reference landmark REF received from the vehicles A and B with reference object information of the reference landmark REF stored in the server 10 (step 101). The reference object information has been detected at a predetermined reference distance from the reference landmark REF. The reference distance may define that the reference landmark REF shall be detected at least at the distance required for safe driving (e.g., the required braking distance), depending on the speed limit of the road or type of the road or the road environment, for example. Further, the reference object information stored in the server 10 may include at least one preset reference confidence value limit set for an accepted perception of the reference landmark REF. The reference distance and / or confidence value limit may be predefined by a local road authority, for example. In the example, let us assume that the road class is a motorway with a speed limit 120 km / h, and the reference distance is set to 150 m. Thus, the server 10 concludes that the reference landmark REF is appropriately perceived and detected, if the reference landmark REF is detected at 150 m or longer distance with confidence value which is the preset confidence value limit or higher (step 102). Let us assume that the vehicle A detects the reference landmark at a distance of less than 100 m (No from step 102). Consequently, the server 10 may broadcast, via roadside units RSU1 and RSU2, to all other vehicles B and C in the area that the CPM messages from the vehicle A cannot be trusted andshould be discarded (step 103). The server 10 may further inform, via the roadside unit RSU1, to vehicle A that its sensor system may not provide object detection in a manner that is sufficient for controlling the vehicle (step 104). On the other hand, if the server 10 concludes based on the reliability / visibility assessment that the vehicle B perceives the reference landmark REF at a sufficient distance (Yes from step 102), no further actions are required.
[0123] In the second example, an exemplary process of the assessing a reliability or sufficiency of perception capability of vehicles taking the influence of weather into account (i.e., under harsh or poor weather conditions) will be described. In this example the vehicles A and B carry out the perception in poor, visibility impairing weather conditions. Let us also assume that the vehicle A is equipped with low-cost sensors (e.g., a low-cost LiDAR) while the vehicle B is equipped with high-end sensors (e.g., a high-end LiDAR and a gated camera system). In other words, the vehicle B may be equipped with high-end sensors having better accuracy, quality and / or performance than the low-cost sensors of the vehicle A. Again, the roadside unit RSU1 receives extended CPM messages with V2X communication from vehicles A and B approaching a known stationary reference landmark, such as reference landmark REF shown in Fig. 1. In addition to a basic content CPM message content, the extended CPM messages contain additional perceived object information about the reference landmark REF, if the reference landmark REF is perceived by the vehicles A and B. The perceived object information may include at least one confidence value associated with the perception of the reference landmark REF as well as information that directly or indirectly indicates a distance from a vehicle to the known stationary reference landmark at a time of perception. The extended CPM messages also include information about sensor used for the perception. The server 10 compares the perceived object information about the reference landmark REF received from the vehicles A and B with reference object information of the reference landmark REF stored in the server 10 in a similar manner as in the first example. Again, the reference object information may include a reference distance and at least one reference confidence value limit preset for an accepted perception of the reference landmark REF. The confidence value limit may be defined by a local road authority, for example. In embodiments, the server 10 may be arranged to update the reference object information in real-time with the perceived object information provided by vehicles with high-quality high-end sensors, such as the vehicle B. Thus, it may be said, the server 10 compares the perceived object information from the vehicle A with the perceived objectinformation from the vehicle B to assess the reliability of the real-time information provided by high-end vehicles passing by the reference landmark. Thereby, the reference information will vary with road and weather conditions. This may improve the accuracy of the reliability assessment, if traffic of vehicles with high-end sensors is heavy enough for the updated reference values to follow the changes in the conditions. In all embodiments, the object detection performance of a vehicle A equipped with low-cost sensors deteriorates significantly more than that of the better-equipped vehicle B in poor weather conditions. For example, in poor weather conditions on a motorway, a better-equipped vehicle B can see reference points at a distance of 100 meters, while a poorly equipped vehicle can only see them at a distance of 50 meters. In this case, the road operator may, for example, reduce the variable speed limit on the motorway to 80 km / h, allowing the better equipped vehicle B to continue driving automatically, but forcing the poorer equipped vehicle A to stop automatic driving.
[0124] In the third example, an exemplary process of the assessing a perception capability of vehicles at a vehicle inspection station or at a vehicle repair garage will be described. The condition of the vehicle’s environment perception (particularly the condition of sensors systems) needs to be checked and accepted in a vehicle inspection carried out by authorities, or at a garage when the sensors have been repaired, irritate or replaced. Let us also assume that the reference landmark REF, and possibly also the roadside unit RSU1 are assigned to a vehicle inspection station or a garage. In embodiments a vehicle inspection station or a garage may have an associated test area with the assigned reference landmark REF for testing a long-range visibility of object detection systems of vehicles. The roadside unit RSU1 receives extended CPM messages with V2X communication from the vehicle A to be inspected and approaching the reference landmark REF. Extended CPM messages containing perceived object information about the reference landmark REF. The perceived object information includes at least one confidence value associated with the perception of the reference landmark REF as well as information that directly or indirectly indicates a distance from a vehicle to the known stationary reference landmark at a time of perception. The server 10 compares the perceived object information about the reference landmark REF received from the vehicle A with reference object information of the reference landmark REF stored in the server 10 in a similar manner as in the first example. In this example, the reference object information includes a reference distance and at least one reference confidence value limit set for an accepted perception of the referencelandmark REF.. The reference distance sets the minimum perception distance (e.g., 150 m) at which the reference landmark REF must be detected by a vehicle. The minimum perception distance may be different for different type of sensor systems, such as low-cost lower quality and high-end higher quality sensor systems. Thus, the server 10 concludes that the reference landmark REF is appropriately perceived and detected, and the vehicle A will pass the inspection, if the reference landmark REF is detected at the minimum perception distance (e.g., 150 m) or longer distance with a confidence value which is the confidence value limit or higher. On the other hand, the vehicle A will fail the inspection, if it detects the reference landmark at a distance shorter than the minimum perception distance, such as 100 m. The server 10 may send the result of the inspection to the vehicle, and / or a data system or a measuring device of the vehicle inspection station or the vehicle service garage or like.
[0125] The functionality of various ITS stations described herein may be implemented by various means. For example, these techniques may be implemented in hardware (one or more devices), firmware (one or more devices), software (one or more modules), or combinations thereof. For a firmware or software, implementation can be through modules (e.g., procedures, functions, and so on) that perform the functions described herein. The software codes may be stored in any suitable, processor / computer-readable data storage medium(s) or memory unit(s) and executed by one or more processors / computers. The data storage medium or the memory unit may be implemented within the processor / computer or external to the processor / computer, in which case it can be communicatively coupled to the processor / computer via various means as is known in the art. Additionally, components of systems described herein may be rearranged and / or complimented by additional components in order to facilitate achieving the various aspects, goals, advantages, etc., described with regard thereto, and are not limited to the precise configurations set forth in a given figure, as will be appreciated by one skilled in the art. For example, a hardware configuration of a server ITS station may include a communication interface unit, one or more processor units, and a computer readable tangible memory or database unit, and ITS functionalities of the server may be embodied by a software code stored in the memory unit and run in the processor unit(s).
[0126] The description and the related drawings are only intended to illustrate the principles of the present invention by means of examples. Various alternative embodiments, variations and changes are obvious to a person skilled inthe art on the basis of this description. The present invention is not intended to be limited to the examples described herein but the invention may vary within the scope and spirit of the appended claims.
Claims
CLAIMS1. A method for controlling reliability of a shared object perception data in a connected intelligent transport system (ITS), the connected ITS comprising an ITS infrastructure and vehicle ITS stations mounted on vehicles, wherein the vehicle ITS stations are capable of wirelessly communicating with each other and the ITS infrastructure and sharing information about their perceived environment by exchanging collective perception messages (CPM), each CPM message containing perceived object information about at least one object, if any, perceived by a transmitting vehicle ITS station, the method comprisingan infrastructure ITS station in the ITS infrastructure receives extended CPM messages from the transmitting vehicle ITS station mounted on a vehicle approaching a known stationary reference landmark, each extended CPM message containing additional perceived object information aboutthe known stationary reference landmark, if such reference landmark is perceived by the transmitting vehicle ITS station,the infrastructure ITS station assesses reliability or sufficiency of the perceived object information received from the transmitting vehicle ITS station by comparing the perceived object information aboutthe known stationary reference landmark to reference object information, andif the perceived object information received from the transmitting vehicle ITS station is not reliable or sufficient based on the assessment, the ITS infrastructure sends a notification message to the transmitting vehicle ITS station and broadcasts a notification message to other vehicle ITS stations, the notification message indicating that perceived object information from the transmitting vehicle ITS station is not reliable or sufficient.
2. The method as claimed in claim 1, wherein the infrastructure ITS station receives extended CPM messages from the vehicle ITS station only when the vehicle ITS station is within a certain measurement distance or measurement area associated with the known stationary reference landmark.
3. The method as claimed in claim 1 or 2, wherein the infrastructure ITS station receives extended CPM messages from the ITS station at regular intervals, and the perceived object information in an extension portion of the extended CPM message is null if no reference object is detected.
4. The method as claimed in any preceding claim 1-3, wherein the reference object information includes a predetermined reference distance of a vehicle from the known stationary reference landmark, and wherein the perceived object information in the extended CPM message includes information for determining a distance from the vehicle to the known stationary reference landmark at a time of perception.
5. The method as claimed in claim 4, wherein the reference object information comprises further reference object information detected at the predetermined distance from the known stationary reference landmark.
6. The method as claimed in claim 4 or 5, wherein the predetermined distance is dependent on a road class, a road speed limit, a road environment and / or a road weather type.
7. The method as claimed in any preceding claim 4-6, wherein the infrastructure ITS station concludes that the perceived object information received from the transmitting vehicle ITS station is not reliable or sufficient based on the assessment, if the known stationary reference landmark is detected at a distance less than the predetermined distance.
8. The method as claimed in any preceding claim 1-7, wherein the perceived object information in the extended CPM message includes at least one confidence value associated with the perception of the known stationary reference landmark, wherein the reference object information comprises at least one reference confidence value for the perception of the known stationary reference landmark, and wherein the infrastructure ITS station concludes that the perceived object information received from the transmitting vehicle ITS station is not reliable or sufficient based on the assessment, if the at least one confidence value in the extended CPM messages is lower than the at least one reference confidence value and / or the at least one confidence value in successively received extended CPM messages varies in a predetermined manner.
9. The method as claimed in any preceding claim 1-8, wherein the perceived object information in the extended CPM message includes a perceived class of the known stationary reference landmark, wherein the reference objectinformation comprises a reference class of the known stationary reference landmark, and wherein the infrastructure ITS station concludes that the perceived object information received from the transmitting vehicle ITS station is not reliable or sufficient based on the assessment, if the perceived class in the extended CPM messages does not match with the reference class.
10. The method as claimed in any preceding claim 1-9, wherein the perceived object information in the extended CPM message further includes one or more of following: a speed of the vehicle, a time of perception of the known stationary reference landmark, a position of the vehicle at the time of perception, a size of the reference landmark, dimensions of the reference landmark, shape of the reference landmark, class of the reference landmark, and information about a sensor system which originated the perceived object information.
11. The method as claimed in any preceding claim 1-10, further comprisingthe infrastructure ITS station creates the reference object information at least partially based on perceived object information of extended CPM messages received from one or multiple vehicle ITS stations mounted on one or multiple vehicles passing by the known stationary reference landmark, preferably from one or more vehicle ITS stations having confidence values associated with the perceptions that meet a preset confidence value limit.
12. The method as claimed in any preceding claim 1-11, further comprisingthe infrastructure ITS station creates the reference object information at least partially based on perceived object information of extended CPM messages received from one or more predetermined measurement ITS with high-quality sensor systems mounted on one or more vehicles passing by the known stationary reference landmark.
13. The method as claimed in any preceding claim 1-12, wherein reference object information comprises different sets of reference object information for two or more road environment or road weather conditions, and wherein the infrastructure ITS station selects the reference object information set used according to a current road environment or weather condition.
14. The method as claimed in any preceding claim 1-13, wherein the known stationary reference landmark, and optionally also the infrastructure ITS station, is associated with a vehicle inspection station or a vehicle service garage or like, and the infrastructure ITS concludes whether an object perception capability of the vehicle will meet inspection requirements, preferably set in the reference object information, or not, and wherein the infrastructure ITS station sends a result of the conclusion to the transmitting vehicle ITS station, a data system of the vehicle inspection station or the vehicle service garage or like, and / or to a measuring device of the vehicle inspection station or the vehicle service garage or like.
15. The method as claimed in any preceding claim 1-14, wherein the notification message sent to the transmitting vehicle station indicates that the perceived object information provided by the transmitting vehicle ITS station is not reliable or sufficient for controlling vehicle, or commands a vehicle control system of the vehicle to perform a control action to limit or stop an automated or assisted driving mode or lower a speed of the vehicle and / or to urge a driver through a user interface to limit or stop the automated or assisted driving mode or lower the speed of the vehicle.
16. The method as claimed in any preceding claim 1-15, wherein the known stationary reference landmark comprises a distinct road infrastructure landmark or a distinct roadside landmark or a radar reflector, wherein preferably, the radar reflector is configured to provide a reflection of an object in a certain object class.
17. An infrastructure intelligent transport system (ITS) station for a connected intelligent transport system (ITS), the connected ITS comprising an ITS infrastructure and vehicle ITS stations mounted on vehicles, wherein the vehicle ITS stations are capable of wirelessly communicating with each other and the ITS infrastructure and sharing information about their perceived environment by exchanging collective perception messages (CPM), each CPM message containing perceived object information about at least one object, if any, perceived by a transmitting vehicle ITS station, the infrastructure ITS station comprising communication unit receiving messages from and sending messages to and from vehicle ITS station directly or via one or more other infrastructure ITSstations,a memory storing data,and one or more processors controlling the memory and the communication unit, the one or more processors are configured to cause the infrastructure ITS to perform the method as claimed in any one of claims 1-16.
18. The infrastructure ITS station as claimed in claim 17, wherein the infrastructure ITS station comprises one of an ITS roadside unit or an ITS application server or an ITS application cloud server, an edge server, an edge server colocated with an ITS roadside unit, and an edge server co-located with two or more ITS roadside units in the same geographical area.
19. A method in a vehicle intelligent transport system (ITS) station in a connected intelligent transport system (ITS), the connected ITS comprising an ITS infrastructure and vehicle ITS stations mounted on vehicles, wherein the vehicle ITS stations are capable of wirelessly communicating with each other and the ITS infrastructure, the method comprisingthe vehicle ITS station mounted on a vehicle shares information about its perceived environment by transmitting collective perception messages (CPM), each CPM message containing perceived object information about at least one object, if any, perceived by the vehicle ITS station,the vehicle ITS station mounted on the vehicle approaching a known stationary reference landmark additionally transmits an extended CPM message to the ITS infrastructure, the extended CPM message containing additional perceived object information about the known stationary reference landmark, if such reference landmark is perceived by the vehicle ITS station, andthe vehicle ITS station receives from the ITS infrastructure, in response to one or more transmitted extended CPM messages, a notification message indicating that the perceived object information from the vehicle ITS station is not reliable or sufficient for controlling the vehicle.
20. The method as claimed in claim 19, wherein the vehicle ITS station transmits extended CPM messages only when the vehicle ITS station is within a certain measurement distance or measurement area associated with the known stationary reference landmark.
21. The method as claimed in claim 19 or 20, wherein the vehicle ITS station transmits extended CPM messages at regular intervals, and the perceived object information in an extension portion of the extended CPM message is null if no reference object is detected.
22. The method as claimed in any preceding claim 19-21, wherein the vehicle ITS station obtains information about the vehicle being approaching the stationary reference landmark and / or about a need for transmitting an extended CPM message from a digital map provided in advance to the vehicle and stored on the vehicle.
23. The method as claimed in any preceding claim 19-22, further comprisinga vehicle control system of the vehicle performs, in response to the notification message, a control action to stop sharing the perceived object information with to other vehicle ITS stations, to limit or stop an automated or assisted driving mode or lower a speed of the vehicle, and / or to urge a driver of the vehicle through a user interface to limit or stop the automated or assisted driving mode or lower the speed of the vehicle.
24. A vehicle intelligent transport system (ITS) station for a connected intelligent transport system (ITS), the connected ITS comprising an ITS infrastructure and vehicle ITS stations mounted on vehicles, wherein the vehicle ITS stations are capable of wirelessly communicating with each other and the ITS infrastructure and sharing information about their perceived environment by exchanging collective perception messages (CPM), each CPM message containing perceived object information about at least one object, if any, perceived by a transmitting vehicle ITS station, the vehicle ITS station comprisingcommunication unit receiving messages from and sending messages to the ITS infrastructure,a memory storing data,and one or more processors controlling the memory and the communication unit, the one or more processors are configured to cause the vehicle ITS station to perform the method as claimed in any one of claims 19-23.
25. A connected intelligent transport system (ITS), comprisingan ITS infrastructure with the infrastructure ITS station as claimed any one of claims 17-18, andvehicle ITS stations as claimed in claim 24.
26. A method in a vehicle intelligent transport system (ITS) station in a connected intelligent transport system (ITS), the connected ITS comprising an ITS infrastructure and vehicle ITS stations mounted on vehicles, wherein the vehicle ITS stations are capable of wirelessly communicating with each other and the ITS infrastructure, the method comprisingthe vehicle ITS station mounted on a vehicle receives collective perception messages (CPM) transmitted from at least one other vehicle ITS station, each CPM message containing perceived object information about at least one object, if any, perceived by the transmitting at least one other vehicle ITS station,the vehicle ITS station receives from the ITS infrastructure a notification message indicating that the perceived object information received from a certain vehicle ITS station is not reliable or sufficient for use in controlling the vehicle, and the vehicle ITS station discards or rejects the perceived object information received from the certain vehicle ITS station.
27. A vehicle intelligent transport system (ITS) station for a connected intelligent transport system (ITS), the connected ITS comprising an ITS infrastructure and vehicle ITS stations mounted on vehicles, wherein the vehicle ITS stations are capable of wirelessly communicating with each other and the ITS infrastructure and sharing information about their perceived environment by exchanging collective perception messages (CPM), each CPM message containing perceived object information about at least one object, if any, perceived by a transmitting vehicle ITS station, the infrastructure ITS station comprisingcommunication unit receiving messages from and sending messages to the ITS infrastructure,a memory storing data,and one or more processors controlling the memory and the communication unit, the one or more processors are configured to cause the vehicle ITS station to perform the method as claimed in claim 26.
