Procedure for determining the applicability of a vehicle driver profile in relation to a traffic sign

Abstract

The invention relates to a method (100) for determining the applicability of a driver profile of a vehicle (1) in relation to a traffic sign (8), comprising the following steps: - Providing (101) sensor data, wherein the sensor data result from a measurement of at least one sensor of the vehicle (1), - Providing (102) the driver profile, wherein the driver profile includes at least one characteristic relating to a driver (2) of the vehicle (1), - Detecting (103) the traffic sign (8) in the sensor data, - Analyzing (104) the detected traffic sign (8) to determine the applicability of at least one characteristic of the driver profile in relation to the detected traffic sign (8). Furthermore, the invention relates to a computer program, a device and a storage medium for this purpose.

Description

[0001] The invention relates to a method for determining the applicability of a vehicle's driver profile with respect to a traffic sign. Furthermore, the invention relates to a computer program, a device, and a storage medium for this purpose. State of the art

[0002] Modern driver assistance systems can be capable of recognizing both traffic signs and any additional signs. Many driver assistance solutions also offer the ability to control the vehicle's driving behavior based on the information provided by the traffic sign and any additional signs. For example, the speed can be adjusted when a speed limit sign is detected, or entry into an area marked with a no-stopping sign, or stopping or parking in a no-stopping or no-parking zone can be prevented.

[0003] For many traffic signs, including possible supplementary signs, it can be trivial to decide whether the traffic sign applies to the vehicle or not. For example, if a supplementary sign specifies a time period or a vehicle type, the driver assistance system can check the current time or vehicle type and decide whether the traffic sign applies or not. Disclosure of the invention

[0004] The subject matter of the invention is a method having the features of claim 1, a computer program having the features of claim 8, a device having the features of claim 9, and a computer-readable storage medium having the features of claim 10. Further features and details of the invention emerge from the respective subclaims, the description, and the drawings. Features and details described in connection with the method according to the invention naturally also apply in connection with the computer program according to the invention, the device according to the invention, and the computer-readable storage medium according to the invention, and vice versa, so that with regard to the disclosure of the individual aspects of the invention, reference is or can always be made to each other.

[0005] The invention particularly relates to a method for determining the applicability of a driver profile of a vehicle with respect to a traffic sign, comprising the following steps: - Providing sensor data, wherein the sensor data result from a measurement of at least one sensor of the vehicle, - Providing the driver profile, wherein the driver profile comprises at least one characteristic relating to a driver of the vehicle, - Detecting the traffic sign in the sensor data, - analyzing the detected traffic sign to determine the applicability of the at least one characteristic of the driver profile with respect to the detected traffic sign.

[0006] In simple terms, applicability therefore refers to the at least one characteristic being applicable to the traffic sign. For example, the traffic sign, or a part of the traffic sign such as an additional sign, can describe an exception that applies to the at least one characteristic. For example, a certain area can only be accessible to drivers with a certain membership, such as employees of a company. In this case, this membership can be the at least one characteristic of the driver profile. The method can thus advantageously support the driver of the vehicle in recognizing the special regulations through traffic signs that match the driver profile. The driver profile can also additionally include at least one characteristic of another passenger in the vehicle.The driver profile with the at least one characteristic can be stored and / or managed, for example, in a database in an on-board computer of the vehicle or on a server to which the vehicle has access. The sensor data can be or include image data, for example, and the sensor can be a camera, for example. The detection of the traffic sign can indicate the general presence of a traffic sign in the sensor data, or a type of traffic sign can be determined, for example, based on a classification. It is conceivable that the analysis to determine applicability is carried out by classifying the sensor data. It is also conceivable that a database of known traffic signs is used for this purpose, or that text on the traffic sign is semantically analyzed for its meaning.State-of-the-art machine learning models and methods, such as a neural network, can be used for classification. The analysis result can, for example, indicate whether or not the at least one characteristic is applicable to the traffic sign.

[0007] According to an advantageous development of the invention, the method can further comprise the following step: - Detecting an additional sign of the traffic sign in the sensor data.

[0008] The analysis of the detected traffic sign can be performed taking into account the detected additional sign. The additional sign can contain additional information, such as that only members of a specific organization are allowed access. This can advantageously be used to determine the applicability of the driver profile to the traffic sign based on the additional information provided by the additional sign.

[0009] Furthermore, it can be provided within the scope of the invention that the method further comprises the following step: - Initiating a message to the driver of the vehicle to alert the driver of the vehicle to the detected traffic sign.

[0010] The output can be initiated depending on the result of analyzing the detected traffic sign. The message can be output to the driver visually or acoustically, for example, and describe the detected traffic sign. This allows the driver to react advantageously based on the detected traffic sign and, for example, decide whether further travel is permitted or prohibited. Furthermore, the message to the driver can advantageously include an alternative route, for example, if a certain area is prohibited according to the detected traffic sign.

[0011] Advantageously, the invention may provide that the method further comprises the following step: - Initiating a capture of an input from the driver to update at least one characteristic of the driver profile or to add an additional characteristic to the driver profile based on the captured input.

[0012] Initiating the capture of the input can be performed depending on the result of analyzing the detected traffic sign, particularly if the result of the analysis indicates that at least one characteristic is not applicable to the traffic sign. For example, the detected traffic sign could indicate that access is only permitted for employees of a company. Accordingly, in this example, the driver's input can be used to determine whether the driver is an employee of this company, and this characteristic is subsequently added to the driver profile or an existing entry regarding the driver's occupation is updated.It can also be provided that the driver's input is captured at any time, for example, when creating the driver profile, in order to update at least one characteristic of the driver profile or to add an additional characteristic to the driver profile. The input can be captured, for example, via a keyboard or a microphone.

[0013] It may be provided within the scope of the invention that the method further comprises the following step: - initiating a detection of a confirmation by the driver in order to determine, on the basis of the detected confirmation, the applicability of the at least one characteristic of the driver profile with respect to the detected traffic sign.

[0014] Initiating the capture of the confirmation may be performed depending on the result of analyzing the detected traffic sign, particularly if the result of the analysis indicates that at least one characteristic is not applicable to the traffic sign. An example of this would be the driver confirming that they have access to an area related to the detected traffic sign. For example, the area could be a hospital, and the driver confirms that they are visiting a relative, and in this case, access is permitted. The confirmation may be captured, for example, via a keyboard or a microphone.

[0015] Preferably, within the scope of the invention, the method may further comprise the following step: - Initiating a control of the vehicle depending on a result of the analysis and / or on a meaning of the detected traffic sign.

[0016] The control could, for example, include braking the vehicle. In the case of at least partially automated driving, the vehicle can, for example, leave an area to which the vehicle has no access according to the detected traffic sign. The detected traffic sign can first be analyzed to determine its meaning so that the control can then be carried out depending on the meaning. The meaning can, for example, be a no-stopping zone. The control can also be a regular onward journey of the vehicle. This can be provided, for example, if the at least one characteristic is applicable to the traffic sign and thus the vehicle is permitted to enter a certain traffic area, for example.

[0017] For example, it may be provided that the at least one characteristic is selected from a list comprising: - an address of the driver, - a driver's membership, - a disability of the driver.

[0018] Membership can, for example, be affiliation with an organization, a company, or a club. Furthermore, it is conceivable that the at least one characteristic is a destination of the vehicle, which is determined, for example, based on the vehicle's navigation system.

[0019] It is possible for the method according to the invention to be used in a vehicle. The vehicle can be designed, for example, as a motor vehicle and / or passenger vehicle and / or an at least partially automated vehicle. The vehicle can have a vehicle device, for example, for providing an at least partially automated driving function and / or a driver assistance system. The vehicle device can be designed to control and / or accelerate and / or decelerate and / or steer the vehicle at least partially automatically.

[0020] The sensor data can, for example, comprise image data resulting from capture with a camera sensor. In this case, an environment and / or a traffic scene can be represented by the values ​​of image points, preferably pixels, of the image data. By classifying and preferably classifying images on the basis of these values, objects in the environment and / or the traffic scene, in particular the traffic sign, can be detected. The classification and image classification can also be provided in the form of semantic segmentation (i.e., pixel- or area-wise classification) and / or object detection. The image data can, for example, be images from a radar sensor and / or an ultrasonic sensor and / or a LiDAR sensor and / or a thermal imaging camera. Accordingly, the images can also be embodied as radar images and / or ultrasonic images and / or thermal images and / or LiDAR images.

[0021] The invention also relates to a computer program, in particular a computer program product, comprising instructions that, when executed by a computer, cause the computer to carry out the method according to the invention. Thus, the computer program according to the invention provides the same advantages as those described in detail with reference to a method according to the invention.

[0022] The invention also relates to a data processing device configured to carry out the method according to the invention. The device can be, for example, a computer that executes the computer program according to the invention. The computer can have at least one processor for executing the computer program. A non-volatile data memory can also be provided, in which the computer program is stored and from which the computer program can be read by the processor for execution.

[0023] The invention may also provide a computer-readable storage medium that contains the computer program according to the invention and / or includes instructions that, when executed by a computer, cause the computer to carry out the method according to the invention. The storage medium is designed, for example, as a data storage device such as a hard disk and / or a non-volatile memory and / or a memory card. The storage medium can, for example, be integrated into the computer.

[0024] Furthermore, the method according to the invention can also be implemented as a computer-implemented method.

[0025] Further advantages, features, and details of the invention will become apparent from the following description, which describes embodiments of the invention in detail with reference to the drawings. The features mentioned in the claims and in the description may be essential to the invention individually or in any combination. They show: Fig. 1 a schematic visualization of a method, a vehicle with a driver, a device, a storage medium and a computer program according to embodiments of the invention, Fig. 2 a schematic representation of a system according to embodiments of the invention, Fig. 3 a schematic representation of a method according to embodiments of the invention.

[0026] In Fig.1, a method 100, a vehicle 1 with a driver 2, a device 10, a storage medium 15 and a computer program 20 according to embodiments of the invention are schematically shown.

[0027] Fig.1 shows in particular an embodiment of a method 100 for determining the applicability of a driver profile of a vehicle 1 with respect to a traffic sign 8. In a first step 101, sensor data is provided, wherein the sensor data result from a measurement of at least one sensor 3 of the vehicle 1. In a second step 102, the driver profile is provided, wherein the driver profile comprises at least one characteristic relating to a driver 2 of the vehicle 1. In a third step 103, the traffic sign 8 is detected in the sensor data. In a fourth step 104, the detected traffic sign 8 is analyzed to determine the applicability of the at least one characteristic of the driver profile with respect to the detected traffic sign 8.

[0028] There may be situations in which the applicability of traffic sign 8 depends on factors that do not relate to vehicle 1 itself, but rather to the driver 2 and / or other passengers of vehicle 1. Examples of this include traffic sign 8 indicating "No entry", "No stopping", and "No parking". Traffic sign 8 itself or parts of traffic sign 9, such as possible additional signs, may provide additional information. Some examples of such additional information include references to exceptions for residents of an area, for people with certain disabilities, or for visitors, customers, or members of an establishment.

[0029] According to embodiments of the present invention, human feedback such as an input or confirmation and / or a previously created driver profile is used to confirm whether a traffic sign 8, and possibly also an additional sign, is applicable to a vehicle 1, a driver 2, or another passenger of the vehicle 1. Based on the feedback, the vehicle 1 can continue its journey or suggest an alternative route.

[0030] As in Fig.2, the system 9, according to exemplary embodiments, can comprise a sensor 3 for monitoring the road and for detecting traffic signs 8, including additional signs 11. Furthermore, the system 9 can have a computing device 4 for processing the sensor signals and a device 5 for outputting a message, for example as an acoustic and / or visual representation of the recognized traffic sign 8 and for interacting with the driver 2 in order to capture feedback, i.e. in particular an input or confirmation. In addition, a further computing device 6 for controlling the vehicle 1 and a memory 7 for storing the driver profile can be provided. The logical blocks of sensor 3 and computing device 4 can be integrated into a common physical unit. Likewise, the logical blocks of the computing device 4 and the further computing device 6 can be integrated into a common physical unit.The memory 7 can be integrated together with the computing device 4 and / or the further computing device 6, or it can be an external memory, for example a mobile phone of the driver 2 or a cloud-based solution.

[0031] Fig.3 describes a method according to exemplary embodiments using a flowchart. In a first step 201, the system 9 monitors, in particular, the road ahead and detects traffic signs 8 with possible additional signs 11. For the sake of simplicity, it can be assumed that the system 9 has already excluded cases in which applicability can be decided based on the information available in the parameter set of the vehicle 1 or on the communication bus. In a next step 202, the system 9 preferably collects relevant information from the driver profile. Such information can include, among other things, the address of the driver 2, membership in an organization, or disabilities of the driver 2. In a further step 203, an algorithm analyzes, in particular, the detected traffic sign 8 to determine a type of exception and compare it with the driver profile.This allows a check to be made as to whether the applicability of traffic sign 8 can be determined based on the available information. Some examples of such matches are listed in the table below. If the applicability can be determined, which is represented by the corresponding path j for yes, the algorithm preferably proceeds to a further step 204. Otherwise, which is represented by the corresponding path n for no, it jumps, for example, to a further step 206. Exception type as indicated on the road sign and / or additional sign Driver profile information Exception for residents / members Address or membership Exception for people with disabilities disability Exception for visitors / customers / deliveries Destination Exception for drivers with authorization Approval type or membership

[0032] In step 204, the algorithm uses in particular the information about traffic sign 8 and the applicability determined in steps 201 to 203 and decides whether vehicle 1 may continue driving. If forward travel is permitted for vehicle 1, the algorithm preferably jumps to a further step 208, represented by the corresponding path j for yes, and continues driving. If forward travel is not permitted for vehicle 1, the algorithm jumps in particular to a further step 205, represented by the corresponding path n for no. In step 205, the vehicle offers, for example, an alternative route. In step 206, the algorithm preferably requests input from driver 2, which is subsequently recorded. The driver can further confirm whether or not traffic sign 8 is applicable to their vehicle 1, or to driver 2 or another passenger of vehicle 1.In step 207, the algorithm preferably updates the driver profile with the detected input or confirmation from driver 2. In step 208, vehicle 1 continues driving as usual.

[0033] The above explanation of the embodiments describes the present invention exclusively by way of examples.

[0034] Of course, individual features of the embodiments can be freely combined with one another, provided that this is technically reasonable, without departing from the scope of the present invention.

Claims

[1] Method (100) for determining an applicability of a driver profile of a vehicle (1) with respect to a traffic sign (8), comprising the following steps: - Providing (101) sensor data, wherein the sensor data result from a measurement of at least one sensor (3) of the vehicle (1), - providing (102) the driver profile, wherein the driver profile comprises at least one characteristic relating to a driver (2) of the vehicle (1), - detecting (103) the traffic sign (8) in the sensor data, - analyzing (104) the detected traffic sign (8) to determine the applicability of the at least one characteristic of the driver profile with respect to the detected traffic sign (8). [2] Method (100) according to claim 1, characterized by , that the method (100) further comprises the following step: - detecting an additional sign (11) of the traffic sign (8) in the sensor data, wherein the analysis (104) is carried out taking into account the detected additional sign (11) of the traffic sign (8). [3] Method (100) according to claim 1 or claim 2, characterized by , that the method (100) further comprises the following step: - initiating the output of a message to the driver (2) of the vehicle (1) in order to draw the driver (2) of the vehicle (1)'s attention to the detected traffic sign (8), wherein the initiation of the output is performed depending on a result of the analyzing (104). [4] Method (100) according to one of the preceding claims, characterized by , that the method (100) further comprises the following step: - initiating a detection of an input by the driver (2) in order to update the at least one characteristic of the driver profile or to add an additional characteristic to the driver profile based on the detected input, wherein the initiation of the acquisition of the input is carried out depending on a result of the analysis (104), in particular if the result of the analysis (104) indicates that the at least one characteristic is not applicable to the traffic sign (8). [5] Method (100) according to one of the preceding claims, characterized by , that the method (100) further comprises the following step: - initiating a detection of a confirmation by the driver (2) in order to determine the applicability of the at least one characteristic of the driver profile with respect to the detected traffic sign (8) on the basis of the detected confirmation, wherein the initiation of the detection of the confirmation is carried out depending on a result of the analysis (104), in particular if the result of the analysis (104) indicates that the at least one characteristic is not applicable to the traffic sign (8). [6] Method (100) according to one of the preceding claims, characterized by that the method (100) further comprises the following step: - initiating a control of the vehicle (1) depending on a result of the analysis (104) and / or on a meaning of the detected traffic sign (8). [7] Method (100) according to one of the preceding claims, characterized by that at least one characteristic is selected from a list comprising: - an address of the driver (2), - a driver's membership (2), - a disability of the driver (2). [8] Computer program (20) comprising instructions which, when the computer program (20) is executed by a computer (10), cause the computer (10) to carry out the method (100) according to one of the preceding claims. [9] Device (10) for data processing, which is arranged to carry out the method (100) according to one of claims 1 to 7. [10] A computer-readable storage medium (15) comprising instructions which, when executed by a computer (10), cause the computer (10) to carry out the steps of the method (100) according to any one of claims 1 to 7.

Images