Method for determining whether a vehicle is traveling in the wrong direction, as well as an electronic wrong-way driving detection assistance system.

Abstract

The invention relates to a method for determining whether a vehicle (11) is traveling in the wrong direction when the vehicle (11) travels in a lane (6, 7, 8) of a roadway (5) in a prohibited direction, comprising the following steps: - Providing position information of at least the vehicle (11) based on a digital environment map to an evaluation unit (13); - Providing image information of the vehicle's surroundings (11) to the evaluation unit (13), wherein the image information is captured with a front camera (14) of the vehicle (11) or a surround view camera system (15) of the vehicle (11); - Analysis of the image information to determine whether a traffic sign (9, 10) with a characteristic was captured; - If a characteristic of the traffic sign (9, 10) has been detected, determine whether a wrong-way driving has occurred depending on the characteristic and the position information.

Description

[0001] One aspect of the invention relates to a method for determining whether a vehicle is traveling in the wrong direction, wherein wrong-way driving is characterized by the vehicle traveling in a lane of a roadway in a prohibited direction. Another aspect of the invention relates to an electronic wrong-way driving detection assistance system for a vehicle. A further aspect of the invention relates to a vehicle with such an assistance system.

[0002] Driving in a lane in a direction that is prohibited and therefore not permitted by law is a regular occurrence in road traffic. For example, such wrong-way driving occurs on roads with at least two lanes in one direction. These roads include highways and expressways with multiple lanes in one direction. Wrong-way driving often occurs due to driver inattention or can also result from a driver being overwhelmed and momentarily disoriented. Such wrong-way driving can create highly critical traffic situations that can lead to serious accidents.

[0003] A method and a control and recording device for verifying the plausibility of a wrong-way driving by a motor vehicle are known, for example, from DE 10 2014 221 675 A1. Furthermore, a corresponding method and system are known from US 2014 / 0354454 A1.

[0004] Although it is known from the state of the art that a multi-information-based approach is possible, only very unstructured approaches to such multi-information-based methods are provided there.

[0005] The object of the present invention is to create a method and an electronic wrong-way driving detection assistance system in which, or with which, a multi-information-based analysis can be carried out in a more needs-based manner, so that wrong-way driving can be detected safely and reliably.

[0006] This task is solved by a procedure and an assistance system in accordance with the independent claims.

[0007] One aspect of the invention relates to a method for determining whether a vehicle is traveling in the wrong direction. Such wrong-way driving is characterized by a vehicle traveling in a lane of a roadway in a prohibited direction. The method comprises, in particular, the following steps: - In particular, providing position information, at least of the vehicle, to an evaluation unit based on a digital map of the surroundings; - In particular, providing image information of the vehicle's surroundings to the evaluation unit, whereby the image information is captured with a front camera of the vehicle or a surround-view camera system of the vehicle; - In particular, analysis of the image information to determine whether a traffic sign with a characteristic was captured; - In particular, if a characteristic of the traffic sign has been recorded, determine whether a wrong-way driving has occurred, depending on the characteristic and the position information.

[0008] Such a procedure, which uses different pieces of information for the assessment and thus employs a multi-information-based assessment scenario, utilizes very specific, diverse information that is specifically related and linked in such a way as to enable a highly reliable and safe assessment of wrong-way driving. In this context, it is particularly advantageous that the image information is provided by specific optical detection units of the vehicle. By providing corresponding image information via the front camera, and due to its intended forward-facing direction, i.e., in front of the vehicle in the direction of travel, a very specific correlation of the information to the precise location of the captured environmental information relative to the vehicle can be established.The same applies, additionally or instead, to a vehicle's surround-view camera system. This allows for a more precise assessment, particularly in conjunction with a potentially detected traffic sign, especially one with a specific characteristic that is clearly indicative of wrong-way driving. Specifically, if the image captures such a characteristic indicating wrong-way driving, and the sensor used to generate this image is known, this correlation allows for a relatively clear determination of whether or not wrong-way driving has occurred.In particular, a statement can then be made as to where the vehicle is and how the vehicle is located and / or moving in relation to this traffic sign with the characteristic, so that, depending on this, a very safe and reliable conclusion can be drawn about wrong-way driving.

[0009] Therefore, such a proposed scenario is also very advantageous with regard to the information used for analysis and evaluation. In particular, it enables a very rapid assessment.

[0010] In one embodiment, the determination process involves combining the position information with the traffic sign's characteristic indicating wrong-way driving. Wrong-way driving is then detected based on the result of this combination. In particular, such a combination is a linking process, as exemplified above.

[0011] In one embodiment, the camera's detection direction, as determined by the provided image information, is taken into account during the data combination. Depending on this, the vehicle's orientation and / or direction of travel, particularly relative to the traffic sign, can be determined. Based on this, it can then be recognized whether the vehicle is driving the wrong way.

[0012] It is possible to capture the reverse side of the traffic sign as a characteristic feature. This can be done very reliably and unambiguously. This is because traffic signs typically have no symbol, informative markings, or other indications on the reverse side, where no traffic information is intended to be displayed. However, in one embodiment, at least one, and in particular several, mounting elements may be attached to this reverse side. These can be detected very reliably and accurately when evaluating the image information. Therefore, not only these, but also, in one embodiment, mounting brackets for attaching the traffic sign to a signpost can be detected.Since such fastening devices are usually only present on the back, particularly to avoid obscuring or distorting the information to be displayed on the front, a very clear identification of the back is possible. This is especially true if, in addition to or instead of the back, a support pole or mounting rod of the traffic sign is also detected in the image information, positioned in front of the actual traffic sign, thus supporting the conclusion that the back side is captured in the image information.

[0013] In another embodiment, it is possible that information indicating that driving in that direction is not permitted is provided on the front of the traffic sign. In such an embodiment, where the informative front of the traffic sign is then captured with the image information, a corresponding conclusion can be drawn as to whether or not wrong-way driving has occurred.

[0014] In one embodiment, the analysis of image information is performed using computer vision. Computer vision, also known as computer-based vision, refers to methods and / or systems that can recognize and process objects in digital still or moving images. In particular, this computer vision utilizes a neural network. This network can be a component of the wrong-way driving detection assistance system. It is also possible to combine deep learning with classical machine learning. Specifically, computer vision also performs an assessment to determine whether a wrong-way driving situation has occurred. In particular, information can then be provided regarding whether measures should be taken. Recommendations can also be issued in this regard.Computer-based vision allows for the recognition and understanding of content-related image information.

[0015] In one embodiment, when a wrong-way driving maneuver is detected, an acoustic and / or visual message is output to a vehicle user via a display unit. This provides informative notification of such a detected wrong-way driving maneuver. This allows a driver to be informed very quickly and unambiguously, so that a wrong-way driving maneuver is made known to the driver very quickly and the driver can react accordingly.

[0016] In one embodiment, a haptically perceptible signal is output to a vehicle unit when a wrong-way driving maneuver is detected. This vehicle unit could be, for example, the vehicle's steering mechanism. Alternatively, or in addition to a steering mechanism, a vehicle unit could also be, for example, a vehicle seat.

[0017] In one embodiment, when a wrong-way driving maneuver is detected, the vehicle's hazard warning lights are activated by a wrong-way driving detection system. Additionally, or instead, the vehicle's headlights can be activated by a wrong-way driving detection system to generate a visual warning pattern. This advantageously provides improved visual warning to road users traveling in the correct, permitted direction of travel that a wrong-way vehicle is approaching.

[0018] In one embodiment, when a wrong-way driving maneuver is detected, the vehicle's speed is automatically reduced to a limit speed by a wrong-way driving detection assistance system. Preferably, the speed is automatically reduced by this assistance system in a situation-adaptive manner, and in particular, relatively quickly. In this context, it is also possible for the wrong-way driving detection assistance system to detect the surroundings, particularly with at least one detection unit, and reduce the speed as needed depending on the detected environment, especially to the limit speed or lower. It is also possible for the assistance system to intervene in the vehicle's steering mechanism, at least semi-autonomously.In particular, this allows the vehicle to be brought at least semi-autonomously, and especially fully autonomously, into a recognized safe area of ​​the road, so that the potential disruption to traffic caused by the wrong-way vehicle can at least be significantly reduced.

[0019] In this context, it is also advantageous that information about the detected wrong-way driving of the vehicle is automatically transmitted to an external traffic control unit by the wrong-way driving detection system. This allows for an automated warning to be issued to other road users. It is also possible, for example, that the number and / or locations of other vehicles on the road are known and transmitted to the wrong-way driving detection system, particularly depending on position information.

[0020] Depending on this information, the wrong-way driving detection assistance system can then reduce the speed limit accordingly and / or determine a route for the vehicle that allows it to maneuver into a safe area of ​​the road, either in terms of time and / or location. This minimizes the impact on other road users as much as possible.

[0021] In one embodiment, when a wrong-way driving maneuver is detected, a wrong-way driving alert is generated by the vehicle's wrong-way driving detection assistance system and sent to an external unit. This alert can inform other road users, particularly by issuing warnings. An external unit can be another vehicle or a traffic management system server. If another vehicle is close to the wrong-way vehicle, for example, if it is traveling on the same route, critical traffic situations can be better avoided. Specifically, communication between the vehicle and the external unit can be facilitated by a vehicle-to-vehicle communication system.

[0022] Another aspect of the invention relates to an electronic wrong-way driving detection assistance system for a vehicle. This assistance system comprises at least one evaluation unit. The assistance system includes at least one front camera and / or a surround-view camera system. The wrong-way driving detection assistance system is configured to carry out a method according to the above-mentioned aspect and an advantageous embodiment thereof. In particular, this method is carried out using this assistance system.

[0023] Another aspect of the invention relates to a vehicle with an electronic wrong-way driving detection assistance system.

[0024] Exemplary embodiments of the invention are explained in more detail below with reference to schematic drawings. These show: Fig. 1 a schematic representation of a traffic situation with an embodiment of a vehicle according to the invention, which has an embodiment of an electronic wrong-way driving detection assistance system according to the invention; Fig. 2. A schematic representation of a traffic sign with a rear view; and Fig. 3. A simplified representation of an information analysis for assessing a wrong-way driving incident.

[0025] In the figures, identical or functionally equivalent elements are given the same reference symbols.

[0026] In Fig. Figure 1 shows a schematic top view of a traffic situation 1. There is a first carriageway 2, which has one lane 3 and another lane 4. The two arrows indicate the intended or permitted directions of travel for vehicles on these lanes 3 and 4. Fig. 1 marked for further understanding. Furthermore, in Fig. Figure 1 shows another carriageway 5. In this embodiment, it also has two lanes 6 and 7. Arrows are shown there as well, intended only for symbolic representation and understanding, to indicate the permitted directions of travel. Thus, both carriageways 2 and 5 each have at least two lanes, dictating travel in the same direction. In the example, Fig. Lane 1 also shows exit 8, which allows traffic to leave lane 5. Lanes 2 and 5 could, for example, represent a motorway or a multi-lane expressway.

[0027] In the exemplary embodiment, a traffic sign 9 is shown only in sketch form and thus as an example of its design and location, and is positioned to the side of exit 8. Additionally or instead of this, another traffic sign 10 may be provided. This is also shown, by way of example, positioned to the side of exit 8 and carriageway 5. Other traffic signs are also possible, which extend at least partially above and over carriageway 6 and / or 7.

[0028] Furthermore, in the exemplary embodiment according to Fig. Figure 1 shows a vehicle 11. The vehicle 11 preferably has an electronic wrong-way driving detection assistance system 12. This system, in particular, has at least one evaluation unit 13. The evaluation unit 13 can be a control unit or a component of a control unit. Furthermore, in the exemplary embodiment, the vehicle 11 has a front camera 14. This is preferably arranged in the interior of the vehicle 11. It can, for example, be positioned so that its detection range extends through a windshield of the vehicle 11 and, in particular, captures an area of ​​the vehicle 11's surroundings located in front of the vehicle 11 in the direction of travel. Additionally or instead, the vehicle 11 can also have a surround-view camera system 15. This is represented here only symbolically by the box shown.

[0029] The wrong-way driving detection assistance system 12 is preferably configured to perform a procedure for determining whether the vehicle 11 is driving in the wrong direction. In particular, this procedure preferably includes the following steps: - Providing position information of at least vehicle 11 based on a digital environment map to an evaluation unit 13; - Providing image information of the environment of the vehicle 11 to the evaluation unit 13, wherein the image information is captured with a front camera 14 of the vehicle 11 or a surround view camera system 15 of the vehicle 11; - Analysis of the image information to determine whether a traffic sign 9, 10 with a characteristic was captured; - If a characteristic of traffic sign 9, 10 has been detected, determine whether wrong-way driving has occurred, depending on the characteristic and the position information.

[0030] At the in Fig. In example 1, vehicle 11 is moving in the direction of travel according to arrow P. This means that wrong-way driving is occurring, or could occur on lane 5 if vehicle 11 continues to move in this wrong direction.

[0031] The process generates a combined result, particularly by combining position information with at least one characteristic. A wrong-way driving maneuver is detected based on this result. In the process described in Fig. In the example shown, traffic sign 9 has a front side 9a facing vehicle 11. In particular, the front side 9a can contain a legally intended indication that further travel in this direction is not permitted. This characteristic can be recognized in the present case by the front camera 14.

[0032] If this traffic sign 9 is not present and / or this information is not recognized on the front 9a, image information can also be generated from the traffic sign 11. This can be done in particular by the front camera 14 and / or the surround-view camera system 15. The traffic sign 10 is oriented such that a front 10a faces the road user who is traveling in the intended permitted direction of travel on lanes 6 and 7. A rear 10b of the traffic sign 10 faces away from this. However, this rear 10b faces the exit 8. This means that the vehicle 11, when traveling in direction P, will optically detect this rear 10b. This rear 10b represents a further embodiment of a characteristic of the traffic sign 10.

[0033] In this context, Fig. Figure 2 shows a schematic example of such a traffic sign 10. This sign features a traffic sign 10c, which already has the aforementioned front side 10a and back side 10b. Furthermore, a support pole 10d is provided, to which the traffic sign 10c is attached. Fastening units or retaining elements 10e are provided for this purpose. The number and location of these are by no means exhaustive. For example, they could be retaining brackets attached to the back side 10b that partially encircle the support pole 10b. Such fastening units 10e can be detected in the captured image data, particularly by computer vision. This also allows the back side 10b of the traffic sign 10c to be identified.If, while driving in the direction of arrow P, the front camera 14 detects the rear side 10b in the image information, this information can be used to conclude that the vehicle 11 is traveling in the wrong direction. This is because, since the front camera 14 detects the area in front of the vehicle 11 in the direction of travel of arrow P and thereby captures the rear side 10b, it can be concluded that this cannot or should not be the case, and therefore a wrong-way driving situation exists. In particular, the orientation of the vehicle 11 and / or the orientation and / or position of the exemplary traffic sign 10 can be used to conclude that a wrong-way driving situation exists.

[0034] In particular, this combination takes into account the camera's direction of capture, which determines the image information it provides. Based on this, the orientation of vehicle 11 and / or its direction of travel (P) relative to traffic signs 9 and / or 10 is determined, and it is then recognized whether a wrong-way driving situation has occurred. If a wrong-way driving situation is detected, an audible and / or visual message may be output to an output unit 16, particularly vehicle 11, and especially to a vehicle occupant.

[0035] In the event of a detected wrong-way driving maneuver, a haptically perceptible message can be issued to a vehicle unit, in particular a steering device and / or a vehicle seat, either additionally or instead of a visual warning. It is also possible that, in the event of a detected wrong-way driving maneuver, the hazard warning lights of the vehicle 11 equipped with the wrong-way driving detection system 12 are activated, and / or the headlights of the vehicle 11 equipped with the wrong-way driving detection system are activated to generate a visual warning pattern, for example, a specific illumination and / or flashing of the headlights. It is also possible that, in the event of a detected wrong-way driving maneuver, the speed of the vehicle 11 equipped with this wrong-way driving detection system 12 is automatically reduced to a limit speed.

[0036] In Fig.Figure 3 is a very simplified and schematic representation showing that position information 17, in particular from a digital environment map, and image information 18 from the front camera 14 and / or the surround-view camera system 15 are transferred to the evaluation unit 13. There, a data fusion or combination of this position information 17 and the image information 18 takes place.

[0037] A detected wrong-way driving incident can be indicated acoustically and / or visually at an output unit 16 and / or haptically at a mentioned vehicle unit. QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] DE 10 2014 221 675 A1

[0003] US 2014 / 0354454 A1

[0003]

Claims

[1] Method for determining a wrong-way driving of a vehicle (11), in which the vehicle (11) travels in a lane (6, 7, 8) of a roadway (5) in a prohibited direction of travel, comprising the following steps: - Providing position information of at least the vehicle (11) on the basis of a digital map of the surroundings to an evaluation unit (13); - Providing image information of the surroundings of the vehicle (11) to the evaluation unit (13), wherein the image information is captured by a front camera (14) of the vehicle (11) or an all-round view camera system (15) of the vehicle (11); - analyzing the image information to determine whether a traffic sign (9, 10) with a characteristic was detected; - If a characteristic of the traffic sign (9, 10) has been detected, determining whether a wrong-way has occurred depending on the characteristic and the position information. [2] Method according to claim 1, wherein the determining comprises combining the position information with the characteristic, and a wrong-way driving is detected depending on the combination result. [3] Method according to claim 2, wherein the combination takes into account the detection direction of the camera (14, 15) with which the provided image information was detected, wherein the orientation of the vehicle (11) and / or the direction of travel of the vehicle (11) to the traffic sign (9, 10) is determined as a function thereof, and it is detected as a function thereof whether a wrong-way is present. [4] Method according to one of the preceding claims, wherein a rear side (10b) of the traffic sign (9, 10) is detected as a characteristic. [5] Method according to one of the preceding claims, wherein the analysis of the image information is carried out by computer-based vision. [6] Method according to one of the preceding claims, wherein, when a wrong-way is detected, acoustic and / or optical information is output to a vehicle user at an output unit (16). [7] Method according to one of the preceding claims, wherein, when a wrong-way is detected, haptically perceptible information is output to a vehicle user on a vehicle unit, in particular on a steering device and / or a vehicle seat. [8] Method according to one of the preceding claims, wherein, when a wrong-way driving is detected, a hazard warning system of the vehicle (11) is activated with a wrong-way driving detection assistance system (12) of the vehicle (11) and / or headlights are activated with a wrong-way driving detection assistance system (12) of the vehicle (11) to generate an optical warning pattern. [9] Method according to one of the preceding claims, wherein, when a wrong-way is detected, a speed of the vehicle (11) is automatically reduced to a limit speed by a wrong-way detection assistance system (12) of the vehicle (11). [10] Method according to one of the preceding claims, wherein, when a wrong-way driving is detected, wrong-way driving information is generated by a wrong-way driving detection assistance system (12) of the vehicle (11) and is sent to an external unit. [11] Electronic wrong-way detection assistance system (12) for a vehicle (11), with an evaluation unit (16), with at least one front camera (14) of the vehicle or an all-round view camera system (15), wherein the wrong-way detection assistance system (12) is designed to carry out a method according to one of the preceding claims.

Images